Skip to main content
Simforge integrates with popular LLM observability platforms to automatically trace your function calls. When configured, every SDK call is automatically logged to your connected services.

Available Integrations

Braintrust

Braintrust is an enterprise-grade platform for LLM evaluation, monitoring, and experimentation.

Setup

  1. Go to Settings > Integrations in the Simforge portal
  2. Click Connect on the Braintrust card
  3. Enter your API Key (starts with sk-)
  4. Click Test Connection to verify
  5. Click Save

What Gets Traced

When Braintrust is connected, each SDK call creates a span with:
  • Input: The function inputs you provided
  • Output: The parsed result from the LLM
  • Model and provider: Which LLM was used
  • Token usage: Input, output, and cached tokens
  • Metadata: Function ID, version ID, and Simforge trace ID
  • Tags: simforge and sdk-call

Viewing Traces

After making SDK calls, you can view spans in your Braintrust dashboard. The Simforge trace ID is included in the metadata for cross-referencing.

Langfuse

Langfuse is an open-source LLM observability platform that provides tracing, analytics, and prompt management.

Setup

  1. Go to Settings > Integrations in the Simforge portal
  2. Click Connect on the Langfuse card
  3. Enter your credentials:
    • Host: Your Langfuse host (e.g., https://cloud.langfuse.com or your self-hosted URL)
    • Public Key: Your Langfuse public key (starts with pk-lf-)
    • Secret Key: Your Langfuse secret key (starts with sk-lf-)
  4. Click Test Connection to verify
  5. Click Save

What Gets Traced

When Langfuse is connected, each SDK call creates a trace with:
  • Input: The function inputs you provided
  • Output: The parsed result from the LLM
  • Generation details: Model, token usage, and timing
  • Metadata: Function ID, version ID, and Simforge trace ID

Viewing Traces

After making SDK calls, you can view traces in your Langfuse dashboard. Each trace includes a direct link back to the corresponding trace in Simforge.

Managing Integrations

Updating Credentials

To update an integration’s credentials:
  1. Go to Settings > Integrations
  2. Click Update on the integration card
  3. Enter new credentials
  4. Click Save

Disconnecting

To disconnect an integration:
  1. Go to Settings > Integrations
  2. Click Disconnect on the integration card
  3. Confirm the disconnection
Disconnecting an integration stops future traces from being sent. Existing traces in the external service are not affected.

Organization Scope

Integrations are configured per organization. Each organization can have its own Langfuse and Braintrust credentials, allowing different teams to use their own observability accounts.