Voice Observability

Connect a voice provider (Vapi, Retell) and get call logs as traces in Observe without any SDK instrumentation.

About

Voice agents are hard to debug. Conversations happen in real time, across multiple turns, and when something goes wrong you usually find out from a user complaint, not a log. Voice observability fixes this by pulling call logs from your voice provider into Observe automatically. No SDK or code changes needed. Connect a provider (Vapi, or Retell) using its API key and assistant ID, and every call shows up as a trace with its transcript, recording URLs, cost, and duration. From there you can run evaluations, set alerts, search, filter, and export, the same way you would with any other trace.


When to use

  • Visibility into voice agent calls: See all conversations for a voice agent in one project without adding SDK instrumentation.
  • Evaluate voice conversations: Run evals (quality, bias, adherence) on conversation spans from voice calls.
  • Alerts on voice metrics: Set monitors on voice project metrics and get notified when something degrades.
  • Transcripts and recordings for debugging: Access transcript and recording URLs from the trace view.
  • Multiple voice providers: Support for Vapi, Retell so you can monitor agents regardless of provider.

How to

Get provider credentials

From your voice provider’s dashboard, obtain:

  • API key
  • Assistant ID (or agent ID)

These are required when observability is enabled. Supported providers: Vapi, Retell.

Create an agent definition with observability

Go to the Agent definition section and click Create agent definition. Agent definition list

Fill in agent name, provider, and other required fields. The API key and Assistant ID are masked for security. Create agent definition form

Check Enable Observability. The API key and Assistant ID are required only if observability is enabled. Agent definition details

Click Create. You are redirected to the agent list where the new agent is now visible. Agent definition list with new agent

View call logs in Observe

Open the Projects tab. A project with the same name as your agent lists all call logs. Projects list

Open the project to see the voice observability table (calls with status, duration, cost). Voice observability table

Click a call to open the detail drawer (transcript, recording URLs, call data). Call log detail drawer

Update or disable observability

Click an agent definition to open the edit form. You can edit any field.

  • If you disable observability, the API key and Assistant ID become optional.
  • If you enable observability (or keep it on), API key and Assistant ID are required.

Agent with observability disabled

Agent with observability enabled

Supported providers


Next Steps

Was this page helpful?

Questions & Discussion