Fix My Agent

Fix My Agent reads a run once it’s finished and turns the calls in it into a short, ranked list of what’s going wrong, each with a recommendation for what to change. You don’t have to scroll through every transcript looking for a pattern yourself: it arrives already grouped, worst first, ready to hand off to an optimization once you’ve read through it.

Open it from a finished run

On a run’s results page, Fix My Agent sits next to the tabs rather than inside one of them. Click it to open a side panel that stays open alongside whichever tab you’re on, with a chevron to collapse it out of the way when you don’t need it.

The button only turns on once the run has enough to analyse: the run has to be completed, and it needs at least 15 connected calls behind it. A run still in progress, or one with fewer calls than that, leaves the button disabled, with a tooltip telling you which of the two is missing.

Generate the analysis

The first time you open the panel on a run, it’s empty: “There are no suggestions yet, click the refresh button to get suggestions.” Click refresh to run the analysis over the run’s calls. If it genuinely finds nothing worth flagging, it says so instead of manufacturing an issue to fill the space.

What a prioritised issue looks like

Each entry in the list is one issue, not one call. A run where a dozen calls fail the same way for the same reason surfaces as a single entry, not a dozen. Every entry carries:

• A short heading naming the issue
• A priority, high, medium, or low, so you know which to read first
• A written recommendation of what to change to address it
• The calls it’s drawn from. Click the entry and the calls grid on the page narrows to just those, so you can read the transcripts behind the pattern before you act on it

The list carries two counts: how many issues were found in total, and how many of those are written as a fix to your agent’s prompt, the ones you can act on directly. You can switch between issues at the agent level and issues at the domain level. A separate group covers issues that aren’t about the prompt at all, things about how the agent is set up rather than what it says. Those are worth reading, but they’re informational: an optimization run can’t act on them the way it can on a prompt-based suggestion.

Hand off to an optimization

Once you’ve read through the actionable suggestions, Optimize My Agent is the button that moves you from reading recommendations to acting on them automatically. It opens the optimization setup scoped to this run and the issues you were just looking at.

Running optimizations walks through finishing that setup and starting the run. What the run does once it starts, searching for a better prompt and scoring each candidate against your evals, is covered in Optimization.

The optimization you start this way lands back on the same run’s results page, under its Optimization Runs tab, alongside any others you’ve started from here.

Dive deeper