Run new evaluations on test executions

POST https://api.futureagi.com/simulate/run-tests/{run_test_id}/run-new-evals/

X-Api-Key API Key Required

Your Future AGI API key used to authenticate requests. You can find and manage your API keys in the Dashboard under Settings.

X-Secret-Key Secret Key Required

Your Future AGI secret key, used alongside the API key for request authentication. This is generated when you create an API key in the Dashboard.

run_test_id UUID Required

UUID of the test run containing the executions to evaluate.

testExecutionIds array of strings Optional

Array of test execution UUIDs to evaluate. Required when selectAll is false. Only COMPLETED executions are eligible.

selectAll boolean Optional

When true, evaluates all completed executions, ignoring testExecutionIds. Defaults to false.

evalConfigIds array of strings Required

Array of evaluation configuration UUIDs to run on the selected executions.

enableToolEvaluation boolean Optional

When true, also evaluates tool usage by the agent. Defaults to false.

200 OK

message string

Confirmation that evaluations were started.

run_test_id string

UUID of the parent test run.

call_execution_count integer

Number of call executions being evaluated.

400 Bad Request Optional

Missing or empty evalConfigIds, no executions specified, or no completed executions found.

401 Unauthorized Optional

Missing or invalid X-Api-Key or X-Secret-Key headers.

404 Not Found Optional

No test run found with the specified run_test_id.

500 Internal Server Error Optional

Unexpected server error. Retry later or contact support.