Compare evaluation summaries
Compares evaluation summaries across multiple test executions.
GET
https://api.futureagi.com/simulate/run-tests/{run_test_id}/eval-summary-comparison/ Authentication
Path parameters
run_test_id
UUID of the test run containing the executions to compare.
Query parameters
execution_ids
JSON-encoded array of test execution UUIDs to compare. Must be URL-encoded.
Response
200 OK comparison
Dictionary keyed by execution ID, each mapping to its evaluation summary metrics.
Errors
400
Missing, malformed, or invalid execution_ids parameter.
401
Missing or invalid X-Api-Key or X-Secret-Key headers.
404
No test run found with the specified run_test_id.
500
Unexpected server error. Retry later or contact support.