Compare Eval Summaries

Compare evaluation summaries side-by-side across multiple test executions. Accepts a JSON-encoded array of execution UUIDs; returns per-execution eval metrics keyed by execution ID.

GET https://api.futureagi.com/simulate/run-tests/{run_test_id}/eval-summary-comparison/

Authentication

X-Api-Key API Key Required

Your Future AGI API key used to authenticate requests. You can find and manage your API keys in the Dashboard under Settings.

X-Secret-Key Secret Key Required

Your Future AGI secret key, used alongside the API key for request authentication. This is generated when you create an API key in the Dashboard.

Path parameters

run_test_id UUID Required

UUID of the test run containing the executions to compare.

Query parameters

execution_ids string Required

JSON-encoded array of test execution UUIDs to compare. Must be URL-encoded.

Response

200 OK
comparison object
Dictionary keyed by execution ID, each mapping to its evaluation summary metrics.

Errors

400 Bad Request Optional

Missing, malformed, or invalid execution_ids parameter.

401 Unauthorized Optional

Missing or invalid X-Api-Key or X-Secret-Key headers.

404 Not Found Optional

No test run found with the specified run_test_id.

500 Internal Server Error Optional

Unexpected server error. Retry later or contact support.

GET /
Authentication
REQUEST 
 
 
  
 
 RESPONSE