Get Eval Summary

Retrieve aggregated evaluation summary for a test run. Optionally scope to a specific execution. Returns per-config average scores, pass counts, and fail counts.

GET https://api.futureagi.com/simulate/run-tests/{run_test_id}/eval-summary/

Authentication

X-Api-Key API Key Required

Your Future AGI API key used to authenticate requests. You can find and manage your API keys in the Dashboard under Settings.

X-Secret-Key Secret Key Required

Your Future AGI secret key, used alongside the API key for request authentication. This is generated when you create an API key in the Dashboard.

Path parameters

run_test_id UUID Required

UUID of the test run whose evaluation summary to retrieve.

Query parameters

execution_id string Optional

UUID of a specific execution to scope the summary to. If omitted, aggregates across all executions.

Response

200 OK
evaluations array

Array of evaluation summary objects, one per eval config.

name string

Name of the evaluation configuration.

average_score number

Average score across all evaluated calls.

total_runs integer

Total evaluation runs for this config.

passed integer

Number of passing evaluations.

failed integer

Number of failing evaluations.

Errors

401 Unauthorized Optional

Missing or invalid X-Api-Key or X-Secret-Key headers.

404 Not Found Optional

No test run found with the specified run_test_id.

500 Internal Server Error Optional

Unexpected server error. Contact support if it persists.

GET /
Authentication
REQUEST 
 
 
  
 
 RESPONSE