Create Eval Task

POST https://api.futureagi.com/tracer/eval-task/

X-Api-Key API Key Required

Your Future AGI API key used to authenticate requests. You can find and manage your API keys in the Dashboard under Settings.

X-Secret-Key Secret Key Required

Your Future AGI secret key, used alongside the API key for request authentication. This is generated when you create an API key in the Dashboard.

project string Required

UUID of the project to associate this eval task with.

name string Required

Name for the eval task. Must be 1–255 characters.

evals array Required

List of custom eval config UUIDs to run on each span. Each must reference a valid, non-deleted config.

sampling_rate number Required

Percentage of eligible spans to evaluate, between 1.0 and 100.0.

run_type string Required

Execution mode: "continuous" (evaluates new spans indefinitely) or "historical" (evaluates existing spans up to spans_limit).

spans_limit integer Optional

Maximum number of spans to evaluate. Required when run_type is "historical", ignored for "continuous". Accepts 1–1000000.

filters object Optional

Query filters to narrow eligible spans. When omitted, all project spans are eligible.

200 OK

id string

UUID of the created eval task.

400 Bad Request Optional

Missing required fields or invalid values.

401 Unauthorized Optional

Invalid or missing API credentials.

500 Internal Server Error Optional

Unexpected server error.