List Custom Eval Configs

Lists custom eval configs, optionally filtered by project or eval task.

GET https://api.futureagi.com/tracer/custom-eval-config/list_custom_eval_configs/

Authentication

X-Api-Key API Key Required

Your Future AGI API key used to authenticate requests. You can find and manage your API keys in the Dashboard under Settings.

X-Secret-Key Secret Key Required

Your Future AGI secret key, used alongside the API key for request authentication. This is generated when you create an API key in the Dashboard.

Query parameters

project_id string Optional

Filter by project UUID. Also accepts projectId.

task_id string Optional

Filter by eval task UUID. Also accepts taskId.

filters string Optional

JSON-encoded dictionary of additional filter criteria. Must be a valid JSON object.

Response

200 OK

Returns an array of custom eval config objects.

id string
UUID of the custom eval config.
eval_template string
UUID of the associated eval template.
name string
Name of the config.
config object
Template configuration overrides.
mapping object
Trace span field-to-template input mapping.
project string
UUID of the associated project.
filters object
Filter criteria restricting evaluated spans.
error_localizer boolean
Whether error localization is enabled.
kb_id string
UUID of the referenced knowledge base file, if any.
model string
Evaluation model, or null for system default.
eval_group string
Eval group this config belongs to, if any.

Errors

400 Bad Request Optional

Invalid filters value; must be a valid JSON object.

401 Unauthorized Optional

Invalid or missing API credentials.

500 Internal Server Error Optional

Unexpected server error.

GET /
Authentication
REQUEST 
 
 
  
 
 RESPONSE