Add evaluation configurations

Your Future AGI API key used to authenticate requests. You can find and manage your API keys in the Dashboard under Settings.

Your Future AGI secret key, used alongside the API key for request authentication. This is generated when you create an API key in the Dashboard.

UUID of the test run to add evaluation configurations to.

Array of evaluation configuration objects. Each object supports the following fields:

• templateId (string, UUID, required) — UUID of the evaluation template to use.

• name (string, required) — Name for this evaluation configuration. Must be unique within the test run.

• config (object, optional) — Template-specific configuration parameters.

• mapping (object, optional) — Maps test execution data fields to the evaluation template’s expected inputs.

• filters (object, optional) — Filter criteria to restrict which test results are evaluated.

• errorLocalizer (boolean, optional) — Enables granular error localization on evaluation failures. Defaults to false.

• model (string, optional) — Model to use for running this evaluation.

Invalid or missing fields such as a non-existent templateId, duplicate name, or malformed config/mapping.

Missing or invalid X-Api-Key or X-Secret-Key headers.

No test run found with the specified run_test_id.

Unexpected server error. Retry later or contact support.