Create a New Test Run

Creates a new test run.

POST https://api.futureagi.com/simulate/run-tests/create/

Authentication

X-Api-Key API Key Required

Your Future AGI API key used to authenticate requests. You can find and manage your API keys in the Dashboard under Settings.

X-Secret-Key Secret Key Required

Your Future AGI secret key, used alongside the API key for request authentication. This is generated when you create an API key in the Dashboard.

Request body

name string Required

Name for the test run. Must be unique within your organization and cannot exceed 255 characters.

description string Optional

Optional free-text description of the test run.

scenarioIds array of string Required

Array of scenario UUIDs to execute against. Must contain at least one valid scenario ID.

agentDefinitionId string Required

UUID of the agent definition to evaluate.

agentVersion string Optional

UUID of a specific agent version to test against. Defaults to the currently active version if omitted.

evalConfigIds array of string Optional

Array of existing evaluation configuration UUIDs to associate with this test run.

evaluationsConfig array of objects Optional

Array of inline evaluation configuration objects to create and associate. Each object must include template_id, name, config, and mapping.

datasetRowIds array of string Optional

Array of dataset row UUIDs to restrict execution to specific data entries. If omitted, all rows are included.

enableToolEvaluation boolean Optional

When true, evaluates correctness of tool calls made by the agent. Defaults to false.

Response

201 Created
id string

UUID of the newly created test run.

name string

Name of the test run.

description string

Description of the test run, or empty string if none provided.

agent_definition string

UUID of the associated agent definition.

scenarios array of string

Array of linked scenario UUIDs.

enable_tool_evaluation boolean

Whether tool evaluation is enabled.

created_at string

ISO 8601 creation timestamp.

updated_at string

ISO 8601 last-modified timestamp.

Errors

400 Bad Request Optional

Invalid or missing required fields, such as empty scenarioIds, invalid UUIDs, or malformed evaluationsConfig.

401 Unauthorized Optional

Missing or invalid X-Api-Key or X-Secret-Key headers.

404 Not Found Optional

Organization not found, or one or more referenced resources (agent definition, scenarios, eval configs) do not exist.

500 Internal Server Error Optional

Unexpected server error. Contact support if it persists.

GET /
Authentication
REQUEST 
 
 
  
 
 RESPONSE