Create Evaluation Group

Creates a new evaluation group within the user's workspace.

POST https://api.futureagi.com/model-hub/eval-groups/

Authentication

Authorization Bearer Required

Include your API key in the Authorization header as Bearer <token>. Retrieve your API Key from the Dashboard.

Request body

name string Required

The name of the evaluation group. Must be unique within the workspace.

description string Optional

An optional description for the evaluation group.

eval_template_ids array of string Required

A list of evaluation template UUIDs to include in this group. Must contain at least one entry.

config object Optional

Optional configuration for the evaluation group.

config.threshold number Optional

The minimum score threshold for passing evaluations (0.0 to 1.0).

config.retry_count integer Optional

Number of retry attempts for failed evaluations. Default: 0.

config.timeout_seconds integer Optional

Timeout in seconds for each evaluation. Default: 300.

Response

201 Created
id string Required

Unique identifier (UUID) for the created evaluation group.

name string Required

The name of the evaluation group.

description string

The description of the evaluation group.

eval_template_ids array of string Required

The list of evaluation template UUIDs in this group.

workspace_id string Required

The workspace this group belongs to.

created_at datetime Required

ISO 8601 timestamp of when the group was created.

Errors

400 Bad Request Optional

The request data is invalid or an evaluation group with the same name already exists.

401 Unauthorized Optional

Authentication credentials were not provided or are invalid.

403 Forbidden Optional

You do not have permission to create evaluation groups in this workspace.

GET /
Authentication
REQUEST
 
RESPONSE