Skip to main content
POST
/
model-hub
/
eval-template
/
create
/
Create base evaluation template
curl --request POST \
  --url https://api.futureagi.com/model-hub/eval-template/create/ \
  --header 'Content-Type: application/json' \
  --header 'X-Api-Key: <api-key>' \
  --header 'X-Secret-Key: <api-key>' \
  --data '{
  "name": "Relevance Check",
  "config": {
    "criteria": "Check if response is relevant",
    "model": "gpt-4"
  }
}'
{
  "id": "3c90c3cc-0d44-4b50-8888-8dd25736052a",
  "name": "<string>",
  "owner": "system",
  "config": {},
  "eval_tags": [
    "<string>"
  ],
  "created_at": "2023-11-07T05:31:56Z",
  "updated_at": "2023-11-07T05:31:56Z"
}

Authorizations

​
X-Api-Key
string
header
required

API Key for authentication. Click here to access API Key

​
X-Secret-Key
string
header
required

Secret Key for authentication. Click here to access Secret Key

Body

application/json
​
name
string
required

Name of the evaluation template

Maximum length: 50
Example:

"Relevance Check"

​
config
object
required

Configuration object for the template

Example:
{
  "criteria": "Check if response is relevant",
  "model": "gpt-4"
}
​
owner
enum<string>
default:system

Owner type of the template

Available options:
system,
user,
organization
​
eval_tags
string[]

Tags associated with the evaluation

Example:
["qa", "relevance"]

Response

Evaluation template created successfully

​
id
string<uuid>
​
name
string
Maximum length: 50
​
owner
enum<string>
Available options:
system,
user,
organization
​
config
object
​
eval_tags
string[]
​
created_at
string<date-time>
​
updated_at
string<date-time>