Authorizations
Body
application/json
Type of custom evaluation template
Available options:
Llm, Futureagi, Function Name of the custom template (lowercase, alphanumeric, hyphens, underscores only)
Maximum length:
255Example:
"custom-eval-template"
Type of evaluation output
Available options:
Pass/Fail, score, choices Required input keys for the evaluation
Example:
["input", "expected_output"]Description of the custom template
Tags for categorization
Example:
["custom", "test"]Evaluation criteria
Maximum length:
100000Template configuration with allowed keys: model, proxy_agi, visible_ui, reverse_output, config
Whether to check internet connectivity
Choices dictionary when output_type is 'choices'
Allow multiple choice selection
Response
Custom evaluation template created successfully