Model configuration

Field reference for a prompt template's model configuration and run limits

Look up a field below for what it accepts and the limit enforced when you save or run it. For which models are available in your workspace, see AI Providers in Admin & Settings.

You set these from the Playground’s editor header or the SDK.

Generation parameters

FieldTypeValid range
temperaturenumber0.0 to 2.0
frequency_penaltynumber-2.0 to 2.0
presence_penaltynumber-2.0 to 2.0
top_pnumber0.0 to 1.0
max_tokensinteger1 to 65536

A value outside its range is rejected before the model runs. These ranges are what the API and SDK enforce.

Output and tool settings

FieldTypeValid valuesDefault
output_formatstringarray, string, number, object, audio, imagestring
tool_choicestringauto, required, or unsetUnset
toolsarrayA list of tool IDsUnset
response_formatobjectA JSON schema object, a string, or the ID of a saved response schemaUnset

Note

An ID that doesn’t resolve to a real tool or response schema is rejected, not silently dropped.

Prompt structure limits

ItemLimit
MessagesAn ordered list of {role, content} objects. role must be system, user, or assistant; content must be a string. Any other role is rejected
Prompt template nameUp to 2000 characters
Base template nameUp to 255 characters
Folder nameUp to 255 characters
Version nameMust match v followed by digits, for example v1, v12. Anything else is rejected
Version comparisonUp to 3 versions at once. A fourth is rejected

Run behavior limits

Limits on how many calls run at once from a Run Prompt column across a dataset.

ItemLimit
Concurrent calls in a dataset run1 to 10, default 5. A value over 10 is rejected

Response schemas

A response schema is a saved shape that response_format can point at by ID instead of an inline JSON schema object.

FieldWhat it means
nameUnique within your organization and workspace
schema_typejson or yaml

Keep exploring

Was this page helpful?

Questions & Discussion