Input | |||
---|---|---|---|
Required Input | Type | Description | |
output | string | Content to evaluate for LLM reference. |
Output | ||
---|---|---|
Field | Description | |
Result | Returns Passed if no LLM reference is detected in the model’s output, or Failed if LLM reference is detected in the model’s output. | |
Reason | Provides a detailed explanation of why the content was classified as containing or not containing LLM reference. |
Troubleshooting
If you encounter issues with this evaluation:- This evaluation detects both explicit mentions (“OpenAI”, “ChatGPT”) and implicit self-identification (“As an AI language model…”)
- It covers references to OpenAI as a company, its products, and its models
- If your content legitimately needs to discuss OpenAI as a subject matter, consider using a different evaluation
- For comprehensive brand compliance, combine with other brand-specific evaluations