This evaluation template checks whether a text contains references to OpenAI, its models (like ChatGPT, GPT-3, GPT-4), or identifies itself as an OpenAI product. It’s particularly useful for ensuring AI responses maintain proper branding and attribution.

​
Python SDK Usage

result = evaluator.evaluate(
    eval_templates="no_openai_reference",
    inputs={
        "input": "Dear Sir, I hope this email finds you well. I look forward to any insights or advice you might have whenever you have a free moment"
    },
    model_name="turing_flash"
)

print(result.eval_results[0].output)
print(result.eval_results[0].reason)

​
Troubleshooting

If you encounter issues with this evaluation:
  • This evaluation detects both explicit mentions (“OpenAI”, “ChatGPT”) and implicit self-identification (“As an AI language model…”)
  • It covers references to OpenAI as a company, its products, and its models
  • If your content legitimately needs to discuss OpenAI as a subject matter, consider using a different evaluation
  • For comprehensive brand compliance, combine with other brand-specific evaluations
  • regex: Can be used to create custom pattern matching for specific brand-related terms
  • contains-evals: Checks for the presence of specific content or phrases in text