This evaluation template checks whether a text contains references to OpenAI, its models (like ChatGPT, GPT-3, GPT-4), or identifies itself as an OpenAI product. It’s particularly useful for ensuring AI responses maintain proper branding and attribution.

​
Interface Usage

result = evaluator.evaluate(
    eval_templates="no_openai_reference", 
    inputs={
        "input": "Dear Sir, I hope this email finds you well. I look forward to any insights or advice you might have whenever you have a free moment"
    },
    model_name="turing_flash"
)

print(result.eval_results[0].metrics[0].value)
print(result.eval_results[0].reason)

​
Python SDK Usage

from futureagi import Evaluator

# Initialize the evaluator
evaluator = Evaluator(api_key="your_api_key")

# Check for OpenAI references in text
result = evaluator.evaluate(
    eval_templates="no_openai_reference", 
    inputs={
        "input": "Dear Sir, I hope this email finds you well. I look forward to any insights or advice you might have whenever you have a free moment"
    },
    model_name="turing_flash"
)

# Access the result
no_openai_reference = result.eval_results[0].metrics[0].value
reason = result.eval_results[0].reason

print(f"No OpenAI references: {no_openai_reference}")
print(f"Reason: {reason}")

​
Example Output

True
The text doesn't contain any references to OpenAI, ChatGPT, GPT models, or any indication that it was generated by an OpenAI product. The message is a simple, professional email greeting without any AI-related self-references or mentions of specific AI companies or products.

​
Troubleshooting

If you encounter issues with this evaluation:

  • This evaluation detects both explicit mentions (“OpenAI”, “ChatGPT”) and implicit self-identification (“As an AI language model…”)
  • It covers references to OpenAI as a company, its products, and its models
  • If your content legitimately needs to discuss OpenAI as a subject matter, consider using a different evaluation
  • For comprehensive brand compliance, combine with other brand-specific evaluations
  • regex: Can be used to create custom pattern matching for specific brand-related terms
  • contains-evals: Checks for the presence of specific content or phrases in text