Is Polite
Detects politeness and respect in AI responses, checking for courteous language and adherence to social communication norms.
Is Polite checks whether a response maintains a respectful, courteous tone free of rudeness. Run it wherever a response represents your product or brand to a user.
What it does
Is Polite is an LLM-as-Judge eval. It reads the generated output and checks whether it’s respectful and free of impolite language.
Input
| Required Input | Type | Description |
|---|---|---|
output | string | The response to be evaluated for politeness |
Output
| Field | Type | Description |
|---|---|---|
| Result | Pass / Fail | Pass means the response is polite and respectful; Fail means it’s not |
| Reason | string | A plain-language explanation of the evaluation |
Run it from code
Call evaluate() with the template name and the eval’s required inputs. It returns the score and the reason.
Note
Before running: install the SDK and set FI_API_KEY / FI_SECRET_KEY. The model argument in the snippets is the evaluator model Future AGI uses to run the eval; turing_flash is a fast default.
from fi.evals import evaluate
result = evaluate(
"is_polite",
output="Dear Sir, I hope this email finds you well. I look forward to any insights or advice you might have whenever you have a free moment",
model="turing_flash",
)
print(result.score)
print(result.reason)import { evaluate } from "@future-agi/ai-evaluation";
const result = await evaluate(
"is_polite",
{
output: "Dear Sir, I hope this email finds you well. I look forward to any insights or advice you might have whenever you have a free moment"
},
{ modelName: "turing_flash" }
);
console.log(result);When to use
Run Is Polite wherever a response needs to stay courteous regardless of what the user says.
- Text and chat outputs delivered directly to end users
- Customer support responses, especially in frustrating or escalated conversations
- Safety reviews, to catch responses that turn curt or dismissive
What to do when Is Polite fails
Politeness standards can vary across cultures and contexts; the evaluation generally uses Western business communication norms. Short or technical communications might read as neutral rather than explicitly polite, since this evaluation focuses on the presence of polite elements and the absence of impolite ones.
Consider cultural context when interpreting results, as politeness norms vary globally.
Questions & Discussion