Agent Judge

Aggregated Metric

Answer Refusal

Answer Similarity

API Call

Audio Quality

Audio Transcription

Bias Detection

BLEU

Caption Hallucination

Chunk Attribution

Chunk Utilization

Clinically Inappropriate Tone

Completeness

Contain Evals

Content Moderation

Content Safety Violation

Context Adherence

Context Relevance

Context Similarity

Conversation Coherence

Conversation Resolution

Cultural Sensitivity

Custom Code

Data Privacy

Detect Hallucination

Deterministic Eval

Embedding Similarity

Eval Context Retrieval

Eval Output

Eval Image Instruction

Eval Audio Description

Eval Ranking

Factual Accuracy

Fuzzy Match

Groundedness

Instruction Adherence

Is Code

Is Compliant

Is Concise

Is Email

Is Factually Consistent

Is Good Summary

Is Harmful Advice

Is Helpful

Is Informal Tone

Is JSON

Is Polite

Lavenshtein Similarity

Length Evals

LLM Function Calling

No Age Bias

No Apologies

No Gender Bias

No Harmful Therapeutic Guidance

No OpenAI Reference

No Racial Bias

Numeric Similarity

PII

Prompt Injection

Recall Score

Rouge

Semantic List Contains

Sexist

Summary Quality

Synthetic Image Evaluator

Task Completion

Text-to-SQL

Tone

Toxicity

Translation Accuracy

Valid Links