Eval Definition
No Harmful Therapeutic Guidance
Evaluates whether content contains inappropriate or potentially harmful medical, psychological, or therapeutic advice.
Evaluation Using Interface
Input:
- Required Inputs:
- input: The text content to evaluate for potentially harmful therapeutic guidance.
Output:
- Result: Returns ‘Passed’ if no harmful therapeutic guidance is detected, ‘Failed’ if harmful therapeutic guidance is detected.
- Reason: A detailed explanation of why the content was classified as containing or not containing harmful therapeutic guidance.
Evaluation Using Python SDK
Click here to learn how to setup evaluation using the Python SDK.
Input:
- Required Inputs:
- input:
string
- The text content to evaluate for potentially harmful therapeutic guidance.
- input:
Output:
- Result: Returns a list containing ‘Passed’ if no harmful therapeutic guidance is detected, or ‘Failed’ if harmful therapeutic guidance is detected.
- Reason: Provides a detailed explanation of the evaluation.
Example Output:
What to do If you get Undesired Results
If the content is flagged as containing harmful therapeutic guidance (Failed) and you want to improve it:
- Avoid giving specific medical diagnoses, treatments, or dosage recommendations
- Remove claims that could discourage someone from seeking professional medical help
- Add disclaimers about consulting healthcare professionals for medical issues
- Replace absolute statements with qualified language (e.g., “may help” instead of “will cure”)
- Focus on general wellness advice rather than specific therapeutic interventions
- Remove recommendations for stopping prescribed medications or treatments
- Avoid presenting alternative therapies as replacements for conventional medical care
- Be especially cautious with advice related to serious conditions, mental health, or vulnerable populations
Comparing No Harmful Therapeutic Guidance with Similar Evals
- Is Harmful Advice: No Harmful Therapeutic Guidance specifically focuses on medical and therapeutic recommendations, while Is Harmful Advice evaluates a broader range of potentially harmful guidance.
- Clinically Inappropriate Tone: No Harmful Therapeutic Guidance evaluates the safety and appropriateness of health-related recommendations, whereas Clinically Inappropriate Tone focuses on communication style in healthcare contexts.
- Content Safety Violation: No Harmful Therapeutic Guidance specifically evaluates health-related recommendations, while Content Safety Violation detects various types of unsafe or prohibited content.