Evaluation Using Interface

Input:

  • Required Inputs:
    • input: The text content to evaluate for clinical appropriateness.

Output:

  • Result: Returns ‘Passed’ if the tone is clinically appropriate, ‘Failed’ if the tone is clinically inappropriate.

Evaluation Using Python SDK

Click here to learn how to setup evaluation using the Python SDK.

Input:

  • Required Inputs:
    • input: string - The text content to evaluate for clinical appropriateness.

Output:

  • Result: Returns a list containing ‘Passed’ if the tone is clinically appropriate, or ‘Failed’ if the tone is clinically inappropriate.
  • Reason: Provides a detailed explanation of why the text was classified as clinically appropriate or inappropriate.
result = evaluator.evaluate(
    eval_templates="clinically_inappropriate_tone", 
    inputs={
        "input": "You can try meditating for a few minutes each night to help improve your sleep."
    },
    model_name="turing_flash"
)

print(result.eval_results[0].metrics[0].value)
print(result.eval_results[0].reason)

Example Output:

['Passed']
The evaluation resulted in a 'Passed' assignment due to the following:

-   The language is **professional** and **straightforward**, making it suitable for clinical contexts.
-   The suggestion demonstrates **empathy** and aims to improve well-being, aligning with supportive communication.
-   There is a **lack of casual or dismissive language**, ensuring the tone remains appropriate.
-   The absence of inappropriate elements, such as humor or dismissiveness, further supports the selection.
-   A different value was not possible because the text **consistently adheres** to the expected standards and contains no elements that would deem it unsuitable.

What to do If you get Undesired Results

If the content is detected as clinically inappropriate but appropriateness is required:

  • Use professional, objective language
  • Avoid casual phrases, jokes, or slang
  • Maintain a respectful, supportive tone
  • Focus on clear, factual information
  • Use empathetic but professional phrasing
  • Avoid minimizing health concerns or symptoms
  • Use appropriate medical terminology when relevant

Comparing Clinically Inappropriate Tone with Similar Evals

  • Tone: While Clinically Inappropriate Tone focuses specifically on appropriateness in healthcare contexts, Tone evaluation assesses the broader emotional context and sentiment.
  • Is Informal Tone: Clinically Inappropriate Tone evaluates suitability for medical or healthcare settings, whereas Is Informal Tone focuses on detecting casual language usage in general contexts.