Contain
In the context of text processing, validating the presence or absence of specific keywords or patterns is crucial for ensuring that generated content meets desired criteria.
Following evals help in assessing whether the text aligns with specific requirements, such as containing necessary information, adhering to expected formats, or avoiding unwanted terms:
1. Contains
Definition: Evaluates whether the input text contains a specific keyword. This is useful for ensuring that essential terms are present in the text.
Evaluation Using Interface
Input:
- Required Inputs:
- text: The content column to search within.
- Configuration Parameters:
- keyword: String - The text to search for in the input
text
. - case_sensitive: Boolean (optional) - Whether the search should match case (defaults to
False
if omitted).
- keyword: String - The text to search for in the input
Output:
- Score: Passed or Failed
Interpretation:
- Passed: The specified
keyword
is present in thetext
. - Failed: The specified
keyword
is not present in thetext
.
Evaluation using Python SDK
Click here to learn how to setup evaluation using the Python SDK.
Input Type | Parameter | Type | Description | UI Component |
---|---|---|---|---|
Required Inputs | text | string | The content column to search within. | Column Select |
Configuration Parameters | keyword | string | The keyword to search for in the text . | Text Input |
case_sensitive | bool | Optional: Whether the keyword search should be case-sensitive. | Checkbox |
What to Do When Contains Evaluation Fails: If the evaluation fails, consider revising the text to include the necessary keyword. Providing clearer instructions regarding required terms can help prevent this issue in future evaluations.
2. Contains Any
Definition: Checks if the input text contains any of the specified keywords. This evaluation is useful for scenarios where the presence of at least one keyword is required.
Evaluation Using InterfaceInput:
- Required Inputs:
- text: The content column to search within.
- Configuration Parameters:
- keywords: List[String] - A list of possible strings to search for. (Enter as a comma-separated string in UI).
- case_sensitive: Boolean (optional) - Whether the search should match case (defaults to
False
if omitted).
Output:
- Score: Passed or Failed
Interpretation:
- Passed: At least one of the specified
keywords
is present in thetext
. - Failed: None of the specified
keywords
are present in thetext
.
Evaluation using Python SDK
Click here to learn how to setup evaluation using the Python SDK.
Input Type | Parameter | Type | Description | UI Component |
---|---|---|---|---|
Required Inputs | text | string | The content column to search within. | Column Select |
Configuration Parameters | keywords | list[string] | List of keywords to search for in the text . (Enter as a comma-separated string in UI). | Text Input |
case_sensitive | bool | Optional: Whether the keyword search should be case-sensitive. | Checkbox |
What to Do When Contains Any Evaluation Fails: If the evaluation fails, ensure that at least one of the required keywords is included in the text. Adjusting the content to meet this requirement can improve compliance in future evaluations.
3. Contains All
Definition: Verifies that the input text contains all specified keywords. This evaluation is critical for ensuring comprehensive coverage of necessary terms.
Evaluation Using InterfaceInput:
- Required Inputs:
- text: The content column to search within.
- Configuration Parameters:
- keywords: List[String] - The list of keywords that must all be present. (Enter as a comma-separated string in UI).
- case_sensitive: Boolean (optional) - Whether the search should match case (defaults to
False
if omitted).
Output:
- Score: Passed or Failed
Interpretation:
- Passed: All of the specified
keywords
are present in thetext
. - Failed: At least one of the specified
keywords
is missing from thetext
.
Evaluation using Python SDK
Click here to learn how to setup evaluation using the Python SDK.
Input Type | Parameter | Type | Description | UI Component |
---|---|---|---|---|
Required Inputs | text | string | The content column to search within. | Column Select |
Configuration Parameters | keywords | list[string] | List of keywords that must all be present in the text . (Enter as a comma-separated string in UI). | Text Input |
case_sensitive | bool | Optional: Whether the keyword search should be case-sensitive. | Checkbox |
What to Do When Contains All Evaluation Fails: If the evaluation fails, review the text to identify which keywords are missing. Revise the content to include all required keywords to meet the evaluation criteria.
4. Contains None
Definition: Verifies that the input text contains none of the specified terms. This evaluation is important for filtering out unwanted or prohibited content.
Evaluation Using InterfaceInput:
- Required Inputs:
- text: The content column to search within.
- Configuration Parameters:
- keywords: List[String] - The list of keywords that should not be present. (Enter as a comma-separated string in UI).
- case_sensitive: Boolean (optional) - Whether the search should match case (defaults to
False
if omitted).
Output:
- Score: Passed or Failed
Interpretation:
- Passed: None of the specified forbidden
keywords
are present in thetext
. - Failed: At least one of the specified forbidden
keywords
is present in thetext
.
Evaluation using Python SDK
Click here to learn how to setup evaluation using the Python SDK.
Input Type | Parameter | Type | Description | UI Component |
---|---|---|---|---|
Required Inputs | text | string | The content column to search within. | Column Select |
Configuration Parameters | keywords | list[string] | List of keywords that should not be present in the text . (Enter as a comma-separated string in UI). | Text Input |
case_sensitive | bool | Optional: Whether the keyword search should be case-sensitive. | Checkbox |
What to Do When Contains None Evaluation Fails: If the evaluation fails, identify which unwanted terms are present in the text. Revise the content to remove these terms to ensure compliance with the evaluation criteria.
5. Starts With
Definition: Checks if the input text begins with a specific substring. This evaluation is useful for ensuring that text adheres to expected formats or structures.
Evaluation Using InterfaceInput:
- Required Inputs:
- text: The content column to check.
- Configuration Parameters:
- substring: String - The required starting text (prefix).
- case_sensitive: Boolean (optional) - Whether the comparison should match case (defaults to
False
if omitted).
Output:
- Score: Passed or Failed
Interpretation:
- Passed: The
text
begins with the specifiedsubstring
. - Failed: The
text
does not begin with the specifiedsubstring
.
Evaluation using Python SDK
Click here to learn how to setup evaluation using the Python SDK.
Input Type | Parameter | Type | Description | UI Component |
---|---|---|---|---|
Required Inputs | text | string | The content column to check. | Column Select |
Configuration Parameters | substring | string | The substring to check for at the start of the text . | Text Input |
case_sensitive | bool | Optional: Whether the comparison should be case-sensitive. | Checkbox |
What to Do When Starts With Evaluation Fails: If the evaluation fails, consider revising the text to ensure it begins with the required substring. Providing clearer formatting guidelines can help prevent this issue in future evaluations.
6. Ends With
Definition: Checks if the input text ends with a specific substring. This evaluation is important for validating the conclusion of the text.
Evaluation Using InterfaceInput:
- Required Inputs:
- text: The content column to check.
- Configuration Parameters:
- substring: String - The required ending text (suffix).
- case_sensitive: Boolean (optional) - Whether the comparison should match case (defaults to
False
if omitted).
Output:
- Score: Passed or Failed
Interpretation:
- Passed: The
text
ends with the specifiedsubstring
. - Failed: The
text
does not end with the specifiedsubstring
.
Evaluation using Python SDK
Click here to learn how to setup evaluation using the Python SDK.
Input Type | Parameter | Type | Description | UI Component |
---|---|---|---|---|
Required Inputs | text | string | The content column to check. | Column Select |
Configuration Parameters | substring | string | The substring to check for at the end of the text . | Text Input |
case_sensitive | bool | Optional: Whether the comparison should be case-sensitive. | Checkbox |
What to Do When Ends With Evaluation Fails: If the evaluation fails, revise the text to ensure it concludes with the required substring. Clear guidelines on expected endings can help improve compliance in future evaluations.
7. Equals
Definition: Compares if the input text is exactly equal to a specified expected text. This evaluation is crucial for scenarios where precise matching is required.
Evaluation Using Interface
Input:
- Required Inputs:
- text: The content column to check.
- expected_text: The column containing the exact string to match against.
- Configuration Parameters:
- case_sensitive: Boolean (optional) - Whether the comparison should match case (defaults to
False
if omitted).
- case_sensitive: Boolean (optional) - Whether the comparison should match case (defaults to
Output:
- Score: Passed or Failed
Interpretation:
- Passed: The
text
is identical to theexpected_text
(considering case sensitivity). - Failed: The
text
differs from theexpected_text
(considering case sensitivity).
Evaluation using Python SDK
Click here to learn how to setup evaluation using the Python SDK.
Input Type | Parameter | Type | Description | UI Component |
---|---|---|---|---|
Required Inputs | text | string | The content column to check. | Column Select |
expected_text | string | The column containing the exact string to match against. | Column Select | |
Configuration Parameters | case_sensitive | bool | Optional: Whether the comparison should be case-sensitive. | Checkbox |
What to Do When Equals Evaluation Fails: If the evaluation fails, review the text for discrepancies. Adjusting the content to match the expected text precisely can help meet the evaluation criteria.