Groundedness

Definition

Assesses whether a response is firmly based on the provided context. This evaluation ensures that the response does not introduce information that is not supported by the context, thereby maintaining factual accuracy and relevance.

A Passed evaluation indicates that the response is well-grounded in the context, while a Failed evaluation suggests that the response includes information not supported by the context.

Calculation

The evaluation process begins with Configuration Setup, where the context and response are defined for analysis, and an appropriate language model is selected from the available options. In Response Analysis, the system compares the response against the provided context to identify any unsupported information, ensuring that the response does not introduce external or unrelated details.

Eval returns binary Pass/Fail output is generated based on the response’s adherence to the given context, determining whether it remains contextually accurate and relevant.

What to do when Groundedness Evaluation Fails

If the evaluation fails, the Context Review should reassess the provided context for completeness and clarity, ensuring it includes all necessary information to support the response. In Response Analysis, the response should be examined for any elements not supported by the context, and adjustments should be made to improve alignment with the given information.

Differentiating Groundedness from Context Adherence

While both evaluations assess context alignment, Groundedness ensures that the response is strictly based on the provided context, whereas Context Adherence measures how well the response stays within the context without introducing external information. Both evaluations require a response and context as inputs and produce a Pass/Fail output based on adherence to the provided information.