Input | |||
---|---|---|---|
Required Input | Type | Description | |
context | string or list[string] | The contextual information provided to the model | |
output | string | The response generated by the language model |
Output | ||
---|---|---|
Field | Description | |
Result | Returns Passed or Failed, where Passed indicates the model acknowledged the context and Failed indicates potential issues | |
Reason | Provides a detailed explanation of the evaluation |
What to Do When Chunk Attribution Fails
- Ensure that the context provided is relevant and sufficiently detailed for the model to utilise effectively. Irrelevant context might be ignored.
- Modify the input prompt to explicitly guide the model to use the context. Clearer instructions (e.g., “Using the provided documents, answer…”) can help.
- Check the retrieval mechanism: Is the correct context being retrieved and passed to the generation model?
- If the model consistently fails to use context despite relevant information and clear prompts, it may require fine-tuning with examples that emphasize context utilization.