Evaluation Using Interface
Input:- Required Inputs:
- output: The generated summary column.
- Optional Inputs:
- context: Additional background information column (if applicable).
- input: The original document or source content column.
- Configuration Parameters:
- Check Internet: Boolean - Whether to verify information using external sources.
- Score: Percentage score between 0 and 100
- Higher scores: Indicate a better quality summary that effectively captures main points, is factually accurate, appropriately concise, and preserves original meaning.
- Lower scores: Suggest issues with the summary, such as missing key information, factual inaccuracies, inclusion of unnecessary details, or poor conciseness.
Evaluation Using SDK
Click here to learn how to setup evaluation using SDK.
Input Type | Parameter | Type | Description |
---|---|---|---|
Required Inputs | output | string | The generated summary. |
Optional Inputs | context | string | Additional background information (if applicable). |
input | string | The original document or source content. | |
Configuration Parameters | check_internet | bool | Whether to verify information using external sources. |
Output | Type | Description |
---|---|---|
Score | float | Returns a score between 0 and 1, where higher values indicate better summary quality. |