Evaluation Using Interface
Input:- Required Inputs:
- input: The query column.
- context: The list of context columns to rank.
- Configuration Parameters:
- criteria: Ranking criteria description (e.g., “Rank contexts based on relevance to the query”).
- Score: Percentage score between 0 and 100
- Higher scores: Indicate that the contexts are ranked effectively according to the specified criteria, with the most relevant contexts ranked higher.
- Lower scores: Suggest poor ranking quality, where less relevant contexts might be ranked higher than more relevant ones.
Evaluation Using SDK
Click here to learn how to setup evaluation using SDK.
Input Type | Parameter | Type | Description |
---|---|---|---|
Required Inputs | input | string | The query. |
context | list[string] | List of contexts to rank. | |
Configuration Parameters | criteria | string | Ranking criteria description. |
Output | Type | Description |
---|---|---|
Score | float | Returns a score between 0 and 1, where higher values indicate better ranking quality. |