Evaluates the accuracy and effectiveness of function calls made by LLM. It checks whether the output correctly identifies the need for a tool call and whether it accurately includes the tool with the appropriate parameters extracted from the input.
Click here to learn how to setup evaluation using SDK.
Input | Parameter | Type | Description |
---|---|---|---|
Required | input | string | input text provided to the LLM that triggers the function call. |
output | string | output text which has the resulting function call or response generated by the LLM. |
Output | Type | Description |
---|---|---|
Result | bool | Returns 0 or 1 . 0 : The LLM did not correctly handle the function call requirement. 1 : The LLM correctly identified that a function/tool call was necessary. |