This evaluation template checks whether a given text contains valid programming code. It can identify code snippets across multiple programming languages and distinguish code from natural language.
result = evaluator.evaluate( eval_templates="is_code", inputs={ "input": """ def fibonacci(n): a, b = 0, 1 for _ in range(n): print(a) a, b = b, a + b """ }, model_name="turing_flash")print(result.eval_results[0].metrics[0].value)print(result.eval_results[0].reason)
from futureagi import Evaluator# Initialize the evaluatorevaluator = Evaluator(api_key="your_api_key")# Evaluate whether text contains valid coderesult = evaluator.evaluate( eval_templates="is_code", inputs={ "input": """ def fibonacci(n): a, b = 0, 1 for _ in range(n): print(a) a, b = b, a + b """ }, model_name="turing_flash")# Access the resultcontains_code = result.eval_results[0].metrics[0].valuereason = result.eval_results[0].reasonprint(f"Contains code: {contains_code}")print(f"Reason: {reason}")
TrueThe input is clearly Python code that defines a function called 'fibonacci'. It has proper Python syntax including function definition with 'def', parameter declaration, variable assignments, a for loop with range(), indentation to denote code blocks, and function logic. This is a valid implementation of a function to print Fibonacci numbers.