Validate JSON

In many AI systems, JSON is a commonly used data format for exchanging information between components, such as APIs, databases, and models. Ensuring that JSON data is both valid and adheres to specific structural requirements is critical for maintaining seamless communication and avoiding system errors.

An AI model might generate JSON for function calls, or external systems might send JSON data for processing. If the JSON is malformed or doesn’t follow the required structure, the workflow could fail, leading to unexpected outcomes or system disruptions.

Future AGI provides solution using which you can validate your JSON data, called “Is JSON” and “JSON Scheme Validation”. It checks if the content is valid JSON, also validates JSON structure against user provided criteria.

• Is JSON
• JSON Scheme Validation

​

1. Is JSON Eval

This evaluation checks whether the input is a valid JSON format. Ensures that the content can be parsed as JSON without syntax errors.

Click here to read the eval definition of Is JSON

​

a. Using Interface

Input Required

• Text: The input content to be evaluated.

Output

• Pass: The content is valid JSON.
• Fail: The content is not valid JSON (e.g., missing brackets, improper structure).

​

b. Using SDK

from fi.evals import Evaluator
from fi.testcases import TestCase
from fi.evals.templates import IsJson

test_case = TestCase(
    text='''
    {
        "name": "John Doe",
        "age": 30,
        "city": "New York",
        "hobbies": ["reading", "hiking"]
    }
    '''
)

template = IsJson()

evaluator = Evaluator()

response = evaluator.evaluate(eval_templates=[template], inputs=[test_case], model_name="turing_flash")

score = response.eval_results[0].metrics[0].value