Eval Definition
Is AI Generated Image
Evaluates whether an image was generated by AI or captured by a camera/created by humans.
Evaluation Using Interface
Input:
- Required Inputs:
- input_image: URL or file path to the image to be evaluated.
Output:
- Result: Returns ‘Passed’ if the image is detected as AI-generated, ‘Failed’ if it appears to be a real photograph or human-created image.
- Reason: A detailed explanation of why the image was classified as AI-generated or not.
Evaluation Using Python SDK
Click here to learn how to setup evaluation using the Python SDK.
Input:
- Required Inputs:
- input_image:
string
- URL or file path to the image to be evaluated.
- input_image:
Output:
- Result: Returns a list containing ‘Passed’ if the image is detected as AI-generated, or ‘Failed’ if it appears to be a real photograph or human-created image.
- Reason: Provides a detailed explanation of the evaluation.
Example Output:
What to do If you get Undesired Results
If you’re evaluating images and the results don’t match your expectations:
-
For actual photographs mistakenly identified as AI-generated:
- Ensure the image has not been heavily processed or filtered
- Check that the image doesn’t have unusual artifacts from compression or editing
- Consider providing higher resolution versions if available
-
For AI-generated images not being detected:
- Be aware that newer AI generation models are becoming increasingly photorealistic
- Some AI-generated images that were post-processed or combined with real photographs may be harder to detect
- The evaluation works best with full images rather than small crops or heavily modified versions
Comparing Is AI Generated Image with Similar Evals
- Caption Hallucination: While Is AI Generated Image determines if an image was artificially created, Caption Hallucination evaluates whether descriptions of images contain fabricated elements not visible in the image.
- Toxicity: Is AI Generated Image focuses on the creation method of images, whereas Toxicity evaluates whether content contains harmful elements.