TTS Accuracy

Analyzes if the text-to-speech output accurately reflects the intended message, including pronunciation, emphasis, and emotional tone. 

result = evaluator.evaluate(
    eval_templates="TTS_accuracy",
    inputs={
        "text": "Welcome to our service. How can I help you today?",
        "generated_audio": "https://example.com/tts-output.wav"
    },
    model_name="turing_flash"
)

print(result.eval_results[0].output)
print(result.eval_results[0].reason)
import { Evaluator, Templates } from "@future-agi/ai-evaluation";

const evaluator = new Evaluator();

const result = await evaluator.evaluate(
  "TTS_accuracy",
  {
    text: "Welcome to our service. How can I help you today?",
    generated_audio: "https://example.com/tts-output.wav"
  },
  {
    modelName: "turing_flash",
  }
);

console.log(result);
Input
Required InputTypeDescription
textstringThe original text input that was converted to speech
generated_audiostringURL or file path to the TTS audio output to be evaluated
Output
FieldDescription
ResultReturns a numeric score from 0 to 100, where higher values indicate more accurate TTS output
ReasonProvides a detailed explanation of the TTS accuracy assessment

What to Do When TTS Accuracy Score is Low

  • Check for mispronounced words, especially proper nouns, technical terms, or abbreviations
  • Verify that emphasis and stress are placed on the correct syllables
  • Review the emotional tone — it should match the context of the text
  • Ensure the audio is clear and free from artifacts or distortion
  • Consider using phonetic spelling or SSML tags to guide the TTS engine

Comparing TTS Accuracy with Similar Evals

  • Audio Transcription (ASR/STT): TTS Accuracy evaluates text-to-speech conversion quality, while Audio Transcription evaluates the reverse — the accuracy of speech-to-text transcription.
  • Audio Quality: TTS Accuracy focuses on whether the speech correctly represents the original text, while Audio Quality evaluates the perceptual quality of the audio signal itself.
Was this page helpful?

Questions & Discussion