Skip to content
  • Models
  • Rankings
  • Ori
Sign Up
Sign Up
OpenRouterOpenRouter
© 2026 OpenRouter, Inc

Product

  • Chat
  • Rankings
  • Benchmarks
  • Apps
  • Discover
  • Models
  • Collections
  • Providers
  • Pricing
  • Business
  • Enterprise
  • Labs

Company

  • About
  • Blog
  • Careers
    Hiring
  • Privacy
  • Terms of Service
  • Trust Center
  • Support
  • Works With OR
  • Data
  • Brand

Developer

  • Documentation
  • API Reference
  • Developer Platform
  • Status

Connect

  • Discord
  • GitHub
  • LinkedIn
  • X
  • YouTube
All benchmarks

Media benchmarks

Compare generation quality across media models

ImageVideoSpeechMemes
Fidelity
Plain sentenceFive nos
Normalization
Invoice lineDirections and units
Prosody
Punctuation
Cues
Bracketed cueNonverbal cue
Language
Other languageCode switch
Length
One wordFull paragraph
Literalness
Embedded instruction

Invoice line

Why we chose this prompt: A dollar amount, an ISO date and an alphanumeric reference code in one line. Each has a conventional spoken form, and reading them as written or guessing wrong is a common failure in production use.

Prompt

The invoice totals $1,156.40, due 2026-08-24, reference KWAI-9F.

Sort by
  • Favicon for google

    Zephyr

    Cost
    --
    Generation time
    7.5s
    Correctness
    76%
  • Favicon for qwen

    loongjohn

    Cost
    --
    Generation time
    2.1s
    Correctness
    76%
  • Favicon for hexgrad

    af_alloy

    Cost
    $0.00004
    Generation time
    0.5s
    Correctness
    75%
  • Favicon for fish-audio

    provider default

    Cost
    $0.00096
    Generation time
    1.7s
    Correctness
    61%
  • Favicon for deepgram

    aura-2-thalia-en

    Cost
    $0.002
    Generation time
    3.1s
    Correctness
    55%
  • Favicon for microsoft

    en-US-Harper:MAI-Voice-2

    Cost
    $0.001
    Generation time
    1.1s
    Correctness
    53%
  • Favicon for microsoft

    en-US-Harper:MAI-Voice-2

    Cost
    $0.00096
    Generation time
    1.3s
    Correctness
    50%
  • Favicon for qwen

    longanlingxin

    Cost
    $0.001
    Generation time
    3.3s
    Correctness
    50%
  • Favicon for sesame

    conversational_a

    Cost
    $0.00045
    Generation time
    21.7s
    Correctness
    42%
  • Favicon for x-ai

    eve

    Cost
    $0.00096
    Generation time
    1.7s
    Correctness
    38%
  • Favicon for canopylabs

    tara

    Cost
    $0.00045
    Generation time
    9.4s
    Correctness
    34%
  • Favicon for fish-audio

    provider default

    Cost
    --
    Generation time
    2.2s
    Correctness
    34%
  • Favicon for minimax

    English_expressive_narrator

    Cost
    $0.006
    Generation time
    1.7s
    Correctness
    31%
  • Favicon for minimax

    English_expressive_narrator

    Cost
    --
    Generation time
    1.3s
    Correctness
    31%
  • Favicon for mistralai

    en_paul_sad

    Cost
    --
    Generation time
    2.0s
    Correctness
    30%
  • Favicon for fish-audio

    provider default

    Cost
    $0.00096
    Generation time
    1.1s
    Correctness
    29%