benchmarks/stt by coval/openai vs deepgram
speech-to-text head-to-head · data by Coval

OpenAI vs Deepgram: Speech-to-Textlatency & accuracy

Measured head-to-head, not marketing: the verdict is split: Deepgram is faster on median TTFS (90 ms vs 554 ms), while OpenAI is more accurate (3.8% WER vs 5.1%). Median TTFS gaps of tens of milliseconds are usually not a pick reason; read p95 TTFS with WER. Independent data, refreshed daily, on identical inputs. Price and whether emails, phones, paths, and IDs survive verbatim are not measured.

OpenAI or Deepgram: which is better?

Each provider's best model on each measured axis, last 7d. Lower is better on both:

AxisOpenAI (best model)Deepgram (best model)Measured winner
Speed: median TTFSgpt-realtime-whisper · 554 msnova-3 · 90 msDeepgram
Accuracy: avg WERgpt-4o-mini-transcribe · 3.8%nova-3 · 5.1%OpenAI

Not measured here: price, hallucination on silence, endpointing, timestamps, diarization, long-form drift, rate limits, and whether emails, phones, paths, and IDs survive verbatim. Treat those as vendor claims until measured. Full leaderboard context: the independent speech-to-text benchmark →

Every OpenAI and Deepgram model, measured

All benchmarked models from both providers on the same pinned dataset, ranked fastest-first (median TTFS), last 7d:

ModelProviderTTFS medianTTFS p95WERSamples
nova-3Deepgram90 ms135 ms5.1%6,381
nova-2Deepgram91 ms144 ms6.6%6,368
flux-general-enDeepgram99 ms164 ms5.7%6,384
flux-general-multiDeepgram101 ms164 ms7.4%6,384
gpt-realtime-whisperOpenAI554 ms694 ms4.0%6,361
gpt-4o-mini-transcribeOpenAI636 ms1,094 ms3.8%6,365
gpt-4o-transcribeOpenAI751 ms1,041 ms3.8%6,365

Data by Coval

Coval sells voice-agent evaluation infrastructure. Numbers are a rolling 7d aggregate on a pinned dataset under production-realistic conditions. Openbenchmarks mirrors the results with attribution; methodology and runner are open-source.

synced from Coval2026-10-11 11:51 UTC · full STT benchmark → · methodology →

OpenAI vs Deepgram: common questions

Is OpenAI faster than Deepgram for speech-to-text?

On the current 7d window, OpenAI's fastest model (gpt-realtime-whisper) has a median TTFS of 554 ms, vs 90 ms for Deepgram's fastest (nova-3), so Deepgram is faster on measured median latency. Distributions matter too: p95 is 694 ms for OpenAI vs 135 ms for Deepgram.

Which is more accurate, OpenAI or Deepgram?

By Word Error Rate: OpenAI's best model (gpt-4o-mini-transcribe) averages 3.8%, vs 5.1% for Deepgram's best (nova-3). OpenAI leads on measured accuracy. Lower is better; WER is measured on identical inputs under production-realistic conditions.

Which should I pick, OpenAI or Deepgram?

The measured verdict is split: Deepgram is faster on median TTFS, OpenAI is more accurate (WER). A few milliseconds of median TTFS is usually not a pick reason; read p95 TTFS and WER together. price, hallucination on silence, endpointing, timestamps, diarization, long-form drift, rate limits, and whether emails, phones, paths, and IDs survive verbatim are not measured here.

Where does this data come from?

Coval sells voice-agent evaluation infrastructure. Every model runs the same pinned dataset under production-realistic conditions. The table is a rolling 7d aggregate, not a single job; Openbenchmarks mirrors it with attribution. Methodology and runner are open-source (Apache-2.0).