gpt-realtime-whisper
gpt-realtime-whisper is a streaming speech-to-text model for realtime transcription, returning transcript text while audio is still arriving, with a tunable latency and accuracy tradeoff and pricing based on audio duration rather than tokens.
- Price
- $1.02, Per hour of audio
import { experimental_streamTranscribe as streamTranscribe } from 'ai';import { createGateway, gateway } from '@ai-sdk/gateway';import { readFile } from 'node:fs/promises';
const modelId = 'openai/gpt-realtime-whisper';
// Mint this on your server, then send only the short-lived token to the client.const { token } = await gateway.experimental_transcription.getToken({ model: modelId,});const clientGateway = createGateway({ apiKey: token });
// Raw 24 kHz, 16-bit signed little-endian mono PCM audio.const bytes = await readFile('audio.pcm');const audio = new ReadableStream<Uint8Array>({ start(controller) { controller.enqueue(new Uint8Array(bytes)); controller.close(); },});
const result = streamTranscribe({ model: clientGateway.transcription(modelId), audio, inputAudioFormat: { type: 'audio/pcm', rate: 24000 },});
for await (const part of result.fullStream) { if (part.type === 'transcript-delta') { process.stdout.write(part.delta); }}
console.log('\nFinal:', await result.text);Copy link to headingPlayground
Try out gpt-realtime-whisper by OpenAI. Usage is billed to your team at API rates. Free users (those who haven't made a payment) get $5 of credits every 30 days.
gpt-realtime-whisperLive transcription
Speak into your microphone and watch the transcript appear in real time.
Start the session and begin speaking to see the transcript.
Copy link to headingProviders
Route requests across multiple providers. Copy a provider slug to set your preference. Visit the docs for more info. Using a provider means you agree to their terms, listed under Legal.
Copy link to headingMore models by OpenAI
| Model |
|---|
| 1.1M | 2.9 s | 56 tps | $10/M+2 more | $50/M+2 more | Read$1/M Write$12.50/M | $10/K | +4 |  | 09/04/2026 | |||||
| 1.1M | 2.4 s | 156 tps | $0.20/M+2 more | $1.20/M+2 more | Read$0.02/M Write$0.25/M | $10/K | +4 |  | 07/09/2026 | |||||
| 1.1M | 2.6 s | 69 tps | $2/M+2 more | $10/M+2 more | Read$0.20/M Write$2.50/M | $10/K | +4 | | 07/09/2026 | |||||
| 1.1M | 2.6 s | 94 tps | $2/M+2 more | $12/M+2 more | Read$0.20/M Write$2.50/M | $10/K | +4 | | 07/09/2026 | |||||
| 1.1M | 3.5 s | 88 tps | $2.50/M+2 more | $15/M+2 more | Read$0.25/M | $10/K | +4 | | 03/05/2026 | |||||
| 400K | 4.4 s | 208 tps | $0.05/M | $0.40/M | Read$0.005/M | $14/K | +3 | | 08/07/2025 |
Copy link to headingAbout gpt-realtime-whisper
gpt-realtime-whisper arrived on May 7, 2026 as OpenAI's streaming speech-to-text model for realtime transcription. Whisper-generation models transcribe completed audio, which suits recordings and post-session processing. gpt-realtime-whisper is the streaming counterpart, built for live audio where the transcript has to appear during the conversation.
Latency and accuracy are tunable rather than fixed. A delay setting controls how much audio gpt-realtime-whisper hears before emitting text: lower values surface partial text sooner, and higher values give the model more context and improve transcript quality. You can also pass the languages you expect and vocabulary hints, so product names, acronyms, and identifiers come through correctly.
gpt-realtime-whisper accepts audio and text input and returns text, with a context window of 0 tokens and up to varies of transcript output per turn. Pricing is based on audio duration rather than text tokens, so cost tracks minutes of speech and forecasts cleanly from call volume. Current rates are listed on this page.
Audio support on AI Gateway is in beta through AI SDK 7. Your server mints a short-lived token and the client streams audio over a WebSocket connection, so your AI Gateway API key never reaches the browser. You get the same authentication, observability, and spend controls as your text models, with no markup on provider pricing.
Copy link to headingWhat To Consider When Choosing a Provider
- Configuration: gpt-realtime-whisper runs in a persistent streaming session rather than a file upload, so plan for a connection that stays open for the length of the audio. Your interface also has to handle revision, because early partial text can change as more audio arrives.
- Configuration: A delay setting controls the tradeoff. Lower delay produces earlier text, and higher delay gives the model more audio context before it emits, which improves transcript quality. Tune it against production-like audio, including telephony, accents, background noise, and your own domain vocabulary, rather than clean samples.
- Zero Data Retention: Zero Data Retention is offered on a per-provider and model basis. See the documentation for details.
- Authentication: AI Gateway authenticates requests using an API key or OIDC token. You do not need to manage provider credentials directly.
Copy link to headingWhen to Use gpt-realtime-whisper
Best for
- Live Captions: Conferences, webinars, and broadcasts that need text on screen as people speak
- Call Monitoring: Support and sales calls transcribed during the call for supervision or analytics
- Meeting Documentation: Notes captured while the conversation happens instead of afterward
- Voice Input Feedback: Interfaces that show users their words appearing as they speak
- Duration-Based Budgeting: Cost that tracks minutes of audio rather than token counts
Consider alternatives when
- Recorded File Transcription:
whisper-1,gpt-4o-transcribe, andgpt-4o-mini-transcribehandle completed audio - Spoken Replies Required: The gpt-realtime family answers in speech rather than returning text only
- Speech Generation Needed:
tts-1andtts-1-hdturn written text into spoken audio
Copy link to headingConclusion
gpt-realtime-whisper covers the transcription half of live audio: text as the words are spoken, a delay setting you tune to your product, and billing by the minute. Use it for captions, monitoring, and live documentation, and reach for the gpt-realtime voice models when the application also has to talk back.
Copy link to headingFrequently Asked Questions
What does gpt-realtime-whisper do?
gpt-realtime-whisper transcribes live audio into text while someone is still speaking. Transcript text arrives incrementally through a streaming session rather than after the recording ends.
How is gpt-realtime-whisper different from Whisper?
Whisper-generation models transcribe completed audio, which fits recordings and post-session processing. gpt-realtime-whisper is the streaming counterpart, built for live audio where the transcript has to appear during the conversation.
How do I access gpt-realtime-whisper through AI Gateway?
Audio support is in beta through AI SDK 7. Mint a short-lived token on your server with the AI SDK's gateway provider, then stream audio from the client over a WebSocket connection. Your AI Gateway API key never reaches the browser.
Can I trade latency for transcript accuracy?
Yes. A delay setting controls how much audio gpt-realtime-whisper hears before emitting text. Lower delay surfaces partial text sooner, and higher delay gives the model more context and improves transcript quality.
How do I improve accuracy on names and product terms?
Pass vocabulary hints and the languages you expect in the audio. Product names, acronyms, and identifiers come through more reliably when gpt-realtime-whisper knows to expect them.
What context window does gpt-realtime-whisper support?
0 tokens, with up to varies of transcript output per turn. Streaming transcription commits audio in turns, so a long session produces many turns instead of one large response.
How is gpt-realtime-whisper priced?
By audio duration rather than text tokens. Rates are listed on this page and update when providers change list prices, and AI Gateway adds no markup.
Does gpt-realtime-whisper support zero data retention through AI Gateway?
Zero Data Retention is not currently available for this model. Zero Data Retention is offered on a per-provider basis. See https://vercel.com/docs/ai-gateway/capabilities/zdr for details.
What are typical latency characteristics?
This page shows live performance metrics measured across real AI Gateway traffic. Your delay setting also shapes how quickly partial transcript text appears.