Deepgram API vs LiveKit Agents

Converts live audio streams to text via WebSocket (WSS) protocol with ultra-low latency processing. Deepgram's Flux models process audio chunks incrementally, detecting natural speech boundaries and returning partial transcripts in real-time without waiting for audio completion. Supports 150-225 concurrent WebSocket connections depending on tier, enabling high-throughput voice applications.

Unique: Flux models are purpose-built for conversational speech with turn-taking detection and interruption handling, processing audio incrementally via WebSocket to return partial results before audio ends — unlike batch-only APIs. Supports 10-language multilingual conversations within a single stream without language switching overhead.

vs alternatives: Faster real-time response than Google Cloud Speech-to-Text or AWS Transcribe because Flux models emit partial transcripts mid-speech rather than waiting for audio completion, enabling immediate downstream processing.

Processes pre-recorded audio files via REST API with automatic speaker identification and segmentation. Nova-3 models analyze complete audio files to detect multiple speakers, assign speaker labels, and return structured transcripts with speaker turns and timing information. Handles background noise, crosstalk, and far-field audio through deep learning-based noise robustness.

Unique: Nova-3 Multilingual model automatically detects language across 45+ languages without pre-configuration, and speaker diarization works across all supported languages — enabling single API call for multilingual multi-speaker content. Handles far-field and noisy audio through specialized training.

vs alternatives: More cost-effective than Whisper Cloud for batch processing (Nova-3 pricing undercuts Whisper), and includes speaker diarization natively without separate API calls or post-processing.

Deepgram offers custom model training for organizations with proprietary speech patterns, accents, or domain-specific audio characteristics. Custom models are trained on customer-provided datasets and deployed as dedicated endpoints. Enables organizations to achieve higher accuracy on edge-case audio (heavy accents, background noise, specialized vocabulary) that generic models struggle with.

Unique: Custom models are trained on customer data and deployed as isolated endpoints, ensuring proprietary speech patterns remain private and not mixed into public models. Deepgram handles full training pipeline including data validation, model optimization, and endpoint provisioning.

vs alternatives: More private than using public models (no data leakage to competitors); more cost-effective than building in-house speech recognition infrastructure; faster than training custom models from scratch because Deepgram provides pre-trained foundation.

Automatically applies formatting rules to transcripts to improve readability without manual post-processing. Converts numbers to digits, adds punctuation, capitalizes proper nouns, and formats currency/dates according to locale. Smart formatting operates on raw transcription output, transforming 'one thousand two hundred thirty four dollars' to '$1,234' and 'the meeting is on january fifteenth' to 'The meeting is on January 15th'.

Unique: Smart formatting is applied during transcription post-processing, not as separate API call — integrated into response pipeline to avoid latency. Handles multiple formatting types (numbers, dates, currency, punctuation) in single pass.

vs alternatives: More efficient than calling separate text formatting API because formatting is built into Deepgram's response; more accurate than regex-based post-processing because formatting rules understand speech context.

Flux Multilingual model supports 10 languages (English, Spanish, German, French, Hindi, Russian, Portuguese, Japanese, Italian, Dutch) within a single WebSocket stream, automatically detecting language switches mid-conversation. Enables applications to handle multilingual users without requiring separate connections or language pre-specification. Language detection happens continuously throughout the stream.

Unique: Flux Multilingual detects language switches continuously within a single stream without reconnection or model switching — language detection is per-segment, not per-stream. Enables seamless multilingual conversations without user intervention.

vs alternatives: More seamless than competitors requiring separate API calls per language or manual language selection; lower latency than sequential language detection because detection is integrated into transcription model.

Deepgram enforces concurrent connection limits that vary by API type and subscription tier. WebSocket STT supports 150 (free/pay-as-you-go) or 225 (Growth tier) concurrent connections; REST STT/TTS limited to 50 concurrent; Voice Agent API limited to 45 (free) or 60 (Growth) concurrent; Audio Intelligence limited to 10 concurrent regardless of tier. Developers must manage connection pooling and queuing to respect these limits.

Unique: Concurrency limits are enforced per API type and tier, with WebSocket getting higher limits than REST — reflects Deepgram's architecture where WebSocket is more efficient for streaming. Audio Intelligence has universal 10-concurrent cap, creating asymmetric bottleneck.

vs alternatives: More transparent than some competitors about concurrency limits; Growth tier upgrade provides meaningful concurrency increase for WebSocket (150→225) but not for REST or Audio Intelligence.

Deepgram offers free tier with $200 credit that never expires, no credit card required to sign up. Free tier includes access to all public models (Flux, Nova-3) and all endpoints (STT, TTS, Voice Agent, Audio Intelligence) at full concurrency limits (150 WebSocket STT, 50 REST, etc.). Developers can build and test production applications without payment until credit is exhausted.

Unique: Non-expiring $200 credit is unusual in the industry — most competitors offer monthly free tier or time-limited trial. No credit card requirement lowers barrier to entry for developers.

vs alternatives: More generous than Google Cloud Speech-to-Text free tier (60 minutes/month) or AWS Transcribe free tier (250 minutes/month); non-expiring credit is better than time-limited trials because developers can work at their own pace.

Deepgram offers two pricing models: pay-as-you-go (per-minute consumption) and Growth tier (pre-paid annual credits with 10-20% discount). Pay-as-you-go pricing ranges from $0.0048/min (Nova-3 Monolingual) to $0.0078/min (Flux Multilingual) for STT. Growth tier offers same models at discounted rates ($0.0042-$0.0068/min) with pre-paid annual commitment. Pricing is per-minute of audio processed, not per request.

Unique: Pricing is per-minute of audio processed, not per API call — transparent and predictable for high-volume applications. Growth tier discount (10-20%) is modest compared to some competitors but no minimum commitment required.

vs alternatives: More transparent than competitors with opaque enterprise pricing; per-minute pricing is fairer than per-request for long-form audio; Growth tier discount is smaller than some competitors (AWS, Google) but no long-term contract lock-in.

livekit/agents | DeepWiki Loading... Index your code with Devin DeepWiki DeepWiki livekit/agents Index your code with Devin Edit Wiki Share Loading... Last indexed: 18 May 2026 ( d687d9 ) Overview Quick Start Project Structure and Versioning Core Architecture AgentServer and Job Management AgentSession and AgentActivity Voice Processing Pipeline Building Agents Agent Class and Instructions Function Tools Session Events and State Management Custom Agent Nodes Background Audio, IVR, and AMD Room I/O System Audio and Video Input Audio and Text Output Transcription Synchronization Session Recording Avatar Agents AI Model Providers LLM Providers Speech-to-Text Providers Text-to-Speech Providers Realtime Models VAD and Utilities Plugin Adapters and Patterns LiveKit Cloud Inference Gateway Development Tools CLI Modes Live Reloading and WatchServer Console Mode Jupyter Integration Production Deployment Process Pool and Scaling Telemetry and Observability Configuration and Environment Advanced Topics Agent Handoffs and Workflows Chat Context Management Testing and Evaluation Remote Sessions and Distributed Agents Durable Functions and Serializable Coroutines Glossary Menu Overview Relevant source files .github/banner_dark.png .github/banner_light.png README.md examples/voice_agents/push_to_talk.py examples/voice_agents/resume_interrupted_agent.py

Core Architecture | livekit/agents | DeepWiki Loading... Index your code with Devin DeepWiki DeepWiki livekit/agents Index your code with Devin Edit Wiki Share Loading... Last indexed: 18 May 2026 ( d687d9 ) Overview Quick Start Project Structure and Versioning Core Architecture AgentServer and Job Management AgentSession and AgentActivity Voice Processing Pipeline Building Agents Agent Class and Instructions Function Tools Session Events and State Management Custom Agent Nodes Background Audio, IVR, and AMD Room I/O System Audio and Video Input Audio and Text Output Transcription Synchronization Session Recording Avatar Agents AI Model Providers LLM Providers Speech-to-Text Providers Text-to-Speech Providers Realtime Models VAD and Utilities Plugin Adapters and Patterns LiveKit Cloud Inference Gateway Development Tools CLI Modes Live Reloading and WatchServer Console Mode Jupyter Integration Production Deployment Process Pool and Scaling Telemetry and Observability Configuration and Environment Advanced Topics Agent Handoffs and Workflows Chat Context Management Testing and Evaluation Remote Sessions and Distributed Agents Durable Functions and Serializable Coroutines Glossary Menu Core Architecture Relevant source files examples/voice_agents/push_to_talk.py examples/voice_agents/resume_interrupted_agent.py livekit-agents/livekit/agents/__init_

AgentServer and Job Management | livekit/agents | DeepWiki Loading... Index your code with Devin DeepWiki DeepWiki livekit/agents Index your code with Devin Edit Wiki Share Loading... Last indexed: 18 May 2026 ( d687d9 ) Overview Quick Start Project Structure and Versioning Core Architecture AgentServer and Job Management AgentSession and AgentActivity Voice Processing Pipeline Building Agents Agent Class and Instructions Function Tools Session Events and State Management Custom Agent Nodes Background Audio, IVR, and AMD Room I/O System Audio and Video Input Audio and Text Output Transcription Synchronization Session Recording Avatar Agents AI Model Providers LLM Providers Speech-to-Text Providers Text-to-Speech Providers Realtime Models VAD and Utilities Plugin Adapters and Patterns LiveKit Cloud Inference Gateway Development Tools CLI Modes Live Reloading and WatchServer Console Mode Jupyter Integration Production Deployment Process Pool and Scaling Telemetry and Observability Configuration and Environment Advanced Topics Agent Handoffs and Workflows Chat Context Management Testing and Evaluation Remote Sessions and Distributed Agents Durable Functions and Serializable Coroutines Glossary Menu AgentServer and Job Management Relevant source files livekit-agents/livekit/agents/cli/cli.py livekit-agents/livekit/agents/cli/log.py livekit-agents/li

livekit/agents | DeepWiki Loading... Index your code with Devin DeepWiki DeepWiki livekit/agents Index your code with Devin Edit Wiki Share Loading... Last indexed: 18 May 2026 ( d687d9 ) Overview Quick Start Project Structure and Versioning Core Architecture AgentServer and Job Management AgentSession and AgentActivity Voice Processing Pipeline Building Agents Agent Class and Instructions Function Tools Session Events and State Management Custom Agent Nodes Background Audio, IVR, and AMD Room I/O System Audio and Video Input Audio and Text Output Transcription Synchronization Session Recording Avatar Agents AI Model Providers LLM Providers Speech-to-Text Providers Text-to-Speech Providers Realtime Models VAD and Utilities Plugin Adapters and Patterns LiveKit Cloud Inference Gateway Development Tools CLI Modes Live Reloading and WatchServer Console Mode Jupyter Integration Production Deployment Process Pool and Scaling Telemetry and Observability Configuration and Environment Advanced Topics Agent Handoffs and Workflows Chat Context Management Testing and Evaluation Remote Sess