Press "Enter" to skip to content

Posts tagged as “Multilingual Speech-to-Text”

Google Launches Gemini 3.5 Transcribe for Precise Multilingual Speech-to-Text

From blog.google;

Today, we’re introducing Gemini 3.5 Transcribe, our most precise speech-to-text model yet, designed for intelligent voice interactions. Unlike conventional speech recognition models that struggle with background noise, complex jargon, and disfluency cleanup, Gemini 3.5 Transcribe converts raw audio directly into accurate, polished, formatted text.

Key Technical Capabilities

  • Automated Code-Switching & Language Detection: Supports over 85 languages and regional locales automatically. It dynamically handles sentence-level and intra-sentence language switching (code-mixing) without requiring pre-configured language hints.
  • Smart Transcription & Disfluency Removal: Automatically strips out filler words (e.g., “um,” “ah”), cleans up mid-sentence self-corrections, and normalizes spoken text into structured formats—converting phrases like “twenty five dollars” directly into “$25”.
  • Custom Vocabulary Biasing: Developers can supply up to 1,000 custom terms, acronyms, or domain-specific jargon phrases to ensure accurate recognition of specialized names and terminology.
  • Speed & Accuracy Benchmarks: Delivers a 70% faster time-to-final-transcription compared to Chirp 3. According to Artificial Analysis measurements, it achieves a 2.6% Word Error Rate (WER) on non-streaming tasks and a 4.0% WER in streaming mode.
  • Speaker Diarization & Word-Level Timestamps: Attributes speech segments for up to 8 distinct speakers and generates start and end time offsets down to the individual word for precise media indexing.

Dual Integration Paths

Feature / Model gemini-3.5-transcribe (Interactions API) gemini-3.5-transcribe-live (Live API)
Primary Use Case Recorded audio files, meeting logs, interviews Sub-second real-time streaming, voice agents
Max Audio Length Up to 1 hour (30 min with timestamps/diarization) 10 minutes per active session
Word-Level Timestamps Supported Not Supported
Speaker Diarization Supported (Up to 8 speakers) Not Supported

Consumer & Ecosystem Availability

In addition to developer access via Google AI Studio and Google Antigravity, Google is integrating Gemini 3.5 Transcribe across its wider product ecosystem:

  • Android (Gboard Rambler): Powers “Rambler,” converting long-form spoken thoughts into formatted notes and allowing voice-driven style updates.
  • Desktop & Browsers: Drives voice interaction in the Gemini macOS app, integrates screen context via Antigravity to increase spelling accuracy, and will soon enable direct voice-to-text dictation across Chrome web fields.