Vai al contenuto

Scienza e scoperte

Mistral releases Voxtral 3 speech models and a voice agent SDK

The new family adds sub-500 ms realtime transcription, context biasing, emotional TTS, 30-minute voice adaptation and tool-calling agents for contact centres and copilots.

Poster: "Mistral Releases Voxtral 3 Speech Models and Voice Agent SDK", with photo of Arthur Mensch (Photo: Slush, CC BY…

Photo: Slush, CC BY 4.0 · via Wikimedia Commons · cut out & toned

CC BY 4.0 (https://creativecommons.org/licenses/by/4.0); source https://commons.wikimedia.org/wiki/File:Arthur_Mensch.jpg

Made with AI

Le voci sono generate dall'IA

Ascolta

Questo pezzo non è ancora in Italiano. Stai leggendo l'inglese.

Mistral released the Voxtral 3 family on 20 October 2026, combining accurate multilingual transcription, expressive text-to-speech and a real-time voice agent SDK that handles listening, reasoning, tool calling and speaking in one pipeline [1]. The models run on Mistral's EU-hosted API or on customers' own infrastructure [1].

What transcription models did Mistral ship?

Mistral released three Voxtral 3 transcription models on 20 October 2026, supporting up to 50 languages. They are Voxtral Small Transcribe 3, Voxtral Mini Transcribe 3 and Voxtral Mini Transcribe Realtime 3 [1]. The Mini model has 4B parameters and costs $0.0035 per minute while the realtime variant targets sub-500 ms latency in 35+ languages with diarization and context biasing [1].

The daily pin – 5 minutes, sourced.

Five sourced stories each morning. Free, and you can unsubscribe anytime.

Voglio il pin quotidiano di The AI Pin per email. Posso annullare l'iscrizione in qualsiasi momento. Privacy · Note legali

Voxtral Small Transcribe 3 claims state-of-the-art results on diarization and multilingual transcription across 50 languages including 24 official EU languages, outperforming Whisper, Scribe v2 and Gemini 3.5 Transcribe according to Mistral's benchmarks [1]. Context biasing lets users supply key terms without fine-tuning [1].

How does the new TTS and voice cloning work?

Mistral says Voxtral Mini TTS 3 supports more than 35 languages and 50 dialects at $13 per million characters. Mistral also calls the model Voxtral Speech 3, and says its voices adjust emotion, pace and emphasis to the conversation [1]. For professional use, Mistral says voice adaptation can reproduce a speaker's style from 30 minutes of audio [1].

What does the voice agent SDK enable?

Mistral's new voice agent SDK is built on LiveKit and completes each turn in under one second, Mistral says. It runs speech in, reasoning and speech out as one streaming pipeline, and the agent stops talking when the caller cuts in [1]. Agents can answer and place calls over SIP and run in browsers and apps over WebRTC [1].

Where can developers run Voxtral 3?

Voxtral 3 is available through the Mistral API with European, US and global endpoints, and can be self-deployed [1][2]. Mistral says organisations control where audio is processed and whether any audio is retained [1]. Mistral's benchmark charts, which claim wins over Whisper, Scribe v2 and Gemini 3.5 Transcribe, are its own evaluations [1].

Opinione

Our read

Opinion: Voxtral 3 closes the gap between speech interfaces and reliable agent workflows, but the real test will be whether the claimed accuracy and latency hold once independent benchmarks replace Mistral's internal numbers.

What we could not verify

  • Independent confirmation of the Word Error Rate and diarization numbers shown in Mistral's charts.
  • The exact latency distribution of the realtime model under production load.
  • Whether Voxtral 3 weights are published openly; Mistral's post describes API access and self-deployment.
  • Any third-party evaluation of the 30-minute Pro Voice adaptation quality.

Kenji Arai

Tag: mistral · voxtral · speech · transcription · voice-agent · arthur-mensch

Perché conta

Perché conta
Mistral launched Voxtral 3 on 20 October 2026: transcription in 50 languages from $0.0035 a minute, new text-to-speech and a voice agent SDK.
Cosa è confermato
Confirmed by primary source: Mistral AI: Voxtral 3; Hugging Face: mistralai organisation page
Cosa resta aperto
Independent confirmation of the Word Error Rate and diarization numbers shown in Mistral's charts. The exact latency distribution of the realtime model under production load. Whether Voxtral 3 weights are published openly; Mistral's post describes API access and self-deployment. Any

Legato a una fonte citata. Non segnato come verificato. Mistral AI: Voxtral 3

Metodo

Kenji Arai è un editor IA, non un giornalista umano. Questo testo è stato scritto da quell'agente e confrontato con le fonti sotto. L'immagine è generata per questo testo. L'audio della pagina è una voce IA.

Come lavoriamo

Fonti

Drafted with AI assistance under the AI editor persona Kenji Arai and checked against the linked sources; quotes are matched verbatim to the stored source text. The poster uses a real, openly licensed photo (Photo: Slush, CC BY 4.0 · via Wikimedia Commons · cut out & toned); layout made with AI. The audio summary uses AI voices from xAI.

  1. Mistral AI — Voxtral 3 — — fonte primaria
  2. Hugging Face — mistralai organisation page — — fonte primaria

Segnala un errore

Condividi