🎤 Micdrop

Voxtral Mini 3B

Tested as the transcription, instead of Whisper. It transcribes French more accurately, but it takes 35 times longer per utterance, which is too slow for a call.

Voxtral Mini transcribes, translates and answers questions about audio. There is a community ONNX export, so it runs in Node through Transformers.js, like Whisper. examples/advanced/server/src/tests/voxtral-stt.ts runs it on French sentences spoken by Piper, with weights in q4 on CPU:

ModelPer utteranceWord errors
Voxtral Mini 3B~16600 ms17 %
Whisper base~470 ms34 %
Whisper french~1200 ms11 %

Voxtral is more accurate than Whisper base, but 35 times slower, because it transcribes by generating tokens with a 3 billion parameter model, where Whisper runs an encoder and a small decoder. Whisper french is more accurate than both and takes a fourteenth of Voxtral’s time. The weights take 3 GB in q4. Transformers.js fails when it downloads files that large, so download them with hf download first.