HackerTrans
TopNewTrendsCommentsPastAskShowJobs

nomad_horse

no profile record

comments

nomad_horse
·10 ay önce·discuss
> Voxtral outperforms Whisper

Can I stop you right here? Whisper is a few years old and it wasn't the best model for a long time. There are like 10 models that are smaller and faster and outperform both of them.

And these models existed before Voxtral.
nomad_horse
·11 ay önce·discuss
Whisper has the encoder-decoder architecture, so it's hard to run streaming efficiently, though whisper-streaming is a thing.

https://kyutai.org/next/stt is natively streaming STT.
nomad_horse
·12 ay önce·discuss
Do you know if OpenAI used the same grading criteria as official judges?
nomad_horse
·12 ay önce·discuss
isn't he an IOI medalist? and even if he was an IMO medalist, isn't there a bit of a conflict of interests?
nomad_horse
·12 ay önce·discuss
Do I understand it correctly that OpenAI self-proclaimed that they got their gold, without the official IMO judges grading their solutions?
nomad_horse
·12 ay önce·discuss
There are larger models in there, a 8B and a 6B. By this logic they should be above 2B model, yet we don't see this. That's why we have open standard benchmarks, to measure this directly - not hypothesize by the models' sizes or do some cross-dataset arithmetics.

Also note that, Voxtral's capacity is not necessarily all devoted to speech, since it "Retains the text understanding capabilities of its language model backbone"
nomad_horse
·12 ay önce·discuss
> brought back competitive open source audio transcription

Bear in mind that there are a lot of very strong _open_ STT models that Mistral's press-release didn't bother to compare to, making impression they are the best new open thing since Whisper. Here is an open benchmark: https://huggingface.co/spaces/hf-audio/open_asr_leaderboard . The strongest model Mistral compared to is Scribe, ranked 10 here.

This benchmark is for English, but many of those models are multilingual (eg https://huggingface.co/nvidia/canary-1b-flash )