I’ve been playing around with the Whisper models for a few years now. Last year I had an idea about how to run Whisper Large v3 in real time. That idea became ScribeAI.
Because the quality of transcripts was so high, much higher than I could get with Parakeet, I started to think about how it would serve as a good input for live translation. I played around with this and was surprised by how good the results is, I’ve used it to follow along political speech’s from foreign leaders and other content I’d have just never been able to consume before. You can translate by bringing your own LLM service API key or using the inbuilt Apple Translate models (for a completely offline experience).
Putting more out there will increase the probability of a reward, but it doesn’t guarantee it.