HackerTrans
TopNewTrendsCommentsPastAskShowJobs

watsonmusic

no profile record

Submissions

Microsoft releases VibeVoice, generates 90-minute, 4-speaker audio

microsoft.github.io
3 points·by watsonmusic·قبل 11 شهرًا·3 comments

comments

watsonmusic
·قبل 10 أشهر·discuss
it's not oss
watsonmusic
·قبل 10 أشهر·discuss
bonus usage
watsonmusic
·قبل 10 أشهر·discuss
11labs is facing a real competitor
watsonmusic
·قبل 10 أشهر·discuss
genius
watsonmusic
·قبل 10 أشهر·discuss
this model is superb
watsonmusic
·قبل 10 أشهر·discuss
Microsoft is cool
watsonmusic
·قبل 10 أشهر·discuss
yes the best
watsonmusic
·قبل 10 أشهر·discuss
one of the best models built by Microsoft
watsonmusic
·قبل 11 شهرًا·discuss
https://github.com/microsoft/VibeVoice
watsonmusic
·قبل 11 شهرًا·discuss
https://huggingface.co/microsoft/VibeVoice-1.5B
watsonmusic
·قبل 11 شهرًا·discuss
VibeVoice is a novel framework designed for generating expressive, long-form, multi-speaker conversational audio, such as podcasts, from text. It addresses significant challenges in traditional Text-to-Speech (TTS) systems, particularly in scalability, speaker consistency, and natural turn-taking. A core innovation of VibeVoice is its use of continuous speech tokenizers (Acoustic and Semantic) operating at an ultra-low frame rate of 7.5 Hz. These tokenizers efficiently preserve audio fidelity while significantly boosting computational efficiency for processing long sequences. VibeVoice employs a next-token diffusion framework, leveraging a Large Language Model (LLM) to understand textual context and dialogue flow, and a diffusion head to generate high-fidelity acoustic details. The model can synthesize speech up to 90 minutes long with up to 4 distinct speakers, surpassing the typical 1-2 speaker limits of many prior models.
watsonmusic
·السنة الماضية·discuss
cannot wait seeing how it goes beyond the current llm training pipeline
watsonmusic
·السنة الماضية·discuss
it could be adaptive. only high-value tokens were allocated with more compute
watsonmusic
·السنة الماضية·discuss
A new scaling paradigm finally comes out!
watsonmusic
·السنة الماضية·discuss
14b model performs comparably with 32b size. the improvement is huge
watsonmusic
·قبل سنتين·discuss
[dead]
watsonmusic
·قبل سنتين·discuss
[dead]
watsonmusic
·قبل سنتين·discuss
[dead]
watsonmusic
·قبل سنتين·discuss
[dead]
watsonmusic
·قبل سنتين·discuss
negative values can enhance the expressibility