r/LocalLLaMA • u/9r4n4y • 18h ago
Showcase Breezeblue-tts-2 is currently the best tts model available right now, and it beats moss tts 1.5.
Its currently THE BEST tts model available locally but sadly it has a non-commercial license.
For free to use license: moss tts 1.5 is the best model rn.
https://huggingface.co/BreezeBlue/Breeze-TTS-2
---
Voice1 - infographics on yt
Voice2 - someordinarygamer on yt
EDIT: i have tested it against omnivoice and i can say that omnivoice is 80% of it, with 2x the speed, and lesser memory needs.
18
10
u/Blizado 17h ago
Too heavy and only English and Chinese. I hope for a OmniVoice v2 model.
3
u/GrungeWerX 15h ago
Yes! Omnivoice is the clear winner for voice cloning. It just needs to do expressions and performances, so Im also hoping for a v2, because its cloning is unmatched. Passed all my voice clone tests.
1
u/9r4n4y 14h ago
Just tried it and i loved it, i am also hoping for V2
2
u/GrungeWerX 13h ago
Yeah, it's boss. I tried it on some very niche actresses from the 80s, and it nailed them! It was even able to emulate a very difficult cartoon character's fake accent that has no real-life equiavalent to go off.
My typical voice cloning tests are usually a range of rare and distinct actors/actresses that most people probably never heard of, along with some more well-known ones as well, like rebecca ferguson. Accents really prove the model's abilities.
That said, it could be better. Mostly performance and artifacts are an issue, but it's still very useful.
1
1
u/Thistlemanizzle 11h ago
One shot 5 second or massive corpus of example? Both are fine by me.
1
u/GrungeWerX 10h ago
Not sure who your response is for, but in case it was my comment, I always do my tests with 2-3 dense paragraphs of text minimum. That gives you a good sample, and the weaknesses/mistakes will show up within that range pretty quickly.
1
u/Thistlemanizzle 9h ago
I meant voice samples to clone.
1
u/GrungeWerX 8h ago
Oh, gotcha. I typically use like 15-20 seconds. I haven't sampled a lot more, so I'm not sure if it helps w/omnivoice. I try to get a normal conversational range with a few high/low pitches. I mostly play it by ear. It changes depending on the person. It also depends on the performance.
There's too many people to name, but off the top of my head: Ornella muti, florence pugh, rebecca ferguson, charlotte rampling, just to name a few. they all have very distinct voices, so you'll learn really fast which models are good and which aren't.
1
u/Thistlemanizzle 8h ago
When I looked at Chatterbox, Qwen 3.5(?) TTS and a few others, they only supported 10 second one shot.
Only Elevenlabs at that time supported 30 minute super duper fine-tuning - that's what I want. I've got 20 minutes of amazing isolated audio I want to clone.
1
u/Blizado 6h ago
I finetuned OmniVoice with a TTS (single) voice dataset from Sonic 3.6 / Elevenlabs V3 with around 40 minutes data, it improves the stability of the voice a lot. I also generated ref audios with different emotions, OmniVoice is very good at following emotions from the ref audio. But sure, a true OmniVoice v2 with emotion tags would be better.
→ More replies (0)
3
u/GrungeWerX 15h ago
It’s not that great at voice clone, I’ve tested it and omnivoice beats it at Italian accents. Breeze gave them an Indian accent instead. I didn’t do a lot of testing because it immediately failed my default tests ; I have a small group of voices I use to test every voice model.
That said, from the little I heard, the voice expression sounded decent.
2
u/letsgoiowa 16h ago
I absolutely love it. I used it to narrate an entire book and it's almost perfect. It has some weird background noises in it here and there (like coughing or some weird glitch noise) but it's maybe like 1 an hour. Very close to perfect.
2
u/DoctorEnema 16h ago
For anyone interested, I made a derivitive that runs real time on Apple Silicon and takes less RAM while sounding pretty much the same (or close enough) to my ears.
In a blind test I often couldn't tell between this and full precision, and sometimes it even sounded better, but that just might be luck. I think it's pretty good.
Samples included here.
https://huggingface.co/Shoof/Gust-MLX
2
u/Cultured_Alien 15h ago
Does it beat omnivoice or higgs at cloning?
1
u/Yorn2 6h ago edited 6h ago
Even MOSS-TTS 1.5 beats both of those, IMHO. I know people like to talk about Qwen and Omnivoice and etc, but for pure voice cloning, MOSS-TTS is one of those engines everyone just completely ignored unless they actually tested them all side-by-side. The only part that sucks about it is small/short generations don't come out sounding good at all, but for like 95% of use cases, MOSS-TTS has been the best and everyone just kind of talks about all the others for some reason.
I blame the audio benchmarkers which, for whatever reason, don't seriously do side-by-side testing.
All that said, it's very likely that BreezeTTS2 is right up there or surpassing MOSS-TTS.
1
2
u/Embarrassed_Soup_279 5h ago
im just gonna dump some of my thoughts on some of the tts i have tried.
breeze tts 2 is 10000% the best model thats around rn and its only 2b params. its actually so good. i have compared it with both moss tts 1.5 8b but both have their own quirks imo. for me, i think moss tts 1.5 has more interesting variety in its generations, which is both good and bad depending on your use case. its basically the new vibevoice-7b. the bad part about breeze tts 2 is that it only supports EN/CN, while moss tts 1.5 has 31 languages.
higgs audio v3 has one of the best multilingual pronunciations of all tts i have tested from a single language voice reference. unfortunately, voice cloning speaker similarity is mid, and it talks like a robot. the similar alternative would be fish audio s2 pro which has better natural speaking but it doesnt have as good pronunciation for other languages from the single reference source. both have sfx tags.
omnivoice is a decent allrounder, and small. its definitely not the best but if you need something that just works for almost every use case, it would be it.
there was also a "new" model released by fishaudio called Drama 3 recently. i havent had the chance to test it yet, but its an open weights TTS. unfortunately its massive at 35b a3b and the license is kinda trash.
4
u/swagonflyyyy 17h ago
It sounds very realistic. Too bad license is non-commercial. Also, 24GB VRAM for CUDAGraphs? Yikes.
5
u/Stepfunction 17h ago edited 17h ago
With the Q4 GGUF, it takes 4.4GB of VRAM roughly. Q8 takes about 5.3GB. BF16 is 7.3GB.
1
u/FinBenton 15h ago
Its by no means a bad tts but it gets so unstable with instructions so I rather use it without them and at that point OmniVoice gets fairly close enough results while being faster and less vram and knows more languages so I kinda stuck with omni.
1
1
u/over-yonder-tech 7h ago
I'd immediately click off if I landed on a short or a video with the first voice. But with the second one it's getting to the point where the manifesto rhetorical style (per second clip) is the thing I'd notice first, before the voice or the Fern style animations. Sloptube is going to have to get better at writing next, it seems.
1
u/winky9827 4h ago
I'll be happy when I find a TTS model that can do long form narration without sudden hitches in intonation between chunks. I've tried dozens, all suffer from it. :(
14
u/Stepfunction 17h ago edited 16h ago
Been using it in audio.cpp and not only is it great at voice cloning, but it also allows for adding instruct descriptions of how you'd like the voice to sound.
For faster generation without the instruct capability, I still really like Omnivoice as well.