Sorry, haven't messed around too much with optimizations. I thought it was quite fast compared to Tortoise for example (where generation speed was at a 3:1 ratio).
I've used coqui.ai's TTS models[0] and library[1] to great success. I was able to get cloned voice to be rendered in about 80% of the audio clip length, and I believe you can also stream the response. Do note the model license for XTTS, it is one they wrote themselves that has some restrictions.
XTTS has a streaming mode with ~300ms latency and sounds good, though it has hallucination issues. StyleTTS2 sounds good and doesn't hallucinate as much. It doesn't support streaming but it's fast so it can still respond quickly. But neither of them sound as good as Eleven Labs or OpenAI or this one.
Comments
Are there any decent TTS models that can be ran locally that plugs into existing software like SAPI without too much lag?
Bark and Tortoise work fairly well. Bark does super fast inference[1] on my M1.
[1] https://github.com/SaladTechnologies/bark
@dvt Is this just a containerized version of Bark? Wondering if this repo has M1-specific improvements.
I think so.
I'm finding M1 generation quite slow (CPU-only) on the stock Bark—any tips on speeding it up?
Sorry, haven't messed around too much with optimizations. I thought it was quite fast compared to Tortoise for example (where generation speed was at a 3:1 ratio).
I've used coqui.ai's TTS models[0] and library[1] to great success. I was able to get cloned voice to be rendered in about 80% of the audio clip length, and I believe you can also stream the response. Do note the model license for XTTS, it is one they wrote themselves that has some restrictions.
[0] https://huggingface.co/coqui/XTTS-v2
[1] https://github.com/coqui-ai/TTS
XTTS has a streaming mode with ~300ms latency and sounds good, though it has hallucination issues. StyleTTS2 sounds good and doesn't hallucinate as much. It doesn't support streaming but it's fast so it can still respond quickly. But neither of them sound as good as Eleven Labs or OpenAI or this one.