π£οΈ Open TTS Tracker
February 13, 2025 Β· View on GitHub
A one stop shop to track all open-access/ source TTS models as they come out. Feel free to make a PR for all those that aren't linked here.
This is aimed as a resource to increase awareness for these models and to make it easier for researchers, developers, and enthusiasts to stay informed about the latest advancements in the field.
Note
This repo will only track open source/access codebase TTS models. More motivation for everyone to open-source! π€
Capability specifics
Click on this to toggle table visibility
| Name | Processor β‘ | Phonetic alphabet π€ | Insta-clone π₯ | Emotional control π | Prompting π | Speech control π | Streaming support π | S2S support π¦ | Longform synthesis |
|---|---|---|---|---|---|---|---|---|---|
| Amphion | CUDA | π₯ | ππ₯ | β | |||||
| Bark | CUDA | β | π tags | β | |||||
| EmotiVoice | |||||||||
| Fish-speech | CUDA | β | π₯ | ππ₯ | β | speed / stability π | π | π¦ | Yes |
| Glow-TTS | |||||||||
| GPT-SoVITS | |||||||||
| HierSpeech++ | β | π₯ | ππ₯ | β | speed / stability π | π¦ | |||
| IMS-Toucan | CUDA | β | β | β | β | ||||
| Kokoro | CPU / CUDA | π₯ | β | β | β | speed π | π | β | |
| Llasa | CUDA | β | π₯ | π | β | β | β | β | |
| MahaTTS | |||||||||
| Matcha-TTS | IPA | β | β | β | speed / stability π | ||||
| MetaVoice-1B | CUDA | π₯ | ππ₯ | β | stability / similarity π | Yes | |||
| Neural-HMM TTS | |||||||||
| OpenVoice | CUDA | β | π₯ | 6-type π π‘πππ―π€«π | β | ||||
| OuteTTS | CPU / CUDA | β | π₯ | β | β | speed π | π | β | |
| OverFlow TTS | |||||||||
| pflowTTS | |||||||||
| Piper | |||||||||
| Pheme | CUDA | β | π₯ | ππ₯ | β | stability π | |||
| RAD-TTS | |||||||||
| Silero | |||||||||
| StyleTTS 2 | CPU / CUDA | IPA | π₯ | ππ₯ | β | π | Yes | ||
| Tacotron 2 | |||||||||
| TorToiSe TTS | β | β | β | π | π | ||||
| TTTS | CPU/CUDA | β | π₯ | ||||||
| VALL-E | |||||||||
| VITS/ MMS-TTS | CUDA | β | β | β | β | speed π | |||
| WhisperSpeech | CUDA | β | π₯ | ππ₯ | β | speed π | |||
| XTTS | CUDA | β | π₯ | ππ₯ | β | speed / stability π | π | β | |
| xVASynth | CPU / CUDA | ARPAbet+ | β | 4-type π π‘πππ― perβphoneme | β | speed / pitch / energy / π π perβphoneme | β | π¦ | |
| Zonos | CUDA | eSpeak | π₯ | π | β | speed / pitch / quality / emotion π | β | β |
- Processor - CPU/CUDA/ROCm (single/multi used for inference; Real-time factor should be below 2.0 to qualify for CPU, though some leeway can be given if it supports audio streaming)
- Phonetic alphabet - None/IPA/ARPAbet
(Phonetic transcription that allows to control pronunciation of certain words during inference) - Insta-clone - Yes/No (Zero-shot model for quick voice clone)
- Emotional control - Yesπ/Strict (Strict, as in has no ability to go in-between states, insta-clone switch/ππ₯)
- Prompting - Yes/No (A side effect of narrator based datasets and a way to affect the emotional state, ElevenLabs docs)
- Streaming support - Yes/No (If it is possible to playback audio that is still being generated)
- Speech control - speed/pitch/
(Ability to change the pitch, duration, energy and/or emotion of generated speech) - Speech-To-Speech support - Yes/No (Streaming support implies real-time S2S; S2T=>T2S does not count)
How can you help?
Help make this list more complete. Create demos on the Hugging Face Hub and link them here :) Got any questions? Drop me a DM on Twitter @reach_vb.