A one stop shop to track all open-access/ source TTS models as they come out. Feel free to make a PR for all those that aren't linked here.
This is aimed as a resource to increase awareness for these models and to make it easier for researchers, developers, and enthusiasts to stay informed about the latest advancements in the field.
Note
This repo will only track open source/access codebase TTS models. More motivation for everyone to open-source! 🤗
| Name | GitHub | Weights | License | Open Source License | Fine-tune | Languages | Paper | Demo | License Issues |
|---|---|---|---|---|---|---|---|---|---|
| XTTS | Repo | 🤗 Hub | CPML | No | Yes | Multilingual | Technical notes | 🤗 Space | |
| TorToiSe TTS | Repo | 🤗 Hub | Apache 2.0 | Yes | Yes | English | Technical report | 🤗 Space | |
| VITS/ MMS-TTS | Repo | 🤗 Hub / MMS | Apache 2.0 | Yes | Yes | English | Paper | 🤗 Space | |
| Pheme | Repo | 🤗 Hub | CC-BY | Yes | Yes | English | Paper | 🤗 Space | |
| OpenVoice | Repo | 🤗 Hub | CC-BY-NC 4.0 | No (soon) | No | ZH + EN | Paper | 🤗 Space | |
| IMS-Toucan | Repo | GH release | Apache 2.0 | Yes | Yes | Multilingual | Paper | 🤗 Space | |
| Matcha-TTS | Repo | GDrive | MIT | Yes (Issue) | Yes | English | Paper | 🤗 Space | Inference relies on GPL-licensed phonemizer |
| pflowTTS | Unofficial Repo | GDrive | MIT | Yes (Issue) | Yes | English | Paper | Not Available | Inference relies on GPL-licensed phonemizer |
| StyleTTS 2 | Repo | 🤗 Hub | MIT | Yes (Issue) | Yes | English | Paper | 🤗 Space | Inference relies on GPL-licensed phonemizer |
| VALL-E | Unofficial Repo | Not Available | MIT | Yes | Yes | NA | Paper | Not Available | |
| HierSpeech++ | Repo | GDrive | CC-BY-NC-SA 4.0 | No | No | KR + EN | Paper | 🤗 Space | |
| Bark | Repo | 🤗 Hub | MIT | Yes | No | Multilingual | Paper | 🤗 Space | |
| EmotiVoice | Repo | GDrive | Apache 2.0 | Yes? | Yes | ZH + EN | Not Available | Not Available | Has a separate agreement for the GUI |
| Amphion | Repo | 🤗 Hub | MIT | Yes | No | Multilingual | Paper | 🤗 Space |
Help make this list more complete. Create demos on the Hugging Face Hub and link them here :) Got any questions? Drop me a DM on Twitter @reach_vb.