Best Text to Speech Software for Hugging Face

Zyphra is thrilled to unveil the beta release of Zonos-v0.1, which boasts two sophisticated and real-time text-to-speech models that include high-fidelity voice cloning capabilities. Our release features both a 1.6B transformer and a 1.6B hybrid model, all under the Apache 2.0 license. Given the challenges in quantitatively assessing audio quality, we believe that the generation quality produced by Zonos is on par with or even surpasses that of top proprietary TTS models currently available. Additionally, we are confident that making models of this quality publicly accessible will greatly propel advancements in TTS research. You can find the Zonos model weights on Huggingface, with sample inference code available on our GitHub repository. Furthermore, Zonos can be utilized via our model playground and API, which offers straightforward and competitive flat-rate pricing options. To illustrate the performance of Zonos, we have prepared a variety of sample comparisons between Zonos and existing proprietary models, highlighting its capabilities. This initiative emphasizes our commitment to fostering innovation in the field of text-to-speech technology.

Canopy Labs has unveiled Orpheus, an innovative suite of advanced speech large language models (LLMs) aimed at achieving human-like speech generation capabilities. Utilizing the Llama-3 architecture, these models have been trained on an extensive dataset comprising over 100,000 hours of English speech, allowing them to generate speech that exhibits natural intonation, emotional depth, and rhythmic flow that outperforms existing high-end closed-source alternatives. Orpheus also features zero-shot voice cloning, enabling users to mimic voices without any need for prior fine-tuning, and provides easy-to-use tags for controlling emotion and intonation. The models are engineered for low latency, achieving approximately 200ms streaming latency for real-time usage, which can be further decreased to around 100ms when utilizing input streaming. Canopy Labs has made available both pre-trained and fine-tuned models with 3 billion parameters under the flexible Apache 2.0 license, with future intentions to offer smaller models with 1 billion, 400 million, and 150 million parameters to cater to devices with limited resources. This strategic move is expected to broaden accessibility and application potential across various platforms and use cases.