Average Ratings 0 Ratings
Average Ratings 0 Ratings
Description
Inworld AI's Realtime TTS-2 represents a cutting-edge voice model designed for instantaneous dialogue, aiming to create a conversational experience that is as human-like as it sounds. This innovative system captures the entirety of an interaction, analyzing the user’s tone, rhythm, and emotional nuances, while also allowing developers to provide voice direction using simple English commands, similar to prompting an AI model. Unlike traditional speech generation that operates in isolation, this model incorporates the context of previous exchanges, ensuring that tone and pacing evolve throughout the conversation, meaning a response can have a completely different impact depending on the preceding context, such as humor or sadness. Furthermore, the Voice Direction feature empowers developers to guide the delivery of speech as a director would with an actor, using intuitive natural language rather than rigid emotion controls or sliders. Additionally, developers can integrate inline nonverbal cues like [sigh], [breathe], and [laugh] directly into the text, which the model seamlessly transforms into corresponding audio events. Notably, Realtime TTS-2 maintains a consistent voice identity across over 100 languages, allowing for smooth language transitions within a single interaction, enhancing its applicability in diverse multilingual settings. This capability ensures that conversations remain fluid and authentic, further bridging the gap between human and machine communication.
Description
Zyphra is thrilled to unveil the beta release of Zonos-v0.1, which boasts two sophisticated and real-time text-to-speech models that include high-fidelity voice cloning capabilities. Our release features both a 1.6B transformer and a 1.6B hybrid model, all under the Apache 2.0 license. Given the challenges in quantitatively assessing audio quality, we believe that the generation quality produced by Zonos is on par with or even surpasses that of top proprietary TTS models currently available. Additionally, we are confident that making models of this quality publicly accessible will greatly propel advancements in TTS research. You can find the Zonos model weights on Huggingface, with sample inference code available on our GitHub repository. Furthermore, Zonos can be utilized via our model playground and API, which offers straightforward and competitive flat-rate pricing options. To illustrate the performance of Zonos, we have prepared a variety of sample comparisons between Zonos and existing proprietary models, highlighting its capabilities. This initiative emphasizes our commitment to fostering innovation in the field of text-to-speech technology.
API Access
Has API
API Access
Has API
Pricing Details
$25 per month
Free Trial
Free Version
Pricing Details
$0.02 per minute
Free Trial
Free Version
Deployment
Web-Based
On-Premises
iPhone App
iPad App
Android App
Windows
Mac
Linux
Chromebook
Deployment
Web-Based
On-Premises
iPhone App
iPad App
Android App
Windows
Mac
Linux
Chromebook
Customer Support
Business Hours
Live Rep (24/7)
Online Support
Customer Support
Business Hours
Live Rep (24/7)
Online Support
Types of Training
Training Docs
Webinars
Live Training (Online)
In Person
Types of Training
Training Docs
Webinars
Live Training (Online)
In Person
Vendor Details
Company Name
Inworld
Founded
2021
Country
United States
Website
inworld.ai/blog/realtime-tts-2
Vendor Details
Company Name
Zyphra
Country
United States
Website
www.zyphra.com/post/beta-release-of-zonos-v0-1
Product Features
Text to Speech
API
Adjust Speaking Rate / Pitch
Audio Optimization
Custom Lexicons
Different Voice Choices
Multi-Language Support
Synchronize Speech
Product Features
Text to Speech
API
Adjust Speaking Rate / Pitch
Audio Optimization
Custom Lexicons
Different Voice Choices
Multi-Language Support
Synchronize Speech