Average Ratings 0 Ratings
Average Ratings 0 Ratings
Description
MAI-Voice-2 represents the pinnacle of Microsoft AI's advancements in text-to-speech technology, delivering a remarkably expressive and lifelike audio experience tailored for various production applications where quality and emotional delivery are essential to user interaction. This model caters to a diverse range of uses, including virtual assistants, customer service, audiobooks, accessible technology, gaming, podcasts, educational courses, simulations, and creative projects, where achieving a natural and fluid voice is paramount. Expanding from solely English support, it now encompasses a total of 15 languages while preserving its signature naturalness and expressiveness, including languages such as Italian, French, German, Hindi, Spanish, Portuguese, Korean, Chinese, Turkish, Russian, Thai, Dutch, Romanian, and Hungarian. MAI-Voice-2 also introduces detailed emotion control through specific tags like sad, whispered, and excited, as well as role-specific expressive speech, making it suitable for applications ranging from motivational speakers to sports commentary and character performances. The versatility of this model ensures it can meet the unique needs of various industries, enhancing how voice technology is integrated into everyday experiences.
Description
Canopy Labs has unveiled Orpheus, an innovative suite of advanced speech large language models (LLMs) aimed at achieving human-like speech generation capabilities. Utilizing the Llama-3 architecture, these models have been trained on an extensive dataset comprising over 100,000 hours of English speech, allowing them to generate speech that exhibits natural intonation, emotional depth, and rhythmic flow that outperforms existing high-end closed-source alternatives. Orpheus also features zero-shot voice cloning, enabling users to mimic voices without any need for prior fine-tuning, and provides easy-to-use tags for controlling emotion and intonation. The models are engineered for low latency, achieving approximately 200ms streaming latency for real-time usage, which can be further decreased to around 100ms when utilizing input streaming. Canopy Labs has made available both pre-trained and fine-tuned models with 3 billion parameters under the flexible Apache 2.0 license, with future intentions to offer smaller models with 1 billion, 400 million, and 150 million parameters to cater to devices with limited resources. This strategic move is expected to broaden accessibility and application potential across various platforms and use cases.
API Access
Has API
API Access
Has API
Integrations
Baseten
GitHub
Google Colab
Hugging Face
Llama 3
Microsoft Azure
Microsoft Foundry
VoiSpark
Integrations
Baseten
GitHub
Google Colab
Hugging Face
Llama 3
Microsoft Azure
Microsoft Foundry
VoiSpark
Pricing Details
No price information available.
Free Trial
Free Version
Pricing Details
No price information available.
Free Trial
Free Version
Deployment
Web-Based
On-Premises
iPhone App
iPad App
Android App
Windows
Mac
Linux
Chromebook
Deployment
Web-Based
On-Premises
iPhone App
iPad App
Android App
Windows
Mac
Linux
Chromebook
Customer Support
Business Hours
Live Rep (24/7)
Online Support
Customer Support
Business Hours
Live Rep (24/7)
Online Support
Types of Training
Training Docs
Webinars
Live Training (Online)
In Person
Types of Training
Training Docs
Webinars
Live Training (Online)
In Person
Vendor Details
Company Name
Microsoft AI
Founded
2024
Country
United States
Website
microsoft.ai/news/mai-voice-2expressive-speech-in-10-languages/
Vendor Details
Company Name
Canopy Labs
Country
United States
Website
canopylabs.ai/model-releases
Product Features
Text to Speech
API
Adjust Speaking Rate / Pitch
Audio Optimization
Custom Lexicons
Different Voice Choices
Multi-Language Support
Synchronize Speech
Product Features
Text to Speech
API
Adjust Speaking Rate / Pitch
Audio Optimization
Custom Lexicons
Different Voice Choices
Multi-Language Support
Synchronize Speech