Average Ratings 0 Ratings
Average Ratings 0 Ratings
Description
Sonic is an advanced text-to-speech model designed specifically for real-time voice agents, featuring a natural delivery system with a response time of less than 90 milliseconds and supporting over 40 languages seamlessly. Its primary aim is to facilitate effortless voice interactions, characterized by a tone that adapts to various contexts, a steady pacing, and speech that aligns with the natural flow of conversation. Sonic automatically interprets the emotional nuances within transcripts, adjusting its delivery accordingly, and allows for the direct insertion of non-verbal cues like laughter into the spoken text. Faithful to the original transcripts, the model generates clear audio across different languages and voice options while effortlessly managing alphanumeric data, including order and phone numbers, email addresses, and IDs, without requiring any prior processing. Its context-aware pronunciation ensures that heteronyms are articulated correctly based on surrounding terms, and customizable pronunciation dictionaries empower teams to dictate how specific proper nouns and industry-related terminology should be pronounced. This comprehensive approach not only enhances the quality of interactions but also tailors the user experience to meet diverse communication needs.
Description
GPT-Realtime, OpenAI's latest and most sophisticated speech-to-speech model, is now available via the fully operational Realtime API. This model produces audio that is not only highly natural but also expressive, allowing users to finely adjust elements such as tone, speed, and accent. It is capable of understanding complex human audio cues, including laughter, can switch languages seamlessly in the middle of a conversation, and accurately interprets alphanumeric information such as phone numbers in various languages. With a notable enhancement in reasoning and instruction-following abilities, it has achieved impressive scores of 82.8% on the BigBench Audio benchmark and 30.5% on MultiChallenge. Additionally, it features improved function calling capabilities, demonstrating greater reliability, speed, and accuracy, with a score of 66.5% on ComplexFuncBench. The model also facilitates asynchronous tool invocation, ensuring that dialogues flow smoothly even during extended calls. Furthermore, the Realtime API introduces groundbreaking features like support for image input, integration with SIP phone networks, connections to remote MCP servers, and the ability to reuse conversation prompts effectively. These advancements make it an invaluable tool for enhancing communication technology.
API Access
Has API
Yes
API Access
Has API
Yes
Integrations
Azure Voice Live API
No
ChatGPT
No
GPT-Realtime-1.5
No
GPT-Realtime-2
No
GPT-Realtime-2.1
No
GPT-Realtime-Translate
No
GPT‑Realtime‑Whisper
No
Microsoft Foundry Models
No
OpenAI
No
SmartCallz
No
Integrations
Azure Voice Live API
Yes
ChatGPT
Yes
GPT-Realtime-1.5
Yes
GPT-Realtime-2
Yes
GPT-Realtime-2.1
Yes
GPT-Realtime-Translate
Yes
GPT‑Realtime‑Whisper
Yes
Microsoft Foundry Models
Yes
OpenAI
Yes
SmartCallz
Yes
Pricing Details
$5 per month
Free Trial
Yes
Free Version
Yes
Pricing Details
$20 per month
Free Trial
No
Free Version
Yes
Deployment
Web-Based
Yes
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Deployment
Web-Based
Yes
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
Yes
Customer Support
Business Hours
Yes
Live Rep (24/7)
No
Online Support
Yes
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
No
In Person
No
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
No
In Person
Yes
Vendor Details
Company Name
Cartesia
Founded
2023
Country
United States
Website
www.cartesia.ai/sonic
Vendor Details
Company Name
OpenAI
Founded
2015
Country
United States
Website
openai.com/index/introducing-gpt-realtime/