Average Ratings 0 Ratings
Average Ratings 0 Ratings
Description
Nova 2 Sonic is an innovative speech-to-speech model from Amazon that facilitates real-time voice interactions, seamlessly merging speech recognition, generation, and text processing into one cohesive system. This integration allows for natural and fluid conversations, effortlessly transitioning between spoken and written communication. With enhanced multilingual capabilities and a variety of expressive voice options, Nova 2 Sonic creates responses that are not only more lifelike but also display a deeper understanding of context. Its extensive one-million-token context window enables prolonged interactions while maintaining coherence with previous exchanges. Additionally, the model's ability to handle asynchronous tasks allows users to engage in conversation, switch topics, or pose follow-up inquiries without interrupting ongoing background processes, thereby creating a more dynamic and engaging voice interaction experience. Such advancements ensure that conversations feel less constrained by conventional turn-taking dialogue methods, paving the way for more immersive communication.
Description
TML-Interaction-Small is a multimodal interaction model created by Thinking Machines Lab that enables continuous real-time collaboration between humans and AI across audio, video, and text modalities. The model is designed to move beyond traditional turn-based AI systems by supporting native interaction capabilities such as simultaneous listening and speaking, proactive interjections, visual cue awareness, real-time responses, and ongoing contextual collaboration. TML-Interaction-Small processes interactions through a time-aligned micro-turn architecture that continuously exchanges 200ms streams of input and output, allowing the model to maintain conversational presence while reasoning, responding, and acting concurrently. The system combines an interaction model with an asynchronous background model that handles deeper reasoning, tool usage, browsing, and long-running workflows while the primary interaction layer continues communicating with the user in real time. The architecture allows users to collaborate with AI more naturally through speech, video, messaging, and multimodal inputs without waiting for rigid conversational turn boundaries. Thinking Machines Lab developed the model to improve human-AI collaboration by keeping people actively involved during AI workflows rather than relying solely on autonomous agents. TML-Interaction-Small includes capabilities such as live translation, contextual interruptions, visual-based reactions, concurrent speech processing, time awareness, tool calling, web browsing, and multimodal streaming interaction. The system also introduces encoder-free early fusion techniques, streaming inference optimization, and reinforcement learning strategies optimized for interactive responsiveness and stability.
API Access
Has API
API Access
Has API
Integrations
Amazon Bedrock
Amazon Nova
Amazon Nova Forge
Amazon Web Services (AWS)
Integrations
Amazon Bedrock
Amazon Nova
Amazon Nova Forge
Amazon Web Services (AWS)
Pricing Details
No price information available.
Free Trial
Free Version
Pricing Details
No price information available.
Free Trial
Free Version
Deployment
Web-Based
On-Premises
iPhone App
iPad App
Android App
Windows
Mac
Linux
Chromebook
Deployment
Web-Based
On-Premises
iPhone App
iPad App
Android App
Windows
Mac
Linux
Chromebook
Customer Support
Business Hours
Live Rep (24/7)
Online Support
Customer Support
Business Hours
Live Rep (24/7)
Online Support
Types of Training
Training Docs
Webinars
Live Training (Online)
In Person
Types of Training
Training Docs
Webinars
Live Training (Online)
In Person
Vendor Details
Company Name
Amazon
Founded
1994
Country
United States
Website
aws.amazon.com/nova/
Vendor Details
Company Name
Thinking Machines Lab
Country
United States
Website
thinkingmachines.ai/