Average Ratings 0 Ratings
Average Ratings 0 Ratings
Description
The Gemini Live API is an advanced preview feature designed to facilitate low-latency, bidirectional interactions through voice and video with the Gemini system. This innovation allows users to engage in conversations that feel natural and human-like, while also enabling them to interrupt the model's responses via voice commands. In addition to handling text inputs, the model is capable of processing audio and video, yielding both text and audio outputs. Recent enhancements include the introduction of two new voice options and support for 30 additional languages, along with the ability to configure the output language as needed. Furthermore, users can adjust image resolution settings (66/256 tokens), decide on turn coverage (whether to send all inputs continuously or only during user speech), and customize interruption preferences. Additional features encompass voice activity detection, new client events for signaling the end of a turn, token count tracking, and a client event for marking the end of the stream. The system also supports text streaming, along with configurable session resumption that retains session data on the server for up to 24 hours, and the capability for extended sessions utilizing a sliding context window for better conversation continuity. Overall, Gemini Live API enhances interaction quality, making it more versatile and user-friendly.
Description
Velma is an innovative AI model created by Modulate, functioning as part of a comprehensive voice intelligence system that comprehends conversations directly from audio rather than depending on textual transcriptions. In contrast to conventional methods that first convert spoken language to text for analysis through language models, Velma employs an Ensemble Listening Model (ELM), which features a unique architecture capable of processing various facets of voice simultaneously, such as tone, emotion, pacing, intent, and behavioral cues. This advanced capability enables it to grasp the complete essence of a dialogue, not merely the spoken words, while identifying subtle indicators like stress, deceit, sarcasm, or escalation as they occur. Velma achieves this by integrating hundreds of specialized detectors, each targeting specific elements of speech, such as emotional context, inappropriate behavior, or signs of synthetic voice, and subsequently amalgamating these signals to derive deeper insights about the dynamics of the conversation. Consequently, this allows for a richer understanding of interactions in real time, enhancing the potential for more effective communication analysis.
API Access
Has API
Yes
API Access
Has API
Yes
Integrations
Agora
Yes
Firebase
Yes
Fishjam
Yes
GENESYS
No
Gemini
Yes
Gemini 3 Pro Image
Yes
Gemini 3.1 Flash Image
Yes
Gemini 3.1 Flash Live
Yes
Gemini 3.1 Flash TTS
Yes
Gemini 3.8 Live
Yes
Integrations
Agora
No
Firebase
No
Fishjam
No
GENESYS
Yes
Gemini
No
Gemini 3 Pro Image
No
Gemini 3.1 Flash Image
No
Gemini 3.1 Flash Live
No
Gemini 3.1 Flash TTS
No
Gemini 3.8 Live
No
Pricing Details
No price information available.
Free Trial
No
Free Version
No
Pricing Details
$0.25 per hour
Free Trial
Yes
Free Version
No
Deployment
Web-Based
Yes
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Deployment
Web-Based
Yes
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Customer Support
Business Hours
Yes
Live Rep (24/7)
No
Online Support
Yes
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
Yes
Types of Training
Training Docs
Yes
Webinars
Yes
Live Training (Online)
Yes
In Person
Yes
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
Yes
In Person
No
Vendor Details
Company Name
Founded
1998
Country
United States
Website
ai.google.dev/gemini-api/docs/live
Vendor Details
Company Name
Modulate
Founded
2019
Country
United States
Website
www.modulate.ai/velma