Average Ratings 0 Ratings

Total
ease
features
design
support

No User Reviews. Be the first to provide a review:

Write a Review

Average Ratings 0 Ratings

Total
ease
features
design
support

No User Reviews. Be the first to provide a review:

Write a Review

Description

Inworld Realtime STT is a streaming API for speech-to-text that captures more than just spoken words. This innovative tool merges low-latency speech recognition with voice profiling capabilities, allowing it to analyze emotions, vocal style, accent, age, and pitch from raw audio inputs, which enhances the responsiveness and expressiveness of downstream LLMs and TTS systems. Developers have the flexibility to stream audio in real time, transcribe entire files, or gather voice profile signals via a single, comprehensive API. The system features real-time bidirectional streaming over WebSocket, synchronous transcription for complete audio files, and offers voice profile signals for each streaming segment, all while supporting multiple providers through one model ID. Each audio segment provides a dynamic profile of the speaker, complete with confidence scores, equipping LLMs with structured context that indicates the emotional state of the user, such as whether they sound sad, frustrated, soft-spoken, high-pitched, or calm. This capability allows for a more nuanced interaction, enriching the user experience by adapting responses to the speaker’s emotional tone and vocal characteristics.

Description

Voxtral Small Transcribe 3 is a versatile multilingual speech-to-text model tailored for converting recorded audio into text. Offered via an audio transcription API by Mistral, it incorporates features like timestamp documentation, speaker diarization, and context biasing, enabling developers to input key phrases that enhance the recognition of specific terms and names relevant to particular domains. This model is capable of automatically identifying supported languages or can utilize a specified language code, accommodating over 50 languages in total. It is particularly suitable for application developers focused on creating workflows for transcribing recorded audio, such as meetings, interviews, call transcriptions, customer service systems, and voice-agent processes. Additionally, Mistral outlines options for self-deployment of the Voxtral 3 series, which includes hosting on private clouds or on-premises solutions, making it adaptable to various organizational needs. Furthermore, the flexibility of the model ensures that it remains a valuable tool for enhancing communication efficiency across different sectors.

API Access

Has API Yes 

API Access

Has API Yes 

Screenshots View All

Screenshots View All

Integrations

Mistral AI No 

Integrations

Mistral AI Yes 

Pricing Details

Free
Free Trial No 
Free Version Yes 

Pricing Details

$0.004/min
API usage is $0.004 per minute of audio.
Free Trial No 
Free Version No 

Deployment

Web-Based Yes 
On-Premises No 
iPhone App No 
iPad App No 
Android App No 
Windows No 
Mac No 
Linux No 
Chromebook No 

Deployment

Web-Based Yes 
On-Premises Yes 
iPhone App No 
iPad App No 
Android App No 
Windows No 
Mac No 
Linux No 
Chromebook No 

Customer Support

Business Hours No 
Live Rep (24/7) No 
Online Support Yes 

Customer Support

Business Hours No 
Live Rep (24/7) No 
Online Support Yes 

Types of Training

Training Docs Yes 
Webinars No 
Live Training (Online) Yes 
In Person No 

Types of Training

Training Docs Yes 
Webinars No 
Live Training (Online) No 
In Person No 

Vendor Details

Company Name

Inworld

Founded

2021

Country

United States

Website

inworld.ai/speech-to-text

Vendor Details

Company Name

Mistral AI

Founded

2023

Country

France

Website

docs.mistral.ai/models/voxtral-small-transcribe-3-0

Product Features

Product Features

Alternatives

Alternatives

Eleven Realtime Reviews

Eleven Realtime

ElevenLabs
Cartesia Ink 2 Reviews

Cartesia Ink 2

Cartesia
Inworld TTS Reviews

Inworld TTS

Inworld
Chirp 3 Reviews

Chirp 3

Google