Average Ratings 0 Ratings
Average Ratings 0 Ratings
Description
AudioLM is an innovative audio language model designed to create high-quality, coherent speech and piano music by solely learning from raw audio data, eliminating the need for text transcripts or symbolic forms. It organizes audio in a hierarchical manner through two distinct types of discrete tokens: semantic tokens, which are derived from a self-supervised model to capture both phonetic and melodic structures along with broader context, and acoustic tokens, which come from a neural codec to maintain speaker characteristics and intricate waveform details. This model employs a series of three Transformer stages, initiating with the prediction of semantic tokens to establish the overarching structure, followed by the generation of coarse tokens, and culminating in the production of fine acoustic tokens for detailed audio synthesis. Consequently, AudioLM can take just a few seconds of input audio to generate seamless continuations that effectively preserve voice identity and prosody in speech, as well as melody, harmony, and rhythm in music. Remarkably, evaluations by humans indicate that the synthetic continuations produced are almost indistinguishable from actual recordings, demonstrating the technology's impressive authenticity and reliability. This advancement in audio generation underscores the potential for future applications in entertainment and communication, where realistic sound reproduction is paramount.
Description
Decibri is an audio library written in Rust, aimed at developers focused on creating applications for real-time speech, voice agents, and audio processing. It includes functionalities for microphone input, speaker output, PCM streaming, and handling audio files, along with a command-line interface that supports Python, Node.js, Rust, and browser APIs. Among its many features are voice activity detection, acoustic echo cancellation, and optional enhancements such as denoising, filtering, automatic gain control, and limiting. Developers have the capability to stream audio they capture to either cloud or local speech-to-text services, while also playing back synthesized speech through its audio output systems. The library can be utilized in various scenarios, including the development of voice assistants, transcription services, conversational agents, wake-word detection, interactive robotics applications, full-duplex speech systems, audio processing pipelines, and for use in edge devices. It offers prebuilt native packages compatible with Windows, macOS, and Linux, and the Python and Node.js implementations do not require any additional build tools for setup. Additionally, the browser version allows for audio capture, energy-based speech detection, and playback, expanding its accessibility and usability across different platforms. This versatility makes Decibri a powerful tool in the realm of audio application development.
API Access
Has API
No
API Access
Has API
Yes
Screenshots View All
No images available
Integrations
Amazon Transcribe
No
AssemblyAI
No
Azure AI Speech
No
Deepgram
No
Google Cloud Speech-to-Text
No
Google Opal
Yes
OpenAI Realtime API
No
Voxtral
No
Integrations
Amazon Transcribe
Yes
AssemblyAI
Yes
Azure AI Speech
Yes
Deepgram
Yes
Google Cloud Speech-to-Text
Yes
Google Opal
No
OpenAI Realtime API
Yes
Voxtral
Yes
Pricing Details
No price information available.
Free Trial
No
Free Version
No
Pricing Details
$0
The core audio library is free under Apache-2.0. Fees for cloud speech-service providers are separate.
Free Trial
No
Free Version
Yes
Deployment
Web-Based
Yes
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Deployment
Web-Based
No
On-Premises
Yes
iPhone App
No
iPad App
No
Android App
No
Windows
Yes
Mac
Yes
Linux
Yes
Chromebook
No
Customer Support
Business Hours
Yes
Live Rep (24/7)
No
Online Support
Yes
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
Yes
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
No
In Person
Yes
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
No
In Person
No
Vendor Details
Company Name
Country
United States
Website
research.google/blog/audiolm-a-language-modeling-approach-to-audio-generation/
Vendor Details
Company Name
Decibri
Founded
2008
Country
Australia
Website
decibri.com
Product Features
Product Features
Alternatives
Alternatives
No Alternatives