Average Ratings 0 Ratings
Average Ratings 0 Ratings
Description
EmbeddingGemma 2 is a versatile and lightweight multimodal embedding model that facilitates the mapping of text, code, images, video, and audio into a unified embedding space, which is useful for applications such as search, retrieval, classification, routing, and RAG. It is constructed on the Gemma 4 framework and distributed under the Apache 2.0 license, featuring an impressive 740 million parameters while being fine-tuned for efficient on-device inference. Its flexible architecture allows for the use of only 270 million parameters for text-centric tasks, and it includes additional vision and audio encoders for comprehensive multimodal capabilities. Furthermore, the innovative Matryoshka Representation Learning technique enables developers to compress output vectors from 768 dimensions down to 512, 256, or even 128 dimensions, effectively reducing the storage and memory demands for local vector databases. The model is equipped with an 8K-token context window, providing the capability to handle up to 5.5 minutes of audio, 29 images, 58 video frames, or various combinations of these inputs seamlessly on local hardware. This adaptability makes it particularly valuable for developers seeking to enhance their applications with rich multimedia integration.
Description
Phonon serves as an open-weight text-to-speech (TTS) model and inference runtime designed for developers seeking to incorporate speech generation into applications that require local and offline audio capabilities. This innovative system transforms text into spoken audio and has the ability to stream speech in real-time as it is produced. The runtime offers interfaces for Rust and Python, a Swift package for iOS and macOS, JavaScript support for web browsers, and libraries for Android; it can also function as a self-hosted server compatible with OpenAI's API. Depending on the variant of the model used, it accommodates languages such as English, French, German, Spanish, and Portuguese. Phonon is tailored for developers aiming to integrate speech functionalities into mobile, desktop, web, embedded, and server applications, particularly in scenarios requiring offline access or enhanced privacy. The English model, which consists of 31 million parameters, is licensed under Apache 2.0, while the language-specific and multilingual models, featuring 40 million parameters, operate under CC BY-NC 4.0. Additionally, the runtime’s code is available under either the Apache 2.0 or MIT licenses, making it accessible for various development needs. This flexibility and wide-ranging support make Phonon a versatile choice for speech synthesis across different platforms.
API Access
Has API
Yes
API Access
Has API
Yes
Screenshots View All
No images available
Integrations
Hugging Face
No
Pricing Details
No price information available.
Free Trial
No
Free Version
No
Pricing Details
No price information available.
Free Trial
No
Free Version
Yes
Deployment
Web-Based
Yes
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Deployment
Web-Based
No
On-Premises
Yes
iPhone App
Yes
iPad App
Yes
Android App
Yes
Windows
Yes
Mac
Yes
Linux
Yes
Chromebook
No
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
Yes
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
No
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
No
In Person
No
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
No
In Person
No
Vendor Details
Company Name
Founded
1998
Country
United States
Website
blog.google/innovation-and-ai/technology/developers-tools/embeddinggemma-2/
Vendor Details
Company Name
Gradium
Founded
2025
Country
France, United States
Website
gradium.ai/phonon