Average Ratings 0 Ratings
Average Ratings 0 Ratings
Description
LiteRT, previously known as TensorFlow Lite, is an advanced runtime developed by Google that provides high-performance capabilities for artificial intelligence on devices. This platform empowers developers to implement machine learning models on multiple devices and microcontrollers with ease. Supporting models from prominent frameworks like TensorFlow, PyTorch, and JAX, LiteRT converts these models into the FlatBuffers format (.tflite) for optimal inference efficiency on devices. Among its notable features are minimal latency, improved privacy by handling data locally, smaller model and binary sizes, and effective power management. The runtime also provides SDKs in various programming languages, including Java/Kotlin, Swift, Objective-C, C++, and Python, making it easier to incorporate into a wide range of applications. To enhance performance on compatible devices, LiteRT utilizes hardware acceleration through delegates such as GPU and iOS Core ML. The upcoming LiteRT Next, which is currently in its alpha phase, promises to deliver a fresh set of APIs aimed at simplifying the process of on-device hardware acceleration, thereby pushing the boundaries of mobile AI capabilities even further. With these advancements, developers can expect more seamless integration and performance improvements in their applications.
Description
The QVAC SDK serves as a toolkit designed for developers looking to integrate on-device AI inference into their applications crafted with JavaScript/TypeScript or Python. It supplies a unified API to facilitate the execution of various supported language, vision, and speech models across both mobile and desktop platforms, encompassing features like model discovery and downloads, inference APIs, and optional connections to remote providers. With this toolkit, developers can create AI features that function offline, ensuring that prompts and processing occur directly on the device for local inference. Additionally, QVAC provides an OpenAI-compatible server alongside plugins that seamlessly link local models with developer tools. Aimed primarily at those developing AI-enhanced applications, the SDK's documentation outlines processes for setup, choosing models, handling tasks related to text generation, image, and audio, as well as invoking tools; the available functionalities can vary based on the chosen model and platform. Furthermore, the QVAC SDK is accessible as free, open-source software under the Apache 2.0 license, and using local inference does not necessitate a hosted QVAC account, making it even more appealing for developers. This flexibility and ease of use make the QVAC SDK a robust choice for integrating AI capabilities into modern applications.
API Access
Has API
Yes
API Access
Has API
Yes
Screenshots View All
No images available
Integrations
C++
Yes
Google AI Edge Gallery
Yes
Hugging Face
No
JAX
Yes
Java
Yes
Kotlin
Yes
Objective-C
Yes
OpenClaw
No
OpenCode
No
PyTorch
Yes
Integrations
C++
No
Google AI Edge Gallery
No
Hugging Face
Yes
JAX
No
Java
No
Kotlin
No
Objective-C
No
OpenClaw
Yes
OpenCode
Yes
PyTorch
No
Pricing Details
Free
Free Trial
No
Free Version
Yes
Pricing Details
$0
Free and open source under Apache 2.0. Local inference has no subscription, API-key, or per-token charge.
Free Trial
No
Free Version
Yes
Deployment
Web-Based
No
On-Premises
No
iPhone App
Yes
iPad App
Yes
Android App
Yes
Windows
No
Mac
No
Linux
Yes
Chromebook
No
Deployment
Web-Based
No
On-Premises
Yes
iPhone App
Yes
iPad App
Yes
Android App
Yes
Windows
Yes
Mac
Yes
Linux
Yes
Chromebook
No
Customer Support
Business Hours
Yes
Live Rep (24/7)
No
Online Support
Yes
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
Yes
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
Yes
In Person
Yes
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
No
In Person
No
Vendor Details
Company Name
Founded
1998
Country
United States
Website
ai.google.dev/edge/litert
Vendor Details
Company Name
Tether Data
Country
El Salvador
Website
qvac.tether.io/products/sdk
Product Features
Artificial Intelligence
Chatbot
No
For Healthcare
No
For Sales
No
For eCommerce
No
Image Recognition
No
Machine Learning
No
Multi-Language
No
Natural Language Processing
No
Predictive Analytics
No
Process/Workflow Automation
No
Rules-Based Automation
No
Virtual Personal Assistant (VPA)
No