Average Ratings 0 Ratings
Average Ratings 0 Ratings
Description
TokenRa serves as a cloud-based AI API gateway tailored for developers seeking to utilize text, reasoning, image, video, and audio models all through a single account and API key. The text models are designed to accommodate OpenAI-style requests, while image and video models are accessed via specific endpoints. Developers are provided with resources such as model documentation, integration options with supported SDKs and tools, as well as a console to track usage and billing details. The platform features an array of models from various providers, including DeepSeek, Moonshot AI, Zhipu AI, Alibaba Qwen, MiniMax, ByteDance, and OpenAI. Billing operates on a pay-as-you-go basis with no mandatory platform subscription fees; however, the rates and billing units differ depending on the model and channel utilized. Users need to make a minimum top-up of $10, and certain models offer free usage options. TokenRa is crafted for developers and collaborative teams that are creating applications requiring a unified interface to assess or interact with multiple AI models effectively. This makes it an excellent solution for those looking to streamline their AI integration processes.
Description
oMLX is an MLX server specifically designed for macOS, enhancing the efficiency and speed of local AI operations on Apple Silicon. It caters to the functional dynamics of coding agents by implementing paged SSD KV caching, which enables the persistence of cache blocks on disk; this means that previously accessed prefixes can be retrieved quickly across different requests and even after server restarts, thereby eliminating the need to recompute them from scratch. As a result, the time taken to generate the first token in lengthy contexts can be significantly reduced, dropping from a range of 30 to 90 seconds down to less than five seconds after the initial interaction. The server adeptly manages simultaneous requests through a continuous batching mechanism via mlx-lm’s BatchGenerator, which enhances overall generation throughput without requiring requests to queue up behind a single task. oMLX is capable of simultaneously serving a variety of models, including LLMs, vision-language models, embedding models, and rerankers, utilizing LRU eviction to manage memory constraints effectively. Furthermore, it is compatible with any MLX-format model sourced from Hugging Face, such as Qwen, LLaMA, Mistral, Gemma, DeepSeek, MiniMax, and GLM, and can also utilize models that are already present in the standard Hugging Face cache, directories associated with LM Studio, or any custom storage locations, ensuring a versatile user experience. This flexibility in model integration enhances the overall usability and practicality of oMLX for developers and researchers alike.
API Access
Has API
Yes
API Access
Has API
Yes
Screenshots View All
No images available
Integrations
Anthropic
No
Claude Code
No
Cursor
No
DeepSeek
No
GLM-4.1V
No
Gemma
No
Gemma
No
GitHub
No
Hugging Face
No
JSON
No
Integrations
Anthropic
Yes
Claude Code
Yes
Cursor
Yes
DeepSeek
Yes
GLM-4.1V
Yes
Gemma
Yes
Gemma
Yes
GitHub
Yes
Hugging Face
Yes
JSON
Yes
Pricing Details
$0.042/1M tokens
Billing is usage-based, with no platform subscription or monthly fee. Text models are billed per 1 million tokens, while image models are billed per request; billing units and rates vary by model and channel. The minimum top-up is $10. Some models have free rates, and at least one listed free rate is a limited-time offer through October 31, 2026.
Free Trial
No
Free Version
Yes
Pricing Details
No price information available.
Free Trial
No
Free Version
No
Deployment
Web-Based
Yes
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Deployment
Web-Based
No
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
Yes
Linux
No
Chromebook
No
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
Yes
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
Yes
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
No
In Person
No
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
No
In Person
No
Vendor Details
Company Name
TokenRa
Founded
2026
Country
China
Website
tokenra.io
Vendor Details
Company Name
oMLX
Country
United States
Website
omlx.ai/