Average Ratings 0 Ratings
Average Ratings 0 Ratings
Description
An EU-based company offers an inference API compatible with OpenAI and Anthropic models. Their premier model operates on dedicated GPUs located in EIA data centres and ensures that no data is retained, as all prompts and completions are processed solely in memory—meaning they are neither stored nor logged, and are not utilized for training purposes. Additionally, users have access to routed open models from various third-party providers using the same key, which are also clearly marked. The service includes a Data Processing Agreement (DPA) and an invoice from the EU entity. Notable features include streaming capabilities, tool calling, structured output, a publicly available DPA and sub-processor list, as well as a pricing model based on token usage. During a measurement conducted on the live system in August 2026, the service demonstrated a capacity of processing 176 tokens per second per stream, with the first token being generated in just 0.3 seconds, highlighting its efficiency and speed. Such performance metrics are critical for developers seeking reliable and rapid AI solutions in their applications.
Description
Xinference serves as a comprehensive AI inference platform tailored for organizations aiming to utilize open models without the hassle of constructing their own serving infrastructure. Initially, teams can access over 300 open models via the Model API, all accessible through a singular OpenAI-compatible endpoint located in Australia. Transitioning from a current service provider is remarkably straightforward, requiring merely two lines of code. As demand increases, workloads can effortlessly shift to Dedicated Inference on allocated GPUs or even to a private setup within the client’s own cloud or data center. Each deployment is equipped with a unified control plane that features per-request logging, real-time TTFT and TPOT monitoring, role-based access management, audit logs, and single sign-on capabilities. Notably, Xinference prioritizes privacy by not training on or retaining customer data by default. Typical applications of the platform encompass enterprise retrieval-augmented generation (RAG), virtual customer assistants, intelligent agents, function calling, coding support, document extraction, and both speech and image generation. Furthermore, the flexibility of Xinference allows businesses to adapt their AI capabilities as their needs evolve.
API Access
Has API
No
API Access
Has API
Yes
Screenshots View All
No images available
Screenshots View All
No images available
Integrations
No details available.
Integrations
No details available.
Pricing Details
$0.04 per 1M input tokens
Free Trial
No
Free Version
Yes
Pricing Details
No price information available.
Free Trial
No
Free Version
No
Deployment
Web-Based
Yes
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Deployment
Web-Based
Yes
On-Premises
Yes
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
Yes
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
No
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
No
In Person
No
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
No
In Person
No
Vendor Details
Company Name
Heabsy
Founded
2014
Country
Slovakia
Website
heabsy.com
Vendor Details
Company Name
Xinference
Founded
2026
Country
Australia
Website
xinference.co