Average Ratings 0 Ratings
Average Ratings 0 Ratings
Description
Lucebox is a ready-to-use computer specifically designed for executing local AI models and agents at peak performance. Within its specially designed casing, it houses a Ryzen AI MAX+ 395 processor combined with 128GB of unified LPDDR5X memory and an RTX 3090 graphics card, both working in harmony through an open-source inference engine meticulously optimized for this configuration.
The design of the architecture is key to its exceptional speed. The 128GB of unified memory allows large models to reside effectively, while the high-bandwidth VRAM of the 3090 serves as a rapid access tier. Techniques like speculative decoding (DFlash) and speculative prefill (PFlash) link these two memory systems, achieving inference speeds that can be up to 10 times faster than llama.cpp running on the same hardware, outperforming systems such as the Mac Studio and DGX Spark while being significantly more cost-effective. Moreover, this combination of hardware and software optimizations positions Lucebox as a formidable player in the local AI computing landscape.
Description
Recursive Flint is an advanced language model featuring 40 billion parameters, designed as a mixture-of-experts specifically for coding tasks executed locally. It engages around 2.5 billion parameters for each token processed, enabling sophisticated reasoning, multi-turn tool utilization, and accommodating context windows as extensive as 512,000 tokens. Developers can leverage Flint within coding agents to analyze codebases, rectify bugs, develop new features, and create tests while executing inference directly on their own hardware. The model's weights are made available under the Apache 2.0 license, promoting accessibility. Flint is compatible with various platforms such as llama.cpp, Ollama, Unsloth, LM Studio, vLLM, and SGLang; additionally, Recursive offers rec, an inference engine that is specifically optimized for use with Apple Silicon M4 Pro and M5 Pro/Max chips. Comprehensive setup documentation and practical examples are provided to assist developers in executing the model on local machines. Flint serves as a valuable tool for developers and technical teams aiming to effectively run and customize a code-centric model tailored to their specific system requirements. This innovative approach empowers users to enhance their coding capabilities and streamline development processes more efficiently than ever before.
API Access
Has API
No
API Access
Has API
Yes
Screenshots View All
No images available
Screenshots View All
No images available
Integrations
LM Studio
No
Ollama
No
OpenRouter
No
Unsloth
No
vLLM
No
Integrations
LM Studio
Yes
Ollama
Yes
OpenRouter
Yes
Unsloth
Yes
vLLM
Yes
Pricing Details
$4,900 - One time payment
Free Trial
No
Free Version
No
Pricing Details
No price information available.
Free Trial
No
Free Version
Yes
Deployment
Web-Based
No
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
Yes
Chromebook
No
Deployment
Web-Based
Yes
On-Premises
Yes
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
Yes
Linux
No
Chromebook
No
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
Yes
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
No
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
No
In Person
No
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
No
In Person
No
Vendor Details
Company Name
Lucebox
Founded
2026
Country
United States
Website
www.lucebox.com
Vendor Details
Company Name
Recursive
Founded
2026
Country
United States
Website
recursive.com/updates/introducing-recursive-flint