Qwen4-Max
5.0 out of 5 starsAverage Ratings 0 Ratings
Average Ratings 1 Rating
Description
This repository showcases the research preview of LongLLaMA, an advanced large language model that can manage extensive contexts of up to 256,000 tokens or potentially more. LongLLaMA is developed on the OpenLLaMA framework and has been fine-tuned utilizing the Focused Transformer (FoT) technique. The underlying code for LongLLaMA is derived from Code Llama. We are releasing a smaller 3B base variant of the LongLLaMA model, which is not instruction-tuned, under an open license (Apache 2.0), along with inference code that accommodates longer contexts available on Hugging Face. This model's weights can seamlessly replace LLaMA in existing systems designed for shorter contexts, specifically those handling up to 2048 tokens. Furthermore, we include evaluation results along with comparisons to the original OpenLLaMA models, thereby providing a comprehensive overview of LongLLaMA's capabilities in the realm of long-context processing.
Description
Qwen4-Max is a flagship generative AI model from Alibaba Cloud designed to support sophisticated reasoning, multimodal analysis, software development, and autonomous task execution. The model introduces the Qwen4 architecture, which uses a sparse mixture-of-experts design containing 2.4 trillion parameters while activating approximately 71 billion parameters for each token. Its native vision capabilities enable users to analyze images, videos, documents, and other visual information alongside written instructions. A one-million-token context window allows the model to process lengthy research materials, complex technical documentation, and large software repositories. Qwen4-Max provides advanced programming capabilities for generating applications, debugging code, creating interactive websites, and developing three-dimensional environments. Its professional productivity features support financial modeling, spreadsheet generation, presentation creation, legal due diligence, and business research. The model also supports autonomous AI agents that coordinate tools, maintain progress across extended workflows, and refine outputs using feedback from external applications. Developers can integrate Qwen4-Max through QwenCloud using function calling, structured JSON outputs, web search, code execution, and Model Context Protocol connectivity. By combining efficient large-scale reasoning, multimodal understanding, and agentic automation, Qwen4-Max enables organizations to streamline technical work, accelerate scientific research, and build intelligent software applications.
API Access
Has API
No
API Access
Has API
Yes
Integrations
Alibaba Cloud
No
Alibaba Cloud Model Studio
No
Cherry Studio
No
Cline
No
ClinePass
No
Hermes Agent
No
Hugging Face
No
Model Context Protocol (MCP)
No
ModelScope
No
Nous Portal
No
Integrations
Alibaba Cloud
Yes
Alibaba Cloud Model Studio
Yes
Cherry Studio
Yes
Cline
Yes
ClinePass
Yes
Hermes Agent
Yes
Hugging Face
Yes
Model Context Protocol (MCP)
Yes
ModelScope
Yes
Nous Portal
Yes
Pricing Details
Free
Free Trial
No
Free Version
Yes
Pricing Details
$1.50 per 1M tokens (input)
$1.50 per 1 million input tokens and $4.50 per 1 million output tokens (including chain-of-thought reasoning and answer tokens)
Free Trial
No
Free Version
No
Deployment
Web-Based
Yes
On-Premises
Yes
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Deployment
Web-Based
Yes
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
Yes
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
Yes
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
No
In Person
No
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
No
In Person
No
Vendor Details
Company Name
LongLLaMA
Website
github.com/CStanKonrad/long_llama
Vendor Details
Company Name
Alibaba
Founded
1999
Country
China
Website
qwen.ai