Alternatives to Yi-Lightning

Kimi K2 represents a cutting-edge series of open-source large language models utilizing a mixture-of-experts (MoE) architecture, with a staggering 1 trillion parameters in total and 32 billion activated parameters tailored for optimized task execution. Utilizing the Muon optimizer, it has been trained on a substantial dataset of over 15.5 trillion tokens, with its performance enhanced by MuonClip’s attention-logit clamping mechanism, resulting in remarkable capabilities in areas such as advanced knowledge comprehension, logical reasoning, mathematics, programming, and various agentic operations. Moonshot AI offers two distinct versions: Kimi-K2-Base, designed for research-level fine-tuning, and Kimi-K2-Instruct, which is pre-trained for immediate applications in chat and tool interactions, facilitating both customized development and seamless integration of agentic features. Comparative benchmarks indicate that Kimi K2 surpasses other leading open-source models and competes effectively with top proprietary systems, particularly excelling in coding and intricate task analysis. Furthermore, it boasts a generous context length of 128 K tokens, compatibility with tool-calling APIs, and support for industry-standard inference engines, making it a versatile option for various applications. The innovative design and features of Kimi K2 position it as a significant advancement in the field of artificial intelligence language processing.

Qwen2.5-Max is an advanced Mixture-of-Experts (MoE) model created by the Qwen team, which has been pretrained on an extensive dataset of over 20 trillion tokens and subsequently enhanced through methods like Supervised Fine-Tuning (SFT) and Reinforcement Learning from Human Feedback (RLHF). Its performance in evaluations surpasses that of models such as DeepSeek V3 across various benchmarks, including Arena-Hard, LiveBench, LiveCodeBench, and GPQA-Diamond, while also achieving strong results in other tests like MMLU-Pro. This model is available through an API on Alibaba Cloud, allowing users to easily integrate it into their applications, and it can also be interacted with on Qwen Chat for a hands-on experience. With its superior capabilities, Qwen2.5-Max represents a significant advancement in AI model technology.

DeepSeek-V2 is a cutting-edge Mixture-of-Experts (MoE) language model developed by DeepSeek-AI, noted for its cost-effective training and high-efficiency inference features. It boasts an impressive total of 236 billion parameters, with only 21 billion active for each token, and is capable of handling a context length of up to 128K tokens. The model utilizes advanced architectures such as Multi-head Latent Attention (MLA) to optimize inference by minimizing the Key-Value (KV) cache and DeepSeekMoE to enable economical training through sparse computations. Compared to its predecessor, DeepSeek 67B, this model shows remarkable improvements, achieving a 42.5% reduction in training expenses, a 93.3% decrease in KV cache size, and a 5.76-fold increase in generation throughput. Trained on an extensive corpus of 8.1 trillion tokens, DeepSeek-V2 demonstrates exceptional capabilities in language comprehension, programming, and reasoning tasks, positioning it as one of the leading open-source models available today. Its innovative approach not only elevates its performance but also sets new benchmarks within the field of artificial intelligence.

We are thrilled to present DBRX, a versatile open LLM developed by Databricks. This innovative model achieves unprecedented performance on a variety of standard benchmarks, setting a new benchmark for existing open LLMs. Additionally, it equips both the open-source community and enterprises crafting their own LLMs with features that were once exclusive to proprietary model APIs; our evaluations indicate that it outperforms GPT-3.5 and competes effectively with Gemini 1.0 Pro. Notably, it excels as a code model, outperforming specialized counterparts like CodeLLaMA-70B in programming tasks, while also demonstrating its prowess as a general-purpose LLM. The remarkable quality of DBRX is complemented by significant enhancements in both training and inference efficiency. Thanks to its advanced fine-grained mixture-of-experts (MoE) architecture, DBRX elevates the efficiency of open models to new heights. In terms of inference speed, it can be twice as fast as LLaMA2-70B, and its total and active parameter counts are approximately 40% of those in Grok-1, showcasing its compact design without compromising capability. This combination of speed and size makes DBRX a game-changer in the landscape of open AI models.

Kimi K2 Thinking is a sophisticated open-source reasoning model created by Moonshot AI, specifically tailored for intricate, multi-step workflows where it effectively combines chain-of-thought reasoning with tool utilization across numerous sequential tasks. Employing a cutting-edge mixture-of-experts architecture, the model encompasses a staggering total of 1 trillion parameters, although only around 32 billion parameters are utilized during each inference, which enhances efficiency while retaining significant capability. It boasts a context window that can accommodate up to 256,000 tokens, allowing it to process exceptionally long inputs and reasoning sequences without sacrificing coherence. Additionally, it features native INT4 quantization, which significantly cuts down inference latency and memory consumption without compromising performance. Designed with agentic workflows in mind, Kimi K2 Thinking is capable of autonomously invoking external tools, orchestrating sequential logic steps—often involving around 200-300 tool calls in a single chain—and ensuring consistent reasoning throughout the process. Its robust architecture makes it an ideal solution for complex reasoning tasks that require both depth and efficiency.

The Hy3 preview represents Tencent Hy's most advanced model in the Hy series to date, featuring a substantial 295 billion parameters in a Mixture-of-Experts structure, with 21 billion parameters activated and an impressive 3.8 billion parameters dedicated to the MTP layer, all while accommodating a context window of up to 256,000 tokens. This groundbreaking model is the first to harness Tencent Hy's newly revamped infrastructure, aimed at enhancing practical applications in areas such as complex reasoning, following instructions, learning from context, coding tasks, and overall inference capabilities. By seamlessly integrating both rapid and thorough cognitive processing, it provides straightforward answers for simpler inquiries while facilitating in-depth analysis for intricate math, programming, and reasoning challenges. The model is crafted to exhibit comprehensive skills in understanding long contexts, adhering to instructions, employing tools, and executing agent workflows, with assessments conducted not only against conventional benchmarks but also within real-world business and development contexts. Furthermore, its design ensures adaptability to a wide range of scenarios, thereby broadening its usability in diverse applications.

Introducing the next iteration of our open-source large language model, this version features model weights along with initial code for the pretrained and fine-tuned Llama language models, which span from 7 billion to 70 billion parameters. The Llama 2 pretrained models have been developed using an impressive 2 trillion tokens and offer double the context length compared to their predecessor, Llama 1. Furthermore, the fine-tuned models have been enhanced through the analysis of over 1 million human annotations. Llama 2 demonstrates superior performance against various other open-source language models across multiple external benchmarks, excelling in areas such as reasoning, coding capabilities, proficiency, and knowledge assessments. For its training, Llama 2 utilized publicly accessible online data sources, while the fine-tuned variant, Llama-2-chat, incorporates publicly available instruction datasets along with the aforementioned extensive human annotations. Our initiative enjoys strong support from a diverse array of global stakeholders who are enthusiastic about our open approach to AI, including companies that have provided valuable early feedback and are eager to collaborate using Llama 2. The excitement surrounding Llama 2 signifies a pivotal shift in how AI can be developed and utilized collectively.

GigaChat 3 Ultra redefines open-source scale by delivering a 702B-parameter frontier model purpose-built for Russian and multilingual understanding. Designed with a modern MoE architecture, it achieves the reasoning strength of giant dense models while using only a fraction of active parameters per generation step. Its massive 14T-token training corpus includes natural human text, curated multilingual sources, extensive STEM materials, and billions of high-quality synthetic examples crafted to boost logic, math, and programming skills. This model is not a derivative or retrained foreign LLM—it is a ground-up build engineered to capture cultural nuance, linguistic accuracy, and reliable long-context performance. GigaChat 3 Ultra integrates seamlessly with open-source tooling like vLLM, sglang, DeepSeek-class architectures, and HuggingFace-based training stacks. It supports advanced capabilities including a code interpreter, improved chat template, memory system, contextual search reformulation, and 128K context windows. Benchmarking shows clear improvements over previous GigaChat generations and competitive results against global leaders in coding, reasoning, and cross-domain tasks. Overall, GigaChat 3 Ultra empowers teams to explore frontier-scale AI without sacrificing transparency, customizability, or ecosystem compatibility.

DeepSeek-V4-Pro is an advanced Mixture-of-Experts language model built for high-performance reasoning, coding, and large-scale AI applications. With 1.6 trillion total parameters and 49 billion activated parameters, it delivers strong capabilities while maintaining computational efficiency. The model supports a massive context window of up to one million tokens, making it ideal for handling long documents and complex workflows. Its hybrid attention architecture improves efficiency by reducing computational overhead while maintaining accuracy. Trained on more than 32 trillion tokens, DeepSeek-V4-Pro demonstrates strong performance across knowledge, reasoning, and coding benchmarks. It includes advanced training techniques such as improved optimization and enhanced signal propagation for better stability. The model offers multiple reasoning modes, allowing users to choose between faster responses or deeper analytical thinking. It is designed to support agentic workflows and complex multi-step problem solving. As an open-source model, it provides flexibility for developers and organizations to customize and deploy at scale. Overall, DeepSeek-V4-Pro delivers a balance of performance, efficiency, and scalability for demanding AI applications.

Yi-Large is an innovative proprietary large language model created by 01.AI, featuring an impressive context length of 32k and a cost structure of $2 for each million tokens for both inputs and outputs. Renowned for its superior natural language processing abilities, common-sense reasoning, and support for multiple languages, it competes effectively with top models such as GPT-4 and Claude3 across various evaluations. This model is particularly adept at handling tasks that involve intricate inference, accurate prediction, and comprehensive language comprehension, making it ideal for applications such as knowledge retrieval, data categorization, and the development of conversational chatbots that mimic human interaction. Built on a decoder-only transformer architecture, Yi-Large incorporates advanced features like pre-normalization and Group Query Attention, and it has been trained on an extensive, high-quality multilingual dataset to enhance its performance. The model's flexibility and economical pricing position it as a formidable player in the artificial intelligence landscape, especially for businesses looking to implement AI technologies on a global scale. Additionally, its ability to adapt to a wide range of use cases underscores its potential to revolutionize how organizations leverage language models for various needs.

DeepSeek-V4-Flash is an optimized Mixture-of-Experts language model built for efficient large-scale AI workloads and fast inference. With 284 billion total parameters and 13 billion activated parameters, it delivers strong performance while maintaining lower computational demands compared to larger models. The model supports a massive context length of up to one million tokens, making it suitable for handling long-form content and multi-step workflows. Its hybrid attention mechanism improves efficiency by minimizing resource consumption while preserving accuracy. Trained on a dataset exceeding 32 trillion tokens, DeepSeek-V4-Flash performs well across reasoning, coding, and knowledge benchmarks. It offers flexible reasoning modes, enabling users to switch between quick responses and more detailed analytical outputs. The architecture is designed to support agentic workflows and scalable deployment environments. As an open-source model, it provides flexibility for customization and integration. Overall, DeepSeek-V4-Flash is a cost-effective and high-performance solution for modern AI applications.

Ling 2.6 represents an independently developed and open-source series of large language models created by Ant Group, utilizing a Mixture of Experts (MoE) architecture to enhance inference efficiency, long context modeling, training methodologies, and collaborative reasoning for AI agents. By employing this MoE architecture, Ling effectively directs each token to engage only the most pertinent expert subnetworks, significantly reducing the computational load while preserving the extensive capabilities of the model. This series makes strides in long-sequence modeling, exemplified by Ling-2.6-1T, which accommodates a native context window of up to 1 million tokens and offers a 256K context window through its official API; additionally, Ling-2.6-flash features a native 256K context window, enabling it to handle around 200,000 characters in lengthy inputs. These models are meticulously crafted to ensure dependable retrieval of long-range information without any discernible loss of quality, regardless of whether the data is located at the start, middle, or end of the context. This innovative approach to long-context processing sets a new benchmark for efficiency and reliability in language model performance.

Xiaomi MiMo-V2.5-Pro is a next-generation open-source AI model designed for advanced reasoning, coding, and long-horizon task execution. It uses a Mixture-of-Experts architecture with over one trillion parameters and a large active parameter set for efficient performance. The model supports an extended context window of up to one million tokens, allowing it to handle complex, multi-step workflows. It is built to perform autonomous tasks, including software development, system design, and engineering optimization. Benchmark results show strong performance across coding, reasoning, and agent-based evaluation tests. MiMo-V2.5-Pro incorporates hybrid attention mechanisms to improve efficiency while maintaining accuracy across long contexts. It is optimized for token efficiency, reducing the computational cost of running complex tasks. The model can integrate with development tools and frameworks to support real-world applications. It is designed to complete tasks that would typically require significant human effort over extended periods. Xiaomi has made the model open source, enabling developers to access and customize it. By combining performance, scalability, and efficiency, MiMo-V2.5-Pro pushes the boundaries of modern AI capabilities.

Qwen3.5 represents a major advancement in open-weight multimodal AI models, engineered to function as a native vision-language agent system. Its flagship model, Qwen3.5-397B-A17B, leverages a hybrid architecture that fuses Gated DeltaNet linear attention with a high-sparsity mixture-of-experts framework, allowing only 17 billion parameters to activate during inference for improved speed and cost efficiency. Despite its sparse activation, the full 397-billion-parameter model achieves competitive performance across reasoning, coding, multilingual benchmarks, and complex agent evaluations. The hosted Qwen3.5-Plus version supports a one-million-token context window and includes built-in tool use for search, code interpretation, and adaptive reasoning. The model significantly expands multilingual coverage to 201 languages and dialects while improving encoding efficiency with a larger vocabulary. Native multimodal training enables strong performance in image understanding, video processing, document analysis, and spatial reasoning tasks. Its infrastructure includes FP8 precision pipelines and heterogeneous parallelism to boost throughput and reduce memory consumption. Reinforcement learning at scale enhances multi-step planning and general agent behavior across text and multimodal environments. Overall, Qwen3.5 positions itself as a high-efficiency foundation for autonomous digital agents capable of reasoning, searching, coding, and interacting with complex environments.

GLM-5.1 represents the latest advancement in Z.ai’s GLM series, crafted as a cutting-edge, agent-focused AI model tailored for coding, reasoning, and managing long-term workflows. This iteration builds upon the framework of GLM-5, which employs a Mixture-of-Experts (MoE) architecture to achieve high performance without incurring excessive inference expenses, aligning with a larger initiative towards open-weight models that are accessible to developers. A significant emphasis of GLM-5.1 is on fostering agentic behavior, allowing it to plan, execute, and refine multi-step tasks instead of merely reacting to isolated prompts. Its capabilities are specifically engineered to manage intricate workflows, such as debugging code, exploring repositories, and performing sequential operations while maintaining context over time. In comparison to its predecessors, GLM-5.1 enhances reliability during lengthy interactions, ensuring coherence throughout extended sessions and minimizing failures in multi-step reasoning processes. Overall, this model signifies a leap forward in AI development, particularly in its ability to support complex task management seamlessly.

Introducing Mistral NeMo, our latest and most advanced small model yet, featuring a cutting-edge 12 billion parameters and an expansive context length of 128,000 tokens, all released under the Apache 2.0 license. Developed in partnership with NVIDIA, Mistral NeMo excels in reasoning, world knowledge, and coding proficiency within its category. Its architecture adheres to industry standards, making it user-friendly and a seamless alternative for systems currently utilizing Mistral 7B. To facilitate widespread adoption among researchers and businesses, we have made available both pre-trained base and instruction-tuned checkpoints under the same Apache license. Notably, Mistral NeMo incorporates quantization awareness, allowing for FP8 inference without compromising performance. The model is also tailored for diverse global applications, adept in function calling and boasting a substantial context window. When compared to Mistral 7B, Mistral NeMo significantly outperforms in understanding and executing detailed instructions, showcasing enhanced reasoning skills and the ability to manage complex multi-turn conversations. Moreover, its design positions it as a strong contender for multi-lingual tasks, ensuring versatility across various use cases.

Tülu 3 is a cutting-edge language model created by the Allen Institute for AI (Ai2) that aims to improve proficiency in fields like knowledge, reasoning, mathematics, coding, and safety. It is based on the Llama 3 Base and undergoes a detailed four-stage post-training regimen: careful prompt curation and synthesis, supervised fine-tuning on a wide array of prompts and completions, preference tuning utilizing both off- and on-policy data, and a unique reinforcement learning strategy that enhances targeted skills through measurable rewards. Notably, this open-source model sets itself apart by ensuring complete transparency, offering access to its training data, code, and evaluation tools, thus bridging the performance divide between open and proprietary fine-tuning techniques. Performance assessments reveal that Tülu 3 surpasses other models with comparable sizes, like Llama 3.1-Instruct and Qwen2.5-Instruct, across an array of benchmarks, highlighting its effectiveness. The continuous development of Tülu 3 signifies the commitment to advancing AI capabilities while promoting an open and accessible approach to technology.

The Xiaomi MiMo API open platform serves as a developer-centric interface that allows for the integration and access of Xiaomi’s MiMo AI model family, which includes various reasoning and language models like MiMo-V2-Flash, enabling the creation of applications and services via standardized APIs and cloud endpoints. This platform empowers developers to incorporate AI-driven functionalities such as conversational agents, reasoning processes, code assistance, and search-enhanced tasks without the need to handle the complexities of model infrastructure. It features RESTful API access complete with authentication, request signing, and well-structured responses, allowing software to send user queries and receive generated text or processed results in a programmatic manner. The platform also supports essential operations including text generation, prompt management, and model inference, facilitating seamless interactions with MiMo models. Furthermore, it provides comprehensive documentation and onboarding resources, enabling teams to effectively integrate the latest open-source large language models from Xiaomi, which utilize innovative Mixture-of-Experts (MoE) architectures to enhance performance and efficiency. Overall, this open platform significantly lowers the barriers for developers looking to harness advanced AI capabilities in their projects.

Qwen3 is a state-of-the-art large language model designed to revolutionize the way we interact with AI. Featuring both thinking and non-thinking modes, Qwen3 allows users to customize its response style, ensuring optimal performance for both complex reasoning tasks and quick inquiries. With the ability to support 119 languages, the model is suitable for international projects. The model's hybrid training approach, which involves over 36 trillion tokens, ensures accuracy across a variety of disciplines, from coding to STEM problems. Its integration with platforms such as Hugging Face, ModelScope, and Kaggle allows for easy adoption in both research and production environments. By enhancing multilingual support and incorporating advanced AI techniques, Qwen3 is designed to push the boundaries of AI-driven applications.

DeepSeek-R1 is a cutting-edge open-source reasoning model created by DeepSeek, aimed at competing with OpenAI's Model o1. It is readily available through web, app, and API interfaces, showcasing its proficiency in challenging tasks such as mathematics and coding, and achieving impressive results on assessments like the American Invitational Mathematics Examination (AIME) and MATH. Utilizing a mixture of experts (MoE) architecture, this model boasts a remarkable total of 671 billion parameters, with 37 billion parameters activated for each token, which allows for both efficient and precise reasoning abilities. As a part of DeepSeek's dedication to the progression of artificial general intelligence (AGI), the model underscores the importance of open-source innovation in this field. Furthermore, its advanced capabilities may significantly impact how we approach complex problem-solving in various domains.

Mistral Large 3 pushes open-source AI into frontier territory with a massive sparse MoE architecture that activates 41B parameters per token while maintaining a highly efficient 675B total parameter design. It sets a new performance standard by combining long-context reasoning, multilingual fluency across 40+ languages, and robust multimodal comprehension within a single unified model. Trained end-to-end on thousands of NVIDIA H200 GPUs, it reaches parity with top closed-source instruction models while remaining fully accessible under the Apache 2.0 license. Developers benefit from optimized deployments through partnerships with NVIDIA, Red Hat, and vLLM, enabling smooth inference on A100, H100, and Blackwell-class systems. The model ships in both base and instruct variants, with a reasoning-enhanced version on the way for even deeper analytical capabilities. Beyond general intelligence, Mistral Large 3 is engineered for enterprise customization, allowing organizations to refine the model on internal datasets or domain-specific tasks. Its efficient token generation and powerful multimodal stack make it ideal for coding, document analysis, knowledge workflows, agentic systems, and multilingual communications. With Mistral Large 3, organizations can finally deploy frontier-class intelligence with full transparency, flexibility, and control.

Xiaomi MiMo-V2.5 is a next-generation open-source AI model that combines agentic intelligence with multimodal capabilities. It is designed to process and understand text, images, and audio within a single architecture. The model uses a sparse Mixture-of-Experts framework with a large parameter count to deliver efficient and scalable performance. It supports a context window of up to one million tokens, allowing it to handle long and complex workflows. MiMo-V2.5 integrates visual and audio encoders to improve perception and cross-modal reasoning. It is capable of performing tasks such as coding, reasoning, and multimodal analysis with strong accuracy. Benchmark results show competitive performance compared to leading AI models in both agentic and multimodal tasks. The model is optimized for token efficiency, balancing performance with lower computational cost. It is designed for real-world applications that require both reasoning and perception. Xiaomi has open-sourced the model, making it accessible for developers and researchers. By combining multimodality, scalability, and efficiency, MiMo-V2.5 pushes forward the development of advanced AI systems.

Qwen3.5-35B-A3B is a member of the Qwen3.5 "Medium" model series, meticulously crafted as an effective multimodal foundation model that strikes a balance between robust reasoning capabilities and practical application needs. Utilizing a Mixture-of-Experts (MoE) architecture, it boasts a total of 35 billion parameters, yet activates only around 3 billion for each token, enabling it to achieve performance levels similar to much larger models while significantly cutting down on computational expenses. The model employs a hybrid attention mechanism that merges linear attention with traditional attention layers, which enhances its ability to handle extensive context and boosts scalability for intricate tasks. As an inherently vision-language model, it processes both textual and visual data, catering to a variety of applications, including multimodal reasoning, programming, and automated workflows. Furthermore, it is engineered to operate as a versatile "AI agent," proficient in planning, utilizing tools, and systematically solving problems, extending its functionality beyond mere conversational interactions. This capability positions it as a valuable asset across diverse domains, where advanced AI-driven solutions are increasingly required.

Qwen3.5-Plus is an advanced multimodal foundation model engineered to deliver efficient large-context reasoning across text, image, and video inputs. Powered by a hybrid architecture that merges linear attention mechanisms with a sparse mixture-of-experts framework, the model achieves state-of-the-art performance while reducing computational overhead. It supports deep thinking mode, enabling extended reasoning chains of up to 80K tokens and total context windows of up to 1 million tokens. Developers can leverage features such as structured output generation, function calling, web search, and integrated code interpretation to build intelligent agent workflows. The model is optimized for high throughput, supporting large token-per-minute limits and robust rate limits for enterprise-scale applications. Qwen3.5-Plus also includes explicit caching options to reduce costs during repeated inference tasks. With tiered pricing based on input and output tokens, organizations can scale usage predictably. OpenAI-compatible API endpoints make integration straightforward across existing AI stacks and developer tools. Designed for demanding applications, Qwen3.5-Plus excels in long-document analysis, multimodal reasoning, and advanced AI agent development.

Qwen3-Coder is a versatile coding model that comes in various sizes, prominently featuring the 480B-parameter Mixture-of-Experts version with 35B active parameters, which naturally accommodates 256K-token contexts that can be extended to 1M tokens. This model achieves impressive performance that rivals Claude Sonnet 4, having undergone pre-training on 7.5 trillion tokens, with 70% of that being code, and utilizing synthetic data refined through Qwen2.5-Coder to enhance both coding skills and overall capabilities. Furthermore, the model benefits from post-training techniques that leverage extensive, execution-guided reinforcement learning, which facilitates the generation of diverse test cases across 20,000 parallel environments, thereby excelling in multi-turn software engineering tasks such as SWE-Bench Verified without needing test-time scaling. In addition to the model itself, the open-source Qwen Code CLI, derived from Gemini Code, empowers users to deploy Qwen3-Coder in dynamic workflows with tailored prompts and function calling protocols, while also offering smooth integration with Node.js, OpenAI SDKs, and environment variables. This comprehensive ecosystem supports developers in optimizing their coding projects effectively and efficiently.

The Ling 2.6 Flash represents the newest and most economical addition to the Ling series, utilizing a Mixture of Experts architecture that encompasses a total of 104 billion parameters, with 7.4 billion of those being actively engaged. This model is crafted to strike an ideal balance between inference speed and computational expense, making it an excellent fit for diverse scenarios where reasoning prowess, high throughput, and effective deployment are essential. By employing its MoE structure, Ling ensures that each token activates only the most pertinent expert subnetworks, significantly reducing the actual computational load while preserving the expansive capacity of the model. Offering a native context window of 256K, Ling 2.6 Flash is capable of handling around 200,000 characters of lengthy input, adeptly retrieving critical long-range information regardless of its position in the context. Furthermore, its overall benchmark performance rivals or surpasses that of 40 billion parameter Dense models, highlighting its competitive edge in the field of AI. This blend of efficiency and performance makes Ling 2.6 Flash a noteworthy option for developers seeking advanced capabilities without excessive resource demands.

Qwen2 represents a collection of extensive language models crafted by the Qwen team at Alibaba Cloud. This series encompasses a variety of models, including base and instruction-tuned versions, with parameters varying from 0.5 billion to an impressive 72 billion, showcasing both dense configurations and a Mixture-of-Experts approach. The Qwen2 series aims to outperform many earlier open-weight models, including its predecessor Qwen1.5, while also striving to hold its own against proprietary models across numerous benchmarks in areas such as language comprehension, generation, multilingual functionality, programming, mathematics, and logical reasoning. Furthermore, this innovative series is poised to make a significant impact in the field of artificial intelligence, offering enhanced capabilities for a diverse range of applications.

CodeQwen serves as the coding counterpart to Qwen, which is a series of large language models created by the Qwen team at Alibaba Cloud. Built on a transformer architecture that functions solely as a decoder, this model has undergone extensive pre-training using a vast dataset of code. It showcases robust code generation abilities and demonstrates impressive results across various benchmarking tests. With the capacity to comprehend and generate long contexts of up to 64,000 tokens, CodeQwen accommodates 92 programming languages and excels in tasks such as text-to-SQL queries and debugging. Engaging with CodeQwen is straightforward—you can initiate a conversation with just a few lines of code utilizing transformers. The foundation of this interaction relies on constructing the tokenizer and model using pre-existing methods, employing the generate function to facilitate dialogue guided by the chat template provided by the tokenizer. In alignment with our established practices, we implement the ChatML template tailored for chat models. This model adeptly completes code snippets based on the prompts it receives, delivering responses without the need for any further formatting adjustments, thereby enhancing the user experience. The seamless integration of these elements underscores the efficiency and versatility of CodeQwen in handling diverse coding tasks.

This repository showcases the research preview of LongLLaMA, an advanced large language model that can manage extensive contexts of up to 256,000 tokens or potentially more. LongLLaMA is developed on the OpenLLaMA framework and has been fine-tuned utilizing the Focused Transformer (FoT) technique. The underlying code for LongLLaMA is derived from Code Llama. We are releasing a smaller 3B base variant of the LongLLaMA model, which is not instruction-tuned, under an open license (Apache 2.0), along with inference code that accommodates longer contexts available on Hugging Face. This model's weights can seamlessly replace LLaMA in existing systems designed for shorter contexts, specifically those handling up to 2048 tokens. Furthermore, we include evaluation results along with comparisons to the original OpenLLaMA models, thereby providing a comprehensive overview of LongLLaMA's capabilities in the realm of long-context processing.

Olmo 3 represents a comprehensive family of open models featuring variations with 7 billion and 32 billion parameters, offering exceptional capabilities in base performance, reasoning, instruction, and reinforcement learning, while also providing transparency throughout the model development process, which includes access to raw training datasets, intermediate checkpoints, training scripts, extended context support (with a window of 65,536 tokens), and provenance tools. The foundation of these models is built upon the Dolma 3 dataset, which comprises approximately 9 trillion tokens and utilizes a careful blend of web content, scientific papers, programming code, and lengthy documents; this thorough pre-training, mid-training, and long-context approach culminates in base models that undergo post-training enhancements through supervised fine-tuning, preference optimization, and reinforcement learning with accountable rewards, resulting in the creation of the Think and Instruct variants. Notably, the 32 billion Think model has been recognized as the most powerful fully open reasoning model to date, demonstrating performance that closely rivals that of proprietary counterparts in areas such as mathematics, programming, and intricate reasoning tasks, thereby marking a significant advancement in open model development. This innovation underscores the potential for open-source models to compete with traditional, closed systems in various complex applications.

The Nemotron-3 Super is an innovative member of NVIDIA's Nemotron 3 series of open models, specifically crafted to facilitate sophisticated agentic AI systems that can effectively reason, plan, and carry out multi-step workflows in intricate environments. This model features a unique hybrid Mamba-Transformer Mixture-of-Experts architecture that merges the streamlined efficiency of Mamba layers with the contextual depth provided by transformer attention mechanisms, which allows it to adeptly manage extended sequences and intricate reasoning tasks with impressive accuracy and throughput. By activating only a portion of its parameters for each token, this architecture significantly enhances computational efficiency while preserving robust reasoning capabilities, making it ideal for scalable inference under heavy workloads. The Nemotron-3 Super comprises approximately 120 billion parameters, with around 12 billion being active during inference, which substantially boosts its ability to handle multi-step reasoning and collaborative interactions among agents within extensive contexts. Such advancements make it a powerful tool for tackling diverse challenges in AI applications.

Ring is a sophisticated trillion-parameter thinking model created by Ant Group, specifically tailored for real-world Agent workflows. It employs a Mixture of Experts architecture similar to that of Ling, activating approximately 63 billion parameters during each inference, and is particularly geared towards tasks such as coding agents, utilizing tools, collaborating with multiple tools, engineering development, conducting research analysis, and executing long-term tasks. Instead of merely striving for "smarter" outcomes, Ring prioritizes the reliable completion of intricate tasks while maintaining a cost-effective approach, effectively balancing quality, speed, and efficiency in production settings. The latest iteration, Ring-2.6-1T, incorporates an adjustable Reasoning Effort mechanism that features high and xhigh reasoning intensity levels, which allocates an adaptive reasoning budget according to the complexity of the task at hand. The high mode is specifically optimized for high-frequency Agent workflows, resulting in lower token costs and quicker multi-step execution, while also facilitating multi-turn interactions, tool collaboration, and task decomposition. As a result, Ring demonstrates a significant advancement in enhancing the capabilities of agents in various operational contexts.

The Mixtral 8x22B represents our newest open model, establishing a new benchmark for both performance and efficiency in the AI sector. This sparse Mixture-of-Experts (SMoE) model activates only 39B parameters from a total of 141B, ensuring exceptional cost efficiency relative to its scale. Additionally, it demonstrates fluency in multiple languages, including English, French, Italian, German, and Spanish, while also possessing robust skills in mathematics and coding. With its native function calling capability, combined with the constrained output mode utilized on la Plateforme, it facilitates the development of applications and the modernization of technology stacks on a large scale. The model's context window can handle up to 64K tokens, enabling accurate information retrieval from extensive documents. We prioritize creating models that maximize cost efficiency for their sizes, thereby offering superior performance-to-cost ratios compared to others in the community. The Mixtral 8x22B serves as a seamless extension of our open model lineage, and its sparse activation patterns contribute to its speed, making it quicker than any comparable dense 70B model on the market. Furthermore, its innovative design positions it as a leading choice for developers seeking high-performance solutions.

MiMo-V2-Flash is a large language model created by Xiaomi that utilizes a Mixture-of-Experts (MoE) framework, combining remarkable performance with efficient inference capabilities. With a total of 309 billion parameters, it activates just 15 billion parameters during each inference, allowing it to effectively balance reasoning quality and computational efficiency. This model is well-suited for handling lengthy contexts, making it ideal for tasks such as long-document comprehension, code generation, and multi-step workflows. Its hybrid attention mechanism integrates both sliding-window and global attention layers, which helps to minimize memory consumption while preserving the ability to understand long-range dependencies. Additionally, the Multi-Token Prediction (MTP) design enhances inference speed by enabling the simultaneous processing of batches of tokens. MiMo-V2-Flash boasts impressive generation rates of up to approximately 150 tokens per second and is specifically optimized for applications that demand continuous reasoning and multi-turn interactions. The innovative architecture of this model reflects a significant advancement in the field of language processing.

StarCoder and StarCoderBase represent advanced Large Language Models specifically designed for code, developed using openly licensed data from GitHub, which encompasses over 80 programming languages, Git commits, GitHub issues, and Jupyter notebooks. In a manner akin to LLaMA, we constructed a model with approximately 15 billion parameters trained on a staggering 1 trillion tokens. Furthermore, we tailored the StarCoderBase model with 35 billion Python tokens, leading to the creation of what we now refer to as StarCoder. Our evaluations indicated that StarCoderBase surpasses other existing open Code LLMs when tested against popular programming benchmarks and performs on par with or even exceeds proprietary models like code-cushman-001 from OpenAI, the original Codex model that fueled early iterations of GitHub Copilot. With an impressive context length exceeding 8,000 tokens, the StarCoder models possess the capability to handle more information than any other open LLM, thus paving the way for a variety of innovative applications. This versatility is highlighted by our ability to prompt the StarCoder models through a sequence of dialogues, effectively transforming them into dynamic technical assistants that can provide support in diverse programming tasks.

MiniMax M2 is an open-source foundational model tailored for agent-driven applications and coding tasks, achieving an innovative equilibrium of efficiency, velocity, and affordability. It shines in comprehensive development environments, adeptly managing programming tasks, invoking tools, and executing intricate, multi-step processes, complete with features like Python integration, while offering impressive inference speeds of approximately 100 tokens per second and competitive API pricing at around 8% of similar proprietary models. The model includes a "Lightning Mode" designed for rapid, streamlined agent operations, alongside a "Pro Mode" aimed at thorough full-stack development, report creation, and the orchestration of web-based tools; its weights are entirely open source, allowing for local deployment via vLLM or SGLang. MiniMax M2 stands out as a model ready for production use, empowering agents to autonomously perform tasks such as data analysis, software development, tool orchestration, and implementing large-scale, multi-step logic across real organizational contexts. With its advanced capabilities, this model is poised to revolutionize the way developers approach complex programming challenges.

GLM-5.2 is a next-generation large language model built for users who need strong reasoning, coding support, and agentic AI capabilities. It can assist with complex software development tasks, technical problem-solving, automation workflows, and advanced research projects. The model is designed to process long-context information, which makes it helpful for analyzing large documents, reviewing codebases, and maintaining continuity across multi-step tasks. GLM-5.2 supports developers and organizations that want to create AI-powered tools capable of planning, reasoning, and executing more sophisticated workflows. Its architecture is structured to deliver high performance while improving efficiency for demanding AI use cases. Businesses can use GLM-5.2 to enhance productivity, streamline engineering processes, and build more capable intelligent applications. It is also useful for teams that need AI assistance across documentation, data interpretation, coding, testing, and workflow automation. The model’s emphasis on agentic engineering makes it well-suited for applications that require more than simple text generation. GLM-5.2 provides a flexible AI foundation for companies looking to bring advanced reasoning and automation into their products or internal operations.

In honor of Cleopatra, whose magnificent fate concluded amidst the tragic incident involving a snake, we are excited to introduce Codestral Mamba, a Mamba2 language model specifically designed for code generation and released under an Apache 2.0 license. Codestral Mamba represents a significant advancement in our ongoing initiative to explore and develop innovative architectures. It is freely accessible for use, modification, and distribution, and we aspire for it to unlock new avenues in architectural research. The Mamba models are distinguished by their linear time inference capabilities and their theoretical potential to handle sequences of infinite length. This feature enables users to interact with the model effectively, providing rapid responses regardless of input size. Such efficiency is particularly advantageous for enhancing code productivity; therefore, we have equipped this model with sophisticated coding and reasoning skills, allowing it to perform competitively with state-of-the-art transformer-based models. As we continue to innovate, we believe Codestral Mamba will inspire further advancements in the coding community.

MAI-Thinking-1 represents Microsoft AI's advanced reasoning model, specifically engineered to tackle intricate and significant challenges, exhibiting superior reasoning capabilities alongside robust software engineering performance within its category. This model features a configuration of 35 billion active parameters and roughly 1 trillion total parameters as a sparse Mixture of Experts, allowing it to maintain a more streamlined inference footprint compared to much larger alternatives while still achieving performance comparable to leading models on essential software engineering benchmarks. Microsoft developed MAI-Thinking-1 from the ground up, utilizing high-quality, enterprise-grade, commercially licensed data, ensuring that its abilities are acquired rather than derived from third-party models. Integral to Microsoft AI’s innovative Hill-Climbing Machine, this model benefits from a collaborative development process designed for ongoing and reliable enhancements throughout all stages of model creation. MAI-Thinking-1 is particularly suited for agentic coding environments, as it is capable of reading code, modifying files, executing tests, detecting errors, and recovering from mistakes made along the way. This ability to adapt and learn in real-time makes it a valuable asset for developers seeking efficiency and reliability in their projects.

Reka Flash 3 is a cutting-edge multimodal AI model with 21 billion parameters, crafted by Reka AI to perform exceptionally well in tasks such as general conversation, coding, following instructions, and executing functions. This model adeptly handles and analyzes a myriad of inputs, including text, images, video, and audio, providing a versatile and compact solution for a wide range of applications. Built from the ground up, Reka Flash 3 was trained on a rich array of datasets, encompassing both publicly available and synthetic information, and it underwent a meticulous instruction tuning process with high-quality selected data to fine-tune its capabilities. The final phase of its training involved employing reinforcement learning techniques, specifically using the REINFORCE Leave One-Out (RLOO) method, which combined both model-based and rule-based rewards to significantly improve its reasoning skills. With an impressive context length of 32,000 tokens, Reka Flash 3 competes effectively with proprietary models like OpenAI's o1-mini, making it an excellent choice for applications requiring low latency or on-device processing. The model operates at full precision with a memory requirement of 39GB (fp16), although it can be efficiently reduced to just 11GB through the use of 4-bit quantization, demonstrating its adaptability for various deployment scenarios. Overall, Reka Flash 3 represents a significant advancement in multimodal AI technology, capable of meeting diverse user needs across multiple platforms.

Qwen3.6 is an advanced AI model from Alibaba that builds on previous Qwen releases with a focus on real-world utility and performance. It is designed as a multimodal large language model capable of understanding and generating text while also processing visual and structured data. The model is optimized for coding tasks, enabling developers to handle complex, repository-level programming workflows. Qwen3.6 uses a mixture-of-experts (MoE) architecture, which activates only a portion of its parameters during inference to improve efficiency. This design allows it to deliver strong performance while reducing computational costs. It is available in both proprietary and open-weight versions, giving developers flexibility in deployment. The model supports integration into enterprise systems and cloud platforms, particularly within Alibaba’s ecosystem. Qwen3.6 also introduces stronger agentic capabilities, allowing it to perform multi-step reasoning and more autonomous task execution. It is designed to handle complex workflows, including engineering, analysis, and decision-making tasks. The model emphasizes stability and responsiveness based on developer feedback. Overall, Qwen3.6 provides a scalable and efficient AI solution for coding, automation, and multimodal applications.

Sarvam-M is an advanced, multilingual large language model that integrates hybrid reasoning to excel in various Indian languages, mathematical tasks, and programming challenges all within a single, streamlined framework. It is built on the foundation of Mistral-Small, boasting a robust architecture with 24 billion parameters, which has been refined through supervised fine-tuning, reinforcement learning with clear rewards, and optimizations for inference to enhance both precision and efficiency. This model is meticulously trained to proficiently handle over ten prominent Indic languages, accommodating native scripts, romanized text, and code-mixed submissions, thereby facilitating smooth multilingual interactions in a variety of linguistic environments. Moreover, Sarvam-M adopts a hybrid reasoning framework, enabling it to alternate between an in-depth “thinking” mode for intricate tasks such as mathematics, logic puzzles, and programming, and a rapid response mode for everyday inquiries, providing an effective balance between speed and performance. This versatility makes Sarvam-M an invaluable tool for users looking to engage with technology in an increasingly diverse linguistic landscape.

Kimi K2.6 is an advanced agentic AI model created by Moonshot AI, aiming to enhance practical implementation, programming, and complex reasoning compared to its predecessors, K2 and K2.5. This model is based on a Mixture-of-Experts framework and the multimodal, agent-centric principles of the Kimi series, merging language comprehension, coding capabilities, and tool utilization into one cohesive system that can plan and execute intricate workflows. It features enhanced reasoning skills and significantly better agent planning, enabling it to deconstruct tasks, synchronize various tools, and tackle multi-file or multi-step challenges with increased precision and effectiveness. Additionally, it provides robust tool-calling capabilities with a high degree of reliability, facilitating seamless integration with external platforms like web searches or APIs, and incorporates built-in validation systems to guarantee the accuracy of execution formats. Notably, Kimi K2.6 represents a significant leap forward in the realm of AI, setting new standards for the complexity and reliability of automated tasks.

Grok 4.1 Fast represents xAI’s leap forward in building highly capable agents that rely heavily on tool calling, long-context reasoning, and real-time information retrieval. It supports a robust 2-million-token window, enabling long-form planning, deep research, and multi-step workflows without degradation. Through extensive RL training and exposure to diverse tool ecosystems, the model performs exceptionally well on demanding benchmarks like τ²-bench Telecom. When paired with the Agent Tools API, it can autonomously browse the web, search X posts, execute Python code, and retrieve documents, eliminating the need for developers to manage external infrastructure. It is engineered to maintain intelligence across multi-turn conversations, making it ideal for enterprise tasks that require continuous context. Its benchmark accuracy on tool-calling and function-calling tasks clearly surpasses competing models in speed, cost, and reliability. Developers can leverage these strengths to build agents that automate customer support, perform real-time analysis, and execute complex domain-specific tasks. With its performance, low pricing, and availability on platforms like OpenRouter, Grok 4.1 Fast stands out as a production-ready solution for next-generation AI systems.

Mistral Small 4 is a next-generation open-source AI model created by Mistral AI to deliver powerful reasoning, coding, and multimodal capabilities within a single unified architecture. The model merges features from several specialized systems, including Magistral for advanced reasoning, Pixtral for multimodal processing, and Devstral for agentic software development tasks. It supports both text and image inputs, enabling applications such as conversational AI, document analysis, and visual data interpretation. The model is built using a mixture-of-experts design with 128 experts, allowing efficient scaling while maintaining strong performance across diverse tasks. Users can adjust the model’s reasoning behavior through a configurable parameter that toggles between lightweight responses and deeper analytical processing. Mistral Small 4 also provides a large context window that enables it to handle long conversations, detailed documents, and complex reasoning chains. Compared with earlier versions, the model offers improved performance, reduced latency, and higher throughput for real-time applications. Developers can integrate it with popular machine learning frameworks such as Transformers, vLLM, and llama.cpp. The model’s open-source Apache 2.0 license allows organizations to fine-tune and customize it for specialized use cases. By combining efficiency, flexibility, and multimodal intelligence, Mistral Small 4 provides a versatile foundation for building advanced AI-powered applications.