Alternatives to Ai2 OLMoE

NVIDIA Nemotron 3.5 Super VL is a multimodal foundation model developed for AI agents that require reasoning, visual understanding, coding, and multistep task execution. Its 120-billion-parameter mixture-of-experts architecture activates approximately 12 billion parameters per token, enabling efficient inference while maintaining substantial model capacity. The model processes text, images, documents, and video within a unified system that combines multimodal interpretation with instruction following and tool use. Its document intelligence capabilities include extracting information from tables, analyzing charts, interpreting page layouts, and processing multipage documents. Video understanding features support visual information retrieval, content review, incident analysis, and reasoning across recorded sequences. The model also supports software engineering tasks such as code analysis, error identification, debugging, testing, and recommending fixes. Developers can customize Nemotron 3.5 Super VL using NVIDIA NeMo for supervised fine-tuning, low-rank adaptation, and reinforcement learning with domain-specific data. Its inference optimizations include speculative decoding, context reuse, multi-token prediction, and NVFP4 quantization to improve throughput and reduce computational requirements. The model is available with open weights and supports deployment across compatible local hardware, enterprise data centers, and cloud infrastructure.

Kimi K3.1 Pro is an advanced multimodal AI reasoning model developed by Moonshot AI for software engineering, autonomous agents, technical design, and analytical knowledge work. Built on the Kimi K3 architecture, the model uses approximately 2.8 trillion total parameters with 104 billion active parameters and supports a one-million-token context window. Its enhanced reasoning capabilities enable complex, multistep problem-solving across programming, scientific analysis, financial research, and business operations. Coding features include source code generation, debugging, repository-level modifications, automated testing, and end-to-end application development. The model can create interactive websites, Three.js environments, games, and software projects using development frameworks and engines such as Unity, Unreal Engine, and Godot. Its spatial reasoning capabilities support CAD code generation, parametric modeling, 3D asset creation, and geometry adjustments through tools such as Blender. Financial analysis capabilities include spreadsheet modeling, document-based research, numerical reasoning, and investment analysis using information from multiple sources. Kimi K3.1 Pro supports text and image inputs, external tool use, and long-running agentic workflows that require planning and iterative execution. The model is accessible through Kimi applications and APIs, with an additional Highspeed version designed to deliver approximately two to three times faster responses.

GLM-5.2 is a next-generation large language model built for users who need strong reasoning, coding support, and agentic AI capabilities. It can assist with complex software development tasks, technical problem-solving, automation workflows, and advanced research projects. The model is designed to process long-context information, which makes it helpful for analyzing large documents, reviewing codebases, and maintaining continuity across multi-step tasks. GLM-5.2 supports developers and organizations that want to create AI-powered tools capable of planning, reasoning, and executing more sophisticated workflows. Its architecture is structured to deliver high performance while improving efficiency for demanding AI use cases. Businesses can use GLM-5.2 to enhance productivity, streamline engineering processes, and build more capable intelligent applications. It is also useful for teams that need AI assistance across documentation, data interpretation, coding, testing, and workflow automation. The model’s emphasis on agentic engineering makes it well-suited for applications that require more than simple text generation. GLM-5.2 provides a flexible AI foundation for companies looking to bring advanced reasoning and automation into their products or internal operations.

NVIDIA Nemotron 3.5 Bolt is a series of efficient AI models developed by NVIDIA for running autonomous agents and conversational applications directly on local hardware. The family consists of Bolt 74B-A9B 24GB and Bolt E4B 4GB, which address different performance and memory requirements. Bolt 74B-A9B uses a mixture-of-experts architecture with 74 billion total parameters and approximately 9 billion active parameters to balance reasoning capabilities with computational efficiency. Native 2-bit quantization enables the model to operate within a 24GB memory footprint on supported NVIDIA systems. Its agentic capabilities include web research, code generation, software debugging, information retrieval, and multistep task execution. The model can be integrated with local AI agent frameworks and development tools to complete assignments without sending application workloads to external inference services. Bolt E4B is optimized for fast conversational responses, multistep interactions, and embedded AI experiences such as virtual assistants and interactive game characters. NVIDIA supports local deployment of the Bolt family across compatible GeForce RTX, RTX PRO, DGX Spark, and Jetson hardware, depending on the model variant. Bolt 74B-A9B is available with open weights through Hugging Face and supports inference tools including llama.cpp, Ollama, LM Studio, Unsloth, and vLLM.

DeepSeek-V4-Pro is an advanced Mixture-of-Experts language model built for high-performance reasoning, coding, and large-scale AI applications. With 1.6 trillion total parameters and 49 billion activated parameters, it delivers strong capabilities while maintaining computational efficiency. The model supports a massive context window of up to one million tokens, making it ideal for handling long documents and complex workflows. Its hybrid attention architecture improves efficiency by reducing computational overhead while maintaining accuracy. Trained on more than 32 trillion tokens, DeepSeek-V4-Pro demonstrates strong performance across knowledge, reasoning, and coding benchmarks. It includes advanced training techniques such as improved optimization and enhanced signal propagation for better stability. The model offers multiple reasoning modes, allowing users to choose between faster responses or deeper analytical thinking. It is designed to support agentic workflows and complex multi-step problem solving. As an open-source model, it provides flexibility for developers and organizations to customize and deploy at scale. Overall, DeepSeek-V4-Pro delivers a balance of performance, efficiency, and scalability for demanding AI applications.

Inkling is Thinking Machines’ open-weights foundation model built for customization, multimodal reasoning, and agentic AI workflows. The model uses a Mixture-of-Experts architecture with 975 billion total parameters and 41 billion active parameters, making it large in capacity while activating only a subset of experts per token. Inkling supports up to a 1 million token context window and was pretrained on 45 trillion tokens spanning text, images, audio, and video. It is designed as a broad generalist model with strengths across coding, reasoning, instruction following, factuality, tool use, vision, audio understanding, forecasting, and safety. Developers can tune its thinking effort to trade off latency, cost, and performance, which is useful for production systems that need efficient reasoning at scale. Inkling can be fine-tuned on Tinker, tested in the Inkling Playground, and deployed through partners such as TogetherAI, Fireworks, Modal, Databricks, Baseten, vLLM, SGLang, llama.cpp, and Hugging Face transformers. The model can generate applications, operate tools, create styled artifacts, reason over visual and audio inputs, and support long refinement loops for collaborative work. Thinking Machines also previewed Inkling-Small, a lighter Mixture-of-Experts model with 276 billion total parameters and 12 billion active parameters for lower-cost and lower-latency workloads. By combining open weights, multimodal training, agentic capabilities, efficient reasoning, and fine-tuning support, Inkling gives builders a flexible AI foundation for specialized products and workflows.

Nemotron 3 Nano is a small yet powerful large language model from NVIDIA's Nemotron 3 series, specifically crafted for effective agentic reasoning, interactive dialogue, and programming assignments. Its innovative Mixture-of-Experts Mamba-Transformer framework selectively activates a limited set of parameters for each token, ensuring rapid inference times without sacrificing accuracy or reasoning capabilities. With roughly 31.6 billion parameters in total, including about 3.2 billion active ones (or 3.6 billion when factoring in embeddings), it surpasses the performance of the previous Nemotron 2 Nano model while requiring less computational effort for each forward pass. The model is equipped to manage long-context processing of up to one million tokens, which allows it to efficiently process extensive documents, complex workflows, and detailed reasoning sequences in a single cycle. Moreover, it is engineered for high-throughput, real-time performance, making it particularly adept at handling multi-turn dialogues, invoking tools, and executing agent-based workflows that involve intricate planning and reasoning tasks. This versatility positions Nemotron 3 Nano as a leading choice for applications requiring advanced cognitive capabilities.

Laguna S 2.1 is an advanced open weight coding model that emphasizes long-term project completion and efficient reasoning capabilities. Featuring a 118-billion-parameter Mixture-of-Experts architecture, it activates 8 billion parameters for each token and accommodates a context window of up to one million tokens in both thinking and non-thinking modes. The model’s streamlined active size allows it to perform intricate tasks on local machines while still competing favorably against significantly larger models across various benchmarks, including terminal usage, software engineering, codebase question answering, and tool utilization. Designed for resilience, Laguna S 2.1 excels in tackling challenging assignments with enhanced persistence, meticulous verification, and a readiness to backtrack rather than prematurely claim success. In practical applications, it has successfully created and validated a browser rendering engine from scratch, optimized an agent harness for improved execution speed and reduced memory usage, and conducted extensive mathematical research using the available tools within its environment, demonstrating its versatility and effectiveness. This combination of features positions Laguna S 2.1 as a powerful tool for developers seeking innovative solutions.

NVIDIA's Nemotron 3 represents a collection of open large language models crafted to drive advanced reasoning, conversational AI, and autonomous AI agents. This series consists of three distinct models tailored for varying scales of AI workloads, all while ensuring remarkable efficiency and precision. Emphasizing "agentic AI" features, these models are capable of executing multi-step reasoning, collaborating with tools, and functioning as integral parts of multi-agent systems utilized across automation, research, and enterprise sectors. The underlying architecture employs a hybrid mixture-of-experts (MoE) approach paired with transformer techniques, enabling the activation of only specific parameter subsets for each task, thereby enhancing performance and minimizing computational expenses. Designed to excel in reasoning, dialogue, and strategic planning, the Nemotron 3 models are optimized for high throughput, making them suitable for extensive deployment across diverse applications. Additionally, their innovative architecture allows for greater adaptability and scalability, ensuring they meet the evolving demands of modern AI challenges.

Qwen3.6 is an advanced AI model from Alibaba that builds on previous Qwen releases with a focus on real-world utility and performance. It is designed as a multimodal large language model capable of understanding and generating text while also processing visual and structured data. The model is optimized for coding tasks, enabling developers to handle complex, repository-level programming workflows. Qwen3.6 uses a mixture-of-experts (MoE) architecture, which activates only a portion of its parameters during inference to improve efficiency. This design allows it to deliver strong performance while reducing computational costs. It is available in both proprietary and open-weight versions, giving developers flexibility in deployment. The model supports integration into enterprise systems and cloud platforms, particularly within Alibaba’s ecosystem. Qwen3.6 also introduces stronger agentic capabilities, allowing it to perform multi-step reasoning and more autonomous task execution. It is designed to handle complex workflows, including engineering, analysis, and decision-making tasks. The model emphasizes stability and responsiveness based on developer feedback. Overall, Qwen3.6 provides a scalable and efficient AI solution for coding, automation, and multimodal applications.

Qwen3.8-2.4T-A95B stands out as the most extensive open model within the Qwen3.8 series, offering advanced Qwen-Max-class features in a publicly accessible format. Constructed upon the solid framework of Qwen3.5, this model significantly enhances performance in areas such as coding, professional tasks, research, and complex, prolonged agentic activities, emphasizing the reliability of executing intricate, multi-step workflows to completion. Utilizing a cutting-edge mixture-of-experts architecture, it boasts an impressive total of 2.4 trillion parameters, with 95 billion of those being activated, featuring 512 experts and engaging 10 routed along with one shared expert simultaneously. The model accommodates a native context length of 262,144 tokens, which can be extended to around 1.01 million tokens, thereby providing substantial flexibility for various applications. Furthermore, improvements in agent execution, such as enhanced autonomous planning and better responsiveness to environmental feedback, contribute to its efficiency, while its broader compatibility with widely used agent frameworks and development tools facilitates seamless integration into existing systems, making it a versatile choice for developers and researchers alike.

Qwen2 represents a collection of extensive language models crafted by the Qwen team at Alibaba Cloud. This series encompasses a variety of models, including base and instruction-tuned versions, with parameters varying from 0.5 billion to an impressive 72 billion, showcasing both dense configurations and a Mixture-of-Experts approach. The Qwen2 series aims to outperform many earlier open-weight models, including its predecessor Qwen1.5, while also striving to hold its own against proprietary models across numerous benchmarks in areas such as language comprehension, generation, multilingual functionality, programming, mathematics, and logical reasoning. Furthermore, this innovative series is poised to make a significant impact in the field of artificial intelligence, offering enhanced capabilities for a diverse range of applications.

Sarvam-105B stands as the premier large language model within Sarvam’s open-source lineup, engineered to provide exceptional reasoning capabilities, multilingual comprehension, and agent-driven execution all within a unified and scalable framework. This Mixture-of-Experts (MoE) model boasts an impressive total of approximately 105 billion parameters, activating only a subset for each token, which allows it to maintain superior computational efficiency while excelling in intricate tasks. It is particularly optimized for advanced reasoning, programming, mathematical challenges, and agentic processes, positioning it well for scenarios that necessitate multi-step problem-solving and organized outputs rather than merely engaging in basic conversations. With the ability to process long contexts of around 128K tokens, Sarvam-105B can effectively manage extensive documents, prolonged discussions, and complex analytical inquiries, ensuring coherence throughout. Additionally, its design facilitates a diverse range of applications, providing users with versatile tools to tackle a variety of intellectual challenges.

Mistral Small 4 is a next-generation open-source AI model created by Mistral AI to deliver powerful reasoning, coding, and multimodal capabilities within a single unified architecture. The model merges features from several specialized systems, including Magistral for advanced reasoning, Pixtral for multimodal processing, and Devstral for agentic software development tasks. It supports both text and image inputs, enabling applications such as conversational AI, document analysis, and visual data interpretation. The model is built using a mixture-of-experts design with 128 experts, allowing efficient scaling while maintaining strong performance across diverse tasks. Users can adjust the model’s reasoning behavior through a configurable parameter that toggles between lightweight responses and deeper analytical processing. Mistral Small 4 also provides a large context window that enables it to handle long conversations, detailed documents, and complex reasoning chains. Compared with earlier versions, the model offers improved performance, reduced latency, and higher throughput for real-time applications. Developers can integrate it with popular machine learning frameworks such as Transformers, vLLM, and llama.cpp. The model’s open-source Apache 2.0 license allows organizations to fine-tune and customize it for specialized use cases. By combining efficiency, flexibility, and multimodal intelligence, Mistral Small 4 provides a versatile foundation for building advanced AI-powered applications.

Kimi K2 represents a cutting-edge series of open-source large language models utilizing a mixture-of-experts (MoE) architecture, with a staggering 1 trillion parameters in total and 32 billion activated parameters tailored for optimized task execution. Utilizing the Muon optimizer, it has been trained on a substantial dataset of over 15.5 trillion tokens, with its performance enhanced by MuonClip’s attention-logit clamping mechanism, resulting in remarkable capabilities in areas such as advanced knowledge comprehension, logical reasoning, mathematics, programming, and various agentic operations. Moonshot AI offers two distinct versions: Kimi-K2-Base, designed for research-level fine-tuning, and Kimi-K2-Instruct, which is pre-trained for immediate applications in chat and tool interactions, facilitating both customized development and seamless integration of agentic features. Comparative benchmarks indicate that Kimi K2 surpasses other leading open-source models and competes effectively with top proprietary systems, particularly excelling in coding and intricate task analysis. Furthermore, it boasts a generous context length of 128 K tokens, compatibility with tool-calling APIs, and support for industry-standard inference engines, making it a versatile option for various applications. The innovative design and features of Kimi K2 position it as a significant advancement in the field of artificial intelligence language processing.

Beam represents Reflection’s inaugural open-weight model, characterized as a sparse Mixture-of-Experts framework featuring a staggering 501 billion parameters, of which 23 billion are actively utilized, specifically crafted for tasks involving coding, reasoning, and agentic functions. Its prowess is derived from extensive pretraining and reinforcement learning, having been developed using a vast dataset of 23.8 trillion diverse, high-quality tokens sourced from the web, public domains, and proprietary licensed materials. With a targeted emphasis on enhancing coding and agentic capabilities, Beam is engineered to provide competitive open-weight performance while ensuring efficient inference compute. This model adeptly handles a wide array of tasks, including intricate software engineering, terminal operations, STEM activities, web searches, tool utilization, and general knowledge inquiries. Reinforcement learning techniques have been employed to bolster its abilities in multi-step reasoning, tool application, and responsiveness to environmental feedback. Moreover, users have the flexibility to manage the balance between efficiency and performance through an adjustable reasoning effort parameter, thus tailoring the model's output to better suit their specific needs.

Qwen3.8-Flash-Next represents an open-weight multimodal Mixture-of-Experts architecture and serves as an initial glimpse into the design intended for Qwen4. This model strategically enhances attention mechanisms, residual pathways, embeddings, and optimization techniques to boost its capabilities, improve computational efficiency, expand model capacity, and ensure training stability. Its innovative hybrid architecture merges Gated DeltaNet, which adeptly compresses past information, with Qwen Sparse Attention, enabling the selection of significant context at a micro-block level to lessen both attention and indexing costs associated with lengthy sequences. The Gated Residual feature broadens the residual pathway into four streams, dynamically managing the flow of information across different layers. Additionally, the N-gram Embedding integrates large-scale local-pattern memory with minimal added computation per token, and it can be transferred to host memory for further efficiency. The model is structured around a 125B-parameter main network supplemented by 51B parameters dedicated to N-gram embeddings, activating only 6B parameters for each token processed. This sophisticated framework highlights the ongoing advancements in machine learning architectures, setting a promising stage for future developments.

Mistral Large 3 pushes open-source AI into frontier territory with a massive sparse MoE architecture that activates 41B parameters per token while maintaining a highly efficient 675B total parameter design. It sets a new performance standard by combining long-context reasoning, multilingual fluency across 40+ languages, and robust multimodal comprehension within a single unified model. Trained end-to-end on thousands of NVIDIA H200 GPUs, it reaches parity with top closed-source instruction models while remaining fully accessible under the Apache 2.0 license. Developers benefit from optimized deployments through partnerships with NVIDIA, Red Hat, and vLLM, enabling smooth inference on A100, H100, and Blackwell-class systems. The model ships in both base and instruct variants, with a reasoning-enhanced version on the way for even deeper analytical capabilities. Beyond general intelligence, Mistral Large 3 is engineered for enterprise customization, allowing organizations to refine the model on internal datasets or domain-specific tasks. Its efficient token generation and powerful multimodal stack make it ideal for coding, document analysis, knowledge workflows, agentic systems, and multilingual communications. With Mistral Large 3, organizations can finally deploy frontier-class intelligence with full transparency, flexibility, and control.

DeepSeek-V2 is a cutting-edge Mixture-of-Experts (MoE) language model developed by DeepSeek-AI, noted for its cost-effective training and high-efficiency inference features. It boasts an impressive total of 236 billion parameters, with only 21 billion active for each token, and is capable of handling a context length of up to 128K tokens. The model utilizes advanced architectures such as Multi-head Latent Attention (MLA) to optimize inference by minimizing the Key-Value (KV) cache and DeepSeekMoE to enable economical training through sparse computations. Compared to its predecessor, DeepSeek 67B, this model shows remarkable improvements, achieving a 42.5% reduction in training expenses, a 93.3% decrease in KV cache size, and a 5.76-fold increase in generation throughput. Trained on an extensive corpus of 8.1 trillion tokens, DeepSeek-V2 demonstrates exceptional capabilities in language comprehension, programming, and reasoning tasks, positioning it as one of the leading open-source models available today. Its innovative approach not only elevates its performance but also sets new benchmarks within the field of artificial intelligence.

The Nemotron-3 Super is an innovative member of NVIDIA's Nemotron 3 series of open models, specifically crafted to facilitate sophisticated agentic AI systems that can effectively reason, plan, and carry out multi-step workflows in intricate environments. This model features a unique hybrid Mamba-Transformer Mixture-of-Experts architecture that merges the streamlined efficiency of Mamba layers with the contextual depth provided by transformer attention mechanisms, which allows it to adeptly manage extended sequences and intricate reasoning tasks with impressive accuracy and throughput. By activating only a portion of its parameters for each token, this architecture significantly enhances computational efficiency while preserving robust reasoning capabilities, making it ideal for scalable inference under heavy workloads. The Nemotron-3 Super comprises approximately 120 billion parameters, with around 12 billion being active during inference, which substantially boosts its ability to handle multi-step reasoning and collaborative interactions among agents within extensive contexts. Such advancements make it a powerful tool for tackling diverse challenges in AI applications.

Kimi K2 Thinking is a sophisticated open-source reasoning model created by Moonshot AI, specifically tailored for intricate, multi-step workflows where it effectively combines chain-of-thought reasoning with tool utilization across numerous sequential tasks. Employing a cutting-edge mixture-of-experts architecture, the model encompasses a staggering total of 1 trillion parameters, although only around 32 billion parameters are utilized during each inference, which enhances efficiency while retaining significant capability. It boasts a context window that can accommodate up to 256,000 tokens, allowing it to process exceptionally long inputs and reasoning sequences without sacrificing coherence. Additionally, it features native INT4 quantization, which significantly cuts down inference latency and memory consumption without compromising performance. Designed with agentic workflows in mind, Kimi K2 Thinking is capable of autonomously invoking external tools, orchestrating sequential logic steps—often involving around 200-300 tool calls in a single chain—and ensuring consistent reasoning throughout the process. Its robust architecture makes it an ideal solution for complex reasoning tasks that require both depth and efficiency.

Kimi K2.6 is an advanced agentic AI model created by Moonshot AI, aiming to enhance practical implementation, programming, and complex reasoning compared to its predecessors, K2 and K2.5. This model is based on a Mixture-of-Experts framework and the multimodal, agent-centric principles of the Kimi series, merging language comprehension, coding capabilities, and tool utilization into one cohesive system that can plan and execute intricate workflows. It features enhanced reasoning skills and significantly better agent planning, enabling it to deconstruct tasks, synchronize various tools, and tackle multi-file or multi-step challenges with increased precision and effectiveness. Additionally, it provides robust tool-calling capabilities with a high degree of reliability, facilitating seamless integration with external platforms like web searches or APIs, and incorporates built-in validation systems to guarantee the accuracy of execution formats. Notably, Kimi K2.6 represents a significant leap forward in the realm of AI, setting new standards for the complexity and reliability of automated tasks.

Qwen3.5-35B-A3B is a member of the Qwen3.5 "Medium" model series, meticulously crafted as an effective multimodal foundation model that strikes a balance between robust reasoning capabilities and practical application needs. Utilizing a Mixture-of-Experts (MoE) architecture, it boasts a total of 35 billion parameters, yet activates only around 3 billion for each token, enabling it to achieve performance levels similar to much larger models while significantly cutting down on computational expenses. The model employs a hybrid attention mechanism that merges linear attention with traditional attention layers, which enhances its ability to handle extensive context and boosts scalability for intricate tasks. As an inherently vision-language model, it processes both textual and visual data, catering to a variety of applications, including multimodal reasoning, programming, and automated workflows. Furthermore, it is engineered to operate as a versatile "AI agent," proficient in planning, utilizing tools, and systematically solving problems, extending its functionality beyond mere conversational interactions. This capability positions it as a valuable asset across diverse domains, where advanced AI-driven solutions are increasingly required.

GLM-5.1 represents the latest advancement in Z.ai’s GLM series, crafted as a cutting-edge, agent-focused AI model tailored for coding, reasoning, and managing long-term workflows. This iteration builds upon the framework of GLM-5, which employs a Mixture-of-Experts (MoE) architecture to achieve high performance without incurring excessive inference expenses, aligning with a larger initiative towards open-weight models that are accessible to developers. A significant emphasis of GLM-5.1 is on fostering agentic behavior, allowing it to plan, execute, and refine multi-step tasks instead of merely reacting to isolated prompts. Its capabilities are specifically engineered to manage intricate workflows, such as debugging code, exploring repositories, and performing sequential operations while maintaining context over time. In comparison to its predecessors, GLM-5.1 enhances reliability during lengthy interactions, ensuring coherence throughout extended sessions and minimizing failures in multi-step reasoning processes. Overall, this model signifies a leap forward in AI development, particularly in its ability to support complex task management seamlessly.

Qwen3.5 represents a major advancement in open-weight multimodal AI models, engineered to function as a native vision-language agent system. Its flagship model, Qwen3.5-397B-A17B, leverages a hybrid architecture that fuses Gated DeltaNet linear attention with a high-sparsity mixture-of-experts framework, allowing only 17 billion parameters to activate during inference for improved speed and cost efficiency. Despite its sparse activation, the full 397-billion-parameter model achieves competitive performance across reasoning, coding, multilingual benchmarks, and complex agent evaluations. The hosted Qwen3.5-Plus version supports a one-million-token context window and includes built-in tool use for search, code interpretation, and adaptive reasoning. The model significantly expands multilingual coverage to 201 languages and dialects while improving encoding efficiency with a larger vocabulary. Native multimodal training enables strong performance in image understanding, video processing, document analysis, and spatial reasoning tasks. Its infrastructure includes FP8 precision pipelines and heterogeneous parallelism to boost throughput and reduce memory consumption. Reinforcement learning at scale enhances multi-step planning and general agent behavior across text and multimodal environments. Overall, Qwen3.5 positions itself as a high-efficiency foundation for autonomous digital agents capable of reasoning, searching, coding, and interacting with complex environments.

Z.ai has unveiled its latest flagship model, GLM-4.5, which boasts an impressive 355 billion total parameters (with 32 billion active) and is complemented by the GLM-4.5-Air variant, featuring 106 billion total parameters (12 billion active), designed to integrate sophisticated reasoning, coding, and agent-like functions into a single framework. This model can switch between a "thinking" mode for intricate, multi-step reasoning and tool usage and a "non-thinking" mode that facilitates rapid responses, accommodating a context length of up to 128K tokens and enabling native function invocation. Accessible through the Z.ai chat platform and API, and with open weights available on platforms like HuggingFace and ModelScope, GLM-4.5 is adept at processing a wide range of inputs for tasks such as general problem solving, common-sense reasoning, coding from the ground up or within existing frameworks, as well as managing comprehensive workflows like web browsing and slide generation. The architecture is underpinned by a Mixture-of-Experts design, featuring loss-free balance routing, grouped-query attention mechanisms, and an MTP layer that facilitates speculative decoding, ensuring it meets enterprise-level performance standards while remaining adaptable to various applications. As a result, GLM-4.5 sets a new benchmark for AI capabilities across numerous domains.

DeepSeek-R1 is a cutting-edge open-source reasoning model created by DeepSeek, aimed at competing with OpenAI's Model o1. It is readily available through web, app, and API interfaces, showcasing its proficiency in challenging tasks such as mathematics and coding, and achieving impressive results on assessments like the American Invitational Mathematics Examination (AIME) and MATH. Utilizing a mixture of experts (MoE) architecture, this model boasts a remarkable total of 671 billion parameters, with 37 billion parameters activated for each token, which allows for both efficient and precise reasoning abilities. As a part of DeepSeek's dedication to the progression of artificial general intelligence (AGI), the model underscores the importance of open-source innovation in this field. Furthermore, its advanced capabilities may significantly impact how we approach complex problem-solving in various domains.

North Mini Code marks the debut of Cohere’s agentic coding model tailored for developers and serves as the first entry in its next generation of robust models. This compact and efficient open-source solution is specifically crafted for the independent developer community, ensuring remarkable software development capabilities without the need for high-end hardware. Featuring a mixture-of-experts architecture, it comprises a total of 30 billion parameters, with 3 billion of those being active, thereby providing developers with powerful agentic coding functionalities in a streamlined package. The model is finely tuned for various tasks, including code generation, agentic software engineering, and terminal operations, boasting an impressive 256K context length and a maximum generation capacity of 64K. It is designed with real-world developer practices in mind, enabling tasks such as understanding and managing sub-agents, mapping out system architectures, conducting code reviews, and assisting coding agents in navigating intricate software challenges. The integration of these capabilities empowers developers to enhance their productivity and efficiency significantly in software development projects.

The MAI-1 Preview marks the debut of Microsoft AI's fully in-house developed foundation model, utilizing a mixture-of-experts architecture for streamlined performance. This model has undergone extensive training on around 15,000 NVIDIA H100 GPUs, equipping it to adeptly follow user instructions and produce relevant text responses for common inquiries, thus illustrating a prototype for future Copilot functionalities. Currently accessible for public testing on LMArena, MAI-1 Preview provides an initial look at the platform's direction, with plans to introduce select text-driven applications in Copilot over the next few weeks aimed at collecting user insights and enhancing its capabilities. Microsoft emphasizes its commitment to integrating its proprietary models, collaborations with partners, and advancements from the open-source sector to dynamically enhance user experiences through millions of distinct interactions every day. This innovative approach illustrates Microsoft's dedication to continuously evolving its AI offerings.

The latest iteration of the open-source AI model, which can be fine-tuned and deployed in various environments, is now offered in multiple versions, including 1B, 3B, 11B, and 90B, alongside the option to continue utilizing Llama 3.1. Llama 3.2 comprises a series of large language models (LLMs) that come pretrained and fine-tuned in 1B and 3B configurations for multilingual text only, while the 11B and 90B models accommodate both text and image inputs, producing text outputs. With this new release, you can create highly effective and efficient applications tailored to your needs. For on-device applications, such as summarizing phone discussions or accessing calendar tools, the 1B or 3B models are ideal choices. Meanwhile, the 11B or 90B models excel in image-related tasks, enabling you to transform existing images or extract additional information from images of your environment. Overall, this diverse range of models allows developers to explore innovative use cases across various domains.

Hy4 preview represents a cutting-edge open source Mixture-of-Experts flagship model tailored for a variety of real-world productivity tasks, including software engineering, office activities, game development, and scientific exploration. This model boasts a staggering total of 770 billion parameters, with 49 billion activated per token, and features an impressive 1 million-token context window, allowing it to efficiently manage large codebases, vast document collections, and complex multi-step processes. The architecture consists of 78 layers that integrate Gated DeepSeek Sparse Attention alongside IndexCache for reusing sparse indices across layers, while also employing identity Hyper-Connections to enhance the flow of information between layers. Additionally, a dedicated Multi-Token Prediction layer facilitates speculative decoding, further enhancing its capabilities. Hy4 preview is crafted to comprehend, plan, debug, and validate intricate engineering projects, while also achieving notable improvements in the quality of front-end visuals and interaction design, thereby making it an invaluable asset for professionals across various domains.

K2 Horizon comprises a network of six open models, including the 375B-A23B, 36B-A4B, 32B, 7B, 3.7B, and 0.9B, all engineered to excel in various domains such as reasoning, mathematics, coding, agentic tasks, and overall capabilities. These models share a unified architecture, vocabulary, training techniques, interfaces, evaluation frameworks, and deployment tools, facilitating seamless transitions between sizes and dynamic workload management. The fleet's flagship, the 375B-A23B model, is particularly adept at handling intricate reasoning, software development, research projects, and long-term agentic functions, while the 32B and 36B-A4B models focus on delivering robust local deployment solutions. Notably, the 36B-A4B model features an innovative Mixture-of-Value Attention mechanism, which merges sparse attention with Mixture-of-Experts layers, allowing it to engage approximately 4 billion parameters per token and compete closely with the performance of the denser 32B model. This architecture not only enhances flexibility but also maximizes resource efficiency across a wide range of applications.

The Mixtral 8x7B model is an advanced sparse mixture of experts (SMoE) system that boasts open weights and is released under the Apache 2.0 license. This model demonstrates superior performance compared to Llama 2 70B across various benchmarks while achieving inference speeds that are six times faster. Recognized as the leading open-weight model with a flexible licensing framework, Mixtral also excels in terms of cost-efficiency and performance. Notably, it competes with and often surpasses GPT-3.5 in numerous established benchmarks, highlighting its significance in the field. Its combination of accessibility, speed, and effectiveness makes it a compelling choice for developers seeking high-performing AI solutions.

Recursive Flint is an advanced language model featuring 40 billion parameters, designed as a mixture-of-experts specifically for coding tasks executed locally. It engages around 2.5 billion parameters for each token processed, enabling sophisticated reasoning, multi-turn tool utilization, and accommodating context windows as extensive as 512,000 tokens. Developers can leverage Flint within coding agents to analyze codebases, rectify bugs, develop new features, and create tests while executing inference directly on their own hardware. The model's weights are made available under the Apache 2.0 license, promoting accessibility. Flint is compatible with various platforms such as llama.cpp, Ollama, Unsloth, LM Studio, vLLM, and SGLang; additionally, Recursive offers rec, an inference engine that is specifically optimized for use with Apple Silicon M4 Pro and M5 Pro/Max chips. Comprehensive setup documentation and practical examples are provided to assist developers in executing the model on local machines. Flint serves as a valuable tool for developers and technical teams aiming to effectively run and customize a code-centric model tailored to their specific system requirements. This innovative approach empowers users to enhance their coding capabilities and streamline development processes more efficiently than ever before.

The Laguna XS 2.1 is an enhanced coding model that operates as an open weight agentic system, ideal for long-duration tasks on local machines. Featuring a 33-billion-parameter Mixture-of-Experts framework with 3 billion parameters activated per token, this model maintains the efficient architecture of Laguna XS.2 while significantly advancing performance in multilingual software engineering and terminal-style tasks. It is specifically engineered to assist coding agents in reviewing repositories, reasoning through intricate changes, utilizing various tools, executing commands, and maintaining continuity throughout extended projects. With a generous 256K context window, the model enables agents to effectively manage extensive codebases, lengthy histories, and complex multi-step workflows. Laguna XS 2.1 benefits from support from platforms like vLLM, SGLang, NVIDIA TensorRT-LLM, Hugging Face Transformers, and Ollama, with plans for native integration with llama.cpp in the future. The model is offered in various checkpoint formats, including BF16, FP8, INT4, and NVFP4, granting developers the flexibility to select between high fidelity and configurations optimized for limited VRAM or computational resources. This adaptability makes it an excellent choice for a wide range of development environments and requirements.

NVIDIA's Nemotron 3.5 Lightning is a state-of-the-art mixture-of-experts model boasting 30 billion parameters, of which 3 billion are actively utilized, specifically engineered for efficient, high-throughput performance in long-duration and continuously operating AI agents. This model is tailored for the execution components of agentic systems, adeptly managing frequent operations like tool invocations, output verification, routine commands, and delegating tasks to subagents, while larger reasoning models concentrate on strategic planning and orchestration. By employing a mixture-of-experts architecture, it activates only a select subset of parameters for each input token, marrying the expansive capacity of a larger model with significantly reduced computational demands. The training of this model is optimized for widely used agent harnesses and enhances inference speed through techniques such as speculative decoding, multi-token prediction, DFlash, and DSpark, making it versatile across various operational scenarios. Additionally, it is compatible with BF16 and NVFP4 checkpoints, providing flexibility in deployment from local systems like DGX Spark and GeForce RTX hardware to extensive data center infrastructures. In summary, its innovative design and scalability make it a powerful tool for advancing AI capabilities.

Mistral 3 represents the newest iteration of open-weight AI models developed by Mistral AI, encompassing a diverse range of models that span from compact, edge-optimized versions to a leading large-scale multimodal model. This lineup features three efficient “Ministral 3” models with 3 billion, 8 billion, and 14 billion parameters, tailored for deployment on devices with limited resources, such as laptops, drones, or other edge devices. Additionally, there is the robust “Mistral Large 3,” which is a sparse mixture-of-experts model boasting a staggering 675 billion total parameters, with 41 billion of them being active. These models are designed to handle multimodal and multilingual tasks, excelling not only in text processing but also in image comprehension, and they have showcased exceptional performance on general queries, multilingual dialogues, and multimodal inputs. Furthermore, both the base and instruction-fine-tuned versions are made available under the Apache 2.0 license, allowing for extensive customization and integration into various enterprise and open-source initiatives. This flexibility in licensing encourages innovation and collaboration among developers and organizations alike.

Liquid AI's LFM2.5 represents an advanced iteration of on-device AI foundation models, engineered to provide high-efficiency and performance for AI inference on edge devices like smartphones, laptops, vehicles, IoT systems, and embedded hardware without the need for cloud computing resources. This new version builds upon the earlier LFM2 framework by greatly enhancing the scale of pretraining and the stages of reinforcement learning, resulting in a suite of hybrid models that boast around 1.2 billion parameters while effectively balancing instruction adherence, reasoning skills, and multimodal functionalities for practical applications. The LFM2.5 series comprises various models including Base (for fine-tuning and personalization), Instruct (designed for general-purpose instruction), Japanese-optimized, Vision-Language, and Audio-Language variants, all meticulously crafted for rapid on-device inference even with stringent memory limitations. These models are also made available as open-weight options, facilitating deployment through platforms such as llama.cpp, MLX, vLLM, and ONNX, thus ensuring versatility for developers. With these enhancements, LFM2.5 positions itself as a robust solution for diverse AI-driven tasks in real-world environments.

Xiaomi MiMo-V2.5 is a next-generation open-source AI model that combines agentic intelligence with multimodal capabilities. It is designed to process and understand text, images, and audio within a single architecture. The model uses a sparse Mixture-of-Experts framework with a large parameter count to deliver efficient and scalable performance. It supports a context window of up to one million tokens, allowing it to handle long and complex workflows. MiMo-V2.5 integrates visual and audio encoders to improve perception and cross-modal reasoning. It is capable of performing tasks such as coding, reasoning, and multimodal analysis with strong accuracy. Benchmark results show competitive performance compared to leading AI models in both agentic and multimodal tasks. The model is optimized for token efficiency, balancing performance with lower computational cost. It is designed for real-world applications that require both reasoning and perception. Xiaomi has open-sourced the model, making it accessible for developers and researchers. By combining multimodality, scalability, and efficiency, MiMo-V2.5 pushes forward the development of advanced AI systems.

Xiaomi MiMo-V2.5-Pro is a next-generation open-source AI model designed for advanced reasoning, coding, and long-horizon task execution. It uses a Mixture-of-Experts architecture with over one trillion parameters and a large active parameter set for efficient performance. The model supports an extended context window of up to one million tokens, allowing it to handle complex, multi-step workflows. It is built to perform autonomous tasks, including software development, system design, and engineering optimization. Benchmark results show strong performance across coding, reasoning, and agent-based evaluation tests. MiMo-V2.5-Pro incorporates hybrid attention mechanisms to improve efficiency while maintaining accuracy across long contexts. It is optimized for token efficiency, reducing the computational cost of running complex tasks. The model can integrate with development tools and frameworks to support real-world applications. It is designed to complete tasks that would typically require significant human effort over extended periods. Xiaomi has made the model open source, enabling developers to access and customize it. By combining performance, scalability, and efficiency, MiMo-V2.5-Pro pushes the boundaries of modern AI capabilities.

The Xiaomi MiMo API open platform serves as a developer-centric interface that allows for the integration and access of Xiaomi’s MiMo AI model family, which includes various reasoning and language models like MiMo-V2-Flash, enabling the creation of applications and services via standardized APIs and cloud endpoints. This platform empowers developers to incorporate AI-driven functionalities such as conversational agents, reasoning processes, code assistance, and search-enhanced tasks without the need to handle the complexities of model infrastructure. It features RESTful API access complete with authentication, request signing, and well-structured responses, allowing software to send user queries and receive generated text or processed results in a programmatic manner. The platform also supports essential operations including text generation, prompt management, and model inference, facilitating seamless interactions with MiMo models. Furthermore, it provides comprehensive documentation and onboarding resources, enabling teams to effectively integrate the latest open-source large language models from Xiaomi, which utilize innovative Mixture-of-Experts (MoE) architectures to enhance performance and efficiency. Overall, this open platform significantly lowers the barriers for developers looking to harness advanced AI capabilities in their projects.

MiniMax-M2.1 is a state-of-the-art open-source AI model built specifically for agent-based development and real-world automation. It focuses on delivering strong performance in coding, tool calling, and long-term task execution. Unlike closed models, MiniMax-M2.1 is fully transparent and can be deployed locally or integrated through APIs. The model excels in multilingual software engineering tasks and complex workflow automation. It demonstrates strong generalization across different agent frameworks and development environments. MiniMax-M2.1 supports advanced use cases such as autonomous coding, application building, and office task automation. Benchmarks show significant improvements over previous MiniMax versions. The model balances high reasoning ability with stability and control. Developers can fine-tune or extend it for specialized agent workflows. MiniMax-M2.1 empowers teams to build reliable AI agents without vendor lock-in.

Command A+ represents Cohere’s most advanced and rapid language model to date, serving as a robust open-source tool tailored for intricate reasoning, diverse multimodal and multilingual tasks, and seamless private deployment. With its architecture as a sparse mixture-of-experts, it boasts a remarkable 218 billion total parameters, of which 25 billion are actively utilized, ensuring high-performance agentic workflows while minimizing computational demands. This model consolidates features from the entire Command series into a single scalable solution, accommodating text, images, reasoning, and tool utilization with an impressive 128K input context, a maximum generation of 64K, and compatibility with 48 different languages. It has been meticulously optimized to enhance reasoning capabilities, agentic workflows, retrieval-augmented generation (RAG), multilingual applications, and the processing of multimodal documents, while also supporting vLLM and Transformers technology. When compared to its predecessors in the Command A lineup, it significantly boosts enterprise performance across various domains, including multimodal comprehension, data retrieval, extended tasks, sophisticated reasoning, programming, translation, and thorough document analysis. The advancements in this model underline its potential to transform how enterprises approach complex language and data processing challenges.

Sarvam-30B is an advanced open-source large language model that serves as a comprehensive platform for real-time conversational AI and complex reasoning tasks, emphasizing its capability in multilingual settings and practical usage. This 30-billion parameter model is engineered for enhanced speed and efficiency through a Mixture-of-Experts (MoE) framework, which selectively activates a portion of its parameters for each request, thus facilitating high throughput and minimal latency while remaining suitable for environments with limited resources, including local devices and edge computing systems. It excels in various conversational applications, programming tasks, and logical reasoning, achieving impressive outcomes in over 20 Indian languages, which underscores its utility for multilingual applications and voice interaction systems. The model features a dual-tier structure, acting as a rapid and deployable "conversational workhorse," and utilizes MoE techniques to lower computational costs without sacrificing performance. This innovative model not only enhances user experience but also broadens accessibility in diverse linguistic contexts.

Ling 3.0 Tiny is a reasoning model featuring open weights, comprising 7.9 billion total parameters and 1.3 billion active parameters, alongside a substantial context window of 262,000 tokens. Leveraging a mixture-of-experts architecture, it pushes the boundaries of the open-weights Pareto frontier in terms of intelligence relative to active parameters, while being compact enough for local deployment in various environments. Scoring 25 on the Artificial Analysis Intelligence Index, it stands on par with gpt-oss-120b, which scores 24, despite utilizing 15 times fewer total parameters and 4 times fewer active parameters. This impressive parameter efficiency does come with a trade-off, as it requires a significant 213 million output tokens to complete the Intelligence Index evaluation. In addition, Ling 3.0 Tiny exhibits noteworthy advancements in reducing hallucination tendencies compared to Ling-mini-2.0; it enhances its AA-Omniscience score by 59 points while keeping accuracy levels consistent. Notably, rather than making random guesses in uncertain situations, the model chose to attempt only 37% of the questions during evaluation, leading to a markedly reduced hallucination rate of 30%, a significant improvement over the previous generation's 96%. This strategic approach not only demonstrates the model's improved reasoning capabilities but also highlights its potential for more reliable real-world applications.