Best Small Language Models for Microsoft Azure

We are excited to announce the launch of Phi-2, a language model featuring 2.7 billion parameters that excels in reasoning and language comprehension, achieving top-tier results compared to other base models with fewer than 13 billion parameters. In challenging benchmarks, Phi-2 competes with and often surpasses models that are up to 25 times its size, a feat made possible by advancements in model scaling and meticulous curation of training data. Due to its efficient design, Phi-2 serves as an excellent resource for researchers interested in areas such as mechanistic interpretability, enhancing safety measures, or conducting fine-tuning experiments across a broad spectrum of tasks. To promote further exploration and innovation in language modeling, Phi-2 has been integrated into the Azure AI Studio model catalog, encouraging collaboration and development within the research community. Researchers can leverage this model to unlock new insights and push the boundaries of language technology.

Phi-4-reasoning is an advanced transformer model featuring 14 billion parameters, specifically tailored for tackling intricate reasoning challenges, including mathematics, programming, algorithm development, and strategic planning. Through a meticulous process of supervised fine-tuning on select "teachable" prompts and reasoning examples created using o3-mini, it excels at generating thorough reasoning sequences that optimize computational resources during inference. By integrating outcome-driven reinforcement learning, Phi-4-reasoning is capable of producing extended reasoning paths. Its performance notably surpasses that of significantly larger open-weight models like DeepSeek-R1-Distill-Llama-70B and nears the capabilities of the comprehensive DeepSeek-R1 model across various reasoning applications. Designed for use in settings with limited computing power or high latency, Phi-4-reasoning is fine-tuned with synthetic data provided by DeepSeek-R1, ensuring it delivers precise and methodical problem-solving. This model's ability to handle complex tasks with efficiency makes it a valuable tool in numerous computational contexts.

Phi-4-reasoning-plus is an advanced reasoning model with 14 billion parameters, enhancing the capabilities of the original Phi-4-reasoning. It employs reinforcement learning for better inference efficiency, processing 1.5 times the number of tokens compared to its predecessor, which results in improved accuracy. Remarkably, this model performs better than both OpenAI's o1-mini and DeepSeek-R1 across various benchmarks, including challenging tasks in mathematical reasoning and advanced scientific inquiries. Notably, it even outperforms the larger DeepSeek-R1, which boasts 671 billion parameters, on the prestigious AIME 2025 assessment, a qualifier for the USA Math Olympiad. Furthermore, Phi-4-reasoning-plus is accessible on platforms like Azure AI Foundry and HuggingFace, making it easier for developers and researchers to leverage its capabilities. Its innovative design positions it as a top contender in the realm of reasoning models.

Phi-4-mini-reasoning is a transformer-based language model with 3.8 billion parameters, specifically designed to excel in mathematical reasoning and methodical problem-solving within environments that have limited computational capacity or latency constraints. Its optimization stems from fine-tuning with synthetic data produced by the DeepSeek-R1 model, striking a balance between efficiency and sophisticated reasoning capabilities. With training that encompasses over one million varied math problems, ranging in complexity from middle school to Ph.D. level, Phi-4-mini-reasoning demonstrates superior performance to its base model in generating lengthy sentences across multiple assessments and outshines larger counterparts such as OpenThinker-7B, Llama-3.2-3B-instruct, and DeepSeek-R1. Equipped with a 128K-token context window, it also facilitates function calling, which allows for seamless integration with various external tools and APIs. Moreover, Phi-4-mini-reasoning can be quantized through the Microsoft Olive or Apple MLX Framework, enabling its deployment on a variety of edge devices, including IoT gadgets, laptops, and smartphones. Its design not only enhances user accessibility but also expands the potential for innovative applications in mathematical fields.