Compare Leanstral 1.5 vs. SWE-2

Leanstral 1.5 is a model licensed under Apache-2.0, designed for effective proof engineering in Lean 4, aimed at enhancing the capabilities and accessibility of formal verification. It boasts a total of 119 billion parameters, with 6 billion of them being active, marking a significant improvement in performance for tasks such as theorem proving, agent-based proof engineering, and the verification of practical code. The development of Leanstral 1.5 involved a comprehensive three-stage training process, which included mid-training, supervised fine-tuning, and reinforcement learning utilizing CISPO. In a multiturn environment, the model is tasked with receiving a theorem statement, submitting a proof, and refining its approach based on feedback from the Lean compiler until the proof is either successfully compiled or the available resources are depleted. In the code agent setting, Leanstral functions similarly to a developer navigating a raw filesystem, allowing it to edit files, execute bash commands, and interact with the Lean language server to monitor goals, errors, and type information in real time. This innovative approach not only streamlines the proof engineering process but also significantly enhances the user experience in formal verification tasks.

SWE-2 is a software engineering model from Cognition built for agentic coding tasks that require strong performance at lower computational and monetary cost. It is post-trained from the Kimi K3 base model and extends Cognition’s earlier SWE-1.7 training approach with a new reinforcement learning method for jointly optimizing multiple reasoning-effort settings. Medium, high, and maximum effort modes provide different tradeoffs between speed, cost, exploration, and verification depending on task complexity. The model is trained to inspect only the parts of a codebase that are likely to matter, helping it reach implementation faster and reduce unnecessary exploration. SWE-2 can generate and modify code, run tests, analyze repositories, work through terminal tasks, and verify whether implementations satisfy user requirements. Cognition also reports improvements in end-to-end test creation, regression detection, instruction following, and re-deriving conclusions when challenged. Its training process incorporates cost-aware rewards, length-weighted reward baselines, expanded reinforcement learning environments, and hardened verifiers intended to improve both efficiency and reliability. SWE-2 is positioned as a cost-efficient alternative to larger frontier coding models while remaining competitive on software engineering benchmarks such as FrontierCode, DeepSWE, and Terminal-Bench. The model is available in Devin Desktop and Devin CLI and is being introduced to additional Cognition products including Devin Web and Fusion.