Leanstral 1.5 Reviews

Leanstral 1.5 Description

Leanstral 1.5 is a model licensed under Apache-2.0, designed for effective proof engineering in Lean 4, aimed at enhancing the capabilities and accessibility of formal verification. It boasts a total of 119 billion parameters, with 6 billion of them being active, marking a significant improvement in performance for tasks such as theorem proving, agent-based proof engineering, and the verification of practical code. The development of Leanstral 1.5 involved a comprehensive three-stage training process, which included mid-training, supervised fine-tuning, and reinforcement learning utilizing CISPO. In a multiturn environment, the model is tasked with receiving a theorem statement, submitting a proof, and refining its approach based on feedback from the Lean compiler until the proof is either successfully compiled or the available resources are depleted. In the code agent setting, Leanstral functions similarly to a developer navigating a raw filesystem, allowing it to edit files, execute bash commands, and interact with the Lean language server to monitor goals, errors, and type information in real time. This innovative approach not only streamlines the proof engineering process but also significantly enhances the user experience in formal verification tasks.