Inflection-2 Description
We are proud to announce we have completed the training on Inflection-2. It is the best model for its compute class in the entire world and the second most powerful LLM. Inflection's mission is to create an AI that is personal for everyone. Inflection-2 is a new model that is significantly more capable than Inflection-1. It has better factual knowledge, better style control, and dramatically enhanced reasoning. Inflection-2 has been trained on 5,000 NVIDIA GPUs at fp8 mixed accuracy for 1025 FLOPs. This puts Inflection-2 in the same training compute category as Google's flagship PaLM 2 Large Model. Inflection-2 also outperforms the majority of standard AI performance benchmarks including the well-known MMLU, TriviaQA, HellaSwag & GSM8k. Inflection-2, designed with efficiency in mind, will soon power Pi. We were able to reduce costs by switching from A100 to the H100 GPUs and optimizing our inference implementation.