Do you think production has actually decreased
Irrelevant. Prices can go up for many reasons.
or did they just raise prices because they could
Prices are ALWAYS raised "because they could".
and then kept them there when supply came back online?
You seem to have a profound misunderstanding of both economics and business.
1. Inflation is a rise in prices. When it ends, prices stop rising. They don't "go back down".
2. Businesses exist to make money. They aren't charities. They don't lower prices to be nice guys.
3. Oats are grown by millions of farmers and processed by thousands of mills. If you really believe that many people are colluding to raise prices, you should have a mental health evaluation.