Comment It's not just Anthropic dealing with this (Score 2) 38
The latest version of Gemini is causing quite a stir in our engineering school. We've been testing it by snapping images of problems from exams on cell phones and asking Gemini to solve them. The worst exam performance we've seen so far is an overall grade of B-, and that includes graduate-level exams. Gemini even helpfully provides all of its intermediate work to show how it got the solution.
Gemini can even (correctly) find a solution for many simple design problems. We're scrambling to adapt to what's happening, and wondering what we'll be dealing with a year (or two) from now.
We had hoped that engineering (as opposed to computer science) would be relatively immune to AI disruption for at least a few more years, but we were very much mistaken. If all one evaluated was homeworks and exams, the best AIs are already capable of earning an engineering degree in most disciplines.