Comment Re:Encoding the Problem? (Score 1) 135
So they claim they fed the challenges in using the exact same format as given to human entrants, but that seems kinda fishy. Unless there has been some huge leap in general purpose AI, they must be banking on some specific aspects of how these particular coding problems are worded/presented and then this really becomes just a case of 'map english to equation, then equation to code' problem, which is cool but something I would expect from academic researchers rather than someone trying to sell a product that does work.
They are using neural networks with transformers. The same approach used for GPT-3 (software that writes unique realistic text in response to a prompt); and for language translation; among other tasks.
It works predominantly off of the natural language of the problem.
No it isn't at all trivial. The level you are talking about is what was doable 20ish years ago, and would score about the 4th percentile in these competitions.