K. S. Kyosuke, We don't know how humans solve problems
True, it's one of the mysteries of the universe. If only I could sneak into a university and observe math students solving problems, then maybe I could write a program that mimics the process to solve my problem. Alas, this is too a radical an idea for sure.
so how can we know anything about the fidelity of so-called AI?
What the hell is "fidelity of AI"?
For example, how does a human look at a chess board and evaluate positions to determine the next move? Nobody knows. Computers do an exhaustive search of available moves to a certain depth, which humans are incapable of, so that disproves your claim straight off.
That's a non sequitur right there.