Better Benchmarks for AI

silverjacket writes: AI benchmarks have lots of problems. Models might achieve superhuman scores, then fail in the real world. Or benchmarks might miss biases or blindspots. A feature in Science magazine reports that researchers are proposing not only better benchmarks, but better methods for constructing them.