Yeah, that's not much better.
Einstein, for example, conceived of relativity before any empirical evidence confirmed it.
WTF does that mean? How can you confirm something before anybody conceives of it? If we assume its just clumsy language then its just not true. Maxwell's electrodynamics were known to be in conflict with Galilean relativity (among other things) and the physics community had spent decades working on the problem including Lorentz, Lamor, Poincaire and others working out the necessary transform to replace the Galilean one. Einstein, who was a PhD student at the time, wrote a very nice paper tying it all together.
As for metaphors, or vocabularies or whatever, Einstein was notably not a fan of the metaphors that are currently most associated with general relativity.
There's also a nice little paper by some physicists where they train a small neural network (much, MUCH smaller than any LLM) on various types of observations and show that it learns symmetries of the physical system. One of their examples is learning the invariance of the spacetime interval.