I'm sure this is improving test scores in cherry picked tests.
I'm pretty confident that what they'll find is that the cell phone ban improves test scores in only tests that involve critical thinking. Basically anything that a distraction would affect. It unlikely affects any test that is multiple choice, or requires physical activity (physical education, shop classes, lab classes (including chemistry and cooking)) though it could be suggested that locking the phone away during shop/labs is a better argument for safety than anything else.
I am pro-cellphone-ban in schools, but that has to be practiced by both the students and the teachers, and has to extend to laptops used by students. During class, Internet is turned off.
I worked for a K-12 school district in an IT support role for 20 years, from late 2001 to early 2022. The problem with technology is that kids don't learn the fundamentals, they learn the specific technology in most cases. Rather than learning how to think about a concept, they learn one specific implementation and might not even build transferrable skills in the process.
Granted, this phenomenon predates digital/electronic devices and software, with a case in point being the library card catalog for pulling records for books sorted by the Dewey Decimal System as opposed to other library sorting systems. But on the other hand Dewey is the most popular library filing system in the US even after the advent of electronic card catalog systems, so it's still useful even if it is specific and not especially transferrable.
As for the idea of turning off the Internet, too much curricula is delivered via Internet now to make that happen. Canvas LMS is basically cloud-only, and Google Classroom tightly integrates with Google Drive/Docs/Sheets and other systems for bringing curricula.
The problem is that we give kids general-purpose computers that let them do almost anything. We attempt to lock-down what they can do but we're imperfect at doing that, and we're imperfect at content-filtering. We tried creating special-purpose educational computers in the past but those generally flopped. We even used to use computers with limited network resources (think the days of campus-wide IPX/SPX networks and little to no WAN connectivity) but again, it's so much easier to deliver the content from the Internet that no one wants to go back to a strictly on-prem model.
I kind of miss the days when one had to get the floppy disk from the teacher and take over to boot it up to game one was going to play. It meant that game was realistically the only thing you could do with the computer for the vast, vast majority of students. So they loaded Number Munchers and did math instead of wasting time on whatever website has barely-educational games and isn't yet blocked by the district's IT department.