This is a decent point, though one supposes the rush to build datacentres would slow further, so it won't all be gravy for the hardware companies either.
There comes a time where there has to be some actual utility for the software running on the hardware that is there however, because a significant amount of what it is being used for now quite often has zero, or negative utility itself. But it may mean some people are going to get access to compute power cheaper than they may have done previously once the realignment starts.
It's like the railroads. Enormous fortunes were made and then lost as the railroad boom played out and then the bubble burst. When people were driving hard to push rails across the continental US, the business case for doing so wasn't there. Yes, linking the east and west coasts had some value, but not much, since there really wasn't that much on the west coast. And there was a whole lot of nothing in between. But it was obvious to everyone that when the railroads connected the coasts and opened access to the interior, there would be enormous value. What exactly, no one knew, in the sense that no one knew where all of the railroad-enabled interior cities would be constructed or what kinds of things they would do. But it was clear that there was value in access to all of that land and that someone would do something with it.
On the other hand, realizing that value didn't happen right away. It took decades for all of the land granted to the railroads to become really valuable, because it wasn't valuable until people came and built farms, dug mines, established ranches and generally built lives and industry. The return on that massive investment was there... but it came far too late for most of the people that invested it. Lots of bankruptcies resulted, and others swooped in and snapped up the resources for bargain-basement prices, and they're the ones who became incredibly wealthy (well, they and the ones who supplied the steel, e.g. Carnegie).
It's been the same with pretty much every technology-driven bubble. Remember telecom/dot-com bubble in the 90s, with all of the "dark fiber" that was laid everywhere? Bankruptcies and consolidations resulted, and all of that fiber got lit up and used. That bubble built the Internet, and huge fortunes were made as a result -- the top half-dozen most valuable companies on the planet are all a direct result.
OpenAI and Anthropic are betting that this time will be different, that the payoff will come fast enough to pay back the investment. Google is betting this somewhat, too, but Google has scale, diversity and resources to weather the bust -- and might be well-positioned to snap up the depreciated investments made by others. If history is any guide, OpenAI and Anthropic are wrong. But, then again, AI is fundamentally different from every other technology we've created.