Yes, and you could buy a floppy disk drive very cheaply too. Nobody uses those anymore either.
What a ridiculous comparison. Floppies were limited in their design capacity, and Apple's decision to start phasing them out in 1998 (I believe) was ALSO premature. Why? Because there wasn't a good alternative on the market yet for those who needed to transfer files. Zipdisks were fine, but they were pricey, buggy, and annoying. CD-ROMs were write-only. CD-RWs were unreliable and often unsupported in some readers. It was really the USB flash drive which finally replaced the floppy, but that didn't come around until 2000. Once they became cheap and popular, most computer companies finally started dropping floppy drives.
The "i" in iMac stood for "Internet". One the selling points of the product is that it took only two steps to connect to the Internet. Being connected meant there was less need for physical media and sneaker net. For those who wanted a floppy drive, there were USB drives available. Another important factor that people forget was that the writing was already on the wall for the original 3.5 floppy and it took a stack of them to do much with. The problem was that there was no clear successor. Zip drives were competing with SyQuest drives and "Super Disks" (remember those) that had some backwards compatibility. The removable media world was in transition.
In spite of getting a ton of criticism for leaving off what was thought to be a crucial peripheral, the original iMac was one of Apple's most successful products and helped bring back the company from the brink of bankruptcy. It also led to an explosion of USB products and helped push USB into being a truly universal connector which is still found on virtually every computer almost 20 years later. Had innovation been left up to PC manufacturers we might have been stuck with RS-232 and parallel ports for another decade.