Comment Web traffic must be significantly compressible (Score 3, Interesting) 85
I keep hearing astonishment at how so much web traffic can be stored with relative ease.
Sure, it's going to be a lot of data, but a whole lot of that data is duplication, and where there is duplication there can be compression. And where it's not, even at level 6/7 you can identify significant commonality (facebook user home page) and simply store the delta.
It's not like they're storing every byte sent and received by every Internet user at all.