russianmafia - Slashdot User

Comment Re:Wait, what? (Score 1) 61

by russianmafia on Tuesday November 15, 2011 @04:41AM (#38057122) Attached to: Common Crawl Foundation Providing Data For Search Researchers

There are 40,000-50,000 buckets that contain one compressed 100Mbyte ARC file each which equals to 4-5TB of total data. So, 5TB / 5 billion pages = 1KB of compressed data per page.

« Newer Older »

Slashdot Top Deals

If it has syntax, it isn't user friendly.