Want to read Slashdot from your mobile device? Point it at m.slashdot.org and keep reading!


Forgot your password?
Back for a limited time - Get 15% off sitewide on Slashdot Deals with coupon code "BLACKFRIDAY" (some exclusions apply)". ×
Data Storage

Submission + - Deduplicating storage on the cheap (vanheusden.com) 1

flok writes: "Deduplicating software/appliances are the bomb currently. Everyone wants them, everyone is developing such a thing.
Software finds duplicates using hashes, and using advanced algorithms those hashes are looked up from huge memory-caches. But wait, looking up data, isn't that the task of a database? This made me think and after a couple of hours I implemented MyDeDub, a deduplicating network block device which stores its data (and hashes) in a MySQL database. As it looks now, filesystems on MyDeDub stay consistent, massive space is saved and it even performs, well, somewhat. It is implemented in Java so even an old windows 98 system might suffice. You can find the software here."

The hardest part of climbing the ladder of success is getting through the crowd at the bottom.