Please create an account to participate in the Slashdot moderation system

 



Forgot your password?
typodupeerror

Slashdot videos: Now with more Slashdot!

  • View

  • Discuss

  • Share

We've improved Slashdot's video section; now you can view our video interviews, product close-ups and site visits with all the usual Slashdot options to comment, share, etc. No more walled garden! It's a work in progress -- we hope you'll check it out (Learn more about the recent updates).

×

Comment: Re:CRC (Score 1) 440

by garglblaster (#41209231) Attached to: Ask Slashdot: How Do I De-Dupe a System With 4.2 Million Files?

Or just by file size first, then do a hash. No need to compute a hash to compare a 1mb file and a 1kb file.

thats exactly right.

Some time ago (years?) I came across a little book called "wicked cool perl scripts" (do a google shure you find it..) In one of the first chapters there is a script that does exactly what you describe (dupfiles.pl if I remember right):

To find duplicate files it goes down the directory hierarchy, sorts the files by size and does a md5sum comparison of files with similar size.

I tried it out once in awhile and it always worked out very well for me.

The scripts themselves can be downloaded from the publishers website. Have a look if your interested -

(btw. I do not have any commercial interests in this recommendation..)

Businesses

+ - ENV - Hydrogen Powered Bike

Submitted by massivacom
massivacom (1085095) writes "ENV — Hydrogen Powered Bike. The vehicle runs on a removable fuel cell, emits almost nothing, and will be street legal. Top speed, for now, is 50 mph. Production versions go on sale later this year"

Top 10 Firefox Extensions to Avoid 538

Posted by CmdrTaco
from the segfault-plugin-still-highly-recommended dept.
jcatcw writes "First there were the 20 must-have Firefox Extension and ensuing Slashdot discussion. Now Computerworld has the top 10 to avoid. For example, NoScript, which does make Firefox safer, but isn't worth the hassle, Or, VideoDownloader for slow downloads, when it works at all. Then there's Greasemonkey — on both lists."

If you steal from one author it's plagiarism; if you steal from many it's research. -- Wilson Mizner

Working...