HackerTrans
TopNewTrendsCommentsPastAskShowJobs

m-manu

no profile record

comments

m-manu
·4 ปีที่แล้ว·discuss
My homepage is on Github. Didn't know Cloudflare also provides free hosting. Thanks.
m-manu
·5 ปีที่แล้ว·discuss
The tool doesn't delete anything -- just reports. If you're uncomfortable with "fuzzy hash", use the -thorough cmd line option.
m-manu
·5 ปีที่แล้ว·discuss
Yes, you can run it on whole hard drive. If you're planning to use it on "low entropy" file formats like "header" files, then use -thorough option.
m-manu
·5 ปีที่แล้ว·discuss
Changes have been incorporated. FYI.
m-manu
·5 ปีที่แล้ว·discuss
As the author of the tool, thanks a lot for wonderful inputs! Many comments are actionable. I'll incorporate them in code soon.

Now to address a few concerns:

# The tool doesn't delete anything -- As the name suggests, it just finds duplicates. Check it out.

# File uniqueness is determined by file extension + file size + CRC32 of first 4KiB, middle 2KiB and last 2KiB

# Above seems not much. But, on my portable hard drive with >172K files (mix of video, audio, pics and source code), I got the same number of collisions as that of "SHA-256 of entire file" (By the way, I'm planning to add an option in the tool to do this)