Rdfind VS Czkawka

You can get a similar effect on top of any file system that supports hard links with rdfind ( https://rdfind.pauldreik.se/ ) -- but it's pretty slow. The Arch wiki says: "Tools dedicated to deduplicate a Btrfs formatted partition include duperemove, bees, bedupAUR and btrfs-dedup. One may also want to merely deduplicate data on a file based level instead using e.g. rmlint, jdupesAUR or dduper-gitAUR. For an... - Source: Hacker News / 10 months ago

Rdfind is very good. It lets you do a variety of things when you find a duplicate: symlink to it, delete it etc. It's efficient in the way it looks for duplicates. Source: almost 2 years ago

You could use a deduplication tool like rdfind maybe? Source: about 2 years ago

I generally use rdfind for this purpose on Linux, when I think/know there are probably some duplicates that I could hardlink together without negative effects. Source: about 3 years ago

Https://github.com/qarmin/czkawka by far the best of anything iv tried. Source: 6 months ago

I've used Czkawka (https://github.com/qarmin/czkawka) because it does Lanczos-based image duplicate detection, which makes it more practical for me. - Source: Hacker News / 6 months ago

Maybe it's a setting you made or the files, not sure. You can try another software czkawka to see if you get better results with it. Source: 7 months ago

For static images I used https://github.com/qarmin/czkawka and it works well enough. I think. But when I used it on a folder with gifs and their jxl conversions, it shows nothing. SURELY this could not be user error, rrrright? Source: 8 months ago

I used to use DupeGuru which has some photo-specific dupe detection where you can fuzzy match image dupes based on content: https://dupeguru.voltaicideas.net/ But I switched over to czkawka, which has a better interface for comparing files, and seems to be a bit faster: https://github.com/qarmin/czkawka. - Source: Hacker News / 10 months ago