PhotoSweeper VS Rdfind

For folks who know they have duplicate photos, but also a photo library large enough that it's hard to manually de-dupe them, I can strongly recommend PhotoSweeper (no affiliation). https://overmacs.com/ What's unique about PhotoSweeper is that it gives you deep control over what you mean by "dupe" and supports pro image formats like RAW and DNG. For example, I was able to automatically de-dupe... - Source: Hacker News / about 1 year ago

I’ve used PhotoSweeper for stuff like this before: https://overmacs.com. Source: about 1 year ago

PowerPhotos or PhotoSweeper X should do the job. Source: over 1 year ago

There are applications for that. I have used PhotoSweeper. Source: over 1 year ago

To keep albums pristine, know that takeout exports two copies of files that are in albums : once in the album folder, once in the year folder. So make sure when deleting duplicates with PhotoSweeper for photos, and Video simili duplicate cleaner for videos, to mark the album folders as “prefered” or “locked” folders to be kept at all costs. Source: over 1 year ago

You can get a similar effect on top of any file system that supports hard links with rdfind ( https://rdfind.pauldreik.se/ ) -- but it's pretty slow. The Arch wiki says: "Tools dedicated to deduplicate a Btrfs formatted partition include duperemove, bees, bedupAUR and btrfs-dedup. One may also want to merely deduplicate data on a file based level instead using e.g. rmlint, jdupesAUR or dduper-gitAUR. For an... - Source: Hacker News / 10 months ago

Rdfind is very good. It lets you do a variety of things when you find a duplicate: symlink to it, delete it etc. It's efficient in the way it looks for duplicates. Source: almost 2 years ago

You could use a deduplication tool like rdfind maybe? Source: about 2 years ago

I generally use rdfind for this purpose on Linux, when I think/know there are probably some duplicates that I could hardlink together without negative effects. Source: about 3 years ago