jdupes Reviews and details

Social recommendations and mentions

• fdupes: Identify or Delete Duplicate Files

  200 lines of Nim [1] seems to run about 9X faster than the 8000 lines of C in fdupes on a little test dir I have. If you need C, I think jdupes [2] is faster as @TacticalCoder points out a couple of times here. In my testing, `dups` is usually faster than `jdupes`, though. [1] https://github.com/c-blake/bu/blob/main/dups.nim. - Source: Hacker News / 6 months ago

• I'm amazed how I find anything & why I have so many dupes!

  There's always the well-respected tool, Czkawka. Or, of the CLI is your thing, jdupes is a good option. Source: 10 months ago

• Johnny Decimal

  My research into this many years ago turned out that jdupes was the right / best solution I could find for my usecase. https://github.com/jbruchon/jdupes Though that works fine from a script perspective I'd like some more interactive way of sorting directories etc. Identifying is just the first step, jdupes helps with linking the files (both soft and hard links... - Source: Hacker News / 11 months ago

• Does jdupes do a 'dry run' if you just specify directory(s) and no other options

  I can work it out by looking at https://github.com/jbruchon/jdupes. Source: 11 months ago

• Am I beyond help?

  Jdupes is filesystem agnostic and will help you find duplicate files. Only works on exact duplicates, but considering the level of disorganization you are talking about, it sounds like you may have some exact duplicates. Source: about 1 year ago

• Anyone running Bees? Or deduping data some other way?

  If not bees, do you run other programs for deduping? I see jdupes has support for BTRFS, https://github.com/jbruchon/jdupes, and also duperemove, https://github.com/markfasheh/duperemove. Source: over 1 year ago

• BTRFS on a external USB drive for Backup

  Btrfs doesn't do online dedup, so there's no table. Tools like jdupes can be used to find and deduplicate files, otherwise files don't share storage unless they're snapshots or are copied via reflink. Source: over 1 year ago

• DupFinder is a duplicate file finder

  Jdupes is an enhanced fork of fdupes. The differences between the two are on the github readme. Source: almost 2 years ago

• Can I offload 50TB of data onto TrueNAS with Deduplication and then take it back to effectively get rid of all duplicate files?

  On Linux, I'd use jdupes. Looks like it has a Windows release? Source: almost 2 years ago

• ISO: Binary File Comparison Tool for Duplicate File Checks

  Fdupes or jdupes work fine. For matching only (no auto-delete) I also use hashdeep - the tools should be available via the package manager of your choice, AFAIK jdupes provides Windows & Mac binaries on the page. Source: over 2 years ago

• Delete Software Recommendation For Duplicate Files

  If you're comfortable with the command line I would suggest jdupes https://github.com/jbruchon/jdupes. Source: over 2 years ago

• Deduplication experiences with various tools?

  There are various tools to use for COW deduplication, such as bees, duperemove, rmlint, jdupes, and dduper. Source: over 2 years ago

• Go Find Duplicates: blazingly-fast simple-to-use tool to find duplicate files

  I use and test assorted duplicate finders regularly. Fdupes is the classic (going way way back) but it's really very slow, not worth using anymore. The four I know are worth trying these days (depending on data set, hardware, file arrangement and other factors, any one of these might be fastest for a specific use case) are https://github.com/jbruchon/jdupes , https://github.com/pauldreik/rdfind ,... - Source: Hacker News / over 2 years ago

• Photo Cluster F* on my hard disk - can Synology Photos help me out?

  Jdupes (https://github.com/jbruchon/jdupes) for matching duplicates based on file hash. Means it won't match photos that look similar, but have different file size, resolution etc. Source: almost 3 years ago

• Free Duplicate file finder for Windows

  I wrote jdupes which is a command-line tool for finding identical files. It only finds identical files, not similar but technically different files. If you need help using it, please let me know. Source: almost 3 years ago