fclones

• GitHub - pkolaczk/fclones: Efficient Duplicate File Finder

group duplicates

find duplicate files across single or multiple folders

fclones group /mnt/media/
fclones group /mnt/bucket-a/ /data/bucket-c/

generate duplicate report

fclones group /mnt/media/ > dupes.txt

dedupe duplicates

instead of deleting one or the other duplicate file, you can dedupe them using fclones: [dedupe] does not remove any files, but deduplicates file data by using native copy-on-write capabilities of the file system (reflink)

fclones dedupe < dupes.txt