Can anyone recommend a duplicate file finder program?


Kol12

Active member
Member
VIP
Local time
6:42 PM
Posts
252
OS
Windows 11 - Release Preview channel
Preferably portable.
 

My Computer

System One

  • OS
    Windows 11 - Release Preview channel
    Computer type
    PC/Desktop
    Manufacturer/Model
    Kol's custom ROG Z590
    CPU
    Intel 10900K @ 5.1 Ghz
    Motherboard
    Asus ROG Maximus XIII Hero Z590
    Memory
    Corsair Dominator Platinum RGB 32GB (4x8) OC to 3866Mhz CL 16
    Graphics Card(s)
    Asus ROG Strix 3080 OC edition
    Sound Card
    SoundBlaster X-AE5
    Monitor(s) Displays
    Asus ROG PG349Q 34" 120hz Gysnc
    Screen Resolution
    3440x1440
    Hard Drives
    Samsung 980 Pro 500GB
    860 EVO's
    Adata SX2000 Pro 1TB
    External RAID enclosure - Seagate 3TB HDD's
    PSU
    Seasonic Prime Ultra 1300W Platinum
    Case
    Phanteks Eclipse P600S
    Cooling
    Custom water cooling. EK Velocity (CPU), EK Quantum Vector (GPU), EK Quantum D5 Pump, 360 + 280 mm rads, 3x120mm Corsair LL, 3x 140mm Corsair LL fans
    Keyboard
    Corsair K70 MK.2 SE
    Mouse
    Corsair Dark Core Pro Wireless
    Antivirus
    Windows Defender

kriskras69

Member
Local time
8:42 AM
Posts
4
OS
windows10

My Computer

System One

  • OS
    windows10
    Computer type
    PC/Desktop
    Manufacturer/Model
    Gigabyte
    CPU
    AMD Ryzen 5 3600 6-Core
    Motherboard
    Gigabyte X570 AORUS ELITE
    Memory
    Corsair 16 GB DDR4-3600
    Graphics Card(s)
    Asus ROG Strix GeForce RTX 2080 Ti OC
    Monitor(s) Displays
    Acer Predator Z35
    Screen Resolution
    3440x1440
    Hard Drives
    Corsair Force Series MP600, 1 TB SSD
    PSU
    Gigabyte G750H
    Case
    Fractal Design Define R6
    Cooling
    Scythe Mugen 5 Rev. B
    Keyboard
    Razor Blackwidow
    Mouse
    Razor Deathadder V2
    Internet Speed
    600 mbit/s
    Browser
    Chrome / Brave

KCR

Member
VIP
Local time
12:42 AM
Posts
27
Location
Montana
OS
Windows 10 Home, 64-bit, Version 21H1 (OS Build 19043.1288)
CCleaner ?

1633174882071.png

1633175212547.png
 

My Computer

System One

  • OS
    Windows 10 Home, 64-bit, Version 21H1 (OS Build 19043.1288)
    Computer type
    PC/Desktop
    Manufacturer/Model
    Home Built
    CPU
    Intel(R) Core(TM) i7-4770
    Motherboard
    ASUS - Z87-A
    Memory
    16 GB
    Graphics Card(s)
    NVIDA GeForce GT 620 x2
    Sound Card
    Realtek High Definition Audio
    Monitor(s) Displays
    2
    Screen Resolution
    1280 x 1024 x 60 hertz
    Hard Drives
    WD My Passport 1.82 TB - external hard drive...

    Seagate FreeAgent Desk 1TB - external hard drive...

    SanDisk Cruzer - READYBOOST - 7.25 GB - USB Drive...

    SanDisk Cruzer - MACRIUM_PE - 14.2 GB - USB Drive...
    PSU
    Not sure.
    Case
    Not sure.
    Cooling
    6 - 3 speed case fans.
    Keyboard
    Lenovo ThinkPad PS/2
    Mouse
    Optical USB Mouse
    Internet Speed
    Around 30 Mbps Download
    Browser
    Firefox 93.0 (64-bit) What's New. . . 🤔
    Antivirus
    Avast Free, Windows Defender, Malwarebytes Free
    Other Info
    Macrium Reflect v8.0.6161 (Trial). . . 🙂

imanlien2020

Active member
Member
Local time
1:42 AM
Posts
131
OS
Windows 10 current
Are these pretty fool proof. I've used this type of software twice and it messed up my system by deleting not only duplicates but original system files.
 

My Computer

System One

  • OS
    Windows 10 current
    Computer type
    PC/Desktop
    Manufacturer/Model
    AMD
    CPU
    AMD Ryzen 7 5800X 8 Core
    Motherboard
    Gigabyte X570 Aorus Pro WiFi
    Memory
    32 GB
    Graphics Card(s)
    PCI Express 3.0 x16: PowerColor RX Vega 56 Red Dragon
    Sound Card
    Realtek ALC1220 and AMD Greenland - High Definition Audio Controller
    Monitor(s) Displays
    2 - 27 inch Westinghouse
    Screen Resolution
    1920 x 1080
    Hard Drives
    2 SSD - 2 TB each
    1 HDD - 2 TB
    Keyboard
    logitech
    Mouse
    logitech
    Internet Speed
    200 MB
    Browser
    Microsoft Edge
    Antivirus
    Avast Premium

kriskras69

Member
Local time
8:42 AM
Posts
4
OS
windows10
Are these pretty fool proof. I've used this type of software twice and it messed up my system by deleting not only duplicates but original system files.
I use a Virtual Machine to try out programs like this, just to make sure i dont mess anything up, worth the try?
Or you could make a backup or snapshot, that works too.
Respect!
 

My Computer

System One

  • OS
    windows10
    Computer type
    PC/Desktop
    Manufacturer/Model
    Gigabyte
    CPU
    AMD Ryzen 5 3600 6-Core
    Motherboard
    Gigabyte X570 AORUS ELITE
    Memory
    Corsair 16 GB DDR4-3600
    Graphics Card(s)
    Asus ROG Strix GeForce RTX 2080 Ti OC
    Monitor(s) Displays
    Acer Predator Z35
    Screen Resolution
    3440x1440
    Hard Drives
    Corsair Force Series MP600, 1 TB SSD
    PSU
    Gigabyte G750H
    Case
    Fractal Design Define R6
    Cooling
    Scythe Mugen 5 Rev. B
    Keyboard
    Razor Blackwidow
    Mouse
    Razor Deathadder V2
    Internet Speed
    600 mbit/s
    Browser
    Chrome / Brave

johnlgalt

Antidisestablishmentarianistentarianist
Power User
VIP
Local time
2:42 AM
Posts
2,350
Location
3rd Rock
OS
Windows 11 21H2
Alldup is a good one I've used in the past, another more recent addition to my repertoire is one developed by the guy who makes my go to file manager - Xplorer². It's called I-DeClone. It's not free, but there is a 30-day free trial.

Announcement of the software at the main dev's page: xplorer² blog: i-DeClone remove duplicate and similar files

Software home page: i-DeClone clean-up duplicate and similar files

I'm not affiliated with the company in any way, just love the software that he has written and bought them all because they're that good for my uses.
 

My Computers

System One System Two

  • OS
    Windows 11 21H2
    Computer type
    PC/Desktop
    Manufacturer/Model
    HomeBrew
    CPU
    AMD Ryzen 9 3950X
    Motherboard
    MSI MEG X570 GODLIKE
    Memory
    4 * Corsair Vengeance 32 GB 3600 MHz
    Graphics Card(s)
    EVGA GeForce RTX 3080 Ti XC3 ULTRA GAMING (12G-P5-3955-KR)
    Sound Card
    Realtek® ALC1220 Codec
    Monitor(s) Displays
    Eve Spectrum ES07D02 280 Hz QHD | Eve Spectrum ES07D03 4K Gaming Monitor
    Screen Resolution
    1440p | 4k
    Hard Drives
    3x Samsung 980 Pro NVMe PCIe 4 M.2 2 TB SSD (MZ-V8P2T0B/AM)
    PSU
    PC Power & Cooling’s Silencer Series 1050 Watt, 80 Plus Platinum
    Case
    Fractal Design Define 7 XL Dark ATX Full Tower Case
    Cooling
    ZXT KRAKEN Z73 73.11 CFM Liquid CPU Cooler (3x 120 mm push top) + Air 3x 140mm case fans (pull front) + 1x 120 mm (push back) and 1 x 120 mm (pull bottom)
    Keyboard
    SteelSeries Apex Pro Wired Gaming Keyboard
    Mouse
    Logitech MX Master 3 for Business
    Internet Speed
    Logitech MX Master 3 for Business
    Browser
    Nightly (default) + Firefox (stable),Chrome, Edge/ß/Dev/Canary
    Antivirus
    Defender
  • Operating System
    Windows 10 x64 Pro build 21H1
    Computer type
    Laptop
    Manufacturer/Model
    Dell Latitude E5470
    CPU
    Intel(R) Core(TM) i5-6300U CPU @ 2.40GHz, 2501 Mhz, 2 Core(s), 4 Logical Processor(s)
    Motherboard
    Dell
    Memory
    16 GB
    Graphics card(s)
    Intel(R) HD Graphics 520
    Sound Card
    Intel(R) HD Graphics 520 + RealTek Audio
    Monitor(s) Displays
    Dell laptop display 15"
    Screen Resolution
    1920 * 1080
    Hard Drives
    Toshiba 128GB M.2 22300 drive
    INTEL Cherryvill 520 Series SSDSC2CW180A 180 GB SATA III SSD
    PSU
    Dell
    Case
    Dell
    Cooling
    Dell
    Mouse
    Logitech MX Master (shared) | Dell TouchPad
    Keyboard
    Dell
    Internet Speed
    AT&T LightSpeed Gigabit Duplex
    Browser
    Edge Chromium | Chrome | Firefox Nightly | Brave
    Antivirus
    Defender + MB4

ZUBZERO

Member
Local time
2:42 AM
Posts
1
OS
Windows 10, Windows 11, Linux mint 20.2
Dupdetector, a very good and intuitive app. Can even find picture dups by content
 

My Computer

System One

  • OS
    Windows 10, Windows 11, Linux mint 20.2
    Computer type
    Laptop
    Manufacturer/Model
    Acer
    CPU
    I7 6700
    Memory
    32GB 2333
    Graphics Card(s)
    GTX 1070 8GB
    Monitor(s) Displays
    17" + 29" LG UltraWide
    Screen Resolution
    2K+ 1080p
    Hard Drives
    2 Lite-on 128 RAID 0
    Internet Speed
    200MBit/sec Spectrum

Feuer

Fatal Error
Member
Local time
9:42 AM
Posts
116
Location
Turkiye
OS
Windows 11 21H2 Home Single Language

My Computer

System One

  • OS
    Windows 11 21H2 Home Single Language
    Computer type
    Laptop
    Manufacturer/Model
    Hometech ALFA400C
    CPU
    I'm ashamed to talk about it...
    Motherboard
    There is no such a God, I only know mother-Earth
    Memory
    3GB :(
    Graphics Card(s)
    on-board
    Sound Card
    on-board
    Monitor(s) Displays
    (s) is too ambitious for me
    Screen Resolution
    1920*1080
    Hard Drives
    Samsung SSD 860 EVO 250GB (SSD)
    Samsung MBG4GC 32GB (SSD)
    PSU
    I was very young when I last saw a PSU
    Case
    ...
    Cooling
    My coldness is enough to cool the computer
    Keyboard
    A broken and very clean keyboard
    Mouse
    Rat King
    Internet Speed
    Slowest internet connection in Europe
    Browser
    ChromePortable / TorBrowser
    Antivirus
    Biontech
    Other Info
    I can simply say that I took the red pill and I am not happy with it.

imanlien2020

Active member
Member
Local time
1:42 AM
Posts
131
OS
Windows 10 current
Alldup is a good one I've used in the past, another more recent addition to my repertoire is one developed by the guy who makes my go to file manager - Xplorer². It's called I-DeClone. It's not free, but there is a 30-day free trial.

Announcement of the software at the main dev's page: xplorer² blog: i-DeClone remove duplicate and similar files

Software home page: i-DeClone clean-up duplicate and similar files

I'm not affiliated with the company in any way, just love the software that he has written and bought them all because they're that good for my uses.
Awesome thanks. Yeah I used to use that file explorer also best one until I found OneCommander. Nothing like it out there in style looks and function in one. But ty for the software recommendation.
 

My Computer

System One

  • OS
    Windows 10 current
    Computer type
    PC/Desktop
    Manufacturer/Model
    AMD
    CPU
    AMD Ryzen 7 5800X 8 Core
    Motherboard
    Gigabyte X570 Aorus Pro WiFi
    Memory
    32 GB
    Graphics Card(s)
    PCI Express 3.0 x16: PowerColor RX Vega 56 Red Dragon
    Sound Card
    Realtek ALC1220 and AMD Greenland - High Definition Audio Controller
    Monitor(s) Displays
    2 - 27 inch Westinghouse
    Screen Resolution
    1920 x 1080
    Hard Drives
    2 SSD - 2 TB each
    1 HDD - 2 TB
    Keyboard
    logitech
    Mouse
    logitech
    Internet Speed
    200 MB
    Browser
    Microsoft Edge
    Antivirus
    Avast Premium

johnlgalt

Antidisestablishmentarianistentarianist
Power User
VIP
Local time
2:42 AM
Posts
2,350
Location
3rd Rock
OS
Windows 11 21H2
Awesome thanks. Yeah I used to use that file explorer also best one until I found OneCommander. Nothing like it out there in style looks and function in one. But ty for the software recommendation.

Oh, wow, thanks for that - it looks modern as heck, and though I've really, really gotten used to X² over the last ...argh well over 15 years (!), I've got to give this one a try. And I'm also giving Yair's Files app a try too, though it is extremely basic for a dual pane, multi-tabbed FM.....
 

My Computers

System One System Two

  • OS
    Windows 11 21H2
    Computer type
    PC/Desktop
    Manufacturer/Model
    HomeBrew
    CPU
    AMD Ryzen 9 3950X
    Motherboard
    MSI MEG X570 GODLIKE
    Memory
    4 * Corsair Vengeance 32 GB 3600 MHz
    Graphics Card(s)
    EVGA GeForce RTX 3080 Ti XC3 ULTRA GAMING (12G-P5-3955-KR)
    Sound Card
    Realtek® ALC1220 Codec
    Monitor(s) Displays
    Eve Spectrum ES07D02 280 Hz QHD | Eve Spectrum ES07D03 4K Gaming Monitor
    Screen Resolution
    1440p | 4k
    Hard Drives
    3x Samsung 980 Pro NVMe PCIe 4 M.2 2 TB SSD (MZ-V8P2T0B/AM)
    PSU
    PC Power & Cooling’s Silencer Series 1050 Watt, 80 Plus Platinum
    Case
    Fractal Design Define 7 XL Dark ATX Full Tower Case
    Cooling
    ZXT KRAKEN Z73 73.11 CFM Liquid CPU Cooler (3x 120 mm push top) + Air 3x 140mm case fans (pull front) + 1x 120 mm (push back) and 1 x 120 mm (pull bottom)
    Keyboard
    SteelSeries Apex Pro Wired Gaming Keyboard
    Mouse
    Logitech MX Master 3 for Business
    Internet Speed
    Logitech MX Master 3 for Business
    Browser
    Nightly (default) + Firefox (stable),Chrome, Edge/ß/Dev/Canary
    Antivirus
    Defender
  • Operating System
    Windows 10 x64 Pro build 21H1
    Computer type
    Laptop
    Manufacturer/Model
    Dell Latitude E5470
    CPU
    Intel(R) Core(TM) i5-6300U CPU @ 2.40GHz, 2501 Mhz, 2 Core(s), 4 Logical Processor(s)
    Motherboard
    Dell
    Memory
    16 GB
    Graphics card(s)
    Intel(R) HD Graphics 520
    Sound Card
    Intel(R) HD Graphics 520 + RealTek Audio
    Monitor(s) Displays
    Dell laptop display 15"
    Screen Resolution
    1920 * 1080
    Hard Drives
    Toshiba 128GB M.2 22300 drive
    INTEL Cherryvill 520 Series SSDSC2CW180A 180 GB SATA III SSD
    PSU
    Dell
    Case
    Dell
    Cooling
    Dell
    Mouse
    Logitech MX Master (shared) | Dell TouchPad
    Keyboard
    Dell
    Internet Speed
    AT&T LightSpeed Gigabit Duplex
    Browser
    Edge Chromium | Chrome | Firefox Nightly | Brave
    Antivirus
    Defender + MB4

jimbo45

Well-known member
Power User
VIP
Local time
6:42 AM
Posts
1,475
Location
Hafnarfjörður IS
OS
Windows XP,7,10,11 Linux Arch Linux
Hi there

@Kol12
If you have Ms EXCEL just dump directory listings into EXCEL - then easy to find duplicates.

in cmd go to directory you want e.g cd c:\
then dir c:\ > doggs.csv
then open as csv with excel

Screenshot_20220506_114025.png

Then you can massage around every which way.

repeat as often as needed. There's probably an easy script to run the command "recursively" -- my Windows knowledge isn't great on this stuff but if I can use basic Ms apps like Office that work I've no problem

Robocopy piped to csv output or xcopy might also be alternatives too , Once stuff is in EXCEL it's a doddle. simply instead of in cmd prompt list to console route to csv file via using ">" output file. If you want a text file pipe to .txt instead of .csv but ensure your text file is utf-8 for most european languages rather than ANSI otherwise you might get some weird results in Excel.


Cheers
jimbo
 
Last edited:

My Computer

System One

  • OS
    Windows XP,7,10,11 Linux Arch Linux
    Computer type
    PC/Desktop
    CPU
    2 X Intel i7

johnlgalt

Antidisestablishmentarianistentarianist
Power User
VIP
Local time
2:42 AM
Posts
2,350
Location
3rd Rock
OS
Windows 11 21H2
The above works great for those wanting to find files with similar / identical file names - but does absolutely nothing for finding files with similar / identical content.
 

My Computers

System One System Two

  • OS
    Windows 11 21H2
    Computer type
    PC/Desktop
    Manufacturer/Model
    HomeBrew
    CPU
    AMD Ryzen 9 3950X
    Motherboard
    MSI MEG X570 GODLIKE
    Memory
    4 * Corsair Vengeance 32 GB 3600 MHz
    Graphics Card(s)
    EVGA GeForce RTX 3080 Ti XC3 ULTRA GAMING (12G-P5-3955-KR)
    Sound Card
    Realtek® ALC1220 Codec
    Monitor(s) Displays
    Eve Spectrum ES07D02 280 Hz QHD | Eve Spectrum ES07D03 4K Gaming Monitor
    Screen Resolution
    1440p | 4k
    Hard Drives
    3x Samsung 980 Pro NVMe PCIe 4 M.2 2 TB SSD (MZ-V8P2T0B/AM)
    PSU
    PC Power & Cooling’s Silencer Series 1050 Watt, 80 Plus Platinum
    Case
    Fractal Design Define 7 XL Dark ATX Full Tower Case
    Cooling
    ZXT KRAKEN Z73 73.11 CFM Liquid CPU Cooler (3x 120 mm push top) + Air 3x 140mm case fans (pull front) + 1x 120 mm (push back) and 1 x 120 mm (pull bottom)
    Keyboard
    SteelSeries Apex Pro Wired Gaming Keyboard
    Mouse
    Logitech MX Master 3 for Business
    Internet Speed
    Logitech MX Master 3 for Business
    Browser
    Nightly (default) + Firefox (stable),Chrome, Edge/ß/Dev/Canary
    Antivirus
    Defender
  • Operating System
    Windows 10 x64 Pro build 21H1
    Computer type
    Laptop
    Manufacturer/Model
    Dell Latitude E5470
    CPU
    Intel(R) Core(TM) i5-6300U CPU @ 2.40GHz, 2501 Mhz, 2 Core(s), 4 Logical Processor(s)
    Motherboard
    Dell
    Memory
    16 GB
    Graphics card(s)
    Intel(R) HD Graphics 520
    Sound Card
    Intel(R) HD Graphics 520 + RealTek Audio
    Monitor(s) Displays
    Dell laptop display 15"
    Screen Resolution
    1920 * 1080
    Hard Drives
    Toshiba 128GB M.2 22300 drive
    INTEL Cherryvill 520 Series SSDSC2CW180A 180 GB SATA III SSD
    PSU
    Dell
    Case
    Dell
    Cooling
    Dell
    Mouse
    Logitech MX Master (shared) | Dell TouchPad
    Keyboard
    Dell
    Internet Speed
    AT&T LightSpeed Gigabit Duplex
    Browser
    Edge Chromium | Chrome | Firefox Nightly | Brave
    Antivirus
    Defender + MB4

Berton

Well-known member
Member
VIP
Local time
12:42 AM
Posts
566
Location
Wyoming
OS
Win11 Pro RTM x64
One thing I do with such programs is uncheck duplicate file names since a folder cannot hold 2 or more files of the exact same name, force looking at content instead.
 

My Computers

System One System Two

  • OS
    Win11 Pro RTM x64
    Computer type
    Laptop
    Manufacturer/Model
    Dell Vostro 3400
    CPU
    Intel Core i5
    Memory
    8GB
    Hard Drives
    256GB SSD NVMe
  • Operating System
    Windows 11 Pro
    Computer type
    PC/Desktop
    Manufacturer/Model
    Dell Vostro 5890
    CPU
    Intel Core i5
    Memory
    8GB [16GB on order]
    Monitor(s) Displays
    21"
    Hard Drives
    512GB SSD NVMe
    Browser
    Firefox, Edge
    Antivirus
    Windows Defender/Microsoft Security

johnlgalt

Antidisestablishmentarianistentarianist
Power User
VIP
Local time
2:42 AM
Posts
2,350
Location
3rd Rock
OS
Windows 11 21H2
One thing I do with such programs is uncheck duplicate file names since a folder cannot hold 2 or more files of the exact same name, force looking at content instead.

Great when you're looking for duplicate content in a single location. But when including multiple locations, then probably better to keep that setting enabled.

BTW, the i-DeClone app I mentioned earlier is going to be 50% off tomorrow and Sunday (7-8 May). I just got an email from the dev this morning.
 

My Computers

System One System Two

  • OS
    Windows 11 21H2
    Computer type
    PC/Desktop
    Manufacturer/Model
    HomeBrew
    CPU
    AMD Ryzen 9 3950X
    Motherboard
    MSI MEG X570 GODLIKE
    Memory
    4 * Corsair Vengeance 32 GB 3600 MHz
    Graphics Card(s)
    EVGA GeForce RTX 3080 Ti XC3 ULTRA GAMING (12G-P5-3955-KR)
    Sound Card
    Realtek® ALC1220 Codec
    Monitor(s) Displays
    Eve Spectrum ES07D02 280 Hz QHD | Eve Spectrum ES07D03 4K Gaming Monitor
    Screen Resolution
    1440p | 4k
    Hard Drives
    3x Samsung 980 Pro NVMe PCIe 4 M.2 2 TB SSD (MZ-V8P2T0B/AM)
    PSU
    PC Power & Cooling’s Silencer Series 1050 Watt, 80 Plus Platinum
    Case
    Fractal Design Define 7 XL Dark ATX Full Tower Case
    Cooling
    ZXT KRAKEN Z73 73.11 CFM Liquid CPU Cooler (3x 120 mm push top) + Air 3x 140mm case fans (pull front) + 1x 120 mm (push back) and 1 x 120 mm (pull bottom)
    Keyboard
    SteelSeries Apex Pro Wired Gaming Keyboard
    Mouse
    Logitech MX Master 3 for Business
    Internet Speed
    Logitech MX Master 3 for Business
    Browser
    Nightly (default) + Firefox (stable),Chrome, Edge/ß/Dev/Canary
    Antivirus
    Defender
  • Operating System
    Windows 10 x64 Pro build 21H1
    Computer type
    Laptop
    Manufacturer/Model
    Dell Latitude E5470
    CPU
    Intel(R) Core(TM) i5-6300U CPU @ 2.40GHz, 2501 Mhz, 2 Core(s), 4 Logical Processor(s)
    Motherboard
    Dell
    Memory
    16 GB
    Graphics card(s)
    Intel(R) HD Graphics 520
    Sound Card
    Intel(R) HD Graphics 520 + RealTek Audio
    Monitor(s) Displays
    Dell laptop display 15"
    Screen Resolution
    1920 * 1080
    Hard Drives
    Toshiba 128GB M.2 22300 drive
    INTEL Cherryvill 520 Series SSDSC2CW180A 180 GB SATA III SSD
    PSU
    Dell
    Case
    Dell
    Cooling
    Dell
    Mouse
    Logitech MX Master (shared) | Dell TouchPad
    Keyboard
    Dell
    Internet Speed
    AT&T LightSpeed Gigabit Duplex
    Browser
    Edge Chromium | Chrome | Firefox Nightly | Brave
    Antivirus
    Defender + MB4
Top Bottom