Sync large data


zack ibraham

Member
Local time
11:34 AM
Posts
7
OS
windows 11
I have about 3 million files and folders sized (240G) on a local PC . Once the main job is synced only a thousand or so files change every day.

What I am trying to do is to sync the entire contents to a webhost via ftp and keep it updated as the files change on my local PC.

So what I need , is to transfer only the changes that happens on the files in the same time it changed on the destination .

I tried using GoodSync for this but it takes 15 hrs to analyses and by that time a number of files have changed.

Is there any software or string of batch files that would do this for me and utilize multiple connections for a ftp username?
 
Windows Build/Version
win 11

My Computer

System One

  • OS
    windows 11
    Computer type
    Laptop
    Manufacturer/Model
    Hp Notebook

FreeBooter

Well-known member
Power User
VIP
Local time
12:34 PM
Posts
1,064
Location
Adana
OS
Windows 11
You can use the attached batch script to total copy first and then incrementally, it just copies the new files and changed files.
 

Attachments

  • Incremental_Backup.bat
    2.6 KB · Views: 4

My Computer

System One

  • OS
    Windows 11
    Computer type
    PC/Desktop
    Manufacturer/Model
    HP Pavilion
    CPU
    AMD Ryzen 7 5700G
    Motherboard
    Erica6
    Memory
    Micron Technology DDR4-3200 16GB
    Graphics Card(s)
    NVIDIA GeForce RTX 3060
    Sound Card
    Realtek ALC671
    Monitor(s) Displays
    Samsung SyncMaster U28E590
    Screen Resolution
    3840 x 2160
    Hard Drives
    SAMSUNG MZVLQ1T0HALB-000H1

Berton

Well-known member
Power User
VIP
Local time
2:34 AM
Posts
1,405
Location
Buffalo, Wyoming
OS
Win11 Pro RTM
Just curious, I also FTP files to my Domain but they are static/never automatically changing. But a question, isn't the process described one of the reasons the various Cloud storages were developed?
 

My Computers

System One System Two

  • OS
    Win11 Pro RTM
    Computer type
    Laptop
    Manufacturer/Model
    Dell Vostro 3400
    CPU
    Intel Core i5
    Memory
    8GB
    Hard Drives
    256GB SSD NVMe
  • Operating System
    Windows 11 Pro RTM x64
    Computer type
    PC/Desktop
    Manufacturer/Model
    Dell Vostro 5890
    CPU
    Intel Core i5
    Memory
    16GB
    Graphics card(s)
    Onboard, no VGA, using a DisplayPort-to-VGA adapter
    Monitor(s) Displays
    21"
    Hard Drives
    512GB SSD NVMe, 2TB WDC HDD
    Browser
    Firefox, Edge
    Antivirus
    Windows Defender/Microsoft Security

zack ibraham

Member
Thread Starter
Local time
11:34 AM
Posts
7
OS
windows 11
maybe, it looks like that
 

My Computer

System One

  • OS
    windows 11
    Computer type
    Laptop
    Manufacturer/Model
    Hp Notebook

zack ibraham

Member
Thread Starter
Local time
11:34 AM
Posts
7
OS
windows 11
I ended up transferring the data with the backup tool called Gs Richcopy 360. This seems to have worked and is straightforward.
Thanks, FreeBooter & Berton, for trying to help:)
 

My Computer

System One

  • OS
    windows 11
    Computer type
    Laptop
    Manufacturer/Model
    Hp Notebook

Latest Support Threads

Top Bottom