Sync large data


zack ibraham

Member
Local time
1:45 PM
Posts
10
OS
windows 11
I have about 3 million files and folders sized (240G) on a local PC . Once the main job is synced only a thousand or so files change every day.

What I am trying to do is to sync the entire contents to a webhost via ftp and keep it updated as the files change on my local PC.

So what I need , is to transfer only the changes that happens on the files in the same time it changed on the destination .

I tried using GoodSync for this but it takes 15 hrs to analyses and by that time a number of files have changed.

Is there any software or string of batch files that would do this for me and utilize multiple connections for a ftp username?
 
Windows Build/Version
win 11

My Computer

System One

  • OS
    windows 11
    Computer type
    Laptop
    Manufacturer/Model
    Hp Notebook
You can use the attached batch script to total copy first and then incrementally, it just copies the new files and changed files.
 

Attachments

  • Incremental_Backup.bat
    2.6 KB · Views: 4

My Computer

System One

  • OS
    Windows 11
    Computer type
    PC/Desktop
    Manufacturer/Model
    HP Pavilion
    CPU
    AMD Ryzen 7 5700G
    Motherboard
    Erica6
    Memory
    Micron Technology DDR4-3200 16GB
    Graphics Card(s)
    NVIDIA GeForce RTX 3060
    Sound Card
    Realtek ALC671
    Monitor(s) Displays
    Samsung SyncMaster U28E590
    Screen Resolution
    3840 x 2160
    Hard Drives
    SAMSUNG MZVLQ1T0HALB-000H1
Just curious, I also FTP files to my Domain but they are static/never automatically changing. But a question, isn't the process described one of the reasons the various Cloud storages were developed?
 

My Computers

System One System Two

  • OS
    Win11 Pro RTM
    Computer type
    Laptop
    Manufacturer/Model
    Dell Vostro 3400
    CPU
    Intel Core i5 11th Gen. 2.40GHz
    Memory
    12GB
    Hard Drives
    256GB SSD NVMe M.2 and 2TB SATA HDD
  • Operating System
    Windows 11 Pro RTM x64
    Computer type
    PC/Desktop
    Manufacturer/Model
    Dell Vostro 5890
    CPU
    Intel Core i5 10th Gen. 2.90GHz
    Memory
    16GB
    Graphics card(s)
    Onboard, no VGA, using a DisplayPort-to-VGA adapter
    Monitor(s) Displays
    24" Dell
    Hard Drives
    512GB SSD NVMe, 2TB WDC HDD
    Browser
    Firefox, Edge
    Antivirus
    Windows Defender/Microsoft Security
maybe, it looks like that
 

My Computer

System One

  • OS
    windows 11
    Computer type
    Laptop
    Manufacturer/Model
    Hp Notebook
I ended up transferring the data with the backup tool called Gs Richcopy 360. This seems to have worked and is straightforward.
Thanks, FreeBooter & Berton, for trying to help:)
 

My Computer

System One

  • OS
    windows 11
    Computer type
    Laptop
    Manufacturer/Model
    Hp Notebook
Back
Top Bottom