Sync large data


zack ibraham

Member
Local time
3:41 AM
Posts
6
OS
windows 11
I have about 3 million files and folders sized (240G) on a local PC . Once the main job is synced only a thousand or so files change every day.

What I am trying to do is to sync the entire contents to a webhost via ftp and keep it updated as the files change on my local PC.

So what I need , is to transfer only the changes that happens on the files in the same time it changed on the destination .

I tried using GoodSync for this but it takes 15 hrs to analyses and by that time a number of files have changed.

Is there any software or string of batch files that would do this for me and utilize multiple connections for a ftp username?
 
Windows Build/Version
win 11

My Computer

System One

  • OS
    windows 11
    Computer type
    Laptop
    Manufacturer/Model
    Hp Notebook

FreeBooter

Well-known member
Power User
VIP
Local time
4:41 AM
Posts
687
OS
Windows 11
You can use the attached batch script to total copy first and then incrementally, it just copies the new files and changed files.
 

Attachments

  • Incremental_Backup.bat
    2.6 KB · Views: 3

My Computer

System One

  • OS
    Windows 11
    Computer type
    PC/Desktop
    Manufacturer/Model
    HP Pavilion
    CPU
    AMD Ryzen 7 5700G
    Motherboard
    Erica6
    Memory
    Micron Technology DDR4-3200 16GB
    Graphics Card(s)
    NVIDIA GeForce RTX 3060
    Sound Card
    Realtek ALC671
    Monitor(s) Displays
    Samsung SyncMaster U28E590
    Screen Resolution
    3840 x 2160
    Hard Drives
    SAMSUNG MZVLQ1T0HALB-000H1

Berton

Well-known member
Member
VIP
Local time
7:41 PM
Posts
565
Location
Wyoming
OS
Win11 Pro RTM x64
Just curious, I also FTP files to my Domain but they are static/never automatically changing. But a question, isn't the process described one of the reasons the various Cloud storages were developed?
 

My Computers

System One System Two

  • OS
    Win11 Pro RTM x64
    Computer type
    Laptop
    Manufacturer/Model
    Dell Vostro 3400
    CPU
    Intel Core i5
    Memory
    8GB
    Hard Drives
    256GB SSD NVMe
  • Operating System
    Windows 11 Pro
    Computer type
    PC/Desktop
    Manufacturer/Model
    Dell Vostro 5890
    CPU
    Intel Core i5
    Memory
    8GB [16GB on order]
    Monitor(s) Displays
    21"
    Hard Drives
    512GB SSD NVMe
    Browser
    Firefox, Edge
    Antivirus
    Windows Defender/Microsoft Security

zack ibraham

Member
Thread Starter
Local time
3:41 AM
Posts
6
OS
windows 11
maybe, it looks like that
 

My Computer

System One

  • OS
    windows 11
    Computer type
    Laptop
    Manufacturer/Model
    Hp Notebook

zack ibraham

Member
Thread Starter
Local time
3:41 AM
Posts
6
OS
windows 11
I ended up transferring the data with the backup tool called Gs Richcopy 360. This seems to have worked and is straightforward.
Thanks, FreeBooter & Berton, for trying to help:)
 

My Computer

System One

  • OS
    windows 11
    Computer type
    Laptop
    Manufacturer/Model
    Hp Notebook
Top Bottom