Sync large data


zack ibraham

Member
Local time
2:32 PM
Posts
10
OS
windows 11
I have about 3 million files and folders sized (240G) on a local PC . Once the main job is synced only a thousand or so files change every day.

What I am trying to do is to sync the entire contents to a webhost via ftp and keep it updated as the files change on my local PC.

So what I need , is to transfer only the changes that happens on the files in the same time it changed on the destination .

I tried using GoodSync for this but it takes 15 hrs to analyses and by that time a number of files have changed.

Is there any software or string of batch files that would do this for me and utilize multiple connections for a ftp username?
 
Windows Build/Version
win 11

My Computer My Computer

At a glance

windows 11
OS
windows 11
Computer type
Laptop
Manufacturer/Model
Hp Notebook
any ideas?
 

My Computer My Computer

At a glance

windows 11
OS
windows 11
Computer type
Laptop
Manufacturer/Model
Hp Notebook
You can use the attached batch script to total copy first and then incrementally, it just copies the new files and changed files.
 

Attachments

My Computer My Computer

At a glance

Windows 11AMD Ryzen 7 5700GMicron Technology DDR4-3200 16GBNVIDIA GeForce RTX 3060
OS
Windows 11
Computer type
PC/Desktop
Manufacturer/Model
HP Pavilion
CPU
AMD Ryzen 7 5700G
Motherboard
Erica6
Memory
Micron Technology DDR4-3200 16GB
Graphics Card(s)
NVIDIA GeForce RTX 3060
Sound Card
Realtek ALC671
Monitor(s) Displays
Samsung SyncMaster U28E590
Screen Resolution
3840 x 2160
Hard Drives
SAMSUNG MZVLQ1T0HALB-000H1
Just curious, I also FTP files to my Domain but they are static/never automatically changing. But a question, isn't the process described one of the reasons the various Cloud storages were developed?
 

My Computers My Computers

  • At a glance

    Win11 Pro RTM Version 24H2 Build 26100.4202Intel Core i5 11th Gen. 2.40GHz12GB
    OS
    Win11 Pro RTM Version 24H2 Build 26100.4202
    Computer type
    Laptop
    Manufacturer/Model
    Dell Vostro 3400
    CPU
    Intel Core i5 11th Gen. 2.40GHz
    Memory
    12GB
    Hard Drives
    256GB SSD NVMe M.2
  • At a glance

    Win11 Pro RTM Version 24H2 Build 26100.4202Intel Core i5 10th Gen. 2.90GHz16GBOnboard, no VGA, using a DisplayPort-to-VGA a...
    Operating System
    Win11 Pro RTM Version 24H2 Build 26100.4202
    Computer type
    PC/Desktop
    Manufacturer/Model
    Dell Vostro 5890
    CPU
    Intel Core i5 10th Gen. 2.90GHz
    Memory
    16GB
    Graphics card(s)
    Onboard, no VGA, using a DisplayPort-to-VGA adapter
    Monitor(s) Displays
    24" Dell
    Hard Drives
    512GB SSD NVMe, 4TB Seagate HDD
    Browser
    Firefox, Edge
    Antivirus
    Windows Defender/Microsoft Security
maybe, it looks like that
 

My Computer My Computer

At a glance

windows 11
OS
windows 11
Computer type
Laptop
Manufacturer/Model
Hp Notebook
I ended up transferring the data with the backup tool called Gs Richcopy 360. This seems to have worked and is straightforward.
Thanks, FreeBooter & Berton, for trying to help:)
 

My Computer My Computer

At a glance

windows 11
OS
windows 11
Computer type
Laptop
Manufacturer/Model
Hp Notebook

Latest Support Threads

Back
Top Bottom