Network Gurus - Help wanted here with remote file transfers please

Hi folks
I've excellent ISP connections etc -- but I'm trying to copy to a Windows VM around 4.5 TB of data to an external HDD which I've re-formatted as NTFS from a remote Linux server so I know there's some file conversion type taking place.

Anyway is there any way that I can speed the transfer up - remember going from a Windows VM to a Remote Linux server and the host is also a LINUX machine. Measured speed is in MB/s so is 4X conventional Mbps speed.

HDD is a decent Toshiba HDD with sensible cache size and speed.



Just seems 11 hrs for this is quite a long time !!! -- No prob running this stuff overnight but local Networking should be able to handle certainly 1 Gbps if not 10 Gbps.


Cheers
jimbo

The difference between B and b is 8x. B = Byte which is 8 bits. b = bit. So you're getting about almost 900Mbps. We don't know where the 'remote' server is. Is that same LAN, across a WAN. Is every point between the local and remote system able to handle over 1Gbps, if not then 1Gbps is your max throughput

neemobeer said:

The difference between B and b is 8x. B = Byte which is 8 bits. b = bit. So you're getting about almost 900Mbps. We don't know where the 'remote' server is. Is that same LAN, across a WAN. Is every point between the local and remote system able to handle over 1Gbps, if not then 1Gbps is your max throughput

Click to expand...

Thanks

My ESP gives currently 10 Gbps but upgrading soon to 1 Tbps -- Nordic counties including Iceland have often the fastest Internet connections on the planet,

Anyway the transfer is still going OK so I'll just let it go. It's rarely I need to xfer anything like this huge amount of data !! but I have some friends who want some of these TV programs I've stored over the years !

Thanks for your reply !!!!



Cheers
jimbo

I'm no guru in networking but I do know that Windows has long had issues with direct copying of large files. Whether it will help in your case or not, you could try Robocopy command line tool built into Windows or one of the 3rd party tools especially designed to handle large transfers such as Fastcopy, Teracopy, and Xcopy..

Neither do I know about VMs. When I have to move/copy large amounts of data, I use Macrium.

Regardless of that advertised speed if any point in the connection only supports say 100Mbps then you would be bottle necked by the slow connection point. This doesn't include that fact that any point of the connection can be QoS'd down to a controllable speed. So if the server is owned and operated by someone else they could simply QoS the connect down as not to overload their systems or to maintain quality amongst their customers. Needless to say there are many factors that can impact speed and many of them are out of your control.

PS: I love Iceland, I visited a couple years ago. Did a lot of hiking there.