Data Hoarder

116 readers

1 users here now

We are digital librarians. Among us are represented the various reasons to keep data -- legal requirements, competitive requirements, uncertainty of permanence of cloud services, distaste for transmitting your data externally (e.g. government or corporate espionage), cultural and familial archivists, internet collapse preppers, and people who do it themselves so they're sure it's done right. Everyone has their reasons for curating the data they have decided to keep (either forever or For A Damn Long Time (tm) ). Along the way we have sought out like-minded individuals to exchange strategies, war stories, and cautionary tales of failures.

founded 1 year ago

MODERATORS

[email protected]

How do you transfer more than 1 terabyte from PC to PC? (alien.top)

submitted 11 months ago by [email protected] to c/[email protected]

30 comments fedilink hide all child comments

In the past, I have used a USB to transfer a few video files from one computer to another. This time I have over 1 terabyte of movies and shows I'd like to transfer. What is the best method?

I know it will take a very long time

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 1 points 11 months ago

Simplest method is to copy via normal drag and drop, provided you have halfway decent hardware copying locally on the same network and a wired connection, 1Terabyte will not take too long, maybe a few hours on a standard Gigabit connection.

There are other options as the Windows SMB network protocol can be a bit slow.

Simplest method, use FTP to copy the files over at "line speed" - you can use filezilla in both client and server versions.

If you are using Linux, you can also use "rsync" to copy files over to a remote machine, "Syncing" means it compares the files on source and destination and only copies the differences, this is a more efficient way to copy files. Do some research on the command to use, I usually use some variant of rsync -av /source/folder/ user@server:/destination/folder

Windows also has a similar file syncing tool called "robocopy" (it's built in to every version of Windows since WinXP), With this you can also use something called "Multithreading" to copy lots of files at once if you have a lot of cores (be careful that the destination has a few cores as well as this can saturate a network link). Basic robocopy command (with threading) example is:"robocopy.exe c:\source \\server\destinaton /copy:DAT /xo /r:1 /w:1 /mt:4 /np /e" (syncs files, ignoring older files in destination, copying Data/Attributes/Timestamps, does not show progress - clutters screen, only tries once and waits 1 second for the retry - can always re run if lots of failures, copies all folders (even empty ones) to preserve structure, and uses 4 CPU threads to prevent big files stalling the copy) Lots more options but this should do for the basics. (using /COPYALL needs you to run in Administrator mode on terminal window due to the auditing admin rights this uses, not needed in most cases and won't work if you aren't copying NTFS to NTFS)