Selected Files Backup to OneDrive

vett93 · Apr 21, 2024

For my laptop backup, my goal is to keep a copy of my documents, images, and Python scripts on OneDrive. In the event that I lose this laptop, I can recover them from OneDrive. So far, documents and images backup works fine.

My issue is with the backup of Python scripts and data. If I put folders containing them on OneDrive, there will be many library files on OneDrive too. I can reconstruct these library files easily and so I don't need to back them up. Additionally, these Python and data files are in both Windows filesystem and WSL too.

What is a good way for backing up my Python and data files?

antspants · Apr 21, 2024

Possibly just archive them to a zip or 7z (7zip) file or some type of archiving format?

If you’re not wanting to use up space in your OneDrive account (due to size) perhaps consider getting a Dropbox or iCloud account solely for your Python scripts/files.

Or, get a very reliable external or new internal, and use something like FreeFileSync/RealTimeSync
I use it so that whenever there is a change to a file, it is recognised and immediately (or at a delay I choose) backed up.

FreeFileSync

Download FreeFileSync 13.5. FreeFileSync is a free open source data backup software that helps you synchronize files and folders on Windows, Linux and macOS.

freefilesync.org

Tutorials (short videos)

FreeFileSync

Download FreeFileSync 13.5. FreeFileSync is a free open source data backup software that helps you synchronize files and folders on Windows, Linux and macOS.

freefilesync.org

antspants · Apr 21, 2024

I see you have a 2TB SSD. You could consider creating a small partition on it (maybe 50/100GB?) so you can separate your Python files from any user account that OneDrive has backup rights to. And by default, save your Python stuff to it.
From there you could setup a sync with Dropbox or another online service of your choosing.

EDIT: Remember though, when reinstalling Windows, that new partition would be eaten so your Online backup and or external/internal backup would be imperative.

EDIT 2: Also, if creating an image of C, you would need to include that partition in the image because by default, it wont be imaged due to it being a separate partition to your OS partition. Depending on the imaging software you use. (Although if backed up online, you don’t really need to worry)

vett93 · Apr 21, 2024

Is there a way for me to sync some folders and specific file types to a folder in OneDrive?

antspants · Apr 21, 2024

vett93 said:
Is there a way for me to sync some folders and specific file types to a folder in OneDrive?

So many threads about OneDrive here, it’s like a plague, and yet I still can not answer that simple question. Someone could.
A far as I know, no?

Hence my suggestion of a partition and everything else.

If not a partition, create an independent folder on your C Drive, outside of your User Folders, then you use ~~something like~~ FreeFileSync/RealTimeSync to recognise changes and backup selected files to your user folder which you want backed up to OneDrive.

For example

Save all Python related files to C:\Python\

Create a job in FreeFileSync to recognise a change in certain files you select in the backup job and back up selected files to User Folders\Documents\Python\

The files you selected to be backed up to User Folders\Documents\Python\ will then be backed up by OneDrive.

EDIT:

Or, due to new files that may be created that you want backed up, instruct FreeFileSync to back up all files but flag particular files you want ignored. (Your library Files, if they are of course, always named the same)

antspants · Apr 21, 2024

Basically, you select a folder (or file of course) that you want FreeFileSync to monitor, if a change is made to a file or if a new file is added to that folder, it will recognise it and backup changes within that folder.

From C:\Python\ > C\Documents\Python > OneDrive (less the files you have excluded)

vett93 · Apr 21, 2024

Thanks. I'll give it a try tomorrow.

antspants · Apr 21, 2024

I would hope you will check the other short tutorials to get a handle of what is possible, but the two above would be the main focus for the task I have suggested.

It’s a great app, it’s 100% free, it has a great forum, it is feature rich and can get as complicated as you want it to be. But essentially it isn’t hard to use.
I would be happy to help if you go that way.

FreeFileSync

Download FreeFileSync 13.5. FreeFileSync is a free open source data backup software that helps you synchronize files and folders on Windows, Linux and macOS.

freefilesync.org

I am certain others will have suggestions. Cheers Vett

antspants · Apr 21, 2024

Also, I have edited post 5 as I read your question wrong, and have already answered the question below my mistake. Cheers again.

cereberus · Apr 21, 2024

vett93 said:
For my laptop backup, my goal is to keep a copy of my documents, images, and Python scripts on OneDrive. In the event that I lose this laptop, I can recover them from OneDrive. So far, documents and images backup works fine.

My issue is with the backup of Python scripts and data. If I put folders containing them on OneDrive, there will be many library files on OneDrive too. I can reconstruct these library files easily and so I don't need to back them up. Additionally, these Python and data files are in both Windows filesystem and WSL too.

What is a good way for backing up my Python and data files?

You can backup specific folders to onedrive using symlinks.

Sync Any Folder to OneDrive in Windows 10

How to Sync Any Folder to OneDrive in Windows 10

www.tenforums.com

antspants · Apr 21, 2024

cereberus said:
You can backup specific folders to onedrive using symlinks.

Sync Any Folder to OneDrive in Windows 10

How to Sync Any Folder to OneDrive in Windows 10

www.tenforums.com

This is true, I had a read of this. But the issue is discriminating between what files are uploaded to OneDrive not what folders.
I figure that if the Project is saved to another folder outside of User Folders and the “Library” files Vett wants to exclude were marked to be excluded within a 3rd party file sync app (FreeFileSync for instance) then only the Python files needed would be in the User Folders to be uploaded to OneDrive

The Python Project folder could be in the User Folder and excluded using that link/method, but the files still need to be separated to discriminate between what is uploaded to OneDrive and what isn’t

User Folders\Python Project Folder\ *OneDrive excluded folder
User Folders\Python Project Folder\ *FreeFileSync folder sync job excluding library files —> to Documents\Python\ *OneDrive included folder

cereberus · Apr 21, 2024

antspants said:
This is true, I had a read of this. But the issue is discriminating between what files are uploaded to OneDrive not what folders.
I figure that if the Project is saved to another folder outside of User Folders and the “Library” files Vett wants to exclude were marked to be excluded within a 3rd party file sync app (FreeFileSync for instance) then only the Python files needed would be in the User Folders to be uploaded to OneDrive

The Python Project folder could be in the User Folder and excluded using that link/method, but the files still need to be separated to discriminate between what is uploaded to OneDrive and what isn’t

User Folders\Python Project Folder\ *OneDrive excluded folder
User Folders\Python Project Folder\ *FreeFileSync folder sync job excluding library files —> to Documents\Python\ *OneDrive included folder

I have some app spevific project folders I symlink to a dummy onedrive folder.

Those project folders get automatically synced to onedrive.

All the remaining folders (executables, dll files etc.) are not symlinked.

As there is no actual copy of data in the symlinked folders, this is very space efficient. Original data in source folder and one online.

Personally, I see no need to use alternative sync tools in my usage which sounds similar to OPs needs.

It all comes down to how OP organises their data

antspants · Apr 21, 2024

cereberus said:
I have some app spevific project folders I symlink to a dummy onedrive folder.

Those project folders get automatically synced to onedrive.

All the remaining folders (executables, dll files etc.) are not symlinked.

As there is no actual copy of data in the symlinked folders, this is very space efficient. Original data in source folder and one online.

Personally, I see no need to use alternative sync tools in my usage which sounds similar to OPs needs.

It all comes down to how OP organises their data

Good plan, perhaps you could show us how? This is what the OP is asking.

cereberus · Apr 21, 2024

antspants said:
Good plan, perhaps you could show us how? This is what the OP is asking.

I posted link to tutorial.

antspants · Apr 21, 2024

cereberus said:
I posted link to tutorial.

I read that tutorial, as mentioned earlier. It mentions noting about symlinking/excluding files etc. I suppose if the OP has questions, they can ask. Thank you

cereberus · Apr 21, 2024

antspants said:
I read that tutorial, as mentioned earlier. It mentions noting about symlinking/excluding files etc. I suppose if the OP has questions, they can ask. Thank you

Yeah it does - just see coding how to use mklink. Obviously only provide symlinks for each folder you wish to sync. Simply exclude folders by not symlinking them to start with.

antspants · Apr 21, 2024

cereberus said:
Yeah it does - just see coding how to use mklink. Obviously only provide symlinks for each folder you wish to sync. Simply exclude folders by not symlinking them to start with.

I think it might be above my pay-grade

Probably why I use FreeFileSync. Thanks, cereberus

cereberus · Apr 21, 2024

antspants said:
I think it might be above my pay-grade Probably why I use FreeFileSync. Thanks, cereberus

Nah - it is simple.

pseymour · Apr 21, 2024

@vett93 If you’re managing code of any sort, it would behoove you to learn a version control system of some sort. Git is super popular these days.

Situations like yours are precisely why git repositories support a gitignore file.

cereberus · Apr 21, 2024

pseymour said:
@vett93 If you’re managing code of any sort, it would behoove you to learn a version control system of some sort. Git is super popular these days.

Situations like yours are precisely why git repositories support a gitignore file.

Are you having a laugh? This is nothing to do with OPs request.