this post was submitted on 24 Jan 2025
27 points (93.5% liked)

Selfhosted

41674 readers
638 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

  1. Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.

  2. No spam posting.

  3. Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.

  4. Don't duplicate the full text of your blog or github here. Just post the link for folks to click.

  5. Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).

  6. No trolling.

Resources:

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 2 years ago
MODERATORS
ruud@lemmy.world
Loki@lemmy.world
CannaVet@lemmy.world
devve@lemmy.world
HybridSarcasm@lemmy.world
HybridSarcasm@lemmy.hybridsarcasm.xyz
27
Proxmox backups to S3 (or similar)? (sopuli.xyz)
submitted 1 week ago by IsoKiero@sopuli.xyz to c/selfhosted@lemmy.world
16 comments fedilink hide all child comments
 

So, I've been pushing my photos to local immich-instance and I'll need some kind of file storage too soon, total amount of data is roughly 1,5TB.

Everything is running on a proxmox server and that's running somewhat smoothly, but now I'd need to get that backed up offsite. I'm running a VPS at Hetzner and they offer pretty decently priced S3 storage or 'storagebox' which is just a raw disk you can connect via SMB/NFS and others.

Now, the question is, how to set up automated backups from proxmox to either of those solutions? I suppose I could just mount anything to the host locally and set up backup paths accordingly, but should the mount drop for whatever reason is proxmox smart enough to notice that actual storage is missing and not fill small local drive with backups?

Encryption would be nice too, but that might be a bit too much to ask. I have enough bandwidth to manage everything and after initial upload the data doesn't change that much, the only question is what is the best practise to do it?

you are viewing a single comment's thread
view the rest of the comments
[–] MangoPenguin@lemmy.blahaj.zone 4 points 1 week ago (1 children)

The most efficient option is probably Restic inside each VM/CT, because you pick exactly what you need to backup instead of the entire OS.

[–] ShortN0te@lemmy.ml 2 points 1 week ago (2 children)

If you use any kind of deduplication and or compression, the system files do not amount to any meaningful size (assuming there is no additional encryption on the VM disks). Especially when you consider the size of OPs data, 1,5TB, then the couple of GB of system binaries etc. do not really matter.

[–] IsoKiero@sopuli.xyz 1 points 1 week ago (1 children)

You are absolutely correct. I don't mind the few GB's worth of data for the operating system, a single video with my drone is likely more than that and it's not something you can deduplicate nor compress very well. If I really wanted I think it should be possible to squeeze the operating system at least below 2GB, but it's just not worth the effort. I just want that the memories over 20+ years I have on the thing to remain.

[–] ShortN0te@lemmy.ml 1 points 1 week ago

I am fully backing up my Mail Server with some exclusions like /tmp etc. with restic now for over a year, including updated binaries and docker images etc. and have about 16GB of data with hourly backups for over a year.

[–] MangoPenguin@lemmy.blahaj.zone 1 points 1 week ago

True, sometimes there are other files though. For example my Minecraft server I backup the world but not the web map files, since those are over 30GB and can be regenerated.