How do you backup important things you store in selfhosted clouds?
I’m currently thinking about hosting Ente myself for syncing all my pictures. Maybe also spinning up nextcloud for various other shared files. However, for me one main benefit of using services like iCloud is the mitigated risk of losing everything in case the hardware fails (and fire, theft, water-damages, …).
Do you keep regular updates on hosted services? Do you keep really important stuff on other providers? Do you have other failsafes?
PC: Veeam
Phone/general pics: Immich (both automatic and manual)
Some general phone files: Syncthing
The remaining stuff is on my NAS at home.
Off-site of the most important VMs and some infrastructure: Veeam Backup Copy to an external HDD I keep at my workplace (encrypted)I use a 48TB ZFS RAIDZ2 pool to maintain data integrity locally and keep rolling ZFS snapshots with sanoid so that data recovery to any point within the last month is possible. Then I use borgmatic (borg) to sync the important data (~1TB) to a Servarica VPS (Polar Bear plan, which works out to be cheaper than Backblaze B2 costs for my purposes). The Servarica server really sucks in terms of CPU, and it’s quite sluggish, but it’s enough for daily backups. I also self-host healthchecks.io on a free Fly.io VPS thing (not sure if they offer this anymore) to make sure the backups are actually happening successfully, and hosting that on a third-party VPS means that it’s not going to fail at the same time my server does. Then I use Uptime Kuma to make sure everything is consistently alive (especially the healthchecks.io server, which in turn verifies that Uptime Kuma stays alive). I also run the same borg configuration to back up to a plain non-redundant disk locally.
The downside of this setup is that I’m only truly backing up a fraction of my pool, but most of my pool is stuff that I can redownload and set up again in the event of e.g. a house fire. I also run a daily script to dump a lot of metadata about my systems and pool, like directory listings of my media folders and installed programs/etc, which means that even if the data might be lost, I have a map of what I need to grab again.
How big are these ZFS snapshots compared to the stored data size? 1:1?
Borg + hetzner backup storage (that supports Borg and rsync but I use Borg so my backups are encrypted)
When I setup my backup strategy, the Hetzner storage boxes showed the best price per TB, and allow ssh / SCP and webdav access.
I run a virtualized TrueNAS Scale with a passed through HBA and about 6 drives in raid-z2 mode. I setup TrueNAS to do regular snapshots - hourly, daily, monthly and I use the built in encrypted backup options to backup my most important data every night (personal videos and pictures, VM backups, documents, docker volumes).
This works like a charm and it seems to be also quite stable. If the system ever dies, I can always simply mount the encrypted backup folder on my laptop using rclone, and then manage my files directly using mc.
Is the best place to ask
I use nextcloud and I love it.
You want to follow the 3-2-1 strategy: 3 copies of your data on at least 2 different forms of media, and 1 backup being off-line.
Off-site rather than offline, protecting against things like your house burning down.
Yes.