Re: [BackupPC-users] Necro'd: Use S3 buckets for the pool

2020-07-21 Thread Kris Lou via BackupPC-users
All, Thanks for the suggestions and links. There's a lot of interesting reading to be done. But as noted, checksum matching and storage latency are probably prohibitive. I hope to have access to a colo with gigabit bandwidth in the near future. Maybe I'll spin up an instance just to see how it

Re: [BackupPC-users] Necro'd: Use S3 buckets for the pool

2020-07-21 Thread Marcelo Ricardo Leitner
Hi, Maybe a solution composed by backuppc + rclone is the way forward. I never used rclone myself, but AFAICT it handles all the issues you raised, plus more: >From their page: "Virtual backends wrap local and cloud file systems to apply encryption, caching, chunking and joining." https://rclone

Re: [BackupPC-users] Necro'd: Use S3 buckets for the pool

2020-07-21 Thread Johan Ehnberg
Hi Kris, Indeed the object storage transformation has not been a hot topic for some time. I explored this some years ago and did some proof of concept testing. It requires a fairly different architecture: https://molnix.com/proposal-new-open-source-backup-solution/ Essentially, the object st

Re: [BackupPC-users] Necro'd: Use S3 buckets for the pool

2020-07-20 Thread Michael Huntley
I found S3 slower than my dead grandma trying to cross the street. No offense grandma D! Cheers, Michael > On Jul 20, 2020, at 5:37 PM, Kris Lou via BackupPC-users > wrote: > >  > This hasn't been addressed for a while, and I didn't find anything in recent > archives. > > Anybody have any

[BackupPC-users] Necro'd: Use S3 buckets for the pool

2020-07-20 Thread Kris Lou via BackupPC-users
This hasn't been addressed for a while, and I didn't find anything in recent archives. Anybody have any experience or hypothetical issues with writing the BPC4 Pool over s3fs-fuse to S3 or something similar? Pros, Cons? Thanks, -Kris Kris Lou k...@themusiclink.net