[ceph-users] Re: consistency of import-diff

2020-03-05 Thread Janne Johansson
Den tors 5 mars 2020 kl 08:13 skrev Stefan Priebe - Profihost AG < s.pri...@profihost.ag>: > >> Hrm. We have checksums on the actual OSD data, so it ought to be > >> possible to add these to the export/import/diff bits so it can be > >> verified faster. > >> (Well, barring bugs.) > >> > > I

[ceph-users] Re: consistency of import-diff

2020-03-04 Thread Stefan Priebe - Profihost AG
Am 04.03.20 um 16:02 schrieb Wido den Hollander: > > > On 3/4/20 3:49 PM, Lars Marowsky-Bree wrote: >> On 2020-03-04T15:44:34, Wido den Hollander wrote: >> >>> I understand what you are trying to do, but it's a trade-off. Endless >>> snapshots are also a danger because bit-rot can sneak in

[ceph-users] Re: consistency of import-diff

2020-03-04 Thread Stefan Priebe - Profihost AG
Am 04.03.20 um 15:49 schrieb Lars Marowsky-Bree: > On 2020-03-04T15:44:34, Wido den Hollander wrote: > >> I understand what you are trying to do, but it's a trade-off. Endless >> snapshots are also a danger because bit-rot can sneak in somewhere which >> you might not notice. >> >> A fresh

[ceph-users] Re: consistency of import-diff

2020-03-04 Thread Stefan Priebe - Profihost AG
Am 04.03.20 um 15:44 schrieb Wido den Hollander: > > > On 3/3/20 8:46 PM, Stefan Priebe - Profihost AG wrote: >> Hello, >> >> does anybody know whether there is any mechanism to make sure an image >> looks like the original after an import-diff? >> >> While doing ceph backups on another ceph

[ceph-users] Re: consistency of import-diff

2020-03-04 Thread Wido den Hollander
On 3/4/20 3:49 PM, Lars Marowsky-Bree wrote: > On 2020-03-04T15:44:34, Wido den Hollander wrote: > >> I understand what you are trying to do, but it's a trade-off. Endless >> snapshots are also a danger because bit-rot can sneak in somewhere which >> you might not notice. >> >> A fresh export

[ceph-users] Re: consistency of import-diff

2020-03-04 Thread Lars Marowsky-Bree
On 2020-03-04T15:44:34, Wido den Hollander wrote: > I understand what you are trying to do, but it's a trade-off. Endless > snapshots are also a danger because bit-rot can sneak in somewhere which > you might not notice. > > A fresh export (full copy) every X period protects you against this.

[ceph-users] Re: consistency of import-diff

2020-03-04 Thread Wido den Hollander
On 3/3/20 8:46 PM, Stefan Priebe - Profihost AG wrote: > Hello, > > does anybody know whether there is any mechanism to make sure an image > looks like the original after an import-diff? > > While doing ceph backups on another ceph cluster i currently do a fresh > import every 7 days. So i'm

[ceph-users] Re: consistency of import-diff

2020-03-04 Thread Janne Johansson
Den tis 3 mars 2020 kl 21:48 skrev Stefan Priebe - Profihost AG < s.pri...@profihost.ag>: > > You can use a full local export, piped to some hash program (this is > > what Backurne¹ does) : rbd export - | xxhsum > > Then, check the hash consistency with the original > > Thanks for the suggestion

[ceph-users] Re: consistency of import-diff

2020-03-03 Thread Stefan Priebe - Profihost AG
Hi, Am 03.03.20 um 20:54 schrieb Jack: > Hi, > > You can use a full local export, piped to some hash program (this is > what Backurne¹ does) : rbd export - | xxhsum > Then, check the hash consistency with the original Thanks for the suggestion but this still needs to run an rbd export on the

[ceph-users] Re: consistency of import-diff

2020-03-03 Thread Jack
Hi, You can use a full local export, piped to some hash program (this is what Backurne¹ does) : rbd export - | xxhsum Then, check the hash consistency with the original Regards, [1] https://github.com/JackSlateur/backurne On 3/3/20 8:46 PM, Stefan Priebe - Profihost AG wrote: > Hello, > >