[ceph-users] Re: rbd-mirror replay is very slow - but initial bootstrap is fast

2020-03-10 Thread Anthony D'Atri
>> >> FWIW when using rbd-mirror to migrate volumes between SATA SSD clusters, I >> found that >> >> >> rbd_mirror_journal_max_fetch_bytes: >>section: "client" >>value: "33554432" >> >> rbd_journal_max_payload_bytes: >>section: "client" >>value: “8388608" > > Indeed,

[ceph-users] Re: rbd-mirror replay is very slow - but initial bootstrap is fast

2020-03-10 Thread Jason Dillaman
On Tue, Mar 10, 2020 at 2:31 PM Anthony D'Atri wrote: > > FWIW when using rbd-mirror to migrate volumes between SATA SSD clusters, I > found that > > >rbd_mirror_journal_max_fetch_bytes: > section: "client" > value: "33554432" > > rbd_journal_max_payload_bytes: > section:

[ceph-users] Re: rbd-mirror replay is very slow - but initial bootstrap is fast

2020-03-10 Thread Anthony D'Atri
FWIW when using rbd-mirror to migrate volumes between SATA SSD clusters, I found that rbd_mirror_journal_max_fetch_bytes: section: "client" value: "33554432" rbd_journal_max_payload_bytes: section: "client" value: “8388608" Made a world of difference in expediting

[ceph-users] Re: rbd-mirror replay is very slow - but initial bootstrap is fast

2020-03-10 Thread Jason Dillaman
On Tue, Mar 10, 2020 at 11:53 AM Ml Ml wrote: > > Hello Jason, > > okay, good hint! > > I did not realize, that it will write the journal 1:1 but that makes > sense. I will benchmark it later. Yes, it's replaying the exact IOs again to ensure it's point-in-time consistent. > However, my backup

[ceph-users] Re: rbd-mirror replay is very slow - but initial bootstrap is fast

2020-03-10 Thread Ml Ml
Hello Jason, okay, good hint! I did not realize, that it will write the journal 1:1 but that makes sense. I will benchmark it later. However, my backup cluster is the place where the old spinning rust will find its last dedication. Therefore it will never be as fast as the live cluster.

[ceph-users] Re: rbd-mirror replay is very slow - but initial bootstrap is fast

2020-03-10 Thread Ml Ml
Hello Jason, thanks for that fast reply. This is now my /etc/ceph/ceph.conf [client] rbd_mirror_journal_max_fetch_bytes = 4194304 I stopped and started my rbd-mirror manually with: rbd-mirror -d -c /etc/ceph/ceph.conf Still same result. Slow speed shown by iftop and entries_behind_master

[ceph-users] Re: rbd-mirror replay is very slow - but initial bootstrap is fast

2020-03-10 Thread Jason Dillaman
On Tue, Mar 10, 2020 at 10:36 AM Ml Ml wrote: > > Hello Jason, > > thanks for that fast reply. > > This is now my /etc/ceph/ceph.conf > > [client] > rbd_mirror_journal_max_fetch_bytes = 4194304 > > > I stopped and started my rbd-mirror manually with: > rbd-mirror -d -c /etc/ceph/ceph.conf > >

[ceph-users] Re: rbd-mirror replay is very slow - but initial bootstrap is fast

2020-03-10 Thread Jason Dillaman
On Tue, Mar 10, 2020 at 6:47 AM Ml Ml wrote: > > Hello List, > > when i initially enable journal/mirror on an image it gets > bootstrapped to my site-b pretty quickly with 250MB/sec which is about > the IO Write limit. > > Once its up2date, the replay is very slow. About 15KB/sec and the >