[ceph-users] Re: CephFS mirror very slow (maybe for small files?)

2023-11-15 Thread Stuart Cornell
Hi Jos, I have tried adding multiple daemons but it seems only 1 is active, and there is no improvement in throughput. On further reading, you suggestion conflicts with the docs (https://docs.ceph.com/en/reef/dev/cephfs-mirroring/#:~:text=Multiple%20mirror%20daemons%20can%20be,set%20thus%20provi

[ceph-users] Re: CephFS mirror very slow (maybe for small files?)

2023-11-15 Thread Stuart Cornell
Thankyou Jos. I will try the multiple daemons to see how that helps. It looks like I need to wait for the fix [1] to be in a release (currently pending review) before I can apply it. Stuart ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscr

[ceph-users] Re: CephFS mirror very slow (maybe for small files?)

2023-11-13 Thread Jos Collin
Hi Stuart, I would highly recommend you to have this [1] fix, so that the mirroring works as expected and uses the prev snapshot for syncing. Having multiple mirror daemons also improves the speed. [1] https://github.com/ceph/ceph/pull/54405 - Jos Collin On 13/11/23 21:31, Stuart Cornell wro

[ceph-users] Re: CephFS mirror very slow (maybe for small files?)

2023-11-13 Thread Peter Grandi
> the speed of data transfer is varying a lot over time (200KB/s > – 120MB/s). [...] The FS in question, has a lot of small files > in it and I suspect this is the cause of the variability – ie, > the transfer of many small files will be more impacted by > greater site-site latency. 200KB/s on sma