Re: [ceph-users] Increase recovery / backfilling speed (with many small objects)

2018-02-28 Thread Stefan Kooman
Hi, We recently learned on this list about the "rotational_journal = 1" for some (all?) NVMe / SSD setups. We also hit this issue (see below). It would eventually take a week to recover ... This was all "scratch data" so didn't matter anyway. We recently had to do some reovery / backfilling on

Re: [ceph-users] Increase recovery / backfilling speed (with many small objects)

2018-01-08 Thread Mark Schouten
On maandag 8 januari 2018 11:34:22 CET Stefan Kooman wrote: > Thanks. If forgot to mention I already increased that setting to "10" > (and eventually 50). It will increase the speed a little bit: from 150 > objects /s to ~ 400 objects / s. It would still take days for the cluster > to recover.

Re: [ceph-users] Increase recovery / backfilling speed (with many small objects)

2018-01-08 Thread Stefan Kooman
Quoting Chris Sarginson (csarg...@gmail.com): > You probably want to consider increasing osd max backfills > > You should be able to inject this online > > http://docs.ceph.com/docs/luminous/rados/configuration/osd-config-ref/ > > You might want to drop your osd recovery max active settings

Re: [ceph-users] Increase recovery / backfilling speed (with many small objects)

2018-01-05 Thread Chris Sarginson
You probably want to consider increasing osd max backfills You should be able to inject this online http://docs.ceph.com/docs/luminous/rados/configuration/osd-config-ref/ You might want to drop your osd recovery max active settings back down to around 2 or 3, although with it being SSD your

[ceph-users] Increase recovery / backfilling speed (with many small objects)

2018-01-05 Thread Stefan Kooman
Hi, I know I'm not the only one with this question as I have see similar questions on this list: How to speed up recovery / backfilling? Current status: pgs: 155325434/800312109 objects degraded (19.408%) 1395 active+clean 440