[ceph-users] Re: Why set osd flag to noout during upgrade ?

2021-09-22 Thread Frank Schilder
. Best regards, = Frank Schilder AIT Risø Campus Bygning 109, rum S14 From: Etienne Menguy Sent: 22 September 2021 12:17:39 To: ceph-users Subject: [ceph-users] Re: Why set osd flag to noout during upgrade ? Hello, >From my experience

[ceph-users] Re: Why set osd flag to noout during upgrade ?

2021-09-22 Thread Anthony D'Atri
Indeed. In a large enough cluster, even a few minutes of extra backfill/recovery per OSD adds up. Say you have 100 OSD nodes, and just 3 minutes of unnecessary backfill per. That prolongs your upgrade by 5 hours. > Yeah you don't want to deal with backfilling while the cluster is >

[ceph-users] Re: Why set osd flag to noout during upgrade ?

2021-09-22 Thread Dan van der Ster
Yeah you don't want to deal with backfilling while the cluster is upgrading. At best it can delay the upgrade, at worst mixed version backfilling has (rarely) caused issues in the past. We additionally `set noin` and disable the balancer: `ceph balancer off`. The former prevents broken osds from

[ceph-users] Re: Why set osd flag to noout during upgrade ?

2021-09-22 Thread Etienne Menguy
Hello, From my experience, I see three reasons : - You don’t want to recover data if you already have them on a down OSD, rebalancing can have a big impact on performance - If upgrade/maintenance goes wrong you will want to focus on this issue and not have to deal with things done by Ceph