Hi Nicola,
might be
https://docs.ceph.com/en/quincy/rados/troubleshooting/troubleshooting-pg/#crush-gives-up-too-soon
or https://tracker.ceph.com/issues/57348.
Best regards,
=
Frank Schilder
AIT Risø Campus
Bygning 109, rum S14
From: Nic
Hi Frank, I checked the first hypothesis, and I found something strange.
This is the decompiled rule:
rule wizard_data {
id 1
type erasure
step set_chooseleaf_tries 5
step set_choose_tries 100
step take default
step chooseleaf indep 0 type host
November 2022 10:39:30
To: ceph-users
Subject: [ceph-users] Re: Missing OSD in up set
Hi Frank, I checked the first hypothesis, and I found something strange.
This is the decompiled rule:
rule wizard_data {
id 1
type erasure
step set_chooseleaf_tries 5
step
better once you have more host buckets to choose OSDs from.
Best regards,
=
Frank Schilder
AIT Risø Campus
Bygning 109, rum S14
From: Nicola Mori
Sent: 03 November 2022 10:39:30
To: ceph-users
Subject: [ceph-users] Re: Missing OSD in up
/issues/57348 contains
examples of how the output looks like.
Best regards,
=
Frank Schilder
AIT Risø Campus
Bygning 109, rum S14
From: Nicola Mori
Sent: 03 November 2022 10:57:03
To: ceph-users
Subject: [ceph-users] Re: Missing OSD in up set
If I use set_choose_tries 100 and choose_total_tries 250 I get a lot of
bad mappings with crushtool;
# crushtool -i better-totaltries--crush.map --test --show-bad-mappings
--rule 1 --num-rep 8 --min-x 1 --max-x 100 --show-choose-tries
bad mapping rule 1 x 319 num_rep 8 result [43,40,58,69
Schilder
AIT Risø Campus
Bygning 109, rum S14
From: Nicola Mori
Sent: 03 November 2022 11:24:12
To: ceph-users
Subject: [ceph-users] Re: Missing OSD in up set
If I use set_choose_tries 100 and choose_total_tries 250 I get a lot of
bad mappings with
Ok, I'd say I fixed it. I set both parameters to 250, recompiled the
crush map and loaded it, and now the PG is in
active+undersized+degraded+remapped+backfilling state and mapped as:
# ceph pg map 3.5e
osdmap e23741 pg 3.5e (3.5e) -> up [38,78,55,49,40,39,64,20] acting
[38,78,55,49,40,39,64,2
To: ceph-users
Subject: [ceph-users] Re: Missing OSD in up set
Ok, I'd say I fixed it. I set both parameters to 250, recompiled the
crush map and loaded it, and now the PG is in
active+undersized+degraded+remapped+backfilling state and mapped as:
# ceph pg map 3.5e
osdmap e23741 pg 3.5e
