[ceph-users] Re: bunch of " received unsolicited reservation grant from osd" messages in log
On Fri, Jul 1, 2022 at 4:22 PM Denis Polom wrote: > OK, and when it will be backported to Pacific? > > Backport PR (https://github.com/ceph/ceph/pull/46873) is pending review and testing. Ronen > On 6/27/22 18:59, Neha Ojha wrote: > > This issue should be addressed by > https://github.com/ceph/ceph/pull/46860. > > > > Thanks, > > Neha > > > > On Fri, Jun 24, 2022 at 2:53 AM Kenneth Waegeman > > wrote: > >> Hi, > >> > >> I’ve updated the cluster to 17.2.0, but the log is still filled with > these entries: > >> > >> 2022-06-24T11:45:12.408944+02:00 osd031 ceph-osd[22024]: osd.508 > pg_epoch: 685367 pg[5.166s0( v 685201'4130317 > (680710'4123328,685201'4130317] local-lis/les=683269/683270 n=375262 > ec=1104/1104 lis/c=683269/683269 les/c/f=683270/683270/19430 sis=683269) > [508,181,357,22,592,228,250,383,28,213,586]p508(0) r=0 lpr=683269 > crt=685201'4130317 lcod 685201'4130316 mlcod 685201'4130316 active+clean > TIME_FOR_DEEP > ps=[591~1,5a3~1,5a5~1,5a7~1,5a9~1,5ab~1,5ad~1,5af~1,5b1~2,5bb~1,5c5~14,5ed~c,5fd~1f]] > scrubber : handle_scrub_reserve_grant: received unsolicited > reservation grant from osd 357(2) (0x55e16d92f600) > >> 2022-06-24T11:45:12.412196+02:00 osd031 ceph-osd[22024]: osd.508 > pg_epoch: 685367 pg[5.166s0( v 685201'4130317 > (680710'4123328,685201'4130317] local-lis/les=683269/683270 n=375262 > ec=1104/1104 lis/c=683269/683269 les/c/f=683270/683270/19430 sis=683269) > [508,181,357,22,592,228,250,383,28,213,586]p508(0) r=0 lpr=683269 > crt=685201'4130317 lcod 685201'4130316 mlcod 685201'4130316 active+clean > TIME_FOR_DEEP > ps=[591~1,5a3~1,5a5~1,5a7~1,5a9~1,5ab~1,5ad~1,5af~1,5b1~2,5bb~1,5c5~14,5ed~c,5fd~1f]] > scrubber : handle_scrub_reserve_grant: received unsolicited > reservation grant from osd 586(10) (0x55e1b57354a0) > >> 2022-06-24T11:45:12.417867+02:00 osd031 ceph-osd[21674]: osd.560 > pg_epoch: 685367 pg[5.6e2s0( v 685198'4133308 > (680724'4126463,685198'4133308] local-lis/les=675991/675992 n=375710 > ec=1104/1104 lis/c=675991/675991 les/c/f=675992/675992/19430 sis=675991) > [560,259,440,156,324,358,338,218,191,335,256]p560(0) r=0 lpr=675991 > crt=685198'4133308 lcod 685198'4133307 mlcod 685198'4133307 active+clean > TIME_FOR_DEEP > ps=[591~1,5a3~1,5a5~1,5a7~1,5a9~1,5ab~1,5ad~1,5af~1,5b1~2,5bb~1,5c5~14,5ed~c,5fd~1f]] > scrubber : handle_scrub_reserve_grant: received unsolicited > reservation grant from osd 259(1) (0x559a5f371080) > >> 2022-06-24T11:45:12.453294+02:00 osd031 ceph-osd[22024]: osd.508 > pg_epoch: 685367 pg[5.166s0( v 685201'4130317 > (680710'4123328,685201'4130317] local-lis/les=683269/683270 n=375262 > ec=1104/1104 lis/c=683269/683269 les/c/f=683270/683270/19430 sis=683269) > [508,181,357,22,592,228,250,383,28,213,586]p508(0) r=0 lpr=683269 > crt=685201'4130317 lcod 685201'4130316 mlcod 685201'4130316 active+clean > TIME_FOR_DEEP > ps=[591~1,5a3~1,5a5~1,5a7~1,5a9~1,5ab~1,5ad~1,5af~1,5b1~2,5bb~1,5c5~14,5ed~c,5fd~1f]] > scrubber : handle_scrub_reserve_grant: received unsolicited > reservation grant from osd 213(9) (0x55e1a9e922c0) > >> > >> Is the bug still there, or is this something else? > >> > >> Thanks!! > >> > >> Kenneth > >> > >> > >> > >> On 19 Dec 2021, at 11:05, Ronen Friedman wrote: > >> > >> > >> > >> On Sat, Dec 18, 2021 at 7:06 PM Ronen Friedman > wrote: > >>> Hi all, > >>> > >>> This was indeed a bug, which I've already fixed in 'master'. > >>> I'll look for the backporting status tomorrow. > >>> > >>> Ronen > >>> > >> The fix is part of a larger change (which fixes a more severe issue). > Pending (non-trivial) backport. > >> I'll try to speed this up. > >> > >> Ronen > >> > >> > >> > >> > >>> On Fri, Dec 17, 2021 at 1:49 PM Kenneth Waegeman < > kenneth.waege...@ugent.be> wrote: > Hi all, > > I'm also seeing these messages spamming the logs after update from > octopus to pacific 16.2.7. > > Any clue yet what this means? > > Thanks!! > > Kenneth > > On 29/10/2021 22:21, Alexander Y. Fomichev wrote: > > Hello. > > After upgrading to 'pacific' I found log spammed by messages like > this: > > ... active+clean] scrubber pg(46.7aas0) handle_scrub_reserve_grant: > > received unsolicited reservation grant from osd 138(1) > (0x560e77c51600) > > > > If I understand it correctly this is exactly what it looks, and this > is not > > good. Running with debug osd 1/5 don't help much and google bring me > > nothing and I stuck. Could anybody give a hint what's happening or > where > >to dig. > > > ___ > ceph-users mailing list -- ceph-users@ceph.io > To unsubscribe send an email to ceph-users-le...@ceph.io > > > ___ > > ceph-users mailing list -- ceph-users@ceph.io > > To unsubscribe send an email to ceph-users-le...@ceph.io > > ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email
[ceph-users] Re: bunch of " received unsolicited reservation grant from osd" messages in log
OK, and when it will be backported to Pacific? On 6/27/22 18:59, Neha Ojha wrote: This issue should be addressed by https://github.com/ceph/ceph/pull/46860. Thanks, Neha On Fri, Jun 24, 2022 at 2:53 AM Kenneth Waegeman wrote: Hi, I’ve updated the cluster to 17.2.0, but the log is still filled with these entries: 2022-06-24T11:45:12.408944+02:00 osd031 ceph-osd[22024]: osd.508 pg_epoch: 685367 pg[5.166s0( v 685201'4130317 (680710'4123328,685201'4130317] local-lis/les=683269/683270 n=375262 ec=1104/1104 lis/c=683269/683269 les/c/f=683270/683270/19430 sis=683269) [508,181,357,22,592,228,250,383,28,213,586]p508(0) r=0 lpr=683269 crt=685201'4130317 lcod 685201'4130316 mlcod 685201'4130316 active+clean TIME_FOR_DEEP ps=[591~1,5a3~1,5a5~1,5a7~1,5a9~1,5ab~1,5ad~1,5af~1,5b1~2,5bb~1,5c5~14,5ed~c,5fd~1f]] scrubber : handle_scrub_reserve_grant: received unsolicited reservation grant from osd 357(2) (0x55e16d92f600) 2022-06-24T11:45:12.412196+02:00 osd031 ceph-osd[22024]: osd.508 pg_epoch: 685367 pg[5.166s0( v 685201'4130317 (680710'4123328,685201'4130317] local-lis/les=683269/683270 n=375262 ec=1104/1104 lis/c=683269/683269 les/c/f=683270/683270/19430 sis=683269) [508,181,357,22,592,228,250,383,28,213,586]p508(0) r=0 lpr=683269 crt=685201'4130317 lcod 685201'4130316 mlcod 685201'4130316 active+clean TIME_FOR_DEEP ps=[591~1,5a3~1,5a5~1,5a7~1,5a9~1,5ab~1,5ad~1,5af~1,5b1~2,5bb~1,5c5~14,5ed~c,5fd~1f]] scrubber : handle_scrub_reserve_grant: received unsolicited reservation grant from osd 586(10) (0x55e1b57354a0) 2022-06-24T11:45:12.417867+02:00 osd031 ceph-osd[21674]: osd.560 pg_epoch: 685367 pg[5.6e2s0( v 685198'4133308 (680724'4126463,685198'4133308] local-lis/les=675991/675992 n=375710 ec=1104/1104 lis/c=675991/675991 les/c/f=675992/675992/19430 sis=675991) [560,259,440,156,324,358,338,218,191,335,256]p560(0) r=0 lpr=675991 crt=685198'4133308 lcod 685198'4133307 mlcod 685198'4133307 active+clean TIME_FOR_DEEP ps=[591~1,5a3~1,5a5~1,5a7~1,5a9~1,5ab~1,5ad~1,5af~1,5b1~2,5bb~1,5c5~14,5ed~c,5fd~1f]] scrubber : handle_scrub_reserve_grant: received unsolicited reservation grant from osd 259(1) (0x559a5f371080) 2022-06-24T11:45:12.453294+02:00 osd031 ceph-osd[22024]: osd.508 pg_epoch: 685367 pg[5.166s0( v 685201'4130317 (680710'4123328,685201'4130317] local-lis/les=683269/683270 n=375262 ec=1104/1104 lis/c=683269/683269 les/c/f=683270/683270/19430 sis=683269) [508,181,357,22,592,228,250,383,28,213,586]p508(0) r=0 lpr=683269 crt=685201'4130317 lcod 685201'4130316 mlcod 685201'4130316 active+clean TIME_FOR_DEEP ps=[591~1,5a3~1,5a5~1,5a7~1,5a9~1,5ab~1,5ad~1,5af~1,5b1~2,5bb~1,5c5~14,5ed~c,5fd~1f]] scrubber : handle_scrub_reserve_grant: received unsolicited reservation grant from osd 213(9) (0x55e1a9e922c0) Is the bug still there, or is this something else? Thanks!! Kenneth On 19 Dec 2021, at 11:05, Ronen Friedman wrote: On Sat, Dec 18, 2021 at 7:06 PM Ronen Friedman wrote: Hi all, This was indeed a bug, which I've already fixed in 'master'. I'll look for the backporting status tomorrow. Ronen The fix is part of a larger change (which fixes a more severe issue). Pending (non-trivial) backport. I'll try to speed this up. Ronen On Fri, Dec 17, 2021 at 1:49 PM Kenneth Waegeman wrote: Hi all, I'm also seeing these messages spamming the logs after update from octopus to pacific 16.2.7. Any clue yet what this means? Thanks!! Kenneth On 29/10/2021 22:21, Alexander Y. Fomichev wrote: Hello. After upgrading to 'pacific' I found log spammed by messages like this: ... active+clean] scrubber pg(46.7aas0) handle_scrub_reserve_grant: received unsolicited reservation grant from osd 138(1) (0x560e77c51600) If I understand it correctly this is exactly what it looks, and this is not good. Running with debug osd 1/5 don't help much and google bring me nothing and I stuck. Could anybody give a hint what's happening or where to dig. ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: bunch of " received unsolicited reservation grant from osd" messages in log
This issue should be addressed by https://github.com/ceph/ceph/pull/46860. Thanks, Neha On Fri, Jun 24, 2022 at 2:53 AM Kenneth Waegeman wrote: > > Hi, > > I’ve updated the cluster to 17.2.0, but the log is still filled with these > entries: > > 2022-06-24T11:45:12.408944+02:00 osd031 ceph-osd[22024]: osd.508 pg_epoch: > 685367 pg[5.166s0( v 685201'4130317 (680710'4123328,685201'4130317] > local-lis/les=683269/683270 n=375262 ec=1104/1104 lis/c=683269/683269 > les/c/f=683270/683270/19430 sis=683269) > [508,181,357,22,592,228,250,383,28,213,586]p508(0) r=0 lpr=683269 > crt=685201'4130317 lcod 685201'4130316 mlcod 685201'4130316 active+clean > TIME_FOR_DEEP > ps=[591~1,5a3~1,5a5~1,5a7~1,5a9~1,5ab~1,5ad~1,5af~1,5b1~2,5bb~1,5c5~14,5ed~c,5fd~1f]] > scrubber : handle_scrub_reserve_grant: received unsolicited > reservation grant from osd 357(2) (0x55e16d92f600) > 2022-06-24T11:45:12.412196+02:00 osd031 ceph-osd[22024]: osd.508 pg_epoch: > 685367 pg[5.166s0( v 685201'4130317 (680710'4123328,685201'4130317] > local-lis/les=683269/683270 n=375262 ec=1104/1104 lis/c=683269/683269 > les/c/f=683270/683270/19430 sis=683269) > [508,181,357,22,592,228,250,383,28,213,586]p508(0) r=0 lpr=683269 > crt=685201'4130317 lcod 685201'4130316 mlcod 685201'4130316 active+clean > TIME_FOR_DEEP > ps=[591~1,5a3~1,5a5~1,5a7~1,5a9~1,5ab~1,5ad~1,5af~1,5b1~2,5bb~1,5c5~14,5ed~c,5fd~1f]] > scrubber : handle_scrub_reserve_grant: received unsolicited > reservation grant from osd 586(10) (0x55e1b57354a0) > 2022-06-24T11:45:12.417867+02:00 osd031 ceph-osd[21674]: osd.560 pg_epoch: > 685367 pg[5.6e2s0( v 685198'4133308 (680724'4126463,685198'4133308] > local-lis/les=675991/675992 n=375710 ec=1104/1104 lis/c=675991/675991 > les/c/f=675992/675992/19430 sis=675991) > [560,259,440,156,324,358,338,218,191,335,256]p560(0) r=0 lpr=675991 > crt=685198'4133308 lcod 685198'4133307 mlcod 685198'4133307 active+clean > TIME_FOR_DEEP > ps=[591~1,5a3~1,5a5~1,5a7~1,5a9~1,5ab~1,5ad~1,5af~1,5b1~2,5bb~1,5c5~14,5ed~c,5fd~1f]] > scrubber : handle_scrub_reserve_grant: received unsolicited > reservation grant from osd 259(1) (0x559a5f371080) > 2022-06-24T11:45:12.453294+02:00 osd031 ceph-osd[22024]: osd.508 pg_epoch: > 685367 pg[5.166s0( v 685201'4130317 (680710'4123328,685201'4130317] > local-lis/les=683269/683270 n=375262 ec=1104/1104 lis/c=683269/683269 > les/c/f=683270/683270/19430 sis=683269) > [508,181,357,22,592,228,250,383,28,213,586]p508(0) r=0 lpr=683269 > crt=685201'4130317 lcod 685201'4130316 mlcod 685201'4130316 active+clean > TIME_FOR_DEEP > ps=[591~1,5a3~1,5a5~1,5a7~1,5a9~1,5ab~1,5ad~1,5af~1,5b1~2,5bb~1,5c5~14,5ed~c,5fd~1f]] > scrubber : handle_scrub_reserve_grant: received unsolicited > reservation grant from osd 213(9) (0x55e1a9e922c0) > > Is the bug still there, or is this something else? > > Thanks!! > > Kenneth > > > > On 19 Dec 2021, at 11:05, Ronen Friedman wrote: > > > > On Sat, Dec 18, 2021 at 7:06 PM Ronen Friedman wrote: >> >> Hi all, >> >> This was indeed a bug, which I've already fixed in 'master'. >> I'll look for the backporting status tomorrow. >> >> Ronen >> > > The fix is part of a larger change (which fixes a more severe issue). Pending > (non-trivial) backport. > I'll try to speed this up. > > Ronen > > > > >> >> On Fri, Dec 17, 2021 at 1:49 PM Kenneth Waegeman >> wrote: >>> >>> Hi all, >>> >>> I'm also seeing these messages spamming the logs after update from >>> octopus to pacific 16.2.7. >>> >>> Any clue yet what this means? >>> >>> Thanks!! >>> >>> Kenneth >>> >>> On 29/10/2021 22:21, Alexander Y. Fomichev wrote: >>> > Hello. >>> > After upgrading to 'pacific' I found log spammed by messages like this: >>> > ... active+clean] scrubber pg(46.7aas0) handle_scrub_reserve_grant: >>> > received unsolicited reservation grant from osd 138(1) (0x560e77c51600) >>> > >>> > If I understand it correctly this is exactly what it looks, and this is >>> > not >>> > good. Running with debug osd 1/5 don't help much and google bring me >>> > nothing and I stuck. Could anybody give a hint what's happening or where >>> > to dig. >>> > >>> ___ >>> ceph-users mailing list -- ceph-users@ceph.io >>> To unsubscribe send an email to ceph-users-le...@ceph.io >>> > ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: bunch of " received unsolicited reservation grant from osd" messages in log
Hi is it still not backportet to latest 16.2.8? I don't see it in release notes. On 12/19/21 11:05, Ronen Friedman wrote: On Sat, Dec 18, 2021 at 7:06 PM Ronen Friedman wrote: Hi all, This was indeed a bug, which I've already fixed in 'master'. I'll look for the backporting status tomorrow. Ronen The fix is part of a larger change (which fixes a more severe issue). Pending (non-trivial) backport. I'll try to speed this up. Ronen On Fri, Dec 17, 2021 at 1:49 PM Kenneth Waegeman < kenneth.waege...@ugent.be> wrote: Hi all, I'm also seeing these messages spamming the logs after update from octopus to pacific 16.2.7. Any clue yet what this means? Thanks!! Kenneth On 29/10/2021 22:21, Alexander Y. Fomichev wrote: Hello. After upgrading to 'pacific' I found log spammed by messages like this: ... active+clean] scrubber pg(46.7aas0) handle_scrub_reserve_grant: received unsolicited reservation grant from osd 138(1) (0x560e77c51600) If I understand it correctly this is exactly what it looks, and this is not good. Running with debug osd 1/5 don't help much and google bring me nothing and I stuck. Could anybody give a hint what's happening or where to dig. ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: bunch of " received unsolicited reservation grant from osd" messages in log
On Sat, Dec 18, 2021 at 7:06 PM Ronen Friedman wrote: > Hi all, > > This was indeed a bug, which I've already fixed in 'master'. > I'll look for the backporting status tomorrow. > > Ronen > > The fix is part of a larger change (which fixes a more severe issue). Pending (non-trivial) backport. I'll try to speed this up. Ronen > On Fri, Dec 17, 2021 at 1:49 PM Kenneth Waegeman < > kenneth.waege...@ugent.be> wrote: > >> Hi all, >> >> I'm also seeing these messages spamming the logs after update from >> octopus to pacific 16.2.7. >> >> Any clue yet what this means? >> >> Thanks!! >> >> Kenneth >> >> On 29/10/2021 22:21, Alexander Y. Fomichev wrote: >> > Hello. >> > After upgrading to 'pacific' I found log spammed by messages like this: >> > ... active+clean] scrubber pg(46.7aas0) handle_scrub_reserve_grant: >> > received unsolicited reservation grant from osd 138(1) (0x560e77c51600) >> > >> > If I understand it correctly this is exactly what it looks, and this is >> not >> > good. Running with debug osd 1/5 don't help much and google bring me >> > nothing and I stuck. Could anybody give a hint what's happening or where >> > to dig. >> > >> ___ >> ceph-users mailing list -- ceph-users@ceph.io >> To unsubscribe send an email to ceph-users-le...@ceph.io >> >> ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: bunch of " received unsolicited reservation grant from osd" messages in log
Hi all, This was indeed a bug, which I've already fixed in 'master'. I'll look for the backporting status tomorrow. Ronen On Fri, Dec 17, 2021 at 1:49 PM Kenneth Waegeman wrote: > Hi all, > > I'm also seeing these messages spamming the logs after update from > octopus to pacific 16.2.7. > > Any clue yet what this means? > > Thanks!! > > Kenneth > > On 29/10/2021 22:21, Alexander Y. Fomichev wrote: > > Hello. > > After upgrading to 'pacific' I found log spammed by messages like this: > > ... active+clean] scrubber pg(46.7aas0) handle_scrub_reserve_grant: > > received unsolicited reservation grant from osd 138(1) (0x560e77c51600) > > > > If I understand it correctly this is exactly what it looks, and this is > not > > good. Running with debug osd 1/5 don't help much and google bring me > > nothing and I stuck. Could anybody give a hint what's happening or where > > to dig. > > > ___ > ceph-users mailing list -- ceph-users@ceph.io > To unsubscribe send an email to ceph-users-le...@ceph.io > > ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: bunch of " received unsolicited reservation grant from osd" messages in log
Hi all, I'm also seeing these messages spamming the logs after update from octopus to pacific 16.2.7. Any clue yet what this means? Thanks!! Kenneth On 29/10/2021 22:21, Alexander Y. Fomichev wrote: Hello. After upgrading to 'pacific' I found log spammed by messages like this: ... active+clean] scrubber pg(46.7aas0) handle_scrub_reserve_grant: received unsolicited reservation grant from osd 138(1) (0x560e77c51600) If I understand it correctly this is exactly what it looks, and this is not good. Running with debug osd 1/5 don't help much and google bring me nothing and I stuck. Could anybody give a hint what's happening or where to dig. ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
