Re: [ceph-users] PGs stuck peering (looping?) after upgrade to Luminous.

2018-11-13 Thread Mark Schouten
luminous'? Mark - Original Message -  From: Magnus Grönlund (mag...@gronlund.se) Date: 12-07-2018 15:26 To: David Majchrzak (da...@oderland.se) Cc: Ceph Users (ceph-users@lists.ceph.com) Subject: Re: [ceph-users] PGs stuck peering (looping?) after upgrade to Luminous.   Hej David and thanks

Re: [ceph-users] PGs stuck peering (looping?) after upgrade to Luminous.

2018-07-12 Thread Magnus Grönlund
Hej David and thanks! That was indeed the magic trick, no more peering, stale or down PGs. Upgraded the ceph-packages on the hosts, restarted the OSDs and then "ceph osd require-osd-release luminous" /Magnus 2018-07-12 12:05 GMT+02:00 David Majchrzak : > Hi/Hej Magnus, > > We had a similar

Re: [ceph-users] PGs stuck peering (looping?) after upgrade to Luminous.

2018-07-12 Thread David Majchrzak
Hi/Hej Magnus, We had a similar issue going from latest hammer to jewel (so might not be applicable for you), with PGs stuck peering / data misplaced, right after updating all mons to latest jewel at that time 10.2.10. Finally setting the require_jewel_osds put everything back in place ( we

Re: [ceph-users] PGs stuck peering (looping?) after upgrade to Luminous.

2018-07-12 Thread Magnus Grönlund
Hi list, Things went from bad to worse, tried to upgrade some OSDs to Luminous to see if that could help but that didn’t appear to make any difference. But for each restarted OSD there was a few PGs that the OSD seemed to “forget” and the number of undersized PGs grew until some PGs had been

Re: [ceph-users] PGs stuck peering (looping?) after upgrade to Luminous.

2018-07-11 Thread Magnus Grönlund
Hi Kevin, Unfortunately restarting OSD don't appear to help, instead it seems to make it worse with PGs getting stuck degraded. Best regards /Magnus 2018-07-11 20:46 GMT+02:00 Kevin Olbrich : > Sounds a little bit like the problem I had on OSDs: > > [ceph-users] Blocked requests

Re: [ceph-users] PGs stuck peering (looping?) after upgrade to Luminous.

2018-07-11 Thread Magnus Grönlund
Hi Paul, No all OSDs are still jewel , the issue started before I had even started to upgrade the first OSD and they don't appear to be flapping. ceph -w shows a lot of slow request etc, but nothing unexpected as far as I can tell considering the state the cluster is in. 2018-07-11

Re: [ceph-users] PGs stuck peering (looping?) after upgrade to Luminous.

2018-07-11 Thread Kevin Olbrich
Sounds a little bit like the problem I had on OSDs: [ceph-users] Blocked requests activating+remapped after extending pg(p)_num *Kevin Olbrich* - [ceph-users] Blocked requests activating+remapped

Re: [ceph-users] PGs stuck peering (looping?) after upgrade to Luminous.

2018-07-11 Thread Paul Emmerich
Did you finish the upgrade of the OSDs? Are OSDs flapping? (ceph -w) Is there anything weird in the OSDs' log files? Paul 2018-07-11 20:30 GMT+02:00 Magnus Grönlund : > Hi, > > Started to upgrade a ceph-cluster from Jewel (10.2.10) to Luminous (12.2.6) > > After upgrading and restarting the