Issue solved. I deleted the problematic pool (rbd) and the problem is now gone. RBD pool is empty by the way.
On Wed, Nov 9, 2016 at 9:31 PM, Vlad Blando <vbla...@morphlabs.com> wrote: > Hi Mehmet, > > It won't let me adjust the PGs because there are "creating" tasks not done > yet. > > --- > [root@avatar0-ceph0 ~]# !157 > ceph osd pool set rbd pgp_num 300 > Error EBUSY: currently creating pgs, wait > [root@avatar0-ceph0 ~]# > --- > > > ᐧ > > Regards, > > Vladimir FS Blando > Cloud Operations Manager > www.morphlabs.com > > On Thu, Nov 3, 2016 at 2:16 PM, Mehmet <m...@elchaka.de> wrote: > >> I would try to Set pgp for your pool equal to 300 >> >> #Ceph osd pool yourpool set pgp 300 >> >> ...not sure about the command... >> >> If that did not help try to restart osd 7 and 15 >> >> Hth >> - Mehmet >> >> Am 2. November 2016 14:15:09 MEZ, schrieb Vlad Blando < >> vbla...@morphlabs.com>: >> >>> I have a 3 Cluster Giant setup with 8 OSD each, during the installation >>> I had to redo a cluster but it looks like the info is still on crush map >>> (based on my readings). How do I fix this? >>> >>> [root@avatar0-ceph1 ~]# ceph -s >>> cluster 2f0d1928-2ee5-4731-a259-64c0dc16110a >>> health HEALTH_WARN 139 pgs stuck inactive; 139 pgs stuck unclean; 2 >>> requests are blocked > 32 sec; pool rbd pg_num 300 > pgp_num 64 >>> monmap e1: 3 mons at {avatar0-ceph0=172.40.40.100:6 >>> 789/0,avatar0-ceph1=172.40.40.101:6789/0,avatar0-ceph2=172. >>> 40.40.102:6789/0}, election epoch 56, quorum 0,1,2 >>> avatar0-ceph0,avatar0-ceph1,avatar0-ceph2 >>> osdmap e557: 24 osds: 24 up, 24 in >>> pgmap v1807359: 1500 pgs, 5 pools, 358 GB data, 48728 objects >>> 737 GB used, 88630 GB / 89368 GB avail >>> 139 creating >>> 1361 active+clean >>> client io 44391 B/s wr, 19 op/s >>> [root@avatar0-ceph1 ~]# >>> >>> >>> [root@avatar0-ceph0 current]# ceph health detail >>> HEALTH_WARN 139 pgs stuck inactive; 139 pgs stuck unclean; 2 requests >>> are blocked > 32 sec; 2 osds have slow requests; pool rbd pg_num 300 > >>> pgp_num 64 >>> pg 0.f4 is stuck inactive since forever, current state creating, last >>> acting [7,9] >>> pg 0.f2 is stuck inactive since forever, current state creating, last >>> acting [16,14] >>> pg 0.ef is stuck inactive since forever, current state creating, last >>> acting [13,0] >>> pg 0.ee is stuck inactive since forever, current state creating, last >>> acting [19,0] >>> pg 0.ec is stuck inactive since forever, current state creating, last >>> acting [12,20] >>> pg 0.ea is stuck inactive since forever, current state creating, last >>> acting [11,3] >>> pg 0.e9 is stuck inactive since forever, current state creating, last >>> acting [9,21] >>> pg 0.e3 is stuck inactive since forever, current state creating, last >>> acting [3,8] >>> pg 0.e2 is stuck inactive since forever, current state creating, last >>> acting [8,5] >>> pg 0.e0 is stuck inactive since forever, current state creating, last >>> acting [7,18] >>> pg 0.dd is stuck inactive since forever, current state creating, last >>> acting [5,17] >>> pg 0.dc is stuck inactive since forever, current state creating, last >>> acting [3,13] >>> pg 0.db is stuck inactive since forever, current state creating, last >>> acting [4,10] >>> pg 0.da is stuck inactive since forever, current state creating, last >>> acting [6,18] >>> pg 0.d9 is stuck inactive since forever, current state creating, last >>> acting [23,12] >>> pg 0.d5 is stuck inactive since forever, current state creating, last >>> acting [22,11] >>> pg 0.d3 is stuck inactive since forever, current state creating, last >>> acting [3,15] >>> pg 0.d2 is stuck inactive since forever, current state creating, last >>> acting [1,9] >>> pg 0.d1 is stuck inactive since forever, current state creating, last >>> acting [0,13] >>> pg 0.ce is stuck inactive since forever, current state creating, last >>> acting [19,7] >>> pg 0.cd is stuck inactive since forever, current state creating, last >>> acting [13,3] >>> pg 0.cc is stuck inactive since forever, current state creating, last >>> acting [0,15] >>> pg 0.cb is stuck inactive since forever, current state creating, last >>> acting [17,3] >>> pg 0.ca is stuck inactive since forever, current state creating, last >>> acting [15,7] >>> pg 0.c9 is stuck inactive since forever, current state creating, last >>> acting [18,6] >>> pg 0.c8 is stuck inactive since forever, current state creating, last >>> acting [3,10] >>> pg 0.c5 is stuck inactive since forever, current state creating, last >>> acting [10,22] >>> pg 0.c4 is stuck inactive since forever, current state creating, last >>> acting [0,12] >>> pg 0.c1 is stuck inactive since forever, current state creating, last >>> acting [2,13] >>> pg 0.c0 is stuck inactive since forever, current state creating, last >>> acting [17,4] >>> pg 0.bf is stuck inactive since forever, current state creating, last >>> acting [18,12] >>> pg 0.be is stuck inactive since forever, current state creating, last >>> acting [13,21] >>> pg 0.bd is stuck inactive since forever, current state creating, last >>> acting [23,14] >>> pg 0.bb is stuck inactive since forever, current state creating, last >>> acting [23,8] >>> pg 0.ba is stuck inactive since forever, current state creating, last >>> acting [17,9] >>> pg 0.b9 is stuck inactive since forever, current state creating, last >>> acting [0,16] >>> pg 0.b7 is stuck inactive since forever, current state creating, last >>> acting [1,21] >>> pg 0.b6 is stuck inactive since forever, current state creating, last >>> acting [0,8] >>> pg 0.b4 is stuck inactive since forever, current state creating, last >>> acting [7,9] >>> pg 0.b2 is stuck inactive since forever, current state creating, last >>> acting [16,14] >>> pg 0.af is stuck inactive since forever, current state creating, last >>> acting [13,0] >>> pg 0.ae is stuck inactive since forever, current state creating, last >>> acting [19,0] >>> pg 0.ac is stuck inactive since forever, current state creating, last >>> acting [12,20] >>> pg 0.aa is stuck inactive since forever, current state creating, last >>> acting [11,3] >>> pg 0.a9 is stuck inactive since forever, current state creating, last >>> acting [9,21] >>> pg 0.a3 is stuck inactive since forever, current state creating, last >>> acting [3,8] >>> pg 0.a2 is stuck inactive since forever, current state creating, last >>> acting [8,5] >>> pg 0.a0 is stuck inactive since forever, current state creating, last >>> acting [7,18] >>> pg 0.9d is stuck inactive since forever, current state creating, last >>> acting [5,17] >>> pg 0.9c is stuck inactive since forever, current state creating, last >>> acting [3,13] >>> pg 0.9b is stuck inactive since forever, current state creating, last >>> acting [4,10] >>> pg 0.9a is stuck inactive since forever, current state creating, last >>> acting [6,18] >>> pg 0.99 is stuck inactive since forever, current state creating, last >>> acting [23,12] >>> pg 0.95 is stuck inactive since forever, current state creating, last >>> acting [22,11] >>> pg 0.93 is stuck inactive since forever, current state creating, last >>> acting [3,15] >>> pg 0.92 is stuck inactive since forever, current state creating, last >>> acting [1,9] >>> pg 0.91 is stuck inactive since forever, current state creating, last >>> acting [0,13] >>> pg 0.8e is stuck inactive since forever, current state creating, last >>> acting [19,7] >>> pg 0.8d is stuck inactive since forever, current state creating, last >>> acting [13,3] >>> pg 0.8c is stuck inactive since forever, current state creating, last >>> acting [0,15] >>> pg 0.8b is stuck inactive since forever, current state creating, last >>> acting [17,3] >>> pg 0.8a is stuck inactive since forever, current state creating, last >>> acting [15,7] >>> pg 0.89 is stuck inactive since forever, current state creating, last >>> acting [18,6] >>> pg 0.88 is stuck inactive since forever, current state creating, last >>> acting [3,10] >>> pg 0.85 is stuck inactive since forever, current state creating, last >>> acting [10,22] >>> pg 0.84 is stuck inactive since forever, current state creating, last >>> acting [0,12] >>> pg 0.81 is stuck inactive since forever, current state creating, last >>> acting [2,13] >>> pg 0.80 is stuck inactive since forever, current state creating, last >>> acting [17,4] >>> pg 0.7f is stuck inactive since forever, current state creating, last >>> acting [18,12] >>> pg 0.7e is stuck inactive since forever, current state creating, last >>> acting [13,21] >>> pg 0.7d is stuck inactive since forever, current state creating, last >>> acting [23,14] >>> pg 0.7b is stuck inactive since forever, current state creating, last >>> acting [23,8] >>> pg 0.7a is stuck inactive since forever, current state creating, last >>> acting [17,9] >>> pg 0.79 is stuck inactive since forever, current state creating, last >>> acting [0,16] >>> pg 0.77 is stuck inactive since forever, current state creating, last >>> acting [1,21] >>> pg 0.76 is stuck inactive since forever, current state creating, last >>> acting [0,8] >>> pg 0.74 is stuck inactive since forever, current state creating, last >>> acting [7,9] >>> pg 0.72 is stuck inactive since forever, current state creating, last >>> acting [16,14] >>> pg 0.6f is stuck inactive since forever, current state creating, last >>> acting [13,0] >>> pg 0.6e is stuck inactive since forever, current state creating, last >>> acting [19,0] >>> pg 0.6c is stuck inactive since forever, current state creating, last >>> acting [12,20] >>> pg 0.6a is stuck inactive since forever, current state creating, last >>> acting [11,3] >>> pg 0.69 is stuck inactive since forever, current state creating, last >>> acting [9,21] >>> pg 0.63 is stuck inactive since forever, current state creating, last >>> acting [3,8] >>> pg 0.12a is stuck inactive since forever, current state creating, last >>> acting [11,3] >>> pg 0.62 is stuck inactive since forever, current state creating, last >>> acting [8,5] >>> pg 0.129 is stuck inactive since forever, current state creating, last >>> acting [9,21] >>> pg 0.60 is stuck inactive since forever, current state creating, last >>> acting [7,18] >>> pg 0.5d is stuck inactive since forever, current state creating, last >>> acting [5,17] >>> pg 0.5c is stuck inactive since forever, current state creating, last >>> acting [3,13] >>> pg 0.123 is stuck inactive since forever, current state creating, last >>> acting [3,8] >>> pg 0.5b is stuck inactive since forever, current state creating, last >>> acting [4,10] >>> pg 0.122 is stuck inactive since forever, current state creating, last >>> acting [8,5] >>> pg 0.5a is stuck inactive since forever, current state creating, last >>> acting [6,18] >>> pg 0.59 is stuck inactive since forever, current state creating, last >>> acting [23,12] >>> pg 0.120 is stuck inactive since forever, current state creating, last >>> acting [7,18] >>> pg 0.11d is stuck inactive since forever, current state creating, last >>> acting [5,17] >>> pg 0.55 is stuck inactive since forever, current state creating, last >>> acting [22,11] >>> pg 0.11c is stuck inactive since forever, current state creating, last >>> acting [3,13] >>> pg 0.11b is stuck inactive since forever, current state creating, last >>> acting [4,10] >>> pg 0.53 is stuck inactive since forever, current state creating, last >>> acting [3,15] >>> pg 0.11a is stuck inactive since forever, current state creating, last >>> acting [6,18] >>> pg 0.52 is stuck inactive since forever, current state creating, last >>> acting [1,9] >>> pg 0.119 is stuck inactive since forever, current state creating, last >>> acting [23,12] >>> pg 0.51 is stuck inactive since forever, current state creating, last >>> acting [0,13] >>> pg 0.4e is stuck inactive since forever, current state creating, last >>> acting [19,7] >>> pg 0.115 is stuck inactive since forever, current state creating, last >>> acting [22,11] >>> pg 0.4d is stuck inactive since forever, current state creating, last >>> acting [13,3] >>> pg 0.4c is stuck inactive since forever, current state creating, last >>> acting [0,15] >>> pg 0.113 is stuck inactive since forever, current state creating, last >>> acting [3,15] >>> pg 0.4b is stuck inactive since forever, current state creating, last >>> acting [17,3] >>> pg 0.112 is stuck inactive since forever, current state creating, last >>> acting [1,9] >>> pg 0.4a is stuck inactive since forever, current state creating, last >>> acting [15,7] >>> pg 0.111 is stuck inactive since forever, current state creating, last >>> acting [0,13] >>> pg 0.49 is stuck inactive since forever, current state creating, last >>> acting [18,6] >>> pg 0.48 is stuck inactive since forever, current state creating, last >>> acting [3,10] >>> pg 0.10e is stuck inactive since forever, current state creating, last >>> acting [19,7] >>> pg 0.10d is stuck inactive since forever, current state creating, last >>> acting [13,3] >>> pg 0.45 is stuck inactive since forever, current state creating, last >>> acting [10,22] >>> pg 0.10c is stuck inactive since forever, current state creating, last >>> acting [0,15] >>> pg 0.44 is stuck inactive since forever, current state creating, last >>> acting [0,12] >>> pg 0.10b is stuck inactive since forever, current state creating, last >>> acting [17,3] >>> pg 0.10a is stuck inactive since forever, current state creating, last >>> acting [15,7] >>> pg 0.109 is stuck inactive since forever, current state creating, last >>> acting [18,6] >>> pg 0.41 is stuck inactive since forever, current state creating, last >>> acting [2,13] >>> pg 0.108 is stuck inactive since forever, current state creating, last >>> acting [3,10] >>> pg 0.40 is stuck inactive since forever, current state creating, last >>> acting [17,4] >>> pg 0.105 is stuck inactive since forever, current state creating, last >>> acting [10,22] >>> pg 0.104 is stuck inactive since forever, current state creating, last >>> acting [0,12] >>> pg 0.101 is stuck inactive since forever, current state creating, last >>> acting [2,13] >>> pg 0.100 is stuck inactive since forever, current state creating, last >>> acting [17,4] >>> pg 0.ff is stuck inactive since forever, current state creating, last >>> acting [18,12] >>> pg 0.fe is stuck inactive since forever, current state creating, last >>> acting [13,21] >>> pg 0.fd is stuck inactive since forever, current state creating, last >>> acting [23,14] >>> pg 0.fb is stuck inactive since forever, current state creating, last >>> acting [23,8] >>> pg 0.fa is stuck inactive since forever, current state creating, last >>> acting [17,9] >>> pg 0.f9 is stuck inactive since forever, current state creating, last >>> acting [0,16] >>> pg 0.f7 is stuck inactive since forever, current state creating, last >>> acting [1,21] >>> pg 0.f6 is stuck inactive since forever, current state creating, last >>> acting [0,8] >>> pg 0.f4 is stuck unclean since forever, current state creating, last >>> acting [7,9] >>> pg 0.f2 is stuck unclean since forever, current state creating, last >>> acting [16,14] >>> pg 0.ef is stuck unclean since forever, current state creating, last >>> acting [13,0] >>> pg 0.ee is stuck unclean since forever, current state creating, last >>> acting [19,0] >>> pg 0.ec is stuck unclean since forever, current state creating, last >>> acting [12,20] >>> pg 0.ea is stuck unclean since forever, current state creating, last >>> acting [11,3] >>> pg 0.e9 is stuck unclean since forever, current state creating, last >>> acting [9,21] >>> pg 0.e3 is stuck unclean since forever, current state creating, last >>> acting [3,8] >>> pg 0.e2 is stuck unclean since forever, current state creating, last >>> acting [8,5] >>> pg 0.e0 is stuck unclean since forever, current state creating, last >>> acting [7,18] >>> pg 0.dd is stuck unclean since forever, current state creating, last >>> acting [5,17] >>> pg 0.dc is stuck unclean since forever, current state creating, last >>> acting [3,13] >>> pg 0.db is stuck unclean since forever, current state creating, last >>> acting [4,10] >>> pg 0.da is stuck unclean since forever, current state creating, last >>> acting [6,18] >>> pg 0.d9 is stuck unclean since forever, current state creating, last >>> acting [23,12] >>> pg 0.d5 is stuck unclean since forever, current state creating, last >>> acting [22,11] >>> pg 0.d3 is stuck unclean since forever, current state creating, last >>> acting [3,15] >>> pg 0.d2 is stuck unclean since forever, current state creating, last >>> acting [1,9] >>> pg 0.d1 is stuck unclean since forever, current state creating, last >>> acting [0,13] >>> pg 0.ce is stuck unclean since forever, current state creating, last >>> acting [19,7] >>> pg 0.cd is stuck unclean since forever, current state creating, last >>> acting [13,3] >>> pg 0.cc is stuck unclean since forever, current state creating, last >>> acting [0,15] >>> pg 0.cb is stuck unclean since forever, current state creating, last >>> acting [17,3] >>> pg 0.ca is stuck unclean since forever, current state creating, last >>> acting [15,7] >>> pg 0.c9 is stuck unclean since forever, current state creating, last >>> acting [18,6] >>> pg 0.c8 is stuck unclean since forever, current state creating, last >>> acting [3,10] >>> pg 0.c5 is stuck unclean since forever, current state creating, last >>> acting [10,22] >>> pg 0.c4 is stuck unclean since forever, current state creating, last >>> acting [0,12] >>> pg 0.c1 is stuck unclean since forever, current state creating, last >>> acting [2,13] >>> pg 0.c0 is stuck unclean since forever, current state creating, last >>> acting [17,4] >>> pg 0.bf is stuck unclean since forever, current state creating, last >>> acting [18,12] >>> pg 0.be is stuck unclean since forever, current state creating, last >>> acting [13,21] >>> pg 0.bd is stuck unclean since forever, current state creating, last >>> acting [23,14] >>> pg 0.bb is stuck unclean since forever, current state creating, last >>> acting [23,8] >>> pg 0.ba is stuck unclean since forever, current state creating, last >>> acting [17,9] >>> pg 0.b9 is stuck unclean since forever, current state creating, last >>> acting [0,16] >>> pg 0.b7 is stuck unclean since forever, current state creating, last >>> acting [1,21] >>> pg 0.b6 is stuck unclean since forever, current state creating, last >>> acting [0,8] >>> pg 0.b4 is stuck unclean since forever, current state creating, last >>> acting [7,9] >>> pg 0.b2 is stuck unclean since forever, current state creating, last >>> acting [16,14] >>> pg 0.af is stuck unclean since forever, current state creating, last >>> acting [13,0] >>> pg 0.ae is stuck unclean since forever, current state creating, last >>> acting [19,0] >>> pg 0.ac is stuck unclean since forever, current state creating, last >>> acting [12,20] >>> pg 0.aa is stuck unclean since forever, current state creating, last >>> acting [11,3] >>> pg 0.a9 is stuck unclean since forever, current state creating, last >>> acting [9,21] >>> pg 0.a3 is stuck unclean since forever, current state creating, last >>> acting [3,8] >>> pg 0.a2 is stuck unclean since forever, current state creating, last >>> acting [8,5] >>> pg 0.a0 is stuck unclean since forever, current state creating, last >>> acting [7,18] >>> pg 0.9d is stuck unclean since forever, current state creating, last >>> acting [5,17] >>> pg 0.9c is stuck unclean since forever, current state creating, last >>> acting [3,13] >>> pg 0.9b is stuck unclean since forever, current state creating, last >>> acting [4,10] >>> pg 0.9a is stuck unclean since forever, current state creating, last >>> acting [6,18] >>> pg 0.99 is stuck unclean since forever, current state creating, last >>> acting [23,12] >>> pg 0.95 is stuck unclean since forever, current state creating, last >>> acting [22,11] >>> pg 0.93 is stuck unclean since forever, current state creating, last >>> acting [3,15] >>> pg 0.92 is stuck unclean since forever, current state creating, last >>> acting [1,9] >>> pg 0.91 is stuck unclean since forever, current state creating, last >>> acting [0,13] >>> pg 0.8e is stuck unclean since forever, current state creating, last >>> acting [19,7] >>> pg 0.8d is stuck unclean since forever, current state creating, last >>> acting [13,3] >>> pg 0.8c is stuck unclean since forever, current state creating, last >>> acting [0,15] >>> pg 0.8b is stuck unclean since forever, current state creating, last >>> acting [17,3] >>> pg 0.8a is stuck unclean since forever, current state creating, last >>> acting [15,7] >>> pg 0.89 is stuck unclean since forever, current state creating, last >>> acting [18,6] >>> pg 0.88 is stuck unclean since forever, current state creating, last >>> acting [3,10] >>> pg 0.85 is stuck unclean since forever, current state creating, last >>> acting [10,22] >>> pg 0.84 is stuck unclean since forever, current state creating, last >>> acting [0,12] >>> pg 0.81 is stuck unclean since forever, current state creating, last >>> acting [2,13] >>> pg 0.80 is stuck unclean since forever, current state creating, last >>> acting [17,4] >>> pg 0.7f is stuck unclean since forever, current state creating, last >>> acting [18,12] >>> pg 0.7e is stuck unclean since forever, current state creating, last >>> acting [13,21] >>> pg 0.7d is stuck unclean since forever, current state creating, last >>> acting [23,14] >>> pg 0.7b is stuck unclean since forever, current state creating, last >>> acting [23,8] >>> pg 0.7a is stuck unclean since forever, current state creating, last >>> acting [17,9] >>> pg 0.79 is stuck unclean since forever, current state creating, last >>> acting [0,16] >>> pg 0.77 is stuck unclean since forever, current state creating, last >>> acting [1,21] >>> pg 0.76 is stuck unclean since forever, current state creating, last >>> acting [0,8] >>> pg 0.74 is stuck unclean since forever, current state creating, last >>> acting [7,9] >>> pg 0.72 is stuck unclean since forever, current state creating, last >>> acting [16,14] >>> pg 0.6f is stuck unclean since forever, current state creating, last >>> acting [13,0] >>> pg 0.6e is stuck unclean since forever, current state creating, last >>> acting [19,0] >>> pg 0.6c is stuck unclean since forever, current state creating, last >>> acting [12,20] >>> pg 0.6a is stuck unclean since forever, current state creating, last >>> acting [11,3] >>> pg 0.69 is stuck unclean since forever, current state creating, last >>> acting [9,21] >>> pg 0.63 is stuck unclean since forever, current state creating, last >>> acting [3,8] >>> pg 0.12a is stuck unclean since forever, current state creating, last >>> acting [11,3] >>> pg 0.62 is stuck unclean since forever, current state creating, last >>> acting [8,5] >>> pg 0.129 is stuck unclean since forever, current state creating, last >>> acting [9,21] >>> pg 0.60 is stuck unclean since forever, current state creating, last >>> acting [7,18] >>> pg 0.5d is stuck unclean since forever, current state creating, last >>> acting [5,17] >>> pg 0.5c is stuck unclean since forever, current state creating, last >>> acting [3,13] >>> pg 0.123 is stuck unclean since forever, current state creating, last >>> acting [3,8] >>> pg 0.5b is stuck unclean since forever, current state creating, last >>> acting [4,10] >>> pg 0.122 is stuck unclean since forever, current state creating, last >>> acting [8,5] >>> pg 0.5a is stuck unclean since forever, current state creating, last >>> acting [6,18] >>> pg 0.59 is stuck unclean since forever, current state creating, last >>> acting [23,12] >>> pg 0.120 is stuck unclean since forever, current state creating, last >>> acting [7,18] >>> pg 0.11d is stuck unclean since forever, current state creating, last >>> acting [5,17] >>> pg 0.55 is stuck unclean since forever, current state creating, last >>> acting [22,11] >>> pg 0.11c is stuck unclean since forever, current state creating, last >>> acting [3,13] >>> pg 0.11b is stuck unclean since forever, current state creating, last >>> acting [4,10] >>> pg 0.53 is stuck unclean since forever, current state creating, last >>> acting [3,15] >>> pg 0.11a is stuck unclean since forever, current state creating, last >>> acting [6,18] >>> pg 0.52 is stuck unclean since forever, current state creating, last >>> acting [1,9] >>> pg 0.119 is stuck unclean since forever, current state creating, last >>> acting [23,12] >>> pg 0.51 is stuck unclean since forever, current state creating, last >>> acting [0,13] >>> pg 0.4e is stuck unclean since forever, current state creating, last >>> acting [19,7] >>> pg 0.115 is stuck unclean since forever, current state creating, last >>> acting [22,11] >>> pg 0.4d is stuck unclean since forever, current state creating, last >>> acting [13,3] >>> pg 0.4c is stuck unclean since forever, current state creating, last >>> acting [0,15] >>> pg 0.113 is stuck unclean since forever, current state creating, last >>> acting [3,15] >>> pg 0.4b is stuck unclean since forever, current state creating, last >>> acting [17,3] >>> pg 0.112 is stuck unclean since forever, current state creating, last >>> acting [1,9] >>> pg 0.4a is stuck unclean since forever, current state creating, last >>> acting [15,7] >>> pg 0.111 is stuck unclean since forever, current state creating, last >>> acting [0,13] >>> pg 0.49 is stuck unclean since forever, current state creating, last >>> acting [18,6] >>> pg 0.48 is stuck unclean since forever, current state creating, last >>> acting [3,10] >>> pg 0.10e is stuck unclean since forever, current state creating, last >>> acting [19,7] >>> pg 0.10d is stuck unclean since forever, current state creating, last >>> acting [13,3] >>> pg 0.45 is stuck unclean since forever, current state creating, last >>> acting [10,22] >>> pg 0.10c is stuck unclean since forever, current state creating, last >>> acting [0,15] >>> pg 0.44 is stuck unclean since forever, current state creating, last >>> acting [0,12] >>> pg 0.10b is stuck unclean since forever, current state creating, last >>> acting [17,3] >>> pg 0.10a is stuck unclean since forever, current state creating, last >>> acting [15,7] >>> pg 0.109 is stuck unclean since forever, current state creating, last >>> acting [18,6] >>> pg 0.41 is stuck unclean since forever, current state creating, last >>> acting [2,13] >>> pg 0.108 is stuck unclean since forever, current state creating, last >>> acting [3,10] >>> pg 0.40 is stuck unclean since forever, current state creating, last >>> acting [17,4] >>> pg 0.105 is stuck unclean since forever, current state creating, last >>> acting [10,22] >>> pg 0.104 is stuck unclean since forever, current state creating, last >>> acting [0,12] >>> pg 0.101 is stuck unclean since forever, current state creating, last >>> acting [2,13] >>> pg 0.100 is stuck unclean since forever, current state creating, last >>> acting [17,4] >>> pg 0.ff is stuck unclean since forever, current state creating, last >>> acting [18,12] >>> pg 0.fe is stuck unclean since forever, current state creating, last >>> acting [13,21] >>> pg 0.fd is stuck unclean since forever, current state creating, last >>> acting [23,14] >>> pg 0.fb is stuck unclean since forever, current state creating, last >>> acting [23,8] >>> pg 0.fa is stuck unclean since forever, current state creating, last >>> acting [17,9] >>> pg 0.f9 is stuck unclean since forever, current state creating, last >>> acting [0,16] >>> pg 0.f7 is stuck unclean since forever, current state creating, last >>> acting [1,21] >>> pg 0.f6 is stuck unclean since forever, current state creating, last >>> acting [0,8] >>> 2 ops are blocked > 2097.15 sec >>> 1 ops are blocked > 2097.15 sec on osd.7 >>> 1 ops are blocked > 2097.15 sec on osd.15 >>> 2 osds have slow requests >>> pool rbd pg_num 300 > pgp_num 64 >>> [root@avatar0-ceph0 current]# >>> >>> querying a pg gives me this >>> >>> [root@avatar0-ceph0 current]# ceph pg 0.f6 query >>> Error ENOENT: i don't have pgid 0.f6 >>> [root@avatar0-ceph0 current]# >>> >>> recreating the PG manually says it is already creating >>> >>> [root@avatar0-ceph0 ~]# ceph pg force_create_pg 0.f6 >>> pg 0.f6 already creating >>> [root@avatar0-ceph0 ~]# >>> >>> >>> then nothing happens. >>> >>> >>> >>> /Vlad >>> ᐧ >>> >>> ------------------------------ >>> >>> ceph-users mailing list >>> ceph-users@lists.ceph.com >>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com >>> >>> > ᐧ
_______________________________________________ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com