Stephane, The monitoring section of operations explains what's happening, but I think I probably need to do a better job of explaining unfound objects. http://ceph.com/docs/master/rados/operations/monitoring-osd-pg/ http://ceph.com/docs/master/rados/operations/troubleshooting-osd/#unfound-objects
Let me know if those docs help, and let me know how I can improve on those for you. That's an area that's not covered quite as well as it needs to be. On Thu, Apr 18, 2013 at 8:26 AM, Stephane Boisvert < stephane.boisv...@gameloft.com> wrote: > Hi, > > I configured a test 'cluster' and did play with it (moving osd folders > around ie. journal file) and did break something. Now I think that this can > occurs again when we go prod. so I would like to know how I can fix it.. I > don't care about loosing my files.. > > Anyone can help? here's the logs > > > HEALTH_WARN 15 pgs degraded; 1 pgs recovering; 15 pgs stale; 15 pgs stuck > stale; 16 pgs stuck unclean; recovery 3/180 degraded (1.667%); 1/60 unfound > (1.667%) > pg 5.63 is stuck unclean for 157741.457285, current state > stale+active+degraded, last acting [2] > pg 4.66 is stuck unclean for 77312.285409, current state > stale+active+degraded, last acting [2] > pg 4.64 is stuck unclean for 157741.034570, current state > stale+active+degraded, last acting [2] > pg 5.65 is stuck unclean for 77312.285382, current state > stale+active+degraded, last acting [2] > pg 4.49 is stuck unclean for 77312.285021, current state > stale+active+degraded, last acting [2] > pg 5.48 is stuck unclean for 77312.285058, current state > stale+active+degraded, last acting [2] > pg 1.26 is stuck unclean for 77362.971821, current state > active+recovering, last acting [5,2,1] > pg 2.10 is stuck unclean for 157740.553908, current state > stale+active+degraded, last acting [2] > pg 4.e is stuck unclean for 157740.355222, current state > stale+active+degraded, last acting [2] > pg 5.d is stuck unclean for 157740.354260, current state > stale+active+degraded, last acting [2] > pg 5.0 is stuck unclean for 77312.264545, current state > stale+active+degraded, last acting [2] > pg 4.1 is stuck unclean for 77312.264416, current state > stale+active+degraded, last acting [2] > pg 3.2 is stuck unclean for 77312.263108, current state > stale+active+degraded, last acting [2] > pg 2.3 is stuck unclean for 77312.263026, current state > stale+active+degraded, last acting [2] > pg 4.71 is stuck unclean for 157740.352440, current state > stale+active+degraded, last acting [2] > pg 5.70 is stuck unclean for 157740.352547, current state > stale+active+degraded, last acting [2] > pg 5.63 is stuck stale for 77085.263183, current state > stale+active+degraded, last acting [2] > pg 4.66 is stuck stale for 77085.263186, current state > stale+active+degraded, last acting [2] > pg 4.64 is stuck stale for 77085.263187, current state > stale+active+degraded, last acting [2] > pg 5.65 is stuck stale for 77085.263191, current state > stale+active+degraded, last acting [2] > pg 4.49 is stuck stale for 77085.263186, current state > stale+active+degraded, last acting [2] > pg 5.48 is stuck stale for 77085.263191, current state > stale+active+degraded, last acting [2] > pg 2.10 is stuck stale for 77085.263258, current state > stale+active+degraded, last acting [2] > pg 4.e is stuck stale for 77085.263247, current state > stale+active+degraded, last acting [2] > pg 5.d is stuck stale for 77085.263245, current state > stale+active+degraded, last acting [2] > pg 5.0 is stuck stale for 77085.263241, current state > stale+active+degraded, last acting [2] > pg 4.1 is stuck stale for 77085.263245, current state > stale+active+degraded, last acting [2] > pg 3.2 is stuck stale for 77085.263242, current state > stale+active+degraded, last acting [2] > pg 2.3 is stuck stale for 77085.263247, current state > stale+active+degraded, last acting [2] > pg 4.71 is stuck stale for 77085.263239, current state > stale+active+degraded, last acting [2] > pg 5.70 is stuck stale for 77085.263245, current state > stale+active+degraded, last acting [2] > pg 1.26 is active+recovering, acting [5,2,1], 1 unfound > recovery 3/180 degraded (1.667%); 1/60 unfound (1.667%) > > > > Thanks > > > -- > > > > > > > > > _______________________________________________ > ceph-users mailing list > ceph-users@lists.ceph.com > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > > -- John Wilkins Senior Technical Writer Intank john.wilk...@inktank.com (415) 425-9599 http://inktank.com
_______________________________________________ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
