> On Feb 4, 2016, at 17:00, Michael Metz-Martini | SpeedPartner GmbH > <m...@speedpartner.de> wrote: > > Hi, > > Am 04.02.2016 um 09:43 schrieb Yan, Zheng: >> On Thu, Feb 4, 2016 at 4:36 PM, Michael Metz-Martini | SpeedPartner >> GmbH <m...@speedpartner.de> wrote: >>> Am 03.02.2016 um 15:55 schrieb Yan, Zheng: >>>>> On Feb 3, 2016, at 21:50, Michael Metz-Martini | SpeedPartner GmbH >>>>> <m...@speedpartner.de> wrote: >>>>> Am 03.02.2016 um 12:11 schrieb Yan, Zheng: >>>>>>> On Feb 3, 2016, at 17:39, Michael Metz-Martini | SpeedPartner GmbH >>>>>>> <m...@speedpartner.de> wrote: >>>>>>> Am 03.02.2016 um 10:26 schrieb Gregory Farnum: >>>>>>>> On Tue, Feb 2, 2016 at 10:09 PM, Michael Metz-Martini | SpeedPartner >>>>> 2016-02-03 14:42:25.581840 7fadfd280700 0 log_channel(default) log >>>>> [WRN] : 7 slow requests, 6 included below; oldest blocked for > >>>>> 62.125785 secs >>>>> 2016-02-03 14:42:25.581849 7fadfd280700 0 log_channel(default) log >>>>> [WRN] : slow request 62.125785 seconds old, received at 2016-02-03 >>>>> 14:41:23.455812: client_request(client.10199855:1313157 getattr >>>>> pAsLsXsFs #100815bd349 2016-02-03 14:41:23.452386) currently failed to >>>>> rdlock, waiting >>>> >>>> This seems like dirty page writeback is too slow. Is there any hung OSD >>>> request in /sys/kernel/debug/ceph/xxx/osdc? >>> Where should I check? Client or mds? Do I have to enable something to >>> get this details? Directory /sys/kernel/debug/ceph/ seems to be missing. >> On client with kernel ceph mount. If there is no debugfs, mount >> debugfs first (mount -t debugfs /sys/kernel/debug /sys/kernel/debug) > Got it. http://www.michael-metz.de/osdc.txt.gz (about 500kb uncompressed)
That’s quite a lot requests. Could you pick some requests in osdc, and check how long do these requests last. > > By looking around I found caps .. $ cat caps > total 305975 > avail 2 > used 305973 > reserved 0 > min 1024 > > Somehow related? avail=2 is low ;-) This is not problem. > > -- > Kind regards > Michael Metz-Martini _______________________________________________ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
