Re: [ceph-users] OSD up takes 15 minutes after machine restarts

2020-01-20 Thread Igor Fedotov
? huxia...@horebdata.cn *From:* Igor Fedotov <mailto:ifedo...@suse.de> *Date:* 2020-01-19 11:41 *To:* huxia...@horebdata.cn <mailto:huxia...@horebdata.cn>; ceph-users <mailto:ceph-users@lists.ceph.com> *Subject:* Re: [ceph-u

Re: [ceph-users] OSD up takes 15 minutes after machine restarts

2020-01-19 Thread huxia...@horebdata.cn
HI, Igor, does this could cause the problem? huxia...@horebdata.cn From: Igor Fedotov Date: 2020-01-19 11:41 To: huxia...@horebdata.cn; ceph-users Subject: Re: [ceph-users] OSD up takes 15 minutes after machine restarts Hi Samuel, wondering if you have bluestore_fsck_on_mount option set to

Re: [ceph-users] OSD up takes 15 minutes after machine restarts

2020-01-19 Thread Igor Fedotov
Hi Samuel, wondering if you have bluestore_fsck_on_mount option set to true? Can you see high read load over OSD device(s) during the startup? If so it might be fsck running which takes that long. Thanks, Igor On 1/19/2020 11:53 AM, huxia...@horebdata.cn wrote: Dear folks, I had a stra

[ceph-users] OSD up takes 15 minutes after machine restarts

2020-01-19 Thread huxia...@horebdata.cn
Dear folks, I had a strange situation with 3-node Ceph cluster on Luminous 12.2.12 with bluestore. Each machine has 5 OSDs on HDD, and each OSD uses a 30GB DB/WAL partition on SSD. At the beginning without much data, OSDs can quickly up if one node restarts. Then I ran 4-day long stress tests