[ceph-users] Re: Best practices for OSD on bcache

2021-03-04 Thread Alexander E. Patrakov
вт, 2 мар. 2021 г. в 13:52, James Page : (Disclaimer: I have never tried to run Ceph on bcache in production, and the test cluster was destroyed before reaching its first deep scrub) > b) turn off the sequential cutoff > > sequential_cutoff = 0 > > This means that sequential writes will also

[ceph-users] Re: Best practices for OSD on bcache

2021-03-03 Thread James Page
Hi Norman On Wed, Mar 3, 2021 at 2:47 AM Norman.Kern wrote: > James, > > Can you tell me what's the hardware config of your bcache? I use the 400G > SATA SSD as cache device and > > 10T HDD as the storage device. Hardware relationed? > It might be - all of the deployments I've seen/worked

[ceph-users] Re: Best practices for OSD on bcache

2021-03-02 Thread Norman.Kern
James, Can you tell me what's the hardware config of your bcache? I use the 400G SATA SSD as cache device and 10T HDD as the storage device.  Hardware relationed? On 2021/3/2 下午4:49, James Page wrote: > Hi Norman > > On Mon, Mar 1, 2021 at 4:38 AM Norman.Kern wrote: > >> Hi, guys >> >> I am

[ceph-users] Re: Best practices for OSD on bcache

2021-03-02 Thread Matthias Ferdinand
On Tue, Mar 02, 2021 at 05:47:29PM +0800, Norman.Kern wrote: > Matthias,  > > I agreed with you for tuning. I  ask this question just for that my OSDs have > problems when the > > cache_available_percent less than 30, the SSDs almost useless and all I/Os > bypass to HDDs with large latency.

[ceph-users] Re: Best practices for OSD on bcache

2021-03-02 Thread Andreas John
Hello, we clearly understood that. But in ceph we have the concept of "OSD Journal on very fast different disk". I just asked what in theory should be the advantage of caching on bcache/NVME vs. Journal/NVME. I would not expect any performance advantage for bcache (if the Journal is reasonably

[ceph-users] Re: Best practices for OSD on bcache

2021-03-02 Thread Norman.Kern
On 2021/3/2 下午4:49, James Page wrote: > Hi Norman > > On Mon, Mar 1, 2021 at 4:38 AM Norman.Kern wrote: > >> Hi, guys >> >> I am testing ceph on bcache devices, I found the performance is not good >> as expected. Does anyone have any best practices for it? Thanks. >> > I've used bcache quite a

[ceph-users] Re: Best practices for OSD on bcache

2021-03-02 Thread Norman.Kern
On 2021/3/2 上午5:09, Andreas John wrote: > Hallo, > > do you expect that to be better (faster), than having the OSD's Journal > on a different disk (ssd, nvme) ? No, I created the OSD storage devices using bcache devices. > > > rgds, > > derjohn > > > On 01.03.21 05:37, Norman.Kern wrote: >> Hi,

[ceph-users] Re: Best practices for OSD on bcache

2021-03-02 Thread Norman.Kern
On 2021/3/1 下午6:32, Matthias Ferdinand wrote: > On Mon, Mar 01, 2021 at 12:37:38PM +0800, Norman.Kern wrote: >> Hi, guys >> >> I am testing ceph on bcache devices,  I found the performance is not >> good as expected. Does anyone have any best practices for it?  Thanks. > Hi, > > sorry to say, but

[ceph-users] Re: Best practices for OSD on bcache

2021-03-02 Thread James Page
Hi Norman On Mon, Mar 1, 2021 at 4:38 AM Norman.Kern wrote: > Hi, guys > > I am testing ceph on bcache devices, I found the performance is not good > as expected. Does anyone have any best practices for it? Thanks. > I've used bcache quite a bit with Ceph with the following configuration

[ceph-users] Re: Best practices for OSD on bcache

2021-03-01 Thread Matthias Ferdinand
On Mon, Mar 01, 2021 at 12:37:38PM +0800, Norman.Kern wrote: > Hi, guys > > I am testing ceph on bcache devices,  I found the performance is not > good as expected. Does anyone have any best practices for it?  Thanks. Hi, sorry to say, but since use cases and workloads differ so much, there is