Re: [ceph-users] SSD journal overload?

2014-04-30 Thread Indra Pramana
Hi Irek, Good day to you. Any updates/comments on below? Looking forward to your reply, thank you. Cheers. On Tue, Apr 29, 2014 at 12:47 PM, Indra Pramana wrote: > Hi Irek, > > Good day to you, and thank you for your e-mail. > > Is there a better way other than patching the kernel? I would

Re: [ceph-users] SSD journal overload?

2014-04-28 Thread Indra Pramana
Hi Irek, Good day to you, and thank you for your e-mail. Is there a better way other than patching the kernel? I would like to avoid having to compile a custom kernel for my OS. I read that I can disable write-caching on the drive using hdparm: hdparm -W0 /dev/sdf hdparm -W0 /dev/sdg I tested o

Re: [ceph-users] SSD journal overload?

2014-04-28 Thread Irek Fasikhov
This is my article :). To patch to the kernel (http://www.theirek.com/downloads/code/CMD_FLUSH.diff ). After rebooting, run the following commands: echo temporary write through > /sys/class/scsi_disk//cache_type 2014-04-28 15:44 GMT+04:00 Indra Pramana : > Hi Irek, > > Thanks for the article. Do

Re: [ceph-users] SSD journal overload?

2014-04-28 Thread Indra Pramana
Hi Irek, Thanks for the article. Do you have any other web sources pertaining to the same issue, which is in English? Looking forward to your reply, thank you. Cheers. On Mon, Apr 28, 2014 at 7:40 PM, Irek Fasikhov wrote: > Most likely you need to apply a patch to the kernel. > > > http://ww

Re: [ceph-users] SSD journal overload?

2014-04-28 Thread Irek Fasikhov
Most likely you need to apply a patch to the kernel. http://www.theirek.com/blog/2014/02/16/patch-dlia-raboty-s-enierghoniezavisimym-keshiem-ssd-diskov 2014-04-28 15:20 GMT+04:00 Indra Pramana : > Hi Udo and Irek, > > Good day to you, and thank you for your emails. > > > >perhaps due IOs from t

Re: [ceph-users] SSD journal overload?

2014-04-28 Thread Indra Pramana
Hi Udo and Irek, Good day to you, and thank you for your emails. >perhaps due IOs from the journal? >You can test with iostat (like "iostat -dm 5 sdg"). Yes, I have shared the iostat result earlier on this same thread. At times the utilisation of the 2 journal drives will hit 100%, especially wh

Re: [ceph-users] SSD journal overload?

2014-04-28 Thread Irek Fasikhov
You what model SSD? Which version of the kernel? 2014-04-28 12:35 GMT+04:00 Udo Lembke : > Hi, > perhaps due IOs from the journal? > You can test with iostat (like "iostat -dm 5 sdg"). > > on debian iostat is in the package sysstat. > > Udo > > Am 28.04.2014 07:38, schrieb Indra Pramana: > > Hi

Re: [ceph-users] SSD journal overload?

2014-04-28 Thread Udo Lembke
Hi, perhaps due IOs from the journal? You can test with iostat (like "iostat -dm 5 sdg"). on debian iostat is in the package sysstat. Udo Am 28.04.2014 07:38, schrieb Indra Pramana: > Hi Craig, > > Good day to you, and thank you for your enquiry. > > As per your suggestion, I have created a 3r

Re: [ceph-users] SSD journal overload?

2014-04-27 Thread Indra Pramana
Hi Craig, Good day to you, and thank you for your enquiry. As per your suggestion, I have created a 3rd partition on the SSDs and did the dd test directly into the device, and the result is very slow. root@ceph-osd-08:/mnt# dd bs=1M count=128 if=/dev/zero of=/dev/sdg3 conv=fdatasync oflag=d

Re: [ceph-users] SSD journal overload?

2014-04-25 Thread Craig Lewis
I am not able to do a dd test on the SSDs since it's not mounted as filesystem, but dd on the OSD (non-SSD) drives gives normal result. Since you have free space on the SSDs, you could add a 3rd 10G partition to one of the SSDs. Then you could put a filesystem on that partition, or just dd

[ceph-users] SSD journal overload?

2014-04-25 Thread Indra Pramana
Hi, On one of our test clusters, I have a node with 4 OSDs with SAS / non-SSD drives (sdb, sdc, sdd, sde) and 2 SSD drives (sdf and sdg) for journals to serve the 4 OSDs (2 each). Model: ATA ST100FM0012 (scsi) Disk /dev/sdf: 100GB Sector size (logical/physical): 512B/4096B Partition Table: gpt N