Re: [ceph-users] How to observed civetweb. (Kobi Laredo)

2015-10-04 Thread Po Chu
Hi, Kobi, >> We are currently testing tuning civetweb's num_threads >> and request_timeout_ms to improve radosgw performance I wonder how's your testing of radosgw perofrmance going? We hit some limitation of single radosgw instance, about ~300MB/s. I'm just thinking how num_threads & request_tim

Re: [ceph-users] Potential OSD deadlock?

2015-10-04 Thread Robert LeBlanc
-BEGIN PGP SIGNED MESSAGE- Hash: SHA256 I have eight nodes running the fio job rbd_test_real to different RBD volumes. I've included the CRUSH map in the tarball. I stopped one OSD process and marked it out. I let it recover for a few minutes and then I started the process again and marke

Re: [ceph-users] Potential OSD deadlock?

2015-10-04 Thread Josef Johansson
I would start with defrag the drives, the good part is that you can just run the defrag with the time parameter and it will take all available xfs drives. On 4 Oct 2015 6:13 pm, "Robert LeBlanc" wrote: > -BEGIN PGP SIGNED MESSAGE- > Hash: SHA256 > > These are Toshiba MG03ACA400 drives. >

Re: [ceph-users] Potential OSD deadlock?

2015-10-04 Thread Robert LeBlanc
-BEGIN PGP SIGNED MESSAGE- Hash: SHA256 These are Toshiba MG03ACA400 drives. sd{a,b} are 4TB on 00:1f.2 SATA controller: Intel Corporation C600/X79 series chipset 6-Port SATA AHCI Controller (rev 05) at 3.0 Gb sd{c,d} are 4TB on 00:1f.2 SATA controller: Intel Corporation C600/X79 series c

Re: [ceph-users] Potential OSD deadlock?

2015-10-04 Thread Alex Gorbachev
We had multiple issues with 4TB drives and delays. Here is the configuration that works for us fairly well on Ubuntu (but we are about to significantly increase the IO load so this may change). NTP: always use NTP and make sure it is working - Ceph is very sensitive to time being precise /etc/de

Re: [ceph-users] A tiny quesion about the object id

2015-10-04 Thread niejun...@hotmail.com
HI, Wheat Thanks for your reply! I do not have any special purposes for getting the object id. Each object comprises metadata、data and object id. I think for the "object1", the object id is also same with the metadata, all i want is to get it. By the way, i think the "object1" is just an objec

Re: [ceph-users] A tiny quesion about the object id

2015-10-04 Thread Haomai Wang
On Sun, Oct 4, 2015 at 6:06 PM, niejunwei wrote: > HI, All: > > I am new and this is my first time to write an email here, i am very > appreciate that i can get your help. > > I create 3 virtual machines on my personal computer and build a simple test > ceph storage platform based on these 3 VMs.

Re: [ceph-users] Potential OSD deadlock?

2015-10-04 Thread Sage Weil
On Sat, 3 Oct 2015, Robert LeBlanc wrote: > -BEGIN PGP SIGNED MESSAGE- > Hash: SHA256 > > We are still struggling with this and have tried a lot of different > things. Unfortunately, Inktank (now Red Hat) no longer provides > consulting services for non-Red Hat systems. If there are some >

[ceph-users] A tiny quesion about the object id

2015-10-04 Thread niejunwei
HI, All: I am new and this is my first time to write an email here, i am very appreciate that i can get your help. I create 3 virtual machines on my personal computer and build a simple test ceph storage platform based on these 3 VMs. The host names are ceph-14(the leader node)、ceph-15 and ceph