Re: [ceph-users] The performance of ceph with RDMA

Hi Thanks your help! I will try it and let u know results after I have finished it. Thanks!! Haomai Wang 於 2017年3月24日 週五，下午6:44寫道： > OH.. you can refer to performance related threads on ceph/ceph-devel > maillist to get ssd-optimized ceph.conf. the default conf lack of good >

Re: [ceph-users] The performance of ceph with RDMA

OH.. you can refer to performance related threads on ceph/ceph-devel maillist to get ssd-optimized ceph.conf. the default conf lack of good support on ssd. On Fri, Mar 24, 2017 at 6:33 AM, Hung-Wei Chiu (邱宏瑋) wrote: > Hi. > > Basic > [global] > > fsid =

Re: [ceph-users] The performance of ceph with RDMA

Hi. Basic [global] fsid = 0612cc7e-6239-456c-978b-b4df781fe831 mon initial members = ceph-1,ceph-2,ceph-3 mon host = 10.0.0.15,10.0.0.16,10.0.0.17 osd pool default size = 2 osd pool default pg num = 1024 osd pool default pgp num = 1024 RDMA [global] fsid = 0612cc7e-6239-456c-978b-b4df781fe831

Re: [ceph-users] The performance of ceph with RDMA

the content of ceph.conf ? On Fri, Mar 24, 2017 at 4:32 AM, Hung-Wei Chiu (邱宏瑋) wrote: > Hi Deepak. > > Thansk your reply, > > I try to use gperf to profile the ceph-osd with basic mode (without RDMA) > and you can see the result in the following link. >

Re: [ceph-users] The performance of ceph with RDMA

Hi Deepak. Thansk your reply, I try to use gperf to profile the ceph-osd with basic mode (without RDMA) and you can see the result in the following link. http://imgur.com/a/SJgEL In the gperf result, we can see the whole CPU usage can divided into three significant part, (Network: 36%,

Re: [ceph-users] The performance of ceph with RDMA

> > > > > > *From:* ceph-users [mailto:ceph-users-boun...@lists.ceph.com] *On Behalf > Of *Haomai Wang > *Sent:* Thursday, March 23, 2017 4:34 AM > *To:* Hung-Wei Chiu (邱宏瑋) > *Cc:* ceph-users@lists.ceph.com > *Subject:* Re: [ceph-users] The performance of ceph with R

Re: [ceph-users] The performance of ceph with RDMA

.com Subject: Re: [ceph-users] The performance of ceph with RDMA On Thu, Mar 23, 2017 at 5:49 AM, Hung-Wei Chiu (邱宏瑋) <hwc...@cs.nctu.edu.tw<mailto:hwc...@cs.nctu.edu.tw>> wrote: Hi, I use the latest (master branch, upgrade at 2017/03/22) to build ceph with RDMA and use the fio

Re: [ceph-users] The performance of ceph with RDMA

On Thu, Mar 23, 2017 at 5:49 AM, Hung-Wei Chiu (邱宏瑋) wrote: > Hi, > > I use the latest (master branch, upgrade at 2017/03/22) to build ceph with > RDMA and use the fio to test its iops/latency/throughput. > > In my environment, I setup 3 hosts and list the detail of each

[ceph-users] The performance of ceph with RDMA

Hi, I use the latest (master branch, upgrade at 2017/03/22) to build ceph with RDMA and use the fio to test its iops/latency/throughput. In my environment, I setup 3 hosts and list the detail of each host below. OS: ubuntu 16.04 Storage: SSD * 4 (256G * 4) Memory: 64GB. NICs: two NICs, one