Re: use crushtool to simulate pg distribution for a specific pool

2015-09-22 Thread Sage Weil
Hi Zhang, On Tue, 22 Sep 2015, Z Zhang wrote: > Hi ceph-devel, > > We enhanced the crushtool to simulate real pg distribution for a > specific pool. Recently we had encountered pg uneven issue again after > expanding our cluster, although we had re-weighted the cluster to make > pg

Re: Adding Data-At-Rest compression support to Ceph

2015-09-22 Thread Sage Weil
On Tue, 22 Sep 2015, Igor Fedotov wrote: > Hi guys, > > I can find some talks about adding compression support to Ceph. Let me share > some thoughts and proposals on that too. > > First of all I?d like to consider several major implementation options > separately. IMHO this makes sense since

Adding Data-At-Rest compression support to Ceph

2015-09-22 Thread Igor Fedotov
Hi guys, I can find some talks about adding compression support to Ceph. Let me share some thoughts and proposals on that too. First of all I’d like to consider several major implementation options separately. IMHO this makes sense since they have different applicability, value and

Re: RBD mirroring CLI proposal ...

2015-09-22 Thread Jason Dillaman
> > * rbd consistency-group create > > [--object-pool ] > > [--splay-width ] > > [--object-size ] > > [--additional-journal-tweakable-settings] > > This will create an empty journal for use with consistency groups > >

Re: [ceph-users] Potential OSD deadlock?

2015-09-22 Thread Robert LeBlanc
-BEGIN PGP SIGNED MESSAGE- Hash: SHA256 OK, looping in ceph-devel to see if I can get some more eyes. I've extracted what I think are important entries from the logs for the first blocked request. NTP is running all the servers so the logs should be close in terms of time. Logs for 12:50

Re: Ceph problem

2015-09-22 Thread huang jun
you can add debug_rados or debug_ms to rbd create command to see what happened during 120s 2015-09-23 9:59 GMT+08:00 zhao.ming...@h3c.com : > > ---原始邮件--- > 发件人: "陈杰"<276648...@qq.com> > 发送时间: 2015年09月21日 17:52:19 > 收件人:

Ceph problem

2015-09-22 Thread zhao.ming...@h3c.com
---原始邮件--- 发件人: "陈杰"<276648...@qq.com> 发送时间: 2015年09月21日 17:52:19 收件人: "ceph-devel@vger.kernel.org"; 主题: Ceph problem Dear ceph-devel I'm a software engineer for H3C,We found a ceph problem in the test,the need your help. If one of the hosts in the cluster

Where does the data go ??

2015-09-22 Thread Tomy Cheru
Noticed while benchmarking newstore with rocksdb backend that, the data is missing in "dev/osd0/fragments" >64k sized objects produces content in above mentioned dir, however missing >with <=64k sized objects Corresponding drive/s shows activity, .sst files are in "dev/osd0/db" dir Is it

RE: use crushtool to simulate pg distribution for a specific pool

2015-09-22 Thread Z Zhang
Thanks, Sage. I will take a look at osdmaptool. Thanks. Zhi Zhang (David) > Date: Tue, 22 Sep 2015 11:41:24 -0700 > From: s...@newdream.net > To: zhangz.da...@outlook.com > CC: ceph-devel@vger.kernel.org > Subject: Re: use crushtool to simulate pg

Seek advice for using Ceph to provice NAS service

2015-09-22 Thread Jevon Qiao
Hi Sage and other Ceph experts, This is a greeting from Jevon, I'm from China and working in a company which are using Ceph as the backend storage. At present, I'm evaluating the following two options of using Ceph cluster to provide NAS service and I need your advice from the perspective of

Re: [ceph-users] Important security noticed regarding release signing key

2015-09-22 Thread wangsongbo
Hi Ken, Thanks for your reply. But in the ceph-cm-ansible project scheduled by teuthology, "ceph.com/packages/ceph-extras" is in used now, such as qemu-kvm-0.12.1.2-2.415.el6.3ceph, qemu-kvm-tools-0.12.1.2-2.415.el6.3ceph etc. Any new releases will be provided ? On 15/9/22 下午10:24,

Ceph problem

2015-09-22 Thread zhao.ming...@h3c.com
---原始邮件--- 发件人: "陈杰"<276648...@qq.com> 发送时间: 2015年09月21日 17:52:19 收件人: "ceph-devel@vger.kernel.org"; 主题: Ceph problem Dear ceph-devel I'm a software engineer for H3C,We found a ceph problem in the test,the need your help. If one of the hosts in the cluster

Re: [ceph-users] Important security noticed regarding release signing key

2015-09-22 Thread Ken Dreyer
Hi Songbo, It's been removed from Ansible now: https://github.com/ceph/ceph-cm-ansible/pull/137 - Ken On Tue, Sep 22, 2015 at 8:33 PM, wangsongbo wrote: > Hi Ken, > Thanks for your reply. But in the ceph-cm-ansible project scheduled by > teuthology,

Re: [ceph-users] Potential OSD deadlock?

2015-09-22 Thread Robert LeBlanc
-BEGIN PGP SIGNED MESSAGE- Hash: SHA256 This is IPoIB and we have the MTU set to 64K. There was some issues pinging hosts with "No buffer space available" (hosts are currently configured for 4GB to test SSD caching rather than page cache). I found that MTU under 32K worked reliable for

Re: [ceph-users] Potential OSD deadlock?

2015-09-22 Thread Samuel Just
I looked at the logs, it looks like there was a 53 second delay between when osd.17 started sending the osd_repop message and when osd.13 started reading it, which is pretty weird. Sage, didn't we once see a kernel issue which caused some messages to be mysteriously delayed for many 10s of

[CEPH-DEVEL] MAX_RBD_IMAGES

2015-09-22 Thread Shinobu Kinjo
Hello, Does any of you know why *MAX_RBD_IMAGES* was changed from 16 to 128? I hope that Dan remember -; http://resources.ustack.com/ceph/ceph/commit/2a6dcabf7f1b7550a0fa4fd223970ffc24ad7870 - Shinobu -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a

Ceph Days 2015

2015-09-22 Thread Patrick McGarry
Hey cephers, All of the planned Ceph Days through the end of the year are now live: http://ceph.com/cephdays/ 16 Oct - Shanghai (hosted by Intel) 22 Oct - Tokyo (hosted by Cyber Agent) 05 Nov - Melbourne (hosted by Monash University) Please sign up as soon as you are able to any of the events

Re: [ceph-users] Potential OSD deadlock?

2015-09-22 Thread Robert LeBlanc
-BEGIN PGP SIGNED MESSAGE- Hash: SHA256 -BEGIN PGP SIGNED MESSAGE- Hash: SHA256 4.2.0-1.el7.elrepo.x86_64 - - Robert LeBlanc PGP Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1 On Tue, Sep 22, 2015 at 3:41 PM, Samuel Just wrote: > I looked at

Re: [ceph-users] Potential OSD deadlock?

2015-09-22 Thread Sage Weil
On Tue, 22 Sep 2015, Samuel Just wrote: > I looked at the logs, it looks like there was a 53 second delay > between when osd.17 started sending the osd_repop message and when > osd.13 started reading it, which is pretty weird. Sage, didn't we > once see a kernel issue which caused some messages

Re: [ceph-users] Important security noticed regarding release signing key

2015-09-22 Thread wangsongbo
Hi Ken, Thank you, I will update my repo and continue my test. - Songbo On 15/9/23 上午10:50, Ken Dreyer wrote: Hi Songbo, It's been removed from Ansible now: https://github.com/ceph/ceph-cm-ansible/pull/137 - Ken On Tue, Sep 22, 2015 at 8:33 PM, wangsongbo

Re: [CEPH-DEVEL] MAX_RBD_IMAGES

2015-09-22 Thread Josh Durgin
On 09/22/2015 02:55 PM, Shinobu Kinjo wrote: Hello, Does any of you know why *MAX_RBD_IMAGES* was changed from 16 to 128? I hope that Dan remember -; http://resources.ustack.com/ceph/ceph/commit/2a6dcabf7f1b7550a0fa4fd223970ffc24ad7870 I don't think there's a reason for the exact limit.

Re: [CEPH-DEVEL] MAX_RBD_IMAGES

2015-09-22 Thread Shinobu Kinjo
> I don't think there's a reason for the exact limit. rbd-fuse was > created as a prototype, and hasn't had much work on it since. That's why I've ended up with asking. I've spent 2 days to find out any reason -; The kernel says nothing to me, of course. Thank you. Shinobu - Original

Re: RBD mirroring CLI proposal ...

2015-09-22 Thread Mykola Golub
On Mon, Sep 21, 2015 at 10:48:11AM -0400, Jason Dillaman wrote: > The following describes a set of proposals to support the upcoming RBD > mirroring feature [1] via the rbd cli.The RBD mirroring feature will > utilize a journal to allow modifications from a primary source to be > replicated

Re: [ceph-users] radosgw + civetweb latency issue on Hammer

2015-09-22 Thread Giridhar Yasa
I encountered the same issue in my setup (with an AWS SDK client) and on further investigation found that 'rgw print continue' was set to false for a civetweb driven rgw. Updated http://tracker.ceph.com/issues/12640 Giridhar -- Giridhar Yasa | Flipkart Engineering | http://www.flipkart.com/ On

test

2015-09-22 Thread wangsongbo
test -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html

the release of ceph-extra

2015-09-22 Thread wangsongbo
Hi, all, Since the last week‘s attack, “ceph.com/packages/ceph-extras ” can be opened never, but where can I get the releases of ceph-extra now? Thanks and Regards, WangSongbo -- To unsubscribe from this list: send the line "unsubscribe

OSD::op_is_discardable condition doubled

2015-09-22 Thread Lakis, Jacek
Hi ceph-devel! We're checking OSD::op_is_discardable condition two times: in dispatcher (handle_op) and in worker threads (do_request->can_discard_request->can_discard_op)   if (!op->get_connection()->is_connected() &&   op->get_version().version == 0) {     return true;   } Is there any

Ceph Tech Talk on Thursday

2015-09-22 Thread Patrick McGarry
Hey cephers, Don't forget that this Thursday is the monthly Ceph Tech Talk (starting @ 2p EDT instead of 1p). This month Brent Compton will be discussing the particulars of building a Ceph reference architecture. Tune in on Thurs for details. http://ceph.com/ceph-tech-talks/ If you have

Re: [ceph-users] Important security noticed regarding release signing key

2015-09-22 Thread Ken Dreyer
On Tue, Sep 22, 2015 at 2:38 AM, Songbo Wang wrote: > Hi, all, > Since the last week‘s attack, “ceph.com/packages/ceph-extras” can be > opened never, but where can I get the releases of ceph-extra now? > > Thanks and Regards, > WangSongbo > The packages in

[no subject]

2015-09-22 Thread Redynk, Lukasz
subscribe ceph-devel Intel Technology Poland sp. z o.o. ul. Slowackiego 173 | 80-298 Gdansk | Sad Rejonowy Gdansk Polnoc | VII Wydzial Gospodarczy Krajowego Rejestru Sadowego - KRS 101882 | NIP 957-07-52-316 | Kapital

Re: OSD::op_is_discardable condition doubled

2015-09-22 Thread Sage Weil
On Tue, 22 Sep 2015, Lakis, Jacek wrote: > Hi ceph-devel! > We're checking OSD::op_is_discardable condition two times: in dispatcher > (handle_op) and in worker threads > (do_request->can_discard_request->can_discard_op) > >   if (!op->get_connection()->is_connected() && >  

Re: OSD::op_is_discardable condition doubled

2015-09-22 Thread Gregory Farnum
On Tue, Sep 22, 2015 at 5:26 AM, Sage Weil wrote: > On Tue, 22 Sep 2015, Lakis, Jacek wrote: >> Hi ceph-devel! >> We're checking OSD::op_is_discardable condition two times: in dispatcher >> (handle_op) and in worker threads >> (do_request->can_discard_request->can_discard_op)