Re: [ceph-users] 800TB - Ceph Physical Architecture Proposal

2016-04-08 Thread Christian Balzer
[re-added the ML] On Fri, 8 Apr 2016 08:30:21 -0500 Brady Deetz wrote: > On Thu, Apr 7, 2016 at 9:47 PM, Christian Balzer wrote: > > > > > Hello, > > > > On Thu, 7 Apr 2016 09:24:46 -0500 Brady Deetz wrote: > > > > > I'd appreciate any critique on the following plan. > > > > > > Before I detail

Re: [ceph-users] adding cache tier in productive hammer environment

2016-04-08 Thread Oliver Dzombic
Hi Christian, yeah i saw the problems with cache tier in the current hammer. But as far as i saw it, i would not get in touch with that szenarios. I dont plan to change settings like that, to let it go rubbish. But i already decided to wait for jewel and create a whole new cluster and copy all d

Re: [ceph-users] How can I monitor current ceph operation at cluster

2016-04-08 Thread Bob R
We're parsing the output of 'ceph daemon osd.N perf dump' for the admin sockets in /var/run/ceph/ceph-osd.*.asok on each node in our cluster. We then push that data into carbon-cache/graphite and using grafana for visualization. Our numbers are much more consistent than yours appear. Bob On Thu,

Re: [ceph-users] OSD activate Error

2016-04-08 Thread lin zhou
Hi,I think you do not need do osd activate. I always just use osd prepare,and it works well most time. can you paste the output of these in host osd01: df -h ls -l /var/lib/ceph I think everything works well but it do not create the directory of /var/lib/ceph/osd/ceph-0 and do not mount /dev/sdc

Re: [ceph-users] optimization for write when object map feature enabled

2016-04-08 Thread Jason Dillaman
No trouble at all. In the forthcoming Jewel release, there are additional optimizations on the write path when object map is used. Specifically, if we know the object doesn't exist, we can skip the initial guarded write (which we know will fail) and directly read the corresponding extent from

Re: [ceph-users] [Ceph-maintainers] v10.1.1 Jewel candidate released

2016-04-08 Thread Loic Dachary
Hi, The notable changes since 10.1.0 are at: http://docs.ceph.com/docs/master/release-notes/#v10-1-1 and the Jewel release candidate information is at: http://docs.ceph.com/docs/master/release-notes/#v10-1-0-jewel-release-candidate Cheers On 07/04/2016 20:14, Sage Weil wrote: > Hi all, > > W

Re: [ceph-users] OSD activate Error

2016-04-08 Thread Oliver Dzombic
Hi, the intresting part is: [osd01][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph --cluster ceph --name client.bootstrap-osd --keyring /var/lib/ceph/bootstrap-osd/ceph.keyring auth add osd.0 -i /var/lib/ceph/tmp/mnt.IkLtKp/keyring osd allow * mon allow profile osd [osd01][WARNIN] Error E

Re: [ceph-users] 800TB - Ceph Physical Architecture Proposal

2016-04-08 Thread Christian Balzer
On Fri, 8 Apr 2016 07:39:18 + Maxime Guyot wrote: > Hello, > > On 08/04/16 04:47, "ceph-users on behalf of Christian Balzer" > wrote: > > > > >> 11 OSD nodes: > >> -SuperMicro 6047R-E1R36L > >> --2x E5-2603v2 > >Vastly underpowered for 36 OSDs. > >> --128GB RAM > >> --36x 6TB OSD > >> --2x

Re: [ceph-users] adding cache tier in productive hammer environment

2016-04-08 Thread Christian Balzer
Hello, On Thu, 7 Apr 2016 13:18:39 +0200 Oliver Dzombic wrote: > Hi Christian, > > thank you for answering, i appriciate your time ! > One thing that should be obvious but I forgot in the previous mail was that of course you should probably wait for 0.94.7 or Jewel before doing anything with

Re: [ceph-users] 800TB - Ceph Physical Architecture Proposal

2016-04-08 Thread Maxime Guyot
Hello, On 08/04/16 04:47, "ceph-users on behalf of Christian Balzer" wrote: > >> 11 OSD nodes: >> -SuperMicro 6047R-E1R36L >> --2x E5-2603v2 >Vastly underpowered for 36 OSDs. >> --128GB RAM >> --36x 6TB OSD >> --2x Intel P3700 (journals) >Which exact model? >If it's the 400GB one, that's 2G

Re: [ceph-users] ceph mds error

2016-04-08 Thread Yan, Zheng
On Tue, Apr 5, 2016 at 7:58 PM, gjprabu wrote: > Hi John, > > Thanks for your reply, current kernel version we are using > 3.10.0-229.20.1.el7.x86_64 and ceph version 0.94.5 , Please advice which > version is perfect. > 3.10.0-227.el7 is about one year old. please use the newest el7 kernel.