[ceph-users] Infernalis OSD errored out on journal permissions without mentioning anything in its log

2016-03-31 Thread Bill Sharer
This took a little head scratching until I figured out why my osd daemons were not restarting under Infernalis on Gentoo. I had just upgraded from Hammer to Infernalis and had reset ownership from root:root to ceph:ceph on the files of each OSD in /var/lib/ceph/osd/ceph-n. However I forgot t

Re: [ceph-users] Error from monitor

2016-03-31 Thread zainal
Yesterday, no error. [root@mon01 ceph]# service ceph-mon@mon01.service status Redirecting to /bin/systemctl status ceph-mon@mon01.service.service ceph-mon@mon01.service.service - Ceph cluster monitor daemon Loaded: loaded (/usr/lib/systemd/system/ceph-mon@.service; enabled) Active:

[ceph-users] Error from monitor

2016-03-31 Thread zainal
Hi, I keep getting this error: 2016-04-01 10:55:59.666015 7fe7301ee700 0 -- :/3560986127 >> 42.0.30.39:6789/0 pipe(0x7fe724000c00 sd=4 :0 s=1 pgs=0 cs=0 l=1 c=0x7fe724004ef0).fault 2016-04-01 10:56:08.667082 7fe73aa67700 0 -- 42.0.30.38:0/3560986127 >> 42.0.30.39:6789/0 pipe(0x7fe724000c

Re: [ceph-users] OSD crash after conversion to bluestore

2016-03-31 Thread Adrian Saul
No - if you use ceph-disk prepare it creates a small filesystem with some control files, the bluestore partition is not visible. > -Original Message- > From: ceph-users [mailto:ceph-users-boun...@lists.ceph.com] On Behalf Of > Oliver Dzombic > Sent: Friday, 1 April 2016 12:08 AM > To: c

Re: [ceph-users] ceph pg query hangs for ever

2016-03-31 Thread Goncalo Borges
Hi Mart, Wido... A disclaimer: Not really an expert, just a regular site admin sharing my experience. At the beginning of the thread you give the idea that only osd.68 has problems dealing with the problematic PG 3.117. If that is indeed the case, you could simply mark that osd.68 down and r

Re: [ceph-users] OSD crash after conversion to bluestore

2016-03-31 Thread Adrian Saul
Not sure about commands however if you look at the OSD mount point there is a “bluefs” file. From: German Anders [mailto:gand...@despegar.com] Sent: Thursday, 31 March 2016 11:48 PM To: Adrian Saul Cc: ceph-users@lists.ceph.com Subject: Re: [ceph-users] OSD crash after conversion to bluestore

[ceph-users] Ceph Developer Monthly (CDM)

2016-03-31 Thread Patrick McGarry
Hey cephers, Just a reminder that the monthly developer standup will be happening next Wed, 06 Apr @ 12:30p EST. Please add your blueprint to the appropriate page on the planning section of the wiki. Thanks! http://tracker.ceph.com/projects/ceph/wiki/Planning -- Best Regards, Patrick McGarry

[ceph-users] Ceph Thin Provisioning on OpenStack Instances

2016-03-31 Thread Mario Codeniera
Hi, Is there anyone done thin provisioning on OpenStack instances (virtual machine)? Based on the current configurations, it works well with my cloud using ceph 0.94.5 with SSD journal (from 18mins to around 7 mins for creating an 40GB instance and not good SSD iops). But what I wanted is the stor

Re: [ceph-users] Frozen Client Mounts

2016-03-31 Thread Oliver Dzombic
Hi Diego, lets start with the basics and please give us the output of ceph -s ceph osd df ceph osd perf at best before and after you provike the iowait. Thank you ! -- Mit freundlichen Gruessen / Best regards Oliver Dzombic IP-Interactive mailto:i...@ip-interactive.de Anschrift: IP Intera

[ceph-users] Frozen Client Mounts

2016-03-31 Thread Diego Castro
Hello, everyone. I have a pretty basic ceph setup running on top of Azure Cloud, (4 mons and 10 osd's) for rbd images. Everything seems to be working as expected until i put some load on it, sometimes it doesn't complete the process (mysql restore for ex.) and sometimes it does without any issues.

Re: [ceph-users] PG Stuck active+undersized+degraded+inconsistent

2016-03-31 Thread Calvin Morrow
On Wed, Mar 30, 2016 at 5:24 PM Christian Balzer wrote: > On Wed, 30 Mar 2016 15:50:07 + Calvin Morrow wrote: > > > On Wed, Mar 30, 2016 at 1:27 AM Christian Balzer wrote: > > > > > > > > Hello, > > > > > > On Tue, 29 Mar 2016 18:10:33 + Calvin Morrow wrote: > > > > > > > Ceph cluster wi

Re: [ceph-users] chunk-based cache in ceph with erasure coded back-end storage

2016-03-31 Thread huang jun
the data encode/decode operation is done on OSD side. 2016-03-31 23:28 GMT+08:00 Yu Xiang : > Thanks for the reply! > So where did the decoding process happen? Is it in cache or on the client > side? (Only considering Read.) If it happened when copying from storage tier > to cache, then it has to

Re: [ceph-users] chunk-based cache in ceph with erasure coded back-end storage

2016-03-31 Thread Yu Xiang
Thanks for the reply! So where did the decoding process happen? Is it in cache or on the client side? (Only considering Read.) If it happened when copying from storage tier to cache, then it has to be an whole object (file), but if decoding can be happened on client side when the client has all

Re: [ceph-users] OSD crash after conversion to bluestore

2016-03-31 Thread Oliver Dzombic
Hi, if i understand it correct, bluestore wont use / is not a filesystem to be mounted. So if an osd is up and in, while we dont see its mounted into the filesystem and accessable, we could assume that it must be powered by bluestore... !??! -- Mit freundlichen Gruessen / Best regards Oliver D

Re: [ceph-users] OSD crash after conversion to bluestore

2016-03-31 Thread German Anders
having jewel install, is possible to run a command in order to see that the OSD is actually using bluestore? Thanks in advance, Best, *German* 2016-03-31 1:24 GMT-03:00 Adrian Saul : > > I upgraded my lab cluster to 10.1.0 specifically to test out bluestore and > see what latency difference i

Re: [ceph-users] xenserver or xen ceph

2016-03-31 Thread Iban Cabrillo
Hi, We have had lot of troubles developing a ceph over xen. Finaly after haunderd of test, we talked with libvirt-users seems that the problem was found on libxl library which did not have support for rbd, but seems this is solved from 1.3.2 libvirt version and xen-utils >4.5 http://libvirt.or