Re: Inject configuration change into cluster

2012-09-17 Thread Sławomir Skowron
Ok, i will try, but i have all day meeting today, and tomorrow. One more question, is there any way to check configuration not from ceph.conf, but from running daemon in cluster ?? On Fri, Sep 14, 2012 at 9:12 PM, Sage Weil s...@inktank.com wrote: Hi, On Wed, 5 Sep 2012, Skowron S?awomir

Re: RBD image max simultaneous mounts

2012-09-17 Thread Josh Durgin
On Mon, 17 Sep 2012 12:13:07 +0930, Vladimir Bashkirtsev vladi...@bashkirtsev.com wrote: Dear devs, We just had an incident where two instances of the same VM started up on different hosts and mounted the same RBD image. Image had ext4 partition and it became corrupted quickly. Therefore it

Re: Inject configuration change into cluster

2012-09-17 Thread Josh Durgin
On Mon, 17 Sep 2012 08:36:09 +0200, Sławomir Skowron szi...@gmail.com wrote: Ok, i will try, but i have all day meeting today, and tomorrow. One more question, is there any way to check configuration not from ceph.conf, but from running daemon in cluster ?? You can do this with the admin

Files disappearing

2012-09-17 Thread Székelyi Szabolcs
Hi, I have a problem that newly copied files disappear from the FS after a few minutes. The only suspicious log entries look like this: 2012-09-17 15:45:40.251610 7f7024f25700 0 mds.0.server missing 1000818 #1/vmdir/2414/images/deployment.0 (mine), will load later I see messages like

Re: How to use ruleset

2012-09-17 Thread Wido den Hollander
On 09/17/2012 11:42 AM, hemant surale wrote: Hi Community, I have read the documentation to know crush map as well as inserting new crushmap, But I have qn that even after writing own rule for data placement how we can apply it for data placement? in short how to utilize newly

Re: MPI applications on ceph fs

2012-09-17 Thread John Wright
Hi Sage and ceph-developers, I reproduced the error again and captured file descriptors and log information. I've quoted them below. Here is a brief summary: I have ceph 0.48 running on a single mulitprocessor node. I have two clients that have mounted the cephfs over infiniband (same error

Re: Files disappearing

2012-09-17 Thread Gregory Farnum
On Mon, Sep 17, 2012 at 6:59 AM, Székelyi Szabolcs szeke...@niif.hu wrote: Hi, I have a problem that newly copied files disappear from the FS after a few minutes. The only suspicious log entries look like this: 2012-09-17 15:45:40.251610 7f7024f25700 0 mds.0.server missing 1000818

Re: Inject configuration change into cluster

2012-09-17 Thread Josh Durgin
On 09/17/2012 12:29 AM, Josh Durgin wrote: On Mon, 17 Sep 2012 08:36:09 +0200, Sławomir Skowron szi...@gmail.com wrote: Ok, i will try, but i have all day meeting today, and tomorrow. One more question, is there any way to check configuration not from ceph.conf, but from running daemon in

How are you using Ceph?

2012-09-17 Thread Ross Turk
Hi, all! One of the most important parts of Inktank's mission is to spread the word about Ceph. We want everyone to know what it is and how to use it. In order to tell a better story to potential new users, I'm trying to get a sense for today's deployments. We've spent the last few months

Re: How are you using Ceph?

2012-09-17 Thread Nick Couchman
My use of Ceph is probably pretty unique in some of the aspects of where/how I'm using it. I run an IT department for a medium-sized engineering firm. One of my goals is to try to make the best possible use of the hardware we're deploying to users' desktops. Often times users cannot get by

Re: How are you using Ceph?

2012-09-17 Thread Mark Nelson
Hi Nick, All I have to say, is that is totally awesome and scary at the same time. :) Glad to hear that it recovers well when people shut their desktops off! Mark On 09/17/2012 05:47 PM, Nick Couchman wrote: My use of Ceph is probably pretty unique in some of the aspects of where/how I'm

Re: How are you using Ceph?

2012-09-17 Thread John Axel Eriksson
Our use of Ceph started pretty recently (this summer). We only use rados together with the radosgw. We moved from another distributed storage solution that had failed us more than once and we lost data. Since the old system had an http interface (not S3 compatible though) we looked around for

Re: How are you using Ceph?

2012-09-17 Thread Nick Couchman
We actually ask people to not shut off their desktops, so it doesn't happen very often :-). Also, I run the MDS and MON systems inside my datacenter, so only the OSDs are out there on the desktops. -Nick Mark Nelson 09/17/12 4:53 PM Hi Nick, All I have to say, is that is totally awesome

Re: How are you using Ceph?

2012-09-17 Thread Nick Couchman
John, I'd be really interested to hear how Btrfs goes over time. I tried it out a few kernel versions ago and regretted it - lost some data after using it. Hopefully the stability is better than it was before, and inline compression is always great! -Nick John Axel Eriksson 09/17/12 5:26

Re: How are you using Ceph?

2012-09-17 Thread Smart Weblications GmbH - Florian Wiessner
Hi, i use ceph to provide storage via rbd for our virtualization cluster delivering KVM based high availability Virtual Machines to my customers. I also use it as rbd device with ocfs2 on top of it for a 4 node webserver cluster as shared storage - i do this, because unfortunatelly cephfs is not

Re: How are you using Ceph?

2012-09-17 Thread Tren Blackburn
On Mon, Sep 17, 2012 at 5:05 PM, Smart Weblications GmbH - Florian Wiessner f.wiess...@smart-weblications.de wrote: Hi, i use ceph to provide storage via rbd for our virtualization cluster delivering KVM based high availability Virtual Machines to my customers. I also use it as rbd device

Re: How are you using Ceph?

2012-09-17 Thread Sage Weil
On Mon, 17 Sep 2012, Tren Blackburn wrote: On Mon, Sep 17, 2012 at 5:05 PM, Smart Weblications GmbH - Florian Wiessner f.wiess...@smart-weblications.de wrote: Hi, i use ceph to provide storage via rbd for our virtualization cluster delivering KVM based high availability Virtual

Re: How are you using Ceph?

2012-09-17 Thread Matt W. Benjamin
Hi Just FYI, on the NFS integration front. A pnfs files (RFC5661)-capable NFSv4 re-exporter for Ceph has been committed to the Ganesha NFSv4 server development branch. We're continuing to enhance and elaborate this. We have had on our (full) plates for a while to return Ceph client library

Re: How are you using Ceph?

2012-09-17 Thread Ian Pye
I'm looking at building a hbase/bigtable style key-value store on top of Ceph's omap abstraction of LevelDB. The plan is to use this for log storage at first. Writes use libradospp, with individual log lines serialized via message-pack and then stored as omap values. Omap keys are strings which