Re: Inject configuration change into cluster

2012-09-17 Thread Josh Durgin
On Mon, 17 Sep 2012 08:36:09 +0200, Sławomir Skowron wrote: > Ok, i will try, but i have all day meeting today, and tomorrow. > > One more question, is there any way to check configuration not from > ceph.conf, but from running daemon in cluster ?? You can do this with the admin socket: ceph --

How to use ruleset

2012-09-17 Thread hemant surale
Hi Community, I have read the documentation to know crush map as well as inserting new crushmap, But I have qn that even after writing own rule for data placement how we can apply it for data placement? in short how to utilize newly specified rule when new data insertion is executed.

Files disappearing

2012-09-17 Thread Székelyi Szabolcs
Hi, I have a problem that newly copied files disappear from the FS after a few minutes. The only suspicious log entries look like this: 2012-09-17 15:45:40.251610 7f7024f25700 0 mds.0.server missing 1000818 #1/vmdir/2414/images/deployment.0 (mine), will load later I see messages like this

Re: How to use ruleset

2012-09-17 Thread Wido den Hollander
On 09/17/2012 11:42 AM, hemant surale wrote: Hi Community, I have read the documentation to know crush map as well as inserting new crushmap, But I have qn that even after writing own rule for data placement how we can apply it for data placement? in short how to utilize newly specifie

Re: MPI applications on ceph fs

2012-09-17 Thread John Wright
Hi Sage and ceph-developers, I reproduced the error again and captured file descriptors and log information. I've quoted them below. Here is a brief summary: I have ceph 0.48 running on a single mulitprocessor node. I have two clients that have mounted the cephfs over infiniband (same error happe

Re: Files disappearing

2012-09-17 Thread Gregory Farnum
On Mon, Sep 17, 2012 at 6:59 AM, Székelyi Szabolcs wrote: > Hi, > > I have a problem that newly copied files disappear from the FS after a few > minutes. The only suspicious log entries look like this: > > 2012-09-17 15:45:40.251610 7f7024f25700 0 mds.0.server missing > 1000818 #1/vmdir/2414/

Re: Inject configuration change into cluster

2012-09-17 Thread Josh Durgin
On 09/17/2012 12:29 AM, Josh Durgin wrote: On Mon, 17 Sep 2012 08:36:09 +0200, Sławomir Skowron wrote: Ok, i will try, but i have all day meeting today, and tomorrow. One more question, is there any way to check configuration not from ceph.conf, but from running daemon in cluster ?? You can

How are you using Ceph?

2012-09-17 Thread Ross Turk
Hi, all! One of the most important parts of Inktank's mission is to spread the word about Ceph. We want everyone to know what it is and how to use it. In order to tell a better story to potential new users, I'm trying to get a sense for today's deployments. We've spent the last few months talking

Re: How are you using Ceph?

2012-09-17 Thread Nick Couchman
My use of Ceph is probably pretty unique in some of the aspects of where/how I'm using it. I run an IT department for a medium-sized engineering firm. One of my goals is to try to make the best possible use of the hardware we're deploying to users' desktops. Often times users cannot get by wi

Re: How are you using Ceph?

2012-09-17 Thread Mark Nelson
Hi Nick, All I have to say, is that is totally awesome and scary at the same time. :) Glad to hear that it recovers well when people shut their desktops off! Mark On 09/17/2012 05:47 PM, Nick Couchman wrote: My use of Ceph is probably pretty unique in some of the aspects of where/how I'm usi

Re: How are you using Ceph?

2012-09-17 Thread John Axel Eriksson
Our use of Ceph started pretty recently (this summer). We only use rados together with the radosgw. We moved from another distributed storage solution that had failed us more than once and we lost data. Since the old system had an http interface (not S3 compatible though) we looked around for anoth

Re: How are you using Ceph?

2012-09-17 Thread Nick Couchman
We actually ask people to not shut off their desktops, so it doesn't happen very often :-). Also, I run the MDS and MON systems inside my datacenter, so only the OSDs are out there on the desktops. -Nick >>> Mark Nelson 09/17/12 4:53 PM >>> Hi Nick, All I have to say, is that is totally awes

Re: How are you using Ceph?

2012-09-17 Thread Nick Couchman
John, I'd be really interested to hear how Btrfs goes over time. I tried it out a few kernel versions ago and regretted it - lost some data after using it. Hopefully the stability is better than it was before, and inline compression is always great! -Nick >>> John Axel Eriksson 09/17/12 5:2

Re: How are you using Ceph?

2012-09-17 Thread Smart Weblications GmbH - Florian Wiessner
Hi, i use ceph to provide storage via rbd for our virtualization cluster delivering KVM based high availability Virtual Machines to my customers. I also use it as rbd device with ocfs2 on top of it for a 4 node webserver cluster as shared storage - i do this, because unfortunatelly cephfs is not

Re: How are you using Ceph?

2012-09-17 Thread Tren Blackburn
On Mon, Sep 17, 2012 at 5:05 PM, Smart Weblications GmbH - Florian Wiessner wrote: > > Hi, > > i use ceph to provide storage via rbd for our virtualization cluster > delivering > KVM based high availability Virtual Machines to my customers. I also use it > as rbd device with ocfs2 on top of it fo

Re: How are you using Ceph?

2012-09-17 Thread Sage Weil
On Mon, 17 Sep 2012, Tren Blackburn wrote: > On Mon, Sep 17, 2012 at 5:05 PM, Smart Weblications GmbH - Florian > Wiessner wrote: > > > > Hi, > > > > i use ceph to provide storage via rbd for our virtualization cluster > > delivering > > KVM based high availability Virtual Machines to my customer

Re: How are you using Ceph?

2012-09-17 Thread Matt W. Benjamin
Hi Just FYI, on the NFS integration front. A pnfs files (RFC5661)-capable NFSv4 re-exporter for Ceph has been committed to the Ganesha NFSv4 server development branch. We're continuing to enhance and elaborate this. We have had on our (full) plates for a while to return Ceph client library c

Re: How are you using Ceph?

2012-09-17 Thread Ian Pye
I'm looking at building a hbase/bigtable style key-value store on top of Ceph's omap abstraction of LevelDB. The plan is to use this for log storage at first. Writes use libradospp, with individual log lines serialized via message-pack and then stored as omap values. Omap keys are strings which gr

Re: How are you using Ceph?

2012-09-17 Thread Yehuda Sadeh
We had a similar idea on our mind for a while now. The thought was to add a key value support that leverages omaps and get it exposed through the RESTful rados gateway. Having a real world use for it will certainly help in understanding the requirements. Yehuda On Mon, Sep 17, 2012 at 10:44 PM, I

Re: How are you using Ceph?

2012-09-17 Thread John Axel Eriksson
Well I've used Btrfs on and off for two years now I think - in less critical situations though (at home, on testing equipment at work and on easily rebuildable systems). I've been bitten several times before so I know there've been serious problems with it. With Kernel 3.5 I had a pretty good feeli