Re: [ceph-users] radosgw warnings in apache error.log

2013-09-04 Thread Fuchs, Andreas (SwissTXT)
> -Original Message- > From: Yehuda Sadeh [mailto:yeh...@inktank.com] > Sent: Dienstag, 3. September 2013 19:08 > To: Fuchs, Andreas (SwissTXT) > Cc: ceph-users@lists.ceph.com > Subject: Re: [ceph-users] radosgw warnings in apache error.log > > On Tue, Sep 3, 2013 at 9:13 AM, Fuchs, Andr

[ceph-users] radosgw md5

2013-09-04 Thread Art M.
Hello, As I know, radosgw calculates MD5 of the uploaded file and compares it with MD5 provided in header. Is it possible to get calculated MD5 of uploaded file directly from Rados. We want to keep it as a file attribute for future use. How radosgw calculates MD5? Is it realtime block by block c

Re: [ceph-users] adding SSD only pool to existing ceph cluster

2013-09-04 Thread Jens-Christian Fischer
Hi Greg > If you saw your existing data migrate that means you changed its > hierarchy somehow. It sounds like maybe you reorganized your existing > nodes slightly, and that would certainly do it (although simply adding > single-node higher levels would not). It's also possible that you > introduc

Re: [ceph-users] adding SSD only pool to existing ceph cluster

2013-09-04 Thread Corin Langosch
Am 04.09.2013 11:24, schrieb Jens-Christian Fischer: And that is the problem: The SSDs are in the same physical servers as the SATA drives. Adding them to the hosts adds them into the hierarchy. Adding them to "virtual hosts" (a host name that doesn't exist) breaks the startup scripts. Can I a

Re: [ceph-users] ceph-mon runs on 6800 not 6789.

2013-09-04 Thread 이주헌
You're right. I checked the other servers, and noticed the server that has problem is just one. the others are all right. I can't figure what is different. All servers are copied from one VM. I don't know why that happended. I'll install all again from the scratch, and will report on this thread a

Re: [ceph-users] SSD only storage, where to place journal

2013-09-04 Thread Neo
Original-Nachricht Betreff:Re: [ceph-users] SSD only storage, where to place journal Datum: Fri, 30 Aug 2013 22:13:12 +0200 Von:Stefan Priebe An: Tobias Brunner Kopie (CC): ceph-users@lists.ceph.com Hi Stefan. Am 30.08.2013 22:09, schrieb Tobias Brunn

Re: [ceph-users] how to remove and re-add broken mon? SOLVED

2013-09-04 Thread Alfredo Deza
On Wed, Sep 4, 2013 at 11:21 AM, Bernhard Glomm wrote: > Removing a monitor, also like described in > http://ceph.com/docs/master/rados/deployment/ceph-deploy-mon/ > doesn't work > > > root@nuke36[/1]:/etc/ceph # ceph-deploy mon destroy nuke36 > [ceph_deploy.mon][DEBUG ] Removing

[ceph-users] Performance issues with small files

2013-09-04 Thread Bill Omer
I'm testing ceph for storing a very large number of small files. I'm seeing some performance issues and would like to see if anyone could offer any insight as to what I could do to correct this. Some numbers: Uploaded 184111 files, with an average file size of 5KB, using 10 separate servers to u

Re: [ceph-users] adding SSD only pool to existing ceph cluster

2013-09-04 Thread Gregory Farnum
On Wed, Sep 4, 2013 at 2:24 AM, Jens-Christian Fischer wrote: > Hi Greg > >> If you saw your existing data migrate that means you changed its >> hierarchy somehow. It sounds like maybe you reorganized your existing >> nodes slightly, and that would certainly do it (although simply adding >> single

Re: [ceph-users] Performance issues with small files

2013-09-04 Thread Bryan Stillwell
Bill, I've run into a similar issue with objects averaging ~100KiB. The explanation I received on IRC is that there are scaling issues if you're uploading them all to the same bucket because the index isn't sharded. The recommended solution is to spread the objects out to a lot of buckets. Howe

Re: [ceph-users] ceph install

2013-09-04 Thread Gregory Farnum
On Fri, Aug 30, 2013 at 11:46 AM, Jimmy Lu [ Storage ] wrote: > Hello ceph-users, > > I am new to Ceph and would like to bring up a 5-node cluster for my PoC. I > am doing an installation from below link and ran into a problem. I am not > so sure how to deal with it. Can someone please shed some l

Re: [ceph-users] Performance issues with small files

2013-09-04 Thread Mark Nelson
Bryan, Good explanation. How's performance now that you've spread the load over multiple buckets? Mark On 09/04/2013 12:39 PM, Bryan Stillwell wrote: Bill, I've run into a similar issue with objects averaging ~100KiB. The explanation I received on IRC is that there are scaling issues if y

Re: [ceph-users] CORS not working

2013-09-04 Thread Yehuda Sadeh
Is static3 a bucket that you created before the upgrade? Can you test it with newly created buckets? Might be that you're hitting some other issue. Thanks, Yehuda On Tue, Sep 3, 2013 at 11:19 PM, Pawel Stefanski wrote: > hello! > > yes, dns name is configured and working perfectly, the bucket (i

[ceph-users] extending ceph

2013-09-04 Thread ker can
https://github.com/ceph/ceph/blob/master/src/testclass.cc In the source tree, I see an example source of extending ceph ... is there a client also that I can test it out with ? thx ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.

[ceph-users] v0.68 released

2013-09-04 Thread Sage Weil
Our first development release after Dumpling has arrived! It includes a lot of small cleanups and documentation improvements, as well as the first blueprint from the Emperor CDS to land (support for ZFS). There are also new sample implementations for RADOS classes (cls_hello) and a sample libra

Re: [ceph-users] extending ceph

2013-09-04 Thread ker can
Never mind ... 0.68 has a new sample implementations for RADOS classes (cls_hello) and a sample librados application (hello_world) On Wed, Sep 4, 2013 at 1:30 PM, ker can wrote: > https://github.com/ceph/ceph/blob/master/src/testclass.cc > > In the source tree, I see an example source of extend

Re: [ceph-users] Performance issues with small files

2013-09-04 Thread Bryan Stillwell
So far I haven't seen much of a change. It's still working through removing the bucket that reached 1.5 million objects though (my guess is that'll take a few more days), so I believe that might have something to do with it. Bryan On Wed, Sep 4, 2013 at 12:14 PM, Mark Nelson wrote: > Bryan, >

Re: [ceph-users] Performance issues with small files

2013-09-04 Thread Bill Omer
We've actually done the same thing, creating 65k buckets and storing 20-50 objects in each. No change really, not noticeable anyway On Wed, Sep 4, 2013 at 2:43 PM, Bryan Stillwell wrote: > So far I haven't seen much of a change. It's still working through > removing the bucket that reached 1.5

Re: [ceph-users] Performance issues with small files

2013-09-04 Thread Mark Nelson
Just for clarification, distributing objects over lots of buckets isn't helping improve small object performance? The degradation over time is similar to something I've seen in the past, with higher numbers of seeks on the underlying OSD device over time. Is it always (temporarily) resolved w

[ceph-users] RBD map question

2013-09-04 Thread Gaylord Holder
Is it possible know if an RBD is mapped by a machine? -Gaylord ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] v0.68 released

2013-09-04 Thread 이주헌
Debian/Ubuntu packages is still 0.67.2. I've been watching my every step since 1995. http://kirrie.pe.kr 2013/9/5 Sage Weil > Our first development release after Dumpling has arrived! It includes a > lot of small cleanups and documentation improvements, as well as the first > blueprint from t

[ceph-users] [ceph-deploy] problem creating mds after a full cluster wipe

2013-09-04 Thread Alphe Salas Michels
Title: signature Hi again, as I was doomed to full wipe my cluster once again after. I uploaded to ceph-deploy 1.2.3 all went smoothing along my ceph-deploy process. until I create the mds and then ceph-deploy mds create myhost provoked  first a

Re: [ceph-users] v0.68 released

2013-09-04 Thread Dan Mick
Where are you looking? ceph.com/debian-testing has 0.68 On 09/04/2013 07:12 PM, 이주헌 wrote: Debian/Ubuntu packages is still 0.67.2. -- Dan Mick, Filesystem Engineering Inktank Storage, Inc. http://inktank.com Ceph docs: http://ceph.com/docs ___ ce

Re: [ceph-users] [ceph-deploy] problem creating mds after a full cluster wipe

2013-09-04 Thread Sage Weil
On Wed, 4 Sep 2013, Alphe Salas Michels wrote: > Hi again, > as I was doomed to full wipe my cluster once again after. I uploaded to > ceph-deploy 1.2.3 > all went smoothing along my ceph-deploy process. > > until I create the mds and then > > ceph-deploy mds create myhost provoked > first a > >

[ceph-users] ceph-deply preflight hostname check?

2013-09-04 Thread Nigel Williams
I notice under HOSTNAME RESOLUTION section the use of 'host -4 {hostname}' as a required test, however, in all my trial deployments so far, none would pass as this command is a direct DNS query, and instead I usually just add entries to the host file. Two thoughts, is Ceph expecting to only do DNS

Re: [ceph-users] v0.68 released

2013-09-04 Thread 이주헌
My fault. I was looking stable repo. I've been watching my every step since 1995. http://kirrie.pe.kr 2013/9/5 Dan Mick > Where are you looking? ceph.com/debian-testing has 0.68 > > > On 09/04/2013 07:12 PM, 이주헌 wrote: > >> Debian/Ubuntu packages is still 0.67.2. >> >> > -- > Dan Mick, Filesy