Re: [ceph-users] Erasure coding

2014-05-19 Thread yalla.gnan.kumar
Hi John, Thanks for the reply. It seems that to understand the internal mechanism and the algorithmic structure of ceph, knowledge of Information theory is necessary ☺. Thanks Kumar From: John Wilkins [mailto:john.wilk...@inktank.com] Sent: Monday, May 19, 2014 10:18 PM To: Gnan Kumar, Yalla

[ceph-users] Access denied error for list users

2014-05-19 Thread Shanil S
Hi, I am trying to create and list all users by using the functions http://ceph.com/docs/master/radosgw/adminops/ and i successfully created the access tokens but i am getting an access denied and 403 for listing users function. The GET /{admin}/user is used for getting the complete users list, bu

Re: [ceph-users] mon create error

2014-05-19 Thread reistlin87
Ok, maybe it is bug) But in Ubuntu distro all work correct. Maybee they know about it and fix it. 19.05.2014, 23:05, "Alfredo Deza" : > On Sun, May 18, 2014 at 1:36 PM, reistlin87 wrote: > >>  Yes, i have tried. I have found,that Ubuntu Server create admin socket with >>  right name. All other

Re: [ceph-users] Fwd: "rbd map" command hangs

2014-05-19 Thread Jay Janardhan
Got the stack trace when it crashed. I had to enable serial port to capture this. Would this help? [ 172.227318] libceph: mon0 192.168.56.102:6789 feature set mismatch, my 40002 < server's 20042040002, missing 2004200 [ 172.451109] libceph: mon0 192.168.56.102:6789 socket error on read [

[ceph-users] How do I do deep-scrub manually?

2014-05-19 Thread Jianing Yang
I found that deep scrub has a significant impact on my cluster. I've used "ceph osd set nodeep-scrub" disable it. But I got an error "HEALTH_WARN nodeep-scrub flag(s) set". What is the proper way to disable deep scrub? and how can I run it manually? -- _ / In

Re: [ceph-users] crushmap for datacenters

2014-05-19 Thread Vladislav Gorbunov
I create the new complex rule: rule datacenter_rep2 { ruleset 2 type replicated min_size 1 max_size 10 step take default step choose firstn 2 type datacenter step chooseleaf firstn -1 type host step emit } assign to pools, and now cluster work as I expect. 2014-05-20 11:59 GMT+12:

Re: [ceph-users] Firefly 0.80 rados bench cleanup / object removal broken?

2014-05-19 Thread Guang Yang
Hi Matt, The problem you came across was due to a change made in the rados bench along with the Firefly release, it aimed to solve the problem that if there were multiple rados instance (for writing), we want to do a rados read for each run as well. Unfortunately, that change broke your user ca

Re: [ceph-users] ' rbd username specified but secret not found' error, virsh live migration on rbd

2014-05-19 Thread JinHwan Hwang
Thank you for your help. Yes, i also defined on the second node(destination node). I've double checked ephemeral and private, both of them show me this ~# virsh secret-dumpxml b34526f2-8d32-ed5d-3153-e90d011dd37e b34526f2-8d32-ed5d-3153-e90d011dd37e client.libvirt secret https://cep

Re: [ceph-users] ' rbd username specified but secret not found' error, virsh live migration on rbd

2014-05-19 Thread Josh Durgin
On 05/19/2014 01:48 AM, JinHwan Hwang wrote: I have been trying to do live migration on vm which is running on rbd. But so far, they only give me ' internal error: rbd username 'libvirt' specified but secret not found' when i do live migration. ceph-admin : source host host : destination host r

[ceph-users] crushmap for datacenters

2014-05-19 Thread Vladislav Gorbunov
Hi! Can you help me to understand why crushmap with step chooseleaf firstn 0 type host can't work with hosts in data centers? If I have the osd tree: # id weight type name up/down reweight -1 0.12 root default -3 0.03 host tceph2 1 0.03 osd.1 up 1 -4 0.03 host tceph3 2 0.03 osd.2 up 1 -2 0.03 hos

[ceph-users] Firefly 0.80 rados bench cleanup / object removal broken?

2014-05-19 Thread Matt . Latter
I was experimenting previously with 0.72 , and could easily cleanup pool objects from several previous rados bench (write) jobs with : rados -p cleanup bench (would remove all objects starting with "bench") I quickly realised when I moved to 0.80 that my script was broken and theoretically

Re: [ceph-users] RBD for ephemeral

2014-05-19 Thread Pierre Grandin
With the help of Josh on IRC, we found that actually the glance_api_version directive has to be in the [default] block of your cinder.conf ( i happen to have two storage backends and this directive was in my rbd block). After fixing this config my volumes created via cinder are indeed COW. Now I

Re: [ceph-users] Ceph Plugin for Collectd

2014-05-19 Thread David McBride
On 14/05/14 13:24, Christian Eichelmann wrote: > Hi Ceph User! > > I had a look at the "official" collectd fork for ceph, which is quite > outdated and not compatible with the upstream version. > > Since this was not an option for us, I've worte a Python Plugin for > Collectd, that gets all the p

Re: [ceph-users] is cephfs ready for production ?

2014-05-19 Thread Gregory Farnum
On Mon, May 19, 2014 at 9:05 AM, Ignazio Cassano wrote: > Hi all, I'd like to know if cephfs is in heavy developement or it is ready > for production . > Documentation reports it is not for production but I think documentation on > ceph.com is not enough recent . There are groups successfully us

Re: [ceph-users] metadata pool : size growing

2014-05-19 Thread Gregory Farnum
On Mon, May 19, 2014 at 4:05 AM, Florent B wrote: > On 05/19/2014 12:40 PM, Wido den Hollander wrote: >> On 05/19/2014 12:31 PM, Florent B wrote: >>> Hi all, >>> >>> I use CephFS and I am wondering what does "metadata" pool contains >>> exactly ? >>> >> >> It contains the directory structure of yo

Re: [ceph-users] CephFS parallel reads from multiple replicas ?

2014-05-19 Thread Gregory Farnum
On Sat, May 17, 2014 at 5:40 PM, Michal Pazdera wrote: > Hi everyone, > > I wonder if CephFS is able to read from all replicas simontaniously, that > will result in doubled read performance if > a replica of 2 has been used. Nope, definitely not. > I have done some humble testing on 5PCs (2OSD >

[ceph-users] Looking for ceph consultant

2014-05-19 Thread Glen Aidukas
Hello, We are looking for a Ceph consultant to help with setting up an S3 gateway. If interested, please contact me via email. Thanks! -Glen gaidu...@behaviormatrix.com ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/l

Re: [ceph-users] mon create error

2014-05-19 Thread Alfredo Deza
On Sun, May 18, 2014 at 1:36 PM, reistlin87 wrote: > > Yes, i have tried. I have found,that Ubuntu Server create admin socket with > right name. All other distros( i have tasted CentOS 6.5, OpenSUSE 13.1, > Debian 7.5) create wrong admin socket name with non-default cluster name. Is > it bug, or i

[ceph-users] Web Gateway Start problem after upgrading Emperor to Firefly

2014-05-19 Thread Julien Calvet
Hello, I have un big problem on Web gateway after upgrading emperor to Firefly. I have only this on my logs: 2014-05-19 20:29:17.303454 7f131217a780 0 ceph version 0.80.1 (a38fe1169b6d2ac98b427334c12d7cf81f809b74), process radosgw, pid 4002 2014-05-19 20:29:17.329183 7f131217a780 0 client.80

Re: [ceph-users] Fwd: "rbd map" command hangs

2014-05-19 Thread Ilya Dryomov
On Mon, May 19, 2014 at 8:37 PM, Jay Janardhan wrote: > Ilya, The SysRq is not doing anything as the kernel is hung. Btw, this is a > VirtualBox environment so I used the VBoxManage to send the SysRq commands. > Just to let you know, the system locksup and the only way out is a hard > reset. Well

Re: [ceph-users] Erasure coding

2014-05-19 Thread John Wilkins
I have also added a big part of Loic's discussion of the architecture into the Ceph architecture document here: http://ceph.com/docs/master/architecture/#erasure-coding On Mon, May 19, 2014 at 5:35 AM, wrote: > Hi Loic, > > Thanks for the reply. > > > Thanks > Kumar > > > -Original Message

Re: [ceph-users] Fwd: "rbd map" command hangs

2014-05-19 Thread Jay Janardhan
Ilya, The SysRq is not doing anything as the kernel is hung. Btw, this is a VirtualBox environment so I used the VBoxManage to send the SysRq commands. Just to let you know, the system locksup and the only way out is a hard reset. On Mon, May 19, 2014 at 12:10 PM, Jay Janardhan wrote: > Thanks

Re: [ceph-users] Fwd: "rbd map" command hangs

2014-05-19 Thread Jay Janardhan
Thanks for the response Ilya. I need to figure out how to use SysRq on my Mac. Meanwhile, here is the strace output and ceph version: *Ceph Version: *ceph version 0.80.1 (a38fe1169b6d2ac98b427334c12d7cf81f809b74) *​* Note that IP 192.168.56.102:6789 is reachable from the client node. ​ *​192.168

[ceph-users] is cephfs ready for production ?

2014-05-19 Thread Ignazio Cassano
Hi all, I'd like to know if cephfs is in heavy developement or it is ready for production . Documentation reports it is not for production but I think documentation on ceph.com is not enough recent . Regards Ignazio ___ ceph-users mailing list ceph-user

[ceph-users] Subscribe

2014-05-19 Thread Jay Janardhan
___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[ceph-users] "rbd map" command hangs

2014-05-19 Thread Jay Janardhan
I'm following quick start guide and have a ceph cluster with three nodes. When I try to map image to block device my command hangs. This seems like a kernel hang as the only way I was able to get out is via a hard reset of the image. The following is my configuration. Any help is greatly appreciate

Re: [ceph-users] RBD for ephemeral

2014-05-19 Thread Michael J. Kidd
After sending my earlier email, I found another commit that was merged in March: https://review.openstack.org/#/c/59149/ Seems to follow a newer image handling technique that was being sought which prevented the first patch from being merged in... Michael J. Kidd Sr. Storage Consultant Inktank Pr

Re: [ceph-users] RBD for ephemeral

2014-05-19 Thread Pierre Grandin
Actually you can get the patched code from here for Havana : https://github.com/jdurgin/nova/tree/havana-ephemeral-rbd But i'm still trying to get it to work (in my case the volumes are still copies, and not copy on write). On Mon, May 19, 2014 at 7:19 AM, Michael J. Kidd wrote: > Since the sta

Re: [ceph-users] RBD for ephemeral

2014-05-19 Thread Michael J. Kidd
Since the status is 'Abandoned', it would appear that the fix has not been merged into any release of OpenStack. Thanks, Michael J. Kidd Sr. Storage Consultant Inktank Professional Services On Sun, May 18, 2014 at 5:13 PM, Yuming Ma (yumima) wrote: > Wondering what is the status of this fix >

Re: [ceph-users] Fwd: "rbd map" command hangs

2014-05-19 Thread Ilya Dryomov
On Mon, May 19, 2014 at 5:42 PM, Jay Janardhan wrote: > (Sorry if this is a duplicate message - email server is acting up this > morning). > > > I'm following quick start guide and have a ceph cluster with three nodes. > When I try to map image to block device my command hangs. This seems like a >

[ceph-users] Fwd: "rbd map" command hangs

2014-05-19 Thread Jay Janardhan
(Sorry if this is a duplicate message - email server is acting up this morning). I'm following quick start guide and have a ceph cluster with three nodes. When I try to map image to block device my command hangs. This seems like a kernel hang as the only way I was able to get out is via a hard re

Re: [ceph-users] Working at RedHat & Ceph User Committee

2014-05-19 Thread Karan Singh
Nice to hear. I would say its a good move from RH to hire you :-) , good luck and keep contributing to ceph *core features* as you already been doing. - Karan Singh - On 19 May 2014, at 12:21, Wido den Hollander wrote: > On 05/19/2014 10:46 AM, Loic Dachary wrote: >> Hi Ceph, >> >> TL;DR:

Re: [ceph-users] Erasure coding

2014-05-19 Thread yalla.gnan.kumar
Hi Loic, Thanks for the reply. Thanks Kumar -Original Message- From: Loic Dachary [mailto:l...@dachary.org] Sent: Monday, May 19, 2014 6:04 PM To: Gnan Kumar, Yalla; ceph-users@lists.ceph.com Subject: Re: [ceph-users] Erasure coding Hi, The general idea to preserve resilience but sa

Re: [ceph-users] Erasure coding

2014-05-19 Thread Loic Dachary
Hi, The general idea to preserve resilience but save space compared to replication. It costs more in terms of CPU and network. You will find a short introduction here : https://wiki.ceph.com/Planning/Blueprints/Dumpling/Erasure_encoding_as_a_storage_backend https://wiki.ceph.com/Planning/Blue

[ceph-users] Erasure coding

2014-05-19 Thread yalla.gnan.kumar
Hi All, What exactly is erasure coding and why is it used in ceph ? I could not get enough explanatory information from the documentation. Thanks Kumar This message is for the designated recipient only and may contain privileged, proprietary, or otherwise con

Re: [ceph-users] Problem with radosgw and some file name characters

2014-05-19 Thread Andrei Mikhailovsky
Yehuda, Never mind my last post, i've found the issue with the rule that you've suggested. my fastcgi script is called differently, so that's why i was getting the 404. I've tried your rewrite rule and I am still having the same issues. The same characters are failing with the rule you've su

Re: [ceph-users] metadata pool : size growing

2014-05-19 Thread Wido den Hollander
On 05/19/2014 12:31 PM, Florent B wrote: Hi all, I use CephFS and I am wondering what does "metadata" pool contains exactly ? It contains the directory structure of your filesystem Its size is growing (multiple GB). It seems that it stores all operations occurring in CephFS, but is it tota

Re: [ceph-users] Working at RedHat & Ceph User Committee

2014-05-19 Thread Wido den Hollander
On 05/19/2014 10:46 AM, Loic Dachary wrote: Hi Ceph, TL;DR: I'm starting a new position at RedHat in the Ceph development team, mid-august. I will keep working under the newly elected head of the Ceph User Committee. Cloudwatt is a company based in France which provides cloud services. My pa

Re: [ceph-users] Ceph booth at http://www.solutionslinux.fr/

2014-05-19 Thread Loic Dachary
Hi Cedric, No mug but ... let's discuss this at the booth. We will figure something out ;-) Cheers On 19/05/2014 10:48, Cedric Lemarchand wrote: > Le 12/05/2014 19:14, Loic Dachary a écrit : >> On 12/05/2014 11:00, Alexandre DERUMIER wrote: >>> I'll be there ! > Will be there too ! >>> >>> >>> (

[ceph-users] ' rbd username specified but secret not found' error, virsh live migration on rbd

2014-05-19 Thread JinHwan Hwang
I have been trying to do live migration on vm which is running on rbd. But so far, they only give me ' internal error: rbd username 'libvirt' specified but secret not found' when i do live migration. ceph-admin : source host host : destination host root@main:/home/ceph-admin# virsh migrate --live

Re: [ceph-users] Ceph booth at http://www.solutionslinux.fr/

2014-05-19 Thread Cedric Lemarchand
Le 12/05/2014 19:14, Loic Dachary a écrit : > On 12/05/2014 11:00, Alexandre DERUMIER wrote: >> I'll be there ! Will be there too ! >> >> >> (Do you known if it'll be possible to buy some ceph t-shirts ?) As a side note, have some mug ? ;-) Cheers ! >> > > Absolutely ! If you want large quantities

[ceph-users] Working at RedHat & Ceph User Committee

2014-05-19 Thread Loic Dachary
Hi Ceph, TL;DR: I'm starting a new position at RedHat in the Ceph development team, mid-august. I will keep working under the newly elected head of the Ceph User Committee. Cloudwatt is a company based in France which provides cloud services. My participation in Ceph (and erasure code specific

Re: [ceph-users] Problem with radosgw and some file name characters

2014-05-19 Thread Andrei Mikhailovsky
Yehuda, I've tried the rewrite rule that you've suggested, but it is not working for me. I get 404 when trying to access the service. RewriteRule ^/(.*) /s3gw.3.fcgi?%{QUERY_STRING} [E=HTTP_AUTHORIZATION:%{HTTP:Authorization},L] Any idea what is wrong with this rule? Cheers Andrei --

Re: [ceph-users] Various file lengths while uploading the same file

2014-05-19 Thread Yehuda Sadeh
On Mon, May 19, 2014 at 12:19 AM, Arthur Tumanyan wrote: > Hi, > I'm writing an fastcgi application, which just gets data from stdin and > appends it to ceph. > Please,have a look: > > while (0 != (written = fread(buffer, sizeof (char), sizeof > buffer, stdin))) { >

[ceph-users] Various file lengths while uploading the same file

2014-05-19 Thread Arthur Tumanyan
Hi, I'm writing an fastcgi application, which just gets data from stdin and appends it to ceph. Please,have a look: while (0 != (written = fread(buffer, sizeof (char), sizeof buffer, stdin))) { if (written < 0) { logger("Error: %s\n", str