Re: [ceph-users] Size of RBD images

2013-11-21 Thread nicolasc
Thanks Josh! This is a lot clearer now. I understand that librbd is low-level, but still, a warning wouldn't hurt, would it? Just check if the size parameter is larger than the cluster capacity, no? Thank you for pointing out the trick of simply deleting the rbd_header, I will try that now.

Re: [ceph-users] Size of RBD images

2013-11-21 Thread Wolfgang Hennerbichler
-- http://www.wogri.at On Nov 21, 2013, at 10:30 AM, nicolasc nicolas.cance...@surfsara.nl wrote: Thanks Josh! This is a lot clearer now. I understand that librbd is low-level, but still, a warning wouldn't hurt, would it? Just check if the size parameter is larger than the cluster

Re: [ceph-users] Size of RBD images

2013-11-21 Thread nicolasc
Yes, I understand that creating an image larger than the cluster may sometimes be considered a feature. I am not suggesting it should be forbidden, simply that it should display a warning message to the operator. Full disc: I am not a Ceph dev, this is a simple user's opinion Best regards,

Re: [ceph-users] Size of RBD images

2013-11-20 Thread Bernhard Glomm
That might be, manpage of ceph version 0.72.1 tells me it isn't though. anyhow still running kernel 3.8.xx Bernhard Am 19.11.2013 20:10:04, schrieb Wolfgang Hennerbichler: On Nov 19, 2013, at 3:47 PM, Bernhard Glomm bernhard.gl...@ecologic.eu wrote: Hi Nicolas just fyi rbd format 2

Re: [ceph-users] Size of RBD images

2013-11-20 Thread nicolasc
Thank you Bernhard and Wogri. My old kernel version also explains the format issue. Once again, sorry to have mixed that in the problem. Back to my original inquiries, I hope someone can help me understand why: * it is possible to create an RBD image larger than the total capacity of the

Re: [ceph-users] Size of RBD images

2013-11-20 Thread Josh Durgin
On 11/20/2013 06:53 AM, nicolasc wrote: Thank you Bernhard and Wogri. My old kernel version also explains the format issue. Once again, sorry to have mixed that in the problem. Back to my original inquiries, I hope someone can help me understand why: * it is possible to create an RBD image

[ceph-users] Size of RBD images

2013-11-19 Thread nicolasc
Hi every one, In the course of playing with RBD, I noticed a few things: * The RBD images are so thin-provisioned, you can create arbitrarily large ones. On my 0.72.1 freshly-installed empty 200TB cluster, I was able to create a 1PB image: $ rbd create --image-format 2 --size 1073741824

Re: [ceph-users] Size of RBD images

2013-11-19 Thread Bernhard Glomm
Hi Nicolas just fyi rbd format 2 is not supported yet by the linux kernel (module) it only can be used as a target for virtual machines using librbd see: man rbd -- --image-format shrinking time: same happend to me, rbd (v1) device took about a week to shrink from 1PBĀ  to 10TB the good news: I

Re: [ceph-users] Size of RBD images

2013-11-19 Thread LaSalle, Jurvis
On 11/19/13, 2:10 PM, Wolfgang Hennerbichler wo...@wogri.com wrote: On Nov 19, 2013, at 3:47 PM, Bernhard Glomm bernhard.gl...@ecologic.eu wrote: Hi Nicolas just fyi rbd format 2 is not supported yet by the linux kernel (module) I believe this is wrong. I think linux supports rbd format 2

Re: [ceph-users] Size of RBD images

2013-11-19 Thread Gruher, Joseph R
So is there any size limit on RBD images? I had a failure this morning mounting 1TB RBD. Deleting now (why does it take so long to delete if it was never even mapped, much less written to?) and will retry with smaller images. See output below. This is 0.72 on Ubuntu 13.04 with 3.12 kernel.

Re: [ceph-users] Size of RBD images

2013-11-19 Thread Gruher, Joseph R
-Original Message- From: Gruher, Joseph R Sent: Tuesday, November 19, 2013 12:24 PM To: 'Wolfgang Hennerbichler'; Bernhard Glomm Cc: ceph-users@lists.ceph.com Subject: RE: [ceph-users] Size of RBD images So is there any size limit on RBD images? I had a failure this morning mounting