Hi George, I actually asked Sage about a similar scenario at the OpenStack summit in Atlanta this year -- namely if I could use the new pool quota functionality to enforce quotas on CephFS. The answer was no, that the pool quota functionality is mostly intended for radosgw and that the existing cephfs clients have no support for it. He said the quota should work, actually, but that you were likely to see some very strange behavior in cephfs. That sounds like what you've seen. It won't be a graceful failure at all.
Quotas in cephfs is a different task, and one that I'm following as well. See here: https://github.com/ceph/ceph/pull/1122 The pull request is old, but Sage did mention he was in contact with the team working on the code and was hopeful to see it finished. - Travis On Tue, Jun 24, 2014 at 7:06 AM, <george.ry...@stfc.ac.uk> wrote: > Last week I decided to take a look at the ‘osd pool set-quota’ option. > > > > I have a directory in cephFS that uses a pool called pool-2 (configured by > following this: > http://www.sebastien-han.fr/blog/2013/02/11/mount-a-specific-pool-with-cephfs/). > I have a directory in that filled with cat pictures. I ran ‘rados df’. I > then copied a couple more cat pictures into my directory using ‘cp file > destination && sync’. I then ran ‘rados df’ again, this showed an increase > in the object count for the pool equal to the number of additional cat > pictures and an increase in the pool size equal to the size of the cat > pictures, as expected. > > > > I then used the command ‘ceph osd pool set-quota {pool-name} [max_objects > {obj-count}] [max_bytes {bytes}]’, as per > http://ceph.com/docs/master/rados/operations/pools/, and set an object > limit a couple of objects bigger than the current pool size. I then ran a > loop copying more cat pictures one at a time (again with ‘&& sync’) each > time. Whilst doing this I ran ‘rados df’, the number of objects in the pool > increased up to the limit and stopped. However on the machine copying the > cat pictures, the copying appeared to work fine and running ls showed more > pictures than the ‘rados df’ command would suggest should be there. If I > accessed the same directory from a different machine, then I saw only the > pictures that were copied up to the limit. If I then removed the limit, the > images would appear in the directory and ‘rados df’ would report a larger > number of objects. Similar behaviour was observed when setting a size > limit. What’s going on? Is this expected behaviour? > > > > > > George Ryall > > > Scientific Computing | STFC Rutherford Appleton Laboratory | Harwell > Oxford | Didcot | OX11 0QX > > (01235 44) 5021 > > > > -- > Scanned by iCritical. > > > _______________________________________________ > ceph-users mailing list > ceph-users@lists.ceph.com > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > >
_______________________________________________ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
