Hello David, On Fri, Aug 20, 2021 at 7:17 AM David Prude <da...@democracynow.org> wrote: > > Hello, > > We have a cluster initially installed with pacific 16.2.5 within > which we have a single cephfs volume created as such: > > ceph fs volume create dncephfs > > We have a client.admin client: > > [client.admin] > key = REDACTED > caps mds = "allow *" > caps mgr = "allow *" > caps mon = "allow *" > caps osd = "allow *" > > We have dncephfs mounted as this client: > > mount | grep dncephfs > 10.30.0.145:6789,10.30.0.146:6789,10.30.0.147:6789,10.30.0.148:6789,10.30.0.149:6789:/ > on /mnt/dncephfs type ceph (rw,noatime,name=admin,secret=<hidden>,acl) > > We can create and delete snapshots at the / of this cephfs: > > root@ceph-01:~# cd /mnt/dncephfs/ > root@ceph-01:/mnt/dncephfs# cd .snap > root@ceph-01:/mnt/dncephfs/.snap# mkdir testsnapshot1 > > And confirm that the snapshot is seen by the mds: > > root@ceph-01:/# ceph daemon mds.dncephfs.ceph-01.zmlkdd dump snaps > { > "last_created": 14, > "last_destroyed": 13, > "snaps": [ > { > "snapid": 14, > "ino": 1, > "stamp": "2021-08-20T11:05:17.129353+0000", > "name": "testsnapshot1", > "metadata": {} > } > ] > } > > However, we are unable to create snapshots within any sub-directories of / : > > root@ceph-01:/mnt/dncephfs# mkdir exampledir > root@ceph-01:/mnt/dncephfs# cd exampledir/.snap > root@ceph-01:/mnt/dncephfs/exampledir/.snap# mkdir examplesnapshot > mkdir: cannot create directory ‘examplesnapshot’: Operation > not permitted
Have you tried remounting? Updating auth credentials usually requires remount. > We initially were mounting this volume under a different client which > did not have rwps. We tried explicitly providing rwps to that client and > then moved on to testing with our client.admin (with auth listed above). I cannot reproduce the problem... > We have tried explicitly setting "ceph fs set dncephfs allow_new_snaps > true" which had no effect. We have search the mds logs and no entries > appear on the snapshot creation failure. > > Does anyone have any idea what may be going on or further information we > should be looking at to resolve this? Next thing to do is collect mds logs: ceph config set mds debug_mds 20 ceph config set mds debug_ms 1 And share a snippet during the failure. -- Patrick Donnelly, Ph.D. He / Him / His Principal Software Engineer Red Hat Sunnyvale, CA GPG: 19F28A586F808C2402351B93C3301A3E258DD79D _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io