[ceph-users] Re: regurlary 'no space left on device' when deleting on cephfs

2019-09-11 Thread Kenneth Waegeman
On 11/09/2019 04:14, Yan, Zheng wrote: On Wed, Sep 11, 2019 at 6:51 AM Kenneth Waegeman wrote: We sync the file system without preserving hard links. But we take snapshots after each sync, so I guess deleting files which are still in snapshots can also be in the stray directories?

[ceph-users] Re: regurlary 'no space left on device' when deleting on cephfs

2019-09-10 Thread Yan, Zheng
On Wed, Sep 11, 2019 at 6:51 AM Kenneth Waegeman wrote: > > We sync the file system without preserving hard links. But we take > snapshots after each sync, so I guess deleting files which are still in > snapshots can also be in the stray directories? > > [root@mds02 ~]# ceph daemon mds.mds02 perf

[ceph-users] Re: regurlary 'no space left on device' when deleting on cephfs

2019-09-10 Thread Kenneth Waegeman
We sync the file system without preserving hard links. But we take snapshots after each sync, so I guess deleting files which are still in snapshots can also be in the stray directories? [root@mds02 ~]# ceph daemon mds.mds02 perf dump | grep -i 'stray\|purge'     "finisher-PurgeQueue": {   

[ceph-users] Re: regurlary 'no space left on device' when deleting on cephfs

2019-09-10 Thread Burkhard Linke
Hi, do you use hard links in your workload? The 'no space left on device' message may also refer to too many stray files. Strays are either files that are to be deleted (e.g. the purge queue), but also files which are deleted, but hard links are still pointing to the same content. Since