[ceph-users] Re: client isn't responding to mclientcaps(revoke), pending pAsLsXsFsc issued pAsLsXsFsc

[Loic Tortay]

On 01/05/2023 11:35, Frank Schilder wrote:

Hi all,

I think we might be hitting a known problem 
(https://tracker.ceph.com/issues/57244). I don't want to fail the mds yet, 
because we have troubles with older kclients that miss the mds restart and hold 
on to cache entries referring to the killed instance, leading to hanging jobs 
on our HPC cluster.

I have seen this issue before and there was a process in D-state that 
dead-locked itself. Usually, killing this process succeeded and resolved the 
issue. However, this time I can't find such a process.

The tracker mentions that one can delete the file/folder. I have the inode 
number, but really don't want to start a find on a 1.5PB file system. Is there 
a better way to find what path is causing the issue (ask the MDS directly, look 
at a cache dump, or similar)? Is there an alternative to deletion or MDS fail?


Hello,
If you have the inode number, you can retrieve the name with something like:
 rados getxattr -p $POOL ${ino}. parent | \
  ceph-dencoder type inode_backtrace_t import - decode dump_json | \
  jq -M '[.ancestors[].dname]' | tr -d '[[",\]]' | \
  awk 't!=""{t=$1 "/" t;}t==""{t=$1;}END{print t}'

Where $POOL is the "default pool" name (for files) or the metadata pool 
name (for directories) and $ino is the inode number (in hexadecimal).



Loïc.
--
|   Loīc Tortay   - IN2P3 Computing Centre |
___
ceph-users mailing list -- ceph-users@ceph.io
To unsubscribe send an email to ceph-users-le...@ceph.io

[ceph-users] Re: cephfs quota used

[Loic Tortay]

On 12/16/21 12:45 PM, Jesper Lykkegaard Karlsen wrote:
> Hi all,
> 
> Cephfs quota work really well for me.
> A cool feature is that if one mounts a folder, which has quotas enabled, then 
> the mountpoint will show as a partition of quota size and how much is used 
> (e.g. with df command), nice!
> 
> Now, I want to access the usage information of folders with quotas from root 
> level of the cephfs.
> I have failed to find this information through getfattr commands, only quota 
> limits are shown here, and du-command on individual folders is a suboptimal 
> solution.
> The usage information must be somewhere in ceph metadata/mondb, but where and 
> how do I read?
> 
Hello,
There are extended attributes with counters at the directory level, for
instance:
 getfattr -n ceph.dir.rbytes $DIR
will show the aggregate size of all the files in the directory hierarchy
starting at $DIR.

On some distribution versions (EL7), you can list all these attributes with:
 getfattr -d -m 'ceph.dir.*' $DIR


Loïc.
-- 
|   Loïc Tortay  - IN2P3 Computing Centre  |
___
ceph-users mailing list -- ceph-users@ceph.io
To unsubscribe send an email to ceph-users-le...@ceph.io