[ceph-users] Re: cephfs: massive drop in MDS requests per second with increasing number of caps

2021-01-20 Thread Frank Schilder
sø Campus Bygning 109, rum S14 From: Dietmar Rieder Sent: 20 January 2021 14:18:19 To: Frank Schilder; ceph-users@ceph.io Subject: Re: [ceph-users] Re: cephfs: massive drop in MDS requests per second with increasing number of caps Hi Frank, yes I ran several tests going down from the

[ceph-users] Re: cephfs: massive drop in MDS requests per second with increasing number of caps

2021-01-20 Thread Frank Schilder
=== > Frank Schilder > AIT Risø Campus > Bygning 109, rum S14 > > > From: Dietmar Rieder > Sent: 18 January 2021 21:01:50 > To: ceph-users@ceph.io > Subject: [ceph-users] Re: cephfs: massive drop in MDS requests per second > with increasin

[ceph-users] Re: cephfs: massive drop in MDS requests per second with increasing number of caps

2021-01-20 Thread Dietmar Rieder
: Dietmar Rieder Sent: 19 January 2021 13:24:15 To: Frank Schilder; ceph-users@ceph.io Subject: Re: [ceph-users] Re: cephfs: massive drop in MDS requests per second with increasing number of caps Hi Frank, you don't need to remount the fs. The kernel driver should react to the change on th

[ceph-users] Re: cephfs: massive drop in MDS requests per second with increasing number of caps

2021-01-19 Thread Dietmar Rieder
From: Dietmar Rieder Sent: 18 January 2021 21:01:50 To: ceph-users@ceph.io Subject: [ceph-users] Re: cephfs: massive drop in MDS requests per second with increasing number of caps Hi Burkhard, hi list, I checked the 'mds_max_caps_per_client' setting and it turned out that i

[ceph-users] Re: cephfs: massive drop in MDS requests per second with increasing number of caps

2021-01-19 Thread Frank Schilder
rmance impact. Best regards, = Frank Schilder AIT Risø Campus Bygning 109, rum S14 From: Dietmar Rieder Sent: 18 January 2021 21:01:50 To: ceph-users@ceph.io Subject: [ceph-users] Re: cephfs: massive drop in MDS requests per second with incre

[ceph-users] Re: cephfs: massive drop in MDS requests per second with increasing number of caps

2021-01-18 Thread Dietmar Rieder
Hi Burkhard, hi list, I checked the 'mds_max_caps_per_client' setting and it turned out that it was set to the default value of 1 million. The 'mds_cache_memory_limit' setting, however I had previously set to 40GB. Given this, I now started to play around with the max_caps and set 'mds_max

[ceph-users] Re: cephfs: massive drop in MDS requests per second with increasing number of caps

2021-01-18 Thread Dietmar Rieder
Hi Burkhard, thanks so much for the quick reply and the explanation and suggestions. I'll check these settings and eventually change them and report back. Best Dietmar On 1/18/21 6:00 PM, Burkhard Linke wrote: Hi, On 1/18/21 5:46 PM, Dietmar Rieder wrote: Hi all, we noticed a massive drop

[ceph-users] Re: cephfs: massive drop in MDS requests per second with increasing number of caps

2021-01-18 Thread Burkhard Linke
Hi, On 1/18/21 5:46 PM, Dietmar Rieder wrote: Hi all, we noticed a massive drop in requests per second a cephfs client is able to perform when we do a recursive chown over a directory with millions of files. As soon as we see about 170k caps on the MDS, the client performance drops from abou