Re: [lustre-discuss] Slow release of inodes on OST

2020-02-08 Thread Andreas Dilger
I suspect that having a totally idle system may actually slow things down, since the destroys may be waiting for transaction commits. That said, it probably makes sense to increase the default values for these tunables a bit. Could you please file an LU ticket with the details. Ideally with so

Re: [lustre-discuss] Slow release of inodes on OST

2020-02-08 Thread Åke Sandgren
The filesystems are completely idle during this. It's a test setup where I'm running io500 and doing nothing else. I set osp.rsos-OST-osc-MDT.max_rpcs_in_flight=512 osp.rsos-OST-osc-MDT.max_rpcs_in_progress=32768 which severely reduced my waiting time between runs. The in_progress

Re: [lustre-discuss] Slow release of inodes on OST

2020-02-07 Thread Andreas Dilger
I haven't looked at that code recently, but I suspect that it is waiting for journal commits to complete every 5s before sending another batch of destroys? Is the filesystem otherwise idle or something? On Feb 7, 2020, at 02:34, Åke Sandgren mailto:ake.sandg...@hpc2n.umu.se>> wrote: Loocking

Re: [lustre-discuss] Slow release of inodes on OST

2020-02-07 Thread Åke Sandgren
Loocking at the osp.*.sync* values i see osp.rsos-OST-osc-MDT.sync_changes=14174002 osp.rsos-OST-osc-MDT.sync_in_flight=0 osp.rsos-OST-osc-MDT.sync_in_progress=4096 osp.rsos-OST-osc-MDT.destroys_in_flight=14178098 And it takes 10 sec between changes of those values.

Re: [lustre-discuss] Slow release of inodes on OST

2020-02-05 Thread Åke Sandgren
On 2/6/20 6:58 AM, Andreas Dilger wrote: > On Feb 4, 2020, at 07:23, Åke Sandgren > wrote: >> >> When I create a large number of files on an OST and then remove them, >> the used inode count on the OST decreases very slowly, it takes several >> hours for it to g

Re: [lustre-discuss] Slow release of inodes on OST

2020-02-05 Thread Åke Sandgren
On 2/6/20 6:58 AM, Andreas Dilger wrote: > On Feb 4, 2020, at 07:23, Åke Sandgren > wrote: >> >> When I create a large number of files on an OST and then remove them, >> the used inode count on the OST decreases very slowly, it takes several >> hours for it to g

Re: [lustre-discuss] Slow release of inodes on OST

2020-02-05 Thread Andreas Dilger
On Feb 4, 2020, at 07:23, Åke Sandgren mailto:ake.sandg...@hpc2n.umu.se>> wrote: When I create a large number of files on an OST and then remove them, the used inode count on the OST decreases very slowly, it takes several hours for it to go from 3M to the correct ~10k. (I'm running the io500 te

Re: [lustre-discuss] Slow release of inodes on OST

2020-02-04 Thread Åke Sandgren
Forgot to mention that I'm running 2.13.0 from git on the servers. On 2/4/20 3:23 PM, Åke Sandgren wrote: > Hi! > > When I create a large number of files on an OST and then remove them, > the used inode count on the OST decreases very slowly, it takes several > hours for it to go from 3M to the c

[lustre-discuss] Slow release of inodes on OST

2020-02-04 Thread Åke Sandgren
Hi! When I create a large number of files on an OST and then remove them, the used inode count on the OST decreases very slowly, it takes several hours for it to go from 3M to the correct ~10k. (I'm running the io500 test suite) Is there something I can do to make it release them faster? Right n