Re: [Cluster-devel] [GFS2 PATCH] gfs2: Always update the in-core rgrp when the buffer_head is read

2018-08-16 Thread Steven Whitehouse
Hi, On 15/08/18 18:04, Bob Peterson wrote: Hi, Before this patch, function gfs2_rgrp_bh_get would only update the rgrp info from the buffer if the GFS2_RDF_UPTODATE flag was clear. This went back to the days when gfs2 kept rgrp version numbers, and re-read the buffer_heads constantly, not just

[Cluster-devel] RFC: growing files more than 4k at the time while writing

2018-08-16 Thread Stefano Panella
Hi, I am looking at gfs2 performance when there is Virtual Machine workload and have some questions: If we have a system where every host is writing sequentially, o_direct, 512k at the time, 20 files or more each host, we can see very high CPU usage and lot of contention on resource groups. I

Re: [Cluster-devel] [PATCH 00/25] GFS2: Pre-pull patch posting (merge window)

2018-08-16 Thread Andreas Gruenbacher
On 13 August 2018 at 19:45, Andreas Gruenbacher wrote: > Hi, > > we've got 25 patches queued for this merge window, in the following > areas: > > 1. Iomap support for buffered writes and for direct I/O. > 2. Two patches that reduce the size of struct gfs2_inode. > 3. Lots of fixes and cleanu

Re: [Cluster-devel] RFC: growing files more than 4k at the time while writing

2018-08-16 Thread Steven Whitehouse
Hi, On 16/08/18 13:56, Stefano Panella wrote: Hi, I am looking at gfs2 performance when there is Virtual Machine workload and have some questions: If we have a system where every host is writing sequentially, o_direct, 512k at the time, 20 files or more each host, we can see very high CPU

Re: [Cluster-devel] [GFS2 PATCH] gfs2: improve debug information when lvb mismatches are found

2018-08-16 Thread Steven Whitehouse
Hi, On 15/08/18 18:13, Bob Peterson wrote: Hi, Before this patch, gfs2_rgrp_bh_get would check for lvb mismatches, but it wouldn't tell you what was actually wrong. This patch adds more information to help us debug it. It also makes rgrp consistency checks dump any bad rgrps, and the rgrp dump

Re: [Cluster-devel] RFC: growing files more than 4k at the time while writing

2018-08-16 Thread Stefano Panella
Hi Steven, Thanks for your reply, unfortunately for us we need to wait a bit until we can take all the iomap changes because we are still on a 4.4 kernel and to backport the iomap framework would be huge. Regarding fixing the application to do fallocate 16MBs at the time, the problem is that

Re: [Cluster-devel] RFC: growing files more than 4k at the time while writing

2018-08-16 Thread Steven Whitehouse
Hi, On 16/08/18 16:05, Stefano Panella wrote: Hi Steven, Thanks for your reply, unfortunately for us we need to wait a bit until we can take all the iomap changes because we are still on a 4.4 kernel and to backport the iomap framework would be huge. Regarding fixing the application to do