Re: [Gluster-devel] md-cache improvements

2016-08-18 Thread Dan Lambright
Pranith > Kumar Karampuri" , "Gluster Devel" > > Sent: Thursday, August 18, 2016 9:32:34 AM > Subject: Re: [Gluster-devel] md-cache improvements > > On Mon, Aug 15, 2016 at 10:39:40PM -0400, Vijay Bellur wrote: > > Hi Poornima, Dan - > > > > Let u

Re: [Gluster-devel] md-cache improvements

2016-08-18 Thread Niels de Vos
> On 08/11/2016 01:04 AM, Poornima Gurusiddaiah wrote: > > > > My comments inline. > > > > Regards, > > Poornima > > > > - Original Message - > > > From: "Dan Lambright" > > > To: "Gluster Devel" &g

Re: [Gluster-devel] md-cache improvements

2016-08-17 Thread Dan Lambright
- Original Message - > From: "Niels de Vos" > To: "Raghavendra G" > Cc: "Dan Lambright" , "Gluster Devel" > , "Csaba Henk" > > Sent: Wednesday, August 17, 2016 4:49:41 AM > Subject: Re: [Gluster-devel] md-cache im

Re: [Gluster-devel] md-cache improvements

2016-08-17 Thread Niels de Vos
gt; > > > Sent: Wednesday, August 17, 2016 4:49:41 AM > > Subject: Re: [Gluster-devel] md-cache improvements > > > > On Wed, Aug 17, 2016 at 11:42:25AM +0530, Raghavendra G wrote: > > > On Fri, Aug 12, 2016 at 10:29 AM, Raghavendra G > > > wrote: >

Re: [Gluster-devel] md-cache improvements

2016-08-17 Thread Niels de Vos
On Wed, Aug 17, 2016 at 11:42:25AM +0530, Raghavendra G wrote: > On Fri, Aug 12, 2016 at 10:29 AM, Raghavendra G > wrote: > > > > > > > On Thu, Aug 11, 2016 at 9:31 AM, Raghavendra G > > wrote: > > > >> Couple of more areas to explore: > >> 1. purging kernel dentry and/or page-cache too. Because

Re: [Gluster-devel] md-cache improvements

2016-08-16 Thread Raghavendra G
On Fri, Aug 12, 2016 at 10:29 AM, Raghavendra G wrote: > > > On Thu, Aug 11, 2016 at 9:31 AM, Raghavendra G > wrote: > >> Couple of more areas to explore: >> 1. purging kernel dentry and/or page-cache too. Because of patch [1], >> upcall notification can result in a call to inode_invalidate, whi

Re: [Gluster-devel] md-cache improvements

2016-08-16 Thread Vijay Bellur
On 08/16/2016 07:22 PM, Michael Adam wrote: Hi all, On 2016-08-15 at 22:39 -0400, Vijay Bellur wrote: Hi Poornima, Dan - Let us have a hangout/bluejeans session this week to discuss the planned md-cache improvements, proposed timelines and sort out open questions if any. Because the initial

Re: [Gluster-devel] md-cache improvements

2016-08-16 Thread Michael Adam
; On 08/11/2016 01:04 AM, Poornima Gurusiddaiah wrote: > > > > My comments inline. > > > > Regards, > > Poornima > > > > - Original Message - > > > From: "Dan Lambright" > > > To: "Gluster Devel" &g

Re: [Gluster-devel] md-cache improvements

2016-08-15 Thread Vijay Bellur
Gurusiddaiah wrote: My comments inline. Regards, Poornima - Original Message - From: "Dan Lambright" To: "Gluster Devel" Sent: Wednesday, August 10, 2016 10:35:58 PM Subject: [Gluster-devel] md-cache improvements There have been recurring discussions within the gluste

Re: [Gluster-devel] md-cache improvements

2016-08-11 Thread Raghavendra G
On Thu, Aug 11, 2016 at 9:31 AM, Raghavendra G wrote: > Couple of more areas to explore: > 1. purging kernel dentry and/or page-cache too. Because of patch [1], > upcall notification can result in a call to inode_invalidate, which results > in an "invalidate" notification to fuse kernel module. W

Re: [Gluster-devel] md-cache improvements

2016-08-10 Thread Poornima Gurusiddaiah
My comments inline. Regards, Poornima - Original Message - > From: "Dan Lambright" > To: "Gluster Devel" > Sent: Wednesday, August 10, 2016 10:35:58 PM > Subject: [Gluster-devel] md-cache improvements > > > There have been recurring discussi

Re: [Gluster-devel] md-cache improvements

2016-08-10 Thread Raghavendra G
Couple of more areas to explore: 1. purging kernel dentry and/or page-cache too. Because of patch [1], upcall notification can result in a call to inode_invalidate, which results in an "invalidate" notification to fuse kernel module. While I am sure that, this notification will purge page-cache fro

[Gluster-devel] md-cache improvements

2016-08-10 Thread Dan Lambright
There have been recurring discussions within the gluster community to build on existing support for md-cache and upcalls to help performance for small file workloads. In certain cases, "lookup amplification" dominates data transfers, i.e. the cumulative round trip times of multiple LOOKUPs from