Re: [Gluster-devel] performance issues Manoj found in EC testing

2016-06-28 Thread Pranith Kumar Karampuri
> >> Yes it will need some changes but I don't think they are big changes. I >> think the functions to decode/encode already exist. We just to need to >> move encoding/decoding as tasks and run as synctasks. >> > > I was also thinking in sleeping fops. Currently when they are resumed, > they are

Re: [Gluster-devel] performance issues Manoj found in EC testing

2016-06-28 Thread Xavier Hernandez
t;gluster-devel@gluster.org <mailto:gluster-devel@gluster.org>> *Sent: *Monday, June 27, 2016 5:48:24 PM *Subject: *Re: [Gluster-devel] performance issues Manoj found in EC testing On Mon, Jun 27, 2016 at 12:42 PM, Pranith Kumar Karampuri <pkara...@re

Re: [Gluster-devel] performance issues Manoj found in EC testing

2016-06-28 Thread Pranith Kumar Karampuri
an...@datalab.es> > *Cc: *"Gluster Devel" <gluster-devel@gluster.org> > *Sent: *Monday, June 27, 2016 5:48:24 PM > *Subject: *Re: [Gluster-devel] performance issues Manoj found in EC > testing > > > > On Mon, Jun 27, 2016 at 12:42 PM, Pranith Kumar Karampuri <

Re: [Gluster-devel] performance issues Manoj found in EC testing

2016-06-27 Thread Poornima Gurusiddaiah
Regards, Poornima - Original Message - > From: "Pranith Kumar Karampuri" <pkara...@redhat.com> > To: "Xavier Hernandez" <xhernan...@datalab.es> > Cc: "Gluster Devel" <gluster-devel@gluster.org> > Sent: Monday, June 27, 2016

Re: [Gluster-devel] performance issues Manoj found in EC testing

2016-06-27 Thread Manoj Pillai
- Original Message - > From: "Sankarshan Mukhopadhyay" <sankarshan.mukhopadh...@gmail.com> > To: "Gluster Devel" <gluster-devel@gluster.org> > Sent: Monday, June 27, 2016 5:54:19 PM > Subject: Re: [Gluster-devel] performance issues Manoj found

Re: [Gluster-devel] performance issues Manoj found in EC testing

2016-06-27 Thread Sankarshan Mukhopadhyay
On Mon, Jun 27, 2016 at 2:38 PM, Manoj Pillai wrote: > Thanks, folks! As a quick update, throughput on a single client test jumped > from ~180 MB/s to 700+MB/s after enabling client-io-threads. Throughput is > now more in line with what is expected for this workload based on >

Re: [Gluster-devel] performance issues Manoj found in EC testing

2016-06-27 Thread Pranith Kumar Karampuri
t;Gluster Devel" <gluster-devel@gluster.org> > > Sent: Monday, June 27, 2016 12:48:49 PM > > Subject: Re: [Gluster-devel] performance issues Manoj found in EC testing > > > > > > > > - Original Message - > > > From: "Pranith K

Re: [Gluster-devel] performance issues Manoj found in EC testing

2016-06-27 Thread Manoj Pillai
- Original Message - > From: "Raghavendra Gowdappa" <rgowd...@redhat.com> > To: "Pranith Kumar Karampuri" <pkara...@redhat.com> > Cc: "Gluster Devel" <gluster-devel@gluster.org> > Sent: Monday, June 27, 2016 12:48:49 PM > Su

Re: [Gluster-devel] performance issues Manoj found in EC testing

2016-06-27 Thread Xavier Hernandez
Hi Manoj, I always enable client-io-threads option for disperse volumes. It improves performance sensibly, most probably because of the problem you have detected. I don't see any other way to solve that problem. I think it would be a lot better to have a true thread pool (and maybe an I/O

Re: [Gluster-devel] performance issues Manoj found in EC testing

2016-06-25 Thread Manoj Pillai
- Original Message - > From: "Pranith Kumar Karampuri" > To: "Xavier Hernandez" > Cc: "Manoj Pillai" , "Gluster Devel" > > Sent: Thursday, June 23, 2016 8:50:44 PM > Subject: performance issues

[Gluster-devel] performance issues Manoj found in EC testing

2016-06-23 Thread Pranith Kumar Karampuri
hi Xavi, Meet Manoj from performance team Redhat. He has been testing EC performance in his stretch clusters. He found some interesting things we would like to share with you. 1) When we perform multiple streams of big file writes(12 parallel dds I think) he found one thread to be