Re: [Gluster-devel] Performance experiments with io-stats translator

Thanks. So I was suggesting a repeat of the test but this time with iodepth=1 in the fio job. If reducing the no. of concurrent requests reduces drastically the high latency you're seeing from the client-side, that would strengthen the hypothesis than serialization/contention among concurrent requ

Re: [Gluster-devel] Performance experiments with io-stats translator

@Xavi/Raghavendra, Indeed. Even I suspect the mutex contention at epoll layer and I've been reading the corresponding code (my first time) ever since I got these numbers. I will get back to you if I have any specific questions for you around this. -Krutika On Thu, Jun 8, 2017 at 9:58 AM, Raghave

Re: [Gluster-devel] Performance experiments with io-stats translator

Hi, So I used Sanjay's setup to get these numbers. So I'm guessing it's a 10G network. I will check again and let you know if that isn't the case. -Krutika On Tue, Jun 6, 2017 at 9:38 PM, Vijay Bellur wrote: > Nice work! > > What is the network interconnect bandwidth? How much of the network >

Re: [Gluster-devel] Performance experiments with io-stats translator

Hi, This is what my job file contains: [global] ioengine=libaio #unified_rw_reporting=1 randrepeat=1 norandommap=1 group_reporting direct=1 runtime=60 thread size=16g [workload] bs=4k rw=randread iodepth=8 numjobs=1 file_service_type=random filename=/perf5/iotest/fio_5 filename=/perf6/iotest/fi

Re: [Gluster-devel] Performance experiments with io-stats translator

On Wed, Jun 7, 2017 at 11:59 AM, Xavier Hernandez wrote: > Hi Krutika, > > On 06/06/17 13:35, Krutika Dhananjay wrote: > >> Hi, >> >> As part of identifying performance bottlenecks within gluster stack for >> VM image store use-case, I loaded io-stats at multiple points on the >> client and brick

Re: [Gluster-devel] Rebalance source code

- Original Message - > From: "Tahereh Fattahi" > To: "Nithya Balachandran" , "Susant Palai" > , "Gluster Devel" > > Sent: Wednesday, June 7, 2017 8:05:35 PM > Subject: Re: [Gluster-devel] Rebalance source code > > I had seen this function before but when dht xlator is not loaded in se

[Gluster-devel] gluster-block v0.2.1 is alive!

Hello Gluster folks, gluster-block [1] release 0.2.1 is tagged, this release is more focused on bug fixing. All the documents are updated and packages made available at copr for fedora users [2] However for other distros one can easily compile it from source, find the install guide at [3] The so

Re: [Gluster-devel] [Qusetions] How profile affect glusterfs performance?

On 06/07/2017 02:41 PM, Pranith Kumar Karampuri wrote: Hi Yuan, On Wed, Jun 7, 2017 at 1:14 PM, liuy...@cmss.chinamobile.com mailto:liuy...@cmss.chinamobile.com>> wrote: Hi Pranith, First of all, we owe you guys big thanks for your excellent

Re: [Gluster-devel] Gluster Community Meeting 2017-06-07

Today's meeting didn't happen due to low turnout. The next meeting is on 2017-06-21. ~kaushal On Wed, Jun 7, 2017 at 6:06 PM, Kaushal M wrote: > Just a reminder. The community meeting is scheduled to happen in about > 2.5 hours. Please add topics you want to discuss and any updates you > have to

[Gluster-devel] glusterfsd crash when using quota without io-threads

After deleting io-threads from the vols, quota operates (list/set/modify) lets glusterfsd crash. I use it at CentOS 7 (CentOS Linux release 7.3.1611) with glusterfs 3.8.12. It seems the stack corrupt, when testing with the following diff, glusterfsd runs correctly. There are two questions as, 1.

Re: [Gluster-devel] Rebalance source code

I had seen this function before but when dht xlator is not loaded in server side, how this function will be called? On Wed, Jun 7, 2017 at 4:58 PM, Nithya Balachandran wrote: > > > On 7 June 2017 at 17:31, Tahereh Fattahi wrote: > >> Hi >> I want to follow the process when rebalance command is

[Gluster-devel] Coverity covscan for 2017-06-07-bae51359 (master branch)

GlusterFS Coverity covscan results are available from http://download.gluster.org/pub/gluster/glusterfs/static-analysis/master/glusterfs-coverity/2017-06-07-bae51359 ___ Gluster-devel mailing list Gluster-devel@gluster.org http://lists.gluster.org/mailman

[Gluster-devel] Gluster Community Meeting 2017-06-07

Just a reminder. The community meeting is scheduled to happen in about 2.5 hours. Please add topics you want to discuss and any updates you have to the meeting notepad at [1]. ~kaushal [1]: https://bit.ly/gluster-community-meetings ___ Gluster-devel mai

[Gluster-devel] Rebalance source code

Hi I want to follow the process when rebalance command is done. Which files should I read? I see something in cli directory that sends request to another abject. But I need to find function that do core operation of rebalance. I expect to see something like this in one function: function rebalance

Re: [Gluster-devel] [Qusetions] How profile affect glusterfs performance?

On Wed, Jun 7, 2017 at 2:28 PM, Xie Changlong wrote: > 在 6/7/2017 4:47 PM, Pranith Kumar Karampuri 写道: > >> Yes, they do. The patches I gave earlier provide the facility to this in >> io-stats. Do let us know if you have any doubts. >> > > Sorry for slowness, but i think i catch up with U now. >

Re: [Gluster-devel] [Qusetions] How profile affect glusterfs performance?

On Wed, Jun 7, 2017 at 1:14 PM, liuy...@cmss.chinamobile.com < liuy...@cmss.chinamobile.com> wrote: > Hi Pranith, > > First of all, we owe you guys big thanks for your excellent work. > > I'm the lead of storage team in China Mobile, Xiubo is also in my team :) > Ah! nice :-). > > We have deplo

Re: [Gluster-devel] [Qusetions] How profile affect glusterfs performance?

在 6/7/2017 4:47 PM, Pranith Kumar Karampuri 写道: Yes, they do. The patches I gave earlier provide the facility to this in io-stats. Do let us know if you have any doubts. Sorry for slowness, but i think i catch up with U now. -- Thanks -Xie _

Re: [Gluster-devel] [Qusetions] How profile affect glusterfs performance?

On Wed, Jun 7, 2017 at 1:55 PM, Xie Changlong wrote: > 在 6/7/2017 3:08 PM, Pranith Kumar Karampuri 写道: > >> On Tue, Jun 6, 2017 at 8:14 AM, Xie Changlong >> wrote: >> >> 在 6/5/2017 6:30 PM, Pranith Kumar Karampuri 写道: >>> >>> I meant what are you using gluster for? VM workload or image/video fil

Re: [Gluster-devel] [Qusetions] How profile affect glusterfs performance?

Hi Pranith, First of all, we owe you guys big thanks for your excellent work. I'm the lead of storage team in China Mobile, Xiubo is also in my team :) We have deployed more than 100 glusterfs nodes in producion(20 nodes for the biggest single cluster), so far so good. Use case ranging from im

Re: [Gluster-devel] [Qusetions] How profile affect glusterfs performance?

在 6/7/2017 3:08 PM, Pranith Kumar Karampuri 写道: On Tue, Jun 6, 2017 at 8:14 AM, Xie Changlong wrote: 在 6/5/2017 6:30 PM, Pranith Kumar Karampuri 写道: I meant what are you using gluster for? VM workload or image/video file creation or lots of small files etc etc. 1) We use glusterfs for gen

Re: [Gluster-devel] [Qusetions] How profile affect glusterfs performance?

On Tue, Jun 6, 2017 at 8:14 AM, Xie Changlong wrote: > 在 6/5/2017 6:30 PM, Pranith Kumar Karampuri 写道: > >> I meant what are you using gluster for? VM workload or image/video file >> creation or lots of small files etc etc. >> > > 1) We use glusterfs for general purpose, no limit to image/video f