Re: [Gluster-users] gluster CPU cycles at 100%

2014-01-29 Thread Pranith Kumar Karampuri
- Original Message - From: Jay Vyas jayunit...@gmail.com To: Paul Robert Marino prmari...@gmail.com Cc: Gluster-users@gluster.org gluster-users@gluster.org Sent: Wednesday, January 29, 2014 6:07:14 AM Subject: Re: [Gluster-users] gluster CPU cycles at 100% the workload : copying 21,000

Re: [Gluster-users] gluster CPU cycles at 100%

2014-01-28 Thread Harshavardhana
You should take a 'gluster' statedump of the process - and open a bugzilla for analysis with logs. On Tue, Jan 28, 2014 at 10:30 AM, Jay Vyas jayunit...@gmail.com wrote: Hi folks : Im running mahout on top of gluster using the GlusterFileSystem hadoop plugin. It works well, but Im noticing

Re: [Gluster-users] gluster CPU cycles at 100%

2014-01-28 Thread Jay Vyas
okay... :) .. but whats a gluster statedump? On Tue, Jan 28, 2014 at 2:08 PM, Harshavardhana har...@harshavardhana.netwrote: You should take a 'gluster' statedump of the process - and open a bugzilla for analysis with logs. On Tue, Jan 28, 2014 at 10:30 AM, Jay Vyas

Re: [Gluster-users] gluster CPU cycles at 100%

2014-01-28 Thread Jay Vyas
bump ^^ whats a gluster statedump and how do I create one? this 100+% CPU issue is very intriguing, and id like to create a bug for it (if it indeed is a bug) On Tue, Jan 28, 2014 at 3:07 PM, Jay Vyas jayunit...@gmail.com wrote: okay... :) .. but whats a gluster

Re: [Gluster-users] gluster CPU cycles at 100%

2014-01-28 Thread Jay Vyas
ah nevermind, googled it: shoulda done this earlier. On Tue, Jan 28, 2014 at 4:58 PM, Jay Vyas jayunit...@gmail.com wrote: bump ^^ whats a gluster statedump and how do I create one? this 100+% CPU issue is very intriguing, and id like to create a bug for it (if it indeed is a

Re: [Gluster-users] gluster CPU cycles at 100%

2014-01-28 Thread Paul Robert Marino
Well what do you mean by %100 CPU do you mean just 1 core or multiple also what's your IO wait percentage on your gluster servers.Its not uncommon for gluster to spike up to use more than a whole core.You may simply be exhausting the effective write cache on the gluster servers in which case

Re: [Gluster-users] gluster CPU cycles at 100%

2014-01-28 Thread Jay Vyas
the workload : copying 21,000 1KB files small files, into gluster. The CPU is spiked the whole time and it takes a long time to do the copying. There are some other moving parts, but Im pretty sure gluster shouldnt spike so high for just 21 MB of data, right? there might be an error in my