Re: Profiling Pig Query

Hi Dmitriy / Keren - To profile pig queries, I was looking into these two tools. 1. Yourkit (Thanks to Thejas) - You can find a document here and also here

Re: Profiling Pig Query

Hi Keren, I ended up using Yourkit Java profiler with Pig. It works for me. Thanks On Sat, May 12, 2012 at 4:28 PM, Keren Ouaknine wrote: > Hello, > > I am interested by this topic (profiling pig), any progress since last > suggestion? > Thanks, > Keren > > On Fri, Apr 13, 2012 at 4:47 AM, Atu

Re: Profiling Pig Query

Hello, I am interested by this topic (profiling pig), any progress since last suggestion? Thanks, Keren On Fri, Apr 13, 2012 at 4:47 AM, Atul Thapliyal < atul.thapli...@aggiemail.usu.edu> wrote: > Hi Dmitriy, > > Thanks for you reply. If nothing comes up then I will try to use Hprof with > Pig.

Re: Profiling Pig Query

Hi Dmitriy, Thanks for you reply. If nothing comes up then I will try to use Hprof with Pig. Though I am not sure if its going to work. Thanks again !! On Thu, Apr 12, 2012 at 6:12 PM, Dmitriy Ryaboy wrote: > Hi Atul, > I usually profile by running pig in local mode and connecting to it > from

Re: Profiling Pig Query

Hi Atul, I usually profile by running pig in local mode and connecting to it from yourkit (or whatever profiler you like best). To understand what's happening on a live cluster, I don't currently have anything fancy -- just looking at the normal system stats, doing occasional jstacks, etc. If peop

Profiling Pig Query

Hi Guys, Has anyone used any tools to profile a pig query ? or Can anyone guide me on 'How to profile a pig query". I am trying to figure out the CPU, disk I/O, RAM usage. I have tried Starfish but its current release doesn't support Pig. Thanks for reading !! -- Warm Regards Atul