Re: Getting the total Mapred time

2011-04-28 Thread sumit ghosh
nction in Pig > Latin. > What will be the syntax in Pig Latin. > > > Thanks, > Sumit > > > > From: Dmitriy Ryaboy > To: user@pig.apache.org; gopi.dai...@gmail.com > Sent: Sun, 24 April, 2011 5:04:20 AM > Subject: Re: Getting

Re: Getting the total Mapred time

2011-04-25 Thread Dmitriy Ryaboy
on in Pig > Latin. > What will be the syntax in Pig Latin. > > > Thanks, > Sumit > > > > From: Dmitriy Ryaboy > To: user@pig.apache.org; gopi.dai...@gmail.com > Sent: Sun, 24 April, 2011 5:04:20 AM > Subject: Re: Getting the

Re: Getting the total Mapred time

2011-04-25 Thread sumit ghosh
the total Mapred time I am still unclear on what isn't clear :) What are you trying to do? Did you read the javadocs for PigStats? To call get duration it's just PigStats stats = PigRunner.run(myscript, mylistener); long duration = stats.getDuration(); D On Sat, Apr 23, 2011 a

Re: Getting the total Mapred time

2011-04-23 Thread Dmitriy Ryaboy
I am still unclear on what isn't clear :) What are you trying to do? Did you read the javadocs for PigStats? To call get duration it's just PigStats stats = PigRunner.run(myscript, mylistener); long duration = stats.getDuration(); D On Sat, Apr 23, 2011 at 10:09 AM, Chaitanya Sharma wrote:

Re: Getting the total Mapred time

2011-04-23 Thread Chaitanya Sharma
Are there any example's around this which could prove useful for understanding this? Thanks, Chaitanya On Fri, Apr 22, 2011 at 1:52 PM, Dmitriy Ryaboy wrote: > I may be misunderstanding what you are asking. The tricky part is measuring > MR time *without* wait time, which one cannot control (it

Re: Getting the total Mapred time

2011-04-23 Thread sumit ghosh
Thanks. I will try that out. Any idea on the second one - What will be the pig syntax for using this function "getDuration(); Thanks, Sumit. From: Dmitriy Ryaboy To: user@pig.apache.org Sent: Fri, 22 April, 2011 11:22:54 PM Subject: Re: Getting the

Re: Getting the total Mapred time

2011-04-22 Thread Dmitriy Ryaboy
I may be misunderstanding what you are asking. The tricky part is measuring MR time *without* wait time, which one cannot control (it depends mostly on the size and utilization level of your cluster). This tricky bit is what PigStats helps you with. If you just want to measure the full time, includ

Getting the total Mapred time

2011-04-21 Thread sumit ghosh
Hi, How to get the actual time spent in doing all the map-reduce operations while executing a pig script. It should exclude the time wait for the scheduler - and any other waiting time. Please help. Another question is - how to use the function getDuration() in: http://pig.apache.org/docs/r0.8.