Re: Spark Streaming UI duration numbers mismatch

2016-03-30 Thread Jatin Kumar 
Hello Jean,

Were you able to reproduce the problem? I couldn't find any documentation
if the two numbers have different meaning.

--
Thanks
Jatin

On Thu, Mar 24, 2016 at 1:43 AM, Jean-Baptiste Onofré 
wrote:

> Hi Jatin,
>
> I will reproduce tomorrow and take a look.
>
> Did you already create a Jira about that (I don't think so) ? If I
> reproduce the problem (and it's really a problem), then I will create one
> for you.
>
> Thanks,
> Regards
> JB
>
> On 03/23/2016 08:20 PM, Jatin Kumar wrote:
>
>> Hello,
>>
>> Can someone please provide some help on the below issue?
>>
>> --
>> Thanks
>> Jatin
>>
>> On Tue, Mar 22, 2016 at 3:30 PM, Jatin Kumar > > wrote:
>>
>> Hello all,
>>
>> I am running spark streaming application and the duration numbers on
>> batch page and job page don't match. Please find attached
>> screenshots of the same.
>>
>> IMO processing time on batch page at top should be sum of durations
>> of all jobs and similarly the duration of a job reported on batch
>> page should be sum of durations of stages of that job.
>>
>> --
>> Thanks
>> Jatin
>>
>>
>>
> --
> Jean-Baptiste Onofré
> jbono...@apache.org
> http://blog.nanthrax.net
> Talend - http://www.talend.com
>
> -
> To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
> For additional commands, e-mail: user-h...@spark.apache.org
>
>

Re: Spark Streaming UI duration numbers mismatch

2016-03-23 Thread Jean-Baptiste Onofré 

Hi Jatin,

I will reproduce tomorrow and take a look.

Did you already create a Jira about that (I don't think so) ? If I 
reproduce the problem (and it's really a problem), then I will create 
one for you.


Thanks,
Regards
JB

On 03/23/2016 08:20 PM, Jatin Kumar wrote:

Hello,

Can someone please provide some help on the below issue?

--
Thanks
Jatin

On Tue, Mar 22, 2016 at 3:30 PM, Jatin Kumar mailto:jku...@rocketfuelinc.com>> wrote:

Hello all,

I am running spark streaming application and the duration numbers on
batch page and job page don't match. Please find attached
screenshots of the same.

IMO processing time on batch page at top should be sum of durations
of all jobs and similarly the duration of a job reported on batch
page should be sum of durations of stages of that job.

--
Thanks
Jatin




--
Jean-Baptiste Onofré
jbono...@apache.org
http://blog.nanthrax.net
Talend - http://www.talend.com

-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org

Re: Spark Streaming UI duration numbers mismatch

2016-03-23 Thread Jatin Kumar 
Hello,

Can someone please provide some help on the below issue?

--
Thanks
Jatin

On Tue, Mar 22, 2016 at 3:30 PM, Jatin Kumar 
wrote:

> Hello all,
>
> I am running spark streaming application and the duration numbers on batch
> page and job page don't match. Please find attached screenshots of the same.
>
> IMO processing time on batch page at top should be sum of durations of all
> jobs and similarly the duration of a job reported on batch page should be
> sum of durations of stages of that job.
>
> --
> Thanks
> Jatin
>