Re: Re: spark job paused(active stages finished)

[bing...@iflytek.com]

Thank you for your reply.

But，sometimes successed， when i rerun the job.
And the job process the same data using the same code.

 
From: Margusja
Date: 2017-11-09 14:25
To: bing...@iflytek.com
CC: user
Subject: Re: spark job paused(active stages finished)
You have to deal with failed jobs. In example try catch in your code.

Br Margus Roo


On 9 Nov 2017, at 05:37, bing...@iflytek.com wrote:

Dear,All
I have a simple spark job, as below, all tasks in the stage 2(sth failed, 
retry) already finished. But the next stage never run.


   
driver thread dump:  attachment( thread.dump)
driver last log:


 driver do not receive the 16 retry tasks report.Thank you ideas.


-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org

Re: spark job paused(active stages finished)

[Margusja]

You have to deal with failed jobs. In example try catch in your code.

Br Margus Roo


> On 9 Nov 2017, at 05:37, bing...@iflytek.com wrote:
> 
> Dear,All
> I have a simple spark job, as below, all tasks in the stage 2(sth failed, 
> retry) already finished. But the next stage never run.
> 
> 
>
> driver thread dump:  attachment( thread.dump)
> driver last log:
> 
> 
>  driver do not receive the 16 retry tasks report.Thank you ideas.
> 
> 
> -
> To unsubscribe e-mail: user-unsubscr...@spark.apache.org 
>