Thank you for your reply. But,sometimes successed, when i rerun the job. And the job process the same data using the same code.
From: Margusja Date: 2017-11-09 14:25 To: bing...@iflytek.com CC: user Subject: Re: spark job paused(active stages finished) You have to deal with failed jobs. In example try catch in your code. Br Margus Roo On 9 Nov 2017, at 05:37, bing...@iflytek.com wrote: Dear,All I have a simple spark job, as below, all tasks in the stage 2(sth failed, retry) already finished. But the next stage never run. <Catch.jpg> driver thread dump: attachment( thread.dump) driver last log: <CatchAFFD.jpg> driver do not receive the 16 retry tasks report.Thank you ideas. <thread.dump> --------------------------------------------------------------------- To unsubscribe e-mail: user-unsubscr...@spark.apache.org