You have to deal with failed jobs. In example try catch in your code. Br Margus Roo
> On 9 Nov 2017, at 05:37, bing...@iflytek.com wrote: > > Dear,All > I have a simple spark job, as below, all tasks in the stage 2(sth failed, > retry) already finished. But the next stage never run. > > <Catch.jpg> > > driver thread dump: attachment( thread.dump) > driver last log: > <CatchAFFD.jpg> > > driver do not receive the 16 retry tasks report.Thank you ideas. > > <thread.dump> > --------------------------------------------------------------------- > To unsubscribe e-mail: user-unsubscr...@spark.apache.org > <mailto:user-unsubscr...@spark.apache.org>