Re: 答复: 答复: 答复: 答复: spark streaming context trigger invoke stop why?

2016-01-18 Thread Shixiong(Ryan) Zhu
pache.spark.rdd.RDD.iterator(RDD.scala:264) > > at > org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:66) > > at org.apache.spark.scheduler.Task.run(Task.scala:88) > > at > org.apache.spark.executor.Executor$TaskRunner.run(Executor.scal

答复: 答复: 答复: 答复: spark streaming context trigger invoke stop why?

2016-01-16 Thread Triones,Deng(vip.com)
or.default-dispatcher-4]: Sent stop signal to all 42 receivers 发件人: Shixiong(Ryan) Zhu [mailto:shixi...@databricks.com] 发送时间: 2016年1月16日 6:28 收件人: 邓刚[技术中心] 抄送: Yogesh Mahajan; user 主题: Re: 答复: 答复: 答复: spark streaming context trigger invoke stop why? I see. So when your job fails, `jsc.awaitTerm

Re: 答复: 答复: 答复: spark streaming context trigger invoke stop why?

2016-01-15 Thread Shixiong(Ryan) Zhu
gt; > jsc.awaitTermination(); > > > > > > *发件人:* Shixiong(Ryan) Zhu [mailto:shixi...@databricks.com] > *发送时间:* 2016年1月15日 6:02 > *收件人:* 邓刚[技术中心] > *抄送:* Yogesh Mahajan; user > *主题:* Re: 答复: 答复: spark streaming context trigger invoke stop why? > > >

答复: 答复: 答复: spark streaming context trigger invoke stop why?

2016-01-14 Thread Triones,Deng(vip.com)
nes.d...@vipshop.com>> wrote: What’s more, I am running a 7*24 hours job , so I won’t call System.exit() by myself. So I believe somewhere of the driver kill itself 发件人: 邓刚[技术中心] 发送时间: 2016年1月14日 15:45 收件人: 'Yogesh Mahajan' 抄送: user 主题: 答复: 答复: spark streaming context trigger invoke s

Re: 答复: 答复: spark streaming context trigger invoke stop why?

2016-01-14 Thread Shixiong(Ryan) Zhu
stem.exit() > by myself. So I believe somewhere of the driver kill itself > > > > *发件人:* 邓刚[技术中心] > *发送时间:* 2016年1月14日 15:45 > *收件人:* 'Yogesh Mahajan' > *抄送:* user > *主题:* 答复: 答复: spark streaming context trigger invoke stop why? > > > > Thanks for your response, Appli

答复: 答复: spark streaming context trigger invoke stop why?

2016-01-13 Thread Triones,Deng(vip.com)
What’s more, I am running a 7*24 hours job , so I won’t call System.exit() by myself. So I believe somewhere of the driver kill itself 发件人: 邓刚[技术中心] 发送时间: 2016年1月14日 15:45 收件人: 'Yogesh Mahajan' 抄送: user 主题: 答复: 答复: spark streaming context trigger invoke stop why? Thanks for your response

答复: 答复: spark streaming context trigger invoke stop why?

2016-01-13 Thread Triones,Deng(vip.com)
am using spark version 1.5.2 发件人: Triones,Deng(vip.com<http://vip.com>) [mailto:triones.d...@vipshop.com<mailto:triones.d...@vipshop.com>] 发送时间: 2016年1月14日 11:24 收件人: user 主题: spark streaming context trigger invoke stop why? Hi all As I saw the driver log, the task failed 4 tim

Re: 答复: spark streaming context trigger invoke stop why?

2016-01-13 Thread Yogesh Mahajan
d...@vipshop.com> wrote: > More info > > > > I am using spark version 1.5.2 > > > > > > *发件人:* Triones,Deng(vip.com) [mailto:triones.d...@vipshop.com] > *发送时间:* 2016年1月14日 11:24 > *收件人:* user > *主题:* spark streaming context trigger invoke stop why? &g

答复: spark streaming context trigger invoke stop why?

2016-01-13 Thread Triones,Deng(vip.com)
More info I am using spark version 1.5.2 发件人: Triones,Deng(vip.com) [mailto:triones.d...@vipshop.com] 发送时间: 2016年1月14日 11:24 收件人: user 主题: spark streaming context trigger invoke stop why? Hi all As I saw the driver log, the task failed 4 times in a stage, the stage will be dropped

spark streaming context trigger invoke stop why?

2016-01-13 Thread Triones,Deng(vip.com)
Hi all As I saw the driver log, the task failed 4 times in a stage, the stage will be dropped when the input block was deleted before make use of. After that the StreamingContext invoke stop. Does anyone know what kind of akka message trigger the stop or which code trigger the

Re: 答复: spark streaming context trigger invoke stop why?

2016-01-13 Thread Yogesh Mahajan
ng spark version 1.5.2 >> >> >> >> >> >> *发件人:* Triones,Deng(vip.com) [mailto:triones.d...@vipshop.com] >> *发送时间:* 2016年1月14日 11:24 >> *收件人:* user >> *主题:* spark streaming context trigger invoke stop why? >> >> >> >> Hi all