Re: [Spark on mesos] Spark framework not re-registered and lost after mesos master restarted

2017-03-30 Thread Yu Wei
I miss something? Any advice? > > > Thanks, > > Jared, (韦煜) > Software developer > Interested in open source software, big data, Linux > > > > > From: Timothy Chen > Sent: Friday, March 31, 2017 5:13 AM > To: Yu Wei > Cc: us...@sp

Re: [Spark on mesos] Spark framework not re-registered and lost after mesos master restarted

2017-03-30 Thread Timothy Chen
> > Jared, (韦煜) > Software developer > Interested in open source software, big data, Linux > > > > > From: Timothy Chen > Sent: Friday, March 31, 2017 5:13 AM > To: Yu Wei > Cc: us...@spark.apache.org; dev > Subject: Re: [Spark

Re: [Spark on mesos] Spark framework not re-registered and lost after mesos master restarted

2017-03-30 Thread Yu Wei
re-registered and lost after mesos master restarted I think failover isn't enabled on regular Spark job framework, since we assume jobs are more ephemeral. It could be a good setting to add to the Spark framework to enable failover. Tim On Mar 30, 2017, at 10:18 AM, Yu Wei mailto

Re: [Spark on mesos] Spark framework not re-registered and lost after mesos master restarted

2017-03-30 Thread Timothy Chen
I think failover isn't enabled on regular Spark job framework, since we assume jobs are more ephemeral. It could be a good setting to add to the Spark framework to enable failover. Tim > On Mar 30, 2017, at 10:18 AM, Yu Wei wrote: > > Hi guys, > > I encountered a problem about spark on mesos

[Spark on mesos] Spark framework not re-registered and lost after mesos master restarted

2017-03-30 Thread Yu Wei
Hi guys, I encountered a problem about spark on mesos. I setup mesos cluster and launched spark framework on mesos successfully. Then mesos master was killed and started again. However, spark framework couldn't be re-registered again as mesos agent does. I also couldn't find any error logs. A