Re: How Spark HA works

2016-08-23 Thread Mohit Jaggi
> wrote: > > I am experiencing this exact issue. Does anyone know what's going on with the > zookeeper setup? > > On Jul 5, 2016 10:34 AM, "Akmal Abbasov" <akmal.abba...@icloud.com > <mailto:akmal.abba...@icloud.com>> wrote: > > > > Hi,

Re: How Spark HA works

2016-08-19 Thread Charles Nnamdi Akalugwu
I am experiencing this exact issue. Does anyone know what's going on with the zookeeper setup? On Jul 5, 2016 10:34 AM, "Akmal Abbasov" <akmal.abba...@icloud.com> wrote: > > Hi, > I'm trying to understand how Spark HA works. I'm using Spark 1.6.1 and Zookeeper 3.4.6. >

How Spark HA works

2016-07-05 Thread Akmal Abbasov
Hi,  I'm trying to understand how Spark HA works. I'm using Spark 1.6.1 and Zookeeper 3.4.6. I've add the following line to $SPARK_HOME/conf/spark-env.sh export SPARK_DAEMON_JAVA_OPTS="-Dspark.deploy.recoveryMode=ZOOKEEPER -Dspark.deploy.zookeeper.url=zk1:2181,zk2:2181,zk3