Re: spark 1.6.0 on ec2 doesn't work

Hi Oleg, The Tachyon related issue should be fixed. Hope this helps, Calvin On Mon, Jan 18, 2016 at 2:51 AM, Oleg Ruchovets wrote: > Hi , >I try to follow the spartk 1.6.0 to install spark on EC2. > > It doesn't work properly - got exceptions and at the end

Re: spark 1.6.0 on ec2 doesn't work

Hi, How do you know it doesn't work? The log looks roughly normal to me. Is Spark not running at the printed address? Can you not start jobs? On Mon, Jan 18, 2016 at 11:51 AM, Oleg Ruchovets wrote: > Hi , >I try to follow the spartk 1.6.0 to install spark on EC2. > >

Re: spark 1.6.0 on ec2 doesn't work

On Mon, Jan 18, 2016 at 5:24 PM, Oleg Ruchovets wrote: > I thought script tries to install hadoop / hdfs also. And it looks like it > failed. Installation is only standalone spark without hadoop. Is it correct > behaviour? > Yes, it also sets up two HDFS clusters. Are they

Re: spark 1.6.0 on ec2 doesn't work

I thought script tries to install hadoop / hdfs also. And it looks like it failed. Installation is only standalone spark without hadoop. Is it correct behaviour? Also errors in the log: ERROR: Unknown Tachyon version Error: Could not find or load main class crayondata.com.log Thanks Oleg.

Re: spark 1.6.0 on ec2 doesn't work

It looks spark is not working fine : I followed this link ( http://spark.apache.org/docs/latest/ec2-scripts.html. ) and I see spot instances installed on EC2. from spark shell I am counting lines and got connection exception. *scala> val lines = sc.textFile("README.md")* *scala> lines.count()*

Re: spark 1.6.0 on ec2 doesn't work

Could you run spark-shell at $SPARK_HOME DIR? You can try to change you command run at $SPARK_HOME or, point to README.md with full path. Peter Zhang --  Google Sent with Airmail On January 19, 2016 at 11:26:14, Oleg Ruchovets (oruchov...@gmail.com) wrote: It looks spark is not working fine

Re: spark 1.6.0 on ec2 doesn't work

I am running from $SPARK_HOME. It looks like connection problem to port 9000. It is on master machine. What is this process is spark tries to connect? Should I start any framework , processes before executing spark? Thanks OIeg. 16/01/19 03:17:56 INFO ipc.Client: Retrying connect to

RE: spark 1.6.0 on ec2 doesn't work

gt; Cc: Daniel Darabos <daniel.dara...@lynxanalytics.com>; user <user@spark.apache.org> Subject: Re: spark 1.6.0 on ec2 doesn't work I am running from $SPARK_HOME. It looks like connection problem to port 9000. It is on master machine. What is this process is spark tries to connect?