Hi Sophia,
Unfortunately, Spark doesn't work against YARN in CDH4. The YARN APIs
changed quite a bit before finally being stabilized in Hadoop 2.2 and CDH5.
Spark on YARN supports Hadoop 0.23.* and Hadoop 2.2+ / CDH5.0+, but does
not support CDH4, which is somewhere in between.
-Sandy
On
Also try this out , we have already done this ..
It will help you..
http://docs.sigmoidanalytics.com/index.php/Setup_hadoop_2.0.0-cdh4.2.0_and_spark_0.9.0_on_ubuntu_12.04
On Tue, May 6, 2014 at 10:17 PM, Andrew Lee alee...@hotmail.com wrote:
Please check JAVA_HOME. Usually it should point to
Please check JAVA_HOME. Usually it should point to /usr/java/default on
CentOS/Linux.
or FYI: http://stackoverflow.com/questions/1117398/java-home-directory
Date: Tue, 6 May 2014 00:23:02 -0700
From: sln-1...@163.com
To: u...@spark.incubator.apache.org
Subject: run spark0.9.1 on yarn with
