https://s3.amazonaws.com/spark-related-packages/
spark-ec2 uses this bucket to download and install HDFS on clusters. Is it
owned by the Spark project or by the AMPLab?
Anyway, it looks like the latest Hadoop install available on there is
Hadoop 2.4.0.
Are there plans to add newer versions of
Hi
the SparkLauncher#setJavaHome method uses its argument to find the java
executable, but it does not reset the JAVA_HOME env var in the child
process. As a result, spark scripts such as bin/spark-class that rely on
JAVA_HOME use the wrong value. Adding this to setJavaHome fixes the problem:
Hey All,
Just a friendly reminder that today (October 31st) is the scheduled code
freeze for Spark 1.6. Since a lot of developers were busy with the Spark
Summit last week I'm going to delay cutting the branch until Monday,
November 2nd. After that point, we'll package a release for testing and
On Linux, I got the following test failure (with or without suggested
change):
testChildProcLauncher(org.apache.spark.launcher.SparkLauncherSuite) Time
elapsed: 0.036 sec <<< FAILURE!
java.lang.AssertionError: expected:<0> but was:<1>
at org.junit.Assert.fail(Assert.java:88)
at
