1051 is essential!
I'm not sure about the others, but anything that adds stability to
Spark/Yarn would be helpful.
Kevin Markey
On 03/20/2014 01:12 PM, Tom Graves wrote:
I'll pull [SPARK-1053] Should not require SPARK_YARN_APP_JAR when running on
YARN - JIRA and [SPARK-1051] On Yarn, executors don't doAs as submitting user
- JIRA in. The pyspark one I would consider more of an enhancement so might
not be appropriate for a point release.
[SPARK-1053] Should not require SPARK_YARN_APP_JAR when running on YA...
org.apache.spark.SparkException: env SPARK_YARN_APP_JAR is not set at
org.apache.spark.scheduler.cluster.YarnClientSchedulerBackend.start(YarnClientSchedulerBackend.scala:49)
at org.apache.spark.schedule...
View on spark-project.atlassian.net Preview by Yahoo
[SPARK-1051] On Yarn, executors don't doAs as submitting user - JIRA
This means that they can't write/read from files that the yarn user doesn't
have permissions to but the submitting user does.
View on spark-project.atlassian.net Preview by Yahoo
On Thursday, March 20, 2014 1:35 PM, Bhaskar Dutta <bhas...@gmail.com> wrote:
It will be great if
"SPARK-1101<https://spark-project.atlassian.net/browse/SPARK-1101>:
Umbrella
for hardening Spark on YARN" can get into 0.9.1.
Thanks,
Bhaskar
On Thu, Mar 20, 2014 at 5:37 AM, Tathagata Das
<tathagata.das1...@gmail.com>wrote:
Hello everyone,
Since the release of Spark 0.9, we have received a number of important bug
fixes and we would like to make a bug-fix release of Spark 0.9.1. We are
going to cut a release candidate soon and we would love it if people test
it out. We have backported several bug fixes into the 0.9 and updated JIRA
accordingly<
https://spark-project.atlassian.net/browse/SPARK-1275?jql=project%20in%20(SPARK%2C%20BLINKDB%2C%20MLI%2C%20MLLIB%2C%20SHARK%2C%20STREAMING%2C%20GRAPH%2C%20TACHYON)%20AND%20fixVersion%20%3D%200.9.1%20AND%20status%20in%20(Resolved%2C%20Closed)
.
Please let me know if there are fixes that were not backported but you
would like to see them in 0.9.1.
Thanks!
TD
