Re: Spark 1.1 Window and 1.0 Wrap-up

[Bhaskar Dutta]

On Tue, Jun 3, 2014 at 11:51 AM, Patrick Wendell  wrote:

> Hey All,
>
> I wanted to announce the the Spark 1.1 release window:
> June 1 - Merge window opens
> July 25 - Cut-off for new pull requests
> August 1 - Merge window closes (code freeze), QA period starts
> August 15+ - RC's and voting
>
>
Hi,

Do you have a plan for 1.0.1 as well?

Thanks,
Bhaskar

Re: Spark 0.9.1 release

[Bhaskar Dutta]

Thank You! We plan to test out 0.9.1 on YARN once it is out.

Regards,
Bhaskar

On Fri, Mar 21, 2014 at 12:42 AM, Tom Graves  wrote:

> I'll pull [SPARK-1053] Should not require SPARK_YARN_APP_JAR when running
> on YARN - JIRA and  [SPARK-1051] On Yarn, executors don't doAs as
> submitting user - JIRA in.  The pyspark one I would consider more of an
> enhancement so might not be appropriate for a point release.
>
>
>  [SPARK-1053] Should not require SPARK_YARN_APP_JAR when running on YA...
> org.apache.spark.SparkException: env SPARK_YARN_APP_JAR is not set at
> org.apache.spark.scheduler.cluster.YarnClientSchedulerBackend.start(YarnClientSchedulerBackend.scala:49)
> at org.apache.spark.schedule...
> View on spark-project.atlassian.net Preview by Yahoo
>
>
>  [SPARK-1051] On Yarn, executors don't doAs as submitting user - JIRA
> This means that they can't write/read from files that the yarn user
> doesn't have permissions to but the submitting user does.
> View on spark-project.atlassian.net Preview by Yahoo
>
>
>
>
>
> On Thursday, March 20, 2014 1:35 PM, Bhaskar Dutta 
> wrote:
>
> It will be great if
> "SPARK-1101<https://spark-project.atlassian.net/browse/SPARK-1101>:
> Umbrella
> for hardening Spark on YARN" can get into 0.9.1.
>
> Thanks,
> Bhaskar
>
>
> On Thu, Mar 20, 2014 at 5:37 AM, Tathagata Das
> wrote:
>
> >  Hello everyone,
> >
> > Since the release of Spark 0.9, we have received a number of important
> bug
> > fixes and we would like to make a bug-fix release of Spark 0.9.1. We are
> > going to cut a release candidate soon and we would love it if people test
> > it out. We have backported several bug fixes into the 0.9 and updated
> JIRA
> > accordingly<
> >
> https://spark-project.atlassian.net/browse/SPARK-1275?jql=project%20in%20(SPARK%2C%20BLINKDB%2C%20MLI%2C%20MLLIB%2C%20SHARK%2C%20STREAMING%2C%20GRAPH%2C%20TACHYON)%20AND%20fixVersion%20%3D%200.9.1%20AND%20status%20in%20(Resolved%2C%20Closed)
> > >.
> > Please let me know if there are fixes that were not backported but you
> > would like to see them in 0.9.1.
> >
> > Thanks!
> >
> > TD
> >
>

Re: Spark 0.9.1 release

[Bhaskar Dutta]

It will be great if
"SPARK-1101:
Umbrella
for hardening Spark on YARN" can get into 0.9.1.

Thanks,
Bhaskar

On Thu, Mar 20, 2014 at 5:37 AM, Tathagata Das
wrote:

>  Hello everyone,
>
> Since the release of Spark 0.9, we have received a number of important bug
> fixes and we would like to make a bug-fix release of Spark 0.9.1. We are
> going to cut a release candidate soon and we would love it if people test
> it out. We have backported several bug fixes into the 0.9 and updated JIRA
> accordingly<
> https://spark-project.atlassian.net/browse/SPARK-1275?jql=project%20in%20(SPARK%2C%20BLINKDB%2C%20MLI%2C%20MLLIB%2C%20SHARK%2C%20STREAMING%2C%20GRAPH%2C%20TACHYON)%20AND%20fixVersion%20%3D%200.9.1%20AND%20status%20in%20(Resolved%2C%20Closed)
> >.
> Please let me know if there are fixes that were not backported but you
> would like to see them in 0.9.1.
>
> Thanks!
>
> TD
>