Re: Spark 1.0.0 rc3

2014-05-03 Thread Nan Zhu
SPARK_HADOOP_VERSION=2.3.0 sbt/sbt assembly and copy the generated jar to lib/ directory of my application, it seems that sbt cannot find the dependencies in the jar? but everything works with the pre-built jar files downloaded from the link provided by Patrick Best, -- Nan Zhu On Thurs

Re: Spark 1.0.0 rc3

2014-05-01 Thread Madhu
I'm guessing EC2 support is not there yet? I was able to build using the binary download on both Windows 7 and RHEL 6 without issues. I tried to create an EC2 cluster, but saw this: ~/spark-ec2 Initializing spark ~ ~/spark-ec2 ERROR: Unknown Spark version Initializing shark ~ ~/spark-ec2 ~/spark-

Re: Spark 1.0.0 rc3

2014-05-01 Thread Manu Suryavansh
spark.rdd.PairRDDFunctions.saveAsHadoopDataset(PairRDDFunctions.scala:749) > >> > at > >> > > >> > org.apache.spark.rdd.PairRDDFunctions.saveAsHadoopFile(PairRDDFunctions.scala:662) > >> > at > >> > > >> > org.apache.sp

Re: Spark 1.0.0 rc3

2014-04-29 Thread Patrick Wendell
2) >> > at >> > >> org.apache.spark.rdd.PairRDDFunctions.saveAsHadoopFile(PairRDDFunctions.scala:581) >> > at org.apache.spark.rdd.RDD.saveAsTextFile(RDD.scala:1057) >> > at spark.activator.WordCount2$.main(WordCount2.scala:42) >> > at spark.ac

Re: Spark 1.0.0 rc3

2014-04-29 Thread Dean Wampler
AM, Patrick Wendell > wrote: > > > >> Hey All, > >> > >> This is not an official vote, but I wanted to cut an RC so that people > can > >> test against the Maven artifacts, test building with their > configuration, > >> etc. We are still chasing down a few i

Re: Spark 1.0.0 rc3

2014-04-29 Thread Patrick Wendell
o that people can >> test against the Maven artifacts, test building with their configuration, >> etc. We are still chasing down a few issues and updating docs, etc. >> >> If you have issues or bug reports for this release, please send an e-mail >> to the Sp

Re: Spark 1.0.0 rc3

2014-04-29 Thread Patrick Wendell
Sorry got cut off. For 0.9.0 and 1.0.0 they are not binary compatible and in a few cases not source compatible. 1.X will be source compatible. We are also planning to support binary compatibility in 1.X but I'm waiting util we make a few releases to officially promise that, since Scala makes this p

Re: Spark 1.0.0 rc3

2014-04-29 Thread Patrick Wendell
> What are the expectations / guarantees on binary compatibility between > 0.9 and 1.0? There are not guarantees.

Re: Spark 1.0.0 rc3

2014-04-29 Thread Marcelo Vanzin
;h=d636772ea9f98e449a038567b7975b1a07de3221 > > Binaries: > http://people.apache.org/~pwendell/spark-1.0.0-rc3/ > > Docs: > http://people.apache.org/~pwendell/spark-1.0.0-rc3-docs/ > > Repository: > https://repository.apache.org/content/repositories/orgapachespark-1012/ &g

Re: Spark 1.0.0 rc3

2014-04-29 Thread Dean Wampler
ation, > etc. We are still chasing down a few issues and updating docs, etc. > > If you have issues or bug reports for this release, please send an e-mail > to the Spark dev list and/or file a JIRA. > > Commit: d636772 (v1.0.0-rc3) > > https://git-wip-us.apache.org/re

Spark 1.0.0 rc3

2014-04-29 Thread Patrick Wendell
-mail to the Spark dev list and/or file a JIRA. Commit: d636772 (v1.0.0-rc3) https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=d636772ea9f98e449a038567b7975b1a07de3221 Binaries: http://people.apache.org/~pwendell/spark-1.0.0-rc3/ Docs: http://people.apache.org/~pwendell/spark-1.0.0-rc3