Re: Scala 2.10 Merge

2013-12-17 Thread Henry Saputra
W00t :) On Thursday, December 12, 2013, Patrick Wendell wrote: > Hi Developers, > > In the next few days we are planning to merge Scala 2.10 support into > Spark. For those that haven't been following this, Prashant Sharma has been > maintaining the scala-2.10 branch of Spark for several months.

Re: spark developer from China

2013-12-17 Thread Azuryy Yu
Hi Clseer, Please read here to subscribe the mailing list. http://spark.incubator.apache.org/mailing-lists.html On Wed, Dec 18, 2013 at 2:03 PM, 董西成(clseer) wrote: > Hi, all, > I'm a spark develpor in China, and want to join this Spark Mailing List. > -- > > Best regards, > Xicheng Dong > >

spark developer from China

2013-12-17 Thread clseer
Hi, all, I'm a spark develpor in China, and want to join this Spark Mailing List. -- Best regards, Xicheng Dong === *技术博客*: http://dongxicheng.org/ *技术书籍*: http://hadoop123.com/ *微博*: http://weibo.com/clseer *关键词*: YARN/Mesos,MapReduce,Tez,St

Contribute to Spark

2013-12-17 Thread Azuryy Yu
Hi, I make my first pull request here(just a minor fix): https://github.com/apache/incubator-spark/pull/274 Another: Spark use assemble plug in to generate a fat jar during build, We should specify SPARK_JAR in the command line, then Spark upload spark jar and user jar to the HDFS, but yarn has

Fwd: Spark development for undergraduate project

2013-12-17 Thread Matthew Cheah
Hi everyone, During my most recent internship, I worked extensively with Apache Spark, integrating it into a company's data analytics platform. I've now become interested in contributing to Apache Spark. I'm returning to undergraduate studies in January and there is an academic course which is si

[RESULT] [VOTE] Release Apache Spark 0.8.1-incubating (rc4)

2013-12-17 Thread Patrick Wendell
The vote is now closed. This vote passes with 4 IPMC +1's and no 0 or -1 votes. +1 (4 Total) Marvin Humphrey Henry Saputra Chris Mattmann Roman Shaposhnik 0 (0 Total) -1 (0 Total) * = Binding Vote Thanks to everyone who helped vet this release. - Patrick

Spark development for undergraduate project

2013-12-17 Thread Matthew Cheah
Hi everyone, During my most recent internship, I worked extensively with Apache Spark, integrating it into a company's data analytics platform. I've now become interested in contributing to Apache Spark. I'm returning to undergraduate studies in January and there is an academic course which is si

Re: Spark development for undergraduate project

2013-12-17 Thread Christopher Nguyen
Matt, some suggestions. If you're interested in the machine-learning layer, perhaps you could look into helping to harmonize our (Adatao) dataframe representation with MLlib's, and base RDDs for that matter. It requires someone to spend some dedicated time looking into the trade-offs between gener

Spark development for undergraduate project

2013-12-17 Thread Matthew Cheah
Hi everyone, During my most recent internship, I worked extensively with Apache Spark, integrating it into a company's data analytics platform. I've now become interested in contributing to Apache Spark. I'm returning to undergraduate studies in January and there is an academic course which is si

Re: [VOTE] Release Apache Spark 0.8.0-incubating (rc4)

2013-12-17 Thread Roman Shaposhnik
+1 (binding) from me as well. That said, I'd expect the issues identified around jar inclusion to be blocking for 0.9 (do we have a blocker JIRA filed?). There's also a few issues around the build but I need to spend time and file JIRAs myself. Will do in time for 0.9 Thanks, Roman. On Tue, Dec

Re: [VOTE] Release Apache Spark 0.8.0-incubating (rc4)

2013-12-17 Thread Chris Mattmann
Hi Guys, +1 from me (binding): SIGS pass, CHECKSUMS pass: [chipotle:~/tmp/apache-spark-0.8.1-incubating-rc4] mattmann% $HOME/bin/stage_apache_rc spark 0.8.1-incubating-bin-hadoop1 http://people.apache.org/~pwendell/spark-0.8.1-incubating-rc4/ % Total% Received % Xferd Average Speed Time