Fail to run on yarn with release version?

2013-08-16 Thread Liu, Raymond
Hi I could run spark trunk code on top of yarn 2.0.5-alpha by SPARK_JAR=./core/target/spark-core-assembly-0.8.0-SNAPSHOT.jar ./run spark.deploy.yarn.Client \ --jar examples/target/scala-2.9.3/spark-examples_2.9.3-0.8.0-SNAPSHOT.jar \ --class spark.examples.SparkPi \ --args

Re: New release of Spark and Shark on Amazon EMR

2013-08-16 Thread Matei Zaharia
Cool, thanks for doing this! Matei On Aug 16, 2013, at 11:27 AM, Parviz deyhim dey...@gmail.com wrote: Amazon EMR now has the latest version of Spark 0.7.3 and Shark 0.7 Let me know if you have any questions. Thanks, Parviz

Re: ML Algos

2013-08-16 Thread Matei Zaharia
On Aug 15, 2013, at 7:13 PM, Lijie Xu csxuli...@gmail.com wrote: 3) MLBase may require Spark to provide some new features for implementing some specific algorithms. Is there any? Or you have added some new fundamental features which are not supported in Spark-0.7? On this particular aspect,

Re: ML Algos

2013-08-16 Thread Gowtham N
Is anyone working on neural networks, ADM, Collaborative Filtering etc?

Re: ML Algos

2013-08-16 Thread Lijie Xu
Thanks for your quick reply. I like the new features. There is another related question about distributed ML. How do you think about the architecutre of Google's deep learning ( http://www.cs.toronto.edu/~ranzato/publications/DistBeliefNIPS2012_withAppendix.pdf)? It contains parameter server,