Re: How to train and predict in parallel via Spark MLlib?

2016-02-19 Thread Xiangrui Meng
DD is produced inside >>> another RDD (GradientBoostedTreesModel is trained on RDD[LabeledPoint]) >>> and >>> as far as I know it's a bad scenario, e.g. >>> toy example below doesn't work: >>> scala> sc.parallelize(1 to 100).map(x =

Re: How to train and predict in parallel via Spark MLlib?

2016-02-18 Thread Игорь Ляхов
7;t work: >> scala> sc.parallelize(1 to 100).map(x => (x, >> sc.parallelize(Array(2)).map(_ >> * 2).collect)).collect. >> >> Is there any way to use Spark MLlib in parallel way? >> >> Thank u for attention! >> >> -- >> BR, >>

Re: How to train and predict in parallel via Spark MLlib?

2016-02-18 Thread Xiangrui Meng
allelize(Array(2)).map(_ > * 2).collect)).collect. > > Is there any way to use Spark MLlib in parallel way? > > Thank u for attention! > > -- > BR, > Junior Scala/Python Developer > Igor L. > > > >

How to train and predict in parallel via Spark MLlib?

2016-02-18 Thread Igor L.
tion! -- BR, Junior Scala/Python Developer Igor L. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/How-to-train-and-predict-in-parallel-via-Spark-MLlib-tp26261.html Sent from the Apache Spark User List m