Hi, here's how to get Parrallel search pipleine:
package org.apache.spark.ml.pipeline
import org.apache.spark.ml.param.ParamMap
import org.apache.spark.ml.{Pipeline, PipelineModel}
import org.apache.spark.sql._
class ParralelGridSearchPipelineextends Pipeline {
override def fit(dataset: Data
On Fri, May 22, 2015 at 6:15 AM, Hugo Ferreira wrote:
> Hi,
>
> I am currently experimenting with linear regression (SGD) (Spark + MLlib,
> ver. 1.2). At this point in time I need to fine-tune the hyper-parameters. I
> do this (for now) by an exhaustive grid search of the step size and the
> numbe
-scheduling.html
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Parallel-parameter-tuning-distributed-execution-of-MLlib-algorithms-tp23031.html
Sent from the Apache Spark User List mailing list archive at Nabble.com
Hi,
I am currently experimenting with linear regression (SGD) (Spark +
MLlib, ver. 1.2). At this point in time I need to fine-tune the
hyper-parameters. I do this (for now) by an exhaustive grid search of
the step size and the number of iterations. Currently I am on a dual
core that acts as a