Re: DAG in Pipeline

2017-09-07 Thread Srikanth Sampath
Hi, Pranay/Joseph, Can you share an example of ML DAG pipeline? Thanks, -Srikanth -- Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/ - To unsubscribe e-mail: dev-unsubscr...@spark.apache.org

Re: DAG in Pipeline

2016-06-12 Thread Joseph Bradley
One more note: When you specify the stages in the Pipeline, they need to be in topological order according to the DAG. On Sun, Jun 12, 2016 at 10:47 AM, Joseph Bradley wrote: > Hi Pranay, > > Yes, you can do this. The DAG structure should be specified via the > various Transformers' input and o

Re: DAG in Pipeline

2016-06-12 Thread Joseph Bradley
Hi Pranay, Yes, you can do this. The DAG structure should be specified via the various Transformers' input and output columns, where a Transformer can have multiple input and/or output columns. Most of the classification and regression Models are good examples of Transformers with multiple input

DAG in Pipeline

2016-06-08 Thread Pranay Tonpay
Hi, Pipeline as of now seems to be having a series of transformers and estimators in a serial fashion. Is it possible to create a DAG sort of thing - Eg - Two transformers running in parallel to cleanse data (a custom built Transformer) in some way and then their outputs ( two outputs ) used for s