Re: ML Transformer: create feature that uses multiple columns

2017-12-11 Thread davideanastasia
Hi Filipp, your solution worked very well: thanks a lot! Davide -- Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/ - To unsubscribe e-mail: user-unsubscr...@spark.apache.org

ML Transformer: create feature that uses multiple columns

2017-12-09 Thread davideanastasia
Hi, I am trying to write a custom ml.Transformer. It's a very simple row-by-row transformation, but it takes in account multiple columns of the DataFrame (and sometimes, interaction between columns). I was wondering what the best way to achieve this is. I have used a udf in the Transformer before,