[ https://issues.apache.org/jira/browse/SPARK-8345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Joseph K. Bradley updated SPARK-8345: ------------------------------------- Summary: Add an SQL node as a feature transformer (was: Add an SQL node as a feature tranformer) > Add an SQL node as a feature transformer > ---------------------------------------- > > Key: SPARK-8345 > URL: https://issues.apache.org/jira/browse/SPARK-8345 > Project: Spark > Issue Type: New Feature > Components: ML > Reporter: Xiangrui Meng > > Some simple feature transformations can take leverage on SQL operators. Users > do not need to create an ML transformer for each of them. We can have an SQL > transformer that executes an SQL command which operates on the input > dataframe. > {code} > val sql = new SQL() > .setStatement("SELECT *, length(text) AS text_length FROM __THIS__") > {code} > where "__THIS__" will be replaced by a temp table that represents the > DataFrame. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org