[ https://issues.apache.org/jira/browse/SPARK-6823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14491885#comment-14491885 ]
Joseph K. Bradley commented on SPARK-6823: ------------------------------------------ This sounds like it would be covered by the OneHotEncoder + VectorAssembler feature transformers: * [https://issues.apache.org/jira/browse/SPARK-5888] * [https://issues.apache.org/jira/browse/SPARK-5885] Do you think these belong within DataFrame (and that this JIRA should be for SQL instead of ML)? > Add a model.matrix like capability to DataFrames (modelDataFrame) > ----------------------------------------------------------------- > > Key: SPARK-6823 > URL: https://issues.apache.org/jira/browse/SPARK-6823 > Project: Spark > Issue Type: New Feature > Components: ML, SparkR > Reporter: Shivaram Venkataraman > > Currently Mllib modeling tools work only with double data. However, data > tables in practice often have a set of categorical fields (factors in R), > that need to be converted to a set of 0/1 indicator variables (making the > data actually used in a modeling algorithm completely numeric). In R, this is > handled in modeling functions using the model.matrix function. Similar > functionality needs to be available within Spark. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org