[ 
https://issues.apache.org/jira/browse/SPARK-14862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Joseph K. Bradley reassigned SPARK-14862:
-----------------------------------------

    Assignee: Joseph K. Bradley

> Tree and ensemble classification: do not require label metadata
> ---------------------------------------------------------------
>
>                 Key: SPARK-14862
>                 URL: https://issues.apache.org/jira/browse/SPARK-14862
>             Project: Spark
>          Issue Type: Improvement
>          Components: ML
>            Reporter: Joseph K. Bradley
>            Assignee: Joseph K. Bradley
>
> spark.ml DecisionTreeClassifier, RandomForestClassifier, and GBTClassifier 
> require that the labelCol have metadata specifying the number of classes.  
> Instead, if the number of classes is not specified, we should automatically 
> scan the column to identify numClasses.
> Note: This could cause problems with very small datasets + cross validation 
> if there are k classes but class index k-1 does not appear in the training 
> data.  We should make sure the error thrown helps the user understand the 
> solution, which is probably to use StringIndexer to index the whole dataset's 
> labelCol before doing cross validation.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to