[
https://issues.apache.org/jira/browse/SPARK-7424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15218253#comment-15218253
]
Yanbo Liang edited comment on SPARK-7424 at 3/30/16 4:32 PM:
-------------------------------------------------------------
[~josephkb] We should copy metadata from the labelCol to the predictionCol. But
we can not do it in PredictorParams.validateAndTransformSchema, because we did
not use the return value of validateAndTransformSchema as the output DataFrame
schema. The output DataFrame and its schema are generated at
ClassificationModel.transform and PredictionModel.transform by "withColumn"
directly.
was (Author: yanboliang):
[~josephkb] We should copy metadata from the labelCol to the predictionCol. But
we can not do it in PredictorParams.validateAndTransformSchema, because we did
not use the return value of validateAndTransformSchema as the output DataFrame
schema. The output DataFrame and its schema are generated at
ClassificationModel.transform and PredictionModel.transform directly.
> spark.ml classification, regression abstractions should add metadata to
> output column
> -------------------------------------------------------------------------------------
>
> Key: SPARK-7424
> URL: https://issues.apache.org/jira/browse/SPARK-7424
> Project: Spark
> Issue Type: Improvement
> Components: ML
> Reporter: Joseph K. Bradley
>
> Update ClassificationModel, ProbabilisticClassificationModel prediction to
> include numClasses in output column metadata.
> Update RegressionModel to specify output column metadata as well.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
