[
https://issues.apache.org/jira/browse/SPARK-24102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16717451#comment-16717451
]
ASF GitHub Bot commented on SPARK-24102:
----------------------------------------
imatiach-msft edited a comment on issue #17085: [SPARK-24102][ML][MLLIB] ML
Evaluators should use weight column - added weight column for regression
evaluator
URL: https://github.com/apache/spark/pull/17085#issuecomment-446259327
@srowen yes, exactly, there is a third PR here for classification:
https://github.com/apache/spark/pull/17084
But I need to update it in a similar way to how I just updated this PR (eg
2.2.0 -> 3.0.0).
The original PR had all three but it was recommended that I break it up into
3 parts so I closed it and opened three separate PRs:
https://github.com/apache/spark/pull/16557
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> RegressionEvaluator should use sample weight data
> -------------------------------------------------
>
> Key: SPARK-24102
> URL: https://issues.apache.org/jira/browse/SPARK-24102
> Project: Spark
> Issue Type: Improvement
> Components: ML
> Affects Versions: 2.0.2
> Reporter: Ilya Matiach
> Priority: Major
> Labels: starter
>
> The LogisticRegression and LinearRegression models support training with a
> weight column, but the corresponding evaluators do not support computing
> metrics using those weights. This breaks model selection using CrossValidator.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
