[
https://issues.apache.org/jira/browse/SPARK-2341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14078031#comment-14078031
]
Xiangrui Meng commented on SPARK-2341:
--------------------------------------
[~srowen] For the doc in your version:
{code}
If "multiclass", the numeric value parsed directly from the label string will
be used as the label value.
If "continuous", the double value parsed directly from the string will be used
as the label.
{code}
Would user feel confused since the two lines are essentially the same?
Another possible solution is that we parse the labels into doubles and remove
the `multiclass` argument. Users can perform a map to transform the labels into
binary 0/1 if needed.
> loadLibSVMFile doesn't handle regression datasets
> -------------------------------------------------
>
> Key: SPARK-2341
> URL: https://issues.apache.org/jira/browse/SPARK-2341
> Project: Spark
> Issue Type: Bug
> Components: MLlib
> Affects Versions: 1.0.0
> Reporter: Eustache
> Priority: Minor
> Labels: easyfix
>
> Many datasets exist in LibSVM format for regression tasks [1] but currently
> the loadLibSVMFile primitive doesn't handle regression datasets.
> More precisely, the LabelParser is either a MulticlassLabelParser or a
> BinaryLabelParser. What happens then is that the file is loaded but in
> multiclass mode : each target value is interpreted as a class name !
> The fix would be to write a RegressionLabelParser which converts target
> values to Double and plug it into the loadLibSVMFile routine.
> [1] http://www.csie.ntu.edu.tw/~cjlin/libsvmtools/datasets/regression.html
--
This message was sent by Atlassian JIRA
(v6.2#6252)
