Eustache created SPARK-2341:
-------------------------------
Summary: loadLibSVMFile doesn't handle regression datasets
Key: SPARK-2341
URL: https://issues.apache.org/jira/browse/SPARK-2341
Project: Spark
Issue Type: Bug
Components: MLlib
Affects Versions: 1.0.0
Reporter: Eustache
Priority: Minor
Many datasets exist in LibSVM format for regression tasks [1] but currently the
loadLibSVMFile primitive doesn't handle regression datasets.
More precisely, the LabelParser is either a MulticlassLabelParser or a
BinaryLabelParser. What happens then is that the file is loaded but in
multiclass mode : each target value is interpreted as a class name !
The fix would be to write a RegressionLabelParser which converts target values
to Double and plug it into the loadLibSVMFile routine.
[1] http://www.csie.ntu.edu.tw/~cjlin/libsvmtools/datasets/regression.html
--
This message was sent by Atlassian JIRA
(v6.2#6252)
