[jira] [Commented] (SPARK-21482) Make LabeledPoint bean-compliant so it can be used in Encoders.bean(LabeledPoint.class)
[ https://issues.apache.org/jira/browse/SPARK-21482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094315#comment-16094315 ] Aseem Bansal commented on SPARK-21482: -- There is a LabeledPoint in new ml api too https://spark.apache.org/docs/2.1.0/api/scala/index.html#org.apache.spark.ml.feature.LabeledPoint I am able to workaround via using my own class. But I thought the ML package was supposed to be used with the dataset's API. That's why I am saying it should support this. > Make LabeledPoint bean-compliant so it can be used in > Encoders.bean(LabeledPoint.class) > --- > > Key: SPARK-21482 > URL: https://issues.apache.org/jira/browse/SPARK-21482 > Project: Spark > Issue Type: Improvement > Components: ML >Affects Versions: 2.1.0 >Reporter: Aseem Bansal >Priority: Minor > > The LabeledPoint class is currently not bean-compliant as per spark > https://spark.apache.org/docs/2.1.0/api/scala/index.html#org.apache.spark.ml.feature.LabeledPoint > This makes it impossible to create a LabeledPoint via a dataset.tranform. It > should be made bean-compliant so it can be used. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-21482) Make LabeledPoint bean-compliant so it can be used in Encoders.bean(LabeledPoint.class)
[ https://issues.apache.org/jira/browse/SPARK-21482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094305#comment-16094305 ] Sean Owen commented on SPARK-21482: --- When using LabeledPoint you're typically using the RDD API, where Encoders aren't needed. Do you really need a DataSet? or, if you're out of .mllib code, why not use your own type and not link yourself to the internal .mllib rep? > Make LabeledPoint bean-compliant so it can be used in > Encoders.bean(LabeledPoint.class) > --- > > Key: SPARK-21482 > URL: https://issues.apache.org/jira/browse/SPARK-21482 > Project: Spark > Issue Type: Improvement > Components: ML >Affects Versions: 2.1.0 >Reporter: Aseem Bansal >Priority: Minor > > The LabeledPoint class is currently not bean-compliant as per spark > https://spark.apache.org/docs/2.1.0/api/scala/index.html#org.apache.spark.ml.feature.LabeledPoint > This makes it impossible to create a LabeledPoint via a dataset.tranform. It > should be made bean-compliant so it can be used. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-21482) Make LabeledPoint bean-compliant so it can be used in Encoders.bean(LabeledPoint.class)
[
https://issues.apache.org/jira/browse/SPARK-21482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094295#comment-16094295
]
Aseem Bansal commented on SPARK-21482:
--
I am using Java API. I tried a simple transformation with
{noformat}
dataset.transform(MyCustomToLabeledPointTransformer::transformer,
Encoders.bean(LabeledPoint.class))
{noformat}
and it threw bean-compliance exception. I am not sure whether the encoders
should act on beans or not but clearly something is going on due to which they
are acting on beans.
> Make LabeledPoint bean-compliant so it can be used in
> Encoders.bean(LabeledPoint.class)
> ---
>
> Key: SPARK-21482
> URL: https://issues.apache.org/jira/browse/SPARK-21482
> Project: Spark
> Issue Type: Improvement
> Components: ML
>Affects Versions: 2.1.0
>Reporter: Aseem Bansal
>Priority: Minor
>
> The LabeledPoint class is currently not bean-compliant as per spark
> https://spark.apache.org/docs/2.1.0/api/scala/index.html#org.apache.spark.ml.feature.LabeledPoint
> This makes it impossible to create a LabeledPoint via a dataset.tranform. It
> should be made bean-compliant so it can be used.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-21482) Make LabeledPoint bean-compliant so it can be used in Encoders.bean(LabeledPoint.class)
[ https://issues.apache.org/jira/browse/SPARK-21482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094282#comment-16094282 ] Sean Owen commented on SPARK-21482: --- Does it need to be bean compliant? Encoders don't have to act on beans. > Make LabeledPoint bean-compliant so it can be used in > Encoders.bean(LabeledPoint.class) > --- > > Key: SPARK-21482 > URL: https://issues.apache.org/jira/browse/SPARK-21482 > Project: Spark > Issue Type: Improvement > Components: ML >Affects Versions: 2.1.0 >Reporter: Aseem Bansal > > The LabeledPoint class is currently not bean-compliant as per spark > https://spark.apache.org/docs/2.1.0/api/scala/index.html#org.apache.spark.ml.feature.LabeledPoint > This makes it impossible to create a LabeledPoint via a dataset.tranform. It > should be made bean-compliant so it can be used. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
