[jira] [Commented] (SPARK-15577) Java can't import DataFrame type alias
[ https://issues.apache.org/jira/browse/SPARK-15577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15564316#comment-15564316 ] Hyukjin Kwon commented on SPARK-15577: -- Let me please close this as a not-a-problem. Please revoke my change if anyone feels it is not right. > Java can't import DataFrame type alias > -- > > Key: SPARK-15577 > URL: https://issues.apache.org/jira/browse/SPARK-15577 > Project: Spark > Issue Type: Improvement > Components: Java API, SQL >Affects Versions: 2.0.0 >Reporter: holdenk > > After SPARK-13244, all Java code needs to be updated to use Dataset > instead of DataFrame as we used a type alias. Should we consider adding a > DataFrame to the Java API which just extends Dataset for compatibility? > cc [~liancheng] ? -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-15577) Java can't import DataFrame type alias
[ https://issues.apache.org/jira/browse/SPARK-15577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15564302#comment-15564302 ] Jakob Odersky commented on SPARK-15577: --- this cleaning of jiras is really good to see :) Considering that spark 2.0 has already shipped with the type alias, I think it is safe to close this ticket. We can always reopen it if necessary. > Java can't import DataFrame type alias > -- > > Key: SPARK-15577 > URL: https://issues.apache.org/jira/browse/SPARK-15577 > Project: Spark > Issue Type: Improvement > Components: Java API, SQL >Affects Versions: 2.0.0 >Reporter: holdenk > > After SPARK-13244, all Java code needs to be updated to use Dataset > instead of DataFrame as we used a type alias. Should we consider adding a > DataFrame to the Java API which just extends Dataset for compatibility? > cc [~liancheng] ? -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-15577) Java can't import DataFrame type alias
[ https://issues.apache.org/jira/browse/SPARK-15577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15564115#comment-15564115 ] Hyukjin Kwon commented on SPARK-15577: -- WDYT - [~holdenk] > Java can't import DataFrame type alias > -- > > Key: SPARK-15577 > URL: https://issues.apache.org/jira/browse/SPARK-15577 > Project: Spark > Issue Type: Improvement > Components: Java API, SQL >Affects Versions: 2.0.0 >Reporter: holdenk > > After SPARK-13244, all Java code needs to be updated to use Dataset > instead of DataFrame as we used a type alias. Should we consider adding a > DataFrame to the Java API which just extends Dataset for compatibility? > cc [~liancheng] ? -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-15577) Java can't import DataFrame type alias
[ https://issues.apache.org/jira/browse/SPARK-15577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15564103#comment-15564103 ] Hyukjin Kwon commented on SPARK-15577: -- Cool, then I guess we might be able to take an action on the status of this JIRA? > Java can't import DataFrame type alias > -- > > Key: SPARK-15577 > URL: https://issues.apache.org/jira/browse/SPARK-15577 > Project: Spark > Issue Type: Improvement > Components: Java API, SQL >Affects Versions: 2.0.0 >Reporter: holdenk > > After SPARK-13244, all Java code needs to be updated to use Dataset > instead of DataFrame as we used a type alias. Should we consider adding a > DataFrame to the Java API which just extends Dataset for compatibility? > cc [~liancheng] ? -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-15577) Java can't import DataFrame type alias
[
https://issues.apache.org/jira/browse/SPARK-15577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15563910#comment-15563910
]
Jakob Odersky commented on SPARK-15577:
---
This was considered and trade-offs were actively discussed, but ultimately the
type alias was chosen over sub classing.
I think the main argument in favor of aliasing was to avoid incompatibilities
in future libraries, i.e. there is utility function was written to accept a
{{DataFrame}}, however I want to pass in a {{Dataset\[Row\]}}.
[This email thread|
http://apache-spark-developers-list.1001551.n3.nabble.com/discuss-DataFrame-vs-Dataset-in-Spark-2-0-td16445.html]
contains the whole discussion
> Java can't import DataFrame type alias
> --
>
> Key: SPARK-15577
> URL: https://issues.apache.org/jira/browse/SPARK-15577
> Project: Spark
> Issue Type: Improvement
> Components: Java API, SQL
>Affects Versions: 2.0.0
>Reporter: holdenk
>
> After SPARK-13244, all Java code needs to be updated to use Dataset
> instead of DataFrame as we used a type alias. Should we consider adding a
> DataFrame to the Java API which just extends Dataset for compatibility?
> cc [~liancheng] ?
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-15577) Java can't import DataFrame type alias
[
https://issues.apache.org/jira/browse/SPARK-15577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15558049#comment-15558049
]
Hyukjin Kwon commented on SPARK-15577:
--
If I were a naive user from Spark 1.x, I think I would prefer to use
{{DataFrame}} in Java too.
> Java can't import DataFrame type alias
> --
>
> Key: SPARK-15577
> URL: https://issues.apache.org/jira/browse/SPARK-15577
> Project: Spark
> Issue Type: Improvement
> Components: Java API, SQL
>Affects Versions: 2.0.0
>Reporter: holdenk
>
> After SPARK-13244, all Java code needs to be updated to use Dataset
> instead of DataFrame as we used a type alias. Should we consider adding a
> DataFrame to the Java API which just extends Dataset for compatibility?
> cc [~liancheng] ?
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
