[
https://issues.apache.org/jira/browse/SPARK-22152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16196053#comment-16196053
]
Apache Spark commented on SPARK-22152:
--
User 'sohum2002' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-22152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16184511#comment-16184511
]
Wenchen Fan commented on SPARK-22152:
-
I don't have a strong opinion, if someone already has a PR, I
[
https://issues.apache.org/jira/browse/SPARK-22152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16184296#comment-16184296
]
Drew Robb commented on SPARK-22152:
---
There is also a ticket for adding it to RDD:
[
https://issues.apache.org/jira/browse/SPARK-22152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16183996#comment-16183996
]
Sean Owen commented on SPARK-22152:
---
(It does not have a flatten method. I was suggesting it makes
[
https://issues.apache.org/jira/browse/SPARK-22152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16183989#comment-16183989
]
Wenchen Fan commented on SPARK-22152:
-
if RDD has flatten, I'm ok to add it to Dataset.
> Add
[
https://issues.apache.org/jira/browse/SPARK-22152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16183828#comment-16183828
]
Takeshi Yamamuro commented on SPARK-22152:
--
cc: [~smilegator][~cloud_fan]
> Add Dataset flatten
[
https://issues.apache.org/jira/browse/SPARK-22152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16183764#comment-16183764
]
Sean Owen commented on SPARK-22152:
---
Likewise for RDDs. It's not a bad idea, but it also adds little.
[
https://issues.apache.org/jira/browse/SPARK-22152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16183585#comment-16183585
]
Drew Robb commented on SPARK-22152:
---
I personally use `Option` very frequently in datasets, and it is
[
https://issues.apache.org/jira/browse/SPARK-22152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16183570#comment-16183570
]
Takeshi Yamamuro commented on SPARK-22152:
--
`Dataset[Option[T]]` is used in a natural usecase?
