[
https://issues.apache.org/jira/browse/SPARK-5782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14371418#comment-14371418
]
Sean Owen commented on SPARK-5782:
--
Doesn't this make an RDD tens of billions of elements
[
https://issues.apache.org/jira/browse/SPARK-5782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14371394#comment-14371394
]
Mark Khaitman commented on SPARK-5782:
--
I didn't think this would be an extreme
[
https://issues.apache.org/jira/browse/SPARK-5782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14371533#comment-14371533
]
Mark Khaitman commented on SPARK-5782:
--
True, there would be billions of elements in
[
https://issues.apache.org/jira/browse/SPARK-5782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14371661#comment-14371661
]
Sean Owen commented on SPARK-5782:
--
I think it might be a useful comparison to try this
[
https://issues.apache.org/jira/browse/SPARK-5782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14372039#comment-14372039
]
Mark Khaitman commented on SPARK-5782:
--
This might also be a problem specific to
[
https://issues.apache.org/jira/browse/SPARK-5782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14371927#comment-14371927
]
Mark Khaitman commented on SPARK-5782:
--
Interesting scala equivalent. I ran it and
[
https://issues.apache.org/jira/browse/SPARK-5782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14363894#comment-14363894
]
Mark Khaitman commented on SPARK-5782:
--
I've upped this JIRA ticket to blocker since
[
https://issues.apache.org/jira/browse/SPARK-5782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14320309#comment-14320309
]
Mark Khaitman commented on SPARK-5782:
--
Would it make sense to instead make the
