[
https://issues.apache.org/jira/browse/LIVY-667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16935852#comment-16935852
]
Marco Gaido commented on LIVY-667:
--
[~yihengw] yes, that's true. The point is that the dat
[
https://issues.apache.org/jira/browse/LIVY-667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16935829#comment-16935829
]
Yiheng Wang commented on LIVY-667:
--
Hi Marco. I think Spark compute on the partition data
[
https://issues.apache.org/jira/browse/LIVY-667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16935616#comment-16935616
]
Marco Gaido commented on LIVY-667:
--
[~runzhiwang] let me cite you in the JIRA body:
> Whe
[
https://issues.apache.org/jira/browse/LIVY-667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16935497#comment-16935497
]
runzhiwang commented on LIVY-667:
-
[~mgaido] Because of the limited memory and huge size of
[
https://issues.apache.org/jira/browse/LIVY-667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16934489#comment-16934489
]
Marco Gaido commented on LIVY-667:
--
[~runzhiwang] I'd argue that if the data which is pres