[jira] [Commented] (SPARK-6738) EstimateSize is difference with spill file size

[ https://issues.apache.org/jira/browse/SPARK-6738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14504638#comment-14504638 ] Apache Spark commented on SPARK-6738: - User 'shenh062326' has created a pull request

[jira] [Commented] (SPARK-6738) EstimateSize is difference with spill file size

[ https://issues.apache.org/jira/browse/SPARK-6738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14482987#comment-14482987 ] Sean Owen commented on SPARK-6738: -- Is that the only file spilled though? I'm not an

[jira] [Commented] (SPARK-6738) EstimateSize is difference with spill file size

[ https://issues.apache.org/jira/browse/SPARK-6738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14483011#comment-14483011 ] Hong Shen commented on SPARK-6738: -- Yes, it spill lots of files, but each one has only

[jira] [Commented] (SPARK-6738) EstimateSize is difference with spill file size

[ https://issues.apache.org/jira/browse/SPARK-6738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14483025#comment-14483025 ] Sean Owen commented on SPARK-6738: -- Do you observe a problem? is it possible that you are

[jira] [Commented] (SPARK-6738) EstimateSize is difference with spill file size

[ https://issues.apache.org/jira/browse/SPARK-6738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14483103#comment-14483103 ] Sean Owen commented on SPARK-6738: -- To be clear I am asking how big the data being

[jira] [Commented] (SPARK-6738) EstimateSize is difference with spill file size

[ https://issues.apache.org/jira/browse/SPARK-6738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14483104#comment-14483104 ] Hong Shen commented on SPARK-6738: -- I don't think it's serialized cause the problem. the