[
https://issues.apache.org/jira/browse/SPARK-12089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15041899#comment-15041899
]
Yin Huai commented on SPARK-12089:
--
[~tyro89] https://github.com/apache/spark/pull/10142 has been
[
https://issues.apache.org/jira/browse/SPARK-12089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15040771#comment-15040771
]
Apache Spark commented on SPARK-12089:
--
User 'nongli' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-12089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15036015#comment-15036015
]
Erik Selin commented on SPARK-12089:
I can make that change if it is that easy. I'm just wondering if
[
https://issues.apache.org/jira/browse/SPARK-12089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15036004#comment-15036004
]
Wenchen Fan commented on SPARK-12089:
-
yea, I think we should be more conservative to grow the buffer
[
https://issues.apache.org/jira/browse/SPARK-12089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15036194#comment-15036194
]
Davies Liu commented on SPARK-12089:
Is it possible that you have a record larger than 1G? I don't
[
https://issues.apache.org/jira/browse/SPARK-12089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15036247#comment-15036247
]
Erik Selin commented on SPARK-12089:
There shouldn't be a single record larger than 1G no. But I'm
[
https://issues.apache.org/jira/browse/SPARK-12089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15036295#comment-15036295
]
Davies Liu commented on SPARK-12089:
[~tyro89] Are you build a large Array using group by? How is the
[
https://issues.apache.org/jira/browse/SPARK-12089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15036280#comment-15036280
]
Davies Liu commented on SPARK-12089:
Could you turn on debug log, and paste the java source code of
[
https://issues.apache.org/jira/browse/SPARK-12089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15036327#comment-15036327
]
Erik Selin commented on SPARK-12089:
It's a bunch of table joins followed by a group by on multiple
[
https://issues.apache.org/jira/browse/SPARK-12089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15036807#comment-15036807
]
Davies Liu commented on SPARK-12089:
This query will not generate huge record, each record should be
[
https://issues.apache.org/jira/browse/SPARK-12089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15037275#comment-15037275
]
Apache Spark commented on SPARK-12089:
--
User 'yhuai' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-12089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15037276#comment-15037276
]
Yin Huai commented on SPARK-12089:
--
[~tyro89] Can you reproduce it? I am trying to add some logs and see
[
https://issues.apache.org/jira/browse/SPARK-12089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15037018#comment-15037018
]
Yin Huai commented on SPARK-12089:
--
The stacktrace I have is
{code}
15/12/02 01:10:43 ERROR
13 matches
Mail list logo
