[
https://issues.apache.org/jira/browse/SPARK-26570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17016200#comment-17016200
]
ShivaKumar SS commented on SPARK-26570:
---
Unfortunately I have hit the same issue.
[
https://issues.apache.org/jira/browse/SPARK-26570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16967947#comment-16967947
]
Gautam Pulla commented on SPARK-26570:
--
I'm hitting a similar issue - but at a more specific line
[
https://issues.apache.org/jira/browse/SPARK-26570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951437#comment-16951437
]
fengchaoge commented on SPARK-26570:
It's just a snapshot of an instant, and it's actually getting
[
https://issues.apache.org/jira/browse/SPARK-26570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951223#comment-16951223
]
L. C. Hsieh commented on SPARK-26570:
-
First from the stacktrace, I was thinking it is possible that
[
https://issues.apache.org/jira/browse/SPARK-26570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16950686#comment-16950686
]
Sean R. Owen commented on SPARK-26570:
--
That doesn't help much, especially as it's a screen shot?
[
https://issues.apache.org/jira/browse/SPARK-26570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16950675#comment-16950675
]
fengchaoge commented on SPARK-26570:
!image-2019-10-14-10-51-28-374.png!
> Out of memory when
[
https://issues.apache.org/jira/browse/SPARK-26570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16950672#comment-16950672
]
fengchaoge commented on SPARK-26570:
!image-2019-10-14-10-48-05-063.png!
[
https://issues.apache.org/jira/browse/SPARK-26570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16950658#comment-16950658
]
fengchaoge commented on SPARK-26570:
hello, [~srowen] [~viirya]
jmap logs is shown below:
[
https://issues.apache.org/jira/browse/SPARK-26570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16950406#comment-16950406
]
L. C. Hsieh commented on SPARK-26570:
-
I think the collected number of filestatus can be more than
[
https://issues.apache.org/jira/browse/SPARK-26570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16950370#comment-16950370
]
Sean R. Owen commented on SPARK-26570:
--
Not sure, those objects aren't large, and 70K of them
[
https://issues.apache.org/jira/browse/SPARK-26570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16950276#comment-16950276
]
fengchaoge commented on SPARK-26570:
hello, [~deshanxiao] [~srowen] spark2.4.3 may also have the
[
https://issues.apache.org/jira/browse/SPARK-26570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16782137#comment-16782137
]
Sean Owen commented on SPARK-26570:
---
How big can these be? are you saying they're large, or that they
[
https://issues.apache.org/jira/browse/SPARK-26570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16739083#comment-16739083
]
deshanxiao commented on SPARK-26570:
[~hyukjin.kwon] OK, I will try it. Thank you!
> Out of memory
[
https://issues.apache.org/jira/browse/SPARK-26570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16738955#comment-16738955
]
Hyukjin Kwon commented on SPARK-26570:
--
Would you be able to test this in upper version of Spark?
[
https://issues.apache.org/jira/browse/SPARK-26570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16737061#comment-16737061
]
deshanxiao commented on SPARK-26570:
!screenshot-1.png!
> Out of memory when InMemoryFileIndex
15 matches
Mail list logo