[jira] [Commented] (SPARK-21172) EOFException reached end of stream in UnsafeRowSerializer

2020-05-24 Thread Yunbo Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-21172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115643#comment-17115643 ] Yunbo Fan commented on SPARK-21172: --- [~liupengcheng] Not yet. I‘m on Spark2.2.3. I'll check the disks

[jira] [Comment Edited] (SPARK-21172) EOFException reached end of stream in UnsafeRowSerializer

2020-05-24 Thread Yunbo Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-21172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115613#comment-17115613 ] Yunbo Fan edited comment on SPARK-21172 at 5/25/20, 1:14 AM: - [~lasanthafdo]

[jira] [Commented] (SPARK-21172) EOFException reached end of stream in UnsafeRowSerializer

2020-05-24 Thread Yunbo Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-21172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115613#comment-17115613 ] Yunbo Fan commented on SPARK-21172: --- [~lasanthafdo] Apply the patch SPARK-24809,but still hit the

[jira] [Commented] (SPARK-21033) fix the potential OOM in UnsafeExternalSorter

2020-05-13 Thread Yunbo Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-21033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106774#comment-17106774 ] Yunbo Fan commented on SPARK-21033: --- [~clehene] Since it's 2020, have you solved the problem? I‘m

[jira] [Commented] (SPARK-31592) bufferPoolsBySize in HeapMemoryAllocator should be thread safe

2020-04-28 Thread Yunbo Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17094669#comment-17094669 ] Yunbo Fan commented on SPARK-31592: --- I checked my executor log again and I find the executor got NPE

[jira] [Updated] (SPARK-31592) bufferPoolsBySize in HeapMemoryAllocator should be thread safe

2020-04-28 Thread Yunbo Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yunbo Fan updated SPARK-31592: -- Affects Version/s: (was: 2.4.5) 2.4.3 > bufferPoolsBySize in

[jira] [Updated] (SPARK-31592) bufferPoolsBySize in HeapMemoryAllocator should be thread safe

2020-04-28 Thread Yunbo Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yunbo Fan updated SPARK-31592: -- Description: Currently, bufferPoolsBySize in HeapMemoryAllocator uses a Map type whose value type is 

[jira] [Created] (SPARK-31592) bufferPoolsBySize in HeapMemoryAllocator should be thread safe

2020-04-28 Thread Yunbo Fan (Jira)
Yunbo Fan created SPARK-31592: - Summary: bufferPoolsBySize in HeapMemoryAllocator should be thread safe Key: SPARK-31592 URL: https://issues.apache.org/jira/browse/SPARK-31592 Project: Spark