spark git commit: [SPARK-18208][SHUFFLE] Executor OOM due to a growing LongArray in BytesToBytesMap

2016-12-07 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/branch-2.0 f5c5a07bd -> e05ad8830 [SPARK-18208][SHUFFLE] Executor OOM due to a growing LongArray in BytesToBytesMap ## What changes were proposed in this pull request? BytesToBytesMap currently does not release the in-memory storage (the

spark git commit: [SPARK-18208][SHUFFLE] Executor OOM due to a growing LongArray in BytesToBytesMap

2016-12-07 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/branch-2.1 51754d6df -> 4432a2a83 [SPARK-18208][SHUFFLE] Executor OOM due to a growing LongArray in BytesToBytesMap ## What changes were proposed in this pull request? BytesToBytesMap currently does not release the in-memory storage (the

spark git commit: [SPARK-18208][SHUFFLE] Executor OOM due to a growing LongArray in BytesToBytesMap

2016-12-07 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/master 79f5f281b -> c496d03b5 [SPARK-18208][SHUFFLE] Executor OOM due to a growing LongArray in BytesToBytesMap ## What changes were proposed in this pull request? BytesToBytesMap currently does not release the in-memory storage (the longArray