Thanks Sean! My novice understanding is that the 'native heap' is the
address space not allocated to the JVM heap, but I wanted to check to see
if I'm missing something. I found out my issue appeared to be actual
memory pressure on the executor machine. There was space for the JVM heap
but not
Yes, that's correct to my understanding and the probable explanation of
your issue. There are no additional limits or differences from how the JVM
works here.
On Nov 3, 2014 4:40 AM, Paul Wais pw...@yelp.com wrote:
Thanks Sean! My novice understanding is that the 'native heap' is the
address
No, but, the JVM also does not allocate memory for native code on the heap.
I dont think heap has any bearing on whether your native code can't
allocate more memory except that of course the heap is also taking memory.
On Oct 30, 2014 6:43 PM, Paul Wais pw...@yelp.com wrote:
Dear Spark List,
I