Re: Spark Effects of Driver Memory, Executor Memory, Driver Memory Overhead and Executor Memory Overhead on success of job runs

Hi Krishna, Thanks for your reply. I will definitely take a look at it to understand the configuration details. Best Regards, Tim On Tue, Sep 1, 2015 at 6:17 PM, Krishna Sangeeth KS < kskrishnasange...@gmail.com> wrote: > Hi Timothy, > > I think the driver memory in all your examples is more

Re: Spark Effects of Driver Memory, Executor Memory, Driver Memory Overhead and Executor Memory Overhead on success of job runs

Dear Sandy, Many thanks for your reply. I am going to respond to your replies in reverse order if you don't mind as my second question is the more pressing issue for now. In the situation where you give more memory, but less memory overhead, and > the job completes less quickly, have you