Re: spark-defaults.conf optimal configuration

2015-12-09 Thread cjrumble
Hello Neelesh, Thank you for the checklist for determining the correct configuration of Spark. I will go through these and let you know if I have further questions. Regards, Chris -- View this message in context:

Re: spark-defaults.conf optimal configuration

2015-12-08 Thread nsalian
Hi Chris, Thank you for posting the question. Tuning spark configurations is a tricky task since there are a lot factors to consider. The configurations that you listed cover the most them. To understand the situation that can guide you in making a decision about tuning: 1) What kind of spark