In spark-shell I get just as many executors as I want, unlike Zeppelin.
From: Jeff Zhang [mailto:[email protected]] Sent: Monday, February 27, 2017 12:45 PM To: [email protected] Subject: Re: My Zeppelin Spark Job is getting only 2 executors What is the behavior if you do it in spark-shell ? Gilad Landau <[email protected]<mailto:[email protected]>>于2017年2月27日周一 下午6:31写道： Hi, My Zeppelin spark job is getting only 2 executors on Yarn even though the interpreter is set to use 10. Also, when I look at history server I see that the job was intiated with the right number of exeuctors (10) but only 2 are actually being used. Any idea what could cause this behavior and how to fix it? Thanks, Gilad
