On 28 Dec 2017, at 19:42, Gourav Sengupta <gourav.sengu...@gmail.com> wrote: > In the EMR cluster what are the other applications that you have enabled > (like HIVE, FLUME, Livy, etc).
Nothing that I can think of, just a Spark step (unless EMR is doing fancy stuff behind my back). > Are you using SPARK Session? Yes. > If yes is your application using cluster mode or client mode? Cluster mode. > Have you read the EC2 service level agreement? I did not -- I doubt it has the answer to my problem though! :-) > Is your cluster on auto scaling group? Nope. > Are you scheduling your job by adding another new step into the EMR cluster? > Or is it the same job running always triggered by some background process? > Since EMR are supposed to be ephemeral, have you tried creating a new cluster > and trying your job in that? I'm creating a new cluster on demand, specifically for that job. No other application runs on it. JM --------------------------------------------------------------------- To unsubscribe e-mail: user-unsubscr...@spark.apache.org
