If you're using YARN with Spark 1.3.1, you could be running into https://issues.apache.org/jira/browse/SPARK-8119, although without more information it's impossible to know.
On Tue, Sep 1, 2015 at 11:28 AM, Priya Ch <learnings.chitt...@gmail.com> wrote: > Hi All, > > I have a spark streaming application which writes the processed results > to cassandra. In local mode, the code seems to work fine. The moment i > start running in distributed mode using yarn, i see executor lost failure. > I increased executor memory to occupy entire node's memory which is around > 12gb/ But still see the same issue. > > What could be the possible scenarios for executor lost failure ? >