Hi All, I have a spark streaming application which writes the processed results to cassandra. In local mode, the code seems to work fine. The moment i start running in distributed mode using yarn, i see executor lost failure. I increased executor memory to occupy entire node's memory which is around 12gb/ But still see the same issue.
What could be the possible scenarios for executor lost failure ?
