If you can look a bit in the executor logs, you would see the exact reason
(mostly a OOM/GC etc). Instead of using foreach, try to use mapPartitions
or foreachPartitions.
Thanks
Best Regards
On Tue, Sep 8, 2015 at 10:45 PM, Priya Ch
wrote:
> Hello All,
>
> I am
Hello All,
I am using foreachRDD in my code as -
dstream.foreachRDD { rdd => rdd.foreach { record => // look up with
cassandra table
// save updated rows to cassandra table.
}
}
This foreachRDD is causing executor lost failure. what is the behavior of
this foreachRDD ???
Thanks,
Padma Ch