If you can look a bit in the executor logs, you would see the exact reason
(mostly a OOM/GC etc). Instead of using foreach, try to use mapPartitions
or foreachPartitions.
Thanks
Best Regards
On Tue, Sep 8, 2015 at 10:45 PM, Priya Ch <learnings.chitt...@gmail.com>
wrote:
> Hello All,
>
> I am using foreachRDD in my code as -
>
> dstream.foreachRDD { rdd => rdd.foreach { record => // look up with
> cassandra table
> // save updated rows to cassandra table.
> }
> }
> This foreachRDD is causing executor lost failure. what is the behavior of
> this foreachRDD ???
>
> Thanks,
> Padma Ch
>
