I have a lot of spark tests. And the failure is not deterministic. It can
happen at any action that I do. Buy given below logs are common. And I
overcome that using the repartitioning, coalescing etc so that I don't get
that Submitting 2 missing tasks from ShuffleMapStage. Basically ensuring
that
Would be good if you can paste the piece of code that you are executing.
On Sun, Jun 26, 2016 at 11:21 AM, Ravindra
wrote:
> Hi All,
>
> May be I need to just set some property or its a known issue. My spark
> application hangs in test environment whenever I see
Hi All,
May be I need to just set some property or its a known issue. My spark
application hangs in test environment whenever I see following message -
16/06/26 11:13:34 INFO DAGScheduler: *Submitting 2 missing tasks from
ShuffleMapStage* 145 (MapPartitionsRDD[590] at rdd at