Re: Spark Task is not created

2016-06-26 Thread Ravindra
I have a lot of spark tests. And the failure is not deterministic. It can happen at any action that I do. Buy given below logs are common. And I overcome that using the repartitioning, coalescing etc so that I don't get that Submitting 2 missing tasks from ShuffleMapStage. Basically ensuring that

Re: Spark Task is not created

2016-06-25 Thread Akhil Das
Would be good if you can paste the piece of code that you are executing. On Sun, Jun 26, 2016 at 11:21 AM, Ravindra wrote: > Hi All, > > May be I need to just set some property or its a known issue. My spark > application hangs in test environment whenever I see

Spark Task is not created

2016-06-25 Thread Ravindra
Hi All, May be I need to just set some property or its a known issue. My spark application hangs in test environment whenever I see following message - 16/06/26 11:13:34 INFO DAGScheduler: *Submitting 2 missing tasks from ShuffleMapStage* 145 (MapPartitionsRDD[590] at rdd at