When doing groupby for big data,may be 500g,some partition tasks success,some
partition tasks fetchfailed error. Spark system retry previous stage,but
always fail
6 computers : 384g
Worker:40g*7 for one computer
Can anyone tell me why fetch failed
r big data,may be 500g,some partition tasks
> success,some partition tasks fetchfailed error. Spark system retry
> previous stage,but always fail
> 6 computers : 384g
> Worker:40g*7 for one computer
>
> Can anyone tell me why fetch failed???
>
puter
>
> Can anyone tell me why fetch failed???
> -
> To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
> For additional commands, e-mail: user-h...@spark.apache.org
>
>
ot;)
> .set("spark.akka.frameSize","50")
>
>
> Thanks
> Best Regards
>
>> On Sun, Oct 19, 2014 at 6:52 AM, marylucy wrote:
>> When doing groupby for big data,may be 500g,some partition tasks
>> success,some partition tasks fetchf
When doing groupby for big data,may be 500g,some partition tasks
>> success,some partition tasks fetchfailed error. Spark system retry
>> previous stage,but always fail
>> 6 computers : 384g
>> Worker:40g*7 for one computer
>>
>> Can anyone tell me why fetch failed???