ursday, April 25, 2019 at 8:47 AM
To: "Long, Andrew"
Cc: dev
Subject: Re: FW: Stage 152 contains a task of very large size (12747 KB). The
maximum recommended task size is 100 KB
I usually only see that in regards to folks parallelizing very large objects.
From what I know, it's
text? I’ve been getting the following message which I suspect means
> I’ve unintentional caught some large objects but figuring out what those
> objects are is stumping me.
>
>
>
> 19/04/23 13:52:13 WARN org.apache.spark.internal.Logging$class
> TaskSetManager: Stage 152 c
org.apache.spark.internal.Logging$class TaskSetManager:
Stage 152 contains a task of very large size (12747 KB). The maximum
recommended task size is 100 KB
Cheers Andrew
