Hi Prashant,
Yes I understand that will be available from Spark 3.0.2 . But I am using
Spark3.0.1
Could you please suggest any way to mitigate this exception?
Will it cause any issues from this exception in the spark application?
Thanks
Sachit
On Mon, 1 Feb 2021, 13:57 Prashant Sharma,
Hi Sachit,
The fix verison on that JIRA says 3.0.2, so this fix is not yet released.
Soon, there will be a 3.1.1 release, in the meantime you can try out the
3.1.1-rc which also has the fix and let us know your findings.
Thanks,
On Mon, Feb 1, 2021 at 10:24 AM Sachit Murarka
wrote:
>
Following is the related JIRA , Can someone pls check
https://issues.apache.org/jira/browse/SPARK-24266
I am using 3.0.1 , It says fixed in 3.0.0 and 3.1.0 . Could you please
suggest what can be done to avoid this?
Kind Regards,
Sachit Murarka
On Sun, Jan 31, 2021 at 6:38 PM Sachit Murarka
Hi Users,
I am running Spark application on Kubernetes and getting the following
exception in the driver pod. Though it is not affecting the output.
This exception is coming every 5 minutes and this is a structured streaming
job.
Could anyone please advise ?
21/01/29 06:33:15 WARN
