Re: Connection reset by peer : failed to remove cache rdd

2021-09-02 Thread Harsh Sharma
On 2021/09/02 06:00:26, Harsh Sharma wrote: > Please Find reply : > Do you know when in your application lifecycle it happens? Spark SQL or > > Structured Streaming? > > ans :its Spark SQL > > Do you use broadcast variables ? > > ans : yes we are using broadcast variables > or are the

Re: Connection reset by peer : failed to remove cache rdd

2021-09-02 Thread Harsh Sharma
Please Find reply : Do you know when in your application lifecycle it happens? Spark SQL or > Structured Streaming? ans :its Spark SQL Do you use broadcast variables ? ans : yes we are using broadcast variables or are the errors coming from broadcast joins perhaps? ans :we are not using

Re: Connection reset by peer : failed to remove cache rdd

2021-09-01 Thread Harsh Sharma
On 2021/08/30 13:32:19, Jacek Laskowski wrote: > Hi, > > No idea what might be going on here, but I'd not worry much about it and > simply monitor disk usage as some broadcast blocks might have left over. > > Do you know when in your application lifecycle it happens? Spark SQL or >

Re: Connection reset by peer : failed to remove cache rdd

2021-08-30 Thread Jacek Laskowski
Hi, No idea what might be going on here, but I'd not worry much about it and simply monitor disk usage as some broadcast blocks might have left over. Do you know when in your application lifecycle it happens? Spark SQL or Structured Streaming? Do you use broadcast variables or are the errors

Connection reset by peer : failed to remove cache rdd

2021-08-30 Thread Harsh Sharma
We are facing issue in production where we are getting frequent Still have 1 request outstanding when connection with the hostname was closed connection reset by peer : errors as well as warnings : failed to remove cache rdd or failed to remove broadcast variable. Please help us how to