Re: Connection reset by peer : failed to remove cache rdd

2021-09-02 Thread Harsh Sharma
On 2021/09/02 06:00:26, Harsh Sharma wrote: > Please Find reply : > Do you know when in your application lifecycle it happens? Spark SQL or > > Structured Streaming? > > ans :its Spark SQL > > Do you use broadcast variables ? > > ans : yes we

Spark Phoenix Connection Exception while loading from Phoenix tables

2021-09-02 Thread Harsh Sharma
[01/09/21 11:55:51,861 WARN pool-1-thread-1](Client) Exception encountered while connecting to the server : java.lang.NullPointerException [01/09/21 11:55:51,862 WARN pool-1-thread-1](Client) Exception encountered while connecting to the server : java.lang.NullPointerException [01/09/21

Re: Connection reset by peer : failed to remove cache rdd

2021-09-02 Thread Harsh Sharma
ila.pl/> > Follow me on https://twitter.com/jaceklaskowski > > <https://twitter.com/jaceklaskowski> > > > On Mon, Aug 30, 2021 at 3:26 PM Harsh Sharma > wrote: > > > We are facing issue in production where we are getting frequent > > > > Still

Re: Connection reset by peer : failed to remove cache rdd

2021-09-01 Thread Harsh Sharma
; Follow me on https://twitter.com/jaceklaskowski > > <https://twitter.com/jaceklaskowski> > > > On Mon, Aug 30, 2021 at 3:26 PM Harsh Sharma > wrote: > > > We are facing issue in production where we are getting frequent > > > > Still have 1 requ

Connection reset by peer : failed to remove cache rdd

2021-08-30 Thread Harsh Sharma
We are facing issue in production where we are getting frequent Still have 1 request outstanding when connection with the hostname was closed connection reset by peer : errors as well as warnings : failed to remove cache rdd or failed to remove broadcast variable. Please help us how to

Spark Issues while upgrade to 2.4 from 1.6 in Parcels

2021-08-11 Thread Harsh Sharma
hi Team , we are upgrading our cloudera parcels to 6.X from 5.x , hence e have upgraded version of park from 1.6 to 2.4 . While executing a spark program we are getting the below error : Please help us how to resolve in cloudera parcels. There are suggestion to install spark gateway roles

Cloudera Parcel : spark issues after upgrade 1.6 to 2.4

2021-07-30 Thread Harsh Sharma
hi Team , we are upgrading our cloudera parcels to 6.X from 5.x , hence e have upgraded version of park from 1.6 to 2.4 . While executing a spark program we are getting the below error : Please help us how to resolve in cloudera parcels. There are suggestion to install spark gateway roles

Re: Connection Reset by Peer : failed to remove cached rdd

2021-07-30 Thread Harsh Sharma
[Stage 284:>(199 + 1) / 200][Stage 292:> (1 + 3) / 200] [Stage 284:>(199 + 1) / 200][Stage 292:> (2 + 3) / 200] [Stage 292:> (2 + 4) / 200][14/06/21 10:46:17,006 WARN