Re: Spark hangs while reading from jdbc - does nothing Removing Guess work from trouble shooting

2020-05-06 Thread Ruijing Li
gt;> done in UI >>>>>>> > so maybe doing manually would be the only option. Not sure Spark >>>>>>> UI will >>>>>>> > provide the same, haven't used at all.) >>>>>>> > >>>>>>> &g

Re: Spark hangs while reading from jdbc - does nothing Removing Guess work from trouble shooting

2020-04-24 Thread Waleed Fateem
;> running) and >>>>>> > which point to look at. >>>>>> > >>>>>> > On Thu, Apr 16, 2020 at 4:29 PM Ruijing Li >>>>>> wrote: >>>>>> > >>>>>> > > Once I do. th

Re: Spark hangs while reading from jdbc - does nothing Removing Guess work from trouble shooting

2020-04-23 Thread ZHANG Wei
-z [1] -- https://linux.die.net/man/2/accept From: Jungtaek Lim Sent: Wednesday, April 22, 2020 11:21 To: Ruijing Li Cc: Gabor Somogyi; Mich Talebzadeh; ZHANG Wei; user Subject: Re: Spark hangs while reading from jdbc - does nothing Removing Guess work from trouble shooting No, that's not a thin

Re: Spark hangs while reading from jdbc - does nothing Removing Guess work from trouble shooting

2020-04-21 Thread Jungtaek Lim
even it's shown as >>>>>> running) and >>>>>> > which point to look at. >>>>>> > >>>>>> > On Thu, Apr 16, 2020 at 4:29 PM Ruijing Li >>>>>> wrote: >>>>>> > >>>>>> > > Once I do. thr

Re: Spark hangs while reading from jdbc - does nothing Removing Guess work from trouble shooting

2020-04-21 Thread Ruijing Li
I be looking for to tell where >>>>> it is >>>>> > > hanging? Seeing a lot of timed_waiting and waiting on driver. >>>>> Driver is >>>>> > > also being blocked by spark UI. If there are no tasks, is there a

Re: Spark hangs while reading from jdbc - does nothing Removing Guess work from trouble shooting

2020-04-21 Thread Jungtaek Lim
; > On Tue, Apr 14, 2020 at 4:49 AM Gabor Somogyi < >>>> gabor.g.somo...@gmail.com> >>>> > > wrote: >>>> > > >>>> > >> The simplest way is to do thread dump which doesn't require any >>>> fancy >&g

Re: Spark hangs while reading from jdbc - does nothing Removing Guess work from trouble shooting

2020-04-21 Thread Ruijing Li
horpe >> >> > >> wrote: >> > >> >> > >>> Here a is another tool I use Logic Analyser 7:55 >> > >>> https://youtu.be/LnzuMJLZRdU >> > >>> >> > >>> you could take some suggestions for improv

Re: Spark hangs while reading from jdbc - does nothing Removing Guess work from trouble shooting

2020-04-21 Thread Ruijing Li
gt;>> > > >>> > >> The simplest way is to do thread dump which doesn't require any >>> fancy >>> > >> tool (it's available on Spark UI). >>> > >> Without thread dump it's hard to say anything... >>> > >> >>> &

Re: Spark hangs while reading from jdbc - does nothing Removing Guess work from trouble shooting

2020-04-21 Thread Ruijing Li
>> Here a is another tool I use Logic Analyser 7:55 > > >>> https://youtu.be/LnzuMJLZRdU > > >>> > > >>> you could take some suggestions for improving performance queries. > > >>> > https://dzone.com/articles/why-you-shoul

Re: Spark hangs while reading from jdbc - does nothing Removing Guess work from trouble shooting

2020-04-16 Thread ZHANG Wei
gt;> you could take some suggestions for improving performance queries. > >>> https://dzone.com/articles/why-you-should-not-use-select-in-sql-query-1 > >>> > >>> > >>> Jane thorpe > >>> janethor...@aol.com > >>> > >>&g

Re: Spark hangs while reading from jdbc - does nothing Removing Guess work from trouble shooting

2020-04-16 Thread Jungtaek Lim
e >>> To: janethorpe1 ; mich.talebzadeh < >>> mich.talebza...@gmail.com>; liruijing09 ; user < >>> user@spark.apache.org> >>> Sent: Mon, 13 Apr 2020 8:32 >>> Subject: Re: Spark hangs while reading from jdbc - does nothing Removing >>>

Re: Spark hangs while reading from jdbc - does nothing Removing Guess work from trouble shooting

2020-04-16 Thread Ruijing Li
m >> >> >> -Original Message- >> From: jane thorpe >> To: janethorpe1 ; mich.talebzadeh < >> mich.talebza...@gmail.com>; liruijing09 ; user < >> user@spark.apache.org> >> Sent: Mon, 13 Apr 2020 8:32 >> Subject: Re: Spark hangs while reading

Re: Spark hangs while reading from jdbc - does nothing Removing Guess work from trouble shooting

2020-04-14 Thread Gabor Somogyi
h.talebzadeh < > mich.talebza...@gmail.com>; liruijing09 ; user < > user@spark.apache.org> > Sent: Mon, 13 Apr 2020 8:32 > Subject: Re: Spark hangs while reading from jdbc - does nothing Removing > Guess work from trouble shooting > > > >

Re: Spark hangs while reading from jdbc - does nothing Removing Guess work from trouble shooting

2020-04-14 Thread jane thorpe
thorpe To: janethorpe1 ; mich.talebzadeh ; liruijing09 ; user Sent: Mon, 13 Apr 2020 8:32 Subject: Re: Spark hangs while reading from jdbc - does nothing Removing Guess work from trouble shooting This tool may be useful for you to trouble shoot your problems away. https

Re: Spark hangs while reading from jdbc - does nothing Removing Guess work from trouble shooting

2020-04-13 Thread jane thorpe
This tool may be useful for you to trouble shoot your problems away. https://www.javacodegeeks.com/2020/04/simplifying-apm-remove-the-guesswork-from-troubleshooting.html "APM tools typically use a waterfall-type view to show the blocking time of different components cascading through the