This tool may be useful for you to trouble shoot your problems away.
https://www.javacodegeeks.com/2020/04/simplifying-apm-remove-the-guesswork-from-troubleshooting.html
"APM tools typically use a waterfall-type view to show the blocking time of
different components cascading through the contr
thorpe
To: janethorpe1 ; mich.talebzadeh
; liruijing09 ; user
Sent: Mon, 13 Apr 2020 8:32
Subject: Re: Spark hangs while reading from jdbc - does nothing Removing Guess
work from trouble shooting
This tool may be useful for you to trouble shoot your problems away.
https
nethorpe1 ; mich.talebzadeh <
> mich.talebza...@gmail.com>; liruijing09 ; user <
> user@spark.apache.org>
> Sent: Mon, 13 Apr 2020 8:32
> Subject: Re: Spark hangs while reading from jdbc - does nothing Removing
> Guess work from trouble shooting
>
ethor...@aol.com
>>
>>
>> -Original Message-
>> From: jane thorpe
>> To: janethorpe1 ; mich.talebzadeh <
>> mich.talebza...@gmail.com>; liruijing09 ; user <
>> user@spark.apache.org>
>> Sent: Mon, 13 Apr 2020 8:32
>> Subject: Re: Spark hangs
>> From: jane thorpe
>>> To: janethorpe1 ; mich.talebzadeh <
>>> mich.talebza...@gmail.com>; liruijing09 ; user <
>>> user@spark.apache.org>
>>> Sent: Mon, 13 Apr 2020 8:32
>>> Subject: Re: Spark hangs while reading from jdbc - does not
; >>>
> >>> you could take some suggestions for improving performance queries.
> >>> https://dzone.com/articles/why-you-should-not-use-select-in-sql-query-1
> >>>
> >>>
> >>> Jane thorpe
> >>> janethor...@aol.com
> >
; >>
> > >>> Here a is another tool I use Logic Analyser 7:55
> > >>> https://youtu.be/LnzuMJLZRdU
> > >>>
> > >>> you could take some suggestions for improving performance queries.
> > >>>
> https://dzone.c
gt;> > >
>>> > >> The simplest way is to do thread dump which doesn't require any
>>> fancy
>>> > >> tool (it's available on Spark UI).
>>> > >> Without thread dump it's hard to say anything...
>>> >
, 2020 at 11:32 AM jane thorpe
>>
>> > >> wrote:
>> > >>
>> > >>> Here a is another tool I use Logic Analyser 7:55
>> > >>> https://youtu.be/LnzuMJLZRdU
>> > >>>
>> > >>> you could take so
gt;>> > > On Tue, Apr 14, 2020 at 4:49 AM Gabor Somogyi <
>>>> gabor.g.somo...@gmail.com>
>>>> > > wrote:
>>>> > >
>>>> > >> The simplest way is to do thread dump which doesn't require any
>>&
mp, what should I be looking for to tell where
>>>>> it is
>>>>> > > hanging? Seeing a lot of timed_waiting and waiting on driver.
>>>>> Driver is
>>>>> > > also being blocked by spark UI. If there are no tas
d (even it's shown as
>>>>>> running) and
>>>>>> > which point to look at.
>>>>>> >
>>>>>> > On Thu, Apr 16, 2020 at 4:29 PM Ruijing Li
>>>>>> wrote:
>>>>>> >
>>>>>>
--
Cheers,
-z
[1] -- https://linux.die.net/man/2/accept
From: Jungtaek Lim
Sent: Wednesday, April 22, 2020 11:21
To: Ruijing Li
Cc: Gabor Somogyi; Mich Talebzadeh; ZHANG Wei; user
Subject: Re: Spark hangs while reading from jdbc - does nothing Removing Guess
work from trouble shooting
No, that
#x27;s shown as
>>>>>> running) and
>>>>>> > which point to look at.
>>>>>> >
>>>>>> > On Thu, Apr 16, 2020 at 4:29 PM Ruijing Li
>>>>>> wrote:
>>>>>> >
>>>&
be
>>>>>>> done in UI
>>>>>>> > so maybe doing manually would be the only option. Not sure Spark
>>>>>>> UI will
>>>>>>> > provide the same, haven't used at all.)
>>>>>>> >
&
15 matches
Mail list logo