gt;> done in UI
>>>>>>> > so maybe doing manually would be the only option. Not sure Spark
>>>>>>> UI will
>>>>>>> > provide the same, haven't used at all.)
>>>>>>> >
>>>>>>> &g
;> running) and
>>>>>> > which point to look at.
>>>>>> >
>>>>>> > On Thu, Apr 16, 2020 at 4:29 PM Ruijing Li
>>>>>> wrote:
>>>>>> >
>>>>>> > > Once I do. th
-z
[1] -- https://linux.die.net/man/2/accept
From: Jungtaek Lim
Sent: Wednesday, April 22, 2020 11:21
To: Ruijing Li
Cc: Gabor Somogyi; Mich Talebzadeh; ZHANG Wei; user
Subject: Re: Spark hangs while reading from jdbc - does nothing Removing Guess
work from trouble shooting
No, that's not a thin
even it's shown as
>>>>>> running) and
>>>>>> > which point to look at.
>>>>>> >
>>>>>> > On Thu, Apr 16, 2020 at 4:29 PM Ruijing Li
>>>>>> wrote:
>>>>>> >
>>>>>> > > Once I do. thr
I be looking for to tell where
>>>>> it is
>>>>> > > hanging? Seeing a lot of timed_waiting and waiting on driver.
>>>>> Driver is
>>>>> > > also being blocked by spark UI. If there are no tasks, is there a
; > On Tue, Apr 14, 2020 at 4:49 AM Gabor Somogyi <
>>>> gabor.g.somo...@gmail.com>
>>>> > > wrote:
>>>> > >
>>>> > >> The simplest way is to do thread dump which doesn't require any
>>>> fancy
>&g
horpe
>>
>> > >> wrote:
>> > >>
>> > >>> Here a is another tool I use Logic Analyser 7:55
>> > >>> https://youtu.be/LnzuMJLZRdU
>> > >>>
>> > >>> you could take some suggestions for improv
gt;>> > >
>>> > >> The simplest way is to do thread dump which doesn't require any
>>> fancy
>>> > >> tool (it's available on Spark UI).
>>> > >> Without thread dump it's hard to say anything...
>>> > >>
>>> &
>> Here a is another tool I use Logic Analyser 7:55
> > >>> https://youtu.be/LnzuMJLZRdU
> > >>>
> > >>> you could take some suggestions for improving performance queries.
> > >>>
> https://dzone.com/articles/why-you-shoul
gt;> you could take some suggestions for improving performance queries.
> >>> https://dzone.com/articles/why-you-should-not-use-select-in-sql-query-1
> >>>
> >>>
> >>> Jane thorpe
> >>> janethor...@aol.com
> >>>
> >>&g
e
>>> To: janethorpe1 ; mich.talebzadeh <
>>> mich.talebza...@gmail.com>; liruijing09 ; user <
>>> user@spark.apache.org>
>>> Sent: Mon, 13 Apr 2020 8:32
>>> Subject: Re: Spark hangs while reading from jdbc - does nothing Removing
>>>
m
>>
>>
>> -Original Message-
>> From: jane thorpe
>> To: janethorpe1 ; mich.talebzadeh <
>> mich.talebza...@gmail.com>; liruijing09 ; user <
>> user@spark.apache.org>
>> Sent: Mon, 13 Apr 2020 8:32
>> Subject: Re: Spark hangs while reading
h.talebzadeh <
> mich.talebza...@gmail.com>; liruijing09 ; user <
> user@spark.apache.org>
> Sent: Mon, 13 Apr 2020 8:32
> Subject: Re: Spark hangs while reading from jdbc - does nothing Removing
> Guess work from trouble shooting
>
>
>
>
thorpe
To: janethorpe1 ; mich.talebzadeh
; liruijing09 ; user
Sent: Mon, 13 Apr 2020 8:32
Subject: Re: Spark hangs while reading from jdbc - does nothing Removing Guess
work from trouble shooting
This tool may be useful for you to trouble shoot your problems away.
https
This tool may be useful for you to trouble shoot your problems away.
https://www.javacodegeeks.com/2020/04/simplifying-apm-remove-the-guesswork-from-troubleshooting.html
"APM tools typically use a waterfall-type view to show the blocking time of
different components cascading through the
15 matches
Mail list logo