Re: Spark Version 3.0.1 Gui Display Query

2021-03-04 Thread Kapil Garg
t; Ok , I understood. I will switch on event logs . > > Regards > Ranju > > -Original Message- > From: Attila Zsolt Piros > Sent: Thursday, March 4, 2021 11:38 PM > To: user@spark.apache.org > Subject: RE: Spark Version 3.0.1 Gui Display Query > > Hi Ranj

RE: Spark Version 3.0.1 Gui Display Query

2021-03-04 Thread Ranju Jain
Hi Attila, Ok , I understood. I will switch on event logs . Regards Ranju -Original Message- From: Attila Zsolt Piros Sent: Thursday, March 4, 2021 11:38 PM To: user@spark.apache.org Subject: RE: Spark Version 3.0.1 Gui Display Query Hi Ranju! I meant the event log would be very

Re: Spark Version 3.0.1 Gui Display Query

2021-03-04 Thread Mich Talebzadeh
Well I cannot recall in Spark 3.0.1. However, this looks fine in Spark 3.1.1 (recent release) See attached the image from the executor tabs LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw

RE: Spark Version 3.0.1 Gui Display Query

2021-03-04 Thread Attila Zsolt Piros
Hi Ranju! I meant the event log would be very helpful for analyzing the problem at your side. The three logs together (driver, executors, event) is the best from the same run of course. I know you want check the executors tab during the job is running. And for this you do not need to eventlog.

RE: Spark Version 3.0.1 Gui Display Query

2021-03-04 Thread Ranju Jain
Ranju -Original Message- From: Attila Zsolt Piros Sent: Wednesday, March 3, 2021 10:37 PM To: user@spark.apache.org Subject: RE: Spark Version 3.0.1 Gui Display Query Hi Ranju! The UI is built up from events. This is why history server able to show the state of the a finished app as

RE: Spark Version 3.0.1 Gui Display Query

2021-03-03 Thread Attila Zsolt Piros
Hi Ranju! The UI is built up from events. This is why history server able to show the state of the a finished app as those events are replayed to build a state, for details you can check web UI page and the following section too < https://spark.apache.org/docs/latest/monitoring.html#web-interface

Re: Spark Version 3.0.1 Gui Display Query

2021-03-01 Thread Kapil Garg
* Kapil Garg > *Sent:* Tuesday, March 2, 2021 11:39 AM > *To:* Ranju Jain > *Cc:* user@spark.apache.org > *Subject:* Re: Spark Version 3.0.1 Gui Display Query > > > > Hi Ranju, > > Is it happening just after you submit the spark application ? or are you > not abl

RE: Spark Version 3.0.1 Gui Display Query

2021-03-01 Thread Ranju Jain
gt; Cc: user@spark.apache.org<mailto:user@spark.apache.org> Subject: Re: Spark Version 3.0.1 Gui Display Query Hi Ranju, Is it happening just after you submit the spark application ? or are you not able to see executors info throughout the application lifetime ? Because you won't be able to s

RE: Spark Version 3.0.1 Gui Display Query

2021-03-01 Thread Ranju Jain
. But currently it is blank shown. [cid:image004.jpg@01D70F5A.8D200C40] [cid:image003.png@01D70F5A.0E04D530] Regards Ranju From: Kapil Garg Sent: Tuesday, March 2, 2021 11:39 AM To: Ranju Jain Cc: user@spark.apache.org Subject: Re: Spark Version 3.0.1 Gui Display Query Hi Ranju, Is it

Re: Spark Version 3.0.1 Gui Display Query

2021-03-01 Thread Kapil Garg
Hi Ranju, Is it happening just after you submit the spark application ? or are you not able to see executors info throughout the application lifetime ? Because you won't be able to see any info there until executors have been added to the application and tasks have been submitted. On Tue, Mar 2,

Spark Version 3.0.1 Gui Display Query

2021-03-01 Thread Ranju Jain
Hi , I started using Spark 3.0.1 version recently and noticed the Executors Tab on Spark GUI appears as blank. Please suggest what could be the reason of this type of display? Regards Ranju