[
https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16784172#comment-16784172
]
peay edited comment on SPARK-27019 at 3/5/19 7:28 AM:
------------------------------------------------------
Great!
-Is that compatible with my second observation above? (I tested without any
executors, and even without any task starting, the SQL tab had the wrong
output). I can try to get an event log for that as well if that's helpful.-
edit: I tried to reproduce that to export the event log, and could not. Seems
like your patch should address the issue.
was (Author: peay):
Great! Is that compatible with my second observation above? (I tested without
any executors, and even without any task starting, the SQL tab had the wrong
output). I can try to get an event log for that as well if that's helpful.
> Spark UI's SQL tab shows inconsistent values
> --------------------------------------------
>
> Key: SPARK-27019
> URL: https://issues.apache.org/jira/browse/SPARK-27019
> Project: Spark
> Issue Type: Bug
> Components: SQL, Web UI
> Affects Versions: 2.4.0
> Reporter: peay
> Priority: Major
> Attachments: Screenshot from 2019-03-01 21-31-48.png,
> application_1550040445209_4748, query-1-details.png, query-1-list.png,
> query-job-1.png, screenshot-spark-ui-details.png, screenshot-spark-ui-list.png
>
>
> Since 2.4.0, I am frequently seeing broken outputs in the SQL tab of the
> Spark UI, where submitted/duration make no sense, description has the ID
> instead of the actual description.
> Clicking on the link to open a query, the SQL plan is missing as well.
> I have tried to increase `spark.scheduler.listenerbus.eventqueue.capacity` to
> very large values like 30k out of paranoia that we may have too many events,
> but to no avail. I have not identified anything particular that leads to
> that: it doesn't occur in all my jobs, but it does occur in a lot of them
> still.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
