[ https://issues.apache.org/jira/browse/SPARK-38550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17630062#comment-17630062 ]
Apache Spark commented on SPARK-38550: -------------------------------------- User 'gengliangwang' has created a pull request for this issue: https://github.com/apache/spark/pull/38542 > Use a disk-based store to save more information in live UI to help debug > ------------------------------------------------------------------------ > > Key: SPARK-38550 > URL: https://issues.apache.org/jira/browse/SPARK-38550 > Project: Spark > Issue Type: Task > Components: Spark Core, SQL > Affects Versions: 3.3.0 > Reporter: Linhong Liu > Assignee: Linhong Liu > Priority: Major > Fix For: 3.4.0 > > > In Spark, the UI lacks troubleshooting abilities. For example: > * AQE plan changes are not available > * plan description of a large plan is truncated > This is because the live UI depends on an in-memory KV store. We should > always be worried > about the stability issues when adding more information to the store. > Therefore, it's better to add a disk-based store to save more information -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org