Does the Spark SQL web UI work for you? https://spark.apache.org/docs/3.0.0-preview/web-ui.html#sql-tab
On Thu, Apr 30, 2020 at 5:30 PM Manu Zhang <owenzhang1...@gmail.com> wrote: > Hi Kelly, > > If you can parse event log, then try listening on > `SparkListenerSQLExecutionStart` event and build a `SparkPlanGraph` like > https://github.com/apache/spark/blob/master/sql/core/src/main/scala/org/apache/spark/sql/execution/ui/SQLAppStatusListener.scala#L306 > . > > `SparkPlanGraph` has a `makeDotFile` method where you can write out a > `.dot` file and visualize it with Graphviz tools, e.g. > http://www.webgraphviz.com/ > > Thanks, > Manu > > On Thu, Apr 30, 2020 at 3:21 PM zhangliyun <kelly...@126.com> wrote: > >> Hi all >> i want to ask a question is there any tool to visualize the spark >> physical plan or spark plan? sometimes the physical plan is very long so it >> is difficult to view it. >> >> Best Regards >> KellyZhang >> >> >> >> >
