Repository: spark Updated Branches: refs/heads/master 47d5d0ddb -> 233845126
[SPARK-18495][UI] Document meaning of green dot in DAG visualization ## What changes were proposed in this pull request? A green dot in the DAG visualization apparently means that the referenced RDD is cached. This is not documented anywhere except in this [blog post](https://databricks.com/blog/2015/06/22/understanding-your-spark-application-through-visualization.html). It would be good if the Web UI itself documented this somehow (perhaps in the tooltip?) so that the user can naturally learn what it means while using the Web UI. before pr:   after pr:   ## How was this patch tested? Author: uncleGen <husty...@gmail.com> Closes #16702 from uncleGen/SPARK-18495. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/23384512 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/23384512 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/23384512 Branch: refs/heads/master Commit: 2338451266d37b4c952827325cdee53b3e8fbc78 Parents: 47d5d0d Author: uncleGen <husty...@gmail.com> Authored: Wed Jan 25 17:18:13 2017 -0800 Committer: Reynold Xin <r...@databricks.com> Committed: Wed Jan 25 17:18:13 2017 -0800 ---------------------------------------------------------------------- .../scala/org/apache/spark/ui/scope/RDDOperationGraph.scala | 7 ++++++- 1 file changed, 6 insertions(+), 1 deletion(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/spark/blob/23384512/core/src/main/scala/org/apache/spark/ui/scope/RDDOperationGraph.scala ---------------------------------------------------------------------- diff --git a/core/src/main/scala/org/apache/spark/ui/scope/RDDOperationGraph.scala b/core/src/main/scala/org/apache/spark/ui/scope/RDDOperationGraph.scala index 0e33087..43bfe0a 100644 --- a/core/src/main/scala/org/apache/spark/ui/scope/RDDOperationGraph.scala +++ b/core/src/main/scala/org/apache/spark/ui/scope/RDDOperationGraph.scala @@ -222,7 +222,12 @@ private[ui] object RDDOperationGraph extends Logging { /** Return the dot representation of a node in an RDDOperationGraph. */ private def makeDotNode(node: RDDOperationNode): String = { - val label = s"${node.name} [${node.id}]\n${node.callsite}" + val isCached = if (node.cached) { + " [Cached]" + } else { + "" + } + val label = s"${node.name} [${node.id}]$isCached\n${node.callsite}" s"""${node.id} [label="${StringEscapeUtils.escapeJava(label)}"]""" } --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
