[jira] [Commented] (SPARK-6943) Graphically show RDD's included in a stage
[ https://issues.apache.org/jira/browse/SPARK-6943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14526181#comment-14526181 ] Andrew Or commented on SPARK-6943: -- Hi [~kayousterhout] I updated the patch to include both the job view and the stage view. Please have a look. Graphically show RDD's included in a stage -- Key: SPARK-6943 URL: https://issues.apache.org/jira/browse/SPARK-6943 Project: Spark Issue Type: Sub-task Components: Spark Core, SQL Reporter: Patrick Wendell Assignee: Andrew Or Attachments: DAGvisualizationintheSparkWebUI.pdf, job-page.png, stage-page.png -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-6943) Graphically show RDD's included in a stage
[ https://issues.apache.org/jira/browse/SPARK-6943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14518084#comment-14518084 ] Andrew Or commented on SPARK-6943: -- Yeah ideally we will have the job graph that magnifies into the stage graph. I'll see what I can do. Graphically show RDD's included in a stage -- Key: SPARK-6943 URL: https://issues.apache.org/jira/browse/SPARK-6943 Project: Spark Issue Type: Sub-task Components: Spark Core, SQL Reporter: Patrick Wendell Assignee: Andrew Or Attachments: DAGvisualizationintheSparkWebUI.pdf, with-closures.png, with-stack-trace.png -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-6943) Graphically show RDD's included in a stage
[ https://issues.apache.org/jira/browse/SPARK-6943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14517582#comment-14517582 ] Kay Ousterhout commented on SPARK-6943: --- After looking at the 2 PRs for this (which BTW look awesome!!) I was wondering: does it make more sense to have this on the job page than on the stage page? Or in addition to on the stage page? My sense is that people often start with the question how did my job end up in all generating all of these stages, and to that end, showing the diagram for an entire job (so the visualization you have, but aggregated for all of the stages, with a box delineating each stage) might be more useful, because then a user can look at a single diagram to see what's happening. Graphically show RDD's included in a stage -- Key: SPARK-6943 URL: https://issues.apache.org/jira/browse/SPARK-6943 Project: Spark Issue Type: Sub-task Components: Spark Core, SQL Reporter: Patrick Wendell Assignee: Andrew Or Attachments: DAGvisualizationintheSparkWebUI.pdf, with-closures.png, with-stack-trace.png -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-6943) Graphically show RDD's included in a stage
[ https://issues.apache.org/jira/browse/SPARK-6943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14515872#comment-14515872 ] Apache Spark commented on SPARK-6943: - User 'andrewor14' has created a pull request for this issue: https://github.com/apache/spark/pull/5728 Graphically show RDD's included in a stage -- Key: SPARK-6943 URL: https://issues.apache.org/jira/browse/SPARK-6943 Project: Spark Issue Type: Sub-task Components: Spark Core, SQL Reporter: Patrick Wendell Assignee: Andrew Or Attachments: DAGvisualizationintheSparkWebUI.pdf, with-closure-cleaner.png -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-6943) Graphically show RDD's included in a stage
[ https://issues.apache.org/jira/browse/SPARK-6943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14515875#comment-14515875 ] Apache Spark commented on SPARK-6943: - User 'andrewor14' has created a pull request for this issue: https://github.com/apache/spark/pull/5729 Graphically show RDD's included in a stage -- Key: SPARK-6943 URL: https://issues.apache.org/jira/browse/SPARK-6943 Project: Spark Issue Type: Sub-task Components: Spark Core, SQL Reporter: Patrick Wendell Assignee: Andrew Or Attachments: DAGvisualizationintheSparkWebUI.pdf, with-closure-cleaner.png -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
