[jira] [Commented] (SPARK-39902) Add Scan details to spark plan scan node in SparkUI
[ https://issues.apache.org/jira/browse/SPARK-39902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574029#comment-17574029 ] Sumeet commented on SPARK-39902: Hi [~dongjoon] - Noted. Thank you for updating the ticket and merging the changes. > Add Scan details to spark plan scan node in SparkUI > --- > > Key: SPARK-39902 > URL: https://issues.apache.org/jira/browse/SPARK-39902 > Project: Spark > Issue Type: Improvement > Components: SQL, Web UI >Affects Versions: 3.4.0 >Reporter: Sumeet >Assignee: Sumeet >Priority: Major > Fix For: 3.4.0 > > Attachments: Screen Shot 2022-07-27 at 6.00.27 PM.png, Screen Shot > 2022-07-27 at 6.00.50 PM.png, Screen Shot 2022-07-27 at 6.38.56 PM.png, > Screen Shot 2022-07-27 at 6.39.48 PM.png > > > Hi, > For DSv2, the scan node in the spark plan on SparkUI simply shows "BatchScan" > as opposed to "Scan ". > Add a method "String name()" to the Scan interface, that "BatchScanExec" can > invoke to set the node name the plan. This nodeName will be eventually used > by "SparkPlanGraphNode" to display it in the header of the UI node. > > DSv1 > !Screen Shot 2022-07-27 at 6.00.27 PM.png|width=356,height=212! > > DSv2 > !Screen Shot 2022-07-27 at 6.00.50 PM.png|width=293,height=277! -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-39902) Add Scan details to spark plan scan node in SparkUI
[ https://issues.apache.org/jira/browse/SPARK-39902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17573984#comment-17573984 ] Dongjoon Hyun commented on SPARK-39902: --- Thank you, [~sumeet.gajjar] . Apache Spark community have a backporting policy which allows bug fixes only. In other words, we cannot backport new features or improvements to branch-3.3. So, the Affected Version should be the version of master branch which is 3.4.0. I updated it in this JIRA. > Add Scan details to spark plan scan node in SparkUI > --- > > Key: SPARK-39902 > URL: https://issues.apache.org/jira/browse/SPARK-39902 > Project: Spark > Issue Type: Improvement > Components: SQL, Web UI >Affects Versions: 3.4.0 >Reporter: Sumeet >Priority: Major > Attachments: Screen Shot 2022-07-27 at 6.00.27 PM.png, Screen Shot > 2022-07-27 at 6.00.50 PM.png, Screen Shot 2022-07-27 at 6.38.56 PM.png, > Screen Shot 2022-07-27 at 6.39.48 PM.png > > > Hi, > For DSv2, the scan node in the spark plan on SparkUI simply shows "BatchScan" > as opposed to "Scan ". > Add a method "String name()" to the Scan interface, that "BatchScanExec" can > invoke to set the node name the plan. This nodeName will be eventually used > by "SparkPlanGraphNode" to display it in the header of the UI node. > > DSv1 > !Screen Shot 2022-07-27 at 6.00.27 PM.png|width=356,height=212! > > DSv2 > !Screen Shot 2022-07-27 at 6.00.50 PM.png|width=293,height=277! -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-39902) Add Scan details to spark plan scan node in SparkUI
[ https://issues.apache.org/jira/browse/SPARK-39902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17572193#comment-17572193 ] Sumeet commented on SPARK-39902: An example of this change can be seen while viewing the Iceberg scans on SparkUI. h2. Before this change: !Screen Shot 2022-07-27 at 6.39.48 PM.png|width=415,height=211! h2. After this change: !Screen Shot 2022-07-27 at 6.38.56 PM.png|width=430,height=216! > Add Scan details to spark plan scan node in SparkUI > --- > > Key: SPARK-39902 > URL: https://issues.apache.org/jira/browse/SPARK-39902 > Project: Spark > Issue Type: Improvement > Components: SQL, Web UI >Affects Versions: 3.3.1 >Reporter: Sumeet >Priority: Major > Attachments: Screen Shot 2022-07-27 at 6.00.27 PM.png, Screen Shot > 2022-07-27 at 6.00.50 PM.png, Screen Shot 2022-07-27 at 6.38.56 PM.png, > Screen Shot 2022-07-27 at 6.39.48 PM.png > > > Hi, > For DSv2, the scan node in the spark plan on SparkUI simply shows "BatchScan" > as opposed to "Scan ". > Add a method "String name()" to the Scan interface, that "BatchScanExec" can > invoke to set the node name the plan. This nodeName will be eventually used > by "SparkPlanGraphNode" to display it in the header of the UI node. > > DSv1 > !Screen Shot 2022-07-27 at 6.00.27 PM.png|width=356,height=212! > > DSv2 > !Screen Shot 2022-07-27 at 6.00.50 PM.png|width=293,height=277! -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-39902) Add Scan details to spark plan scan node in SparkUI
[ https://issues.apache.org/jira/browse/SPARK-39902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17572192#comment-17572192 ] Apache Spark commented on SPARK-39902: -- User 'sumeetgajjar' has created a pull request for this issue: https://github.com/apache/spark/pull/37325 > Add Scan details to spark plan scan node in SparkUI > --- > > Key: SPARK-39902 > URL: https://issues.apache.org/jira/browse/SPARK-39902 > Project: Spark > Issue Type: Improvement > Components: SQL, Web UI >Affects Versions: 3.3.1 >Reporter: Sumeet >Priority: Major > Attachments: Screen Shot 2022-07-27 at 6.00.27 PM.png, Screen Shot > 2022-07-27 at 6.00.50 PM.png > > > Hi, > For DSv2, the scan node in the spark plan on SparkUI simply shows "BatchScan" > as opposed to "Scan ". > Add a method "String name()" to the Scan interface, that "BatchScanExec" can > invoke to set the node name the plan. This nodeName will be eventually used > by "SparkPlanGraphNode" to display it in the header of the UI node. > > DSv1 > !Screen Shot 2022-07-27 at 6.00.27 PM.png|width=356,height=212! > > DSv2 > !Screen Shot 2022-07-27 at 6.00.50 PM.png|width=293,height=277! -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-39902) Add Scan details to spark plan scan node in SparkUI
[ https://issues.apache.org/jira/browse/SPARK-39902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17572186#comment-17572186 ] Sumeet commented on SPARK-39902: I'm working on it and will publish a patch soon. > Add Scan details to spark plan scan node in SparkUI > --- > > Key: SPARK-39902 > URL: https://issues.apache.org/jira/browse/SPARK-39902 > Project: Spark > Issue Type: Improvement > Components: SQL, Web UI >Affects Versions: 3.3.1 >Reporter: Sumeet >Priority: Major > > Hi, > For DSv2, the scan node in the spark plan on SparkUI simply shows "BatchScan" > as opposed to "Scan ". > Add a method "String name()" to the Scan interface, that "BatchScanExec" can > invoke to set the node name the plan. This nodeName will be eventually used > by "SparkPlanGraphNode" to display it in the header of the UI node. > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
