[ https://issues.apache.org/jira/browse/SPARK-38559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
caican updated SPARK-38559: --------------------------- Description: When demoting join from broadcast-hash to smj, i think it is necessary to display the number of empty partitions on spark ui. Otherwise, users might wonder why SMJ is used when joining a small table. Displaying the number of empty partitions is useful for users to understand changes to the execution plan. Before updated the ui:) !image-2022-03-16-10-56-46-446.png! After updated the ui, display the number of empty partitions:) !image-2022-03-16-11-07-39-182.png! was: When demoting join from broadcast-hash to smj, i think it is necessary to display the number of empty partitions on spark ui. Otherwise, users might wonder why SMJ is used when joining a small table. Displaying the number of empty partitions is useful for users to understand changes to the execution plan. Before modify the ui: !image-2022-03-16-10-56-46-446.png! > display the number of empty partitions on spark ui > -------------------------------------------------- > > Key: SPARK-38559 > URL: https://issues.apache.org/jira/browse/SPARK-38559 > Project: Spark > Issue Type: Improvement > Components: SQL, Web UI > Affects Versions: 3.1.2 > Reporter: caican > Priority: Major > Attachments: image-2022-03-16-10-56-46-446.png, > image-2022-03-16-11-07-39-182.png > > > When demoting join from broadcast-hash to smj, i think it is necessary to > display the number of empty partitions on spark ui. > Otherwise, users might wonder why SMJ is used when joining a small table. > Displaying the number of empty partitions is useful for users to understand > changes to the execution plan. > Before updated the ui:) > !image-2022-03-16-10-56-46-446.png! > After updated the ui, display the number of empty partitions:) > !image-2022-03-16-11-07-39-182.png! > > > > -- This message was sent by Atlassian Jira (v8.20.1#820001) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org