[GitHub] [spark] pengbo opened a new pull request #24666: [SPARK-27482][SQL][WEBUI] Show BroadcastHashJoinExec numOutputRows statistics info on SparkSQL UI page

[GitBox]

pengbo opened a new pull request #24666: [SPARK-27482][SQL][WEBUI] Show 
BroadcastHashJoinExec numOutputRows statistics info on SparkSQL UI page
URL: https://github.com/apache/spark/pull/24666
 
 
   ## What changes were proposed in this pull request?
   Currently, the SparkSQL UI page shows only actual metric info in each 
SparkPlan node. However with `statistics` info may help us understand how the 
plan is designed and the reason why it runs slowly. This PR is to show 
`numOutputRows` metric's `statistic` info of `BroadcastHashJoinExec` node on 
SparkSQL UI page when it's available.
   
   The main changes:
   1.  Add `stats` field in `SQLMetric` and passing it to `SQLPlanMetric` to 
show on UI page when it's available
   2. Initialize `numOutputRows` with rowCount `stats` in `logicalPlan` of 
`BroadcastHashJoinExec`, thanks to https://github.com/apache/spark/pull/24626
   
   <img width="311" alt="SPARK-27482-1" 
src="https://user-images.githubusercontent.com/1247590/56264561-7d8d4e00-6119-11e9-9ea3-9b19634ab9b6.png";>
   
   ## How was this patch tested?
   Regarding unit test has been added, manual UI test has been tested
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org