Juan Yu has uploaded a new change for review. http://gerrit.cloudera.org:8080/2579
Change subject: PREVIEW IMPALA-2076: Part2 - Show DataStreamSender in ExecSummary under EXCHANGE node. ...................................................................... PREVIEW IMPALA-2076: Part2 - Show DataStreamSender in ExecSummary under EXCHANGE node. ExecSummary only shows summary for plan node. DataStreamSender is not a plan node. Modified TExecSummary to include a data_stream_sender_map so Impala could track DataStreamSender summary and provide more insight about network traffic. Here is an example of new ExecSummary: Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail --------------------------------------------------------------------------------------------------------------------------------- 07:AGGREGATE 1 91.807ms 91.807ms 1 1 20.00 KB -1.00 B FINALIZE 06:EXCHANGE 1 255.625us 255.625us 2 1 0 -1.00 B UNPARTITIONED |--DataStreamSender 2 184.988us 185.751us 2 -1 16.00 KB -1.00 B DataStreamSender (dst_id=6) 03:AGGREGATE 2 3s336ms 3s422ms 2 1 94.59 KB 10.00 MB 02:HASH JOIN 2 1m15s 1m15s 1.93B 1.50M 1.01 GB 396.52 MB INNER JOIN, PARTITIONED |--05:EXCHANGE 2 2s743ms 2s783ms 15.75M 15.75M 0 0 HASH(b.medallion) | |--DataStreamSender 3 3s872ms 4s172ms 15.75M -1 130.66 KB -1.00 B DataStreamSender (dst_id=5) | 01:SCAN HDFS 3 789.420ms 833.881ms 15.75M 15.75M 14.32 MB 80.00 MB default.trip_fare_parquet b 04:EXCHANGE 2 128.059ms 142.198ms 1.50M 1.50M 0 0 HASH(s.medallion) |--DataStreamSender 2 563.868ms 828.027ms 1.50M -1 130.66 KB -1.00 B DataStreamSender (dst_id=4) 00:SCAN HDFS 2 376.407ms 416.973ms 1.50M 1.50M 33.68 MB 176.00 MB default.trip_fare_mid s Change-Id: Ia53206fdd02bd72294f86ab9dd0b71b58303d33e (cherry picked from commit 305bd5b54e8a35d894b32d36d2a4d54a2f4e300c) --- M be/src/runtime/coordinator.cc M be/src/runtime/data-stream-sender.cc M be/src/util/summary-util.cc M common/thrift/ExecStats.thrift M shell/impala_client.py 5 files changed, 81 insertions(+), 42 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala refs/changes/79/2579/1 -- To view, visit http://gerrit.cloudera.org:8080/2579 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-MessageType: newchange Gerrit-Change-Id: Ia53206fdd02bd72294f86ab9dd0b71b58303d33e Gerrit-PatchSet: 1 Gerrit-Project: Impala Gerrit-Branch: cdh5-trunk Gerrit-Owner: Juan Yu <j...@cloudera.com>
