[ 
https://issues.apache.org/jira/browse/IMPALA-8906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16975289#comment-16975289
 ] 

ASF subversion and git services commented on IMPALA-8906:
---------------------------------------------------------

Commit 96394b4e3f653139d0a9a36e34122528fae6dcde in impala's branch 
refs/heads/master from Tamas Mate
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=96394b4 ]

IMPALA-8906: Fix flaky profile observability test

The test_query_profile_contains_query_compilation_metadata_load_events
is flaky because only non-zero stats are printed and the test is not
prepared to handle lines appearing based on conditions.

In general, zero values are printed in the profile as well, this makes
profile parsing simpler. Therefore, instead of changing the test the
condition has been removed as part of this change and the test is
updated accordingly.

Change-Id: I7f6172d75294c1dea8f6be086ebb303725c92620
Reviewed-on: http://gerrit.cloudera.org:8080/14704
Tested-by: Impala Public Jenkins <impala-public-jenk...@cloudera.com>
Reviewed-by: Csaba Ringhofer <csringho...@cloudera.com>


> TestObservability.test_query_profile_contains_query_compilation_metadata_load_events
>  is flaky
> ---------------------------------------------------------------------------------------------
>
>                 Key: IMPALA-8906
>                 URL: https://issues.apache.org/jira/browse/IMPALA-8906
>             Project: IMPALA
>          Issue Type: Bug
>          Components: Backend
>            Reporter: Sahil Takiar
>            Assignee: Tamas Mate
>            Priority: Major
>              Labels: broken-build, flaky
>         Attachments: jenkins.impala.io.txt
>
>
> This test failed in a recent run of ubuntu-16.04-dockerised-tests: 
> [https://jenkins.impala.io/job/ubuntu-16.04-dockerised-tests/1100/testReport/junit/query_test.test_observability/TestObservability/test_query_profile_contains_query_compilation_metadata_load_events/]
> Error Message:
> {code:java}
>  query_test/test_observability.py:340: in 
> test_query_profile_contains_query_compilation_metadata_load_events     
> self.__verify_profile_event_sequence(load_event_regexes, runtime_profile) 
> query_test/test_observability.py:432: in __verify_profile_event_sequence     
> assert event_regex_index == 0, \ E   AssertionError: 
> CatalogFetch.PartitionLists.Misses not in        - 
> CatalogFetch.PartitionLists.Hits: 1 E     Query 
> (id=56480a470616cf3c:7cfadfbe00000000): E       DEBUG MODE WARNING: Query 
> profile created while running a DEBUG build of Impala. Use RELEASE builds to 
> measure query performance. E       Summary: E         Session ID: 
> 854d1d6ab3cb65b7:9ba11e621c088385 E         Session Type: BEESWAX E         
> Start Time: 2019-08-28 20:01:05.725329000 E         End Time: 2019-08-28 
> 20:01:07.305869000 E         Query Type: QUERY E         Query State: 
> FINISHED E         Query Status: OK E         Impala Version: impalad version 
> 3.4.0-SNAPSHOT DEBUG (build 207b1443ff1b116d2d031dc5325ce971af80c4a6) E       
>   User: ubuntu E         Connected User: ubuntu E         Delegated User:  E  
>        Network Address: 172.18.0.1:44044 E         Default Db: default E      
>    Sql Statement: select * from functional.alltypes E         Coordinator: 
> f6d78aab23cf:22000 E         Query Options (set by configuration): 
> DEBUG_ACTION=CRS_BEFORE_ADMISSION:SLEEP@1000,TIMEZONE=Zulu,CLIENT_IDENTIFIER=query_test/test_observability.py::TestObservability::()::test_exec_summary_in_runtime_profile
>  E         Query Options (set by configuration and planner): 
> DEBUG_ACTION=CRS_BEFORE_ADMISSION:SLEEP@1000,MT_DOP=0,TIMEZONE=Zulu,CLIENT_IDENTIFIER=query_test/test_observability.py::TestObservability::()::test_exec_summary_in_runtime_profile
>  E         Plan:  E     ---------------- E     Max Per-Host Resource 
> Reservation: Memory=32.00KB Threads=3 E     Per-Host Resource Estimates: 
> Memory=160MB E     Codegen disabled by planner E     Analyzed query: SELECT * 
> FROM functional.alltypes E      E     F01:PLAN FRAGMENT [UNPARTITIONED] 
> hosts=1 instances=1 E     |  Per-Host Resources: mem-estimate=490.49KB 
> mem-reservation=0B thread-reservation=1 E     PLAN-ROOT SINK E     |  
> mem-estimate=0B mem-reservation=0B thread-reservation=0 E     | E     
> 01:EXCHANGE [UNPARTITIONED] E     |  mem-estimate=490.49KB mem-reservation=0B 
> thread-reservation=0 E     |  tuple-ids=0 row-size=89B cardinality=7.30K E    
>  |  in pipelines: 00(GETNEXT) E     | E     F00:PLAN FRAGMENT [RANDOM] 
> hosts=3 instances=3 E     Per-Host Resources: mem-estimate=160.00MB 
> mem-reservation=32.00KB thread-reservation=2 E     00:SCAN HDFS 
> [functional.alltypes, RANDOM] E        HDFS partitions=24/24 files=24 
> size=478.45KB E        stored statistics: E          table: rows=7.30K 
> size=478.45KB E          partitions: 24/24 rows=7.30K E          columns: all 
> E        extrapolated-rows=disabled max-scan-range-rows=310 E        
> mem-estimate=160.00MB mem-reservation=32.00KB thread-reservation=1 E        
> tuple-ids=0 row-size=89B cardinality=7.30K E        in pipelines: 00(GETNEXT) 
> E     ---------------- E         Estimated Per-Host Mem: 168274422 E         
> Request Pool: default-pool E         Per Host Min Memory Reservation: 
> 6db176633e3a:22000(32.00 KB) bf5c6b4d70c3:22000(32.00 KB) 
> f6d78aab23cf:22000(32.00 KB) E         Per Host Number of Fragment Instances: 
> 6db176633e3a:22000(1) bf5c6b4d70c3:22000(1) f6d78aab23cf:22000(2) E         
> Admission result: Admitted immediately E         Cluster Memory Admitted: 
> 481.44 MB E         Executor Group: default E         ExecSummary:  E     
> Operator              #Hosts   Avg Time   Max Time  #Rows  Est. #Rows   Peak 
> Mem  Est. Peak Mem  Detail               E     
> ---------------------------------------------------------------------------------------------------------------------
>  E     F01:ROOT                   1  323.998ms  323.998ms                     
>         0              0                       E     01:EXCHANGE              
>   1    3.999ms    3.999ms  7.30K       7.30K  776.00 KB      490.49 KB  
> UNPARTITIONED        E     F00:EXCHANGE SENDER        3    7.999ms   19.999ms 
>                       1.55 KB              0                       E     
> 00:SCAN HDFS               3   66.666ms  163.999ms  7.30K       7.30K    1.38 
> MB      160.00 MB  functional.alltypes E         Errors:  E         Query 
> Compilation: 139.437ms E            - Metadata of all 1 tables cached: 
> 116.233ms (116.233ms) E            - Analysis finished: 116.458ms (225.333us) 
> E            - Authorization finished (noop): 116.480ms (21.466us) E          
>   - Value transfer graph computed: 116.628ms (148.642us) E            - 
> Single node plan created: 133.186ms (16.557ms) E            - Runtime filters 
> computed: 133.229ms (43.430us) E            - Distributed plan created: 
> 133.256ms (27.095us) E            - Planning finished: 139.437ms (6.180ms) E  
>        Query Timeline: 1s587ms E            - Query submitted: 0.000ns 
> (0.000ns) E            - Planning finished: 143.999ms (143.999ms) E           
>  - Submit for admission: 1s147ms (1s003ms) E            - Completed 
> admission: 1s147ms (0.000ns) E            - Ready to start on 3 backends: 
> 1s147ms (0.000ns) E            - All 3 execution backends (4 fragment 
> instances) started: 1s167ms (19.999ms) E            - Rows available: 1s195ms 
> (27.999ms) E            - First row fetched: 1s211ms (15.999ms) E            
> - Last row fetched: 1s575ms (363.998ms) E            - Released admission 
> control resources: 1s583ms (7.999ms) E          - 
> AdmissionControlTimeSinceLastUpdate: 77.000ms E          - 
> ComputeScanRangeAssignmentTimer: 0.000ns E         Frontend: E            - 
> CatalogFetch.ColumnStats.Misses: 13 E            - 
> CatalogFetch.ColumnStats.Requests: 13 E            - 
> CatalogFetch.ColumnStats.Time: 9ms E            - CatalogFetch.Config.Hits: 1 
> E            - CatalogFetch.Config.Requests: 1 E            - 
> CatalogFetch.Config.Time: 0 E            - CatalogFetch.DatabaseList.Hits: 1 
> E            - CatalogFetch.DatabaseList.Requests: 1 E            - 
> CatalogFetch.DatabaseList.Time: 0 E            - 
> CatalogFetch.PartitionLists.Hits: 1 E            - 
> CatalogFetch.PartitionLists.Requests: 1 E            - 
> CatalogFetch.PartitionLists.Time: 0 E            - 
> CatalogFetch.Partitions.Hits: 48 E            - 
> CatalogFetch.Partitions.Misses: 20 E            - 
> CatalogFetch.Partitions.Requests: 68 E            - 
> CatalogFetch.Partitions.Time: 8ms E            - CatalogFetch.RPCs.Bytes: 
> 27.93 KB (28604) E            - CatalogFetch.RPCs.Requests: 3 E            - 
> CatalogFetch.RPCs.Time: 116ms E            - CatalogFetch.TableNames.Hits: 2 
> E            - CatalogFetch.TableNames.Requests: 2 E            - 
> CatalogFetch.TableNames.Time: 0 E            - CatalogFetch.Tables.Misses: 1 
> E            - CatalogFetch.Tables.Requests: 1 E            - 
> CatalogFetch.Tables.Time: 105ms E       ImpalaServer: E          - 
> ClientFetchWaitTimer: 51.999ms E          - RowMaterializationTimer: 
> 335.998ms E       Execution Profile 56480a470616cf3c:7cfadfbe00000000:(Total: 
> 383.998ms, non-child: 0.000ns, % non-child: 0.00%) E         Number of 
> filters: 0 E         Filter routing table:  E      ID  Src. Node  Tgt. 
> Node(s)  Target type  Partition filter  Pending (Expected)  First arrived  
> Completed   Enabled E     
> -------------------------------------------------------------------------------------------------------------------
>  E         Backend startup latencies: Count: 3, min / max: 9ms / 17ms, 25th 
> %-ile: 9ms, 50th %-ile: 10ms, 75th %-ile: 10ms, 90th %-ile: 17ms, 95th %-ile: 
> 17ms, 99.9th %-ile: 17ms E         Slowest backend to start up: 
> bf5c6b4d70c3:22000 E         Per Node Peak Memory Usage: 
> 6db176633e3a:22000(1.63 MB) bf5c6b4d70c3:22000(1.62 MB) 
> f6d78aab23cf:22000(1.06 MB) E         Per Node Bytes Read: 
> 6db176633e3a:22000(161.29 KB) bf5c6b4d70c3:22000(157.38 KB) 
> f6d78aab23cf:22000(159.77 KB) E         Per Node User Time: 
> 6db176633e3a:22000(16.000ms) bf5c6b4d70c3:22000(16.000ms) 
> f6d78aab23cf:22000(160.000ms) E         Per Node System Time: 
> 6db176633e3a:22000(0.000ns) bf5c6b4d70c3:22000(0.000ns) 
> f6d78aab23cf:22000(0.000ns) E          - ExchangeScanRatio: 0.59  E          
> - FiltersReceived: 0 (0) E          - FinalizationTimer: 0.000ns E          - 
> InnerNodeSelectivityRatio: 0.00  E          - NumBackends: 3 (3) E          - 
> NumFragmentInstances: 4 (4) E          - NumFragments: 2 (2) E          - 
> TotalBytesRead: 478.45 KB (489934) E          - TotalBytesSent: 283.47 KB 
> (290271) E          - TotalCpuTime: 192.000ms E          - 
> TotalInnerBytesSent: 0 E          - TotalScanBytesSent: 283.47 KB (290271) E  
>        Per Node Profiles: E           6db176633e3a:22000: E              - 
> ScratchBytesRead: 0 E              - ScratchBytesWritten: 0 E              - 
> ScratchFileUsedBytes: 0 E              - ScratchReads: 0 (0) E              - 
> ScratchWrites: 0 (0) E              - TotalEncryptionTime: 0.000ns E          
>     - TotalReadBlockTime: 0.000ns E           bf5c6b4d70c3:22000: E           
>    - ScratchBytesRead: 0 E              - ScratchBytesWritten: 0 E            
>   - ScratchFileUsedBytes: 0 E              - ScratchReads: 0 (0) E            
>   - ScratchWrites: 0 (0) E              - TotalEncryptionTime: 0.000ns E      
>         - TotalReadBlockTime: 0.000ns E           f6d78aab23cf:22000: E       
>        - ScratchBytesRead: 0 E              - ScratchBytesWritten: 0 E        
>       - ScratchFileUsedBytes: 0 E              - ScratchReads: 0 (0) E        
>       - ScratchWrites: 0 (0) E              - TotalEncryptionTime: 0.000ns E  
>             - TotalReadBlockTime: 0.000ns E         Averaged Fragment 
> F01:(Total: 403.998ms, non-child: 3.999ms, % non-child: 0.99%) E           
> split sizes:  min: 0, max: 0, avg: 0, stddev: 0 E           completion times: 
> min:415.998ms  max:415.998ms  mean: 415.998ms  stddev:0.000ns E           
> execution rates: min:0.00 /sec  max:0.00 /sec  mean:0.00 /sec  stddev:0.00 
> /sec E           num instances: 1 E            - AverageThreadTokens: 0.00  E 
>            - BloomFilterBytes: 0 E            - ExchangeScanRatio: 0.00  E    
>         - PeakMemoryUsage: 784.00 KB (802816) E            - PeakReservation: 
> 0 E            - PeakUsedReservation: 0 E            - PerHostPeakMemUsage: 
> 1.06 MB (1113656) E            - RowsProduced: 7.30K (7300) E            - 
> TotalNetworkReceiveTime: 23.999ms E            - TotalNetworkSendTime: 
> 0.000ns E            - TotalStorageWaitTime: 0.000ns E            - 
> TotalThreadsInvoluntaryContextSwitches: 78 (78) E            - 
> TotalThreadsTotalWallClockTime: 399.998ms E              - 
> TotalThreadsSysTime: 0.000ns E              - TotalThreadsUserTime: 140.000ms 
> E            - TotalThreadsVoluntaryContextSwitches: 10 (10) E           
> Buffer pool: E              - AllocTime: 0.000ns E              - 
> CumulativeAllocationBytes: 0 E              - CumulativeAllocations: 0 (0) E  
>             - PeakReservation: 0 E              - PeakUnpinnedBytes: 0 E      
>         - PeakUsedReservation: 0 E              - ReadIoBytes: 0 E            
>   - ReadIoOps: 0 (0) E              - ReadIoWaitTime: 0.000ns E              
> - ReservationLimit: 0 E              - SystemAllocTime: 0.000ns E             
>  - WriteIoBytes: 0 E              - WriteIoOps: 0 (0) E              - 
> WriteIoWaitTime: 0.000ns E           Fragment Instance Lifecycle Timings: E   
>            - ExecTime: 399.998ms E                - ExecTreeExecTime: 
> 27.999ms E              - OpenTime: 0.000ns E                - 
> ExecTreeOpenTime: 0.000ns E              - PrepareTime: 3.999ms E             
>    - ExecTreePrepareTime: 0.000ns E           PLAN_ROOT_SINK:(Total: 
> 371.998ms, non-child: 371.998ms, % non-child: 100.00%) E              - 
> PeakMemoryUsage: 0 E           EXCHANGE_NODE (id=1):(Total: 27.999ms, 
> non-child: 27.999ms, % non-child: 100.00%) E              - 
> ConvertRowBatchTime: 3.999ms E              - PeakMemoryUsage: 776.00 KB 
> (794624) E              - RowsReturned: 7.30K (7300) E              - 
> RowsReturnedRate: 260.71 K/sec E             Buffer pool: E                - 
> AllocTime: 0.000ns E                - CumulativeAllocationBytes: 960.00 KB 
> (983040) E                - CumulativeAllocations: 48 (48) E                - 
> PeakReservation: 776.00 KB (794624) E                - PeakUnpinnedBytes: 0 E 
>                - PeakUsedReservation: 776.00 KB (794624) E                - 
> ReadIoBytes: 0 E                - ReadIoOps: 0 (0) E                - 
> ReadIoWaitTime: 0.000ns E                - SystemAllocTime: 0.000ns E         
>        - WriteIoBytes: 0 E                - WriteIoOps: 0 (0) E               
>  - WriteIoWaitTime: 0.000ns E             Dequeue: E                - 
> FirstBatchWaitTime: 0.000ns E                - TotalBytesDequeued: 705.76 KB 
> (722700) E                - TotalGetBatchTime: 23.999ms E                  - 
> DataWaitTime: 23.999ms E             Enqueue: E                - 
> DeserializeRowBatchTime: 3.999ms E                - TotalBatchesEnqueued: 24 
> (24) E                - TotalBatchesReceived: 24 (24) E                - 
> TotalBytesReceived: 283.47 KB (290271) E                - TotalEarlySenders: 
> 1 (1) E                - TotalEosReceived: 3 (3) E                - 
> TotalHasDeferredRPCsTime: 53.864us E                - TotalRPCsDeferred: 1 
> (1) E         Coordinator Fragment F01: E           Instance 
> 56480a470616cf3c:7cfadfbe00000000 (host=f6d78aab23cf:22000):(Total: 
> 403.998ms, non-child: 3.999ms, % non-child: 0.99%) E             Last report 
> received time: 2019-08-28 20:01:07.300 E             Fragment Instance 
> Lifecycle Event Timeline: 415.998ms E                - Prepare Finished: 
> 15.999ms (15.999ms) E                - Open Finished: 15.999ms (0.000ns) E    
>             - First Batch Produced: 39.999ms (23.999ms) E                - 
> First Batch Sent: 87.999ms (47.999ms) E                - ExecInternal 
> Finished: 415.998ms (327.998ms) E              - MemoryUsage (500.000ms): 
> 784.00 KB E              - AverageThreadTokens: 0.00  E              - 
> BloomFilterBytes: 0 E              - ExchangeScanRatio: 0.00  E              
> - PeakMemoryUsage: 784.00 KB (802816) E              - PeakReservation: 0 E   
>            - PeakUsedReservation: 0 E              - PerHostPeakMemUsage: 
> 1.06 MB (1113656) E              - RowsProduced: 7.30K (7300) E              
> - TotalNetworkReceiveTime: 23.999ms E              - TotalNetworkSendTime: 
> 0.000ns E              - TotalStorageWaitTime: 0.000ns E              - 
> TotalThreadsInvoluntaryContextSwitches: 78 (78) E              - 
> TotalThreadsTotalWallClockTime: 399.998ms E                - 
> TotalThreadsSysTime: 0.000ns E                - TotalThreadsUserTime: 
> 140.000ms E              - TotalThreadsVoluntaryContextSwitches: 10 (10) E    
>          Buffer pool: E                - AllocTime: 0.000ns E                
> - CumulativeAllocationBytes: 0 E                - CumulativeAllocations: 0 
> (0) E                - PeakReservation: 0 E                - 
> PeakUnpinnedBytes: 0 E                - PeakUsedReservation: 0 E              
>   - ReadIoBytes: 0 E                - ReadIoOps: 0 (0) E                - 
> ReadIoWaitTime: 0.000ns E                - ReservationLimit: 0 E              
>   - SystemAllocTime: 0.000ns E                - WriteIoBytes: 0 E             
>    - WriteIoOps: 0 (0) E                - WriteIoWaitTime: 0.000ns E          
>    Fragment Instance Lifecycle Timings: E                - ExecTime: 
> 399.998ms E                  - ExecTreeExecTime: 27.999ms E                - 
> OpenTime: 0.000ns E                  - ExecTreeOpenTime: 0.000ns E            
>     - PrepareTime: 3.999ms E                  - ExecTreePrepareTime: 0.000ns 
> E             PLAN_ROOT_SINK:(Total: 371.998ms, non-child: 323.998ms, % 
> non-child: 87.10%) E                - PeakMemoryUsage: 0 E             
> EXCHANGE_NODE (id=1):(Total: 27.999ms, non-child: 3.999ms, % non-child: 
> 14.29%) E               Node Lifecycle Event Timeline: 415.998ms E            
>       - Open Started: 15.999ms (15.999ms) E                  - Open Finished: 
> 15.999ms (0.000ns) E                  - First Batch Requested: 15.999ms 
> (0.000ns) E                  - First Batch Returned: 39.999ms (23.999ms) E    
>               - Last Batch Returned: 407.998ms (367.998ms) E                  
> - Closed: 415.998ms (7.999ms) E                - ConvertRowBatchTime: 3.999ms 
> E                - PeakMemoryUsage: 776.00 KB (794624) E                - 
> RowsReturned: 7.30K (7300) E                - RowsReturnedRate: 260.71 K/sec 
> E               Buffer pool: E                  - AllocTime: 0.000ns E        
>           - CumulativeAllocationBytes: 960.00 KB (983040) E                  
> - CumulativeAllocations: 48 (48) E                  - PeakReservation: 776.00 
> KB (794624) E                  - PeakUnpinnedBytes: 0 E                  - 
> PeakUsedReservation: 776.00 KB (794624) E                  - ReadIoBytes: 0 E 
>                  - ReadIoOps: 0 (0) E                  - ReadIoWaitTime: 
> 0.000ns E                  - SystemAllocTime: 0.000ns E                  - 
> WriteIoBytes: 0 E                  - WriteIoOps: 0 (0) E                  - 
> WriteIoWaitTime: 0.000ns E               Dequeue: E                  - 
> BytesDequeued (500.000ms): 502.73 KB E                  - FirstBatchWaitTime: 
> 0.000ns E                  - TotalBytesDequeued: 705.76 KB (722700) E         
>          - TotalGetBatchTime: 23.999ms E                    - DataWaitTime: 
> 23.999ms E               Enqueue: E                  - BytesReceived 
> (500.000ms): 283.47 KB E                  - DeferredQueueSize (500.000ms): 0 
> E                  - DispatchTime: (Avg: 178.622us ; Min: 53.536us ; Max: 
> 1.203ms ; Number of samples: 23) E                  - 
> DeserializeRowBatchTime: 3.999ms E                  - TotalBatchesEnqueued: 
> 24 (24) E                  - TotalBatchesReceived: 24 (24) E                  
> - TotalBytesReceived: 283.47 KB (290271) E                  - 
> TotalEarlySenders: 1 (1) E                  - TotalEosReceived: 3 (3) E       
>            - TotalHasDeferredRPCsTime: 53.864us E                  - 
> TotalRPCsDeferred: 1 (1) E         Averaged Fragment F00:(Total: 118.666ms, 
> non-child: 0.000ns, % non-child: 0.00%) E           split sizes:  min: 157.38 
> KB, max: 161.29 KB, avg: 159.48 KB, stddev: 1.61 KB E           completion 
> times: min:95.999ms  max:415.998ms  mean: 205.332ms  stddev:148.998ms E       
>     execution rates: min:384.07 KB/sec  max:1.60 MB/sec  mean:1.16 MB/sec  
> stddev:572.06 KB/sec E           num instances: 3 E            - 
> AverageThreadTokens: 0.00  E            - BloomFilterBytes: 0 E            - 
> ExchangeScanRatio: 0.59  E            - PeakMemoryUsage: 1.18 MB (1239266) E  
>           - PeakReservation: 117.33 KB (120149) E            - 
> PeakUsedReservation: 0 E            - PerHostPeakMemUsage: 1.44 MB (1506872) 
> E            - RowsProduced: 2.43K (2433) E            - 
> TotalNetworkReceiveTime: 0.000ns E            - TotalNetworkSendTime: 
> 43.999ms E            - TotalStorageWaitTime: 5.333ms E            - 
> TotalThreadsInvoluntaryContextSwitches: 41 (41) E            - 
> TotalThreadsTotalWallClockTime: 235.998ms E              - 
> TotalThreadsSysTime: 0.000ns E              - TotalThreadsUserTime: 17.333ms 
> E            - TotalThreadsVoluntaryContextSwitches: 25 (25) E           
> Buffer pool: E              - AllocTime: 0.000ns E              - 
> CumulativeAllocationBytes: 0 E              - CumulativeAllocations: 0 (0) E  
>             - PeakReservation: 0 E              - PeakUnpinnedBytes: 0 E      
>         - PeakUsedReservation: 0 E              - ReadIoBytes: 0 E            
>   - ReadIoOps: 0 (0) E              - ReadIoWaitTime: 0.000ns E              
> - ReservationLimit: 0 E              - SystemAllocTime: 0.000ns E             
>  - WriteIoBytes: 0 E              - WriteIoOps: 0 (0) E              - 
> WriteIoWaitTime: 0.000ns E           Fragment Instance Lifecycle Timings: E   
>            - ExecTime: 117.332ms E                - ExecTreeExecTime: 
> 66.666ms E              - OpenTime: 0.000ns E                - 
> ExecTreeOpenTime: 0.000ns E              - PrepareTime: 1.333ms E             
>    - ExecTreePrepareTime: 0.000ns E           KrpcDataStreamSender 
> (dst_id=1):(Total: 51.999ms, non-child: 51.999ms, % non-child: 100.00%) E     
>          - EosSent: 1 (1) E              - PeakMemoryUsage: 1.55 KB (1592) E  
>             - RowsSent: 2.43K (2433) E              - RpcFailure: 0 (0) E     
>          - RpcRetry: 0 (0) E              - SerializeBatchTime: 3.999ms E     
>          - TotalBytesSent: 94.49 KB (96757) E              - 
> UncompressedRowBatchSize: 235.25 KB (240900) E           HDFS_SCAN_NODE 
> (id=0):(Total: 66.666ms, non-child: 66.666ms, % non-child: 100.00%) E         
>      - AverageHdfsReadThreadConcurrency: 0.00  E              - 
> AverageScannerThreadConcurrency: 0.00  E              - BytesRead: 159.48 KB 
> (163311) E              - BytesReadDataNodeCache: 0 E              - 
> BytesReadLocal: 0 E              - BytesReadRemoteUnexpected: 0 E             
>  - BytesReadShortCircuit: 0 E              - CachedFileHandlesHitCount: 8 (8) 
> E              - CachedFileHandlesMissCount: 0 (0) E              - 
> CollectionItemsRead: 0 (0) E              - DataCacheHitBytes: 132.99 KB 
> (136181) E              - DataCacheHitCount: 6 (6) E              - 
> DataCacheMissBytes: 26.49 KB (27130) E              - DataCacheMissCount: 1 
> (1) E              - DataCachePartialHitCount: 0 (0) E              - 
> DecompressionTime: 0.000ns E              - DelimiterParseTime: 6.666ms E     
>          - MaterializeTupleTime(*): 67.999ms E              - 
> MaxCompressedTextFileLength: 0 E              - NumDisksAccessed: 1 (1) E     
>          - NumScannerThreadMemUnavailable: 0 (0) E              - 
> NumScannerThreadReservationsDenied: 0 (0) E              - 
> NumScannerThreadsStarted: 2 (2) E              - PeakMemoryUsage: 1.01 MB 
> (1061546) E              - PeakScannerThreadConcurrency: 2 (2) E              
> - PerReadThreadRawHdfsThroughput: 4.27 MB/sec E              - 
> RemoteScanRanges: 4 (4) E              - RowBatchBytesEnqueued: 1.95 MB 
> (2048000) E              - RowBatchQueueGetWaitTime: 58.666ms E              
> - RowBatchQueuePeakMemoryUsage: 894.67 KB (916138) E              - 
> RowBatchQueuePutWaitTime: 0.000ns E              - RowBatchesEnqueued: 16 
> (16) E              - RowsRead: 2.43K (2433) E              - RowsReturned: 
> 2.43K (2433) E              - RowsReturnedRate: 27.18 K/sec E              - 
> ScanRangesComplete: 8 (8) E              - ScannerIoWaitTime: 5.333ms E       
>        - ScannerThreadWorklessLoops: 0 (0) E              - 
> ScannerThreadsInvoluntaryContextSwitches: 39 (39) E              - 
> ScannerThreadsTotalWallClockTime: 118.666ms E                - 
> ScannerThreadsSysTime: 0.000ns E                - ScannerThreadsUserTime: 
> 13.333ms E              - ScannerThreadsVoluntaryContextSwitches: 7 (7) E     
>          - TotalRawHdfsOpenFileTime(*): 0.000ns E              - 
> TotalRawHdfsReadTime(*): 3.999ms E              - TotalReadThroughput: 0.00 
> /sec E             Buffer pool: E                - AllocTime: 0.000ns E       
>          - CumulativeAllocationBytes: 256.00 KB (262144) E                - 
> CumulativeAllocations: 8 (8) E                - PeakReservation: 117.33 KB 
> (120149) E                - PeakUnpinnedBytes: 0 E                - 
> PeakUsedReservation: 74.67 KB (76458) E                - ReadIoBytes: 0 E     
>            - ReadIoOps: 0 (0) E                - ReadIoWaitTime: 0.000ns E    
>             - SystemAllocTime: 0.000ns E                - WriteIoBytes: 0 E   
>              - WriteIoOps: 0 (0) E                - WriteIoWaitTime: 0.000ns 
> E         Fragment F00: E           Instance 
> 56480a470616cf3c:7cfadfbe00000001 (host=f6d78aab23cf:22000):(Total: 
> 167.999ms, non-child: 0.000ns, % non-child: 0.00%) E             Last report 
> received time: 2019-08-28 20:01:07.300 E             Hdfs split stats 
> (<volume id>:<# splits>/<split lengths>): -1:8/159.77 KB E             
> Fragment Instance Lifecycle Event Timeline: 219.999ms E                - 
> Prepare Finished: 31.999ms (31.999ms) E                - Open Finished: 
> 31.999ms (0.000ns) E                - First Batch Produced: 67.999ms 
> (35.999ms) E                - First Batch Sent: 67.999ms (0.000ns) E          
>       - ExecInternal Finished: 219.999ms (151.999ms) E              - 
> AverageThreadTokens: 0.00  E              - BloomFilterBytes: 0 E             
>  - ExchangeScanRatio: 0.59  E              - PeakMemoryUsage: 303.55 KB 
> (310840) E              - PeakReservation: 64.00 KB (65536) E              - 
> PeakUsedReservation: 0 E              - PerHostPeakMemUsage: 1.06 MB 
> (1113656) E              - RowsProduced: 2.44K (2440) E              - 
> TotalNetworkReceiveTime: 0.000ns E              - TotalNetworkSendTime: 
> 3.999ms E              - TotalStorageWaitTime: 0.000ns E              - 
> TotalThreadsInvoluntaryContextSwitches: 62 (62) E              - 
> TotalThreadsTotalWallClockTime: 331.998ms E                - 
> TotalThreadsSysTime: 0.000ns E                - TotalThreadsUserTime: 
> 20.000ms E              - TotalThreadsVoluntaryContextSwitches: 27 (27) E     
>         Buffer pool: E                - AllocTime: 0.000ns E                - 
> CumulativeAllocationBytes: 0 E                - CumulativeAllocations: 0 (0) 
> E                - PeakReservation: 0 E                - PeakUnpinnedBytes: 0 
> E                - PeakUsedReservation: 0 E                - ReadIoBytes: 0 E 
>                - ReadIoOps: 0 (0) E                - ReadIoWaitTime: 0.000ns 
> E                - ReservationLimit: 0 E                - SystemAllocTime: 
> 0.000ns E                - WriteIoBytes: 0 E                - WriteIoOps: 0 
> (0) E                - WriteIoWaitTime: 0.000ns E             Fragment 
> Instance Lifecycle Timings: E                - ExecTime: 167.999ms E          
>         - ExecTreeExecTime: 163.999ms E                - OpenTime: 0.000ns E  
>                 - ExecTreeOpenTime: 0.000ns E                - PrepareTime: 
> 0.000ns E                  - ExecTreePrepareTime: 0.000ns E             
> KrpcDataStreamSender (dst_id=1):(Total: 3.999ms, non-child: 0.000ns, % 
> non-child: 0.00%) E               ExecOption: Codegen Disabled: disabled due 
> to optimization hints E                - NetworkThroughput: (Avg: 32.50 
> MB/sec ; Min: 1.83 MB/sec ; Max: 47.13 MB/sec ; Number of samples: 8) E       
>          - EosSent: 1 (1) E                - PeakMemoryUsage: 1.55 KB (1592) 
> E                - RowsSent: 2.44K (2440) E                - RpcFailure: 0 
> (0) E                - RpcRetry: 0 (0) E                - SerializeBatchTime: 
> 0.000ns E                - TotalBytesSent: 94.89 KB (97166) E                
> - UncompressedRowBatchSize: 235.90 KB (241560) E             HDFS_SCAN_NODE 
> (id=0):(Total: 163.999ms, non-child: 163.999ms, % non-child: 100.00%) E       
>         Hdfs split stats (<volume id>:<# splits>/<split lengths>): 
> -1:8/159.77 KB E               ExecOption: Codegen Disabled: disabled due to 
> optimization hints, Codegen enabled: 0 out of 8 E               Hdfs Read 
> Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% E               
> File Formats: TEXT/NONE:8 E               Node Lifecycle Event Timeline: 
> 219.999ms E                  - Open Started: 31.999ms (31.999ms) E            
>       - Open Finished: 31.999ms (0.000ns) E                  - First Batch 
> Requested: 31.999ms (0.000ns) E                  - First Batch Returned: 
> 67.999ms (35.999ms) E                  - Last Batch Returned: 195.999ms 
> (127.999ms) E                  - Closed: 219.999ms (23.999ms) E               
>  - InitialRangeActualReservation: (Avg: 32.00 KB (32768) ; Min: 32.00 KB 
> (32768) ; Max: 32.00 KB (32768) ; Number of samples: 8) E                - 
> InitialRangeIdealReservation: (Avg: 32.00 KB (32768) ; Min: 32.00 KB (32768) 
> ; Max: 32.00 KB (32768) ; Number of samples: 8) E                - 
> ParquetCompressedBytesReadPerColumn: 0 (Number of samples: 0) E               
>  - ParquetUncompressedBytesReadPerColumn: 0 (Number of samples: 0) E          
>       - AverageHdfsReadThreadConcurrency: 0.00  E                - 
> AverageScannerThreadConcurrency: 0.00  E                - BytesRead: 159.77 
> KB (163608) E                - BytesReadDataNodeCache: 0 E                - 
> BytesReadLocal: 0 E                - BytesReadRemoteUnexpected: 0 E           
>      - BytesReadShortCircuit: 0 E                - CachedFileHandlesHitCount: 
> 8 (8) E                - CachedFileHandlesMissCount: 0 (0) E                - 
> CollectionItemsRead: 0 (0) E                - DataCacheHitBytes: 159.77 KB 
> (163608) E                - DataCacheHitCount: 8 (8) E                - 
> DataCacheMissBytes: 0 E                - DataCacheMissCount: 0 (0) E          
>       - DataCachePartialHitCount: 0 (0) E                - DecompressionTime: 
> 0.000ns E                - DelimiterParseTime: 3.999ms E                - 
> MaterializeTupleTime(*): 143.999ms E                - 
> MaxCompressedTextFileLength: 0 E                - NumDisksAccessed: 1 (1) E   
>              - NumScannerThreadMemUnavailable: 0 (0) E                - 
> NumScannerThreadReservationsDenied: 0 (0) E                - 
> NumScannerThreadsStarted: 1 (1) E                - PeakMemoryUsage: 294.00 KB 
> (301056) E                - PeakScannerThreadConcurrency: 1 (1) E             
>    - PerReadThreadRawHdfsThroughput: 0.00 /sec E                - 
> RemoteScanRanges: 0 (0) E                - RowBatchBytesEnqueued: 1.95 MB 
> (2048000) E                - RowBatchQueueGetWaitTime: 163.999ms E            
>     - RowBatchQueuePeakMemoryUsage: 254.00 KB (260096) E                - 
> RowBatchQueuePutWaitTime: 0.000ns E                - RowBatchesEnqueued: 16 
> (16) E                - RowsRead: 2.44K (2440) E                - 
> RowsReturned: 2.44K (2440) E                - RowsReturnedRate: 14.88 K/sec E 
>                - ScanRangesComplete: 8 (8) E                - 
> ScannerIoWaitTime: 0.000ns E                - ScannerThreadWorklessLoops: 0 
> (0) E                - ScannerThreadsInvoluntaryContextSwitches: 60 (60) E    
>             - ScannerThreadsTotalWallClockTime: 163.999ms E                  
> - ScannerThreadsSysTime: 0.000ns E                  - ScannerThreadsUserTime: 
> 16.000ms E                - ScannerThreadsVoluntaryContextSwitches: 5 (5) E   
>              - TotalRawHdfsOpenFileTime(*): 0.000ns E                - 
> TotalRawHdfsReadTime(*): 0.000ns E                - TotalReadThroughput: 0.00 
> /sec E               Buffer pool: E                  - AllocTime: 0.000ns E   
>                - CumulativeAllocationBytes: 256.00 KB (262144) E              
>     - CumulativeAllocations: 8 (8) E                  - PeakReservation: 
> 64.00 KB (65536) E                  - PeakUnpinnedBytes: 0 E                  
> - PeakUsedReservation: 32.00 KB (32768) E                  - ReadIoBytes: 0 E 
>                  - ReadIoOps: 0 (0) E                  - ReadIoWaitTime: 
> 0.000ns E                  - SystemAllocTime: 0.000ns E                  - 
> WriteIoBytes: 0 E                  - WriteIoOps: 0 (0) E                  - 
> WriteIoWaitTime: 0.000ns E           Instance 
> 56480a470616cf3c:7cfadfbe00000003 (host=6db176633e3a:22000):(Total: 99.999ms, 
> non-child: 0.000ns, % non-child: 0.00%) E             Last report received 
> time: 2019-08-28 20:01:06.986 E             Hdfs split stats (<volume id>:<# 
> splits>/<split lengths>): -1:8/161.29 KB E             Fragment Instance 
> Lifecycle Event Timeline: 99.999ms E                - Prepare Finished: 
> 3.999ms (3.999ms) E                - Open Finished: 3.999ms (0.000ns) E       
>          - First Batch Produced: 3.999ms (0.000ns) E                - First 
> Batch Sent: 11.999ms (7.999ms) E                - ExecInternal Finished: 
> 99.999ms (87.999ms) E              - AverageThreadTokens: 0.00  E             
>  - BloomFilterBytes: 0 E              - ExchangeScanRatio: 0.59  E            
>   - PeakMemoryUsage: 1.63 MB (1709624) E              - PeakReservation: 
> 128.00 KB (131072) E              - PeakUsedReservation: 0 E              - 
> PerHostPeakMemUsage: 1.63 MB (1709624) E              - RowsProduced: 2.46K 
> (2460) E              - TotalNetworkReceiveTime: 0.000ns E              - 
> TotalNetworkSendTime: 79.999ms E              - TotalStorageWaitTime: 0.000ns 
> E              - TotalThreadsInvoluntaryContextSwitches: 36 (36) E            
>   - TotalThreadsTotalWallClockTime: 163.999ms E                - 
> TotalThreadsSysTime: 0.000ns E                - TotalThreadsUserTime: 
> 16.000ms E              - TotalThreadsVoluntaryContextSwitches: 25 (25) E     
>         Buffer pool: E                - AllocTime: 0.000ns E                - 
> CumulativeAllocationBytes: 0 E                - CumulativeAllocations: 0 (0) 
> E                - PeakReservation: 0 E                - PeakUnpinnedBytes: 0 
> E                - PeakUsedReservation: 0 E                - ReadIoBytes: 0 E 
>                - ReadIoOps: 0 (0) E                - ReadIoWaitTime: 0.000ns 
> E                - ReservationLimit: 0 E                - SystemAllocTime: 
> 0.000ns E                - WriteIoBytes: 0 E                - WriteIoOps: 0 
> (0) E                - WriteIoWaitTime: 0.000ns E             Fragment 
> Instance Lifecycle Timings: E                - ExecTime: 95.999ms E           
>        - ExecTreeExecTime: 0.000ns E                - OpenTime: 0.000ns E     
>              - ExecTreeOpenTime: 0.000ns E                - PrepareTime: 
> 3.999ms E                  - ExecTreePrepareTime: 0.000ns E             
> KrpcDataStreamSender (dst_id=1):(Total: 99.999ms, non-child: 19.999ms, % 
> non-child: 20.00%) E               ExecOption: Codegen Disabled: disabled due 
> to optimization hints E                - NetworkThroughput: (Avg: 2.08 MB/sec 
> ; Min: 892.97 KB/sec ; Max: 5.42 MB/sec ; Number of samples: 8) E             
>    - EosSent: 1 (1) E                - PeakMemoryUsage: 1.55 KB (1592) E      
>           - RowsSent: 2.46K (2460) E                - RpcFailure: 0 (0) E     
>            - RpcRetry: 0 (0) E                - SerializeBatchTime: 7.999ms E 
>                - TotalBytesSent: 95.36 KB (97644) E                - 
> UncompressedRowBatchSize: 237.83 KB (243540) E             HDFS_SCAN_NODE 
> (id=0): E               Hdfs split stats (<volume id>:<# splits>/<split 
> lengths>): -1:8/161.29 KB E               ExecOption: Codegen Disabled: 
> disabled due to optimization hints, Codegen enabled: 0 out of 8 E             
>   Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% E   
>             File Formats: TEXT/NONE:8 E               Node Lifecycle Event 
> Timeline: 99.999ms E                  - Open Started: 3.999ms (3.999ms) E     
>              - Open Finished: 3.999ms (0.000ns) E                  - First 
> Batch Requested: 3.999ms (0.000ns) E                  - First Batch Returned: 
> 3.999ms (0.000ns) E                  - Last Batch Returned: 87.999ms 
> (83.999ms) E                  - Closed: 99.999ms (11.999ms) E                
> - InitialRangeActualReservation: (Avg: 32.00 KB (32768) ; Min: 32.00 KB 
> (32768) ; Max: 32.00 KB (32768) ; Number of samples: 8) E                - 
> InitialRangeIdealReservation: (Avg: 32.00 KB (32768) ; Min: 32.00 KB (32768) 
> ; Max: 32.00 KB (32768) ; Number of samples: 8) E                - 
> ParquetCompressedBytesReadPerColumn: 0 (Number of samples: 0) E               
>  - ParquetUncompressedBytesReadPerColumn: 0 (Number of samples: 0) E          
>       - AverageHdfsReadThreadConcurrency: 0.00  E                - 
> AverageScannerThreadConcurrency: 0.00  E                - BytesRead: 161.29 
> KB (165166) E                - BytesReadDataNodeCache: 0 E                - 
> BytesReadLocal: 0 E                - BytesReadRemoteUnexpected: 0 E           
>      - BytesReadShortCircuit: 0 E                - CachedFileHandlesHitCount: 
> 8 (8) E                - CachedFileHandlesMissCount: 0 (0) E                - 
> CollectionItemsRead: 0 (0) E                - DataCacheHitBytes: 141.59 KB 
> (144987) E                - DataCacheHitCount: 7 (7) E                - 
> DataCacheMissBytes: 19.71 KB (20179) E                - DataCacheMissCount: 1 
> (1) E                - DataCachePartialHitCount: 0 (0) E                - 
> DecompressionTime: 0.000ns E                - DelimiterParseTime: 0.000ns E   
>              - MaterializeTupleTime(*): 19.999ms E                - 
> MaxCompressedTextFileLength: 0 E                - NumDisksAccessed: 1 (1) E   
>              - NumScannerThreadMemUnavailable: 0 (0) E                - 
> NumScannerThreadReservationsDenied: 0 (0) E                - 
> NumScannerThreadsStarted: 3 (3) E                - PeakMemoryUsage: 1.38 MB 
> (1447936) E                - PeakScannerThreadConcurrency: 3 (3) E            
>     - PerReadThreadRawHdfsThroughput: 0.00 /sec E                - 
> RemoteScanRanges: 3 (3) E                - RowBatchBytesEnqueued: 1.95 MB 
> (2048000) E                - RowBatchQueueGetWaitTime: 0.000ns E              
>   - RowBatchQueuePeakMemoryUsage: 1.32 MB (1386496) E                - 
> RowBatchQueuePutWaitTime: 0.000ns E                - RowBatchesEnqueued: 16 
> (16) E                - RowsRead: 2.46K (2460) E                - 
> RowsReturned: 2.46K (2460) E                - RowsReturnedRate: 0 E           
>      - ScanRangesComplete: 8 (8) E                - ScannerIoWaitTime: 
> 0.000ns E                - ScannerThreadWorklessLoops: 0 (0) E                
> - ScannerThreadsInvoluntaryContextSwitches: 32 (32) E                - 
> ScannerThreadsTotalWallClockTime: 67.999ms E                  - 
> ScannerThreadsSysTime: 0.000ns E                  - ScannerThreadsUserTime: 
> 12.000ms E                - ScannerThreadsVoluntaryContextSwitches: 7 (7) E   
>              - TotalRawHdfsOpenFileTime(*): 0.000ns E                - 
> TotalRawHdfsReadTime(*): 0.000ns E                - TotalReadThroughput: 0.00 
> /sec E               Buffer pool: E                  - AllocTime: 0.000ns E   
>                - CumulativeAllocationBytes: 256.00 KB (262144) E              
>     - CumulativeAllocations: 8 (8) E                  - PeakReservation: 
> 128.00 KB (131072) E                  - PeakUnpinnedBytes: 0 E                
>   - PeakUsedReservation: 64.00 KB (65536) E                  - ReadIoBytes: 0 
> E                  - ReadIoOps: 0 (0) E                  - ReadIoWaitTime: 
> 0.000ns E                  - SystemAllocTime: 0.000ns E                  - 
> WriteIoBytes: 0 E                  - WriteIoOps: 0 (0) E                  - 
> WriteIoWaitTime: 0.000ns E           Instance 
> 56480a470616cf3c:7cfadfbe00000002 (host=bf5c6b4d70c3:22000):(Total: 87.999ms, 
> non-child: 0.000ns, % non-child: 0.00%) E             Last report received 
> time: 2019-08-28 20:01:06.987 E             Hdfs split stats (<volume id>:<# 
> splits>/<split lengths>): -1:8/157.38 KB E             Fragment Instance 
> Lifecycle Event Timeline: 95.999ms E                - Prepare Finished: 
> 7.999ms (7.999ms) E                - Open Finished: 7.999ms (0.000ns) E       
>          - First Batch Produced: 43.999ms (35.999ms) E                - First 
> Batch Sent: 43.999ms (0.000ns) E                - ExecInternal Finished: 
> 95.999ms (51.999ms) E              - AverageThreadTokens: 0.00  E             
>  - BloomFilterBytes: 0 E              - ExchangeScanRatio: 0.59  E            
>   - PeakMemoryUsage: 1.62 MB (1697336) E              - PeakReservation: 
> 160.00 KB (163840) E              - PeakUsedReservation: 0 E              - 
> PerHostPeakMemUsage: 1.62 MB (1697336) E              - RowsProduced: 2.40K 
> (2400) E              - TotalNetworkReceiveTime: 0.000ns E              - 
> TotalNetworkSendTime: 47.999ms E              - TotalStorageWaitTime: 
> 15.999ms E              - TotalThreadsInvoluntaryContextSwitches: 27 (27) E   
>            - TotalThreadsTotalWallClockTime: 211.999ms E                - 
> TotalThreadsSysTime: 0.000ns E                - TotalThreadsUserTime: 
> 16.000ms E              - TotalThreadsVoluntaryContextSwitches: 24 (24) E     
>         Buffer pool: E                - AllocTime: 0.000ns E                - 
> CumulativeAllocationBytes: 0 E                - CumulativeAllocations: 0 (0) 
> E                - PeakReservation: 0 E                - PeakUnpinnedBytes: 0 
> E                - PeakUsedReservation: 0 E                - ReadIoBytes: 0 E 
>                - ReadIoOps: 0 (0) E                - ReadIoWaitTime: 0.000ns 
> E                - ReservationLimit: 0 E                - SystemAllocTime: 
> 0.000ns E                - WriteIoBytes: 0 E                - WriteIoOps: 0 
> (0) E                - WriteIoWaitTime: 0.000ns E             Fragment 
> Instance Lifecycle Timings: E                - ExecTime: 87.999ms E           
>        - ExecTreeExecTime: 35.999ms E                - OpenTime: 0.000ns E    
>               - ExecTreeOpenTime: 0.000ns E                - PrepareTime: 
> 0.000ns E                  - ExecTreePrepareTime: 0.000ns E             
> KrpcDataStreamSender (dst_id=1):(Total: 51.999ms, non-child: 3.999ms, % 
> non-child: 7.69%) E               ExecOption: Codegen Disabled: disabled due 
> to optimization hints E                - NetworkThroughput: (Avg: 2.35 MB/sec 
> ; Min: 1.05 MB/sec ; Max: 3.73 MB/sec ; Number of samples: 8) E               
>  - EosSent: 1 (1) E                - PeakMemoryUsage: 1.55 KB (1592) E        
>         - RowsSent: 2.40K (2400) E                - RpcFailure: 0 (0) E       
>          - RpcRetry: 0 (0) E                - SerializeBatchTime: 3.999ms E   
>              - TotalBytesSent: 93.22 KB (95461) E                - 
> UncompressedRowBatchSize: 232.03 KB (237600) E             HDFS_SCAN_NODE 
> (id=0):(Total: 35.999ms, non-child: 35.999ms, % non-child: 100.00%) E         
>       Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:8/157.38 
> KB E               ExecOption: Codegen Disabled: disabled due to optimization 
> hints, Codegen enabled: 0 out of 8 E               Hdfs Read Thread 
> Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% E               File 
> Formats: TEXT/NONE:8 E               Node Lifecycle Event Timeline: 95.999ms 
> E                  - Open Started: 7.999ms (7.999ms) E                  - 
> Open Finished: 7.999ms (0.000ns) E                  - First Batch Requested: 
> 7.999ms (0.000ns) E                  - First Batch Returned: 43.999ms 
> (35.999ms) E                  - Last Batch Returned: 91.999ms (47.999ms) E    
>               - Closed: 95.999ms (3.999ms) E                - 
> InitialRangeActualReservation: (Avg: 32.00 KB (32768) ; Min: 32.00 KB (32768) 
> ; Max: 32.00 KB (32768) ; Number of samples: 8) E                - 
> InitialRangeIdealReservation: (Avg: 32.00 KB (32768) ; Min: 32.00 KB (32768) 
> ; Max: 32.00 KB (32768) ; Number of samples: 8) E                - 
> ParquetCompressedBytesReadPerColumn: 0 (Number of samples: 0) E               
>  - ParquetUncompressedBytesReadPerColumn: 0 (Number of samples: 0) E          
>       - AverageHdfsReadThreadConcurrency: 0.00  E                - 
> AverageScannerThreadConcurrency: 0.00  E                - BytesRead: 157.38 
> KB (161160) E                - BytesReadDataNodeCache: 0 E                - 
> BytesReadLocal: 0 E                - BytesReadRemoteUnexpected: 0 E           
>      - BytesReadShortCircuit: 0 E                - CachedFileHandlesHitCount: 
> 8 (8) E                - CachedFileHandlesMissCount: 0 (0) E                - 
> CollectionItemsRead: 0 (0) E                - DataCacheHitBytes: 97.61 KB 
> (99949) E                - DataCacheHitCount: 5 (5) E                - 
> DataCacheMissBytes: 59.78 KB (61211) E                - DataCacheMissCount: 3 
> (3) E                - DataCachePartialHitCount: 0 (0) E                - 
> DecompressionTime: 0.000ns E                - DelimiterParseTime: 15.999ms E  
>               - MaterializeTupleTime(*): 39.999ms E                - 
> MaxCompressedTextFileLength: 0 E                - NumDisksAccessed: 1 (1) E   
>              - NumScannerThreadMemUnavailable: 0 (0) E                - 
> NumScannerThreadReservationsDenied: 0 (0) E                - 
> NumScannerThreadsStarted: 4 (4) E                - PeakMemoryUsage: 1.37 MB 
> (1435648) E                - PeakScannerThreadConcurrency: 4 (4) E            
>     - PerReadThreadRawHdfsThroughput: 12.81 MB/sec E                - 
> RemoteScanRanges: 9 (9) E                - RowBatchBytesEnqueued: 1.95 MB 
> (2048000) E                - RowBatchQueueGetWaitTime: 11.999ms E             
>    - RowBatchQueuePeakMemoryUsage: 1.05 MB (1101824) E                - 
> RowBatchQueuePutWaitTime: 0.000ns E                - RowBatchesEnqueued: 16 
> (16) E                - RowsRead: 2.40K (2400) E                - 
> RowsReturned: 2.40K (2400) E                - RowsReturnedRate: 66.67 K/sec E 
>                - ScanRangesComplete: 8 (8) E                - 
> ScannerIoWaitTime: 15.999ms E                - ScannerThreadWorklessLoops: 0 
> (0) E                - ScannerThreadsInvoluntaryContextSwitches: 26 (26) E    
>             - ScannerThreadsTotalWallClockTime: 123.999ms E                  
> - ScannerThreadsSysTime: 0.000ns E                  - ScannerThreadsUserTime: 
> 12.000ms E                - ScannerThreadsVoluntaryContextSwitches: 9 (9) E   
>              - TotalRawHdfsOpenFileTime(*): 0.000ns E                - 
> TotalRawHdfsReadTime(*): 11.999ms E                - TotalReadThroughput: 
> 0.00 /sec E               Buffer pool: E                  - AllocTime: 
> 0.000ns E                  - CumulativeAllocationBytes: 256.00 KB (262144) E  
>                 - CumulativeAllocations: 8 (8) E                  - 
> PeakReservation: 160.00 KB (163840) E                  - PeakUnpinnedBytes: 0 
> E                  - PeakUsedReservation: 128.00 KB (131072) E                
>   - ReadIoBytes: 0 E                  - ReadIoOps: 0 (0) E                  - 
> ReadIoWaitTime: 0.000ns E                  - SystemAllocTime: 0.000ns E       
>            - WriteIoBytes: 0 E                  - WriteIoOps: 0 (0) E         
>          - WriteIoWaitTime: 0.000ns E      E   assert 10 == 
> 0Stacktracequery_test/test_observability.py:340: in 
> test_query_profile_contains_query_compilation_metadata_load_events
>     self.__verify_profile_event_sequence(load_event_regexes, runtime_profile)
> query_test/test_observability.py:432: in __verify_profile_event_sequence
>     assert event_regex_index == 0, \
> E   AssertionError: CatalogFetch.PartitionLists.Misses not in        - 
> CatalogFetch.PartitionLists.Hits: 1
> E     Query (id=56480a470616cf3c:7cfadfbe00000000):
> E       DEBUG MODE WARNING: Query profile created while running a DEBUG build 
> of Impala. Use RELEASE builds to measure query performance.
> E       Summary:
> E         Session ID: 854d1d6ab3cb65b7:9ba11e621c088385
> E         Session Type: BEESWAX
> E         Start Time: 2019-08-28 20:01:05.725329000
> E         End Time: 2019-08-28 20:01:07.305869000
> E         Query Type: QUERY
> E         Query State: FINISHED
> E         Query Status: OK
> E         Impala Version: impalad version 3.4.0-SNAPSHOT DEBUG (build 
> 207b1443ff1b116d2d031dc5325ce971af80c4a6)
> E         User: ubuntu
> E         Connected User: ubuntu
> E         Delegated User: 
> E         Network Address: 172.18.0.1:44044
> E         Default Db: default
> E         Sql Statement: select * from functional.alltypes
> E         Coordinator: f6d78aab23cf:22000
> E         Query Options (set by configuration): 
> DEBUG_ACTION=CRS_BEFORE_ADMISSION:SLEEP@1000,TIMEZONE=Zulu,CLIENT_IDENTIFIER=query_test/test_observability.py::TestObservability::()::test_exec_summary_in_runtime_profile
> E         Query Options (set by configuration and planner): 
> DEBUG_ACTION=CRS_BEFORE_ADMISSION:SLEEP@1000,MT_DOP=0,TIMEZONE=Zulu,CLIENT_IDENTIFIER=query_test/test_observability.py::TestObservability::()::test_exec_summary_in_runtime_profile
> E         Plan: 
> E     ----------------
> E     Max Per-Host Resource Reservation: Memory=32.00KB Threads=3
> E     Per-Host Resource Estimates: Memory=160MB
> E     Codegen disabled by planner
> E     Analyzed query: SELECT * FROM functional.alltypes
> E     
> E     F01:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
> E     |  Per-Host Resources: mem-estimate=490.49KB mem-reservation=0B 
> thread-reservation=1
> E     PLAN-ROOT SINK
> E     |  mem-estimate=0B mem-reservation=0B thread-reservation=0
> E     |
> E     01:EXCHANGE [UNPARTITIONED]
> E     |  mem-estimate=490.49KB mem-reservation=0B thread-reservation=0
> E     |  tuple-ids=0 row-size=89B cardinality=7.30K
> E     |  in pipelines: 00(GETNEXT)
> E     |
> E     F00:PLAN FRAGMENT [RANDOM] hosts=3 instances=3
> E     Per-Host Resources: mem-estimate=160.00MB mem-reservation=32.00KB 
> thread-reservation=2
> E     00:SCAN HDFS [functional.alltypes, RANDOM]
> E        HDFS partitions=24/24 files=24 size=478.45KB
> E        stored statistics:
> E          table: rows=7.30K size=478.45KB
> E          partitions: 24/24 rows=7.30K
> E          columns: all
> E        extrapolated-rows=disabled max-scan-range-rows=310
> E        mem-estimate=160.00MB mem-reservation=32.00KB thread-reservation=1
> E        tuple-ids=0 row-size=89B cardinality=7.30K
> E        in pipelines: 00(GETNEXT)
> E     ----------------
> E         Estimated Per-Host Mem: 168274422
> E         Request Pool: default-pool
> E         Per Host Min Memory Reservation: 6db176633e3a:22000(32.00 KB) 
> bf5c6b4d70c3:22000(32.00 KB) f6d78aab23cf:22000(32.00 KB)
> E         Per Host Number of Fragment Instances: 6db176633e3a:22000(1) 
> bf5c6b4d70c3:22000(1) f6d78aab23cf:22000(2)
> E         Admission result: Admitted immediately
> E         Cluster Memory Admitted: 481.44 MB
> E         Executor Group: default
> E         ExecSummary: 
> E     Operator              #Hosts   Avg Time   Max Time  #Rows  Est. #Rows   
> Peak Mem  Est. Peak Mem  Detail              
> E     
> ---------------------------------------------------------------------------------------------------------------------
> E     F01:ROOT                   1  323.998ms  323.998ms                      
>        0              0                      
> E     01:EXCHANGE                1    3.999ms    3.999ms  7.30K       7.30K  
> 776.00 KB      490.49 KB  UNPARTITIONED       
> E     F00:EXCHANGE SENDER        3    7.999ms   19.999ms                      
>  1.55 KB              0                      
> E     00:SCAN HDFS               3   66.666ms  163.999ms  7.30K       7.30K   
>  1.38 MB      160.00 MB  functional.alltypes
> E         Errors: 
> E         Query Compilation: 139.437ms
> E            - Metadata of all 1 tables cached: 116.233ms (116.233ms)
> E            - Analysis finished: 116.458ms (225.333us)
> E            - Authorization finished (noop): 116.480ms (21.466us)
> E            - Value transfer graph computed: 116.628ms (148.642us)
> E            - Single node plan created: 133.186ms (16.557ms)
> E            - Runtime filters computed: 133.229ms (43.430us)
> E            - Distributed plan created: 133.256ms (27.095us)
> E            - Planning finished: 139.437ms (6.180ms)
> E         Query Timeline: 1s587ms
> E            - Query submitted: 0.000ns (0.000ns)
> E            - Planning finished: 143.999ms (143.999ms)
> E            - Submit for admission: 1s147ms (1s003ms)
> E            - Completed admission: 1s147ms (0.000ns)
> E            - Ready to start on 3 backends: 1s147ms (0.000ns)
> E            - All 3 execution backends (4 fragment instances) started: 
> 1s167ms (19.999ms)
> E            - Rows available: 1s195ms (27.999ms)
> E            - First row fetched: 1s211ms (15.999ms)
> E            - Last row fetched: 1s575ms (363.998ms)
> E            - Released admission control resources: 1s583ms (7.999ms)
> E          - AdmissionControlTimeSinceLastUpdate: 77.000ms
> E          - ComputeScanRangeAssignmentTimer: 0.000ns
> E         Frontend:
> E            - CatalogFetch.ColumnStats.Misses: 13
> E            - CatalogFetch.ColumnStats.Requests: 13
> E            - CatalogFetch.ColumnStats.Time: 9ms
> E            - CatalogFetch.Config.Hits: 1
> E            - CatalogFetch.Config.Requests: 1
> E            - CatalogFetch.Config.Time: 0
> E            - CatalogFetch.DatabaseList.Hits: 1
> E            - CatalogFetch.DatabaseList.Requests: 1
> E            - CatalogFetch.DatabaseList.Time: 0
> E            - CatalogFetch.PartitionLists.Hits: 1
> E            - CatalogFetch.PartitionLists.Requests: 1
> E            - CatalogFetch.PartitionLists.Time: 0
> E            - CatalogFetch.Partitions.Hits: 48
> E            - CatalogFetch.Partitions.Misses: 20
> E            - CatalogFetch.Partitions.Requests: 68
> E            - CatalogFetch.Partitions.Time: 8ms
> E            - CatalogFetch.RPCs.Bytes: 27.93 KB (28604)
> E            - CatalogFetch.RPCs.Requests: 3
> E            - CatalogFetch.RPCs.Time: 116ms
> E            - CatalogFetch.TableNames.Hits: 2
> E            - CatalogFetch.TableNames.Requests: 2
> E            - CatalogFetch.TableNames.Time: 0
> E            - CatalogFetch.Tables.Misses: 1
> E            - CatalogFetch.Tables.Requests: 1
> E            - CatalogFetch.Tables.Time: 105ms
> E       ImpalaServer:
> E          - ClientFetchWaitTimer: 51.999ms
> E          - RowMaterializationTimer: 335.998ms
> E       Execution Profile 56480a470616cf3c:7cfadfbe00000000:(Total: 
> 383.998ms, non-child: 0.000ns, % non-child: 0.00%)
> E         Number of filters: 0
> E         Filter routing table: 
> E      ID  Src. Node  Tgt. Node(s)  Target type  Partition filter  Pending 
> (Expected)  First arrived  Completed   Enabled
> E     
> -------------------------------------------------------------------------------------------------------------------
> E         Backend startup latencies: Count: 3, min / max: 9ms / 17ms, 25th 
> %-ile: 9ms, 50th %-ile: 10ms, 75th %-ile: 10ms, 90th %-ile: 17ms, 95th %-ile: 
> 17ms, 99.9th %-ile: 17ms
> E         Slowest backend to start up: bf5c6b4d70c3:22000
> E         Per Node Peak Memory Usage: 6db176633e3a:22000(1.63 MB) 
> bf5c6b4d70c3:22000(1.62 MB) f6d78aab23cf:22000(1.06 MB)
> E         Per Node Bytes Read: 6db176633e3a:22000(161.29 KB) 
> bf5c6b4d70c3:22000(157.38 KB) f6d78aab23cf:22000(159.77 KB)
> E         Per Node User Time: 6db176633e3a:22000(16.000ms) 
> bf5c6b4d70c3:22000(16.000ms) f6d78aab23cf:22000(160.000ms)
> E         Per Node System Time: 6db176633e3a:22000(0.000ns) 
> bf5c6b4d70c3:22000(0.000ns) f6d78aab23cf:22000(0.000ns)
> E          - ExchangeScanRatio: 0.59 
> E          - FiltersReceived: 0 (0)
> E          - FinalizationTimer: 0.000ns
> E          - InnerNodeSelectivityRatio: 0.00 
> E          - NumBackends: 3 (3)
> E          - NumFragmentInstances: 4 (4)
> E          - NumFragments: 2 (2)
> E          - TotalBytesRead: 478.45 KB (489934)
> E          - TotalBytesSent: 283.47 KB (290271)
> E          - TotalCpuTime: 192.000ms
> E          - TotalInnerBytesSent: 0
> E          - TotalScanBytesSent: 283.47 KB (290271)
> E         Per Node Profiles:
> E           6db176633e3a:22000:
> E              - ScratchBytesRead: 0
> E              - ScratchBytesWritten: 0
> E              - ScratchFileUsedBytes: 0
> E              - ScratchReads: 0 (0)
> E              - ScratchWrites: 0 (0)
> E              - TotalEncryptionTime: 0.000ns
> E              - TotalReadBlockTime: 0.000ns
> E           bf5c6b4d70c3:22000:
> E              - ScratchBytesRead: 0
> E              - ScratchBytesWritten: 0
> E              - ScratchFileUsedBytes: 0
> E              - ScratchReads: 0 (0)
> E              - ScratchWrites: 0 (0)
> E              - TotalEncryptionTime: 0.000ns
> E              - TotalReadBlockTime: 0.000ns
> E           f6d78aab23cf:22000:
> E              - ScratchBytesRead: 0
> E              - ScratchBytesWritten: 0
> E              - ScratchFileUsedBytes: 0
> E              - ScratchReads: 0 (0)
> E              - ScratchWrites: 0 (0)
> E              - TotalEncryptionTime: 0.000ns
> E              - TotalReadBlockTime: 0.000ns
> E         Averaged Fragment F01:(Total: 403.998ms, non-child: 3.999ms, % 
> non-child: 0.99%)
> E           split sizes:  min: 0, max: 0, avg: 0, stddev: 0
> E           completion times: min:415.998ms  max:415.998ms  mean: 415.998ms  
> stddev:0.000ns
> E           execution rates: min:0.00 /sec  max:0.00 /sec  mean:0.00 /sec  
> stddev:0.00 /sec
> E           num instances: 1
> E            - AverageThreadTokens: 0.00 
> E            - BloomFilterBytes: 0
> E            - ExchangeScanRatio: 0.00 
> E            - PeakMemoryUsage: 784.00 KB (802816)
> E            - PeakReservation: 0
> E            - PeakUsedReservation: 0
> E            - PerHostPeakMemUsage: 1.06 MB (1113656)
> E            - RowsProduced: 7.30K (7300)
> E            - TotalNetworkReceiveTime: 23.999ms
> E            - TotalNetworkSendTime: 0.000ns
> E            - TotalStorageWaitTime: 0.000ns
> E            - TotalThreadsInvoluntaryContextSwitches: 78 (78)
> E            - TotalThreadsTotalWallClockTime: 399.998ms
> E              - TotalThreadsSysTime: 0.000ns
> E              - TotalThreadsUserTime: 140.000ms
> E            - TotalThreadsVoluntaryContextSwitches: 10 (10)
> E           Buffer pool:
> E              - AllocTime: 0.000ns
> E              - CumulativeAllocationBytes: 0
> E              - CumulativeAllocations: 0 (0)
> E              - PeakReservation: 0
> E              - PeakUnpinnedBytes: 0
> E              - PeakUsedReservation: 0
> E              - ReadIoBytes: 0
> E              - ReadIoOps: 0 (0)
> E              - ReadIoWaitTime: 0.000ns
> E              - ReservationLimit: 0
> E              - SystemAllocTime: 0.000ns
> E              - WriteIoBytes: 0
> E              - WriteIoOps: 0 (0)
> E              - WriteIoWaitTime: 0.000ns
> E           Fragment Instance Lifecycle Timings:
> E              - ExecTime: 399.998ms
> E                - ExecTreeExecTime: 27.999ms
> E              - OpenTime: 0.000ns
> E                - ExecTreeOpenTime: 0.000ns
> E              - PrepareTime: 3.999ms
> E                - ExecTreePrepareTime: 0.000ns
> E           PLAN_ROOT_SINK:(Total: 371.998ms, non-child: 371.998ms, % 
> non-child: 100.00%)
> E              - PeakMemoryUsage: 0
> E           EXCHANGE_NODE (id=1):(Total: 27.999ms, non-child: 27.999ms, % 
> non-child: 100.00%)
> E              - ConvertRowBatchTime: 3.999ms
> E              - PeakMemoryUsage: 776.00 KB (794624)
> E              - RowsReturned: 7.30K (7300)
> E              - RowsReturnedRate: 260.71 K/sec
> E             Buffer pool:
> E                - AllocTime: 0.000ns
> E                - CumulativeAllocationBytes: 960.00 KB (983040)
> E                - CumulativeAllocations: 48 (48)
> E                - PeakReservation: 776.00 KB (794624)
> E                - PeakUnpinnedBytes: 0
> E                - PeakUsedReservation: 776.00 KB (794624)
> E                - ReadIoBytes: 0
> E                - ReadIoOps: 0 (0)
> E                - ReadIoWaitTime: 0.000ns
> E                - SystemAllocTime: 0.000ns
> E                - WriteIoBytes: 0
> E                - WriteIoOps: 0 (0)
> E                - WriteIoWaitTime: 0.000ns
> E             Dequeue:
> E                - FirstBatchWaitTime: 0.000ns
> E                - TotalBytesDequeued: 705.76 KB (722700)
> E                - TotalGetBatchTime: 23.999ms
> E                  - DataWaitTime: 23.999ms
> E             Enqueue:
> E                - DeserializeRowBatchTime: 3.999ms
> E                - TotalBatchesEnqueued: 24 (24)
> E                - TotalBatchesReceived: 24 (24)
> E                - TotalBytesReceived: 283.47 KB (290271)
> E                - TotalEarlySenders: 1 (1)
> E                - TotalEosReceived: 3 (3)
> E                - TotalHasDeferredRPCsTime: 53.864us
> E                - TotalRPCsDeferred: 1 (1)
> E         Coordinator Fragment F01:
> E           Instance 56480a470616cf3c:7cfadfbe00000000 
> (host=f6d78aab23cf:22000):(Total: 403.998ms, non-child: 3.999ms, % non-child: 
> 0.99%)
> E             Last report received time: 2019-08-28 20:01:07.300
> E             Fragment Instance Lifecycle Event Timeline: 415.998ms
> E                - Prepare Finished: 15.999ms (15.999ms)
> E                - Open Finished: 15.999ms (0.000ns)
> E                - First Batch Produced: 39.999ms (23.999ms)
> E                - First Batch Sent: 87.999ms (47.999ms)
> E                - ExecInternal Finished: 415.998ms (327.998ms)
> E              - MemoryUsage (500.000ms): 784.00 KB
> E              - AverageThreadTokens: 0.00 
> E              - BloomFilterBytes: 0
> E              - ExchangeScanRatio: 0.00 
> E              - PeakMemoryUsage: 784.00 KB (802816)
> E              - PeakReservation: 0
> E              - PeakUsedReservation: 0
> E              - PerHostPeakMemUsage: 1.06 MB (1113656)
> E              - RowsProduced: 7.30K (7300)
> E              - TotalNetworkReceiveTime: 23.999ms
> E              - TotalNetworkSendTime: 0.000ns
> E              - TotalStorageWaitTime: 0.000ns
> E              - TotalThreadsInvoluntaryContextSwitches: 78 (78)
> E              - TotalThreadsTotalWallClockTime: 399.998ms
> E                - TotalThreadsSysTime: 0.000ns
> E                - TotalThreadsUserTime: 140.000ms
> E              - TotalThreadsVoluntaryContextSwitches: 10 (10)
> E             Buffer pool:
> E                - AllocTime: 0.000ns
> E                - CumulativeAllocationBytes: 0
> E                - CumulativeAllocations: 0 (0)
> E                - PeakReservation: 0
> E                - PeakUnpinnedBytes: 0
> E                - PeakUsedReservation: 0
> E                - ReadIoBytes: 0
> E                - ReadIoOps: 0 (0)
> E                - ReadIoWaitTime: 0.000ns
> E                - ReservationLimit: 0
> E                - SystemAllocTime: 0.000ns
> E                - WriteIoBytes: 0
> E                - WriteIoOps: 0 (0)
> E                - WriteIoWaitTime: 0.000ns
> E             Fragment Instance Lifecycle Timings:
> E                - ExecTime: 399.998ms
> E                  - ExecTreeExecTime: 27.999ms
> E                - OpenTime: 0.000ns
> E                  - ExecTreeOpenTime: 0.000ns
> E                - PrepareTime: 3.999ms
> E                  - ExecTreePrepareTime: 0.000ns
> E             PLAN_ROOT_SINK:(Total: 371.998ms, non-child: 323.998ms, % 
> non-child: 87.10%)
> E                - PeakMemoryUsage: 0
> E             EXCHANGE_NODE (id=1):(Total: 27.999ms, non-child: 3.999ms, % 
> non-child: 14.29%)
> E               Node Lifecycle Event Timeline: 415.998ms
> E                  - Open Started: 15.999ms (15.999ms)
> E                  - Open Finished: 15.999ms (0.000ns)
> E                  - First Batch Requested: 15.999ms (0.000ns)
> E                  - First Batch Returned: 39.999ms (23.999ms)
> E                  - Last Batch Returned: 407.998ms (367.998ms)
> E                  - Closed: 415.998ms (7.999ms)
> E                - ConvertRowBatchTime: 3.999ms
> E                - PeakMemoryUsage: 776.00 KB (794624)
> E                - RowsReturned: 7.30K (7300)
> E                - RowsReturnedRate: 260.71 K/sec
> E               Buffer pool:
> E                  - AllocTime: 0.000ns
> E                  - CumulativeAllocationBytes: 960.00 KB (983040)
> E                  - CumulativeAllocations: 48 (48)
> E                  - PeakReservation: 776.00 KB (794624)
> E                  - PeakUnpinnedBytes: 0
> E                  - PeakUsedReservation: 776.00 KB (794624)
> E                  - ReadIoBytes: 0
> E                  - ReadIoOps: 0 (0)
> E                  - ReadIoWaitTime: 0.000ns
> E                  - SystemAllocTime: 0.000ns
> E                  - WriteIoBytes: 0
> E                  - WriteIoOps: 0 (0)
> E                  - WriteIoWaitTime: 0.000ns
> E               Dequeue:
> E                  - BytesDequeued (500.000ms): 502.73 KB
> E                  - FirstBatchWaitTime: 0.000ns
> E                  - TotalBytesDequeued: 705.76 KB (722700)
> E                  - TotalGetBatchTime: 23.999ms
> E                    - DataWaitTime: 23.999ms
> E               Enqueue:
> E                  - BytesReceived (500.000ms): 283.47 KB
> E                  - DeferredQueueSize (500.000ms): 0
> E                  - DispatchTime: (Avg: 178.622us ; Min: 53.536us ; Max: 
> 1.203ms ; Number of samples: 23)
> E                  - DeserializeRowBatchTime: 3.999ms
> E                  - TotalBatchesEnqueued: 24 (24)
> E                  - TotalBatchesReceived: 24 (24)
> E                  - TotalBytesReceived: 283.47 KB (290271)
> E                  - TotalEarlySenders: 1 (1)
> E                  - TotalEosReceived: 3 (3)
> E                  - TotalHasDeferredRPCsTime: 53.864us
> E                  - TotalRPCsDeferred: 1 (1)
> E         Averaged Fragment F00:(Total: 118.666ms, non-child: 0.000ns, % 
> non-child: 0.00%)
> E           split sizes:  min: 157.38 KB, max: 161.29 KB, avg: 159.48 KB, 
> stddev: 1.61 KB
> E           completion times: min:95.999ms  max:415.998ms  mean: 205.332ms  
> stddev:148.998ms
> E           execution rates: min:384.07 KB/sec  max:1.60 MB/sec  mean:1.16 
> MB/sec  stddev:572.06 KB/sec
> E           num instances: 3
> E            - AverageThreadTokens: 0.00 
> E            - BloomFilterBytes: 0
> E            - ExchangeScanRatio: 0.59 
> E            - PeakMemoryUsage: 1.18 MB (1239266)
> E            - PeakReservation: 117.33 KB (120149)
> E            - PeakUsedReservation: 0
> E            - PerHostPeakMemUsage: 1.44 MB (1506872)
> E            - RowsProduced: 2.43K (2433)
> E            - TotalNetworkReceiveTime: 0.000ns
> E            - TotalNetworkSendTime: 43.999ms
> E            - TotalStorageWaitTime: 5.333ms
> E            - TotalThreadsInvoluntaryContextSwitches: 41 (41)
> E            - TotalThreadsTotalWallClockTime: 235.998ms
> E              - TotalThreadsSysTime: 0.000ns
> E              - TotalThreadsUserTime: 17.333ms
> E            - TotalThreadsVoluntaryContextSwitches: 25 (25)
> E           Buffer pool:
> E              - AllocTime: 0.000ns
> E              - CumulativeAllocationBytes: 0
> E              - CumulativeAllocations: 0 (0)
> E              - PeakReservation: 0
> E              - PeakUnpinnedBytes: 0
> E              - PeakUsedReservation: 0
> E              - ReadIoBytes: 0
> E              - ReadIoOps: 0 (0)
> E              - ReadIoWaitTime: 0.000ns
> E              - ReservationLimit: 0
> E              - SystemAllocTime: 0.000ns
> E              - WriteIoBytes: 0
> E              - WriteIoOps: 0 (0)
> E              - WriteIoWaitTime: 0.000ns
> E           Fragment Instance Lifecycle Timings:
> E              - ExecTime: 117.332ms
> E                - ExecTreeExecTime: 66.666ms
> E              - OpenTime: 0.000ns
> E                - ExecTreeOpenTime: 0.000ns
> E              - PrepareTime: 1.333ms
> E                - ExecTreePrepareTime: 0.000ns
> E           KrpcDataStreamSender (dst_id=1):(Total: 51.999ms, non-child: 
> 51.999ms, % non-child: 100.00%)
> E              - EosSent: 1 (1)
> E              - PeakMemoryUsage: 1.55 KB (1592)
> E              - RowsSent: 2.43K (2433)
> E              - RpcFailure: 0 (0)
> E              - RpcRetry: 0 (0)
> E              - SerializeBatchTime: 3.999ms
> E              - TotalBytesSent: 94.49 KB (96757)
> E              - UncompressedRowBatchSize: 235.25 KB (240900)
> E           HDFS_SCAN_NODE (id=0):(Total: 66.666ms, non-child: 66.666ms, % 
> non-child: 100.00%)
> E              - AverageHdfsReadThreadConcurrency: 0.00 
> E              - AverageScannerThreadConcurrency: 0.00 
> E              - BytesRead: 159.48 KB (163311)
> E              - BytesReadDataNodeCache: 0
> E              - BytesReadLocal: 0
> E              - BytesReadRemoteUnexpected: 0
> E              - BytesReadShortCircuit: 0
> E              - CachedFileHandlesHitCount: 8 (8)
> E              - CachedFileHandlesMissCount: 0 (0)
> E              - CollectionItemsRead: 0 (0)
> E              - DataCacheHitBytes: 132.99 KB (136181)
> E              - DataCacheHitCount: 6 (6)
> E              - DataCacheMissBytes: 26.49 KB (27130)
> E              - DataCacheMissCount: 1 (1)
> E              - DataCachePartialHitCount: 0 (0)
> E              - DecompressionTime: 0.000ns
> E              - DelimiterParseTime: 6.666ms
> E              - MaterializeTupleTime(*): 67.999ms
> E              - MaxCompressedTextFileLength: 0
> E              - NumDisksAccessed: 1 (1)
> E              - NumScannerThreadMemUnavailable: 0 (0)
> E              - NumScannerThreadReservationsDenied: 0 (0)
> E              - NumScannerThreadsStarted: 2 (2)
> E              - PeakMemoryUsage: 1.01 MB (1061546)
> E              - PeakScannerThreadConcurrency: 2 (2)
> E              - PerReadThreadRawHdfsThroughput: 4.27 MB/sec
> E              - RemoteScanRanges: 4 (4)
> E              - RowBatchBytesEnqueued: 1.95 MB (2048000)
> E              - RowBatchQueueGetWaitTime: 58.666ms
> E              - RowBatchQueuePeakMemoryUsage: 894.67 KB (916138)
> E              - RowBatchQueuePutWaitTime: 0.000ns
> E              - RowBatchesEnqueued: 16 (16)
> E              - RowsRead: 2.43K (2433)
> E              - RowsReturned: 2.43K (2433)
> E              - RowsReturnedRate: 27.18 K/sec
> E              - ScanRangesComplete: 8 (8)
> E              - ScannerIoWaitTime: 5.333ms
> E              - ScannerThreadWorklessLoops: 0 (0)
> E              - ScannerThreadsInvoluntaryContextSwitches: 39 (39)
> E              - ScannerThreadsTotalWallClockTime: 118.666ms
> E                - ScannerThreadsSysTime: 0.000ns
> E                - ScannerThreadsUserTime: 13.333ms
> E              - ScannerThreadsVoluntaryContextSwitches: 7 (7)
> E              - TotalRawHdfsOpenFileTime(*): 0.000ns
> E              - TotalRawHdfsReadTime(*): 3.999ms
> E              - TotalReadThroughput: 0.00 /sec
> E             Buffer pool:
> E                - AllocTime: 0.000ns
> E                - CumulativeAllocationBytes: 256.00 KB (262144)
> E                - CumulativeAllocations: 8 (8)
> E                - PeakReservation: 117.33 KB (120149)
> E                - PeakUnpinnedBytes: 0
> E                - PeakUsedReservation: 74.67 KB (76458)
> E                - ReadIoBytes: 0
> E                - ReadIoOps: 0 (0)
> E                - ReadIoWaitTime: 0.000ns
> E                - SystemAllocTime: 0.000ns
> E                - WriteIoBytes: 0
> E                - WriteIoOps: 0 (0)
> E                - WriteIoWaitTime: 0.000ns
> E         Fragment F00:
> E           Instance 56480a470616cf3c:7cfadfbe00000001 
> (host=f6d78aab23cf:22000):(Total: 167.999ms, non-child: 0.000ns, % non-child: 
> 0.00%)
> E             Last report received time: 2019-08-28 20:01:07.300
> E             Hdfs split stats (<volume id>:<# splits>/<split lengths>): 
> -1:8/159.77 KB
> E             Fragment Instance Lifecycle Event Timeline: 219.999ms
> E                - Prepare Finished: 31.999ms (31.999ms)
> E                - Open Finished: 31.999ms (0.000ns)
> E                - First Batch Produced: 67.999ms (35.999ms)
> E                - First Batch Sent: 67.999ms (0.000ns)
> E                - ExecInternal Finished: 219.999ms (151.999ms)
> E              - AverageThreadTokens: 0.00 
> E              - BloomFilterBytes: 0
> E              - ExchangeScanRatio: 0.59 
> E              - PeakMemoryUsage: 303.55 KB (310840)
> E              - PeakReservation: 64.00 KB (65536)
> E              - PeakUsedReservation: 0
> E              - PerHostPeakMemUsage: 1.06 MB (1113656)
> E              - RowsProduced: 2.44K (2440)
> E              - TotalNetworkReceiveTime: 0.000ns
> E              - TotalNetworkSendTime: 3.999ms
> E              - TotalStorageWaitTime: 0.000ns
> E              - TotalThreadsInvoluntaryContextSwitches: 62 (62)
> E              - TotalThreadsTotalWallClockTime: 331.998ms
> E                - TotalThreadsSysTime: 0.000ns
> E                - TotalThreadsUserTime: 20.000ms
> E              - TotalThreadsVoluntaryContextSwitches: 27 (27)
> E             Buffer pool:
> E                - AllocTime: 0.000ns
> E                - CumulativeAllocationBytes: 0
> E                - CumulativeAllocations: 0 (0)
> E                - PeakReservation: 0
> E                - PeakUnpinnedBytes: 0
> E                - PeakUsedReservation: 0
> E                - ReadIoBytes: 0
> E                - ReadIoOps: 0 (0)
> E                - ReadIoWaitTime: 0.000ns
> E                - ReservationLimit: 0
> E                - SystemAllocTime: 0.000ns
> E                - WriteIoBytes: 0
> E                - WriteIoOps: 0 (0)
> E                - WriteIoWaitTime: 0.000ns
> E             Fragment Instance Lifecycle Timings:
> E                - ExecTime: 167.999ms
> E                  - ExecTreeExecTime: 163.999ms
> E                - OpenTime: 0.000ns
> E                  - ExecTreeOpenTime: 0.000ns
> E                - PrepareTime: 0.000ns
> E                  - ExecTreePrepareTime: 0.000ns
> E             KrpcDataStreamSender (dst_id=1):(Total: 3.999ms, non-child: 
> 0.000ns, % non-child: 0.00%)
> E               ExecOption: Codegen Disabled: disabled due to optimization 
> hints
> E                - NetworkThroughput: (Avg: 32.50 MB/sec ; Min: 1.83 MB/sec ; 
> Max: 47.13 MB/sec ; Number of samples: 8)
> E                - EosSent: 1 (1)
> E                - PeakMemoryUsage: 1.55 KB (1592)
> E                - RowsSent: 2.44K (2440)
> E                - RpcFailure: 0 (0)
> E                - RpcRetry: 0 (0)
> E                - SerializeBatchTime: 0.000ns
> E                - TotalBytesSent: 94.89 KB (97166)
> E                - UncompressedRowBatchSize: 235.90 KB (241560)
> E             HDFS_SCAN_NODE (id=0):(Total: 163.999ms, non-child: 163.999ms, 
> % non-child: 100.00%)
> E               Hdfs split stats (<volume id>:<# splits>/<split lengths>): 
> -1:8/159.77 KB
> E               ExecOption: Codegen Disabled: disabled due to optimization 
> hints, Codegen enabled: 0 out of 8
> E               Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 
> 5:0% 6:0%
> E               File Formats: TEXT/NONE:8
> E               Node Lifecycle Event Timeline: 219.999ms
> E                  - Open Started: 31.999ms (31.999ms)
> E                  - Open Finished: 31.999ms (0.000ns)
> E                  - First Batch Requested: 31.999ms (0.000ns)
> E                  - First Batch Returned: 67.999ms (35.999ms)
> E                  - Last Batch Returned: 195.999ms (127.999ms)
> E                  - Closed: 219.999ms (23.999ms)
> E                - InitialRangeActualReservation: (Avg: 32.00 KB (32768) ; 
> Min: 32.00 KB (32768) ; Max: 32.00 KB (32768) ; Number of samples: 8)
> E                - InitialRangeIdealReservation: (Avg: 32.00 KB (32768) ; 
> Min: 32.00 KB (32768) ; Max: 32.00 KB (32768) ; Number of samples: 8)
> E                - ParquetCompressedBytesReadPerColumn: 0 (Number of samples: 
> 0)
> E                - ParquetUncompressedBytesReadPerColumn: 0 (Number of 
> samples: 0)
> E                - AverageHdfsReadThreadConcurrency: 0.00 
> E                - AverageScannerThreadConcurrency: 0.00 
> E                - BytesRead: 159.77 KB (163608)
> E                - BytesReadDataNodeCache: 0
> E                - BytesReadLocal: 0
> E                - BytesReadRemoteUnexpected: 0
> E                - BytesReadShortCircuit: 0
> E                - CachedFileHandlesHitCount: 8 (8)
> E                - CachedFileHandlesMissCount: 0 (0)
> E                - CollectionItemsRead: 0 (0)
> E                - DataCacheHitBytes: 159.77 KB (163608)
> E                - DataCacheHitCount: 8 (8)
> E                - DataCacheMissBytes: 0
> E                - DataCacheMissCount: 0 (0)
> E                - DataCachePartialHitCount: 0 (0)
> E                - DecompressionTime: 0.000ns
> E                - DelimiterParseTime: 3.999ms
> E                - MaterializeTupleTime(*): 143.999ms
> E                - MaxCompressedTextFileLength: 0
> E                - NumDisksAccessed: 1 (1)
> E                - NumScannerThreadMemUnavailable: 0 (0)
> E                - NumScannerThreadReservationsDenied: 0 (0)
> E                - NumScannerThreadsStarted: 1 (1)
> E                - PeakMemoryUsage: 294.00 KB (301056)
> E                - PeakScannerThreadConcurrency: 1 (1)
> E                - PerReadThreadRawHdfsThroughput: 0.00 /sec
> E                - RemoteScanRanges: 0 (0)
> E                - RowBatchBytesEnqueued: 1.95 MB (2048000)
> E                - RowBatchQueueGetWaitTime: 163.999ms
> E                - RowBatchQueuePeakMemoryUsage: 254.00 KB (260096)
> E                - RowBatchQueuePutWaitTime: 0.000ns
> E                - RowBatchesEnqueued: 16 (16)
> E                - RowsRead: 2.44K (2440)
> E                - RowsReturned: 2.44K (2440)
> E                - RowsReturnedRate: 14.88 K/sec
> E                - ScanRangesComplete: 8 (8)
> E                - ScannerIoWaitTime: 0.000ns
> E                - ScannerThreadWorklessLoops: 0 (0)
> E                - ScannerThreadsInvoluntaryContextSwitches: 60 (60)
> E                - ScannerThreadsTotalWallClockTime: 163.999ms
> E                  - ScannerThreadsSysTime: 0.000ns
> E                  - ScannerThreadsUserTime: 16.000ms
> E                - ScannerThreadsVoluntaryContextSwitches: 5 (5)
> E                - TotalRawHdfsOpenFileTime(*): 0.000ns
> E                - TotalRawHdfsReadTime(*): 0.000ns
> E                - TotalReadThroughput: 0.00 /sec
> E               Buffer pool:
> E                  - AllocTime: 0.000ns
> E                  - CumulativeAllocationBytes: 256.00 KB (262144)
> E                  - CumulativeAllocations: 8 (8)
> E                  - PeakReservation: 64.00 KB (65536)
> E                  - PeakUnpinnedBytes: 0
> E                  - PeakUsedReservation: 32.00 KB (32768)
> E                  - ReadIoBytes: 0
> E                  - ReadIoOps: 0 (0)
> E                  - ReadIoWaitTime: 0.000ns
> E                  - SystemAllocTime: 0.000ns
> E                  - WriteIoBytes: 0
> E                  - WriteIoOps: 0 (0)
> E                  - WriteIoWaitTime: 0.000ns
> E           Instance 56480a470616cf3c:7cfadfbe00000003 
> (host=6db176633e3a:22000):(Total: 99.999ms, non-child: 0.000ns, % non-child: 
> 0.00%)
> E             Last report received time: 2019-08-28 20:01:06.986
> E             Hdfs split stats (<volume id>:<# splits>/<split lengths>): 
> -1:8/161.29 KB
> E             Fragment Instance Lifecycle Event Timeline: 99.999ms
> E                - Prepare Finished: 3.999ms (3.999ms)
> E                - Open Finished: 3.999ms (0.000ns)
> E                - First Batch Produced: 3.999ms (0.000ns)
> E                - First Batch Sent: 11.999ms (7.999ms)
> E                - ExecInternal Finished: 99.999ms (87.999ms)
> E              - AverageThreadTokens: 0.00 
> E              - BloomFilterBytes: 0
> E              - ExchangeScanRatio: 0.59 
> E              - PeakMemoryUsage: 1.63 MB (1709624)
> E              - PeakReservation: 128.00 KB (131072)
> E              - PeakUsedReservation: 0
> E              - PerHostPeakMemUsage: 1.63 MB (1709624)
> E              - RowsProduced: 2.46K (2460)
> E              - TotalNetworkReceiveTime: 0.000ns
> E              - TotalNetworkSendTime: 79.999ms
> E              - TotalStorageWaitTime: 0.000ns
> E              - TotalThreadsInvoluntaryContextSwitches: 36 (36)
> E              - TotalThreadsTotalWallClockTime: 163.999ms
> E                - TotalThreadsSysTime: 0.000ns
> E                - TotalThreadsUserTime: 16.000ms
> E              - TotalThreadsVoluntaryContextSwitches: 25 (25)
> E             Buffer pool:
> E                - AllocTime: 0.000ns
> E                - CumulativeAllocationBytes: 0
> E                - CumulativeAllocations: 0 (0)
> E                - PeakReservation: 0
> E                - PeakUnpinnedBytes: 0
> E                - PeakUsedReservation: 0
> E                - ReadIoBytes: 0
> E                - ReadIoOps: 0 (0)
> E                - ReadIoWaitTime: 0.000ns
> E                - ReservationLimit: 0
> E                - SystemAllocTime: 0.000ns
> E                - WriteIoBytes: 0
> E                - WriteIoOps: 0 (0)
> E                - WriteIoWaitTime: 0.000ns
> E             Fragment Instance Lifecycle Timings:
> E                - ExecTime: 95.999ms
> E                  - ExecTreeExecTime: 0.000ns
> E                - OpenTime: 0.000ns
> E                  - ExecTreeOpenTime: 0.000ns
> E                - PrepareTime: 3.999ms
> E                  - ExecTreePrepareTime: 0.000ns
> E             KrpcDataStreamSender (dst_id=1):(Total: 99.999ms, non-child: 
> 19.999ms, % non-child: 20.00%)
> E               ExecOption: Codegen Disabled: disabled due to optimization 
> hints
> E                - NetworkThroughput: (Avg: 2.08 MB/sec ; Min: 892.97 KB/sec 
> ; Max: 5.42 MB/sec ; Number of samples: 8)
> E                - EosSent: 1 (1)
> E                - PeakMemoryUsage: 1.55 KB (1592)
> E                - RowsSent: 2.46K (2460)
> E                - RpcFailure: 0 (0)
> E                - RpcRetry: 0 (0)
> E                - SerializeBatchTime: 7.999ms
> E                - TotalBytesSent: 95.36 KB (97644)
> E                - UncompressedRowBatchSize: 237.83 KB (243540)
> E             HDFS_SCAN_NODE (id=0):
> E               Hdfs split stats (<volume id>:<# splits>/<split lengths>): 
> -1:8/161.29 KB
> E               ExecOption: Codegen Disabled: disabled due to optimization 
> hints, Codegen enabled: 0 out of 8
> E               Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 
> 5:0% 6:0%
> E               File Formats: TEXT/NONE:8
> E               Node Lifecycle Event Timeline: 99.999ms
> E                  - Open Started: 3.999ms (3.999ms)
> E                  - Open Finished: 3.999ms (0.000ns)
> E                  - First Batch Requested: 3.999ms (0.000ns)
> E                  - First Batch Returned: 3.999ms (0.000ns)
> E                  - Last Batch Returned: 87.999ms (83.999ms)
> E                  - Closed: 99.999ms (11.999ms)
> E                - InitialRangeActualReservation: (Avg: 32.00 KB (32768) ; 
> Min: 32.00 KB (32768) ; Max: 32.00 KB (32768) ; Number of samples: 8)
> E                - InitialRangeIdealReservation: (Avg: 32.00 KB (32768) ; 
> Min: 32.00 KB (32768) ; Max: 32.00 KB (32768) ; Number of samples: 8)
> E                - ParquetCompressedBytesReadPerColumn: 0 (Number of samples: 
> 0)
> E                - ParquetUncompressedBytesReadPerColumn: 0 (Number of 
> samples: 0)
> E                - AverageHdfsReadThreadConcurrency: 0.00 
> E                - AverageScannerThreadConcurrency: 0.00 
> E                - BytesRead: 161.29 KB (165166)
> E                - BytesReadDataNodeCache: 0
> E                - BytesReadLocal: 0
> E                - BytesReadRemoteUnexpected: 0
> E                - BytesReadShortCircuit: 0
> E                - CachedFileHandlesHitCount: 8 (8)
> E                - CachedFileHandlesMissCount: 0 (0)
> E                - CollectionItemsRead: 0 (0)
> E                - DataCacheHitBytes: 141.59 KB (144987)
> E                - DataCacheHitCount: 7 (7)
> E                - DataCacheMissBytes: 19.71 KB (20179)
> E                - DataCacheMissCount: 1 (1)
> E                - DataCachePartialHitCount: 0 (0)
> E                - DecompressionTime: 0.000ns
> E                - DelimiterParseTime: 0.000ns
> E                - MaterializeTupleTime(*): 19.999ms
> E                - MaxCompressedTextFileLength: 0
> E                - NumDisksAccessed: 1 (1)
> E                - NumScannerThreadMemUnavailable: 0 (0)
> E                - NumScannerThreadReservationsDenied: 0 (0)
> E                - NumScannerThreadsStarted: 3 (3)
> E                - PeakMemoryUsage: 1.38 MB (1447936)
> E                - PeakScannerThreadConcurrency: 3 (3)
> E                - PerReadThreadRawHdfsThroughput: 0.00 /sec
> E                - RemoteScanRanges: 3 (3)
> E                - RowBatchBytesEnqueued: 1.95 MB (2048000)
> E                - RowBatchQueueGetWaitTime: 0.000ns
> E                - RowBatchQueuePeakMemoryUsage: 1.32 MB (1386496)
> E                - RowBatchQueuePutWaitTime: 0.000ns
> E                - RowBatchesEnqueued: 16 (16)
> E                - RowsRead: 2.46K (2460)
> E                - RowsReturned: 2.46K (2460)
> E                - RowsReturnedRate: 0
> E                - ScanRangesComplete: 8 (8)
> E                - ScannerIoWaitTime: 0.000ns
> E                - ScannerThreadWorklessLoops: 0 (0)
> E                - ScannerThreadsInvoluntaryContextSwitches: 32 (32)
> E                - ScannerThreadsTotalWallClockTime: 67.999ms
> E                  - ScannerThreadsSysTime: 0.000ns
> E                  - ScannerThreadsUserTime: 12.000ms
> E                - ScannerThreadsVoluntaryContextSwitches: 7 (7)
> E                - TotalRawHdfsOpenFileTime(*): 0.000ns
> E                - TotalRawHdfsReadTime(*): 0.000ns
> E                - TotalReadThroughput: 0.00 /sec
> E               Buffer pool:
> E                  - AllocTime: 0.000ns
> E                  - CumulativeAllocationBytes: 256.00 KB (262144)
> E                  - CumulativeAllocations: 8 (8)
> E                  - PeakReservation: 128.00 KB (131072)
> E                  - PeakUnpinnedBytes: 0
> E                  - PeakUsedReservation: 64.00 KB (65536)
> E                  - ReadIoBytes: 0
> E                  - ReadIoOps: 0 (0)
> E                  - ReadIoWaitTime: 0.000ns
> E                  - SystemAllocTime: 0.000ns
> E                  - WriteIoBytes: 0
> E                  - WriteIoOps: 0 (0)
> E                  - WriteIoWaitTime: 0.000ns
> E           Instance 56480a470616cf3c:7cfadfbe00000002 
> (host=bf5c6b4d70c3:22000):(Total: 87.999ms, non-child: 0.000ns, % non-child: 
> 0.00%)
> E             Last report received time: 2019-08-28 20:01:06.987
> E             Hdfs split stats (<volume id>:<# splits>/<split lengths>): 
> -1:8/157.38 KB
> E             Fragment Instance Lifecycle Event Timeline: 95.999ms
> E                - Prepare Finished: 7.999ms (7.999ms)
> E                - Open Finished: 7.999ms (0.000ns)
> E                - First Batch Produced: 43.999ms (35.999ms)
> E                - First Batch Sent: 43.999ms (0.000ns)
> E                - ExecInternal Finished: 95.999ms (51.999ms)
> E              - AverageThreadTokens: 0.00 
> E              - BloomFilterBytes: 0
> E              - ExchangeScanRatio: 0.59 
> E              - PeakMemoryUsage: 1.62 MB (1697336)
> E              - PeakReservation: 160.00 KB (163840)
> E              - PeakUsedReservation: 0
> E              - PerHostPeakMemUsage: 1.62 MB (1697336)
> E              - RowsProduced: 2.40K (2400)
> E              - TotalNetworkReceiveTime: 0.000ns
> E              - TotalNetworkSendTime: 47.999ms
> E              - TotalStorageWaitTime: 15.999ms
> E              - TotalThreadsInvoluntaryContextSwitches: 27 (27)
> E              - TotalThreadsTotalWallClockTime: 211.999ms
> E                - TotalThreadsSysTime: 0.000ns
> E                - TotalThreadsUserTime: 16.000ms
> E              - TotalThreadsVoluntaryContextSwitches: 24 (24)
> E             Buffer pool:
> E                - AllocTime: 0.000ns
> E                - CumulativeAllocationBytes: 0
> E                - CumulativeAllocations: 0 (0)
> E                - PeakReservation: 0
> E                - PeakUnpinnedBytes: 0
> E                - PeakUsedReservation: 0
> E                - ReadIoBytes: 0
> E                - ReadIoOps: 0 (0)
> E                - ReadIoWaitTime: 0.000ns
> E                - ReservationLimit: 0
> E                - SystemAllocTime: 0.000ns
> E                - WriteIoBytes: 0
> E                - WriteIoOps: 0 (0)
> E                - WriteIoWaitTime: 0.000ns
> E             Fragment Instance Lifecycle Timings:
> E                - ExecTime: 87.999ms
> E                  - ExecTreeExecTime: 35.999ms
> E                - OpenTime: 0.000ns
> E                  - ExecTreeOpenTime: 0.000ns
> E                - PrepareTime: 0.000ns
> E                  - ExecTreePrepareTime: 0.000ns
> E             KrpcDataStreamSender (dst_id=1):(Total: 51.999ms, non-child: 
> 3.999ms, % non-child: 7.69%)
> E               ExecOption: Codegen Disabled: disabled due to optimization 
> hints
> E                - NetworkThroughput: (Avg: 2.35 MB/sec ; Min: 1.05 MB/sec ; 
> Max: 3.73 MB/sec ; Number of samples: 8)
> E                - EosSent: 1 (1)
> E                - PeakMemoryUsage: 1.55 KB (1592)
> E                - RowsSent: 2.40K (2400)
> E                - RpcFailure: 0 (0)
> E                - RpcRetry: 0 (0)
> E                - SerializeBatchTime: 3.999ms
> E                - TotalBytesSent: 93.22 KB (95461)
> E                - UncompressedRowBatchSize: 232.03 KB (237600)
> E             HDFS_SCAN_NODE (id=0):(Total: 35.999ms, non-child: 35.999ms, % 
> non-child: 100.00%)
> E               Hdfs split stats (<volume id>:<# splits>/<split lengths>): 
> -1:8/157.38 KB
> E               ExecOption: Codegen Disabled: disabled due to optimization 
> hints, Codegen enabled: 0 out of 8
> E               Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 
> 5:0% 6:0%
> E               File Formats: TEXT/NONE:8
> E               Node Lifecycle Event Timeline: 95.999ms
> E                  - Open Started: 7.999ms (7.999ms)
> E                  - Open Finished: 7.999ms (0.000ns)
> E                  - First Batch Requested: 7.999ms (0.000ns)
> E                  - First Batch Returned: 43.999ms (35.999ms)
> E                  - Last Batch Returned: 91.999ms (47.999ms)
> E                  - Closed: 95.999ms (3.999ms)
> E                - InitialRangeActualReservation: (Avg: 32.00 KB (32768) ; 
> Min: 32.00 KB (32768) ; Max: 32.00 KB (32768) ; Number of samples: 8)
> E                - InitialRangeIdealReservation: (Avg: 32.00 KB (32768) ; 
> Min: 32.00 KB (32768) ; Max: 32.00 KB (32768) ; Number of samples: 8)
> E                - ParquetCompressedBytesReadPerColumn: 0 (Number of samples: 
> 0)
> E                - ParquetUncompressedBytesReadPerColumn: 0 (Number of 
> samples: 0)
> E                - AverageHdfsReadThreadConcurrency: 0.00 
> E                - AverageScannerThreadConcurrency: 0.00 
> E                - BytesRead: 157.38 KB (161160)
> E                - BytesReadDataNodeCache: 0
> E                - BytesReadLocal: 0
> E                - BytesReadRemoteUnexpected: 0
> E                - BytesReadShortCircuit: 0
> E                - CachedFileHandlesHitCount: 8 (8)
> E                - CachedFileHandlesMissCount: 0 (0)
> E                - CollectionItemsRead: 0 (0)
> E                - DataCacheHitBytes: 97.61 KB (99949)
> E                - DataCacheHitCount: 5 (5)
> E                - DataCacheMissBytes: 59.78 KB (61211)
> E                - DataCacheMissCount: 3 (3)
> E                - DataCachePartialHitCount: 0 (0)
> E                - DecompressionTime: 0.000ns
> E                - DelimiterParseTime: 15.999ms
> E                - MaterializeTupleTime(*): 39.999ms
> E                - MaxCompressedTextFileLength: 0
> E                - NumDisksAccessed: 1 (1)
> E                - NumScannerThreadMemUnavailable: 0 (0)
> E                - NumScannerThreadReservationsDenied: 0 (0)
> E                - NumScannerThreadsStarted: 4 (4)
> E                - PeakMemoryUsage: 1.37 MB (1435648)
> E                - PeakScannerThreadConcurrency: 4 (4)
> E                - PerReadThreadRawHdfsThroughput: 12.81 MB/sec
> E                - RemoteScanRanges: 9 (9)
> E                - RowBatchBytesEnqueued: 1.95 MB (2048000)
> E                - RowBatchQueueGetWaitTime: 11.999ms
> E                - RowBatchQueuePeakMemoryUsage: 1.05 MB (1101824)
> E                - RowBatchQueuePutWaitTime: 0.000ns
> E                - RowBatchesEnqueued: 16 (16)
> E                - RowsRead: 2.40K (2400)
> E                - RowsReturned: 2.40K (2400)
> E                - RowsReturnedRate: 66.67 K/sec
> E                - ScanRangesComplete: 8 (8)
> E                - ScannerIoWaitTime: 15.999ms
> E                - ScannerThreadWorklessLoops: 0 (0)
> E                - ScannerThreadsInvoluntaryContextSwitches: 26 (26)
> E                - ScannerThreadsTotalWallClockTime: 123.999ms
> E                  - ScannerThreadsSysTime: 0.000ns
> E                  - ScannerThreadsUserTime: 12.000ms
> E                - ScannerThreadsVoluntaryContextSwitches: 9 (9)
> E                - TotalRawHdfsOpenFileTime(*): 0.000ns
> E                - TotalRawHdfsReadTime(*): 11.999ms
> E                - TotalReadThroughput: 0.00 /sec
> E               Buffer pool:
> E                  - AllocTime: 0.000ns
> E                  - CumulativeAllocationBytes: 256.00 KB (262144)
> E                  - CumulativeAllocations: 8 (8)
> E                  - PeakReservation: 160.00 KB (163840)
> E                  - PeakUnpinnedBytes: 0
> E                  - PeakUsedReservation: 128.00 KB (131072)
> E                  - ReadIoBytes: 0
> E                  - ReadIoOps: 0 (0)
> E                  - ReadIoWaitTime: 0.000ns
> E                  - SystemAllocTime: 0.000ns
> E                  - WriteIoBytes: 0
> E                  - WriteIoOps: 0 (0)
> E                  - WriteIoWaitTime: 0.000ns
> E     
> E   assert 10 == 0{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org
For additional commands, e-mail: issues-all-h...@impala.apache.org

Reply via email to