[
https://issues.apache.org/jira/browse/IMPALA-6811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Joe McDonnell resolved IMPALA-6811.
-----------------------------------
Resolution: Fixed
Fix Version/s: Impala 2.12.0
> test_exchange_delays failed
> ---------------------------
>
> Key: IMPALA-6811
> URL: https://issues.apache.org/jira/browse/IMPALA-6811
> Project: IMPALA
> Issue Type: Bug
> Components: Backend
> Affects Versions: Impala 2.13.0
> Reporter: Tianyi Wang
> Assignee: Joe McDonnell
> Priority: Blocker
> Labels: broken-build
> Fix For: Impala 2.12.0
>
>
> {noformat}
> Error Message
> AssertionError: Expected exception: timed out waiting for receiver fragment
> instance
> Stacktrace
> custom_cluster/test_exchange_delays.py:63: in test_exchange_large_delay
> self.run_test_case('QueryTest/exchange-delays-zero-rows', vector)
> common/impala_test_suite.py:413: in run_test_case
> assert False, "Expected exception: %s" % expected_str
> E AssertionError: Expected exception: timed out waiting for receiver
> fragment instance
> {noformat}
> profile:
> {noformat}
> TRuntimeProfileTree(nodes=[TRuntimeProfileNode(info_strings_display_order=['DEBUG
> MODE WARNING'], indent=True, name='Query
> (id=a6461a30c2fb8bec:d4c89d2200000000)', time_series_counters=None,
> info_strings={'DEBUG MODE WARNING': 'Query profile created while running a
> DEBUG build of Impala. Use RELEASE builds to measure query performance.'},
> summary_stats_counters=None, num_children=3, child_counters_map={},
> event_sequences=None, counters=[TCounter(value=0, name='InactiveTotalTime',
> unit=5), TCounter(value=0, name='TotalTime', unit=5)], metadata=-1),
> TRuntimeProfileNode(info_strings_display_order=['Session ID', 'Session Type',
> 'Start Time', 'End Time', 'Query Type', 'Query State', 'Query Status',
> 'Impala Version', 'User', 'Connected User', 'Delegated User', 'Network
> Address', 'Default Db', 'Sql Statement', 'Coordinator', 'Query Options (set
> by configuration)', 'Query Options (set by configuration and planner)',
> 'Plan', 'Estimated Per-Host Mem', 'Per Host Min Reservation', 'Request Pool',
> 'Admission result', 'ExecSummary', 'Errors'], indent=True, name='Summary',
> time_series_counters=None, info_strings={'Errors': '', 'Sql Statement':
> 'select l_orderkey, count(*)\nfrom tpch.lineitem\nwhere l_linenumber =
> -1\ngroup by l_orderkey', 'Network Address': '127.0.0.1:43193', 'Impala
> Version': 'impalad version 2.12.0-SNAPSHOT DEBUG (build
> 5166270bfcfca424be023b5495e9dcf0d344fca2)', 'Query Options (set by
> configuration and planner)':
> 'ABORT_ON_ERROR=1,EXEC_SINGLE_NODE_ROWS_THRESHOLD=0,MT_DOP=0,DISABLE_CODEGEN_ROWS_THRESHOLD=0',
> 'ExecSummary': '\nOperator #Hosts Avg Time Max Time #Rows Est.
> #Rows Peak Mem Est. Peak Mem Detail
> \n--------------------------------------------------------------------------------------------------------\n04:EXCHANGE
> 1 0.000ns 0.000ns 0 857.32K 0 0
> UNPARTITIONED \n03:AGGREGATE 3 10s003ms 10s004ms 0
> 857.32K 8.52 MB 10.00 MB FINALIZE \n02:EXCHANGE 3
> 0.000ns 0.000ns 0 857.32K 0 0
> HASH(l_orderkey) \n01:AGGREGATE 3 3.333ms 3.999ms 0
> 857.32K 17.06 MB 17.00 MB STREAMING \n00:SCAN HDFS 3
> 10s775ms 10s908ms 0 857.32K 88.22 MB 320.00 MB tpch.lineitem
> ', 'Admission result': 'Admitted immediately', 'Request Pool':
> 'default-pool', 'Start Time': '2018-04-04 00:32:34.242692000', 'End Time':
> '2018-04-04 00:32:45.504165000', 'Plan': '\n----------------\nMax Per-Host
> Resource Reservation: Memory=25.50MB\nPer-Host Resource Estimates:
> Memory=347.00MB\n\nF02:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1\n|
> Per-Host Resources: mem-estimate=0B mem-reservation=0B\nPLAN-ROOT SINK\n|
> mem-estimate=0B mem-reservation=0B\n|\n04:EXCHANGE [UNPARTITIONED]\n|
> mem-estimate=0B mem-reservation=0B\n| tuple-ids=1 row-size=16B
> cardinality=857316\n|\nF01:PLAN FRAGMENT [HASH(l_orderkey)] hosts=3
> instances=3\nPer-Host Resources: mem-estimate=10.00MB
> mem-reservation=8.50MB\n03:AGGREGATE [FINALIZE]\n| output: count:merge(*)\n|
> group by: l_orderkey\n| mem-estimate=10.00MB mem-reservation=8.50MB
> spill-buffer=512.00KB\n| tuple-ids=1 row-size=16B
> cardinality=857316\n|\n02:EXCHANGE [HASH(l_orderkey)]\n| mem-estimate=0B
> mem-reservation=0B\n| tuple-ids=1 row-size=16B
> cardinality=857316\n|\nF00:PLAN FRAGMENT [RANDOM] hosts=3
> instances=3\nPer-Host Resources: mem-estimate=337.00MB
> mem-reservation=17.00MB\n01:AGGREGATE [STREAMING]\n| output: count(*)\n|
> group by: l_orderkey\n| mem-estimate=17.00MB mem-reservation=17.00MB
> spill-buffer=1.00MB\n| tuple-ids=1 row-size=16B
> cardinality=857316\n|\n00:SCAN HDFS [tpch.lineitem, RANDOM]\n
> partitions=1/1 files=1 size=718.94MB\n predicates: l_linenumber = -1\n
> stored statistics:\n table: rows=6001215 size=718.94MB\n columns:
> all\n extrapolated-rows=disabled\n parquet dictionary predicates:
> l_linenumber = -1\n mem-estimate=320.00MB mem-reservation=0B\n
> tuple-ids=0 row-size=12B cardinality=857316\n----------------', 'Query Type':
> 'QUERY', 'Connected User': 'jenkins', 'Session ID':
> '75414a6fbddec773:358c37eef8592588', 'User': 'jenkins', 'Default Db':
> 'functional', 'Per Host Min Reservation':
> 'ec2-m2-4xlarge-centos-6-4-0bb5.vpc.cloudera.com:22000(25.50 MB)
> ec2-m2-4xlarge-centos-6-4-0bb5.vpc.cloudera.com:22001(25.50 MB)
> ec2-m2-4xlarge-centos-6-4-0bb5.vpc.cloudera.com:22002(25.50 MB) ', 'Delegated
> User': '', 'Query State': 'FINISHED', 'Session Type': 'BEESWAX', 'Query
> Status': 'OK', 'Query Options (set by configuration)':
> 'ABORT_ON_ERROR=1,EXEC_SINGLE_NODE_ROWS_THRESHOLD=0,DISABLE_CODEGEN_ROWS_THRESHOLD=0',
> 'Coordinator': 'ec2-m2-4xlarge-centos-6-4-0bb5.vpc.cloudera.com:22000',
> 'Estimated Per-Host Mem': '363855872'}, summary_stats_counters=None,
> num_children=0, child_counters_map={'':
> set(['ComputeScanRangeAssignmentTimer'])},
> event_sequences=[TEventSequence(timestamps=[4630648, 7623814, 7882296,
> 36431063, 37117604, 37192620, 41519526], labels=['Metadata of all 1 tables
> cached', 'Analysis finished', 'Value transfer graph computed', 'Single node
> plan created', 'Runtime filters computed', 'Distributed plan created',
> 'Planning finished'], name='Query Compilation'),
> TEventSequence(timestamps=[0, 42999903, 43999900, 44999898, 44999898,
> 46999894, 11236974533, 11246974511, 11246974511, 11246974511, 11260974479],
> labels=['Query submitted', 'Planning finished', 'Submit for admission',
> 'Completed admission', 'Ready to start on 3 backends', 'All 3 execution
> backends (7 fragment instances) started', 'Rows available', 'First row
> fetched', 'Last row fetched', 'Released admission control resources',
> 'Unregister query'], name='Query Timeline')], counters=[TCounter(value=0,
> name='ComputeScanRangeAssignmentTimer', unit=5), TCounter(value=0,
> name='InactiveTotalTime', unit=5), TCounter(value=0, name='TotalTime',
> unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[],
> indent=True, name='ImpalaServer', time_series_counters=None, info_strings={},
> summary_stats_counters=None, num_children=0, child_counters_map={'':
> set(['ClientFetchWaitTimer', 'RowMaterializationTimer'])},
> event_sequences=None, counters=[TCounter(value=20999954,
> name='ClientFetchWaitTimer', unit=5), TCounter(value=0,
> name='InactiveTotalTime', unit=5), TCounter(value=2999992,
> name='RowMaterializationTimer', unit=5), TCounter(value=0, name='TotalTime',
> unit=5)], metadata=-1),
> TRuntimeProfileNode(info_strings_display_order=['Number of filters', 'Filter
> routing table', 'Backend startup latencies', 'Per Node Peak Memory Usage'],
> indent=True, name='Execution Profile a6461a30c2fb8bec:d4c89d2200000000',
> time_series_counters=None, info_strings={'Backend startup latencies': 'Count:
> 3, min / max: 1ms / 1ms, 25th %-ile: 1ms, 50th %-ile: 1ms, 75th %-ile: 1ms,
> 90th %-ile: 1ms, 95th %-ile: 1ms, 99.9th %-ile: 1ms', 'Filter routing table':
> '\n ID Src. Node Tgt. Node(s) Target type Partition filter Pending
> (Expected) First arrived Completed
> Enabled\n-------------------------------------------------------------------------------------------------------------------\n',
> 'Per Node Peak Memory Usage':
> 'ec2-m2-4xlarge-centos-6-4-0bb5.vpc.cloudera.com:22000(97.79 MB)
> ec2-m2-4xlarge-centos-6-4-0bb5.vpc.cloudera.com:22001(113.79 MB)
> ec2-m2-4xlarge-centos-6-4-0bb5.vpc.cloudera.com:22002(97.74 MB) ', 'Number of
> filters': '0'}, summary_stats_counters=None, num_children=6,
> child_counters_map={'': set(['NumBackends', 'FinalizationTimer',
> 'FiltersReceived', 'NumFragmentInstances', 'NumFragments'])},
> event_sequences=None, counters=[TCounter(value=0, name='FiltersReceived',
> unit=0), TCounter(value=0, name='FinalizationTimer', unit=5),
> TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=3,
> name='NumBackends', unit=0), TCounter(value=7, name='NumFragmentInstances',
> unit=0), TCounter(value=3, name='NumFragments', unit=0),
> TCounter(value=11188974641, name='TotalTime', unit=5)], metadata=-1),
> TRuntimeProfileNode(info_strings_display_order=['split sizes', 'completion
> times', 'execution rates', 'num instances'], indent=True, name='Averaged
> Fragment F02', time_series_counters=None, info_strings={'completion times':
> 'min:11s191ms max:11s191ms mean: 11s191ms stddev:0.000ns', 'split sizes':
> ' min: 0, max: 0, avg: 0, stddev: 0', 'execution rates': 'min:0.00 /sec
> max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec', 'num instances': '1'},
> summary_stats_counters=None, num_children=5, child_counters_map={'':
> set(['TotalNetworkSendTime', 'PerHostPeakMemUsage', 'AverageThreadTokens',
> 'PeakMemoryUsage', 'TotalStorageWaitTime',
> 'TotalThreadsInvoluntaryContextSwitches', 'TotalThreadsTotalWallClockTime',
> 'RowsProduced', 'TotalThreadsVoluntaryContextSwitches',
> 'TotalNetworkReceiveTime', 'BloomFilterBytes', 'PeakReservation',
> 'PeakUsedReservation']), 'TotalThreadsTotalWallClockTime':
> set(['TotalThreadsUserTime', 'TotalThreadsSysTime'])}, event_sequences=None,
> counters=[TCounter(value=4607182418800017408, name='AverageThreadTokens',
> unit=6), TCounter(value=0, name='BloomFilterBytes', unit=3),
> TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=8192,
> name='PeakMemoryUsage', unit=3), TCounter(value=0, name='PeakReservation',
> unit=3), TCounter(value=0, name='PeakUsedReservation', unit=3),
> TCounter(value=102539267, name='PerHostPeakMemUsage', unit=3),
> TCounter(value=0, name='RowsProduced', unit=0), TCounter(value=1133997430,
> name='TotalNetworkReceiveTime', unit=5), TCounter(value=0,
> name='TotalNetworkSendTime', unit=5), TCounter(value=0,
> name='TotalStorageWaitTime', unit=5), TCounter(value=17,
> name='TotalThreadsInvoluntaryContextSwitches', unit=0),
> TCounter(value=3999000, name='TotalThreadsSysTime', unit=5),
> TCounter(value=1179997326, name='TotalThreadsTotalWallClockTime', unit=5),
> TCounter(value=20997000, name='TotalThreadsUserTime', unit=5),
> TCounter(value=5, name='TotalThreadsVoluntaryContextSwitches', unit=0),
> TCounter(value=11188974641, name='TotalTime', unit=5)], metadata=-1),
> TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Buffer
> pool', time_series_counters=None, info_strings={},
> summary_stats_counters=None, num_children=0, child_counters_map={'':
> set(['ReadIoWaitTime', 'WriteIoOps', 'WriteIoWaitTime',
> 'CumulativeAllocations', 'ReadIoOps', 'ReservationLimit', 'WriteIoBytes',
> 'PeakUnpinnedBytes', 'AllocTime', 'ReadIoBytes', 'CumulativeAllocationBytes',
> 'PeakReservation', 'PeakUsedReservation'])}, event_sequences=None,
> counters=[TCounter(value=0, name='AllocTime', unit=5), TCounter(value=0,
> name='CumulativeAllocationBytes', unit=3), TCounter(value=0,
> name='CumulativeAllocations', unit=0), TCounter(value=0,
> name='InactiveTotalTime', unit=5), TCounter(value=0, name='PeakReservation',
> unit=3), TCounter(value=0, name='PeakUnpinnedBytes', unit=3),
> TCounter(value=0, name='PeakUsedReservation', unit=3), TCounter(value=0,
> name='ReadIoBytes', unit=3), TCounter(value=0, name='ReadIoOps', unit=0),
> TCounter(value=0, name='ReadIoWaitTime', unit=5), TCounter(value=0,
> name='ReservationLimit', unit=3), TCounter(value=0, name='TotalTime',
> unit=5), TCounter(value=0, name='WriteIoBytes', unit=3), TCounter(value=0,
> name='WriteIoOps', unit=0), TCounter(value=0, name='WriteIoWaitTime',
> unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[],
> indent=True, name='Fragment Instance Lifecycle Timings',
> time_series_counters=None, info_strings={}, summary_stats_counters=None,
> num_children=0, child_counters_map={'': set(['ExecTime', 'OpenTime',
> 'PrepareTime']), 'ExecTime': set(['ExecTreeExecTime']), 'OpenTime':
> set(['ExecTreeOpenTime']), 'PrepareTime': set(['ExecTreePrepareTime'])},
> event_sequences=None, counters=[TCounter(value=0, name='ExecTime', unit=5),
> TCounter(value=0, name='ExecTreeExecTime', unit=5),
> TCounter(value=1133997430, name='ExecTreeOpenTime', unit=5),
> TCounter(value=9999977335, name='ExecTreePrepareTime', unit=5),
> TCounter(value=0, name='InactiveTotalTime', unit=5),
> TCounter(value=1179997326, name='OpenTime', unit=5),
> TCounter(value=10008977315, name='PrepareTime', unit=5), TCounter(value=0,
> name='TotalTime', unit=5)], metadata=-1),
> TRuntimeProfileNode(info_strings_display_order=[], indent=True,
> name='PLAN_ROOT_SINK', time_series_counters=None, info_strings={},
> summary_stats_counters=None, num_children=0, child_counters_map={'':
> set(['PeakMemoryUsage'])}, event_sequences=None, counters=[TCounter(value=0,
> name='InactiveTotalTime', unit=5), TCounter(value=0, name='PeakMemoryUsage',
> unit=3), TCounter(value=0, name='TotalTime', unit=5)], metadata=-1),
> TRuntimeProfileNode(info_strings_display_order=[], indent=True,
> name='EXCHANGE_NODE (id=4)', time_series_counters=None, info_strings={},
> summary_stats_counters=None, num_children=3, child_counters_map={'':
> set(['RowsReturned', 'RowsReturnedRate', 'ConvertRowBatchTime',
> 'PeakMemoryUsage'])}, event_sequences=None, counters=[TCounter(value=0,
> name='ConvertRowBatchTime', unit=5), TCounter(value=0,
> name='InactiveTotalTime', unit=5), TCounter(value=0, name='PeakMemoryUsage',
> unit=3), TCounter(value=0, name='RowsReturned', unit=0), TCounter(value=0,
> name='RowsReturnedRate', unit=1), TCounter(value=1133997430,
> name='TotalTime', unit=5)], metadata=4),
> TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Buffer
> pool', time_series_counters=None, info_strings={},
> summary_stats_counters=None, num_children=0, child_counters_map={'':
> set(['ReadIoWaitTime', 'WriteIoOps', 'WriteIoWaitTime',
> 'CumulativeAllocations', 'ReadIoOps', 'WriteIoBytes', 'PeakUnpinnedBytes',
> 'AllocTime', 'ReadIoBytes', 'CumulativeAllocationBytes', 'PeakReservation',
> 'PeakUsedReservation'])}, event_sequences=None, counters=[TCounter(value=0,
> name='AllocTime', unit=5), TCounter(value=0,
> name='CumulativeAllocationBytes', unit=3), TCounter(value=0,
> name='CumulativeAllocations', unit=0), TCounter(value=0,
> name='InactiveTotalTime', unit=5), TCounter(value=0, name='PeakReservation',
> unit=3), TCounter(value=0, name='PeakUnpinnedBytes', unit=3),
> TCounter(value=0, name='PeakUsedReservation', unit=3), TCounter(value=0,
> name='ReadIoBytes', unit=3), TCounter(value=0, name='ReadIoOps', unit=0),
> TCounter(value=0, name='ReadIoWaitTime', unit=5), TCounter(value=0,
> name='TotalTime', unit=5), TCounter(value=0, name='WriteIoBytes', unit=3),
> TCounter(value=0, name='WriteIoOps', unit=0), TCounter(value=0,
> name='WriteIoWaitTime', unit=5)], metadata=-1),
> TRuntimeProfileNode(info_strings_display_order=[], indent=True,
> name='Dequeue', time_series_counters=None, info_strings={},
> summary_stats_counters=None, num_children=0, child_counters_map={'':
> set(['FirstBatchWaitTime', 'TotalGetBatchTime', 'TotalBytesDequeued']),
> 'TotalGetBatchTime': set(['DataWaitTime'])}, event_sequences=None,
> counters=[TCounter(value=1133997430, name='DataWaitTime', unit=5),
> TCounter(value=1133997430, name='FirstBatchWaitTime', unit=5),
> TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=0,
> name='TotalBytesDequeued', unit=3), TCounter(value=1133997430,
> name='TotalGetBatchTime', unit=5), TCounter(value=0, name='TotalTime',
> unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[],
> indent=True, name='Enqueue', time_series_counters=None, info_strings={},
> summary_stats_counters=None, num_children=0, child_counters_map={'':
> set(['TotalBatchesEnqueued', 'TotalHasDeferredRPCsTime', 'TotalEosReceived',
> 'DeserializeRowBatchTime', 'TotalRPCsDeferred', 'TotalBytesReceived',
> 'TotalEarlySenders', 'TotalBatchesReceived'])}, event_sequences=None,
> counters=[TCounter(value=0, name='DeserializeRowBatchTime', unit=5),
> TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=0,
> name='TotalBatchesEnqueued', unit=0), TCounter(value=0,
> name='TotalBatchesReceived', unit=0), TCounter(value=0,
> name='TotalBytesReceived', unit=3), TCounter(value=0,
> name='TotalEarlySenders', unit=0), TCounter(value=3, name='TotalEosReceived',
> unit=0), TCounter(value=0, name='TotalHasDeferredRPCsTime', unit=5),
> TCounter(value=0, name='TotalRPCsDeferred', unit=0), TCounter(value=0,
> name='TotalTime', unit=5)], metadata=-1),
> TRuntimeProfileNode(info_strings_display_order=[], indent=True,
> name='CodeGen', time_series_counters=None, info_strings={},
> summary_stats_counters=None, num_children=0, child_counters_map={'':
> set(['OptimizationTime', 'CompileTime', 'LoadTime', 'NumInstructions',
> 'PeakMemoryUsage', 'ModuleBitcodeSize', 'PrepareTime', 'NumFunctions',
> 'CodegenTime'])}, event_sequences=None, counters=[TCounter(value=0,
> name='CodegenTime', unit=5), TCounter(value=0, name='CompileTime', unit=5),
> TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=0,
> name='LoadTime', unit=5), TCounter(value=2370660, name='ModuleBitcodeSize',
> unit=3), TCounter(value=0, name='NumFunctions', unit=0), TCounter(value=0,
> name='NumInstructions', unit=0), TCounter(value=0, name='OptimizationTime',
> unit=5), TCounter(value=0, name='PeakMemoryUsage', unit=3),
> TCounter(value=45999896, name='PrepareTime', unit=5),
> TCounter(value=45999896, name='TotalTime', unit=5)], metadata=-1),
> TRuntimeProfileNode(info_strings_display_order=[], indent=True,
> name='Coordinator Fragment F02', time_series_counters=None, info_strings={},
> summary_stats_counters=None, num_children=1, child_counters_map={},
> event_sequences=None, counters=[TCounter(value=0, name='InactiveTotalTime',
> unit=5), TCounter(value=0, name='TotalTime', unit=5)], metadata=-1),
> TRuntimeProfileNode(info_strings_display_order=[], indent=True,
> name='Instance a6461a30c2fb8bec:d4c89d2200000000
> (host=ec2-m2-4xlarge-centos-6-4-0bb5.vpc.cloudera.com:22000)',
> time_series_counters=[TTimeSeriesCounter(values=[0, 0, 0, 0, 0, 0, 0, 0, 0,
> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 8192, 8192], name='MemoryUsage', unit=3,
> period_ms=500), TTimeSeriesCounter(values=[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,
> 1, 1, 1, 1, 1, 1, 1, 1, 1], name='ThreadUsage', unit=0, period_ms=500)],
> info_strings={}, summary_stats_counters=None, num_children=5,
> child_counters_map={'': set(['TotalNetworkSendTime', 'PerHostPeakMemUsage',
> 'AverageThreadTokens', 'PeakMemoryUsage', 'TotalStorageWaitTime',
> 'TotalThreadsInvoluntaryContextSwitches', 'TotalThreadsTotalWallClockTime',
> 'RowsProduced', 'TotalThreadsVoluntaryContextSwitches',
> 'TotalNetworkReceiveTime', 'BloomFilterBytes', 'PeakReservation',
> 'PeakUsedReservation']), 'TotalThreadsTotalWallClockTime':
> set(['TotalThreadsUserTime', 'TotalThreadsSysTime'])},
> event_sequences=[TEventSequence(timestamps=[10009977313, 11189974639,
> 11189974639, 11189974639, 11189974639], labels=['Prepare Finished', 'Open
> Finished', 'First Batch Produced', 'First Batch Sent', 'ExecInternal
> Finished'], name='Fragment Instance Lifecycle Event Timeline')],
> counters=[TCounter(value=4607182418800017408, name='AverageThreadTokens',
> unit=6), TCounter(value=0, name='BloomFilterBytes', unit=3),
> TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=8192,
> name='PeakMemoryUsage', unit=3), TCounter(value=0, name='PeakReservation',
> unit=3), TCounter(value=0, name='PeakUsedReservation', unit=3),
> TCounter(value=102539267, name='PerHostPeakMemUsage', unit=3),
> TCounter(value=0, name='RowsProduced', unit=0), TCounter(value=1133997430,
> name='TotalNetworkReceiveTime', unit=5), TCounter(value=0,
> name='TotalNetworkSendTime', unit=5), TCounter(value=0,
> name='TotalStorageWaitTime', unit=5), TCounter(value=17,
> name='TotalThreadsInvoluntaryContextSwitches', unit=0),
> TCounter(value=3999000, name='TotalThreadsSysTime', unit=5),
> TCounter(value=1179997326, name='TotalThreadsTotalWallClockTime', unit=5),
> TCounter(value=20997000, name='TotalThreadsUserTime', unit=5),
> TCounter(value=5, name='TotalThreadsVoluntaryContextSwitches', unit=0),
> TCounter(value=11188974641, name='TotalTime', unit=5)], metadata=-1),
> TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Buffer
> pool', time_series_counters=None, info_strings={},
> summary_stats_counters=None, num_children=0, child_counters_map={'':
> set(['ReadIoWaitTime', 'WriteIoOps', 'WriteIoWaitTime',
> 'CumulativeAllocations', 'ReadIoOps', 'ReservationLimit', 'WriteIoBytes',
> 'PeakUnpinnedBytes', 'AllocTime', 'ReadIoBytes', 'CumulativeAllocationBytes',
> 'PeakReservation', 'PeakUsedReservation'])}, event_sequences=None,
> counters=[TCounter(value=0, name='AllocTime', unit=5), TCounter(value=0,
> name='CumulativeAllocationBytes', unit=3), TCounter(value=0,
> name='CumulativeAllocations', unit=0), TCounter(value=0,
> name='InactiveTotalTime', unit=5), TCounter(value=0, name='PeakReservation',
> unit=3), TCounter(value=0, name='PeakUnpinnedBytes', unit=3),
> TCounter(value=0, name='PeakUsedReservation', unit=3), TCounter(value=0,
> name='ReadIoBytes', unit=3), TCounter(value=0, name='ReadIoOps', unit=0),
> TCounter(value=0, name='ReadIoWaitTime', unit=5), TCounter(value=0,
> name='ReservationLimit', unit=3), TCounter(value=0, name='TotalTime',
> unit=5), TCounter(value=0, name='WriteIoBytes', unit=3), TCounter(value=0,
> name='WriteIoOps', unit=0), TCounter(value=0, name='WriteIoWaitTime',
> unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[],
> indent=True, name='Fragment Instance Lifecycle Timings',
> time_series_counters=None, info_strings={}, summary_stats_counters=None,
> num_children=0, child_counters_map={'': set(['ExecTime', 'OpenTime',
> 'PrepareTime']), 'ExecTime': set(['ExecTreeExecTime']), 'OpenTime':
> set(['ExecTreeOpenTime']), 'PrepareTime': set(['ExecTreePrepareTime'])},
> event_sequences=None, counters=[TCounter(value=0, name='ExecTime', unit=5),
> TCounter(value=0, name='ExecTreeExecTime', unit=5),
> TCounter(value=1133997430, name='ExecTreeOpenTime', unit=5),
> TCounter(value=9999977335, name='ExecTreePrepareTime', unit=5),
> TCounter(value=0, name='InactiveTotalTime', unit=5),
> TCounter(value=1179997326, name='OpenTime', unit=5),
> TCounter(value=10008977315, name='PrepareTime', unit=5), TCounter(value=0,
> name='TotalTime', unit=5)], metadata=-1),
> TRuntimeProfileNode(info_strings_display_order=[], indent=True,
> name='PLAN_ROOT_SINK', time_series_counters=None, info_strings={},
> summary_stats_counters=None, num_children=0, child_counters_map={'':
> set(['PeakMemoryUsage'])}, event_sequences=None, counters=[TCounter(value=0,
> name='InactiveTotalTime', unit=5), TCounter(value=0, name='PeakMemoryUsage',
> unit=3), TCounter(value=0, name='TotalTime', unit=5)], metadata=-1),
> TRuntimeProfileNode(info_strings_display_order=[], indent=True,
> name='EXCHANGE_NODE (id=4)', time_series_counters=None, info_strings={},
> summary_stats_counters=None, num_children=3, child_counters_map={'':
> set(['RowsReturned', 'RowsReturnedRate', 'ConvertRowBatchTime',
> 'PeakMemoryUsage'])}, event_sequences=None, counters=[TCounter(value=0,
> name='ConvertRowBatchTime', unit=5), TCounter(value=1133997430,
> name='InactiveTotalTime', unit=5), TCounter(value=0, name='PeakMemoryUsage',
> unit=3), TCounter(value=0, name='RowsReturned', unit=0), TCounter(value=0,
> name='RowsReturnedRate', unit=1), TCounter(value=1133997430,
> name='TotalTime', unit=5)], metadata=4),
> TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Buffer
> pool', time_series_counters=None, info_strings={},
> summary_stats_counters=None, num_children=0, child_counters_map={'':
> set(['ReadIoWaitTime', 'WriteIoOps', 'WriteIoWaitTime',
> 'CumulativeAllocations', 'ReadIoOps', 'WriteIoBytes', 'PeakUnpinnedBytes',
> 'AllocTime', 'ReadIoBytes', 'CumulativeAllocationBytes', 'PeakReservation',
> 'PeakUsedReservation'])}, event_sequences=None, counters=[TCounter(value=0,
> name='AllocTime', unit=5), TCounter(value=0,
> name='CumulativeAllocationBytes', unit=3), TCounter(value=0,
> name='CumulativeAllocations', unit=0), TCounter(value=0,
> name='InactiveTotalTime', unit=5), TCounter(value=0, name='PeakReservation',
> unit=3), TCounter(value=0, name='PeakUnpinnedBytes', unit=3),
> TCounter(value=0, name='PeakUsedReservation', unit=3), TCounter(value=0,
> name='ReadIoBytes', unit=3), TCounter(value=0, name='ReadIoOps', unit=0),
> TCounter(value=0, name='ReadIoWaitTime', unit=5), TCounter(value=0,
> name='TotalTime', unit=5), TCounter(value=0, name='WriteIoBytes', unit=3),
> TCounter(value=0, name='WriteIoOps', unit=0), TCounter(value=0,
> name='WriteIoWaitTime', unit=5)], metadata=-1),
> TRuntimeProfileNode(info_strings_display_order=[], indent=True,
> name='Dequeue', time_series_counters=[TTimeSeriesCounter(values=[0, 0],
> name='BytesDequeued', unit=3, period_ms=500)], info_strings={},
> summary_stats_counters=None, num_children=0, child_counters_map={'':
> set(['FirstBatchWaitTime', 'TotalGetBatchTime', 'TotalBytesDequeued']),
> 'TotalGetBatchTime': set(['DataWaitTime'])}, event_sequences=None,
> counters=[TCounter(value=1133997430, name='DataWaitTime', unit=5),
> TCounter(value=1133997430, name='FirstBatchWaitTime', unit=5),
> TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=0,
> name='TotalBytesDequeued', unit=3), TCounter(value=1133997430,
> name='TotalGetBatchTime', unit=5), TCounter(value=0, name='TotalTime',
> unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[],
> indent=True, name='Enqueue',
> time_series_counters=[TTimeSeriesCounter(values=[0, 0], name='BytesReceived',
> unit=3, period_ms=500), TTimeSeriesCounter(values=[0, 0],
> name='DeferredQueueSize', unit=0, period_ms=500)], info_strings={},
> summary_stats_counters=[TSummaryStatsCounter(total_num_values=0,
> name='DispatchTime', max_value=-9223372036854775808L, sum=0,
> min_value=9223372036854775807L, unit=5)], num_children=0,
> child_counters_map={'': set(['TotalBatchesEnqueued',
> 'TotalHasDeferredRPCsTime', 'TotalEosReceived', 'DeserializeRowBatchTime',
> 'TotalRPCsDeferred', 'TotalBytesReceived', 'TotalEarlySenders',
> 'TotalBatchesReceived'])}, event_sequences=None, counters=[TCounter(value=0,
> name='DeserializeRowBatchTime', unit=5), TCounter(value=0,
> name='InactiveTotalTime', unit=5), TCounter(value=0,
> name='TotalBatchesEnqueued', unit=0), TCounter(value=0,
> name='TotalBatchesReceived', unit=0), TCounter(value=0,
> name='TotalBytesReceived', unit=3), TCounter(value=0,
> name='TotalEarlySenders', unit=0), TCounter(value=3, name='TotalEosReceived',
> unit=0), TCounter(value=0, name='TotalHasDeferredRPCsTime', unit=5),
> TCounter(value=0, name='TotalRPCsDeferred', unit=0), TCounter(value=0,
> name='TotalTime', unit=5)], metadata=-1),
> TRuntimeProfileNode(info_strings_display_order=[], indent=True,
> name='CodeGen', time_series_counters=None, info_strings={},
> summary_stats_counters=None, num_children=0, child_counters_map={'':
> set(['OptimizationTime', 'CompileTime', 'LoadTime', 'NumInstructions',
> 'PeakMemoryUsage', 'ModuleBitcodeSize', 'PrepareTime', 'NumFunctions',
> 'CodegenTime'])}, event_sequences=None, counters=[TCounter(value=0,
> name='CodegenTime', unit=5), TCounter(value=0, name='CompileTime', unit=5),
> TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=0,
> name='LoadTime', unit=5), TCounter(value=2370660, name='ModuleBitcodeSize',
> unit=3), TCounter(value=0, name='NumFunctions', unit=0), TCounter(value=0,
> name='NumInstructions', unit=0), TCounter(value=0, name='OptimizationTime',
> unit=5), TCounter(value=0, name='PeakMemoryUsage', unit=3),
> TCounter(value=45999896, name='PrepareTime', unit=5),
> TCounter(value=45999896, name='TotalTime', unit=5)], metadata=-1),
> TRuntimeProfileNode(info_strings_display_order=['split sizes', 'completion
> times', 'execution rates', 'num instances'], indent=True, name='Averaged
> Fragment F01', time_series_counters=None, info_strings={'completion times':
> 'min:11s188ms max:11s190ms mean: 11s190ms stddev:942.807us', 'split
> sizes': ' min: 0, max: 0, avg: 0, stddev: 0', 'execution rates': 'min:0.00
> /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec', 'num instances':
> '3'}, summary_stats_counters=None, num_children=5, child_counters_map={'':
> set(['TotalNetworkSendTime', 'PerHostPeakMemUsage', 'AverageThreadTokens',
> 'PeakMemoryUsage', 'TotalStorageWaitTime',
> 'TotalThreadsInvoluntaryContextSwitches', 'TotalThreadsTotalWallClockTime',
> 'RowsProduced', 'TotalThreadsVoluntaryContextSwitches',
> 'TotalNetworkReceiveTime', 'BloomFilterBytes', 'PeakReservation',
> 'PeakUsedReservation']), 'TotalThreadsTotalWallClockTime':
> set(['TotalThreadsUserTime', 'TotalThreadsSysTime'])}, event_sequences=None,
> counters=[TCounter(value=4607182418800017408, name='AverageThreadTokens',
> unit=6), TCounter(value=0, name='BloomFilterBytes', unit=3),
> TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=8957872,
> name='PeakMemoryUsage', unit=3), TCounter(value=8912896,
> name='PeakReservation', unit=3), TCounter(value=0,
> name='PeakUsedReservation', unit=3), TCounter(value=108113581,
> name='PerHostPeakMemUsage', unit=3), TCounter(value=0, name='RowsProduced',
> unit=0), TCounter(value=960331157, name='TotalNetworkReceiveTime', unit=5),
> TCounter(value=999998, name='TotalNetworkSendTime', unit=5),
> TCounter(value=0, name='TotalStorageWaitTime', unit=5), TCounter(value=110,
> name='TotalThreadsInvoluntaryContextSwitches', unit=0),
> TCounter(value=10665000, name='TotalThreadsSysTime', unit=5),
> TCounter(value=1178330662, name='TotalThreadsTotalWallClockTime', unit=5),
> TCounter(value=115649333, name='TotalThreadsUserTime', unit=5),
> TCounter(value=3, name='TotalThreadsVoluntaryContextSwitches', unit=0),
> TCounter(value=11187641310, name='TotalTime', unit=5)], metadata=-1),
> TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Buffer
> pool', time_series_counters=None, info_strings={},
> summary_stats_counters=None, num_children=0, child_counters_map={'':
> set(['ReadIoWaitTime', 'WriteIoOps', 'WriteIoWaitTime',
> 'CumulativeAllocations', 'ReadIoOps', 'ReservationLimit', 'WriteIoBytes',
> 'PeakUnpinnedBytes', 'AllocTime', 'ReadIoBytes', 'CumulativeAllocationBytes',
> 'PeakReservation', 'PeakUsedReservation'])}, event_sequences=None,
> counters=[TCounter(value=0, name='AllocTime', unit=5), TCounter(value=0,
> name='CumulativeAllocationBytes', unit=3), TCounter(value=0,
> name='CumulativeAllocations', unit=0), TCounter(value=0,
> name='InactiveTotalTime', unit=5), TCounter(value=0, name='PeakReservation',
> unit=3), TCounter(value=0, name='PeakUnpinnedBytes', unit=3),
> TCounter(value=0, name='PeakUsedReservation', unit=3), TCounter(value=0,
> name='ReadIoBytes', unit=3), TCounter(value=0, name='ReadIoOps', unit=0),
> TCounter(value=0, name='ReadIoWaitTime', unit=5), TCounter(value=0,
> name='ReservationLimit', unit=3), TCounter(value=0, name='TotalTime',
> unit=5), TCounter(value=0, name='WriteIoBytes', unit=3), TCounter(value=0,
> name='WriteIoOps', unit=0), TCounter(value=0, name='WriteIoWaitTime',
> unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[],
> indent=True, name='Fragment Instance Lifecycle Timings',
> time_series_counters=None, info_strings={}, summary_stats_counters=None,
> num_children=0, child_counters_map={'': set(['ExecTime', 'OpenTime',
> 'PrepareTime']), 'ExecTime': set(['ExecTreeExecTime']), 'OpenTime':
> set(['ExecTreeOpenTime']), 'PrepareTime': set(['ExecTreePrepareTime'])},
> event_sequences=None, counters=[TCounter(value=999998, name='ExecTime',
> unit=5), TCounter(value=0, name='ExecTreeExecTime', unit=5),
> TCounter(value=963664482, name='ExecTreeOpenTime', unit=5),
> TCounter(value=10000644000, name='ExecTreePrepareTime', unit=5),
> TCounter(value=0, name='InactiveTotalTime', unit=5),
> TCounter(value=1177330664, name='OpenTime', unit=5),
> TCounter(value=10009310647, name='PrepareTime', unit=5), TCounter(value=0,
> name='TotalTime', unit=5)], metadata=-1),
> TRuntimeProfileNode(info_strings_display_order=[], indent=True,
> name='KrpcDataStreamSender (dst_id=4)', time_series_counters=None,
> info_strings={}, summary_stats_counters=None, num_children=0,
> child_counters_map={'': set(['SerializeBatchTime',
> 'UncompressedRowBatchSize', 'RpcFailure', 'PeakMemoryUsage', 'RpcRetry',
> 'EosSent', 'NetworkThroughput', 'TotalBytesSent', 'RowsSent'])},
> event_sequences=None, counters=[TCounter(value=1, name='EosSent', unit=0),
> TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=0,
> name='NetworkThroughput', unit=4), TCounter(value=7704,
> name='PeakMemoryUsage', unit=3), TCounter(value=0, name='RowsSent', unit=0),
> TCounter(value=0, name='RpcFailure', unit=0), TCounter(value=0,
> name='RpcRetry', unit=0), TCounter(value=0, name='SerializeBatchTime',
> unit=5), TCounter(value=0, name='TotalBytesSent', unit=3),
> TCounter(value=999998, name='TotalTime', unit=5), TCounter(value=0,
> name='UncompressedRowBatchSize', unit=3)], metadata=-1),
> TRuntimeProfileNode(info_strings_display_order=[], indent=True,
> name='AGGREGATION_NODE (id=3)', time_series_counters=None, info_strings={},
> summary_stats_counters=None, num_children=2, child_counters_map={'':
> set(['LargestPartitionPercent', 'HTResizeTime', 'HashBuckets', 'BuildTime',
> 'RowsRepartitioned', 'PeakMemoryUsage', 'MaxPartitionLevel',
> 'SpilledPartitions', 'PartitionsCreated', 'RowsReturnedRate', 'RowsReturned',
> 'NumRepartitions', 'GetResultsTime'])}, event_sequences=None,
> counters=[TCounter(value=0, name='BuildTime', unit=5), TCounter(value=0,
> name='GetResultsTime', unit=5), TCounter(value=0, name='HTResizeTime',
> unit=5), TCounter(value=0, name='HashBuckets', unit=0), TCounter(value=0,
> name='InactiveTotalTime', unit=5), TCounter(value=0,
> name='LargestPartitionPercent', unit=0), TCounter(value=0,
> name='MaxPartitionLevel', unit=0), TCounter(value=0, name='NumRepartitions',
> unit=0), TCounter(value=16, name='PartitionsCreated', unit=0),
> TCounter(value=8938624, name='PeakMemoryUsage', unit=3), TCounter(value=0,
> name='RowsRepartitioned', unit=0), TCounter(value=0, name='RowsReturned',
> unit=0), TCounter(value=0, name='RowsReturnedRate', unit=1),
> TCounter(value=0, name='SpilledPartitions', unit=0),
> TCounter(value=10964308482, name='TotalTime', unit=5)], metadata=3),
> TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Buffer
> pool', time_series_counters=None, info_strings={},
> summary_stats_counters=None, num_children=0, child_counters_map={'':
> set(['ReadIoWaitTime', 'WriteIoOps', 'WriteIoWaitTime',
> 'CumulativeAllocations', 'ReadIoOps', 'WriteIoBytes', 'PeakUnpinnedBytes',
> 'AllocTime', 'ReadIoBytes', 'CumulativeAllocationBytes', 'PeakReservation',
> 'PeakUsedReservation'])}, event_sequences=None, counters=[TCounter(value=0,
> name='AllocTime', unit=5), TCounter(value=524288,
> name='CumulativeAllocationBytes', unit=3), TCounter(value=1,
> name='CumulativeAllocations', unit=0), TCounter(value=0,
> name='InactiveTotalTime', unit=5), TCounter(value=8912896,
> name='PeakReservation', unit=3), TCounter(value=0, name='PeakUnpinnedBytes',
> unit=3), TCounter(value=524288, name='PeakUsedReservation', unit=3),
> TCounter(value=0, name='ReadIoBytes', unit=3), TCounter(value=0,
> name='ReadIoOps', unit=0), TCounter(value=0, name='ReadIoWaitTime', unit=5),
> TCounter(value=0, name='TotalTime', unit=5), TCounter(value=0,
> name='WriteIoBytes', unit=3), TCounter(value=0, name='WriteIoOps', unit=0),
> TCounter(value=0, name='WriteIoWaitTime', unit=5)], metadata=-1),
> TRuntimeProfileNode(info_strings_display_order=[], indent=False,
> name='EXCHANGE_NODE (id=2)', time_series_counters=None, info_strings={},
> summary_stats_counters=None, num_children=3, child_counters_map={'':
> set(['RowsReturned', 'RowsReturnedRate', 'ConvertRowBatchTime',
> 'PeakMemoryUsage'])}, event_sequences=None, counters=[TCounter(value=0,
> name='ConvertRowBatchTime', unit=5), TCounter(value=0,
> name='InactiveTotalTime', unit=5), TCounter(value=0, name='PeakMemoryUsage',
> unit=3), TCounter(value=0, name='RowsReturned', unit=0), TCounter(value=0,
> name='RowsReturnedRate', unit=1), TCounter(value=960331157, name='TotalTime',
> unit=5)], metadata=2), TRuntimeProfileNode(info_strings_display_order=[],
> indent=True, name='Buffer pool', time_series_counters=None, info_strings={},
> summary_stats_counters=None, num_children=0, child_counters_map={'':
> set(['ReadIoWaitTime', 'WriteIoOps', 'WriteIoWaitTime',
> 'CumulativeAllocations', 'ReadIoOps', 'WriteIoBytes', 'PeakUnpinnedBytes',
> 'AllocTime', 'ReadIoBytes', 'CumulativeAllocationBytes', 'PeakReservation',
> 'PeakUsedReservation'])}, event_sequences=None, counters=[TCounter(value=0,
> name='AllocTime', unit=5), TCounter(value=0,
> name='CumulativeAllocationBytes', unit=3), TCounter(value=0,
> name='CumulativeAllocations', unit=0), TCounter(value=0,
> name='InactiveTotalTime', unit=5), TCounter(value=0, name='PeakReservation',
> unit=3), TCounter(value=0, name='PeakUnpinnedBytes', unit=3),
> TCounter(value=0, name='PeakUsedReservation', unit=3), TCounter(value=0,
> name='ReadIoBytes', unit=3), TCounter(value=0, name='ReadIoOps', unit=0),
> TCounter(value=0, name='ReadIoWaitTime', unit=5), TCounter(value=0,
> name='TotalTime', unit=5), TCounter(value=0, name='WriteIoBytes', unit=3),
> TCounter(value=0, name='WriteIoOps', unit=0), TCounter(value=0,
> name='WriteIoWaitTime', unit=5)], metadata=-1),
> TRuntimeProfileNode(info_strings_display_order=[], indent=True,
> name='Dequeue', time_series_counters=None, info_strings={},
> summary_stats_counters=None, num_children=0, child_counters_map={'':
> set(['FirstBatchWaitTime', 'TotalGetBatchTime', 'TotalBytesDequeued']),
> 'TotalGetBatchTime': set(['DataWaitTime'])}, event_sequences=None,
> counters=[TCounter(value=960331157, name='DataWaitTime', unit=5),
> TCounter(value=960331157, name='FirstBatchWaitTime', unit=5),
> TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=0,
> name='TotalBytesDequeued', unit=3), TCounter(value=960331157,
> name='TotalGetBatchTime', unit=5), TCounter(value=0, name='TotalTime',
> unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[],
> indent=True, name='Enqueue', time_series_counters=None, info_strings={},
> summary_stats_counters=None, num_children=0, child_counters_map={'':
> set(['TotalBatchesEnqueued', 'TotalHasDeferredRPCsTime', 'TotalEosReceived',
> 'DeserializeRowBatchTime', 'TotalRPCsDeferred', 'TotalBytesReceived',
> 'TotalEarlySenders', 'TotalBatchesReceived'])}, event_sequences=None,
> counters=[TCounter(value=0, name='DeserializeRowBatchTime', unit=5),
> TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=0,
> name='TotalBatchesEnqueued', unit=0), TCounter(value=0,
> name='TotalBatchesReceived', unit=0), TCounter(value=0,
> name='TotalBytesReceived', unit=3), TCounter(value=0,
> name='TotalEarlySenders', unit=0), TCounter(value=3, name='TotalEosReceived',
> unit=0), TCounter(value=0, name='TotalHasDeferredRPCsTime', unit=5),
> TCounter(value=0, name='TotalRPCsDeferred', unit=0), TCounter(value=0,
> name='TotalTime', unit=5)], metadata=-1),
> TRuntimeProfileNode(info_strings_display_order=[], indent=True,
> name='CodeGen', time_series_counters=None, info_strings={},
> summary_stats_counters=None, num_children=0, child_counters_map={'':
> set(['OptimizationTime', 'CompileTime', 'LoadTime', 'NumInstructions',
> 'PeakMemoryUsage', 'ModuleBitcodeSize', 'PrepareTime', 'NumFunctions',
> 'CodegenTime'])}, event_sequences=None, counters=[TCounter(value=8333314,
> name='CodegenTime', unit=5), TCounter(value=8333314, name='CompileTime',
> unit=5), TCounter(value=0, name='InactiveTotalTime', unit=5),
> TCounter(value=0, name='LoadTime', unit=5), TCounter(value=2370660,
> name='ModuleBitcodeSize', unit=3), TCounter(value=32, name='NumFunctions',
> unit=0), TCounter(value=573, name='NumInstructions', unit=0),
> TCounter(value=142666343, name='OptimizationTime', unit=5),
> TCounter(value=293376, name='PeakMemoryUsage', unit=3),
> TCounter(value=56666538, name='PrepareTime', unit=5),
> TCounter(value=207999529, name='TotalTime', unit=5)], metadata=-1),
> TRuntimeProfileNode(info_strings_display_order=[], indent=True,
> name='Fragment F01', time_series_counters=None, info_strings={},
> summary_stats_counters=None, num_children=3, child_counters_map={},
> event_sequences=None, counters=[TCounter(value=0, name='InactiveTotalTime',
> unit=5), TCounter(value=0, name='TotalTime', unit=5)], metadata=-1),
> TRuntimeProfileNode(info_strings_display_order=[], indent=True,
> name='Instance a6461a30c2fb8bec:d4c89d2200000006
> (host=ec2-m2-4xlarge-centos-6-4-0bb5.vpc.cloudera.com:22001)',
> time_series_counters=[TTimeSeriesCounter(values=[0, 0, 0, 0, 0, 0, 0, 0, 0,
> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 33432, 36784, 36784], name='MemoryUsage',
> unit=3, period_ms=500), TTimeSeriesCounter(values=[1, 1, 1, 1, 1, 1, 1, 1, 1,
> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1], name='ThreadUsage', unit=0,
> period_ms=500)], info_strings={}, summary_stats_counters=None,
> num_children=5, child_counters_map={'': set(['TotalNetworkSendTime',
> 'PerHostPeakMemUsage', 'AverageThreadTokens', 'PeakMemoryUsage',
> 'TotalStorageWaitTime', 'TotalThreadsInvoluntaryContextSwitches',
> 'TotalThreadsTotalWallClockTime', 'RowsProduced',
> 'TotalThreadsVoluntaryContextSwitches', 'TotalNetworkReceiveTime',
> 'BloomFilterBytes', 'PeakReservation', 'PeakUsedReservation']),
> 'TotalThreadsTotalWallClockTime': set(['TotalThreadsUserTime',
> 'TotalThreadsSysTime'])},
> event_sequences=[TEventSequence(timestamps=[10010977311, 11188974641,
> 11188974641, 11188974641, 11189974639], labels=['Prepare Finished', 'Open
> Finished', 'First Batch Produced', 'First Batch Sent', 'ExecInternal
> Finished'], name='Fragment Instance Lifecycle Event Timeline')],
> counters=[TCounter(value=4607182418800017408, name='AverageThreadTokens',
> unit=6), TCounter(value=0, name='BloomFilterBytes', unit=3),
> TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=8957872,
> name='PeakMemoryUsage', unit=3), TCounter(value=8912896,
> name='PeakReservation', unit=3), TCounter(value=0,
> name='PeakUsedReservation', unit=3), TCounter(value=119315459,
> name='PerHostPeakMemUsage', unit=3), TCounter(value=0, name='RowsProduced',
> unit=0), TCounter(value=902997954, name='TotalNetworkReceiveTime', unit=5),
> TCounter(value=999998, name='TotalNetworkSendTime', unit=5),
> TCounter(value=0, name='TotalStorageWaitTime', unit=5), TCounter(value=50,
> name='TotalThreadsInvoluntaryContextSwitches', unit=0),
> TCounter(value=8998000, name='TotalThreadsSysTime', unit=5),
> TCounter(value=1178997328, name='TotalThreadsTotalWallClockTime', unit=5),
> TCounter(value=128981000, name='TotalThreadsUserTime', unit=5),
> TCounter(value=3, name='TotalThreadsVoluntaryContextSwitches', unit=0),
> TCounter(value=11188974641, name='TotalTime', unit=5)], metadata=-1),
> TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Buffer
> pool', time_series_counters=None, info_strings={},
> summary_stats_counters=None, num_children=0, child_counters_map={'':
> set(['ReadIoWaitTime', 'WriteIoOps', 'WriteIoWaitTime',
> 'CumulativeAllocations', 'ReadIoOps', 'ReservationLimit', 'WriteIoBytes',
> 'PeakUnpinnedBytes', 'AllocTime', 'ReadIoBytes', 'CumulativeAllocationBytes',
> 'PeakReservation', 'PeakUsedReservation'])}, event_sequences=None,
> counters=[TCounter(value=0, name='AllocTime', unit=5), TCounter(value=0,
> name='CumulativeAllocationBytes', unit=3), TCounter(value=0,
> name='CumulativeAllocations', unit=0), TCounter(value=0,
> name='InactiveTotalTime', unit=5), TCounter(value=0, name='PeakReservation',
> unit=3), TCounter(value=0, name='PeakUnpinnedBytes', unit=3),
> TCounter(value=0, name='PeakUsedReservation', unit=3), TCounter(value=0,
> name='ReadIoBytes', unit=3), TCounter(value=0, name='ReadIoOps', unit=0),
> TCounter(value=0, name='ReadIoWaitTime', unit=5), TCounter(value=0,
> name='ReservationLimit', unit=3), TCounter(value=0, name='TotalTime',
> unit=5), TCounter(value=0, name='WriteIoBytes', unit=3), TCounter(value=0,
> name='WriteIoOps', unit=0), TCounter(value=0, name='WriteIoWaitTime',
> unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[],
> indent=True, name='Fragment Instance Lifecycle Timings',
> time_series_counters=None, info_strings={}, summary_stats_counters=None,
> num_children=0, child_counters_map={'': set(['ExecTime', 'OpenTime',
> 'PrepareTime']), 'ExecTime': set(['ExecTreeExecTime']), 'OpenTime':
> set(['ExecTreeOpenTime']), 'PrepareTime': set(['ExecTreePrepareTime'])},
> event_sequences=None, counters=[TCounter(value=999998, name='ExecTime',
> unit=5), TCounter(value=0, name='ExecTreeExecTime', unit=5),
> TCounter(value=906997944, name='ExecTreeOpenTime', unit=5),
> TCounter(value=10000977333, name='ExecTreePrepareTime', unit=5),
> TCounter(value=0, name='InactiveTotalTime', unit=5),
> TCounter(value=1177997330, name='OpenTime', unit=5),
> TCounter(value=10009977313, name='PrepareTime', unit=5), TCounter(value=0,
> name='TotalTime', unit=5)], metadata=-1),
> TRuntimeProfileNode(info_strings_display_order=[], indent=True,
> name='KrpcDataStreamSender (dst_id=4)',
> time_series_counters=[TTimeSeriesCounter(values=[0, 0, 0], name='BytesSent',
> unit=3, period_ms=500)], info_strings={}, summary_stats_counters=None,
> num_children=0, child_counters_map={'': set(['SerializeBatchTime',
> 'UncompressedRowBatchSize', 'RpcFailure', 'PeakMemoryUsage', 'RpcRetry',
> 'EosSent', 'NetworkThroughput', 'TotalBytesSent', 'RowsSent'])},
> event_sequences=None, counters=[TCounter(value=1, name='EosSent', unit=0),
> TCounter(value=999998, name='InactiveTotalTime', unit=5), TCounter(value=0,
> name='NetworkThroughput', unit=4), TCounter(value=7704,
> name='PeakMemoryUsage', unit=3), TCounter(value=0, name='RowsSent', unit=0),
> TCounter(value=0, name='RpcFailure', unit=0), TCounter(value=0,
> name='RpcRetry', unit=0), TCounter(value=0, name='SerializeBatchTime',
> unit=5), TCounter(value=0, name='TotalBytesSent', unit=3),
> TCounter(value=999998, name='TotalTime', unit=5), TCounter(value=0,
> name='UncompressedRowBatchSize', unit=3)], metadata=-1),
> TRuntimeProfileNode(info_strings_display_order=['ExecOption'], indent=True,
> name='AGGREGATION_NODE (id=3)', time_series_counters=None,
> info_strings={'ExecOption': 'Codegen Enabled'}, summary_stats_counters=None,
> num_children=2, child_counters_map={'': set(['LargestPartitionPercent',
> 'HTResizeTime', 'HashBuckets', 'BuildTime', 'RowsRepartitioned',
> 'PeakMemoryUsage', 'MaxPartitionLevel', 'SpilledPartitions',
> 'PartitionsCreated', 'RowsReturnedRate', 'RowsReturned', 'NumRepartitions',
> 'GetResultsTime'])}, event_sequences=None, counters=[TCounter(value=0,
> name='BuildTime', unit=5), TCounter(value=0, name='GetResultsTime', unit=5),
> TCounter(value=0, name='HTResizeTime', unit=5), TCounter(value=0,
> name='HashBuckets', unit=0), TCounter(value=0, name='InactiveTotalTime',
> unit=5), TCounter(value=0, name='LargestPartitionPercent', unit=0),
> TCounter(value=0, name='MaxPartitionLevel', unit=0), TCounter(value=0,
> name='NumRepartitions', unit=0), TCounter(value=16, name='PartitionsCreated',
> unit=0), TCounter(value=8938624, name='PeakMemoryUsage', unit=3),
> TCounter(value=0, name='RowsRepartitioned', unit=0), TCounter(value=0,
> name='RowsReturned', unit=0), TCounter(value=0, name='RowsReturnedRate',
> unit=1), TCounter(value=0, name='SpilledPartitions', unit=0),
> TCounter(value=10907975277, name='TotalTime', unit=5)], metadata=3),
> TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Buffer
> pool', time_series_counters=None, info_strings={},
> summary_stats_counters=None, num_children=0, child_counters_map={'':
> set(['ReadIoWaitTime', 'WriteIoOps', 'WriteIoWaitTime',
> 'CumulativeAllocations', 'ReadIoOps', 'WriteIoBytes', 'PeakUnpinnedBytes',
> 'AllocTime', 'ReadIoBytes', 'CumulativeAllocationBytes', 'PeakReservation',
> 'PeakUsedReservation'])}, event_sequences=None, counters=[TCounter(value=0,
> name='AllocTime', unit=5), TCounter(value=524288,
> name='CumulativeAllocationBytes', unit=3), TCounter(value=1,
> name='CumulativeAllocations', unit=0), TCounter(value=0,
> name='InactiveTotalTime', unit=5), TCounter(value=8912896,
> name='PeakReservation', unit=3), TCounter(value=0, name='PeakUnpinnedBytes',
> unit=3), TCounter(value=524288, name='PeakUsedReservation', unit=3),
> TCounter(value=0, name='ReadIoBytes', unit=3), TCounter(value=0,
> name='ReadIoOps', unit=0), TCounter(value=0, name='ReadIoWaitTime', unit=5),
> TCounter(value=0, name='TotalTime', unit=5), TCounter(value=0,
> name='WriteIoBytes', unit=3), TCounter(value=0, name='WriteIoOps', unit=0),
> TCounter(value=0, name='WriteIoWaitTime', unit=5)], metadata=-1),
> TRuntimeProfileNode(info_strings_display_order=[], indent=False,
> name='EXCHANGE_NODE (id=2)', time_series_counters=None, info_strings={},
> summary_stats_counters=None, num_children=3, child_counters_map={'':
> set(['RowsReturned', 'RowsReturnedRate', 'ConvertRowBatchTime',
> 'PeakMemoryUsage'])}, event_sequences=None, counters=[TCounter(value=0,
> name='ConvertRowBatchTime', unit=5), TCounter(value=902997954,
> name='InactiveTotalTime', unit=5), TCounter(value=0, name='PeakMemoryUsage',
> unit=3), TCounter(value=0, name='RowsReturned', unit=0), TCounter(value=0,
> name='RowsReturnedRate', unit=1), TCounter(value=902997954, name='TotalTime',
> unit=5)], metadata=2), TRuntimeProfileNode(info_strings_display_order=[],
> indent=True, name='Buffer pool', time_series_counters=None, info_strings={},
> summary_stats_counters=None, num_children=0, child_counters_map={'':
> set(['ReadIoWaitTime', 'WriteIoOps', 'WriteIoWaitTime',
> 'CumulativeAllocations', 'ReadIoOps', 'WriteIoBytes', 'PeakUnpinnedBytes',
> 'AllocTime', 'ReadIoBytes', 'CumulativeAllocationBytes', 'PeakReservation',
> 'PeakUsedReservation'])}, event_sequences=None, counters=[TCounter(value=0,
> name='AllocTime', unit=5), TCounter(value=0,
> name='CumulativeAllocationBytes', unit=3), TCounter(value=0,
> name='CumulativeAllocations', unit=0), TCounter(value=0,
> name='InactiveTotalTime', unit=5), TCounter(value=0, name='PeakReservation',
> unit=3), TCounter(value=0, name='PeakUnpinnedBytes', unit=3),
> TCounter(value=0, name='PeakUsedReservation', unit=3), TCounter(value=0,
> name='ReadIoBytes', unit=3), TCounter(value=0, name='ReadIoOps', unit=0),
> TCounter(value=0, name='ReadIoWaitTime', unit=5), TCounter(value=0,
> name='TotalTime', unit=5), TCounter(value=0, name='WriteIoBytes', unit=3),
> TCounter(value=0, name='WriteIoOps', unit=0), TCounter(value=0,
> name='WriteIoWaitTime', unit=5)], metadata=-1),
> TRuntimeProfileNode(info_strings_display_order=[], indent=True,
> name='Dequeue', time_series_counters=[TTimeSeriesCounter(values=[0, 0, 0],
> name='BytesDequeued', unit=3, period_ms=500)], info_strings={},
> summary_stats_counters=None, num_children=0, child_counters_map={'':
> set(['FirstBatchWaitTime', 'TotalGetBatchTime', 'TotalBytesDequeued']),
> 'TotalGetBatchTime': set(['DataWaitTime'])}, event_sequences=None,
> counters=[TCounter(value=902997954, name='DataWaitTime', unit=5),
> TCounter(value=902997954, name='FirstBatchWaitTime', unit=5),
> TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=0,
> name='TotalBytesDequeued', unit=3), TCounter(value=902997954,
> name='TotalGetBatchTime', unit=5), TCounter(value=0, name='TotalTime',
> unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[],
> indent=True, name='Enqueue',
> time_series_counters=[TTimeSeriesCounter(values=[0, 0, 0],
> name='BytesReceived', unit=3, period_ms=500), TTimeSeriesCounter(values=[0,
> 0, 0], name='DeferredQueueSize', unit=0, period_ms=500)], info_strings={},
> summary_stats_counters=[TSummaryStatsCounter(total_num_values=0,
> name='DispatchTime', max_value=-9223372036854775808L, sum=0,
> min_value=9223372036854775807L, unit=5)], num_children=0,
> child_counters_map={'': set(['TotalBatchesEnqueued',
> 'TotalHasDeferredRPCsTime', 'TotalEosReceived', 'DeserializeRowBatchTime',
> 'TotalRPCsDeferred', 'TotalBytesReceived', 'TotalEarlySenders',
> 'TotalBatchesReceived'])}, event_sequences=None, counters=[TCounter(value=0,
> name='DeserializeRowBatchTime', unit=5), TCounter(value=0,
> name='InactiveTotalTime', unit=5), TCounter(value=0,
> name='TotalBatchesEnqueued', unit=0), TCounter(value=0,
> name='TotalBatchesReceived', unit=0), TCounter(value=0,
> name='TotalBytesReceived', unit=3), TCounter(value=0,
> name='TotalEarlySenders', unit=0), TCounter(value=3, name='TotalEosReceived',
> unit=0), TCounter(value=0, name='TotalHasDeferredRPCsTime', unit=5),
> TCounter(value=0, name='TotalRPCsDeferred', unit=0), TCounter(value=0,
> name='TotalTime', unit=5)], metadata=-1),
> TRuntimeProfileNode(info_strings_display_order=[], indent=True,
> name='CodeGen', time_series_counters=None, info_strings={},
> summary_stats_counters=None, num_children=0, child_counters_map={'':
> set(['OptimizationTime', 'CompileTime', 'LoadTime', 'NumInstructions',
> 'PeakMemoryUsage', 'ModuleBitcodeSize', 'PrepareTime', 'NumFunctions',
> 'CodegenTime'])}, event_sequences=None, counters=[TCounter(value=6999984,
> name='CodegenTime', unit=5), TCounter(value=8999980, name='CompileTime',
> unit=5), TCounter(value=0, name='InactiveTotalTime', unit=5),
> TCounter(value=0, name='LoadTime', unit=5), TCounter(value=2370660,
> name='ModuleBitcodeSize', unit=3), TCounter(value=32, name='NumFunctions',
> unit=0), TCounter(value=573, name='NumInstructions', unit=0),
> TCounter(value=190999567, name='OptimizationTime', unit=5),
> TCounter(value=293376, name='PeakMemoryUsage', unit=3),
> TCounter(value=65999850, name='PrepareTime', unit=5),
> TCounter(value=265999397, name='TotalTime', unit=5)], metadata=-1),
> TRuntimeProfileNode(info_strings_display_order=[], indent=True,
> name='Instance a6461a30c2fb8bec:d4c89d2200000005
> (host=ec2-m2-4xlarge-centos-6-4-0bb5.vpc.cloudera.com:22000)',
> time_series_counters=[TTimeSeriesCounter(values=[0, 0, 0, 0, 0, 0, 0, 0, 0,
> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 36784, 36784], name='MemoryUsage', unit=3,
> period_ms=500), TTimeSeriesCounter(values=[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,
> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1], name='ThreadUsage', unit=0,
> period_ms=500)], info_strings={}, summary_stats_counters=None,
> num_children=5, child_counters_map={'': set(['TotalNetworkSendTime',
> 'PerHostPeakMemUsage', 'AverageThreadTokens', 'PeakMemoryUsage',
> 'TotalStorageWaitTime', 'TotalThreadsInvoluntaryContextSwitches',
> 'TotalThreadsTotalWallClockTime', 'RowsProduced',
> 'TotalThreadsVoluntaryContextSwitches', 'TotalNetworkReceiveTime',
> 'BloomFilterBytes', 'PeakReservation', 'PeakUsedReservation']),
> 'TotalThreadsTotalWallClockTime': set(['TotalThreadsUserTime',
> 'TotalThreadsSysTime'])},
> event_sequences=[TEventSequence(timestamps=[10012977307, 11187974643,
> 11187974643, 11187974643, 11188974641], labels=['Prepare Finished', 'Open
> Finished', 'First Batch Produced', 'First Batch Sent', 'ExecInternal
> Finished'], name='Fragment Instance Lifecycle Event Timeline')],
> counters=[TCounter(value=4607182418800017408, name='AverageThreadTokens',
> unit=6), TCounter(value=0, name='BloomFilterBytes', unit=3),
> TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=8957872,
> name='PeakMemoryUsage', unit=3), TCounter(value=8912896,
> name='PeakReservation', unit=3), TCounter(value=0,
> name='PeakUsedReservation', unit=3), TCounter(value=102539267,
> name='PerHostPeakMemUsage', unit=3), TCounter(value=0, name='RowsProduced',
> unit=0), TCounter(value=968997804, name='TotalNetworkReceiveTime', unit=5),
> TCounter(value=999998, name='TotalNetworkSendTime', unit=5),
> TCounter(value=0, name='TotalStorageWaitTime', unit=5), TCounter(value=182,
> name='TotalThreadsInvoluntaryContextSwitches', unit=0),
> TCounter(value=11998000, name='TotalThreadsSysTime', unit=5),
> TCounter(value=1175997334, name='TotalThreadsTotalWallClockTime', unit=5),
> TCounter(value=108984000, name='TotalThreadsUserTime', unit=5),
> TCounter(value=6, name='TotalThreadsVoluntaryContextSwitches', unit=0),
> TCounter(value=11186974645, name='TotalTime', unit=5)], metadata=-1),
> TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Buffer
> pool', time_series_counters=None, info_strings={},
> summary_stats_counters=None, num_children=0, child_counters_map={'':
> set(['ReadIoWaitTime', 'WriteIoOps', 'WriteIoWaitTime',
> 'CumulativeAllocations', 'ReadIoOps', 'ReservationLimit', 'WriteIoBytes',
> 'PeakUnpinnedBytes', 'AllocTime', 'ReadIoBytes', 'CumulativeAllocationBytes',
> 'PeakReservation', 'PeakUsedReservation'])}, event_sequences=None,
> counters=[TCounter(value=0, name='AllocTime', unit=5), TCounter(value=0,
> name='CumulativeAllocationBytes', unit=3), TCounter(value=0,
> name='CumulativeAllocations', unit=0), TCounter(value=0,
> name='InactiveTotalTime', unit=5), TCounter(value=0, name='PeakReservation',
> unit=3), TCounter(value=0, name='PeakUnpinnedBytes', unit=3),
> TCounter(value=0, name='PeakUsedReservation', unit=3), TCounter(value=0,
> name='ReadIoBytes', unit=3), TCounter(value=0, name='ReadIoOps', unit=0),
> TCounter(value=0, name='ReadIoWaitTime', unit=5), TCounter(value=0,
> name='ReservationLimit', unit=3), TCounter(value=0, name='TotalTime',
> unit=5), TCounter(value=0, name='WriteIoBytes', unit=3), TCounter(value=0,
> name='WriteIoOps', unit=0), TCounter(value=0, name='WriteIoWaitTime',
> unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[],
> indent=True, name='Fragment Instance Lifecycle Timings',
> time_series_counters=None, info_strings={}, summary_stats_counters=None,
> num_children=0, child_counters_map={'': set(['ExecTime', 'OpenTime',
> 'PrepareTime']), 'ExecTime': set(['ExecTreeExecTime']), 'OpenTime':
> set(['ExecTreeOpenTime']), 'PrepareTime': set(['ExecTreePrepareTime'])},
> event_sequences=None, counters=[TCounter(value=999998, name='ExecTime',
> unit=5), TCounter(value=0, name='ExecTreeExecTime', unit=5),
> TCounter(value=971997796, name='ExecTreeOpenTime', unit=5),
> TCounter(value=9999977335, name='ExecTreePrepareTime', unit=5),
> TCounter(value=0, name='InactiveTotalTime', unit=5),
> TCounter(value=1174997336, name='OpenTime', unit=5),
> TCounter(value=10010977311, name='PrepareTime', unit=5), TCounter(value=0,
> name='TotalTime', unit=5)], metadata=-1),
> TRuntimeProfileNode(info_strings_display_order=[], indent=True,
> name='KrpcDataStreamSender (dst_id=4)',
> time_series_counters=[TTimeSeriesCounter(values=[0, 0], name='BytesSent',
> unit=3, period_ms=500)], info_strings={}, summary_stats_counters=None,
> num_children=0, child_counters_map={'': set(['SerializeBatchTime',
> 'UncompressedRowBatchSize', 'RpcFailure', 'PeakMemoryUsage', 'RpcRetry',
> 'EosSent', 'NetworkThroughput', 'TotalBytesSent', 'RowsSent'])},
> event_sequences=None, counters=[TCounter(value=1, name='EosSent', unit=0),
> TCounter(value=999998, name='InactiveTotalTime', unit=5), TCounter(value=0,
> name='NetworkThroughput', unit=4), TCounter(value=7704,
> name='PeakMemoryUsage', unit=3), TCounter(value=0, name='RowsSent', unit=0),
> TCounter(value=0, name='RpcFailure', unit=0), TCounter(value=0,
> name='RpcRetry', unit=0), TCounter(value=0, name='SerializeBatchTime',
> unit=5), TCounter(value=0, name='TotalBytesSent', unit=3),
> TCounter(value=999998, name='TotalTime', unit=5), TCounter(value=0,
> name='UncompressedRowBatchSize', unit=3)], metadata=-1),
> TRuntimeProfileNode(info_strings_display_order=['ExecOption'], indent=True,
> name='AGGREGATION_NODE (id=3)', time_series_counters=None,
> info_strings={'ExecOption': 'Codegen Enabled'}, summary_stats_counters=None,
> num_children=2, child_counters_map={'': set(['LargestPartitionPercent',
> 'HTResizeTime', 'HashBuckets', 'BuildTime', 'RowsRepartitioned',
> 'PeakMemoryUsage', 'MaxPartitionLevel', 'SpilledPartitions',
> 'PartitionsCreated', 'RowsReturnedRate', 'RowsReturned', 'NumRepartitions',
> 'GetResultsTime'])}, event_sequences=None, counters=[TCounter(value=0,
> name='BuildTime', unit=5), TCounter(value=0, name='GetResultsTime', unit=5),
> TCounter(value=0, name='HTResizeTime', unit=5), TCounter(value=0,
> name='HashBuckets', unit=0), TCounter(value=0, name='InactiveTotalTime',
> unit=5), TCounter(value=0, name='LargestPartitionPercent', unit=0),
> TCounter(value=0, name='MaxPartitionLevel', unit=0), TCounter(value=0,
> name='NumRepartitions', unit=0), TCounter(value=16, name='PartitionsCreated',
> unit=0), TCounter(value=8938624, name='PeakMemoryUsage', unit=3),
> TCounter(value=0, name='RowsRepartitioned', unit=0), TCounter(value=0,
> name='RowsReturned', unit=0), TCounter(value=0, name='RowsReturnedRate',
> unit=1), TCounter(value=0, name='SpilledPartitions', unit=0),
> TCounter(value=10971975131, name='TotalTime', unit=5)], metadata=3),
> TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Buffer
> pool', time_series_counters=None, info_strings={},
> summary_stats_counters=None, num_children=0, child_counters_map={'':
> set(['ReadIoWaitTime', 'WriteIoOps', 'WriteIoWaitTime',
> 'CumulativeAllocations', 'ReadIoOps', 'WriteIoBytes', 'PeakUnpinnedBytes',
> 'AllocTime', 'ReadIoBytes', 'CumulativeAllocationBytes', 'PeakReservation',
> 'PeakUsedReservation'])}, event_sequences=None, counters=[TCounter(value=0,
> name='AllocTime', unit=5), TCounter(value=524288,
> name='CumulativeAllocationBytes', unit=3), TCounter(value=1,
> name='CumulativeAllocations', unit=0), TCounter(value=0,
> name='InactiveTotalTime', unit=5), TCounter(value=8912896,
> name='PeakReservation', unit=3), TCounter(value=0, name='PeakUnpinnedBytes',
> unit=3), TCounter(value=524288, name='PeakUsedReservation', unit=3),
> TCounter(value=0, name='ReadIoBytes', unit=3), TCounter(value=0,
> name='ReadIoOps', unit=0), TCounter(value=0, name='ReadIoWaitTime', unit=5),
> TCounter(value=0, name='TotalTime', unit=5), TCounter(value=0,
> name='WriteIoBytes', unit=3), TCounter(value=0, name='WriteIoOps', unit=0),
> TCounter(value=0, name='WriteIoWaitTime', unit=5)], metadata=-1),
> TRuntimeProfileNode(info_strings_display_order=[], indent=False,
> name='EXCHANGE_NODE (id=2)', time_series_counters=None, info_strings={},
> summary_stats_counters=None, num_children=3, child_counters_map={'':
> set(['RowsReturned', 'RowsReturnedRate', 'ConvertRowBatchTime',
> 'PeakMemoryUsage'])}, event_sequences=None, counters=[TCounter(value=0,
> name='ConvertRowBatchTime', unit=5), TCounter(value=968997804,
> name='InactiveTotalTime', unit=5), TCounter(value=0, name='PeakMemoryUsage',
> unit=3), TCounter(value=0, name='RowsReturned', unit=0), TCounter(value=0,
> name='RowsReturnedRate', unit=1), TCounter(value=968997804, name='TotalTime',
> unit=5)], metadata=2), TRuntimeProfileNode(info_strings_display_order=[],
> indent=True, name='Buffer pool', time_series_counters=None, info_strings={},
> summary_stats_counters=None, num_children=0, child_counters_map={'':
> set(['ReadIoWaitTime', 'WriteIoOps', 'WriteIoWaitTime',
> 'CumulativeAllocations', 'ReadIoOps', 'WriteIoBytes', 'PeakUnpinnedBytes',
> 'AllocTime', 'ReadIoBytes', 'CumulativeAllocationBytes', 'PeakReservation',
> 'PeakUsedReservation'])}, event_sequences=None, counters=[TCounter(value=0,
> name='AllocTime', unit=5), TCounter(value=0,
> name='CumulativeAllocationBytes', unit=3), TCounter(value=0,
> name='CumulativeAllocations', unit=0), TCounter(value=0,
> name='InactiveTotalTime', unit=5), TCounter(value=0, name='PeakReservation',
> unit=3), TCounter(value=0, name='PeakUnpinnedBytes', unit=3),
> TCounter(value=0, name='PeakUsedReservation', unit=3), TCounter(value=0,
> name='ReadIoBytes', unit=3), TCounter(value=0, name='ReadIoOps', unit=0),
> TCounter(value=0, name='ReadIoWaitTime', unit=5), TCounter(value=0,
> name='TotalTime', unit=5), TCounter(value=0, name='WriteIoBytes', unit=3),
> TCounter(value=0, name='WriteIoOps', unit=0), TCounter(value=0,
> name='WriteIoWaitTime', unit=5)], metadata=-1),
> TRuntimeProfileNode(info_strings_display_order=[], indent=True,
> name='Dequeue', time_series_counters=[TTimeSeriesCounter(values=[0, 0],
> name='BytesDequeued', unit=3, period_ms=500)], info_strings={},
> summary_stats_counters=None, num_children=0, child_counters_map={'':
> set(['FirstBatchWaitTime', 'TotalGetBatchTime', 'TotalBytesDequeued']),
> 'TotalGetBatchTime': set(['DataWaitTime'])}, event_sequences=None,
> counters=[TCounter(value=968997804, name='DataWaitTime', unit=5),
> TCounter(value=968997804, name='FirstBatchWaitTime', unit=5),
> TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=0,
> name='TotalBytesDequeued', unit=3), TCounter(value=968997804,
> name='TotalGetBatchTime', unit=5), TCounter(value=0, name='TotalTime',
> unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[],
> indent=True, name='Enqueue',
> time_series_counters=[TTimeSeriesCounter(values=[0, 0], name='BytesReceived',
> unit=3, period_ms=500), TTimeSeriesCounter(values=[0, 0],
> name='DeferredQueueSize', unit=0, period_ms=500)], info_strings={},
> summary_stats_counters=[TSummaryStatsCounter(total_num_values=0,
> name='DispatchTime', max_value=-9223372036854775808L, sum=0,
> min_value=9223372036854775807L, unit=5)], num_children=0,
> child_counters_map={'': set(['TotalBatchesEnqueued',
> 'TotalHasDeferredRPCsTime', 'TotalEosReceived', 'DeserializeRowBatchTime',
> 'TotalRPCsDeferred', 'TotalBytesReceived', 'TotalEarlySenders',
> 'TotalBatchesReceived'])}, event_sequences=None, counters=[TCounter(value=0,
> name='DeserializeRowBatchTime', unit=5), TCounter(value=0,
> name='InactiveTotalTime', unit=5), TCounter(value=0,
> name='TotalBatchesEnqueued', unit=0), TCounter(value=0,
> name='TotalBatchesReceived', unit=0), TCounter(value=0,
> name='TotalBytesReceived', unit=3), TCounter(value=0,
> name='TotalEarlySenders', unit=0), TCounter(value=3, name='TotalEosReceived',
> unit=0), TCounter(value=0, name='TotalHasDeferredRPCsTime', unit=5),
> TCounter(value=0, name='TotalRPCsDeferred', unit=0), TCounter(value=0,
> name='TotalTime', unit=5)], metadata=-1),
> TRuntimeProfileNode(info_strings_display_order=[], indent=True,
> name='CodeGen', time_series_counters=None, info_strings={},
> summary_stats_counters=None, num_children=0, child_counters_map={'':
> set(['OptimizationTime', 'CompileTime', 'LoadTime', 'NumInstructions',
> 'PeakMemoryUsage', 'ModuleBitcodeSize', 'PrepareTime', 'NumFunctions',
> 'CodegenTime'])}, event_sequences=None, counters=[TCounter(value=9999978,
> name='CodegenTime', unit=5), TCounter(value=7999982, name='CompileTime',
> unit=5), TCounter(value=0, name='InactiveTotalTime', unit=5),
> TCounter(value=0, name='LoadTime', unit=5), TCounter(value=2370660,
> name='ModuleBitcodeSize', unit=3), TCounter(value=32, name='NumFunctions',
> unit=0), TCounter(value=573, name='NumInstructions', unit=0),
> TCounter(value=127999710, name='OptimizationTime', unit=5),
> TCounter(value=293376, name='PeakMemoryUsage', unit=3),
> TCounter(value=59999864, name='PrepareTime', unit=5),
> TCounter(value=196999554, name='TotalTime', unit=5)], metadata=-1),
> TRuntimeProfileNode(info_strings_display_order=[], indent=True,
> name='Instance a6461a30c2fb8bec:d4c89d2200000004
> (host=ec2-m2-4xlarge-centos-6-4-0bb5.vpc.cloudera.com:22002)',
> time_series_counters=[TTimeSeriesCounter(values=[0, 0, 0, 0, 0, 0, 0, 0, 0,
> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 36784, 36784], name='MemoryUsage', unit=3,
> period_ms=500), TTimeSeriesCounter(values=[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,
> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1], name='ThreadUsage', unit=0,
> period_ms=500)], info_strings={}, summary_stats_counters=None,
> num_children=5, child_counters_map={'': set(['TotalNetworkSendTime',
> 'PerHostPeakMemUsage', 'AverageThreadTokens', 'PeakMemoryUsage',
> 'TotalStorageWaitTime', 'TotalThreadsInvoluntaryContextSwitches',
> 'TotalThreadsTotalWallClockTime', 'RowsProduced',
> 'TotalThreadsVoluntaryContextSwitches', 'TotalNetworkReceiveTime',
> 'BloomFilterBytes', 'PeakReservation', 'PeakUsedReservation']),
> 'TotalThreadsTotalWallClockTime': set(['TotalThreadsUserTime',
> 'TotalThreadsSysTime'])},
> event_sequences=[TEventSequence(timestamps=[10006977319, 11185974647,
> 11185974647, 11185974647, 11186974645], labels=['Prepare Finished', 'Open
> Finished', 'First Batch Produced', 'First Batch Sent', 'ExecInternal
> Finished'], name='Fragment Instance Lifecycle Event Timeline')],
> counters=[TCounter(value=4607182418800017408, name='AverageThreadTokens',
> unit=6), TCounter(value=0, name='BloomFilterBytes', unit=3),
> TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=8957872,
> name='PeakMemoryUsage', unit=3), TCounter(value=8912896,
> name='PeakReservation', unit=3), TCounter(value=0,
> name='PeakUsedReservation', unit=3), TCounter(value=102486019,
> name='PerHostPeakMemUsage', unit=3), TCounter(value=0, name='RowsProduced',
> unit=0), TCounter(value=1008997714, name='TotalNetworkReceiveTime', unit=5),
> TCounter(value=999998, name='TotalNetworkSendTime', unit=5),
> TCounter(value=0, name='TotalStorageWaitTime', unit=5), TCounter(value=98,
> name='TotalThreadsInvoluntaryContextSwitches', unit=0),
> TCounter(value=10999000, name='TotalThreadsSysTime', unit=5),
> TCounter(value=1179997326, name='TotalThreadsTotalWallClockTime', unit=5),
> TCounter(value=108983000, name='TotalThreadsUserTime', unit=5),
> TCounter(value=2, name='TotalThreadsVoluntaryContextSwitches', unit=0),
> TCounter(value=11186974645, name='TotalTime', unit=5)], metadata=-1),
> TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Buffer
> pool', time_series_counters=None, info_strings={},
> summary_stats_counters=None, num_children=0, child_counters_map={'':
> set(['ReadIoWaitTime', 'WriteIoOps', 'WriteIoWaitTime',
> 'CumulativeAllocations', 'ReadIoOps', 'ReservationLimit', 'WriteIoBytes',
> 'PeakUnpinnedBytes', 'AllocTime', 'ReadIoBytes', 'CumulativeAllocationBytes',
> 'PeakReservation', 'PeakUsedReservation'])}, event_sequences=None,
> counters=[TCounter(value=0, name='AllocTime', unit=5), TCounter(value=0,
> name='CumulativeAllocationBytes', unit=3), TCounter(value=0,
> name='CumulativeAllocations', unit=0), TCounter(value=0,
> name='InactiveTotalTime', unit=5), TCounter(value=0, name='PeakReservation',
> unit=3), TCounter(value=0, name='PeakUnpinnedBytes', unit=3),
> TCounter(value=0, name='PeakUsedReservation', unit=3), TCounter(value=0,
> name='ReadIoBytes', unit=3), TCounter(value=0, name='ReadIoOps', unit=0),
> TCounter(value=0, name='ReadIoWaitTime', unit=5), TCounter(value=0,
> name='ReservationLimit', unit=3), TCounter(value=0, name='TotalTime',
> unit=5), TCounter(value=0, name='WriteIoBytes', unit=3), TCounter(value=0,
> name='WriteIoOps', unit=0), TCounter(value=0, name='WriteIoWaitTime',
> unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[],
> indent=True, name='Fragment Instance Lifecycle Timings',
> time_series_counters=None, info_strings={}, summary_stats_counters=None,
> num_children=0, child_counters_map={'': set(['ExecTime', 'OpenTime',
> 'PrepareTime']), 'ExecTime': set(['ExecTreeExecTime']), 'OpenTime':
> set(['ExecTreeOpenTime']), 'PrepareTime': set(['ExecTreePrepareTime'])},
> event_sequences=None, counters=[TCounter(value=999998, name='ExecTime',
> unit=5), TCounter(value=0, name='ExecTreeExecTime', unit=5),
> TCounter(value=1011997706, name='ExecTreeOpenTime', unit=5),
> TCounter(value=10000977333, name='ExecTreePrepareTime', unit=5),
> TCounter(value=0, name='InactiveTotalTime', unit=5),
> TCounter(value=1178997328, name='OpenTime', unit=5),
> TCounter(value=10006977319, name='PrepareTime', unit=5), TCounter(value=0,
> name='TotalTime', unit=5)], metadata=-1),
> TRuntimeProfileNode(info_strings_display_order=[], indent=True,
> name='KrpcDataStreamSender (dst_id=4)',
> time_series_counters=[TTimeSeriesCounter(values=[0, 0], name='BytesSent',
> unit=3, period_ms=500)], info_strings={}, summary_stats_counters=None,
> num_children=0, child_counters_map={'': set(['SerializeBatchTime',
> 'UncompressedRowBatchSize', 'RpcFailure', 'PeakMemoryUsage', 'RpcRetry',
> 'EosSent', 'NetworkThroughput', 'TotalBytesSent', 'RowsSent'])},
> event_sequences=None, counters=[TCounter(value=1, name='EosSent', unit=0),
> TCounter(value=999998, name='InactiveTotalTime', unit=5), TCounter(value=0,
> name='NetworkThroughput', unit=4), TCounter(value=7704,
> name='PeakMemoryUsage', unit=3), TCounter(value=0, name='RowsSent', unit=0),
> TCounter(value=0, name='RpcFailure', unit=0), TCounter(value=0,
> name='RpcRetry', unit=0), TCounter(value=0, name='SerializeBatchTime',
> unit=5), TCounter(value=0, name='TotalBytesSent', unit=3),
> TCounter(value=999998, name='TotalTime', unit=5), TCounter(value=0,
> name='UncompressedRowBatchSize', unit=3)], metadata=-1),
> TRuntimeProfileNode(info_strings_display_order=['ExecOption'], indent=True,
> name='AGGREGATION_NODE (id=3)', time_series_counters=None,
> info_strings={'ExecOption': 'Codegen Enabled'}, summary_stats_counters=None,
> num_children=2, child_counters_map={'': set(['LargestPartitionPercent',
> 'HTResizeTime', 'HashBuckets', 'BuildTime', 'RowsRepartitioned',
> 'PeakMemoryUsage', 'MaxPartitionLevel', 'SpilledPartitions',
> 'PartitionsCreated', 'RowsReturnedRate', 'RowsReturned', 'NumRepartitions',
> 'GetResultsTime'])}, event_sequences=None, counters=[TCounter(value=0,
> name='BuildTime', unit=5), TCounter(value=0, name='GetResultsTime', unit=5),
> TCounter(value=0, name='HTResizeTime', unit=5), TCounter(value=0,
> name='HashBuckets', unit=0), TCounter(value=0, name='InactiveTotalTime',
> unit=5), TCounter(value=0, name='LargestPartitionPercent', unit=0),
> TCounter(value=0, name='MaxPartitionLevel', unit=0), TCounter(value=0,
> name='NumRepartitions', unit=0), TCounter(value=16, name='PartitionsCreated',
> unit=0), TCounter(value=8938624, name='PeakMemoryUsage', unit=3),
> TCounter(value=0, name='RowsRepartitioned', unit=0), TCounter(value=0,
> name='RowsReturned', unit=0), TCounter(value=0, name='RowsReturnedRate',
> unit=1), TCounter(value=0, name='SpilledPartitions', unit=0),
> TCounter(value=11012975039, name='TotalTime', unit=5)], metadata=3),
> TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Buffer
> pool', time_series_counters=None, info_strings={},
> summary_stats_counters=None, num_children=0, child_counters_map={'':
> set(['ReadIoWaitTime', 'WriteIoOps', 'WriteIoWaitTime',
> 'CumulativeAllocations', 'ReadIoOps', 'WriteIoBytes', 'PeakUnpinnedBytes',
> 'AllocTime', 'ReadIoBytes', 'CumulativeAllocationBytes', 'PeakReservation',
> 'PeakUsedReservation'])}, event_sequences=None, counters=[TCounter(value=0,
> name='AllocTime', unit=5), TCounter(value=524288,
> name='CumulativeAllocationBytes', unit=3), TCounter(value=1,
> name='CumulativeAllocations', unit=0), TCounter(value=0,
> name='InactiveTotalTime', unit=5), TCounter(value=8912896,
> name='PeakReservation', unit=3), TCounter(value=0, name='PeakUnpinnedBytes',
> unit=3), TCounter(value=524288, name='PeakUsedReservation', unit=3),
> TCounter(value=0, name='ReadIoBytes', unit=3), TCounter(value=0,
> name='ReadIoOps', unit=0), TCounter(value=0, name='ReadIoWaitTime', unit=5),
> TCounter(value=0, name='TotalTime', unit=5), TCounter(value=0,
> name='WriteIoBytes', unit=3), TCounter(value=0, name='WriteIoOps', unit=0),
> TCounter(value=0, name='WriteIoWaitTime', unit=5)], metadata=-1),
> TRuntimeProfileNode(info_strings_display_order=[], indent=False,
> name='EXCHANGE_NODE (id=2)', time_series_counters=None, info_strings={},
> summary_stats_counters=None, num_children=3, child_counters_map={'':
> set(['RowsReturned', 'RowsReturnedRate', 'ConvertRowBatchTime',
> 'PeakMemoryUsage'])}, event_sequences=None, counters=[TCounter(value=0,
> name='ConvertRowBatchTime', unit=5), TCounter(value=1008997714,
> name='InactiveTotalTime', unit=5), TCounter(value=0, name='PeakMemoryUsage',
> unit=3), TCounter(value=0, name='RowsReturned', unit=0), TCounter(value=0,
> name='RowsReturnedRate', unit=1), TCounter(value=1008997714,
> name='TotalTime', unit=5)], metadata=2),
> TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Buffer
> pool', time_series_counters=None, info_strings={},
> summary_stats_counters=None, num_children=0, child_counters_map={'':
> set(['ReadIoWaitTime', 'WriteIoOps', 'WriteIoWaitTime',
> 'CumulativeAllocations', 'ReadIoOps', 'WriteIoBytes', 'PeakUnpinnedBytes',
> 'AllocTime', 'ReadIoBytes', 'CumulativeAllocationBytes', 'PeakReservation',
> 'PeakUsedReservation'])}, event_sequences=None, counters=[TCounter(value=0,
> name='AllocTime', unit=5), TCounter(value=0,
> name='CumulativeAllocationBytes', unit=3), TCounter(value=0,
> name='CumulativeAllocations', unit=0), TCounter(value=0,
> name='InactiveTotalTime', unit=5), TCounter(value=0, name='PeakReservation',
> unit=3), TCounter(value=0, name='PeakUnpinnedBytes', unit=3),
> TCounter(value=0, name='PeakUsedReservation', unit=3), TCounter(value=0,
> name='ReadIoBytes', unit=3), TCounter(value=0, name='ReadIoOps', unit=0),
> TCounter(value=0, name='ReadIoWaitTime', unit=5), TCounter(value=0,
> name='TotalTime', unit=5), TCounter(value=0, name='WriteIoBytes', unit=3),
> TCounter(value=0, name='WriteIoOps', unit=0), TCounter(value=0,
> name='WriteIoWaitTime', unit=5)], metadata=-1),
> TRuntimeProfileNode(info_strings_display_order=[], indent=True,
> name='Dequeue', time_series_counters=[TTimeSeriesCounter(values=[0, 0],
> name='BytesDequeued', unit=3, period_ms=500)], info_strings={},
> summary_stats_counters=None, num_children=0, child_counters_map={'':
> set(['FirstBatchWaitTime', 'TotalGetBatchTime', 'TotalBytesDequeued']),
> 'TotalGetBatchTime': set(['DataWaitTime'])}, event_sequences=None,
> counters=[TCounter(value=1008997714, name='DataWaitTime', unit=5),
> TCounter(value=1008997714, name='FirstBatchWaitTime', unit=5),
> TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=0,
> name='TotalBytesDequeued', unit=3), TCounter(value=1008997714,
> name='TotalGetBatchTime', unit=5), TCounter(value=0, name='TotalTime',
> unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[],
> indent=True, name='Enqueue',
> time_series_counters=[TTimeSeriesCounter(values=[0, 0], name='BytesReceived',
> unit=3, period_ms=500), TTimeSeriesCounter(values=[0, 0],
> name='DeferredQueueSize', unit=0, period_ms=500)], info_strings={},
> summary_stats_counters=[TSummaryStatsCounter(total_num_values=0,
> name='DispatchTime', max_value=-9223372036854775808L, sum=0,
> min_value=9223372036854775807L, unit=5)], num_children=0,
> child_counters_map={'': set(['TotalBatchesEnqueued',
> 'TotalHasDeferredRPCsTime', 'TotalEosReceived', 'DeserializeRowBatchTime',
> 'TotalRPCsDeferred', 'TotalBytesReceived', 'TotalEarlySenders',
> 'TotalBatchesReceived'])}, event_sequences=None, counters=[TCounter(value=0,
> name='DeserializeRowBatchTime', unit=5), TCounter(value=0,
> name='InactiveTotalTime', unit=5), TCounter(value=0,
> name='TotalBatchesEnqueued', unit=0), TCounter(value=0,
> name='TotalBatchesReceived', unit=0), TCounter(value=0,
> name='TotalBytesReceived', unit=3), TCounter(value=0,
> name='TotalEarlySenders', unit=0), TCounter(value=3, name='TotalEosReceived',
> unit=0), TCounter(value=0, name='TotalHasDeferredRPCsTime', unit=5),
> TCounter(value=0, name='TotalRPCsDeferred', unit=0), TCounter(value=0,
> name='TotalTime', unit=5)], metadata=-1),
> TRuntimeProfileNode(info_strings_display_order=[], indent=True,
> name='CodeGen', time_series_counters=None, info_strings={},
> summary_stats_counters=None, num_children=0, child_counters_map={'':
> set(['OptimizationTime', 'CompileTime', 'LoadTime', 'NumInstructions',
> 'PeakMemoryUsage', 'ModuleBitcodeSize', 'PrepareTime', 'NumFunctions',
> 'CodegenTime'])}, event_sequences=None, counters=[TCounter(value=7999982,
> name='CodegenTime', unit=5), TCounter(value=7999982, name='CompileTime',
> unit=5), TCounter(value=0, name='InactiveTotalTime', unit=5),
> TCounter(value=0, name='LoadTime', unit=5), TCounter(value=2370660,
> name='ModuleBitcodeSize', unit=3), TCounter(value=32, name='NumFunctions',
> unit=0), TCounter(value=573, name='NumInstructions', unit=0),
> TCounter(value=108999752, name='OptimizationTime', unit=5),
> TCounter(value=293376, name='PeakMemoryUsage', unit=3),
> TCounter(value=43999902, name='PrepareTime', unit=5),
> TCounter(value=160999636, name='TotalTime', unit=5)], metadata=-1),
> TRuntimeProfileNode(info_strings_display_order=['split sizes', 'completion
> times', 'execution rates', 'num instances'], indent=True, name='Averaged
> Fragment F00', time_series_counters=None, info_strings={'completion times':
> 'min:10s818ms max:11s187ms mean: 11s059ms stddev:170.082ms', 'split
> sizes': ' min: 224.00 MB, max: 256.00 MB, avg: 239.65 MB, stddev: 13.07 MB',
> 'execution rates': 'min:20.05 MB/sec max:22.88 MB/sec mean:21.67 MB/sec
> stddev:1.19 MB/sec', 'num instances': '3'}, summary_stats_counters=None,
> num_children=5, child_counters_map={'': set(['TotalNetworkSendTime',
> 'PerHostPeakMemUsage', 'AverageThreadTokens', 'PeakMemoryUsage',
> 'TotalStorageWaitTime', 'TotalThreadsInvoluntaryContextSwitches',
> 'TotalThreadsTotalWallClockTime', 'RowsProduced',
> 'TotalThreadsVoluntaryContextSwitches', 'TotalNetworkReceiveTime',
> 'BloomFilterBytes', 'PeakReservation', 'PeakUsedReservation']),
> 'TotalThreadsTotalWallClockTime': set(['TotalThreadsUserTime',
> 'TotalThreadsSysTime'])}, event_sequences=None,
> counters=[TCounter(value=4620083081510138611L, name='AverageThreadTokens',
> unit=6), TCounter(value=0, name='BloomFilterBytes', unit=3),
> TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=99200685,
> name='PeakMemoryUsage', unit=3), TCounter(value=17825792,
> name='PeakReservation', unit=3), TCounter(value=0,
> name='PeakUsedReservation', unit=3), TCounter(value=108113581,
> name='PerHostPeakMemUsage', unit=3), TCounter(value=0, name='RowsProduced',
> unit=0), TCounter(value=0, name='TotalNetworkReceiveTime', unit=5),
> TCounter(value=2666660, name='TotalNetworkSendTime', unit=5),
> TCounter(value=68093845668, name='TotalStorageWaitTime', unit=5),
> TCounter(value=2193, name='TotalThreadsInvoluntaryContextSwitches', unit=0),
> TCounter(value=38990000, name='TotalThreadsSysTime', unit=5),
> TCounter(value=82459479779, name='TotalThreadsTotalWallClockTime', unit=5),
> TCounter(value=2979543333, name='TotalThreadsUserTime', unit=5),
> TCounter(value=131, name='TotalThreadsVoluntaryContextSwitches', unit=0),
> TCounter(value=11056308275, name='TotalTime', unit=5)], metadata=-1),
> TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Buffer
> pool', time_series_counters=None, info_strings={},
> summary_stats_counters=None, num_children=0, child_counters_map={'':
> set(['ReadIoWaitTime', 'WriteIoOps', 'WriteIoWaitTime',
> 'CumulativeAllocations', 'ReadIoOps', 'ReservationLimit', 'WriteIoBytes',
> 'PeakUnpinnedBytes', 'AllocTime', 'ReadIoBytes', 'CumulativeAllocationBytes',
> 'PeakReservation', 'PeakUsedReservation'])}, event_sequences=None,
> counters=[TCounter(value=0, name='AllocTime', unit=5), TCounter(value=0,
> name='CumulativeAllocationBytes', unit=3), TCounter(value=0,
> name='CumulativeAllocations', unit=0), TCounter(value=0,
> name='InactiveTotalTime', unit=5), TCounter(value=0, name='PeakReservation',
> unit=3), TCounter(value=0, name='PeakUnpinnedBytes', unit=3),
> TCounter(value=0, name='PeakUsedReservation', unit=3), TCounter(value=0,
> name='ReadIoBytes', unit=3), TCounter(value=0, name='ReadIoOps', unit=0),
> TCounter(value=0, name='ReadIoWaitTime', unit=5), TCounter(value=0,
> name='ReservationLimit', unit=3), TCounter(value=0, name='TotalTime',
> unit=5), TCounter(value=0, name='WriteIoBytes', unit=3), TCounter(value=0,
> name='WriteIoOps', unit=0), TCounter(value=0, name='WriteIoWaitTime',
> unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[],
> indent=True, name='Fragment Instance Lifecycle Timings',
> time_series_counters=None, info_strings={}, summary_stats_counters=None,
> num_children=0, child_counters_map={'': set(['ExecTime', 'OpenTime',
> 'PrepareTime']), 'ExecTime': set(['ExecTreeExecTime']), 'OpenTime':
> set(['ExecTreeOpenTime']), 'PrepareTime': set(['ExecTreePrepareTime'])},
> event_sequences=None, counters=[TCounter(value=10778975570, name='ExecTime',
> unit=5), TCounter(value=10776308910, name='ExecTreeExecTime', unit=5),
> TCounter(value=2333327, name='ExecTreeOpenTime', unit=5),
> TCounter(value=333332, name='ExecTreePrepareTime', unit=5), TCounter(value=0,
> name='InactiveTotalTime', unit=5), TCounter(value=275332709, name='OpenTime',
> unit=5), TCounter(value=1999995, name='PrepareTime', unit=5),
> TCounter(value=0, name='TotalTime', unit=5)], metadata=-1),
> TRuntimeProfileNode(info_strings_display_order=[], indent=True,
> name='KrpcDataStreamSender (dst_id=2)', time_series_counters=None,
> info_strings={}, summary_stats_counters=None, num_children=0,
> child_counters_map={'': set(['SerializeBatchTime',
> 'UncompressedRowBatchSize', 'RpcFailure', 'PeakMemoryUsage', 'RpcRetry',
> 'EosSent', 'NetworkThroughput', 'TotalBytesSent', 'RowsSent'])},
> event_sequences=None, counters=[TCounter(value=3, name='EosSent', unit=0),
> TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=0,
> name='NetworkThroughput', unit=4), TCounter(value=23112,
> name='PeakMemoryUsage', unit=3), TCounter(value=0, name='RowsSent', unit=0),
> TCounter(value=0, name='RpcFailure', unit=0), TCounter(value=0,
> name='RpcRetry', unit=0), TCounter(value=0, name='SerializeBatchTime',
> unit=5), TCounter(value=0, name='TotalBytesSent', unit=3),
> TCounter(value=2666660, name='TotalTime', unit=5), TCounter(value=0,
> name='UncompressedRowBatchSize', unit=3)], metadata=-1),
> TRuntimeProfileNode(info_strings_display_order=[], indent=True,
> name='AGGREGATION_NODE (id=1)', time_series_counters=None, info_strings={},
> summary_stats_counters=None, num_children=2, child_counters_map={'':
> set(['LargestPartitionPercent', 'HTResizeTime', 'StreamingTime',
> 'HashBuckets', 'PeakMemoryUsage', 'PartitionsCreated', 'RowsPassedThrough',
> 'RowsReturnedRate', 'RowsReturned', 'ReductionFactorEstimate',
> 'ReductionFactorThresholdToExpand', 'GetResultsTime'])},
> event_sequences=None, counters=[TCounter(value=0, name='GetResultsTime',
> unit=5), TCounter(value=0, name='HTResizeTime', unit=5), TCounter(value=0,
> name='HashBuckets', unit=0), TCounter(value=0, name='InactiveTotalTime',
> unit=5), TCounter(value=0, name='LargestPartitionPercent', unit=0),
> TCounter(value=16, name='PartitionsCreated', unit=0),
> TCounter(value=17891456, name='PeakMemoryUsage', unit=3), TCounter(value=0,
> name='ReductionFactorEstimate', unit=6), TCounter(value=0,
> name='ReductionFactorThresholdToExpand', unit=6), TCounter(value=0,
> name='RowsPassedThrough', unit=0), TCounter(value=0, name='RowsReturned',
> unit=0), TCounter(value=0, name='RowsReturnedRate', unit=1),
> TCounter(value=0, name='StreamingTime', unit=5), TCounter(value=10778975570,
> name='TotalTime', unit=5)], metadata=1),
> TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Buffer
> pool', time_series_counters=None, info_strings={},
> summary_stats_counters=None, num_children=0, child_counters_map={'':
> set(['ReadIoWaitTime', 'WriteIoOps', 'WriteIoWaitTime',
> 'CumulativeAllocations', 'ReadIoOps', 'WriteIoBytes', 'PeakUnpinnedBytes',
> 'AllocTime', 'ReadIoBytes', 'CumulativeAllocationBytes', 'PeakReservation',
> 'PeakUsedReservation'])}, event_sequences=None, counters=[TCounter(value=0,
> name='AllocTime', unit=5), TCounter(value=1048576,
> name='CumulativeAllocationBytes', unit=3), TCounter(value=1,
> name='CumulativeAllocations', unit=0), TCounter(value=0,
> name='InactiveTotalTime', unit=5), TCounter(value=17825792,
> name='PeakReservation', unit=3), TCounter(value=0, name='PeakUnpinnedBytes',
> unit=3), TCounter(value=1048576, name='PeakUsedReservation', unit=3),
> TCounter(value=0, name='ReadIoBytes', unit=3), TCounter(value=0,
> name='ReadIoOps', unit=0), TCounter(value=0, name='ReadIoWaitTime', unit=5),
> TCounter(value=0, name='TotalTime', unit=5), TCounter(value=0,
> name='WriteIoBytes', unit=3), TCounter(value=0, name='WriteIoOps', unit=0),
> TCounter(value=0, name='WriteIoWaitTime', unit=5)], metadata=-1),
> TRuntimeProfileNode(info_strings_display_order=[], indent=False,
> name='HDFS_SCAN_NODE (id=0)', time_series_counters=None, info_strings={},
> summary_stats_counters=None, num_children=0, child_counters_map={'':
> set(['CachedFileHandlesHitCount', 'BytesReadRemoteUnexpected',
> 'ScanRangesComplete', 'RowsReturned', 'TotalReadThroughput',
> 'ScannerThreadsTotalWallClockTime', 'CachedFileHandlesMissCount',
> 'TotalRawHdfsOpenFileTime(*)', 'ScannerThreadsInvoluntaryContextSwitches',
> 'NumDisksAccessed', 'RowBatchQueueGetWaitTime', 'RowsReturnedRate',
> 'TotalRawHdfsReadTime(*)', 'AverageHdfsReadThreadConcurrency',
> 'ScannerThreadsVoluntaryContextSwitches', 'AverageScannerThreadConcurrency',
> 'CollectionItemsRead', 'NumScannerThreadsStarted', 'BytesReadLocal',
> 'DecompressionTime', 'PerReadThreadRawHdfsThroughput', 'RemoteScanRanges',
> 'MaxCompressedTextFileLength', 'PeakMemoryUsage', 'RowBatchQueuePutWaitTime',
> 'BytesReadShortCircuit', 'BytesReadDataNodeCache', 'BytesRead', 'RowsRead']),
> 'ScannerThreadsTotalWallClockTime': set(['DelimiterParseTime',
> 'MaterializeTupleTime(*)', 'ScannerThreadsUserTime',
> 'ScannerThreadsSysTime'])}, event_sequences=None,
> counters=[TCounter(value=4618958876916537987L,
> name='AverageHdfsReadThreadConcurrency', unit=6),
> TCounter(value=4619187143780767984L, name='AverageScannerThreadConcurrency',
> unit=6), TCounter(value=251767954, name='BytesRead', unit=3),
> TCounter(value=0, name='BytesReadDataNodeCache', unit=3), TCounter(value=0,
> name='BytesReadLocal', unit=3), TCounter(value=0,
> name='BytesReadRemoteUnexpected', unit=3), TCounter(value=0,
> name='BytesReadShortCircuit', unit=3), TCounter(value=0,
> name='CachedFileHandlesHitCount', unit=0), TCounter(value=15,
> name='CachedFileHandlesMissCount', unit=0), TCounter(value=0,
> name='CollectionItemsRead', unit=0), TCounter(value=0,
> name='DecompressionTime', unit=5), TCounter(value=3047993095,
> name='DelimiterParseTime', unit=5), TCounter(value=0,
> name='InactiveTotalTime', unit=5), TCounter(value=115333069,
> name='MaterializeTupleTime(*)', unit=5), TCounter(value=0,
> name='MaxCompressedTextFileLength', unit=3), TCounter(value=1,
> name='NumDisksAccessed', unit=0), TCounter(value=7,
> name='NumScannerThreadsStarted', unit=0), TCounter(value=81308330,
> name='PeakMemoryUsage', unit=3), TCounter(value=3680821,
> name='PerReadThreadRawHdfsThroughput', unit=4), TCounter(value=0,
> name='RemoteScanRanges', unit=0), TCounter(value=10756642287,
> name='RowBatchQueueGetWaitTime', unit=5), TCounter(value=0,
> name='RowBatchQueuePutWaitTime', unit=5), TCounter(value=2000405,
> name='RowsRead', unit=0), TCounter(value=0, name='RowsReturned', unit=0),
> TCounter(value=0, name='RowsReturnedRate', unit=1), TCounter(value=7,
> name='ScanRangesComplete', unit=0), TCounter(value=1954,
> name='ScannerThreadsInvoluntaryContextSwitches', unit=0),
> TCounter(value=15660666, name='ScannerThreadsSysTime', unit=5),
> TCounter(value=71405504832, name='ScannerThreadsTotalWallClockTime', unit=5),
> TCounter(value=2743912333, name='ScannerThreadsUserTime', unit=5),
> TCounter(value=111, name='ScannerThreadsVoluntaryContextSwitches', unit=0),
> TCounter(value=1569329775, name='TotalRawHdfsOpenFileTime(*)', unit=5),
> TCounter(value=68714177598, name='TotalRawHdfsReadTime(*)', unit=5),
> TCounter(value=22364767, name='TotalReadThroughput', unit=4),
> TCounter(value=10775642244, name='TotalTime', unit=5)], metadata=0),
> TRuntimeProfileNode(info_strings_display_order=[], indent=True,
> name='CodeGen', time_series_counters=None, info_strings={},
> summary_stats_counters=None, num_children=0, child_counters_map={'':
> set(['OptimizationTime', 'CompileTime', 'LoadTime', 'NumInstructions',
> 'PeakMemoryUsage', 'ModuleBitcodeSize', 'PrepareTime', 'NumFunctions',
> 'CodegenTime'])}, event_sequences=None, counters=[TCounter(value=14666633,
> name='CodegenTime', unit=5), TCounter(value=19666622, name='CompileTime',
> unit=5), TCounter(value=0, name='InactiveTotalTime', unit=5),
> TCounter(value=0, name='LoadTime', unit=5), TCounter(value=2370660,
> name='ModuleBitcodeSize', unit=3), TCounter(value=63, name='NumFunctions',
> unit=0), TCounter(value=1352, name='NumInstructions', unit=0),
> TCounter(value=207666196, name='OptimizationTime', unit=5),
> TCounter(value=692224, name='PeakMemoryUsage', unit=3),
> TCounter(value=37333248, name='PrepareTime', unit=5),
> TCounter(value=265332731, name='TotalTime', unit=5)], metadata=-1),
> TRuntimeProfileNode(info_strings_display_order=[], indent=True,
> name='Fragment F00', time_series_counters=None, info_strings={},
> summary_stats_counters=None, num_children=3, child_counters_map={},
> event_sequences=None, counters=[TCounter(value=0, name='InactiveTotalTime',
> unit=5), TCounter(value=0, name='TotalTime', unit=5)], metadata=-1),
> TRuntimeProfileNode(info_strings_display_order=['Hdfs split stats (<volume
> id>:<# splits>/<split lengths>)'], indent=True, name='Instance
> a6461a30c2fb8bec:d4c89d2200000003
> (host=ec2-m2-4xlarge-centos-6-4-0bb5.vpc.cloudera.com:22001)',
> time_series_counters=[TTimeSeriesCounter(values=[48840, 85075971, 85084163,
> 85084163, 85101571, 85118979, 85153795, 85171203, 93577219, 85206019,
> 85206019, 85210115, 85210115, 85210115, 93598723, 85210115, 85210115,
> 85236739, 76913667, 68408323, 60085251, 34869251, 26310659],
> name='MemoryUsage', unit=3, period_ms=500), TTimeSeriesCounter(values=[1, 9,
> 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 7, 7, 4, 2],
> name='ThreadUsage', unit=0, period_ms=500)], info_strings={'Hdfs split stats
> (<volume id>:<# splits>/<split lengths>)': '-1:8/256.00 MB '},
> summary_stats_counters=None, num_children=5, child_counters_map={'':
> set(['TotalNetworkSendTime', 'PerHostPeakMemUsage', 'AverageThreadTokens',
> 'PeakMemoryUsage', 'TotalStorageWaitTime',
> 'TotalThreadsInvoluntaryContextSwitches', 'TotalThreadsTotalWallClockTime',
> 'RowsProduced', 'TotalThreadsVoluntaryContextSwitches',
> 'TotalNetworkReceiveTime', 'BloomFilterBytes', 'PeakReservation',
> 'PeakUsedReservation']), 'TotalThreadsTotalWallClockTime':
> set(['TotalThreadsUserTime', 'TotalThreadsSysTime'])},
> event_sequences=[TEventSequence(timestamps=[2999994, 273999379, 11182974655,
> 11182974655, 11186974645], labels=['Prepare Finished', 'Open Finished',
> 'First Batch Produced', 'First Batch Sent', 'ExecInternal Finished'],
> name='Fragment Instance Lifecycle Event Timeline')],
> counters=[TCounter(value=4620644265512266173L, name='AverageThreadTokens',
> unit=6), TCounter(value=0, name='BloomFilterBytes', unit=3),
> TCounter(value=0, name='InactiveTotalTime', unit=5),
> TCounter(value=110402563, name='PeakMemoryUsage', unit=3),
> TCounter(value=17825792, name='PeakReservation', unit=3), TCounter(value=0,
> name='PeakUsedReservation', unit=3), TCounter(value=119315459,
> name='PerHostPeakMemUsage', unit=3), TCounter(value=0, name='RowsProduced',
> unit=0), TCounter(value=0, name='TotalNetworkReceiveTime', unit=5),
> TCounter(value=3999990, name='TotalNetworkSendTime', unit=5),
> TCounter(value=76034827672, name='TotalStorageWaitTime', unit=5),
> TCounter(value=2343, name='TotalThreadsInvoluntaryContextSwitches', unit=0),
> TCounter(value=35989000, name='TotalThreadsSysTime', unit=5),
> TCounter(value=90734794356, name='TotalThreadsTotalWallClockTime', unit=5),
> TCounter(value=3187511000, name='TotalThreadsUserTime', unit=5),
> TCounter(value=138, name='TotalThreadsVoluntaryContextSwitches', unit=0),
> TCounter(value=11185974647, name='TotalTime', unit=5)], metadata=-1),
> TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Buffer
> pool', time_series_counters=None, info_strings={},
> summary_stats_counters=None, num_children=0, child_counters_map={'':
> set(['ReadIoWaitTime', 'WriteIoOps', 'WriteIoWaitTime',
> 'CumulativeAllocations', 'ReadIoOps', 'ReservationLimit', 'WriteIoBytes',
> 'PeakUnpinnedBytes', 'AllocTime', 'ReadIoBytes', 'CumulativeAllocationBytes',
> 'PeakReservation', 'PeakUsedReservation'])}, event_sequences=None,
> counters=[TCounter(value=0, name='AllocTime', unit=5), TCounter(value=0,
> name='CumulativeAllocationBytes', unit=3), TCounter(value=0,
> name='CumulativeAllocations', unit=0), TCounter(value=0,
> name='InactiveTotalTime', unit=5), TCounter(value=0, name='PeakReservation',
> unit=3), TCounter(value=0, name='PeakUnpinnedBytes', unit=3),
> TCounter(value=0, name='PeakUsedReservation', unit=3), TCounter(value=0,
> name='ReadIoBytes', unit=3), TCounter(value=0, name='ReadIoOps', unit=0),
> TCounter(value=0, name='ReadIoWaitTime', unit=5), TCounter(value=0,
> name='ReservationLimit', unit=3), TCounter(value=0, name='TotalTime',
> unit=5), TCounter(value=0, name='WriteIoBytes', unit=3), TCounter(value=0,
> name='WriteIoOps', unit=0), TCounter(value=0, name='WriteIoWaitTime',
> unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[],
> indent=True, name='Fragment Instance Lifecycle Timings',
> time_series_counters=None, info_strings={}, summary_stats_counters=None,
> num_children=0, child_counters_map={'': set(['ExecTime', 'OpenTime',
> 'PrepareTime']), 'ExecTime': set(['ExecTreeExecTime']), 'OpenTime':
> set(['ExecTreeOpenTime']), 'PrepareTime': set(['ExecTreePrepareTime'])},
> event_sequences=None, counters=[TCounter(value=10912975266, name='ExecTime',
> unit=5), TCounter(value=10908975276, name='ExecTreeExecTime', unit=5),
> TCounter(value=2999993, name='ExecTreeOpenTime', unit=5), TCounter(value=0,
> name='ExecTreePrepareTime', unit=5), TCounter(value=0,
> name='InactiveTotalTime', unit=5), TCounter(value=270999385, name='OpenTime',
> unit=5), TCounter(value=1999996, name='PrepareTime', unit=5),
> TCounter(value=0, name='TotalTime', unit=5)], metadata=-1),
> TRuntimeProfileNode(info_strings_display_order=[], indent=True,
> name='KrpcDataStreamSender (dst_id=2)',
> time_series_counters=[TTimeSeriesCounter(values=[0, 0, 0, 0, 0, 0, 0, 0, 0,
> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0], name='BytesSent', unit=3,
> period_ms=500)], info_strings={}, summary_stats_counters=None,
> num_children=0, child_counters_map={'': set(['SerializeBatchTime',
> 'UncompressedRowBatchSize', 'RpcFailure', 'PeakMemoryUsage', 'RpcRetry',
> 'EosSent', 'NetworkThroughput', 'TotalBytesSent', 'RowsSent'])},
> event_sequences=None, counters=[TCounter(value=3, name='EosSent', unit=0),
> TCounter(value=3999990, name='InactiveTotalTime', unit=5), TCounter(value=0,
> name='NetworkThroughput', unit=4), TCounter(value=23112,
> name='PeakMemoryUsage', unit=3), TCounter(value=0, name='RowsSent', unit=0),
> TCounter(value=0, name='RpcFailure', unit=0), TCounter(value=0,
> name='RpcRetry', unit=0), TCounter(value=0, name='SerializeBatchTime',
> unit=5), TCounter(value=0, name='TotalBytesSent', unit=3),
> TCounter(value=3999990, name='TotalTime', unit=5), TCounter(value=0,
> name='UncompressedRowBatchSize', unit=3)], metadata=-1),
> TRuntimeProfileNode(info_strings_display_order=['ExecOption'], indent=True,
> name='AGGREGATION_NODE (id=1)', time_series_counters=None,
> info_strings={'ExecOption': 'Streaming Preaggregation, Codegen Enabled'},
> summary_stats_counters=None, num_children=2, child_counters_map={'':
> set(['LargestPartitionPercent', 'HTResizeTime', 'StreamingTime',
> 'HashBuckets', 'PeakMemoryUsage', 'PartitionsCreated', 'RowsPassedThrough',
> 'RowsReturnedRate', 'RowsReturned', 'ReductionFactorEstimate',
> 'ReductionFactorThresholdToExpand', 'GetResultsTime'])},
> event_sequences=None, counters=[TCounter(value=0, name='GetResultsTime',
> unit=5), TCounter(value=0, name='HTResizeTime', unit=5), TCounter(value=0,
> name='HashBuckets', unit=0), TCounter(value=0, name='InactiveTotalTime',
> unit=5), TCounter(value=0, name='LargestPartitionPercent', unit=0),
> TCounter(value=16, name='PartitionsCreated', unit=0),
> TCounter(value=17891456, name='PeakMemoryUsage', unit=3), TCounter(value=0,
> name='ReductionFactorEstimate', unit=6), TCounter(value=0,
> name='ReductionFactorThresholdToExpand', unit=6), TCounter(value=0,
> name='RowsPassedThrough', unit=0), TCounter(value=0, name='RowsReturned',
> unit=0), TCounter(value=0, name='RowsReturnedRate', unit=1),
> TCounter(value=0, name='StreamingTime', unit=5), TCounter(value=10911975269,
> name='TotalTime', unit=5)], metadata=1),
> TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Buffer
> pool', time_series_counters=None, info_strings={},
> summary_stats_counters=None, num_children=0, child_counters_map={'':
> set(['ReadIoWaitTime', 'WriteIoOps', 'WriteIoWaitTime',
> 'CumulativeAllocations', 'ReadIoOps', 'WriteIoBytes', 'PeakUnpinnedBytes',
> 'AllocTime', 'ReadIoBytes', 'CumulativeAllocationBytes', 'PeakReservation',
> 'PeakUsedReservation'])}, event_sequences=None, counters=[TCounter(value=0,
> name='AllocTime', unit=5), TCounter(value=1048576,
> name='CumulativeAllocationBytes', unit=3), TCounter(value=1,
> name='CumulativeAllocations', unit=0), TCounter(value=0,
> name='InactiveTotalTime', unit=5), TCounter(value=17825792,
> name='PeakReservation', unit=3), TCounter(value=0, name='PeakUnpinnedBytes',
> unit=3), TCounter(value=1048576, name='PeakUsedReservation', unit=3),
> TCounter(value=0, name='ReadIoBytes', unit=3), TCounter(value=0,
> name='ReadIoOps', unit=0), TCounter(value=0, name='ReadIoWaitTime', unit=5),
> TCounter(value=0, name='TotalTime', unit=5), TCounter(value=0,
> name='WriteIoBytes', unit=3), TCounter(value=0, name='WriteIoOps', unit=0),
> TCounter(value=0, name='WriteIoWaitTime', unit=5)], metadata=-1),
> TRuntimeProfileNode(info_strings_display_order=['Hdfs split stats (<volume
> id>:<# splits>/<split lengths>)', 'ExecOption', 'Hdfs Read Thread Concurrency
> Bucket', 'File Formats'], indent=False, name='HDFS_SCAN_NODE (id=0)',
> time_series_counters=[TTimeSeriesCounter(values=[0, 0, 0, 0, 8388608,
> 16777216, 33554432, 41943040, 58720256, 75497472, 83886080, 100663296,
> 109051904, 125829120, 134217728, 134217728, 142606336, 176160768, 192937984,
> 201457664, 226623488, 243597312, 268894208], name='BytesRead', unit=3,
> period_ms=500)], info_strings={'Hdfs Read Thread Concurrency Bucket':
> '0:4.545% 1:0% 2:0% 3:4.545% 4:4.545% 5:0% 6:86.36% ', 'ExecOption': 'TEXT
> Codegen Enabled, Codegen enabled: 8 out of 8', 'File Formats': 'TEXT/NONE:8
> ', 'Hdfs split stats (<volume id>:<# splits>/<split lengths>)': '-1:8/256.00
> MB '}, summary_stats_counters=None, num_children=0, child_counters_map={'':
> set(['CachedFileHandlesHitCount', 'BytesReadRemoteUnexpected',
> 'ScanRangesComplete', 'RowsReturned', 'TotalReadThroughput',
> 'ScannerThreadsTotalWallClockTime', 'CachedFileHandlesMissCount',
> 'TotalRawHdfsOpenFileTime(*)', 'ScannerThreadsInvoluntaryContextSwitches',
> 'NumDisksAccessed', 'RowBatchQueueGetWaitTime', 'RowsReturnedRate',
> 'TotalRawHdfsReadTime(*)', 'AverageHdfsReadThreadConcurrency',
> 'ScannerThreadsVoluntaryContextSwitches', 'AverageScannerThreadConcurrency',
> 'CollectionItemsRead', 'NumScannerThreadsStarted', 'BytesReadLocal',
> 'DecompressionTime', 'PerReadThreadRawHdfsThroughput', 'RemoteScanRanges',
> 'MaxCompressedTextFileLength', 'PeakMemoryUsage', 'RowBatchQueuePutWaitTime',
> 'BytesReadShortCircuit', 'BytesReadDataNodeCache', 'BytesRead', 'RowsRead']),
> 'ScannerThreadsTotalWallClockTime': set(['DelimiterParseTime',
> 'MaterializeTupleTime(*)', 'ScannerThreadsUserTime',
> 'ScannerThreadsSysTime'])}, event_sequences=None,
> counters=[TCounter(value=4619618495043779119L,
> name='AverageHdfsReadThreadConcurrency', unit=6),
> TCounter(value=4619874381386243351L, name='AverageScannerThreadConcurrency',
> unit=6), TCounter(value=268959744, name='BytesRead', unit=3),
> TCounter(value=0, name='BytesReadDataNodeCache', unit=3), TCounter(value=0,
> name='BytesReadLocal', unit=3), TCounter(value=0,
> name='BytesReadRemoteUnexpected', unit=3), TCounter(value=0,
> name='BytesReadShortCircuit', unit=3), TCounter(value=0,
> name='CachedFileHandlesHitCount', unit=0), TCounter(value=16,
> name='CachedFileHandlesMissCount', unit=0), TCounter(value=0,
> name='CollectionItemsRead', unit=0), TCounter(value=0,
> name='DecompressionTime', unit=5), TCounter(value=3334992441,
> name='DelimiterParseTime', unit=5), TCounter(value=0,
> name='InactiveTotalTime', unit=5), TCounter(value=118999732,
> name='MaterializeTupleTime(*)', unit=5), TCounter(value=0,
> name='MaxCompressedTextFileLength', unit=3), TCounter(value=1,
> name='NumDisksAccessed', unit=0), TCounter(value=8,
> name='NumScannerThreadsStarted', unit=0), TCounter(value=92510208,
> name='PeakMemoryUsage', unit=3), TCounter(value=3510590,
> name='PerReadThreadRawHdfsThroughput', unit=4), TCounter(value=0,
> name='RemoteScanRanges', unit=0), TCounter(value=10903975287,
> name='RowBatchQueueGetWaitTime', unit=5), TCounter(value=0,
> name='RowBatchQueuePutWaitTime', unit=5), TCounter(value=2138019,
> name='RowsRead', unit=0), TCounter(value=0, name='RowsReturned', unit=0),
> TCounter(value=0, name='RowsReturnedRate', unit=1), TCounter(value=8,
> name='ScanRangesComplete', unit=0), TCounter(value=2159,
> name='ScannerThreadsInvoluntaryContextSwitches', unit=0),
> TCounter(value=13993000, name='ScannerThreadsSysTime', unit=5),
> TCounter(value=79550819705, name='ScannerThreadsTotalWallClockTime', unit=5),
> TCounter(value=2951547000, name='ScannerThreadsUserTime', unit=5),
> TCounter(value=118, name='ScannerThreadsVoluntaryContextSwitches', unit=0),
> TCounter(value=1802995915, name='TotalRawHdfsOpenFileTime(*)', unit=5),
> TCounter(value=76613826357, name='TotalRawHdfsReadTime(*)', unit=5),
> TCounter(value=23382105, name='TotalReadThroughput', unit=4),
> TCounter(value=10908975276, name='TotalTime', unit=5)], metadata=0),
> TRuntimeProfileNode(info_strings_display_order=[], indent=True,
> name='CodeGen', time_series_counters=None, info_strings={},
> summary_stats_counters=None, num_children=0, child_counters_map={'':
> set(['OptimizationTime', 'CompileTime', 'LoadTime', 'NumInstructions',
> 'PeakMemoryUsage', 'ModuleBitcodeSize', 'PrepareTime', 'NumFunctions',
> 'CodegenTime'])}, event_sequences=None, counters=[TCounter(value=11999974,
> name='CodegenTime', unit=5), TCounter(value=18999957, name='CompileTime',
> unit=5), TCounter(value=0, name='InactiveTotalTime', unit=5),
> TCounter(value=0, name='LoadTime', unit=5), TCounter(value=2370660,
> name='ModuleBitcodeSize', unit=3), TCounter(value=63, name='NumFunctions',
> unit=0), TCounter(value=1352, name='NumInstructions', unit=0),
> TCounter(value=209999525, name='OptimizationTime', unit=5),
> TCounter(value=692224, name='PeakMemoryUsage', unit=3),
> TCounter(value=31999924, name='PrepareTime', unit=5),
> TCounter(value=261999404, name='TotalTime', unit=5)], metadata=-1),
> TRuntimeProfileNode(info_strings_display_order=['Hdfs split stats (<volume
> id>:<# splits>/<split lengths>)'], indent=True, name='Instance
> a6461a30c2fb8bec:d4c89d2200000001
> (host=ec2-m2-4xlarge-centos-6-4-0bb5.vpc.cloudera.com:22002)',
> time_series_counters=[TTimeSeriesCounter(values=[741064, 76674051, 76674051,
> 76674051, 76691459, 76708867, 76708867, 76726275, 76743683, 85163011,
> 76795907, 76795907, 76795907, 85211139, 85211139, 85211139, 76822531,
> 68408323, 68434947, 60020739, 51697667, 34816003], name='MemoryUsage',
> unit=3, period_ms=500), TTimeSeriesCounter(values=[1, 8, 8, 8, 8, 8, 8, 8, 8,
> 8, 8, 8, 8, 8, 8, 8, 8, 7, 7, 6, 6, 4], name='ThreadUsage', unit=0,
> period_ms=500)], info_strings={'Hdfs split stats (<volume id>:<#
> splits>/<split lengths>)': '-1:7/224.00 MB '}, summary_stats_counters=None,
> num_children=5, child_counters_map={'': set(['TotalNetworkSendTime',
> 'PerHostPeakMemUsage', 'AverageThreadTokens', 'PeakMemoryUsage',
> 'TotalStorageWaitTime', 'TotalThreadsInvoluntaryContextSwitches',
> 'TotalThreadsTotalWallClockTime', 'RowsProduced',
> 'TotalThreadsVoluntaryContextSwitches', 'TotalNetworkReceiveTime',
> 'BloomFilterBytes', 'PeakReservation', 'PeakUsedReservation']),
> 'TotalThreadsTotalWallClockTime': set(['TotalThreadsUserTime',
> 'TotalThreadsSysTime'])},
> event_sequences=[TEventSequence(timestamps=[2999993, 286999350, 11166974691,
> 11166974691, 11168974687], labels=['Prepare Finished', 'Open Finished',
> 'First Batch Produced', 'First Batch Sent', 'ExecInternal Finished'],
> name='Fragment Instance Lifecycle Event Timeline')],
> counters=[TCounter(value=4619823204117750505L, name='AverageThreadTokens',
> unit=6), TCounter(value=0, name='BloomFilterBytes', unit=3),
> TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=93573123,
> name='PeakMemoryUsage', unit=3), TCounter(value=17825792,
> name='PeakReservation', unit=3), TCounter(value=0,
> name='PeakUsedReservation', unit=3), TCounter(value=102486019,
> name='PerHostPeakMemUsage', unit=3), TCounter(value=0, name='RowsProduced',
> unit=0), TCounter(value=0, name='TotalNetworkReceiveTime', unit=5),
> TCounter(value=1999996, name='TotalNetworkSendTime', unit=5),
> TCounter(value=66904848362, name='TotalStorageWaitTime', unit=5),
> TCounter(value=1985, name='TotalThreadsInvoluntaryContextSwitches', unit=0),
> TCounter(value=37991000, name='TotalThreadsSysTime', unit=5),
> TCounter(value=81285815773, name='TotalThreadsTotalWallClockTime', unit=5),
> TCounter(value=2780574000, name='TotalThreadsUserTime', unit=5),
> TCounter(value=125, name='TotalThreadsVoluntaryContextSwitches', unit=0),
> TCounter(value=11167974689, name='TotalTime', unit=5)], metadata=-1),
> TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Buffer
> pool', time_series_counters=None, info_strings={},
> summary_stats_counters=None, num_children=0, child_counters_map={'':
> set(['ReadIoWaitTime', 'WriteIoOps', 'WriteIoWaitTime',
> 'CumulativeAllocations', 'ReadIoOps', 'ReservationLimit', 'WriteIoBytes',
> 'PeakUnpinnedBytes', 'AllocTime', 'ReadIoBytes', 'CumulativeAllocationBytes',
> 'PeakReservation', 'PeakUsedReservation'])}, event_sequences=None,
> counters=[TCounter(value=0, name='AllocTime', unit=5), TCounter(value=0,
> name='CumulativeAllocationBytes', unit=3), TCounter(value=0,
> name='CumulativeAllocations', unit=0), TCounter(value=0,
> name='InactiveTotalTime', unit=5), TCounter(value=0, name='PeakReservation',
> unit=3), TCounter(value=0, name='PeakUnpinnedBytes', unit=3),
> TCounter(value=0, name='PeakUsedReservation', unit=3), TCounter(value=0,
> name='ReadIoBytes', unit=3), TCounter(value=0, name='ReadIoOps', unit=0),
> TCounter(value=0, name='ReadIoWaitTime', unit=5), TCounter(value=0,
> name='ReservationLimit', unit=3), TCounter(value=0, name='TotalTime',
> unit=5), TCounter(value=0, name='WriteIoBytes', unit=3), TCounter(value=0,
> name='WriteIoOps', unit=0), TCounter(value=0, name='WriteIoWaitTime',
> unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[],
> indent=True, name='Fragment Instance Lifecycle Timings',
> time_series_counters=None, info_strings={}, summary_stats_counters=None,
> num_children=0, child_counters_map={'': set(['ExecTime', 'OpenTime',
> 'PrepareTime']), 'ExecTime': set(['ExecTreeExecTime']), 'OpenTime':
> set(['ExecTreeOpenTime']), 'PrepareTime': set(['ExecTreePrepareTime'])},
> event_sequences=None, counters=[TCounter(value=10881975337, name='ExecTime',
> unit=5), TCounter(value=10879975341, name='ExecTreeExecTime', unit=5),
> TCounter(value=1999996, name='ExecTreeOpenTime', unit=5),
> TCounter(value=999998, name='ExecTreePrepareTime', unit=5), TCounter(value=0,
> name='InactiveTotalTime', unit=5), TCounter(value=283999357, name='OpenTime',
> unit=5), TCounter(value=1999995, name='PrepareTime', unit=5),
> TCounter(value=0, name='TotalTime', unit=5)], metadata=-1),
> TRuntimeProfileNode(info_strings_display_order=[], indent=True,
> name='KrpcDataStreamSender (dst_id=2)',
> time_series_counters=[TTimeSeriesCounter(values=[0, 0, 0, 0, 0, 0, 0, 0, 0,
> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0], name='BytesSent', unit=3,
> period_ms=500)], info_strings={}, summary_stats_counters=None,
> num_children=0, child_counters_map={'': set(['SerializeBatchTime',
> 'UncompressedRowBatchSize', 'RpcFailure', 'PeakMemoryUsage', 'RpcRetry',
> 'EosSent', 'NetworkThroughput', 'TotalBytesSent', 'RowsSent'])},
> event_sequences=None, counters=[TCounter(value=3, name='EosSent', unit=0),
> TCounter(value=1999996, name='InactiveTotalTime', unit=5), TCounter(value=0,
> name='NetworkThroughput', unit=4), TCounter(value=23112,
> name='PeakMemoryUsage', unit=3), TCounter(value=0, name='RowsSent', unit=0),
> TCounter(value=0, name='RpcFailure', unit=0), TCounter(value=0,
> name='RpcRetry', unit=0), TCounter(value=0, name='SerializeBatchTime',
> unit=5), TCounter(value=0, name='TotalBytesSent', unit=3),
> TCounter(value=1999996, name='TotalTime', unit=5), TCounter(value=0,
> name='UncompressedRowBatchSize', unit=3)], metadata=-1),
> TRuntimeProfileNode(info_strings_display_order=['ExecOption'], indent=True,
> name='AGGREGATION_NODE (id=1)', time_series_counters=None,
> info_strings={'ExecOption': 'Streaming Preaggregation, Codegen Enabled'},
> summary_stats_counters=None, num_children=2, child_counters_map={'':
> set(['LargestPartitionPercent', 'HTResizeTime', 'StreamingTime',
> 'HashBuckets', 'PeakMemoryUsage', 'PartitionsCreated', 'RowsPassedThrough',
> 'RowsReturnedRate', 'RowsReturned', 'ReductionFactorEstimate',
> 'ReductionFactorThresholdToExpand', 'GetResultsTime'])},
> event_sequences=None, counters=[TCounter(value=0, name='GetResultsTime',
> unit=5), TCounter(value=0, name='HTResizeTime', unit=5), TCounter(value=0,
> name='HashBuckets', unit=0), TCounter(value=0, name='InactiveTotalTime',
> unit=5), TCounter(value=0, name='LargestPartitionPercent', unit=0),
> TCounter(value=16, name='PartitionsCreated', unit=0),
> TCounter(value=17891456, name='PeakMemoryUsage', unit=3), TCounter(value=0,
> name='ReductionFactorEstimate', unit=6), TCounter(value=0,
> name='ReductionFactorThresholdToExpand', unit=6), TCounter(value=0,
> name='RowsPassedThrough', unit=0), TCounter(value=0, name='RowsReturned',
> unit=0), TCounter(value=0, name='RowsReturnedRate', unit=1),
> TCounter(value=0, name='StreamingTime', unit=5), TCounter(value=10882975335,
> name='TotalTime', unit=5)], metadata=1),
> TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Buffer
> pool', time_series_counters=None, info_strings={},
> summary_stats_counters=None, num_children=0, child_counters_map={'':
> set(['ReadIoWaitTime', 'WriteIoOps', 'WriteIoWaitTime',
> 'CumulativeAllocations', 'ReadIoOps', 'WriteIoBytes', 'PeakUnpinnedBytes',
> 'AllocTime', 'ReadIoBytes', 'CumulativeAllocationBytes', 'PeakReservation',
> 'PeakUsedReservation'])}, event_sequences=None, counters=[TCounter(value=0,
> name='AllocTime', unit=5), TCounter(value=1048576,
> name='CumulativeAllocationBytes', unit=3), TCounter(value=1,
> name='CumulativeAllocations', unit=0), TCounter(value=0,
> name='InactiveTotalTime', unit=5), TCounter(value=17825792,
> name='PeakReservation', unit=3), TCounter(value=0, name='PeakUnpinnedBytes',
> unit=3), TCounter(value=1048576, name='PeakUsedReservation', unit=3),
> TCounter(value=0, name='ReadIoBytes', unit=3), TCounter(value=0,
> name='ReadIoOps', unit=0), TCounter(value=0, name='ReadIoWaitTime', unit=5),
> TCounter(value=0, name='TotalTime', unit=5), TCounter(value=0,
> name='WriteIoBytes', unit=3), TCounter(value=0, name='WriteIoOps', unit=0),
> TCounter(value=0, name='WriteIoWaitTime', unit=5)], metadata=-1),
> TRuntimeProfileNode(info_strings_display_order=['Hdfs split stats (<volume
> id>:<# splits>/<split lengths>)', 'ExecOption', 'Hdfs Read Thread Concurrency
> Bucket', 'File Formats'], indent=False, name='HDFS_SCAN_NODE (id=0)',
> time_series_counters=[TTimeSeriesCounter(values=[0, 0, 0, 0, 8388608,
> 16777216, 16777216, 25165824, 41943040, 58720256, 67108864, 67108864,
> 83886080, 100663296, 109051904, 125829120, 134217728, 142671872, 151060480,
> 167903232, 184680448, 226754560], name='BytesRead', unit=3, period_ms=500)],
> info_strings={'Hdfs Read Thread Concurrency Bucket': '0:0% 1:4.762% 2:0% 3:0%
> 4:4.762% 5:4.762% 6:85.71% ', 'ExecOption': 'TEXT Codegen Enabled, Codegen
> enabled: 7 out of 7', 'File Formats': 'TEXT/NONE:7 ', 'Hdfs split stats
> (<volume id>:<# splits>/<split lengths>)': '-1:7/224.00 MB '},
> summary_stats_counters=None, num_children=0, child_counters_map={'':
> set(['CachedFileHandlesHitCount', 'BytesReadRemoteUnexpected',
> 'ScanRangesComplete', 'RowsReturned', 'TotalReadThroughput',
> 'ScannerThreadsTotalWallClockTime', 'CachedFileHandlesMissCount',
> 'TotalRawHdfsOpenFileTime(*)', 'ScannerThreadsInvoluntaryContextSwitches',
> 'NumDisksAccessed', 'RowBatchQueueGetWaitTime', 'RowsReturnedRate',
> 'TotalRawHdfsReadTime(*)', 'AverageHdfsReadThreadConcurrency',
> 'ScannerThreadsVoluntaryContextSwitches', 'AverageScannerThreadConcurrency',
> 'CollectionItemsRead', 'NumScannerThreadsStarted', 'BytesReadLocal',
> 'DecompressionTime', 'PerReadThreadRawHdfsThroughput', 'RemoteScanRanges',
> 'MaxCompressedTextFileLength', 'PeakMemoryUsage', 'RowBatchQueuePutWaitTime',
> 'BytesReadShortCircuit', 'BytesReadDataNodeCache', 'BytesRead', 'RowsRead']),
> 'ScannerThreadsTotalWallClockTime': set(['DelimiterParseTime',
> 'MaterializeTupleTime(*)', 'ScannerThreadsUserTime',
> 'ScannerThreadsSysTime'])}, event_sequences=None,
> counters=[TCounter(value=4618870332118669410L,
> name='AverageHdfsReadThreadConcurrency', unit=6),
> TCounter(value=4619031174962504070L, name='AverageScannerThreadConcurrency',
> unit=6), TCounter(value=235339776, name='BytesRead', unit=3),
> TCounter(value=0, name='BytesReadDataNodeCache', unit=3), TCounter(value=0,
> name='BytesReadLocal', unit=3), TCounter(value=0,
> name='BytesReadRemoteUnexpected', unit=3), TCounter(value=0,
> name='BytesReadShortCircuit', unit=3), TCounter(value=0,
> name='CachedFileHandlesHitCount', unit=0), TCounter(value=14,
> name='CachedFileHandlesMissCount', unit=0), TCounter(value=0,
> name='CollectionItemsRead', unit=0), TCounter(value=0,
> name='DecompressionTime', unit=5), TCounter(value=2783993692,
> name='DelimiterParseTime', unit=5), TCounter(value=0,
> name='InactiveTotalTime', unit=5), TCounter(value=113999742,
> name='MaterializeTupleTime(*)', unit=5), TCounter(value=0,
> name='MaxCompressedTextFileLength', unit=3), TCounter(value=1,
> name='NumDisksAccessed', unit=0), TCounter(value=7,
> name='NumScannerThreadsStarted', unit=0), TCounter(value=75680768,
> name='PeakMemoryUsage', unit=3), TCounter(value=3491229,
> name='PerReadThreadRawHdfsThroughput', unit=4), TCounter(value=0,
> name='RemoteScanRanges', unit=0), TCounter(value=10832975447,
> name='RowBatchQueueGetWaitTime', unit=5), TCounter(value=0,
> name='RowBatchQueuePutWaitTime', unit=5), TCounter(value=1869354,
> name='RowsRead', unit=0), TCounter(value=0, name='RowsReturned', unit=0),
> TCounter(value=0, name='RowsReturnedRate', unit=1), TCounter(value=7,
> name='ScanRangesComplete', unit=0), TCounter(value=1636,
> name='ScannerThreadsInvoluntaryContextSwitches', unit=0),
> TCounter(value=14995000, name='ScannerThreadsSysTime', unit=5),
> TCounter(value=70119841079, name='ScannerThreadsTotalWallClockTime', unit=5),
> TCounter(value=2539610000, name='ScannerThreadsUserTime', unit=5),
> TCounter(value=104, name='ScannerThreadsVoluntaryContextSwitches', unit=0),
> TCounter(value=1483996634, name='TotalRawHdfsOpenFileTime(*)', unit=5),
> TCounter(value=67408847225, name='TotalRawHdfsReadTime(*)', unit=5),
> TCounter(value=20612177, name='TotalReadThroughput', unit=4),
> TCounter(value=10879975341, name='TotalTime', unit=5)], metadata=0),
> TRuntimeProfileNode(info_strings_display_order=[], indent=True,
> name='CodeGen', time_series_counters=None, info_strings={},
> summary_stats_counters=None, num_children=0, child_counters_map={'':
> set(['OptimizationTime', 'CompileTime', 'LoadTime', 'NumInstructions',
> 'PeakMemoryUsage', 'ModuleBitcodeSize', 'PrepareTime', 'NumFunctions',
> 'CodegenTime'])}, event_sequences=None, counters=[TCounter(value=16999960,
> name='CodegenTime', unit=5), TCounter(value=18999957, name='CompileTime',
> unit=5), TCounter(value=0, name='InactiveTotalTime', unit=5),
> TCounter(value=0, name='LoadTime', unit=5), TCounter(value=2370660,
> name='ModuleBitcodeSize', unit=3), TCounter(value=63, name='NumFunctions',
> unit=0), TCounter(value=1352, name='NumInstructions', unit=0),
> TCounter(value=207999529, name='OptimizationTime', unit=5),
> TCounter(value=692224, name='PeakMemoryUsage', unit=3),
> TCounter(value=45999896, name='PrepareTime', unit=5),
> TCounter(value=273999379, name='TotalTime', unit=5)], metadata=-1),
> TRuntimeProfileNode(info_strings_display_order=['Hdfs split stats (<volume
> id>:<# splits>/<split lengths>)'], indent=True, name='Instance
> a6461a30c2fb8bec:d4c89d2200000002
> (host=ec2-m2-4xlarge-centos-6-4-0bb5.vpc.cloudera.com:22000)',
> time_series_counters=[TTimeSeriesCounter(values=[76674051, 76674051,
> 93477891, 76726275, 85128195, 76761091, 85163011, 76805123, 76805123,
> 76805123, 93595651, 76822531, 76822531, 85211139, 76849155, 76914691,
> 68364291, 51653635, 51553283, 34724867, 26310659], name='MemoryUsage',
> unit=3, period_ms=500), TTimeSeriesCounter(values=[8, 8, 8, 8, 8, 8, 8, 8, 8,
> 8, 8, 8, 8, 8, 8, 8, 7, 6, 5, 3, 2], name='ThreadUsage', unit=0,
> period_ms=500)], info_strings={'Hdfs split stats (<volume id>:<#
> splits>/<split lengths>)': '-1:8/238.94 MB '}, summary_stats_counters=None,
> num_children=5, child_counters_map={'': set(['TotalNetworkSendTime',
> 'PerHostPeakMemUsage', 'AverageThreadTokens', 'PeakMemoryUsage',
> 'TotalStorageWaitTime', 'TotalThreadsInvoluntaryContextSwitches',
> 'TotalThreadsTotalWallClockTime', 'RowsProduced',
> 'TotalThreadsVoluntaryContextSwitches', 'TotalNetworkReceiveTime',
> 'BloomFilterBytes', 'PeakReservation', 'PeakUsedReservation']),
> 'TotalThreadsTotalWallClockTime': set(['TotalThreadsUserTime',
> 'TotalThreadsSysTime'])},
> event_sequences=[TEventSequence(timestamps=[3999991, 274999376, 10814975489,
> 10814975489, 10816975485], labels=['Prepare Finished', 'Open Finished',
> 'First Batch Produced', 'First Batch Sent', 'ExecInternal Finished'],
> name='Fragment Instance Lifecycle Event Timeline')],
> counters=[TCounter(value=4619781774900399153L, name='AverageThreadTokens',
> unit=6), TCounter(value=0, name='BloomFilterBytes', unit=3),
> TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=93626371,
> name='PeakMemoryUsage', unit=3), TCounter(value=17825792,
> name='PeakReservation', unit=3), TCounter(value=0,
> name='PeakUsedReservation', unit=3), TCounter(value=102539267,
> name='PerHostPeakMemUsage', unit=3), TCounter(value=0, name='RowsProduced',
> unit=0), TCounter(value=0, name='TotalNetworkReceiveTime', unit=5),
> TCounter(value=1999996, name='TotalNetworkSendTime', unit=5),
> TCounter(value=61341860971, name='TotalStorageWaitTime', unit=5),
> TCounter(value=2253, name='TotalThreadsInvoluntaryContextSwitches', unit=0),
> TCounter(value=42990000, name='TotalThreadsSysTime', unit=5),
> TCounter(value=75357829208, name='TotalThreadsTotalWallClockTime', unit=5),
> TCounter(value=2970545000, name='TotalThreadsUserTime', unit=5),
> TCounter(value=132, name='TotalThreadsVoluntaryContextSwitches', unit=0),
> TCounter(value=10814975489, name='TotalTime', unit=5)], metadata=-1),
> TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Buffer
> pool', time_series_counters=None, info_strings={},
> summary_stats_counters=None, num_children=0, child_counters_map={'':
> set(['ReadIoWaitTime', 'WriteIoOps', 'WriteIoWaitTime',
> 'CumulativeAllocations', 'ReadIoOps', 'ReservationLimit', 'WriteIoBytes',
> 'PeakUnpinnedBytes', 'AllocTime', 'ReadIoBytes', 'CumulativeAllocationBytes',
> 'PeakReservation', 'PeakUsedReservation'])}, event_sequences=None,
> counters=[TCounter(value=0, name='AllocTime', unit=5), TCounter(value=0,
> name='CumulativeAllocationBytes', unit=3), TCounter(value=0,
> name='CumulativeAllocations', unit=0), TCounter(value=0,
> name='InactiveTotalTime', unit=5), TCounter(value=0, name='PeakReservation',
> unit=3), TCounter(value=0, name='PeakUnpinnedBytes', unit=3),
> TCounter(value=0, name='PeakUsedReservation', unit=3), TCounter(value=0,
> name='ReadIoBytes', unit=3), TCounter(value=0, name='ReadIoOps', unit=0),
> TCounter(value=0, name='ReadIoWaitTime', unit=5), TCounter(value=0,
> name='ReservationLimit', unit=3), TCounter(value=0, name='TotalTime',
> unit=5), TCounter(value=0, name='WriteIoBytes', unit=3), TCounter(value=0,
> name='WriteIoOps', unit=0), TCounter(value=0, name='WriteIoWaitTime',
> unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[],
> indent=True, name='Fragment Instance Lifecycle Timings',
> time_series_counters=None, info_strings={}, summary_stats_counters=None,
> num_children=0, child_counters_map={'': set(['ExecTime', 'OpenTime',
> 'PrepareTime']), 'ExecTime': set(['ExecTreeExecTime']), 'OpenTime':
> set(['ExecTreeOpenTime']), 'PrepareTime': set(['ExecTreePrepareTime'])},
> event_sequences=None, counters=[TCounter(value=10541976109, name='ExecTime',
> unit=5), TCounter(value=10539976113, name='ExecTreeExecTime', unit=5),
> TCounter(value=1999994, name='ExecTreeOpenTime', unit=5), TCounter(value=0,
> name='ExecTreePrepareTime', unit=5), TCounter(value=0,
> name='InactiveTotalTime', unit=5), TCounter(value=270999385, name='OpenTime',
> unit=5), TCounter(value=1999995, name='PrepareTime', unit=5),
> TCounter(value=0, name='TotalTime', unit=5)], metadata=-1),
> TRuntimeProfileNode(info_strings_display_order=[], indent=True,
> name='KrpcDataStreamSender (dst_id=2)',
> time_series_counters=[TTimeSeriesCounter(values=[0, 0, 0, 0, 0, 0, 0, 0, 0,
> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0], name='BytesSent', unit=3,
> period_ms=500)], info_strings={}, summary_stats_counters=None,
> num_children=0, child_counters_map={'': set(['SerializeBatchTime',
> 'UncompressedRowBatchSize', 'RpcFailure', 'PeakMemoryUsage', 'RpcRetry',
> 'EosSent', 'NetworkThroughput', 'TotalBytesSent', 'RowsSent'])},
> event_sequences=None, counters=[TCounter(value=3, name='EosSent', unit=0),
> TCounter(value=1999996, name='InactiveTotalTime', unit=5), TCounter(value=0,
> name='NetworkThroughput', unit=4), TCounter(value=23112,
> name='PeakMemoryUsage', unit=3), TCounter(value=0, name='RowsSent', unit=0),
> TCounter(value=0, name='RpcFailure', unit=0), TCounter(value=0,
> name='RpcRetry', unit=0), TCounter(value=0, name='SerializeBatchTime',
> unit=5), TCounter(value=0, name='TotalBytesSent', unit=3),
> TCounter(value=1999996, name='TotalTime', unit=5), TCounter(value=0,
> name='UncompressedRowBatchSize', unit=3)], metadata=-1),
> TRuntimeProfileNode(info_strings_display_order=['ExecOption'], indent=True,
> name='AGGREGATION_NODE (id=1)', time_series_counters=None,
> info_strings={'ExecOption': 'Streaming Preaggregation, Codegen Enabled'},
> summary_stats_counters=None, num_children=2, child_counters_map={'':
> set(['LargestPartitionPercent', 'HTResizeTime', 'StreamingTime',
> 'HashBuckets', 'PeakMemoryUsage', 'PartitionsCreated', 'RowsPassedThrough',
> 'RowsReturnedRate', 'RowsReturned', 'ReductionFactorEstimate',
> 'ReductionFactorThresholdToExpand', 'GetResultsTime'])},
> event_sequences=None, counters=[TCounter(value=0, name='GetResultsTime',
> unit=5), TCounter(value=0, name='HTResizeTime', unit=5), TCounter(value=0,
> name='HashBuckets', unit=0), TCounter(value=0, name='InactiveTotalTime',
> unit=5), TCounter(value=0, name='LargestPartitionPercent', unit=0),
> TCounter(value=16, name='PartitionsCreated', unit=0),
> TCounter(value=17891456, name='PeakMemoryUsage', unit=3), TCounter(value=0,
> name='ReductionFactorEstimate', unit=6), TCounter(value=0,
> name='ReductionFactorThresholdToExpand', unit=6), TCounter(value=0,
> name='RowsPassedThrough', unit=0), TCounter(value=0, name='RowsReturned',
> unit=0), TCounter(value=0, name='RowsReturnedRate', unit=1),
> TCounter(value=0, name='StreamingTime', unit=5), TCounter(value=10541976107,
> name='TotalTime', unit=5)], metadata=1),
> TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Buffer
> pool', time_series_counters=None, info_strings={},
> summary_stats_counters=None, num_children=0, child_counters_map={'':
> set(['ReadIoWaitTime', 'WriteIoOps', 'WriteIoWaitTime',
> 'CumulativeAllocations', 'ReadIoOps', 'WriteIoBytes', 'PeakUnpinnedBytes',
> 'AllocTime', 'ReadIoBytes', 'CumulativeAllocationBytes', 'PeakReservation',
> 'PeakUsedReservation'])}, event_sequences=None, counters=[TCounter(value=0,
> name='AllocTime', unit=5), TCounter(value=1048576,
> name='CumulativeAllocationBytes', unit=3), TCounter(value=1,
> name='CumulativeAllocations', unit=0), TCounter(value=0,
> name='InactiveTotalTime', unit=5), TCounter(value=17825792,
> name='PeakReservation', unit=3), TCounter(value=0, name='PeakUnpinnedBytes',
> unit=3), TCounter(value=1048576, name='PeakUsedReservation', unit=3),
> TCounter(value=0, name='ReadIoBytes', unit=3), TCounter(value=0,
> name='ReadIoOps', unit=0), TCounter(value=0, name='ReadIoWaitTime', unit=5),
> TCounter(value=0, name='TotalTime', unit=5), TCounter(value=0,
> name='WriteIoBytes', unit=3), TCounter(value=0, name='WriteIoOps', unit=0),
> TCounter(value=0, name='WriteIoWaitTime', unit=5)], metadata=-1),
> TRuntimeProfileNode(info_strings_display_order=['Hdfs split stats (<volume
> id>:<# splits>/<split lengths>)', 'ExecOption', 'Hdfs Read Thread Concurrency
> Bucket', 'File Formats'], indent=False, name='HDFS_SCAN_NODE (id=0)',
> time_series_counters=[TTimeSeriesCounter(values=[0, 0, 16777216, 25165824,
> 33554432, 41943040, 50331648, 75497472, 75497472, 83886080, 100663296,
> 100663296, 125829120, 134217728, 150994944, 167772160, 193069056, 201523200,
> 225641912, 234096056, 242550200], name='BytesRead', unit=3, period_ms=500)],
> info_strings={'Hdfs Read Thread Concurrency Bucket': '0:0% 1:9.524% 2:4.762%
> 3:0% 4:0% 5:9.524% 6:76.19% ', 'ExecOption': 'TEXT Codegen Enabled, Codegen
> enabled: 8 out of 8', 'File Formats': 'TEXT/NONE:8 ', 'Hdfs split stats
> (<volume id>:<# splits>/<split lengths>)': '-1:8/238.94 MB '},
> summary_stats_counters=None, num_children=0, child_counters_map={'':
> set(['CachedFileHandlesHitCount', 'BytesReadRemoteUnexpected',
> 'ScanRangesComplete', 'RowsReturned', 'TotalReadThroughput',
> 'ScannerThreadsTotalWallClockTime', 'CachedFileHandlesMissCount',
> 'TotalRawHdfsOpenFileTime(*)', 'ScannerThreadsInvoluntaryContextSwitches',
> 'NumDisksAccessed', 'RowBatchQueueGetWaitTime', 'RowsReturnedRate',
> 'TotalRawHdfsReadTime(*)', 'AverageHdfsReadThreadConcurrency',
> 'ScannerThreadsVoluntaryContextSwitches', 'AverageScannerThreadConcurrency',
> 'CollectionItemsRead', 'NumScannerThreadsStarted', 'BytesReadLocal',
> 'DecompressionTime', 'PerReadThreadRawHdfsThroughput', 'RemoteScanRanges',
> 'MaxCompressedTextFileLength', 'PeakMemoryUsage', 'RowBatchQueuePutWaitTime',
> 'BytesReadShortCircuit', 'BytesReadDataNodeCache', 'BytesRead', 'RowsRead']),
> 'ScannerThreadsTotalWallClockTime': set(['DelimiterParseTime',
> 'MaterializeTupleTime(*)', 'ScannerThreadsUserTime',
> 'ScannerThreadsSysTime'])}, event_sequences=None,
> counters=[TCounter(value=4618387803587165428L,
> name='AverageHdfsReadThreadConcurrency', unit=6),
> TCounter(value=4618655874993556529L, name='AverageScannerThreadConcurrency',
> unit=6), TCounter(value=251004344, name='BytesRead', unit=3),
> TCounter(value=0, name='BytesReadDataNodeCache', unit=3), TCounter(value=0,
> name='BytesReadLocal', unit=3), TCounter(value=0,
> name='BytesReadRemoteUnexpected', unit=3), TCounter(value=0,
> name='BytesReadShortCircuit', unit=3), TCounter(value=0,
> name='CachedFileHandlesHitCount', unit=0), TCounter(value=15,
> name='CachedFileHandlesMissCount', unit=0), TCounter(value=0,
> name='CollectionItemsRead', unit=0), TCounter(value=0,
> name='DecompressionTime', unit=5), TCounter(value=3024993152,
> name='DelimiterParseTime', unit=5), TCounter(value=0,
> name='InactiveTotalTime', unit=5), TCounter(value=112999734,
> name='MaterializeTupleTime(*)', unit=5), TCounter(value=0,
> name='MaxCompressedTextFileLength', unit=3), TCounter(value=1,
> name='NumDisksAccessed', unit=0), TCounter(value=7,
> name='NumScannerThreadsStarted', unit=0), TCounter(value=75734016,
> name='PeakMemoryUsage', unit=3), TCounter(value=4040645,
> name='PerReadThreadRawHdfsThroughput', unit=4), TCounter(value=0,
> name='RemoteScanRanges', unit=0), TCounter(value=10532976127,
> name='RowBatchQueueGetWaitTime', unit=5), TCounter(value=0,
> name='RowBatchQueuePutWaitTime', unit=5), TCounter(value=1993842,
> name='RowsRead', unit=0), TCounter(value=0, name='RowsReturned', unit=0),
> TCounter(value=0, name='RowsReturnedRate', unit=1), TCounter(value=8,
> name='ScanRangesComplete', unit=0), TCounter(value=2069,
> name='ScannerThreadsInvoluntaryContextSwitches', unit=0),
> TCounter(value=17994000, name='ScannerThreadsSysTime', unit=5),
> TCounter(value=64545853712, name='ScannerThreadsTotalWallClockTime', unit=5),
> TCounter(value=2740580000, name='ScannerThreadsUserTime', unit=5),
> TCounter(value=113, name='ScannerThreadsVoluntaryContextSwitches', unit=0),
> TCounter(value=1420996777, name='TotalRawHdfsOpenFileTime(*)', unit=5),
> TCounter(value=62119859212, name='TotalRawHdfsReadTime(*)', unit=5),
> TCounter(value=23100019, name='TotalReadThroughput', unit=4),
> TCounter(value=10537976117, name='TotalTime', unit=5)], metadata=0),
> TRuntimeProfileNode(info_strings_display_order=[], indent=True,
> name='CodeGen', time_series_counters=None, info_strings={},
> summary_stats_counters=None, num_children=0, child_counters_map={'':
> set(['OptimizationTime', 'CompileTime', 'LoadTime', 'NumInstructions',
> 'PeakMemoryUsage', 'ModuleBitcodeSize', 'PrepareTime', 'NumFunctions',
> 'CodegenTime'])}, event_sequences=None, counters=[TCounter(value=14999965,
> name='CodegenTime', unit=5), TCounter(value=20999953, name='CompileTime',
> unit=5), TCounter(value=0, name='InactiveTotalTime', unit=5),
> TCounter(value=0, name='LoadTime', unit=5), TCounter(value=2370660,
> name='ModuleBitcodeSize', unit=3), TCounter(value=63, name='NumFunctions',
> unit=0), TCounter(value=1352, name='NumInstructions', unit=0),
> TCounter(value=204999535, name='OptimizationTime', unit=5),
> TCounter(value=692224, name='PeakMemoryUsage', unit=3),
> TCounter(value=33999924, name='PrepareTime', unit=5),
> TCounter(value=259999412, name='TotalTime', unit=5)], metadata=-1)])
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
