[ https://issues.apache.org/jira/browse/IMPALA-13209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Csaba Ringhofer resolved IMPALA-13209. -------------------------------------- Fix Version/s: Impala 4.5.0 Resolution: Fixed > ExchangeNode's ConvertRowBatchTime can be high > ---------------------------------------------- > > Key: IMPALA-13209 > URL: https://issues.apache.org/jira/browse/IMPALA-13209 > Project: IMPALA > Issue Type: Improvement > Components: Backend > Reporter: Csaba Ringhofer > Assignee: Csaba Ringhofer > Priority: Major > Labels: performance > Fix For: Impala 4.5.0 > > > ConvertRowBatchTime can be surprisingly high - the only thing done during > this timer is copying tuple pointers from one RowBatch to another. > https://github.com/apache/impala/blob/c53987480726b114e0c3537c71297df2834a4962/be/src/exec/exchange-node.cc#L217 > {code} > set mt_dop=8; > select straight_join count(*) from tpcds_parquet.store_sales s1 join > /*+broadcast*/ tpcds_parquet.store_sales16 s2 on s1.ss_customer_sk = > s2.ss_customer_sk; > ConvertRowBatchTime dominates the busy exchange node's exec time in the > profile: > - ConvertRowBatchTime: 640.072ms > - InactiveTotalTime: 243.783ms > - PeakMemoryUsage: 12.53 MB (13142368) > - RowsReturned: 46.09M (46086464) > - RowsReturnedRate: 46.93 M/sec > - TotalTime: 981.968ms > {code} -- This message was sent by Atlassian Jira (v8.20.10#820010)