[
https://issues.apache.org/jira/browse/IMPALA-14866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18070121#comment-18070121
]
Fang-Yu Rao commented on IMPALA-14866:
--------------------------------------
[~baggio000], assigned this to you since you are more familiar with this part
of Impala. Please reassign the ticket as you see appropriate. Thanks!
> test_dedicated_coordinator_legacy_mem_accounting() seems to be flaky
> --------------------------------------------------------------------
>
> Key: IMPALA-14866
> URL: https://issues.apache.org/jira/browse/IMPALA-14866
> Project: IMPALA
> Issue Type: Bug
> Reporter: Fang-Yu Rao
> Assignee: Yida Wu
> Priority: Major
> Labels: broken-build
>
> We found that
> [test_dedicated_coordinator_legacy_mem_accounting()|https://github.com/apache/impala/blame/59504bd/tests/custom_cluster/test_admission_controller.py#L689]
> could fail with the following error.
> *Error Message*
> {code}
> AssertionError: expected_mem_limits:{'coordinator': 146755478.0, 'executor':
> 277183958.0} actual_mem_limits:{'coordinator': 146758696.96, 'executor':
> 277180579.84} mem_admitted:{'executor': [0.0], 'coordinator': 146758696.96}
> assert 277183958.0 < (5 * 1048576)
> + where 277183958.0 = abs((0.0 - 277183958.0))
> {code}
> *Stacktrace*
> {code}
> custom_cluster/test_admission_controller.py:694: in
> test_dedicated_coordinator_legacy_mem_accounting
> self.__verify_mem_accounting(vector,
> using_dedicated_coord_estimates=False)
> self =
> <tests.custom_cluster.test_admission_controller.TestAdmissionControllerWithACServiceCompress
> object at 0xffff7bbf7c50>
> vector = "table_format: text/none" | "protocol: hs2" |
> "exec_option: {'abort_on_error': 1, 'batch_size': 0, 'disable_codegen':
> ...ld': 5000, 'exec_single_node_rows_threshold': 0, 'num_nodes': 0,
> 'test_replan': 1, 'request_pool': 'root.regularPool'}"
> custom_cluster/test_admission_controller.py:777: in __verify_mem_accounting
> assert abs(
> E AssertionError: expected_mem_limits:{'coordinator': 146755478.0,
> 'executor': 277183958.0} actual_mem_limits:{'coordinator': 146758696.96,
> 'executor': 277180579.84} mem_admitted:{'executor': [0.0], 'coordinator':
> 146758696.96}
> E assert 277183958.0 < (5 * 1048576)
> E + where 277183958.0 = abs((0.0 - 277183958.0))
> MB = 1048576
> actual_mem_limits = {'coordinator': 146758696.96, 'executor':
> 277180579.84}
> debug_string = " expected_mem_limits:{'coordinator': 146755478.0,
> 'executor': 277183958.0} actual_mem_limits:{'coordinator': 146758696.96,
> 'executor': 277180579.84} mem_admitted:{'executor': [0.0], 'coordinator':
> 146758696.96}"
> expected_mem_limits = {'coordinator': 146755478.0, 'executor':
> 277183958.0}
> handle = <tests.common.impala_connection.OperationHandle object
> at 0xffff4e9ebc50>
> mem_admitted = {'coordinator': 146758696.96, 'executor': [0.0]}
> query = 'select * from functional.alltypesagg where id != {0}
> union all select * from functional.alltypesagg where id != {0} u...ll select
> * from functional.alltypesagg where id != {0} union all select * from
> functional.alltypesagg where id != {0}'
> self =
> <tests.custom_cluster.test_admission_controller.TestAdmissionControllerWithACServiceCompress
> object at 0xffff7bbf7c50>
> using_dedicated_coord_estimates = False
> vector = "table_format: text/none" | "protocol: hs2" |
> "exec_option: {'abort_on_error': 1, 'batch_size': 0, 'disable_codegen':
> ...ld': 5000, 'exec_single_node_rows_threshold': 0, 'num_nodes': 0,
> 'test_replan': 1, 'request_pool': 'root.regularPool'}"
> {code}
> It failed the check at
> https://github.com/apache/impala/blame/59504bd/tests/custom_cluster/test_admission_controller.py#L777-L779.
> {code:python}
> assert abs(
> mem_admitted['executor'][0] - expected_mem_limits['executor']) < 5 *
> MB, \
> debug_string
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
