[ https://issues.apache.org/jira/browse/IMPALA-9187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16980408#comment-16980408 ]
Sahil Takiar commented on IMPALA-9187: -------------------------------------- Looking at the test, I think there is a race condition. The query can still be in the COMPILED state when the assert is hit: {{assert "Initial admission queue reason: number of running queries" in profile, profile}}, in which case it hasn't been submitted for admission control yet. > TestExecutorGroups.test_executor_group_shutdown is flaky > -------------------------------------------------------- > > Key: IMPALA-9187 > URL: https://issues.apache.org/jira/browse/IMPALA-9187 > Project: IMPALA > Issue Type: Bug > Reporter: Sahil Takiar > Assignee: Lars Volker > Priority: Major > Labels: broken-build, flaky > > The following test is flaky: > custom_cluster.test_executor_groups.TestExecutorGroups.test_executor_group_shutdown > (from pytest) > Error Message > {code} > AssertionError: Query (id=6c4bb1c6f501bae4:ee49118300000000): DEBUG MODE > WARNING: Query profile created while running a DEBUG build of Impala. Use > RELEASE builds to measure query performance. Summary: Session ID: > 104c00e26afad563:fad6988e52bf9cba Session Type: BEESWAX Start Time: > 2019-11-22 00:19:26.497324000 End Time: Query Type: QUERY Query State: > COMPILED Query Status: OK Impala Version: impalad version 3.4.0-SNAPSHOT > DEBUG (build 2bdca39a8b178b7186dd24141a8e97fa0c46358f) User: jenkins > Connected User: jenkins Delegated User: Network Address: 127.0.0.1:59977 > Default Db: default Sql Statement: select sleep(3) Coordinator: []:22000 > Query Options (set by configuration): > TIMEZONE=America/Los_Angeles,CLIENT_IDENTIFIER=custom_cluster/test_executor_groups.py::TestExecutorGroups::()::test_executor_group_shutdown > Query Options (set by configuration and planner): > NUM_NODES=1,NUM_SCANNER_THREADS=1,RUNTIME_FILTER_MODE=0,MT_DOP=0,TIMEZONE=America/Los_Angeles,CLIENT_IDENTIFIER=custom_cluster/test_executor_groups.py::TestExecutorGroups::()::test_executor_group_shutdown > Plan: ---------------- Max Per-Host Resource Reservation: Memory=0B > Threads=1 Per-Host Resource Estimates: Memory=10MB Dedicated Coordinator > Resource Estimate: Memory=100MB Codegen disabled by planner Analyzed query: > SELECT sleep(CAST(3 AS INT)) F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 > instances=1 | Per-Host Resources: mem-estimate=0B mem-reservation=0B > thread-reservation=1 PLAN-ROOT SINK | output exprs: sleep(3) | > mem-estimate=0B mem-reservation=0B thread-reservation=0 | 00:UNION > constant-operands=1 mem-estimate=0B mem-reservation=0B thread-reservation=0 > tuple-ids=0 row-size=1B cardinality=1 in pipelines: <none> ---------------- > Estimated Per-Host Mem: 10485760 Request Pool: default-pool Per Host Min > Memory Reservation: []:22000(0) Per Host Number of Fragment Instances: > []:22000(1) Admission result: Queued Query Compilation: 5.077ms - Metadata of > all 0 tables cached: 679.990us (679.990us) - Analysis finished: 1.269ms > (589.508us) - Authorization finished (noop): 1.350ms (81.387us) - Value > transfer graph computed: 1.681ms (330.356us) - Single node plan created: > 1.801ms (120.709us) - Distributed plan created: 1.880ms (78.868us) - Planning > finished: 5.077ms (3.196ms) Query Timeline: 11.000ms - Query submitted: > 0.000ns (0.000ns) - Planning finished: 7.000ms (7.000ms) - Submit for > admission: 9.000ms (2.000ms) - Queued: 11.000ms (2.000ms) - > ComputeScanRangeAssignmentTimer: 0.000ns Frontend: ImpalaServer: - > ClientFetchWaitTimer: 0.000ns - NumRowsFetched: 0 (0) - > NumRowsFetchedFromCache: 0 (0) - RowMaterializationRate: 0 - > RowMaterializationTimer: 0.000ns assert 'Initial admission queue reason: > number of running queries' in 'Query > (id=6c4bb1c6f501bae4:ee49118300000000):\n DEBUG MODE WARNING: Query profile > created while running a DEBUG buil...0)\n - NumRowsFetchedFromCache: 0 (0)\n > - RowMaterializationRate: 0\n - RowMaterializationTimer: 0.000ns\n' > {code} > Stacktrace > {code} > custom_cluster/test_executor_groups.py:185: in test_executor_group_shutdown > assert "Initial admission queue reason: number of running queries" in > profile, profile E AssertionError: Query > (id=6c4bb1c6f501bae4:ee49118300000000): E DEBUG MODE WARNING: Query profile > created while running a DEBUG build of Impala. Use RELEASE builds to measure > query performance. E Summary: E Session ID: 104c00e26afad563:fad6988e52bf9cba > E Session Type: BEESWAX E Start Time: 2019-11-22 00:19:26.497324000 E End > Time: E Query Type: QUERY E Query State: COMPILED E Query Status: OK > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org For additional commands, e-mail: issues-all-h...@impala.apache.org