Qifan Chen created IMPALA-10927: ----------------------------------- Summary: TestFetchAndSpooling.test_rows_sent_counters is flaky in impala-cdpd-master-staging-core-s3 based test Key: IMPALA-10927 URL: https://issues.apache.org/jira/browse/IMPALA-10927 Project: IMPALA Issue Type: Improvement Reporter: Qifan Chen
RowsSentRate counter is seen with a value of 0 and the following is the error report. A fix in the similar area was described in IMPALA-8957, where a delay via DEBUG_ACTION BPRS_BEFORE_ADD_BATCH was introduced. {code:java} query_test.test_fetch.TestFetchAndSpooling.test_rows_sent_counters[protocol: beeswax | exec_option: {'batch_size': 0, 'num_nodes': 0, 'disable_codegen_rows_threshold': 0, 'disable_codegen': False, 'abort_on_error': 1, 'exec_single_node_rows_threshold': 0} | table_format: parquet/none] (from pytest) Failing for the past 1 build (Since Failed#206 ) Took 0.47 sec. Error Message query_test/test_fetch.py:101: in test_rows_sent_counters assert float(rows_sent_rate.group(1)) > 0 E assert 0.0 > 0 E + where 0.0 = float('0') E + where '0' = <built-in method group of _sre.SRE_Match object at 0x7f9d22693030>(1) E + where <built-in method group of _sre.SRE_Match object at 0x7f9d22693030> = <_sre.SRE_Match object at 0x7f9d22693030>.group Stacktrace query_test/test_fetch.py:101: in test_rows_sent_counters assert float(rows_sent_rate.group(1)) > 0 E assert 0.0 > 0 E + where 0.0 = float('0') E + where '0' = <built-in method group of _sre.SRE_Match object at 0x7f9d22693030>(1) E + where <built-in method group of _sre.SRE_Match object at 0x7f9d22693030> = <_sre.SRE_Match object at 0x7f9d22693030>.group Standard Error SET client_identifier=query_test/test_fetch.py::TestFetchAndSpooling::()::test_rows_sent_counters[protocol:beeswax|exec_option:{'batch_size':0;'num_nodes':0;'disable_codegen_rows_threshold':0;'disable_codegen':False;'abort_on_error':1;'exec_single_node_rows_threshold':0}|table; -- connecting to: localhost:21000 -- connecting to localhost:21050 with impyla -- 2021-09-10 04:41:56,852 INFO MainThread: Closing active operation -- connecting to localhost:28000 with impyla -- 2021-09-10 04:41:56,925 INFO MainThread: Closing active operation -- connecting to localhost:11050 with impyla -- 2021-09-10 04:41:56,939 INFO MainThread: Could not connect to ('::1', 11050, 0, 0) Traceback (most recent call last): File "/data/jenkins/workspace/impala-cdpd-master-staging-core-s3/Impala-Toolchain/toolchain-packages-gcc7.5.0/thrift-0.11.0-p4/python/lib/python2.7/site-packages/thrift/transport/TSocket.py", line 104, in open handle.connect(sockaddr) File "/data/jenkins/workspace/impala-cdpd-master-staging-core-s3/Impala-Toolchain/toolchain-packages-gcc7.5.0/python-2.7.16/lib/python2.7/socket.py", line 228, in meth return getattr(self._sock,name)(*args) error: [Errno 111] Connection refused -- 2021-09-10 04:41:56,939 INFO MainThread: Could not connect to ('127.0.0.1', 11050) Traceback (most recent call last): File "/data/jenkins/workspace/impala-cdpd-master-staging-core-s3/Impala-Toolchain/toolchain-packages-gcc7.5.0/thrift-0.11.0-p4/python/lib/python2.7/site-packages/thrift/transport/TSocket.py", line 104, in open handle.connect(sockaddr) File "/data/jenkins/workspace/impala-cdpd-master-staging-core-s3/Impala-Toolchain/toolchain-packages-gcc7.5.0/python-2.7.16/lib/python2.7/socket.py", line 228, in meth return getattr(self._sock,name)(*args) error: [Errno 111] Connection refused -- 2021-09-10 04:41:56,939 ERROR MainThread: Could not connect to any of [('::1', 11050, 0, 0), ('127.0.0.1', 11050)] -- 2021-09-10 04:41:56,939 INFO MainThread: HS2 FENG connection setup failed, continuing...: Could not connect to any of [('::1', 11050, 0, 0), ('127.0.0.1', 11050)] SET client_identifier=query_test/test_fetch.py::TestFetchAndSpooling::()::test_rows_sent_counters[protocol:beeswax|exec_option:{'batch_size':0;'num_nodes':0;'disable_codegen_rows_threshold':0;'disable_codegen':False;'abort_on_error':1;'exec_single_node_rows_threshold':0}|table; SET batch_size=0; SET num_nodes=0; SET disable_codegen_rows_threshold=0; SET disable_codegen=False; SET abort_on_error=1; SET debug_action=BPRS_BEFORE_ADD_ROWS:SLEEP@1000; SET exec_single_node_rows_threshold=0; -- executing against localhost:21000 select id from functional.alltypes limit 10; -- 2021-09-10 04:41:56,988 INFO MainThread: Started query b04941a7ffff5e31:1da6c8eb00000000 Options {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)