philipnee opened a new pull request, #15548: URL: https://github.com/apache/kafka/pull/15548
Adding this as part of the greater effort to modify the system tests to incorporate the use of consumer group protocol from KIP-848. Following is the test results and the tests using protocol = consumer are expected to fail: ``` ================================================================================ SESSION REPORT (ALL TESTS) ducktape version: 0.11.4 session_id: 2024-03-16--002 run time: 76 minutes 36.150 seconds tests run: 28 passed: 25 flaky: 0 failed: 3 ignored: 0 ================================================================================ test_id: kafkatest.tests.core.consume_bench_test.ConsumeBenchTest.test_consume_bench.topics=.consume_bench_topic.0-5.0-4.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False status: PASS run time: 2 minutes 5.067 seconds -------------------------------------------------------------------------------- test_id: kafkatest.tests.core.consume_bench_test.ConsumeBenchTest.test_consume_bench.topics=.consume_bench_topic.0-5.0-4.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=True.group_protocol=classic status: PASS run time: 2 minutes 3.908 seconds -------------------------------------------------------------------------------- test_id: kafkatest.tests.core.consume_bench_test.ConsumeBenchTest.test_consume_bench.topics=.consume_bench_topic.0-5.0-4.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=True.group_protocol=consumer status: FAIL run time: 12 minutes 10.546 seconds TimeoutError('consume_workload failed to finish in the expected amount of time.') Traceback (most recent call last): File "/usr/local/lib/python3.9/dist-packages/ducktape/tests/runner_client.py", line 186, in _do_run data = self.run_test() File "/usr/local/lib/python3.9/dist-packages/ducktape/tests/runner_client.py", line 246, in run_test return self.test_context.function(self.test) File "/usr/local/lib/python3.9/dist-packages/ducktape/mark/_mark.py", line 433, in wrapper return functools.partial(f, *args, **kwargs)(*w_args, **w_kwargs) File "/opt/kafka-dev/tests/kafkatest/tests/core/consume_bench_test.py", line 111, in test_consume_bench consume_workload.wait_for_done(timeout_sec=360) File "/opt/kafka-dev/tests/kafkatest/services/trogdor/trogdor.py", line 352, in wait_for_done wait_until(lambda: self.done(), File "/usr/local/lib/python3.9/dist-packages/ducktape/utils/util.py", line 58, in wait_until raise TimeoutError(err_msg() if callable(err_msg) else err_msg) from last_exception ducktape.errors.TimeoutError: consume_workload failed to finish in the expected amount of time. -------------------------------------------------------------------------------- test_id: kafkatest.tests.core.consume_bench_test.ConsumeBenchTest.test_consume_bench.topics=.consume_bench_topic.0-5.0-4.metadata_quorum=ZK.use_new_coordinator=False status: PASS run time: 2 minutes 2.461 seconds -------------------------------------------------------------------------------- test_id: kafkatest.tests.core.consume_bench_test.ConsumeBenchTest.test_consume_bench.topics=.consume_bench_topic.0-5.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False status: PASS run time: 2 minutes 6.186 seconds -------------------------------------------------------------------------------- test_id: kafkatest.tests.core.consume_bench_test.ConsumeBenchTest.test_consume_bench.topics=.consume_bench_topic.0-5.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=True.group_protocol=classic status: PASS run time: 2 minutes 4.417 seconds -------------------------------------------------------------------------------- test_id: kafkatest.tests.core.consume_bench_test.ConsumeBenchTest.test_consume_bench.topics=.consume_bench_topic.0-5.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=True.group_protocol=consumer status: PASS run time: 2 minutes 4.510 seconds -------------------------------------------------------------------------------- test_id: kafkatest.tests.core.consume_bench_test.ConsumeBenchTest.test_consume_bench.topics=.consume_bench_topic.0-5.metadata_quorum=ZK.use_new_coordinator=False status: PASS run time: 2 minutes 0.361 seconds -------------------------------------------------------------------------------- test_id: kafkatest.tests.core.consume_bench_test.ConsumeBenchTest.test_multiple_consumers_random_group_partitions.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False status: PASS run time: 2 minutes 14.046 seconds -------------------------------------------------------------------------------- test_id: kafkatest.tests.core.consume_bench_test.ConsumeBenchTest.test_multiple_consumers_random_group_partitions.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=True.group_protocol=classic status: PASS run time: 2 minutes 14.037 seconds -------------------------------------------------------------------------------- test_id: kafkatest.tests.core.consume_bench_test.ConsumeBenchTest.test_multiple_consumers_random_group_partitions.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=True.group_protocol=consumer status: FAIL run time: 10 minutes 33.474 seconds TimeoutError('consume_workload failed to finish in the expected amount of time.') Traceback (most recent call last): File "/usr/local/lib/python3.9/dist-packages/ducktape/tests/runner_client.py", line 186, in _do_run data = self.run_test() File "/usr/local/lib/python3.9/dist-packages/ducktape/tests/runner_client.py", line 246, in run_test return self.test_context.function(self.test) File "/usr/local/lib/python3.9/dist-packages/ducktape/mark/_mark.py", line 433, in wrapper return functools.partial(f, *args, **kwargs)(*w_args, **w_kwargs) File "/opt/kafka-dev/tests/kafkatest/tests/core/consume_bench_test.py", line 256, in test_multiple_consumers_random_group_partitions consume_workload.wait_for_done(timeout_sec=360) File "/opt/kafka-dev/tests/kafkatest/services/trogdor/trogdor.py", line 352, in wait_for_done wait_until(lambda: self.done(), File "/usr/local/lib/python3.9/dist-packages/ducktape/utils/util.py", line 58, in wait_until raise TimeoutError(err_msg() if callable(err_msg) else err_msg) from last_exception ducktape.errors.TimeoutError: consume_workload failed to finish in the expected amount of time. -------------------------------------------------------------------------------- test_id: kafkatest.tests.core.consume_bench_test.ConsumeBenchTest.test_multiple_consumers_random_group_partitions.metadata_quorum=ZK.use_new_coordinator=False status: PASS run time: 2 minutes 12.690 seconds -------------------------------------------------------------------------------- test_id: kafkatest.tests.core.consume_bench_test.ConsumeBenchTest.test_multiple_consumers_random_group_topics.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False status: PASS run time: 1 minute 59.728 seconds -------------------------------------------------------------------------------- test_id: kafkatest.tests.core.consume_bench_test.ConsumeBenchTest.test_multiple_consumers_random_group_topics.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=True.group_protocol=classic status: PASS run time: 2 minutes 4.751 seconds -------------------------------------------------------------------------------- test_id: kafkatest.tests.core.consume_bench_test.ConsumeBenchTest.test_multiple_consumers_random_group_topics.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=True.group_protocol=consumer status: PASS run time: 2 minutes 2.370 seconds -------------------------------------------------------------------------------- test_id: kafkatest.tests.core.consume_bench_test.ConsumeBenchTest.test_multiple_consumers_random_group_topics.metadata_quorum=ZK.use_new_coordinator=False status: PASS run time: 1 minute 57.040 seconds -------------------------------------------------------------------------------- test_id: kafkatest.tests.core.consume_bench_test.ConsumeBenchTest.test_multiple_consumers_specified_group_partitions_should_raise.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False status: PASS run time: 1 minute 14.091 seconds -------------------------------------------------------------------------------- test_id: kafkatest.tests.core.consume_bench_test.ConsumeBenchTest.test_multiple_consumers_specified_group_partitions_should_raise.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=True.group_protocol=classic status: PASS run time: 1 minute 15.042 seconds -------------------------------------------------------------------------------- test_id: kafkatest.tests.core.consume_bench_test.ConsumeBenchTest.test_multiple_consumers_specified_group_partitions_should_raise.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=True.group_protocol=consumer status: PASS run time: 1 minute 14.844 seconds -------------------------------------------------------------------------------- test_id: kafkatest.tests.core.consume_bench_test.ConsumeBenchTest.test_multiple_consumers_specified_group_partitions_should_raise.metadata_quorum=ZK.use_new_coordinator=False status: PASS run time: 1 minute 12.074 seconds -------------------------------------------------------------------------------- test_id: kafkatest.tests.core.consume_bench_test.ConsumeBenchTest.test_single_partition.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False status: PASS run time: 1 minute 58.561 seconds -------------------------------------------------------------------------------- test_id: kafkatest.tests.core.consume_bench_test.ConsumeBenchTest.test_single_partition.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=True.group_protocol=classic status: PASS run time: 2 minutes 0.083 seconds -------------------------------------------------------------------------------- test_id: kafkatest.tests.core.consume_bench_test.ConsumeBenchTest.test_single_partition.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=True.group_protocol=consumer status: FAIL run time: 5 minutes 28.610 seconds TimeoutError('consume_workload failed to finish in the expected amount of time.') Traceback (most recent call last): File "/usr/local/lib/python3.9/dist-packages/ducktape/tests/runner_client.py", line 186, in _do_run data = self.run_test() File "/usr/local/lib/python3.9/dist-packages/ducktape/tests/runner_client.py", line 246, in run_test return self.test_context.function(self.test) File "/usr/local/lib/python3.9/dist-packages/ducktape/mark/_mark.py", line 433, in wrapper return functools.partial(f, *args, **kwargs)(*w_args, **w_kwargs) File "/opt/kafka-dev/tests/kafkatest/tests/core/consume_bench_test.py", line 146, in test_single_partition consume_workload.wait_for_done(timeout_sec=180) File "/opt/kafka-dev/tests/kafkatest/services/trogdor/trogdor.py", line 352, in wait_for_done wait_until(lambda: self.done(), File "/usr/local/lib/python3.9/dist-packages/ducktape/utils/util.py", line 58, in wait_until raise TimeoutError(err_msg() if callable(err_msg) else err_msg) from last_exception ducktape.errors.TimeoutError: consume_workload failed to finish in the expected amount of time. -------------------------------------------------------------------------------- test_id: kafkatest.tests.core.consume_bench_test.ConsumeBenchTest.test_single_partition.metadata_quorum=ZK.use_new_coordinator=False status: PASS run time: 1 minute 56.572 seconds -------------------------------------------------------------------------------- test_id: kafkatest.tests.core.consume_bench_test.ConsumeBenchTest.test_two_consumers_specified_group_topics.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False status: PASS run time: 2 minutes 6.544 seconds -------------------------------------------------------------------------------- test_id: kafkatest.tests.core.consume_bench_test.ConsumeBenchTest.test_two_consumers_specified_group_topics.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=True.group_protocol=classic status: PASS run time: 2 minutes 6.178 seconds -------------------------------------------------------------------------------- test_id: kafkatest.tests.core.consume_bench_test.ConsumeBenchTest.test_two_consumers_specified_group_topics.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=True.group_protocol=consumer status: PASS run time: 2 minutes 4.364 seconds -------------------------------------------------------------------------------- test_id: kafkatest.tests.core.consume_bench_test.ConsumeBenchTest.test_two_consumers_specified_group_topics.metadata_quorum=ZK.use_new_coordinator=False status: PASS run time: 2 minutes 1.623 seconds -------------------------------------------------------------------------------- ================================================================================ FAILED TEST SUITE Test suite to rerun failed tests: /opt/kafka-dev/results/2024-03-16--002/rerun-failed.yml ================================================================================ ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org