[ https://issues.apache.org/jira/browse/KAFKA-9319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17036929#comment-17036929 ]
Nikolay Izhikov commented on KAFKA-9319: ---------------------------------------- {noformat} ==================================================================================================== SESSION REPORT (ALL TESTS) ducktape version: 0.7.6 session_id: 2020-02-13--006 run time: 165 minutes 51.003 seconds tests run: 45 passed: 41 failed: 4 ignored: 0 ==================================================================================================== test_id: kafkatest.tests.core.delegation_token_test.DelegationTokenTest.test_delegation_token_lifecycle status: PASS run time: 1 minute 47.231 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.core.security_rolling_upgrade_test.TestSecurityRollingUpgrade.test_disable_separate_interbroker_listener status: FAIL run time: 4 minutes 19.073 seconds The consumer has terminated, or timed out, on node ducker@ducker08. Traceback (most recent call last): File "/usr/local/lib/python2.7/dist-packages/ducktape/tests/runner_client.py", line 132, in run data = self.run_test() File "/usr/local/lib/python2.7/dist-packages/ducktape/tests/runner_client.py", line 189, in run_test return self.test_context.function(self.test) File "/opt/kafka-dev/tests/kafkatest/tests/core/security_rolling_upgrade_test.py", line 249, in test_disable_separate_interbroker_listener self.remove_separate_broker_listener, client_protocol, client_sasl_mechanism) File "/opt/kafka-dev/tests/kafkatest/tests/produce_consume_validate.py", line 102, in run_produce_consume_validate self.stop_producer_and_consumer() File "/opt/kafka-dev/tests/kafkatest/tests/produce_consume_validate.py", line 89, in stop_producer_and_consumer self.check_alive() File "/opt/kafka-dev/tests/kafkatest/tests/produce_consume_validate.py", line 81, in check_alive raise Exception(msg) Exception: The consumer has terminated, or timed out, on node ducker@ducker08. ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.core.security_rolling_upgrade_test.TestSecurityRollingUpgrade.test_enable_separate_interbroker_listener status: FAIL run time: 3 minutes 30.965 seconds The consumer has terminated, or timed out, on node ducker@ducker03. Traceback (most recent call last): File "/usr/local/lib/python2.7/dist-packages/ducktape/tests/runner_client.py", line 132, in run data = self.run_test() File "/usr/local/lib/python2.7/dist-packages/ducktape/tests/runner_client.py", line 189, in run_test return self.test_context.function(self.test) File "/opt/kafka-dev/tests/kafkatest/tests/core/security_rolling_upgrade_test.py", line 225, in test_enable_separate_interbroker_listener SecurityConfig.SASL_MECHANISM_PLAIN) File "/opt/kafka-dev/tests/kafkatest/tests/produce_consume_validate.py", line 102, in run_produce_consume_validate self.stop_producer_and_consumer() File "/opt/kafka-dev/tests/kafkatest/tests/produce_consume_validate.py", line 89, in stop_producer_and_consumer self.check_alive() File "/opt/kafka-dev/tests/kafkatest/tests/produce_consume_validate.py", line 81, in check_alive raise Exception(msg) Exception: The consumer has terminated, or timed out, on node ducker@ducker03. ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.core.security_rolling_upgrade_test.TestSecurityRollingUpgrade.test_rolling_upgrade_phase_one.client_protocol=SASL_PLAINTEXT status: PASS run time: 4 minutes 46.723 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.core.security_rolling_upgrade_test.TestSecurityRollingUpgrade.test_rolling_upgrade_phase_one.client_protocol=SASL_SSL status: PASS run time: 5 minutes 15.402 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.core.security_rolling_upgrade_test.TestSecurityRollingUpgrade.test_rolling_upgrade_sasl_mechanism_phase_one.new_client_sasl_mechanism=PLAIN status: PASS run time: 5 minutes 48.541 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.core.transactions_test.TransactionsTest.test_transactions.failure_mode=clean_bounce.bounce_target=brokers.check_order=False status: PASS run time: 4 minutes 29.088 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.core.transactions_test.TransactionsTest.test_transactions.failure_mode=clean_bounce.bounce_target=brokers.check_order=True status: PASS run time: 4 minutes 0.152 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.core.transactions_test.TransactionsTest.test_transactions.failure_mode=clean_bounce.bounce_target=clients.check_order=False status: PASS run time: 4 minutes 26.723 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.core.transactions_test.TransactionsTest.test_transactions.failure_mode=clean_bounce.bounce_target=clients.check_order=True status: PASS run time: 3 minutes 44.763 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.core.transactions_test.TransactionsTest.test_transactions.failure_mode=hard_bounce.bounce_target=brokers.check_order=False status: PASS run time: 4 minutes 51.598 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.core.transactions_test.TransactionsTest.test_transactions.failure_mode=hard_bounce.bounce_target=brokers.check_order=True status: PASS run time: 4 minutes 15.202 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.core.transactions_test.TransactionsTest.test_transactions.failure_mode=hard_bounce.bounce_target=clients.check_order=False status: FAIL run time: 4 minutes 26.627 seconds copier-1 : Message copier didn't make enough progress in 30s. Current progress: 0 Traceback (most recent call last): File "/usr/local/lib/python2.7/dist-packages/ducktape/tests/runner_client.py", line 132, in run data = self.run_test() File "/usr/local/lib/python2.7/dist-packages/ducktape/tests/runner_client.py", line 189, in run_test return self.test_context.function(self.test) File "/usr/local/lib/python2.7/dist-packages/ducktape/mark/_mark.py", line 428, in wrapper return functools.partial(f, *args, **kwargs)(*w_args, **w_kwargs) File "/opt/kafka-dev/tests/kafkatest/tests/core/transactions_test.py", line 246, in test_transactions num_messages_to_copy=self.num_seed_messages) File "/opt/kafka-dev/tests/kafkatest/tests/core/transactions_test.py", line 189, in copy_messages_transactionally self.bounce_copiers(copiers, clean_shutdown) File "/opt/kafka-dev/tests/kafkatest/tests/core/transactions_test.py", line 117, in bounce_copiers % (copier.transactional_id, str(copier.progress_percent()))) File "/usr/local/lib/python2.7/dist-packages/ducktape/utils/util.py", line 41, in wait_until raise TimeoutError(err_msg() if callable(err_msg) else err_msg) TimeoutError: copier-1 : Message copier didn't make enough progress in 30s. Current progress: 0 ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.core.transactions_test.TransactionsTest.test_transactions.failure_mode=hard_bounce.bounce_target=clients.check_order=True status: PASS run time: 3 minutes 46.452 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.core.mirror_maker_test.TestMirrorMakerService.test_bounce.clean_shutdown=False.security_protocol=SASL_PLAINTEXT status: PASS run time: 2 minutes 55.050 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.core.mirror_maker_test.TestMirrorMakerService.test_bounce.clean_shutdown=False.security_protocol=SASL_SSL status: PASS run time: 3 minutes 24.344 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.core.mirror_maker_test.TestMirrorMakerService.test_bounce.clean_shutdown=True.security_protocol=SASL_PLAINTEXT status: PASS run time: 2 minutes 44.703 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.core.mirror_maker_test.TestMirrorMakerService.test_bounce.clean_shutdown=True.security_protocol=SASL_SSL status: PASS run time: 3 minutes 24.544 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.core.mirror_maker_test.TestMirrorMakerService.test_simple_end_to_end.security_protocol=SASL_PLAINTEXT status: PASS run time: 2 minutes 20.617 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.core.mirror_maker_test.TestMirrorMakerService.test_simple_end_to_end.security_protocol=SASL_SSL status: PASS run time: 2 minutes 44.589 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.core.security_rolling_upgrade_test.TestSecurityRollingUpgrade.test_rolling_upgrade_phase_one.client_protocol=SSL status: PASS run time: 4 minutes 29.670 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.core.security_rolling_upgrade_test.TestSecurityRollingUpgrade.test_rolling_upgrade_phase_two.broker_protocol=SASL_PLAINTEXT.client_protocol=SASL_PLAINTEXT status: PASS run time: 5 minutes 30.252 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.core.security_rolling_upgrade_test.TestSecurityRollingUpgrade.test_rolling_upgrade_phase_two.broker_protocol=SASL_PLAINTEXT.client_protocol=SASL_SSL status: PASS run time: 6 minutes 24.268 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.core.security_rolling_upgrade_test.TestSecurityRollingUpgrade.test_rolling_upgrade_phase_two.broker_protocol=SASL_PLAINTEXT.client_protocol=SSL status: PASS run time: 6 minutes 26.756 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.core.security_rolling_upgrade_test.TestSecurityRollingUpgrade.test_rolling_upgrade_phase_two.broker_protocol=SASL_SSL.client_protocol=SASL_PLAINTEXT status: PASS run time: 6 minutes 19.379 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.core.security_rolling_upgrade_test.TestSecurityRollingUpgrade.test_rolling_upgrade_phase_two.broker_protocol=SASL_SSL.client_protocol=SASL_SSL status: PASS run time: 6 minutes 28.369 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.core.security_rolling_upgrade_test.TestSecurityRollingUpgrade.test_rolling_upgrade_phase_two.broker_protocol=SASL_SSL.client_protocol=SSL status: PASS run time: 6 minutes 34.198 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.core.security_rolling_upgrade_test.TestSecurityRollingUpgrade.test_rolling_upgrade_phase_two.broker_protocol=SSL.client_protocol=SASL_PLAINTEXT status: PASS run time: 6 minutes 36.551 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.core.security_rolling_upgrade_test.TestSecurityRollingUpgrade.test_rolling_upgrade_phase_two.broker_protocol=SSL.client_protocol=SASL_SSL status: PASS run time: 6 minutes 44.657 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.core.security_rolling_upgrade_test.TestSecurityRollingUpgrade.test_rolling_upgrade_phase_two.broker_protocol=SSL.client_protocol=SSL status: PASS run time: 5 minutes 4.645 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.core.security_rolling_upgrade_test.TestSecurityRollingUpgrade.test_rolling_upgrade_sasl_mechanism_phase_two.new_sasl_mechanism=PLAIN status: FAIL run time: 6 minutes 24.385 seconds The consumer has terminated, or timed out, on node ducker@ducker06. Traceback (most recent call last): File "/usr/local/lib/python2.7/dist-packages/ducktape/tests/runner_client.py", line 132, in run data = self.run_test() File "/usr/local/lib/python2.7/dist-packages/ducktape/tests/runner_client.py", line 189, in run_test return self.test_context.function(self.test) File "/usr/local/lib/python2.7/dist-packages/ducktape/mark/_mark.py", line 428, in wrapper return functools.partial(f, *args, **kwargs)(*w_args, **w_kwargs) File "/opt/kafka-dev/tests/kafkatest/tests/core/security_rolling_upgrade_test.py", line 208, in test_rolling_upgrade_sasl_mechanism_phase_two self.run_produce_consume_validate(self.roll_in_sasl_mechanism, self.kafka.security_protocol, new_sasl_mechanism) File "/opt/kafka-dev/tests/kafkatest/tests/produce_consume_validate.py", line 102, in run_produce_consume_validate self.stop_producer_and_consumer() File "/opt/kafka-dev/tests/kafkatest/tests/produce_consume_validate.py", line 89, in stop_producer_and_consumer self.check_alive() File "/opt/kafka-dev/tests/kafkatest/tests/produce_consume_validate.py", line 81, in check_alive raise Exception(msg) Exception: The consumer has terminated, or timed out, on node ducker@ducker06. ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.core.mirror_maker_test.TestMirrorMakerService.test_bounce.clean_shutdown=False.security_protocol=PLAINTEXT status: PASS run time: 2 minutes 26.196 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.core.mirror_maker_test.TestMirrorMakerService.test_bounce.clean_shutdown=False.security_protocol=SSL status: PASS run time: 2 minutes 44.125 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.core.mirror_maker_test.TestMirrorMakerService.test_bounce.clean_shutdown=True.security_protocol=PLAINTEXT status: PASS run time: 2 minutes 6.908 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.core.mirror_maker_test.TestMirrorMakerService.test_bounce.clean_shutdown=True.security_protocol=SSL status: PASS run time: 2 minutes 35.928 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.core.mirror_maker_test.TestMirrorMakerService.test_simple_end_to_end.security_protocol=PLAINTEXT status: PASS run time: 1 minute 52.046 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.core.mirror_maker_test.TestMirrorMakerService.test_simple_end_to_end.security_protocol=SSL status: PASS run time: 2 minutes 9.968 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.core.security_test.SecurityTest.test_client_ssl_endpoint_validation_failure.interbroker_security_protocol=PLAINTEXT.security_protocol=SSL status: PASS run time: 1 minute 22.079 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.core.security_test.SecurityTest.test_client_ssl_endpoint_validation_failure.interbroker_security_protocol=SSL.security_protocol=PLAINTEXT status: PASS run time: 1 minute 22.838 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.tools.replica_verification_test.ReplicaVerificationToolTest.test_replica_lags status: PASS run time: 56.896 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.tools.log4j_appender_test.Log4jAppenderTest.test_log4j_appender.security_protocol=SASL_PLAINTEXT status: PASS run time: 45.825 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.tools.log4j_appender_test.Log4jAppenderTest.test_log4j_appender.security_protocol=SASL_SSL status: PASS run time: 1 minute 3.470 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.tools.log4j_appender_test.Log4jAppenderTest.test_log4j_appender.security_protocol=PLAINTEXT status: PASS run time: 29.523 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.tools.log4j_appender_test.Log4jAppenderTest.test_log4j_appender.security_protocol=SSL status: PASS run time: 39.957 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.tools.log_compaction_test.LogCompactionTest.test_log_compaction status: PASS run time: 1 minute 7.593 seconds ---------------------------------------------------------------------------------------------------- {noformat} > Run some system tests using TLSv1.3 > ----------------------------------- > > Key: KAFKA-9319 > URL: https://issues.apache.org/jira/browse/KAFKA-9319 > Project: Kafka > Issue Type: Test > Reporter: Rajini Sivaram > Assignee: Nikolay Izhikov > Priority: Major > Fix For: 2.5.0 > > > KAFKA-7251 enables TLSv1.3 for Kafka. We should get some system tests to run > using TLSv1.3. Since TLSv1.3 is only supported from Java 11 onwards, we need > a system test build that runs with JDK 11 to enable these tests. -- This message was sent by Atlassian Jira (v8.3.4#803005)