chia7712 commented on pull request #8657: URL: https://github.com/apache/kafka/pull/8657#issuecomment-650503360
> For comparison, 29 test failures in trunk http://testing.confluent.io/confluent-kafka-system-test-results/?prefix=2020-06-25--001.1593132363--apache--trunk--3348fc49d/ It seems to me there are many flaky in system tests and I need more time to dig in them (TLSv1.3 is traced by https://issues.apache.org/jira/browse/KAFKA-10180) **Following failed tests happens with this PR** ``` Module: kafkatest.tests.streams.streams_upgrade_test Class: StreamsUpgradeTest Method: test_simple_upgrade_downgrade Arguments: { "from_version": "0.10.1.1", "to_version": "0.10.2.2" } ``` ``` Module: kafkatest.tests.streams.streams_cooperative_rebalance_upgrade_test Class: StreamsCooperativeRebalanceUpgradeTest Method: test_upgrade_to_cooperative_rebalance Arguments: { "upgrade_from_version": "1.0.2" } ``` ``` Module: kafkatest.tests.core.round_trip_fault_test Class: RoundTripFaultTest Method: test_round_trip_workload_with_broker_partition ``` ``` Module: kafkatest.tests.connect.connect_distributed_test Class: ConnectDistributedTest Method: test_bounce Arguments: { "clean": true, "connect_protocol": "compatible" } ``` ``` Module: kafkatest.tests.core.group_mode_transactions_test Class: GroupModeTransactionsTest Method: test_transactions Arguments: { "bounce_target": "clients", "failure_mode": "clean_bounce" } ``` ``` Module: kafkatest.tests.core.replica_scale_test Class: ReplicaScaleTest Method: test_produce_consume Arguments: { "partition_count": 34, "replication_factor": 3, "topic_count": 500 } ``` ``` Module: kafkatest.tests.core.zookeeper_security_upgrade_test Class: ZooKeeperSecurityUpgradeTest Method: test_zk_security_upgrade Arguments: { "security_protocol": "SASL_PLAINTEXT" } ``` ``` Module: kafkatest.tests.streams.streams_eos_test Class: StreamsEosTest Method: test_failure_and_recovery Arguments: { "processing_guarantee": "exactly_once" } ``` --- **Following failed tests happens without this PR** ``` Module: kafkatest.tests.streams.streams_upgrade_test Class: StreamsUpgradeTest Method: test_metadata_upgrade Arguments: { "from_version": "0.10.0.1", "to_version": "0.11.0.3" } ``` ``` Module: kafkatest.tests.streams.streams_upgrade_test Class: StreamsUpgradeTest Method: test_metadata_upgrade Arguments: { "from_version": "0.11.0.3", "to_version": "2.4.1" } ``` ``` Module: kafkatest.tests.core.transactions_test Class: TransactionsTest Method: test_transactions Arguments: { "bounce_target": "brokers", "check_order": true, "failure_mode": "clean_bounce", "use_group_metadata": false } ``` ``` Module: kafkatest.tests.core.transactions_test Class: TransactionsTest Method: test_transactions Arguments: { "bounce_target": "clients", "check_order": false, "failure_mode": "hard_bounce", "use_group_metadata": true } ``` ``` Module: kafkatest.tests.core.security_rolling_upgrade_test Class: TestSecurityRollingUpgrade Method: test_rolling_upgrade_phase_two Arguments: { "broker_protocol": "SASL_SSL", "client_protocol": "SASL_SSL" } ``` ``` Module: kafkatest.tests.client.consumer_test Class: OffsetValidationTest Method: test_consumer_failure Arguments: { "clean_shutdown": true, "enable_autocommit": true } ``` ``` Module: kafkatest.tests.core.upgrade_test Class: TestUpgrade Method: test_upgrade Arguments: { "compression_types": [ "snappy" ], "from_kafka_version": "0.10.0.1", "to_message_format_version": null } ``` ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
