junrao commented on PR #19964: URL: https://github.com/apache/kafka/pull/19964#issuecomment-3028806833
@lucasbru : Thanks for the update. As for the integration test failure. I saw the following locally. ``` Formatting metadata directory /var/folders/t1/_lmg790n4dg46yk7lzvzg45r0000gp/T/kafka-13068287464958241505/controller_3000 with metadata.version 4.2-IV1. Formatting metadata directory /var/folders/t1/_lmg790n4dg46yk7lzvzg45r0000gp/T/kafka-13068287464958241505/broker_1_data0 with metadata.version 4.2-IV1. Formatting metadata directory /var/folders/t1/_lmg790n4dg46yk7lzvzg45r0000gp/T/kafka-13068287464958241505/broker_0_data0 with metadata.version 4.2-IV1. [2025-07-02 09:49:51,304] WARN [QuorumController id=3000] Performing controller activation. The metadata log appears to be empty. Appending 6 bootstrap record(s) in metadata transaction at metadata.version 4.2-IV1 from bootstrap source 'testkit'. (org.apache.kafka.controller.QuorumController:106) [2025-07-02 09:49:51,469] WARN [Producer clientId=producer-2] The metadata response from the cluster reported a recoverable issue with correlation id 1 : {topic=UNKNOWN_TOPIC_OR_PARTITION} (org.apache.kafka.clients.NetworkClient:1295) [2025-07-02 09:49:51,677] WARN [Producer clientId=producer-2] The metadata response from the cluster reported a recoverable issue with correlation id 7 : {topic=UNKNOWN_TOPIC_OR_PARTITION} (org.apache.kafka.clients.NetworkClient:1295) [2025-07-02 09:49:52,372] WARN [NodeToControllerChannelManager id=3000 name=registration] Attempting to close NetworkClient that has already been closed. (org.apache.kafka.clients.NetworkClient:744) Formatting metadata directory /var/folders/t1/_lmg790n4dg46yk7lzvzg45r0000gp/T/kafka-14231399981533981299/controller_3000 with metadata.version 4.2-IV1. Formatting metadata directory /var/folders/t1/_lmg790n4dg46yk7lzvzg45r0000gp/T/kafka-14231399981533981299/broker_1_data0 with metadata.version 4.2-IV1. Formatting metadata directory /var/folders/t1/_lmg790n4dg46yk7lzvzg45r0000gp/T/kafka-14231399981533981299/broker_0_data0 with metadata.version 4.2-IV1. [2025-07-02 09:49:52,491] WARN [QuorumController id=3000] Performing controller activation. The metadata log appears to be empty. Appending 6 bootstrap record(s) in metadata transaction at metadata.version 4.2-IV1 from bootstrap source 'testkit'. (org.apache.kafka.controller.QuorumController:106) [2025-07-02 09:49:52,648] WARN [Producer clientId=producer-3] The metadata response from the cluster reported a recoverable issue with correlation id 1 : {topic=UNKNOWN_TOPIC_OR_PARTITION} (org.apache.kafka.clients.NetworkClient:1295) [2025-07-02 09:49:52,858] WARN [Producer clientId=producer-3] The metadata response from the cluster reported a recoverable issue with correlation id 8 : {topic=UNKNOWN_TOPIC_OR_PARTITION} (org.apache.kafka.clients.NetworkClient:1295) [2025-07-02 09:49:53,568] WARN [NodeToControllerChannelManager id=3000 name=registration] Attempting to close NetworkClient that has already been closed. (org.apache.kafka.clients.NetworkClient:744) Formatting metadata directory /var/folders/t1/_lmg790n4dg46yk7lzvzg45r0000gp/T/kafka-6584854305397606511/broker_0_data0 with metadata.version 4.2-IV1. Formatting metadata directory /var/folders/t1/_lmg790n4dg46yk7lzvzg45r0000gp/T/kafka-6584854305397606511/controller_3000 with metadata.version 4.2-IV1. Formatting metadata directory /var/folders/t1/_lmg790n4dg46yk7lzvzg45r0000gp/T/kafka-6584854305397606511/broker_1_data0 with metadata.version 4.2-IV1. [2025-07-02 09:49:53,671] WARN [QuorumController id=3000] Performing controller activation. The metadata log appears to be empty. Appending 6 bootstrap record(s) in metadata transaction at metadata.version 4.2-IV1 from bootstrap source 'testkit'. (org.apache.kafka.controller.QuorumController:106) [2025-07-02 09:49:53,820] WARN [Producer clientId=producer-4] The metadata response from the cluster reported a recoverable issue with correlation id 1 : {topic=UNKNOWN_TOPIC_OR_PARTITION} (org.apache.kafka.clients.NetworkClient:1295) [2025-07-02 09:49:54,566] WARN [NodeToControllerChannelManager id=3000 name=registration] Attempting to close NetworkClient that has already been closed. (org.apache.kafka.clients.NetworkClient:744) Formatting metadata directory /var/folders/t1/_lmg790n4dg46yk7lzvzg45r0000gp/T/kafka-7033202108695639212/controller_3000 with metadata.version 4.2-IV1. Formatting metadata directory /var/folders/t1/_lmg790n4dg46yk7lzvzg45r0000gp/T/kafka-7033202108695639212/broker_0_data0 with metadata.version 4.2-IV1. Formatting metadata directory /var/folders/t1/_lmg790n4dg46yk7lzvzg45r0000gp/T/kafka-7033202108695639212/broker_1_data0 with metadata.version 4.2-IV1. [2025-07-02 09:49:54,652] WARN [QuorumController id=3000] Performing controller activation. The metadata log appears to be empty. Appending 6 bootstrap record(s) in metadata transaction at metadata.version 4.2-IV1 from bootstrap source 'testkit'. (org.apache.kafka.controller.QuorumController:106) [2025-07-02 09:49:54,811] WARN [Producer clientId=producer-5] The metadata response from the cluster reported a recoverable issue with correlation id 1 : {topic=UNKNOWN_TOPIC_OR_PARTITION} (org.apache.kafka.clients.NetworkClient:1295) [2025-07-02 09:49:55,023] WARN [Producer clientId=producer-5] The metadata response from the cluster reported a recoverable issue with correlation id 7 : {topic=UNKNOWN_TOPIC_OR_PARTITION} (org.apache.kafka.clients.NetworkClient:1295) [2025-07-02 09:49:55,590] WARN [NodeToControllerChannelManager id=3000 name=registration] Attempting to close NetworkClient that has already been closed. (org.apache.kafka.clients.NetworkClient:744) Formatting metadata directory /var/folders/t1/_lmg790n4dg46yk7lzvzg45r0000gp/T/kafka-4645572128043181693/controller_3000 with metadata.version 4.2-IV1. Formatting metadata directory /var/folders/t1/_lmg790n4dg46yk7lzvzg45r0000gp/T/kafka-4645572128043181693/broker_1_data0 with metadata.version 4.2-IV1. Formatting metadata directory /var/folders/t1/_lmg790n4dg46yk7lzvzg45r0000gp/T/kafka-4645572128043181693/broker_0_data0 with metadata.version 4.2-IV1. [2025-07-02 09:49:55,693] WARN [QuorumController id=3000] Performing controller activation. The metadata log appears to be empty. Appending 6 bootstrap record(s) in metadata transaction at metadata.version 4.2-IV1 from bootstrap source 'testkit'. (org.apache.kafka.controller.QuorumController:106) [2025-07-02 09:49:55,847] WARN [Producer clientId=producer-6] The metadata response from the cluster reported a recoverable issue with correlation id 1 : {topic=UNKNOWN_TOPIC_OR_PARTITION} (org.apache.kafka.clients.NetworkClient:1295) [2025-07-02 09:49:56,058] WARN [Producer clientId=producer-6] The metadata response from the cluster reported a recoverable issue with correlation id 7 : {topic=UNKNOWN_TOPIC_OR_PARTITION} (org.apache.kafka.clients.NetworkClient:1295) [2025-07-02 09:49:56,568] WARN [NodeToControllerChannelManager id=3000 name=registration] Attempting to close NetworkClient that has already been closed. (org.apache.kafka.clients.NetworkClient:744) ``` Not sure why the cluster keeps reformatting. However, the default [delivery.timeout.ms](https://kafka.apache.org/documentation/#producerconfigs_delivery.timeout.ms) is 120 secs, which is too long for the test. In our case, it's ok for a producer.send() to fail. We just want to make sure that every callback is called. So, we could at least reduce [delivery.timeout.ms](https://kafka.apache.org/documentation/#producerconfigs_delivery.timeout.ms). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org