[
https://issues.apache.org/jira/browse/KAFKA-16672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chia-Ping Tsai updated KAFKA-16672:
-----------------------------------
Description:
It is flaky on my jenkins, and sometimes it fails in Kafka CI[0]
The error happens in virtue of race condition. `KafkaBasedLog` loads records
from topic via thread, so `RebalanceNeededException` will be thrown if we check
the task configs too soon. It seems to me `RebalanceNeededException` is a
temporary exception so we should treat it as a retryable exception in waiting.
In short, we should catch `RebalanceNeededException` in
`awaitTaskConfigurations` [1]
[0]
https://ge.apache.org/scans/tests?search.buildOutcome=failure&search.buildToolType=gradle&search.relativeStartTime=P28D&search.rootProjectNames=kafka&search.timeZoneId=Asia%2FTaipei&tests.container=org.apache.kafka.connect.mirror.integration.DedicatedMirrorIntegrationTest&tests.test=testMultiNodeCluster()
[1]
https://github.com/apache/kafka/blob/55a00be4e973f3f4c8869b6f70de1e285719e890/connect/mirror/src/test/java/org/apache/kafka/connect/mirror/integration/DedicatedMirrorIntegrationTest.java#L355
was:
It is flaky on my jenkins, and sometimes it fails in Kafka
[CI|https://ge.apache.org/scans/tests?search.buildOutcome=failure&search.buildToolType=gradle&search.relativeStartTime=P28D&search.rootProjectNames=kafka&search.timeZoneId=Asia%2FTaipei&tests.container=org.apache.kafka.connect.mirror.integration.DedicatedMirrorIntegrationTest&tests.test=testMultiNodeCluster()]
The error happens in virtue of race condition. `KafkaBasedLog` loads records
from topic via thread, so `RebalanceNeededException` will be thrown if we check
the task configs too soon. It seems to me `RebalanceNeededException` is a
temporary exception so we should treat it as a retryable exception in waiting.
> Fix flaky DedicatedMirrorIntegrationTest.testMultiNodeCluster
> -------------------------------------------------------------
>
> Key: KAFKA-16672
> URL: https://issues.apache.org/jira/browse/KAFKA-16672
> Project: Kafka
> Issue Type: Test
> Reporter: Chia-Ping Tsai
> Assignee: Chia-Ping Tsai
> Priority: Minor
>
> It is flaky on my jenkins, and sometimes it fails in Kafka CI[0]
> The error happens in virtue of race condition. `KafkaBasedLog` loads records
> from topic via thread, so `RebalanceNeededException` will be thrown if we
> check the task configs too soon. It seems to me `RebalanceNeededException` is
> a temporary exception so we should treat it as a retryable exception in
> waiting.
> In short, we should catch `RebalanceNeededException` in
> `awaitTaskConfigurations` [1]
> [0]
> https://ge.apache.org/scans/tests?search.buildOutcome=failure&search.buildToolType=gradle&search.relativeStartTime=P28D&search.rootProjectNames=kafka&search.timeZoneId=Asia%2FTaipei&tests.container=org.apache.kafka.connect.mirror.integration.DedicatedMirrorIntegrationTest&tests.test=testMultiNodeCluster()
> [1]
> https://github.com/apache/kafka/blob/55a00be4e973f3f4c8869b6f70de1e285719e890/connect/mirror/src/test/java/org/apache/kafka/connect/mirror/integration/DedicatedMirrorIntegrationTest.java#L355
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
