[jira] [Comment Edited] (KAFKA-13010) Flaky test org.apache.kafka.streams.integration.TaskMetadataIntegrationTest.shouldReportCorrectCommittedOffsetInformation()
[
https://issues.apache.org/jira/browse/KAFKA-13010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17383620#comment-17383620
]
Walker Carlson edited comment on KAFKA-13010 at 7/19/21, 10:15 PM:
---
I ran it for the commit before KIP-744 and it did fail. I am going to do a
binary search from when the test was introduced to see where it started failing.
EDIT: It looks like it always would fail eventually.
I am seeing if this is an error that will persist beyond one try
was (Author: wcarlson5):
I ran it for the commit before KIP-744 and it did fail. I am going to do a
binary search from when the test was introduced to see where it started failing.
EDIT: It looks like it always would fail eventually.
> Flaky test
> org.apache.kafka.streams.integration.TaskMetadataIntegrationTest.shouldReportCorrectCommittedOffsetInformation()
> ---
>
> Key: KAFKA-13010
> URL: https://issues.apache.org/jira/browse/KAFKA-13010
> Project: Kafka
> Issue Type: Bug
> Components: streams
>Reporter: Bruno Cadonna
>Assignee: Walker Carlson
>Priority: Major
> Labels: flaky-test
> Attachments:
> TaskMetadataIntegrationTest#shouldReportCorrectEndOffsetInformation.rtf
>
>
> Integration test {{test
> org.apache.kafka.streams.integration.TaskMetadataIntegrationTest.shouldReportCorrectCommittedOffsetInformation()}}
> sometimes fails with
> {code:java}
> java.lang.AssertionError: only one task
> at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:26)
> at
> org.apache.kafka.streams.integration.TaskMetadataIntegrationTest.getTaskMetadata(TaskMetadataIntegrationTest.java:162)
> at
> org.apache.kafka.streams.integration.TaskMetadataIntegrationTest.shouldReportCorrectCommittedOffsetInformation(TaskMetadataIntegrationTest.java:117)
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Comment Edited] (KAFKA-13010) Flaky test org.apache.kafka.streams.integration.TaskMetadataIntegrationTest.shouldReportCorrectCommittedOffsetInformation()
[
https://issues.apache.org/jira/browse/KAFKA-13010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17383620#comment-17383620
]
Walker Carlson edited comment on KAFKA-13010 at 7/19/21, 10:08 PM:
---
I ran it for the commit before KIP-744 and it did fail. I am going to do a
binary search from when the test was introduced to see where it started failing.
EDIT: It looks like it always would fail eventually.
was (Author: wcarlson5):
I ran it for the commit before KIP-744 and it did fail. I am going to do a
binary search from when the test was introduced to see where it started failing.
EDIT: It looks like it always would fail eventually. I did find this i n the
logs
{code:java}
java.nio.file.FileSystemException:
/var/folders/55/w9205z6d7csbfby6mj1jpnx0gp/T/kafka-6916100724973642606/TaskMetadataTest_TaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformation/0_0/.checkpoint:
File name too longjava.nio.file.FileSystemException:
/var/folders/55/w9205z6d7csbfby6mj1jpnx0gp/T/kafka-6916100724973642606/TaskMetadataTest_TaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformation/0_0/.checkpoint:
File name too long at
sun.nio.fs.UnixException.translateToIOException(UnixException.java:91) at
sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102) at
sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107) at
sun.nio.fs.UnixFileAttributeViews$Basic.readAttributes(UnixFileAttributeViews.java:55)
at
sun.nio.fs.UnixFileSystemProvider.readAttributes(UnixFileSystemProvider.java:144)
at java.nio.file.Files.readAttributes(Files.java:1737) at
java.nio.file.FileTreeWalker.getAttributes(FileTreeWalker.java:219) at
java.nio.file.FileTreeWalker.visit(FileTreeWalker.java:276) at
java.nio.file.FileTreeWalker.walk(FileTreeWalker.java:322) at
java.nio.file.Files.walkFileTree(Files.java:2662) at
java.nio.file.Files.walkFileTree(Files.java:2742) at
org.apache.kafka.common.utils.Utils.delete(Utils.java:815) at
[jira] [Comment Edited] (KAFKA-13010) Flaky test org.apache.kafka.streams.integration.TaskMetadataIntegrationTest.shouldReportCorrectCommittedOffsetInformation()
[
https://issues.apache.org/jira/browse/KAFKA-13010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17383620#comment-17383620
]
Walker Carlson edited comment on KAFKA-13010 at 7/19/21, 10:07 PM:
---
I ran it for the commit before KIP-744 and it did fail. I am going to do a
binary search from when the test was introduced to see where it started failing.
EDIT: It looks like it always would fail eventually. I did find this i n the
logs
{code:java}
java.nio.file.FileSystemException:
/var/folders/55/w9205z6d7csbfby6mj1jpnx0gp/T/kafka-6916100724973642606/TaskMetadataTest_TaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformation/0_0/.checkpoint:
File name too longjava.nio.file.FileSystemException:
/var/folders/55/w9205z6d7csbfby6mj1jpnx0gp/T/kafka-6916100724973642606/TaskMetadataTest_TaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformationTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformation/0_0/.checkpoint:
File name too long at
sun.nio.fs.UnixException.translateToIOException(UnixException.java:91) at
sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102) at
sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107) at
sun.nio.fs.UnixFileAttributeViews$Basic.readAttributes(UnixFileAttributeViews.java:55)
at
sun.nio.fs.UnixFileSystemProvider.readAttributes(UnixFileSystemProvider.java:144)
at java.nio.file.Files.readAttributes(Files.java:1737) at
java.nio.file.FileTreeWalker.getAttributes(FileTreeWalker.java:219) at
java.nio.file.FileTreeWalker.visit(FileTreeWalker.java:276) at
java.nio.file.FileTreeWalker.walk(FileTreeWalker.java:322) at
java.nio.file.Files.walkFileTree(Files.java:2662) at
java.nio.file.Files.walkFileTree(Files.java:2742) at
org.apache.kafka.common.utils.Utils.delete(Utils.java:815) at
org.apache.kafka.streams.state.internals.OffsetCheckpoint.write(OffsetCheckpoint.java:84)
at
org.apache.kafka.streams.processor.internals.ProcessorStateManager.checkpoint(ProcessorStateManager.java:604)
at
[jira] [Comment Edited] (KAFKA-13010) Flaky test org.apache.kafka.streams.integration.TaskMetadataIntegrationTest.shouldReportCorrectCommittedOffsetInformation()
[
https://issues.apache.org/jira/browse/KAFKA-13010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17383620#comment-17383620
]
Walker Carlson edited comment on KAFKA-13010 at 7/19/21, 10:05 PM:
---
I ran it for the commit before KIP-744 and it did fail. I am going to do a
binary search from when the test was introduced to see where it started failing.
EDIT: It looks like it always would fail eventually
was (Author: wcarlson5):
I ran it for the commit before KIP-744 and it did fail. I am going to do a
binary search from when the test was introduced to see where it started failing
> Flaky test
> org.apache.kafka.streams.integration.TaskMetadataIntegrationTest.shouldReportCorrectCommittedOffsetInformation()
> ---
>
> Key: KAFKA-13010
> URL: https://issues.apache.org/jira/browse/KAFKA-13010
> Project: Kafka
> Issue Type: Bug
> Components: streams
>Reporter: Bruno Cadonna
>Assignee: Walker Carlson
>Priority: Major
> Labels: flaky-test
> Attachments:
> TaskMetadataIntegrationTest#shouldReportCorrectEndOffsetInformation.rtf
>
>
> Integration test {{test
> org.apache.kafka.streams.integration.TaskMetadataIntegrationTest.shouldReportCorrectCommittedOffsetInformation()}}
> sometimes fails with
> {code:java}
> java.lang.AssertionError: only one task
> at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:26)
> at
> org.apache.kafka.streams.integration.TaskMetadataIntegrationTest.getTaskMetadata(TaskMetadataIntegrationTest.java:162)
> at
> org.apache.kafka.streams.integration.TaskMetadataIntegrationTest.shouldReportCorrectCommittedOffsetInformation(TaskMetadataIntegrationTest.java:117)
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Comment Edited] (KAFKA-13010) Flaky test org.apache.kafka.streams.integration.TaskMetadataIntegrationTest.shouldReportCorrectCommittedOffsetInformation()
[
https://issues.apache.org/jira/browse/KAFKA-13010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17383564#comment-17383564
]
Josep Prat edited comment on KAFKA-13010 at 7/19/21, 9:02 PM:
--
I only mentioned because it seems to be the only other change in that PR that
is not just moving implementations around.
If you run the test before the KIP-744 changes were introduced, does it also
fail after, let's say 200 iterations?
was (Author: josep.prat):
I only mentioned because it seems to be the only other change in that PR that
is not just moving implementations around.
If youbrun the test before the KIP-744 changes were introduced, does it also
fail after, let's say 200 iterations?
> Flaky test
> org.apache.kafka.streams.integration.TaskMetadataIntegrationTest.shouldReportCorrectCommittedOffsetInformation()
> ---
>
> Key: KAFKA-13010
> URL: https://issues.apache.org/jira/browse/KAFKA-13010
> Project: Kafka
> Issue Type: Bug
> Components: streams
>Reporter: Bruno Cadonna
>Assignee: Walker Carlson
>Priority: Major
> Labels: flaky-test
> Attachments:
> TaskMetadataIntegrationTest#shouldReportCorrectEndOffsetInformation.rtf
>
>
> Integration test {{test
> org.apache.kafka.streams.integration.TaskMetadataIntegrationTest.shouldReportCorrectCommittedOffsetInformation()}}
> sometimes fails with
> {code:java}
> java.lang.AssertionError: only one task
> at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:26)
> at
> org.apache.kafka.streams.integration.TaskMetadataIntegrationTest.getTaskMetadata(TaskMetadataIntegrationTest.java:162)
> at
> org.apache.kafka.streams.integration.TaskMetadataIntegrationTest.shouldReportCorrectCommittedOffsetInformation(TaskMetadataIntegrationTest.java:117)
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Comment Edited] (KAFKA-13010) Flaky test org.apache.kafka.streams.integration.TaskMetadataIntegrationTest.shouldReportCorrectCommittedOffsetInformation()
[
https://issues.apache.org/jira/browse/KAFKA-13010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17383537#comment-17383537
]
Josep Prat edited comment on KAFKA-13010 at 7/19/21, 7:40 PM:
--
If this is the reason why we are seeing this bug, by replacing line 60 in
ThreadMetadataImpl the following might cause the test to not fail:
{code:java}
this.producerClientIds = producerClientIds;
{code}
As I can't reproduce the test locally would you be able to try this
[~wcarlson5] ?
was (Author: josep.prat):
If this is the reason why we are seeing this bug, by replacing line 60 in
ThreadMetadataImpl the following might cause the test to not fail:
{code:java}
this.producerClientIds = producerClientIds;
{code}
As I can't reproduce the test locally would you be able to try this?
> Flaky test
> org.apache.kafka.streams.integration.TaskMetadataIntegrationTest.shouldReportCorrectCommittedOffsetInformation()
> ---
>
> Key: KAFKA-13010
> URL: https://issues.apache.org/jira/browse/KAFKA-13010
> Project: Kafka
> Issue Type: Bug
> Components: streams
>Reporter: Bruno Cadonna
>Assignee: Walker Carlson
>Priority: Major
> Labels: flaky-test
> Attachments:
> TaskMetadataIntegrationTest#shouldReportCorrectEndOffsetInformation.rtf
>
>
> Integration test {{test
> org.apache.kafka.streams.integration.TaskMetadataIntegrationTest.shouldReportCorrectCommittedOffsetInformation()}}
> sometimes fails with
> {code:java}
> java.lang.AssertionError: only one task
> at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:26)
> at
> org.apache.kafka.streams.integration.TaskMetadataIntegrationTest.getTaskMetadata(TaskMetadataIntegrationTest.java:162)
> at
> org.apache.kafka.streams.integration.TaskMetadataIntegrationTest.shouldReportCorrectCommittedOffsetInformation(TaskMetadataIntegrationTest.java:117)
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Comment Edited] (KAFKA-13010) Flaky test org.apache.kafka.streams.integration.TaskMetadataIntegrationTest.shouldReportCorrectCommittedOffsetInformation()
[
https://issues.apache.org/jira/browse/KAFKA-13010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17383474#comment-17383474
]
Walker Carlson edited comment on KAFKA-13010 at 7/19/21, 5:20 PM:
--
It is possible [~ableegoldman] . I ran till failure (75 runs). And it seems
that the metadata was reporting no tasks, so I would agree.
{code:java}
[ThreadMetadata{threadName=TaskMetadataTest_TaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformation-c1a902ee-54b1-4b8e-a195-98d4a6143c1e-StreamThread-2,
threadState=RUNNING, activeTasks=[], standbyTasks=[],
consumerClientId=TaskMetadataTest_TaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformation-c1a902ee-54b1-4b8e-a195-98d4a6143c1e-StreamThread-2-consumer,
restoreConsumerClientId=TaskMetadataTest_TaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformation-c1a902ee-54b1-4b8e-a195-98d4a6143c1e-StreamThread-2-restore-consumer,
producerClientIds=[TaskMetadataTest_TaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformation-c1a902ee-54b1-4b8e-a195-98d4a6143c1e-StreamThread-2-producer],
adminClientId=TaskMetadataTest_TaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformation-c1a902ee-54b1-4b8e-a195-98d4a6143c1e-admin},
ThreadMetadata{threadName=TaskMetadataTest_TaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformation-c1a902ee-54b1-4b8e-a195-98d4a6143c1e-StreamThread-1,
threadState=RUNNING, activeTasks=[], standbyTasks=[],
consumerClientId=TaskMetadataTest_TaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformation-c1a902ee-54b1-4b8e-a195-98d4a6143c1e-StreamThread-1-consumer,
restoreConsumerClientId=TaskMetadataTest_TaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformation-c1a902ee-54b1-4b8e-a195-98d4a6143c1e-StreamThread-1-restore-consumer,
producerClientIds=[TaskMetadataTest_TaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformation-c1a902ee-54b1-4b8e-a195-98d4a6143c1e-StreamThread-1-producer],
adminClientId=TaskMetadataTest_TaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformation-c1a902ee-54b1-4b8e-a195-98d4a6143c1e-admin}]
{code}
was (Author: wcarlson5):
It is possible. I ran till failure (75 runs). And it seems that the metadata
was reporting no tasks, so I would agree.
{code:java}
[ThreadMetadata{threadName=TaskMetadataTest_TaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformation-c1a902ee-54b1-4b8e-a195-98d4a6143c1e-StreamThread-2,
threadState=RUNNING, activeTasks=[], standbyTasks=[],
consumerClientId=TaskMetadataTest_TaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformation-c1a902ee-54b1-4b8e-a195-98d4a6143c1e-StreamThread-2-consumer,
restoreConsumerClientId=TaskMetadataTest_TaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformation-c1a902ee-54b1-4b8e-a195-98d4a6143c1e-StreamThread-2-restore-consumer,
producerClientIds=[TaskMetadataTest_TaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformation-c1a902ee-54b1-4b8e-a195-98d4a6143c1e-StreamThread-2-producer],
adminClientId=TaskMetadataTest_TaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformation-c1a902ee-54b1-4b8e-a195-98d4a6143c1e-admin},
ThreadMetadata{threadName=TaskMetadataTest_TaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformation-c1a902ee-54b1-4b8e-a195-98d4a6143c1e-StreamThread-1,
threadState=RUNNING, activeTasks=[], standbyTasks=[],
consumerClientId=TaskMetadataTest_TaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformation-c1a902ee-54b1-4b8e-a195-98d4a6143c1e-StreamThread-1-consumer,
restoreConsumerClientId=TaskMetadataTest_TaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformation-c1a902ee-54b1-4b8e-a195-98d4a6143c1e-StreamThread-1-restore-consumer,
producerClientIds=[TaskMetadataTest_TaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformation-c1a902ee-54b1-4b8e-a195-98d4a6143c1e-StreamThread-1-producer],
adminClientId=TaskMetadataTest_TaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformation-c1a902ee-54b1-4b8e-a195-98d4a6143c1e-admin}]
{code}
> Flaky test
> org.apache.kafka.streams.integration.TaskMetadataIntegrationTest.shouldReportCorrectCommittedOffsetInformation()
> ---
>
> Key: KAFKA-13010
> URL: https://issues.apache.org/jira/browse/KAFKA-13010
> Project: Kafka
> Issue Type: Bug
> Components: streams
>Reporter: Bruno Cadonna
>Assignee: Walker Carlson
>Priority: Major
> Labels: flaky-test
> Attachments:
> TaskMetadataIntegrationTest#shouldReportCorrectEndOffsetInformation.rtf
>
>
> Integration test {{test
>
[jira] [Comment Edited] (KAFKA-13010) Flaky test org.apache.kafka.streams.integration.TaskMetadataIntegrationTest.shouldReportCorrectCommittedOffsetInformation()
[
https://issues.apache.org/jira/browse/KAFKA-13010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17380212#comment-17380212
]
A. Sophie Blee-Goldman edited comment on KAFKA-13010 at 7/13/21, 10:39 PM:
---
Failed again
[https://ci-builds.apache.org/job/Kafka/job/kafka-pr/job/PR-10985/6/testReport/junit/org.apache.kafka.streams.integration/TaskMetadataIntegrationTest/Build___JDK_11_and_Scala_2_13___shouldReportCorrectCommittedOffsetInformation/]
FWIW I didn't see the above log message about that subscribed topic not being
assigned to any members. The logs were truncated so it's possible that it
actually was there, but I don't think that's the case since AFAICT the
truncated logs are mostly from kafka/zookeeper. The relevant logs from the
rebalance seem to be present
was (Author: ableegoldman):
Failed again
https://ci-builds.apache.org/job/Kafka/job/kafka-pr/job/PR-10985/6/testReport/junit/org.apache.kafka.streams.integration/TaskMetadataIntegrationTest/Build___JDK_11_and_Scala_2_13___shouldReportCorrectCommittedOffsetInformation/
> Flaky test
> org.apache.kafka.streams.integration.TaskMetadataIntegrationTest.shouldReportCorrectCommittedOffsetInformation()
> ---
>
> Key: KAFKA-13010
> URL: https://issues.apache.org/jira/browse/KAFKA-13010
> Project: Kafka
> Issue Type: Bug
> Components: streams
>Reporter: Bruno Cadonna
>Priority: Major
> Labels: flaky-test
>
> Integration test {{test
> org.apache.kafka.streams.integration.TaskMetadataIntegrationTest.shouldReportCorrectCommittedOffsetInformation()}}
> sometimes fails with
> {code:java}
> java.lang.AssertionError: only one task
> at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:26)
> at
> org.apache.kafka.streams.integration.TaskMetadataIntegrationTest.getTaskMetadata(TaskMetadataIntegrationTest.java:162)
> at
> org.apache.kafka.streams.integration.TaskMetadataIntegrationTest.shouldReportCorrectCommittedOffsetInformation(TaskMetadataIntegrationTest.java:117)
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Comment Edited] (KAFKA-13010) Flaky test org.apache.kafka.streams.integration.TaskMetadataIntegrationTest.shouldReportCorrectCommittedOffsetInformation()
[
https://issues.apache.org/jira/browse/KAFKA-13010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17372977#comment-17372977
]
Bruno Cadonna edited comment on KAFKA-13010 at 7/1/21, 6:01 PM:
Some logs that might be interesting:
{code}
[2021-06-29 12:19:40,200] INFO stream-thread
[TaskMetadataTest_TaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformation-6889e6c9-c4fa-427c-83bf-469b33a34bb5-StreamThread-2-consumer]
Finished unstable assignment of tasks, a followup rebalance will be scheduled.
(org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:818)
[2021-06-29 12:19:40,200] WARN [Consumer
clientId=TaskMetadataTest_TaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformation-6889e6c9-c4fa-427c-83bf-469b33a34bb5-StreamThread-2-consumer,
groupId=TaskMetadataTest_TaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformation]
The following subscribed topics are not assigned to any members:
[inputTaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformation]
(org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:611)
[2021-06-29 12:19:40,200] INFO [GroupCoordinator 0]: Assignment received from
leader
TaskMetadataTest_TaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformation-6889e6c9-c4fa-427c-83bf-469b33a34bb5-StreamThread-2-consumer-0a548162-9e3f-4003-98c5-54ece6f5e1b8
for group
TaskMetadataTest_TaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformation
for generation 2. The group has 2 members, 0 of which are static.
(kafka.coordinator.group.GroupCoordinator:66)
[2021-06-29 12:19:40,201] INFO stream-thread
[TaskMetadataTest_TaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformation-6889e6c9-c4fa-427c-83bf-469b33a34bb5-StreamThread-1-consumer]
Requested to schedule immediate rebalance for new tasks to be safely revoked
from current owner.
(org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1300)
[2021-06-29 12:19:40,201] INFO stream-thread
[TaskMetadataTest_TaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformation-6889e6c9-c4fa-427c-83bf-469b33a34bb5-StreamThread-2]
State transition from RUNNING to PARTITIONS_REVOKED
(org.apache.kafka.streams.processor.internals.StreamThread:229)
[2021-06-29 12:19:40,201] INFO stream-thread
[TaskMetadataTest_TaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformation-6889e6c9-c4fa-427c-83bf-469b33a34bb5-StreamThread-1]
Handle new assignment with:
New active tasks: []
New standby tasks: []
Existing active tasks: []
Existing standby tasks: []
(org.apache.kafka.streams.processor.internals.TaskManager:263)
[2021-06-29 12:19:40,201] INFO stream-thread
[TaskMetadataTest_TaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformation-6889e6c9-c4fa-427c-83bf-469b33a34bb5-StreamThread-1]
State transition from STARTING to PARTITIONS_ASSIGNED
(org.apache.kafka.streams.processor.internals.StreamThread:229)
[2021-06-29 12:19:40,202] INFO stream-thread
[TaskMetadataTest_TaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformation-6889e6c9-c4fa-427c-83bf-469b33a34bb5-StreamThread-2]
task [0_0] Suspended RUNNING
(org.apache.kafka.streams.processor.internals.StreamTask:1187)
[2021-06-29 12:19:40,202] INFO stream-thread
[TaskMetadataTest_TaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformation-6889e6c9-c4fa-427c-83bf-469b33a34bb5-StreamThread-2]
task [0_0] Suspended running
(org.apache.kafka.streams.processor.internals.StreamTask:300)
[2021-06-29 12:19:40,202] INFO stream-thread
[TaskMetadataTest_TaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformation-6889e6c9-c4fa-427c-83bf-469b33a34bb5-StreamThread-2]
partition revocation took 1 ms.
(org.apache.kafka.streams.processor.internals.StreamThread:97)
[2021-06-29 12:19:40,202] INFO stream-thread
[TaskMetadataTest_TaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformation-6889e6c9-c4fa-427c-83bf-469b33a34bb5-StreamThread-2-consumer]
No followup rebalance was requested, resetting the rebalance schedule.
(org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1306)
[2021-06-29 12:19:40,202] INFO stream-thread
[TaskMetadataTest_TaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformation-6889e6c9-c4fa-427c-83bf-469b33a34bb5-StreamThread-2]
Handle new assignment with:
New active tasks: []
New standby tasks: []
Existing active tasks: [0_0]
Existing standby tasks: []
(org.apache.kafka.streams.processor.internals.TaskManager:263)
[2021-06-29 12:19:40,202] INFO stream-thread
[TaskMetadataTest_TaskMetadataIntegrationTestshouldReportCorrectCommittedOffsetInformation-6889e6c9-c4fa-427c-83bf-469b33a34bb5-StreamThread-2]
task [0_0] Closing record collector clean
