[jira] [Updated] (KAFKA-16623) KafkaAsyncConsumer system tests warn about revoking partitions that weren't previously assigned
[ https://issues.apache.org/jira/browse/KAFKA-16623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16623: -- Fix Version/s: 4.0.0 (was: 3.9.0) > KafkaAsyncConsumer system tests warn about revoking partitions that weren't > previously assigned > --- > > Key: KAFKA-16623 > URL: https://issues.apache.org/jira/browse/KAFKA-16623 > Project: Kafka > Issue Type: Bug > Components: clients, consumer, system tests >Affects Versions: 3.8.0 >Reporter: Kirk True >Assignee: Lianet Magrans >Priority: Critical > Labels: consumer-threading-refactor, kip-848-client-support, > system-tests > Fix For: 4.0.0 > > > When running system tests for the KafkaAsyncConsumer, we occasionally see > this warning: > {noformat} > File "/usr/lib/python3.7/threading.py", line 917, in _bootstrap_inner > self.run() > File "/usr/lib/python3.7/threading.py", line 865, in run > self._target(*self._args, **self._kwargs) > File > "/home/jenkins/workspace/system-test-kafka-branch-builder/kafka/venv/lib/python3.7/site-packages/ducktape/services/background_thread.py", > line 38, in _protected_worker > self._worker(idx, node) > File > "/home/jenkins/workspace/system-test-kafka-branch-builder/kafka/tests/kafkatest/services/verifiable_consumer.py", > line 304, in _worker > handler.handle_partitions_revoked(event, node, self.logger) > File > "/home/jenkins/workspace/system-test-kafka-branch-builder/kafka/tests/kafkatest/services/verifiable_consumer.py", > line 163, in handle_partitions_revoked > (tp, node.account.hostname) > AssertionError: Topic partition TopicPartition(topic='test_topic', > partition=0) cannot be revoked from worker20 as it was not previously > assigned to that consumer > {noformat} > In test_fencing_static_consumer, there are two sets of consumers that use > group instance IDs: the initial set and the "conflict" set. It appears that > one of the "conflicting" consumers hijacks the partition ownership from the > coordinator's perspective when the initial consumer leaves the group. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (KAFKA-16623) KafkaAsyncConsumer system tests warn about revoking partitions that weren't previously assigned
[ https://issues.apache.org/jira/browse/KAFKA-16623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16623: -- Fix Version/s: 3.9.0 (was: 3.8.0) > KafkaAsyncConsumer system tests warn about revoking partitions that weren't > previously assigned > --- > > Key: KAFKA-16623 > URL: https://issues.apache.org/jira/browse/KAFKA-16623 > Project: Kafka > Issue Type: Bug > Components: clients, consumer, system tests >Affects Versions: 3.8.0 >Reporter: Kirk True >Assignee: Lianet Magrans >Priority: Critical > Labels: consumer-threading-refactor, kip-848-client-support, > system-tests > Fix For: 3.9.0 > > > When running system tests for the KafkaAsyncConsumer, we occasionally see > this warning: > {noformat} > File "/usr/lib/python3.7/threading.py", line 917, in _bootstrap_inner > self.run() > File "/usr/lib/python3.7/threading.py", line 865, in run > self._target(*self._args, **self._kwargs) > File > "/home/jenkins/workspace/system-test-kafka-branch-builder/kafka/venv/lib/python3.7/site-packages/ducktape/services/background_thread.py", > line 38, in _protected_worker > self._worker(idx, node) > File > "/home/jenkins/workspace/system-test-kafka-branch-builder/kafka/tests/kafkatest/services/verifiable_consumer.py", > line 304, in _worker > handler.handle_partitions_revoked(event, node, self.logger) > File > "/home/jenkins/workspace/system-test-kafka-branch-builder/kafka/tests/kafkatest/services/verifiable_consumer.py", > line 163, in handle_partitions_revoked > (tp, node.account.hostname) > AssertionError: Topic partition TopicPartition(topic='test_topic', > partition=0) cannot be revoked from worker20 as it was not previously > assigned to that consumer > {noformat} > In test_fencing_static_consumer, there are two sets of consumers that use > group instance IDs: the initial set and the "conflict" set. It appears that > one of the "conflicting" consumers hijacks the partition ownership from the > coordinator's perspective when the initial consumer leaves the group. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (KAFKA-16623) KafkaAsyncConsumer system tests warn about revoking partitions that weren't previously assigned
[ https://issues.apache.org/jira/browse/KAFKA-16623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16623: -- Description: When running system tests for the KafkaAsyncConsumer, we occasionally see this warning: {noformat} File "/usr/lib/python3.7/threading.py", line 917, in _bootstrap_inner self.run() File "/usr/lib/python3.7/threading.py", line 865, in run self._target(*self._args, **self._kwargs) File "/home/jenkins/workspace/system-test-kafka-branch-builder/kafka/venv/lib/python3.7/site-packages/ducktape/services/background_thread.py", line 38, in _protected_worker self._worker(idx, node) File "/home/jenkins/workspace/system-test-kafka-branch-builder/kafka/tests/kafkatest/services/verifiable_consumer.py", line 304, in _worker handler.handle_partitions_revoked(event, node, self.logger) File "/home/jenkins/workspace/system-test-kafka-branch-builder/kafka/tests/kafkatest/services/verifiable_consumer.py", line 163, in handle_partitions_revoked (tp, node.account.hostname) AssertionError: Topic partition TopicPartition(topic='test_topic', partition=0) cannot be revoked from worker20 as it was not previously assigned to that consumer {noformat} In test_fencing_static_consumer, there are two sets of consumers that use group instance IDs: the initial set and the "conflict" set. It appears that one of the "conflicting" consumers hijacks the partition ownership from the coordinator's perspective when the initial consumer leaves the group. was: When running system tests for the KafkaAsyncConsumer, we occasionally see this warning: {noformat} File "/usr/lib/python3.7/threading.py", line 917, in _bootstrap_inner self.run() File "/usr/lib/python3.7/threading.py", line 865, in run self._target(*self._args, **self._kwargs) File "/home/jenkins/workspace/system-test-kafka-branch-builder/kafka/venv/lib/python3.7/site-packages/ducktape/services/background_thread.py", line 38, in _protected_worker self._worker(idx, node) File "/home/jenkins/workspace/system-test-kafka-branch-builder/kafka/tests/kafkatest/services/verifiable_consumer.py", line 304, in _worker handler.handle_partitions_revoked(event, node, self.logger) File "/home/jenkins/workspace/system-test-kafka-branch-builder/kafka/tests/kafkatest/services/verifiable_consumer.py", line 163, in handle_partitions_revoked (tp, node.account.hostname) AssertionError: Topic partition TopicPartition(topic='test_topic', partition=0) cannot be revoked from worker20 as it was not previously assigned to that consumer {noformat} In > KafkaAsyncConsumer system tests warn about revoking partitions that weren't > previously assigned > --- > > Key: KAFKA-16623 > URL: https://issues.apache.org/jira/browse/KAFKA-16623 > Project: Kafka > Issue Type: Bug > Components: clients, consumer, system tests >Affects Versions: 3.8.0 >Reporter: Kirk True >Assignee: Kirk True >Priority: Critical > Labels: consumer-threading-refactor, kip-848-client-support, > system-tests > Fix For: 3.8.0 > > > When running system tests for the KafkaAsyncConsumer, we occasionally see > this warning: > {noformat} > File "/usr/lib/python3.7/threading.py", line 917, in _bootstrap_inner > self.run() > File "/usr/lib/python3.7/threading.py", line 865, in run > self._target(*self._args, **self._kwargs) > File > "/home/jenkins/workspace/system-test-kafka-branch-builder/kafka/venv/lib/python3.7/site-packages/ducktape/services/background_thread.py", > line 38, in _protected_worker > self._worker(idx, node) > File > "/home/jenkins/workspace/system-test-kafka-branch-builder/kafka/tests/kafkatest/services/verifiable_consumer.py", > line 304, in _worker > handler.handle_partitions_revoked(event, node, self.logger) > File > "/home/jenkins/workspace/system-test-kafka-branch-builder/kafka/tests/kafkatest/services/verifiable_consumer.py", > line 163, in handle_partitions_revoked > (tp, node.account.hostname) > AssertionError: Topic partition TopicPartition(topic='test_topic', > partition=0) cannot be revoked from worker20 as it was not previously > assigned to that consumer > {noformat} > In test_fencing_static_consumer, there are two sets of consumers that use > group instance IDs: the initial set and the "conflict" set. It appears that > one of the "conflicting" consumers hijacks the partition ownership from the > coordinator's perspective when the initial consumer leaves the group. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (KAFKA-16623) KafkaAsyncConsumer system tests warn about revoking partitions that weren't previously assigned
[ https://issues.apache.org/jira/browse/KAFKA-16623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16623: -- Description: When running system tests for the KafkaAsyncConsumer, we occasionally see this warning: {noformat} File "/usr/lib/python3.7/threading.py", line 917, in _bootstrap_inner self.run() File "/usr/lib/python3.7/threading.py", line 865, in run self._target(*self._args, **self._kwargs) File "/home/jenkins/workspace/system-test-kafka-branch-builder/kafka/venv/lib/python3.7/site-packages/ducktape/services/background_thread.py", line 38, in _protected_worker self._worker(idx, node) File "/home/jenkins/workspace/system-test-kafka-branch-builder/kafka/tests/kafkatest/services/verifiable_consumer.py", line 304, in _worker handler.handle_partitions_revoked(event, node, self.logger) File "/home/jenkins/workspace/system-test-kafka-branch-builder/kafka/tests/kafkatest/services/verifiable_consumer.py", line 163, in handle_partitions_revoked (tp, node.account.hostname) AssertionError: Topic partition TopicPartition(topic='test_topic', partition=0) cannot be revoked from worker20 as it was not previously assigned to that consumer {noformat} In was: When running system tests for the KafkaAsyncConsumer, we occasionally see this warning: {noformat} File "/usr/lib/python3.7/threading.py", line 917, in _bootstrap_inner self.run() File "/usr/lib/python3.7/threading.py", line 865, in run self._target(*self._args, **self._kwargs) File "/home/jenkins/workspace/system-test-kafka-branch-builder/kafka/venv/lib/python3.7/site-packages/ducktape/services/background_thread.py", line 38, in _protected_worker self._worker(idx, node) File "/home/jenkins/workspace/system-test-kafka-branch-builder/kafka/tests/kafkatest/services/verifiable_consumer.py", line 304, in _worker handler.handle_partitions_revoked(event, node, self.logger) File "/home/jenkins/workspace/system-test-kafka-branch-builder/kafka/tests/kafkatest/services/verifiable_consumer.py", line 163, in handle_partitions_revoked (tp, node.account.hostname) AssertionError: Topic partition TopicPartition(topic='test_topic', partition=0) cannot be revoked from worker20 as it was not previously assigned to that consumer {noformat} It is unclear what is causing this. > KafkaAsyncConsumer system tests warn about revoking partitions that weren't > previously assigned > --- > > Key: KAFKA-16623 > URL: https://issues.apache.org/jira/browse/KAFKA-16623 > Project: Kafka > Issue Type: Bug > Components: clients, consumer, system tests >Affects Versions: 3.8.0 >Reporter: Kirk True >Assignee: Kirk True >Priority: Critical > Labels: consumer-threading-refactor, kip-848-client-support, > system-tests > Fix For: 3.8.0 > > > When running system tests for the KafkaAsyncConsumer, we occasionally see > this warning: > {noformat} > File "/usr/lib/python3.7/threading.py", line 917, in _bootstrap_inner > self.run() > File "/usr/lib/python3.7/threading.py", line 865, in run > self._target(*self._args, **self._kwargs) > File > "/home/jenkins/workspace/system-test-kafka-branch-builder/kafka/venv/lib/python3.7/site-packages/ducktape/services/background_thread.py", > line 38, in _protected_worker > self._worker(idx, node) > File > "/home/jenkins/workspace/system-test-kafka-branch-builder/kafka/tests/kafkatest/services/verifiable_consumer.py", > line 304, in _worker > handler.handle_partitions_revoked(event, node, self.logger) > File > "/home/jenkins/workspace/system-test-kafka-branch-builder/kafka/tests/kafkatest/services/verifiable_consumer.py", > line 163, in handle_partitions_revoked > (tp, node.account.hostname) > AssertionError: Topic partition TopicPartition(topic='test_topic', > partition=0) cannot be revoked from worker20 as it was not previously > assigned to that consumer > {noformat} > In -- This message was sent by Atlassian Jira (v8.20.10#820010)