Re: [PR] KAFKA-16156: beginningOrEndOffsets does not need to build an OffsetAndTimestamps object upon completion [kafka]

2024-04-02 Thread via GitHub
philipnee commented on PR #15525: URL: https://github.com/apache/kafka/pull/15525#issuecomment-2033505687 hi @lianetm - Much appreciate for the reviews. I think I've addressed your comments. LMK if there's anything more. cc @lucasbru -- This is an automated message from the Apache Git S

Re: [PR] KAFKA-16156: beginningOrEndOffsets does not need to build an OffsetAndTimestamps object upon completion [kafka]

2024-04-02 Thread via GitHub
philipnee commented on code in PR #15525: URL: https://github.com/apache/kafka/pull/15525#discussion_r1548891748 ## core/src/test/scala/integration/kafka/api/PlaintextConsumerTest.scala: ## @@ -805,4 +805,73 @@ class PlaintextConsumerTest extends BaseConsumerTest { consum

Re: [PR] KAFKA-16156: beginningOrEndOffsets does not need to build an OffsetAndTimestamps object upon completion [kafka]

2024-04-02 Thread via GitHub
philipnee commented on code in PR #15525: URL: https://github.com/apache/kafka/pull/15525#discussion_r1548887021 ## core/src/test/scala/integration/kafka/api/PlaintextConsumerCommitTest.scala: ## @@ -304,6 +304,60 @@ class PlaintextConsumerCommitTest extends AbstractConsumerTes

[jira] [Commented] (KAFKA-16430) The group-metadata-manager thread is always in a loading state and occupies one CPU, unable to end.

2024-04-02 Thread Gao Fei (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17833389#comment-17833389 ] Gao Fei commented on KAFKA-16430: - [~chia7712] what you mean?  Is the newer kafka script

[jira] [Commented] (KAFKA-16412) Uncreated topics is considered as created topics

2024-04-02 Thread gendong1 (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17833387#comment-17833387 ] gendong1 commented on KAFKA-16412: -- sorry for later reply. I will try to trigger this p

Re: [PR] KAFKA-15801: improve Kafka broker/NetworkClient logging for connectiv… [kafka]

2024-04-02 Thread via GitHub
github-actions[bot] commented on PR #14799: URL: https://github.com/apache/kafka/pull/14799#issuecomment-2033467022 This PR is being marked as stale since it has not had any activity in 90 days. If you would like to keep this PR alive, please ask a committer for review. If the PR has merge

Re: [PR] KAFKA-16070: move setReadOnly to Headers [kafka]

2024-04-02 Thread via GitHub
github-actions[bot] commented on PR #15097: URL: https://github.com/apache/kafka/pull/15097#issuecomment-2033466946 This PR is being marked as stale since it has not had any activity in 90 days. If you would like to keep this PR alive, please ask a committer for review. If the PR has merge

Re: [PR] KAFKA-16068: Use TestPlugins in ConnectorValidationIntegrationTest to silence plugin scanning errors [kafka]

2024-04-02 Thread via GitHub
Joker-5 commented on code in PR #15642: URL: https://github.com/apache/kafka/pull/15642#discussion_r1547690392 ## connect/runtime/src/test/java/org/apache/kafka/connect/integration/ConnectorValidationIntegrationTest.java: ## @@ -69,6 +69,9 @@ public static void setup() {

[jira] [Assigned] (KAFKA-16466) QuorumController is swallowing some exception messages

2024-04-02 Thread Chia Chuan Yu (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia Chuan Yu reassigned KAFKA-16466: - Assignee: Chia Chuan Yu > QuorumController is swallowing some exception messages >

[jira] [Updated] (KAFKA-16467) Add README to docs folder

2024-04-02 Thread PoAn Yang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] PoAn Yang updated KAFKA-16467: -- Description: We don't have a guide in project root folder or docs folder to show how to run local web

[jira] [Updated] (KAFKA-16467) Add README to docs folder

2024-04-02 Thread PoAn Yang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] PoAn Yang updated KAFKA-16467: -- Issue Type: Improvement (was: Test) > Add README to docs folder > - > >

[jira] [Created] (KAFKA-16467) Add README to docs folder

2024-04-02 Thread PoAn Yang (Jira)
PoAn Yang created KAFKA-16467: - Summary: Add README to docs folder Key: KAFKA-16467 URL: https://issues.apache.org/jira/browse/KAFKA-16467 Project: Kafka Issue Type: Test Reporter: Po

Re: [PR] KAFKA-16297: Race condition while promoting future replica [kafka]

2024-04-02 Thread via GitHub
showuon commented on PR #15557: URL: https://github.com/apache/kafka/pull/15557#issuecomment-2033422766 There are quite many failed tests because of this change. Could you take a look? https://ci-builds.apache.org/job/Kafka/job/kafka-pr/job/PR-15557/4 -- This is an automated message fr

[jira] [Commented] (KAFKA-15615) Improve handling of fetching during metadata updates

2024-04-02 Thread appchemist (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17833359#comment-17833359 ] appchemist commented on KAFKA-15615: HI, [~kirktrue]  I want take this issue.   D

[jira] [Commented] (KAFKA-13907) Fix hanging ServerShutdownTest.testCleanShutdownWithKRaftControllerUnavailable

2024-04-02 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17833354#comment-17833354 ] Chia-Ping Tsai commented on KAFKA-13907: [~soarez]  I have observed this issue t

Re: [PR] MINOR: Improve logging in AssignmentsManager [kafka]

2024-04-02 Thread via GitHub
showuon commented on PR #15522: URL: https://github.com/apache/kafka/pull/15522#issuecomment-2033354648 ``` /home/jenkins/workspace/Kafka_kafka-pr_PR-15522/server/src/test/java/org/apache/kafka/server/AssignmentsManagerTest.java:354: error: method onAssignment in class Assignmen

Re: [PR] KAFKA-16310 ListOffsets doesn't report the offset with maxTimestamp a… [kafka]

2024-04-02 Thread via GitHub
chia7712 commented on code in PR #15621: URL: https://github.com/apache/kafka/pull/15621#discussion_r1548765182 ## core/src/main/scala/kafka/log/UnifiedLog.scala: ## @@ -1337,13 +1337,17 @@ class UnifiedLog(@volatile var logStartOffset: Long, } else if (targetTimestamp ==

[jira] [Commented] (KAFKA-16262) Add IQv2 to Kafka Streams documentation

2024-04-02 Thread Suprem Vanam (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17833347#comment-17833347 ] Suprem Vanam commented on KAFKA-16262: -- Hi [~mjsax], can I work on this ticket? Thi

[jira] [Commented] (KAFKA-9528) Improve accessibility on website

2024-04-02 Thread Suprem Vanam (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17833346#comment-17833346 ] Suprem Vanam commented on KAFKA-9528: - Hi [~Dionakra], looks like this issue is still

Re: [PR] KAFKA-16310 ListOffsets doesn't report the offset with maxTimestamp a… [kafka]

2024-04-02 Thread via GitHub
junrao commented on code in PR #15621: URL: https://github.com/apache/kafka/pull/15621#discussion_r1548687661 ## core/src/main/scala/kafka/log/UnifiedLog.scala: ## @@ -1337,13 +1337,17 @@ class UnifiedLog(@volatile var logStartOffset: Long, } else if (targetTimestamp == L

Re: [PR] KAFKA-16293: Test log directory failure in Kraft [kafka]

2024-04-02 Thread via GitHub
soarez commented on PR #15409: URL: https://github.com/apache/kafka/pull/15409#issuecomment-2033175375 @showuon could you have a look at this? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [PR] MINOR: Improve logging in AssignmentsManager [kafka]

2024-04-02 Thread via GitHub
soarez commented on code in PR #15522: URL: https://github.com/apache/kafka/pull/15522#discussion_r1548655446 ## core/src/test/scala/unit/kafka/server/ReplicaAlterLogDirsThreadTest.scala: ## @@ -458,7 +458,7 @@ class ReplicaAlterLogDirsThreadTest { ArgumentCaptor.forClas

Re: [PR] KAFKA-16310 ListOffsets doesn't report the offset with maxTimestamp a… [kafka]

2024-04-02 Thread via GitHub
chia7712 commented on code in PR #15621: URL: https://github.com/apache/kafka/pull/15621#discussion_r1548654826 ## core/src/main/scala/kafka/log/UnifiedLog.scala: ## @@ -1337,13 +1337,17 @@ class UnifiedLog(@volatile var logStartOffset: Long, } else if (targetTimestamp ==

Re: [PR] KAFKA-16310 ListOffsets doesn't report the offset with maxTimestamp a… [kafka]

2024-04-02 Thread via GitHub
chia7712 commented on code in PR #15621: URL: https://github.com/apache/kafka/pull/15621#discussion_r1548644261 ## core/src/main/scala/kafka/log/UnifiedLog.scala: ## @@ -1337,13 +1337,17 @@ class UnifiedLog(@volatile var logStartOffset: Long, } else if (targetTimestamp ==

Re: [PR] KAFKA-16310 ListOffsets doesn't report the offset with maxTimestamp a… [kafka]

2024-04-02 Thread via GitHub
junrao commented on code in PR #15621: URL: https://github.com/apache/kafka/pull/15621#discussion_r1548633965 ## core/src/main/scala/kafka/log/UnifiedLog.scala: ## @@ -1337,13 +1337,17 @@ class UnifiedLog(@volatile var logStartOffset: Long, } else if (targetTimestamp == L

Re: [PR] KAFKA-16156: beginningOrEndOffsets does not need to build an OffsetAndTimestamps object upon completion [kafka]

2024-04-02 Thread via GitHub
lianetm commented on code in PR #15525: URL: https://github.com/apache/kafka/pull/15525#discussion_r1548614429 ## core/src/test/scala/integration/kafka/api/PlaintextConsumerCommitTest.scala: ## @@ -304,6 +304,60 @@ class PlaintextConsumerCommitTest extends AbstractConsumerTest

Re: [PR] KAFKA-16156: beginningOrEndOffsets does not need to build an OffsetAndTimestamps object upon completion [kafka]

2024-04-02 Thread via GitHub
lianetm commented on code in PR #15525: URL: https://github.com/apache/kafka/pull/15525#discussion_r1548603219 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/OffsetAndTimestampInternal.java: ## @@ -0,0 +1,81 @@ +/* + * Licensed to the Apache Software Founda

Re: [PR] KAFKA-16156: beginningOrEndOffsets does not need to build an OffsetAndTimestamps object upon completion [kafka]

2024-04-02 Thread via GitHub
philipnee commented on code in PR #15525: URL: https://github.com/apache/kafka/pull/15525#discussion_r1548599057 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/OffsetAndTimestampInternal.java: ## @@ -0,0 +1,81 @@ +/* + * Licensed to the Apache Software Foun

Re: [PR] KAFKA-16156: beginningOrEndOffsets does not need to build an OffsetAndTimestamps object upon completion [kafka]

2024-04-02 Thread via GitHub
lianetm commented on code in PR #15525: URL: https://github.com/apache/kafka/pull/15525#discussion_r1548596033 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/OffsetAndTimestampInternal.java: ## @@ -0,0 +1,81 @@ +/* + * Licensed to the Apache Software Founda

Re: [PR] KAFKA-16156: beginningOrEndOffsets does not need to build an OffsetAndTimestamps object upon completion [kafka]

2024-04-02 Thread via GitHub
philipnee commented on code in PR #15525: URL: https://github.com/apache/kafka/pull/15525#discussion_r1548593720 ## core/src/test/scala/integration/kafka/api/PlaintextConsumerTest.scala: ## @@ -805,4 +805,73 @@ class PlaintextConsumerTest extends BaseConsumerTest { consum

Re: [PR] KAFKA-16156: beginningOrEndOffsets does not need to build an OffsetAndTimestamps object upon completion [kafka]

2024-04-02 Thread via GitHub
philipnee commented on code in PR #15525: URL: https://github.com/apache/kafka/pull/15525#discussion_r1548593720 ## core/src/test/scala/integration/kafka/api/PlaintextConsumerTest.scala: ## @@ -805,4 +805,73 @@ class PlaintextConsumerTest extends BaseConsumerTest { consum

Re: [PR] KAFKA-16156: beginningOrEndOffsets does not need to build an OffsetAndTimestamps object upon completion [kafka]

2024-04-02 Thread via GitHub
lianetm commented on code in PR #15525: URL: https://github.com/apache/kafka/pull/15525#discussion_r1548593248 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/AsyncKafkaConsumer.java: ## @@ -1141,21 +1146,29 @@ private Map beginningOrEndOffset(Collection ti

Re: [PR] KAFKA-16156: beginningOrEndOffsets does not need to build an OffsetAndTimestamps object upon completion [kafka]

2024-04-02 Thread via GitHub
lianetm commented on code in PR #15525: URL: https://github.com/apache/kafka/pull/15525#discussion_r1548591307 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/OffsetAndTimestampInternal.java: ## @@ -0,0 +1,81 @@ +/* + * Licensed to the Apache Software Founda

Re: [PR] KAFKA-16156: beginningOrEndOffsets does not need to build an OffsetAndTimestamps object upon completion [kafka]

2024-04-02 Thread via GitHub
philipnee commented on code in PR #15525: URL: https://github.com/apache/kafka/pull/15525#discussion_r1548585054 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/OffsetFetcherUtils.java: ## @@ -240,20 +241,48 @@ Map getOffsetResetTimestamp() { return

Re: [PR] KAFKA-16156: beginningOrEndOffsets does not need to build an OffsetAndTimestamps object upon completion [kafka]

2024-04-02 Thread via GitHub
philipnee commented on code in PR #15525: URL: https://github.com/apache/kafka/pull/15525#discussion_r1548581658 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/OffsetAndTimestampInternal.java: ## @@ -0,0 +1,81 @@ +/* + * Licensed to the Apache Software Foun

Re: [PR] KAFKA-16156: beginningOrEndOffsets does not need to build an OffsetAndTimestamps object upon completion [kafka]

2024-04-02 Thread via GitHub
lianetm commented on code in PR #15525: URL: https://github.com/apache/kafka/pull/15525#discussion_r1548580872 ## core/src/test/scala/integration/kafka/api/PlaintextConsumerTest.scala: ## @@ -805,4 +805,73 @@ class PlaintextConsumerTest extends BaseConsumerTest { consumer

Re: [PR] KAFKA-16156: beginningOrEndOffsets does not need to build an OffsetAndTimestamps object upon completion [kafka]

2024-04-02 Thread via GitHub
lianetm commented on code in PR #15525: URL: https://github.com/apache/kafka/pull/15525#discussion_r1548576809 ## core/src/test/scala/integration/kafka/api/PlaintextConsumerTest.scala: ## @@ -805,4 +805,73 @@ class PlaintextConsumerTest extends BaseConsumerTest { consumer

Re: [PR] KAFKA-16156: beginningOrEndOffsets does not need to build an OffsetAndTimestamps object upon completion [kafka]

2024-04-02 Thread via GitHub
philipnee commented on code in PR #15525: URL: https://github.com/apache/kafka/pull/15525#discussion_r1548574194 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/AsyncKafkaConsumer.java: ## @@ -1141,21 +1146,29 @@ private Map beginningOrEndOffset(Collection

Re: [PR] KAFKA-16156: beginningOrEndOffsets does not need to build an OffsetAndTimestamps object upon completion [kafka]

2024-04-02 Thread via GitHub
lianetm commented on code in PR #15525: URL: https://github.com/apache/kafka/pull/15525#discussion_r1548571273 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/OffsetFetcherUtils.java: ## @@ -240,20 +241,48 @@ Map getOffsetResetTimestamp() { return o

[jira] [Updated] (KAFKA-16466) QuorumController is swallowing some exception messages

2024-04-02 Thread David Arthur (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Arthur updated KAFKA-16466: - Description: In some cases in QuorumController, we throw exceptions from the control manager me

[jira] [Commented] (KAFKA-16427) KafkaConsumer#position() does not respect timeout when group protocol is CONSUMER

2024-04-02 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17833307#comment-17833307 ] Kirk True commented on KAFKA-16427: --- [~alyssahuang]—any chance you have a test case to

[jira] [Created] (KAFKA-16466) QuorumController is swallowing some exception messages

2024-04-02 Thread David Arthur (Jira)
David Arthur created KAFKA-16466: Summary: QuorumController is swallowing some exception messages Key: KAFKA-16466 URL: https://issues.apache.org/jira/browse/KAFKA-16466 Project: Kafka Issue

[jira] [Assigned] (KAFKA-16465) New consumer does not invoke rebalance callbacks as expected in consumer_test.py system test

2024-04-02 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True reassigned KAFKA-16465: - Assignee: Lianet Magrans (was: Kirk True) > New consumer does not invoke rebalance callbacks a

[jira] [Assigned] (KAFKA-16459) New consumer times out joining group in consumer_test.py system test

2024-04-02 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True reassigned KAFKA-16459: - Assignee: Lianet Magrans (was: Kirk True) > New consumer times out joining group in consumer_t

Re: [PR] KAFKA-16156: beginningOrEndOffsets does not need to build an OffsetAndTimestamps object upon completion [kafka]

2024-04-02 Thread via GitHub
lianetm commented on code in PR #15525: URL: https://github.com/apache/kafka/pull/15525#discussion_r1548554563 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/OffsetAndTimestampInternal.java: ## @@ -0,0 +1,81 @@ +/* + * Licensed to the Apache Software Founda

Re: [PR] KAFKA-16156: beginningOrEndOffsets does not need to build an OffsetAndTimestamps object upon completion [kafka]

2024-04-02 Thread via GitHub
lianetm commented on code in PR #15525: URL: https://github.com/apache/kafka/pull/15525#discussion_r1548547539 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/AsyncKafkaConsumer.java: ## @@ -1141,21 +1146,29 @@ private Map beginningOrEndOffset(Collection ti

Re: [PR] KAFKA-16156: beginningOrEndOffsets does not need to build an OffsetAndTimestamps object upon completion [kafka]

2024-04-02 Thread via GitHub
lianetm commented on code in PR #15525: URL: https://github.com/apache/kafka/pull/15525#discussion_r1548547539 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/AsyncKafkaConsumer.java: ## @@ -1141,21 +1146,29 @@ private Map beginningOrEndOffset(Collection ti

Re: [PR] KAFKA-16310 ListOffsets doesn't report the offset with maxTimestamp a… [kafka]

2024-04-02 Thread via GitHub
chia7712 commented on code in PR #15621: URL: https://github.com/apache/kafka/pull/15621#discussion_r1548530489 ## core/src/main/scala/kafka/log/UnifiedLog.scala: ## @@ -1337,13 +1337,16 @@ class UnifiedLog(@volatile var logStartOffset: Long, } else if (targetTimestamp ==

Re: [PR] KAFKA-16463 Delete metadata log on ZK broker startup [kafka]

2024-04-02 Thread via GitHub
cmccabe commented on code in PR #15648: URL: https://github.com/apache/kafka/pull/15648#discussion_r1548528194 ## core/src/main/scala/kafka/raft/RaftManager.scala: ## @@ -69,6 +69,36 @@ object KafkaRaftManager { lock } + + /** + * Obtain the file lock and delete the

[PR] Benchmark fibers [kafka]

2024-04-02 Thread via GitHub
bgprudhomme opened a new pull request, #15649: URL: https://github.com/apache/kafka/pull/15649 Refactor to fibers -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubsc

Re: [PR] Benchmark fibers [kafka]

2024-04-02 Thread via GitHub
bgprudhomme closed pull request #15649: Benchmark fibers URL: https://github.com/apache/kafka/pull/15649 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] KAFKA-16463 Delete metadata log on ZK broker startup [kafka]

2024-04-02 Thread via GitHub
mumrah commented on code in PR #15648: URL: https://github.com/apache/kafka/pull/15648#discussion_r1548499611 ## core/src/main/scala/kafka/raft/RaftManager.scala: ## @@ -69,6 +69,36 @@ object KafkaRaftManager { lock } + + /** + * Obtain the file lock and delete the

[jira] [Commented] (KAFKA-16389) consumer_test.py’s test_valid_assignment fails with new consumer

2024-04-02 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17833298#comment-17833298 ] Kirk True commented on KAFKA-16389: --- Can you mark this as "In progress", [~pnee]? Than

Re: [PR] KAFKA-16310 ListOffsets doesn't report the offset with maxTimestamp a… [kafka]

2024-04-02 Thread via GitHub
junrao commented on code in PR #15621: URL: https://github.com/apache/kafka/pull/15621#discussion_r1548487542 ## core/src/main/scala/kafka/log/UnifiedLog.scala: ## @@ -1337,13 +1337,16 @@ class UnifiedLog(@volatile var logStartOffset: Long, } else if (targetTimestamp == L

Re: [PR] KAFKA-16463 Delete metadata log on ZK broker startup [kafka]

2024-04-02 Thread via GitHub
jsancio commented on code in PR #15648: URL: https://github.com/apache/kafka/pull/15648#discussion_r1548472966 ## core/src/main/scala/kafka/raft/RaftManager.scala: ## @@ -69,6 +69,36 @@ object KafkaRaftManager { lock } + + /** + * Obtain the file lock and delete the

[jira] [Updated] (KAFKA-16405) Mismatch assignment error when running consumer rolling upgrade system tests

2024-04-02 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16405: -- Fix Version/s: 3.8.0 > Mismatch assignment error when running consumer rolling upgrade system tests >

[jira] [Updated] (KAFKA-16465) New consumer does not invoke rebalance callbacks as expected in consumer_test.py system test

2024-04-02 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16465: -- Description: The {{consumer_test.py}} system test fails with the following error: {noformat} test_id:

[jira] [Created] (KAFKA-16465) New consumer does not invoke rebalance callbacks as expected in consumer_test.py system test

2024-04-02 Thread Kirk True (Jira)
Kirk True created KAFKA-16465: - Summary: New consumer does not invoke rebalance callbacks as expected in consumer_test.py system test Key: KAFKA-16465 URL: https://issues.apache.org/jira/browse/KAFKA-16465

[jira] [Updated] (KAFKA-16464) New consumer fails with timeout in replication_replica_failure_test.py system test

2024-04-02 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16464: -- Description: The {{replication_replica_failure_test.py}} system test fails with the following error:

[jira] [Created] (KAFKA-16464) New consumer fails with timeout in replication_replica_failure_test.py system test

2024-04-02 Thread Kirk True (Jira)
Kirk True created KAFKA-16464: - Summary: New consumer fails with timeout in replication_replica_failure_test.py system test Key: KAFKA-16464 URL: https://issues.apache.org/jira/browse/KAFKA-16464 Project:

Re: [PR] KAFKA-16310 ListOffsets doesn't report the offset with maxTimestamp a… [kafka]

2024-04-02 Thread via GitHub
chia7712 commented on code in PR #15621: URL: https://github.com/apache/kafka/pull/15621#discussion_r1548438900 ## core/src/main/scala/kafka/log/UnifiedLog.scala: ## @@ -1337,13 +1337,16 @@ class UnifiedLog(@volatile var logStartOffset: Long, } else if (targetTimestamp ==

[jira] [Updated] (KAFKA-16405) Mismatch assignment error when running consumer rolling upgrade system tests

2024-04-02 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16405: -- Labels: kip-848-client-support system-tests (was: kip-848-client-support) > Mismatch assignment error

[jira] [Updated] (KAFKA-16405) Mismatch assignment error when running consumer rolling upgrade system tests

2024-04-02 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16405: -- Component/s: clients > Mismatch assignment error when running consumer rolling upgrade system tests >

[jira] [Updated] (KAFKA-16405) Mismatch assignment error when running consumer rolling upgrade system tests

2024-04-02 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16405: -- Priority: Blocker (was: Major) > Mismatch assignment error when running consumer rolling upgrade syst

[jira] [Updated] (KAFKA-16405) Mismatch assignment error when running consumer rolling upgrade system tests

2024-04-02 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16405: -- Issue Type: Bug (was: Task) > Mismatch assignment error when running consumer rolling upgrade system

Re: [PR] KAFKA-16310 ListOffsets doesn't report the offset with maxTimestamp a… [kafka]

2024-04-02 Thread via GitHub
junrao commented on code in PR #15621: URL: https://github.com/apache/kafka/pull/15621#discussion_r1548427028 ## clients/src/main/java/org/apache/kafka/common/record/MemoryRecordsBuilder.java: ## @@ -240,25 +240,54 @@ public MemoryRecords build() { return builtRecords;

[PR] KAFKA-16463 Delete metadata log on ZK broker startup [kafka]

2024-04-02 Thread via GitHub
mumrah opened a new pull request, #15648: URL: https://github.com/apache/kafka/pull/15648 This patch changes the behavior of the migrating ZK broker to always delete the local metadata log during startup. This deletion is done immediately before creating the RaftManager which will re-create

Re: [PR] KAFKA-16310 ListOffsets doesn't report the offset with maxTimestamp a… [kafka]

2024-04-02 Thread via GitHub
chia7712 commented on code in PR #15621: URL: https://github.com/apache/kafka/pull/15621#discussion_r1548390558 ## clients/src/main/java/org/apache/kafka/common/record/MemoryRecordsBuilder.java: ## @@ -240,25 +240,54 @@ public MemoryRecords build() { return builtRecords

[jira] [Updated] (KAFKA-16463) Automatically delete metadata log directory on ZK brokers

2024-04-02 Thread David Arthur (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Arthur updated KAFKA-16463: - Description: Throughout the process of a ZK to KRaft migration, the operator has the choice to

[jira] [Updated] (KAFKA-16463) Automatically delete metadata log directory on ZK brokers

2024-04-02 Thread David Arthur (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Arthur updated KAFKA-16463: - Description: Throughout the process of a ZK to KRaft migration, the operator has the choice to

[jira] [Created] (KAFKA-16463) Automatically delete metadata log directory on ZK brokers

2024-04-02 Thread David Arthur (Jira)
David Arthur created KAFKA-16463: Summary: Automatically delete metadata log directory on ZK brokers Key: KAFKA-16463 URL: https://issues.apache.org/jira/browse/KAFKA-16463 Project: Kafka Iss

Re: [PR] KAFKA-16310 ListOffsets doesn't report the offset with maxTimestamp a… [kafka]

2024-04-02 Thread via GitHub
junrao commented on code in PR #15621: URL: https://github.com/apache/kafka/pull/15621#discussion_r154830 ## clients/src/main/java/org/apache/kafka/common/record/MemoryRecordsBuilder.java: ## @@ -240,25 +240,40 @@ public MemoryRecords build() { return builtRecords;

[jira] [Updated] (KAFKA-16462) New consumer fails with timeout in security_test.py system test

2024-04-02 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16462: -- Description: The {{security_test.py}} system test fails with the following error: {noformat} test_id:

[jira] [Created] (KAFKA-16462) New consumer fails with timeout in security_test.py system test

2024-04-02 Thread Kirk True (Jira)
Kirk True created KAFKA-16462: - Summary: New consumer fails with timeout in security_test.py system test Key: KAFKA-16462 URL: https://issues.apache.org/jira/browse/KAFKA-16462 Project: Kafka Is

[jira] [Updated] (KAFKA-16461) New consumer fails to consume records in security_test.py system test

2024-04-02 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16461: -- Description: The {{security_test.py}} system test fails with the following error: {quote} * Consumer

[jira] [Created] (KAFKA-16461) New consumer fails to consume records in security_test.py system test

2024-04-02 Thread Kirk True (Jira)
Kirk True created KAFKA-16461: - Summary: New consumer fails to consume records in security_test.py system test Key: KAFKA-16461 URL: https://issues.apache.org/jira/browse/KAFKA-16461 Project: Kafka

[jira] [Updated] (KAFKA-16460) New consumer times out consuming records in consumer_test.py system test

2024-04-02 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16460: -- Description: The {{consumer_test.py}} system test fails with the following errors: {quote} * Timed ou

[jira] [Updated] (KAFKA-16460) New consumer times out consuming records in consumer_test.py system test

2024-04-02 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16460: -- Description: The {{consumer_test.py}} system test fails with the following errors: {quote} * Timed ou

[jira] [Updated] (KAFKA-16460) New consumer times out consuming records in consumer_test.py system test

2024-04-02 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16460: -- Description: The {{consumer_test.py}} system test fails with the following errors: {quote} * Timed ou

[jira] [Updated] (KAFKA-16460) New consumer times out consuming records in consumer_test.py system test

2024-04-02 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16460: -- Description: The {{consumer_test.py}} system test fails with two different errors related to consumpt

[jira] [Updated] (KAFKA-16460) New consumer times out system test

2024-04-02 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16460: -- Description: The {{consumer_test.py}} system test fails with two different errors related to consumer

[jira] [Assigned] (KAFKA-16459) New consumer times out join group in consumer_test.py system test

2024-04-02 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True reassigned KAFKA-16459: - Assignee: Kirk True (was: Philip Nee) > New consumer times out join group in consumer_test.py

[jira] [Updated] (KAFKA-16459) New consumer times out joining group in consumer_test.py system test

2024-04-02 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16459: -- Summary: New consumer times out joining group in consumer_test.py system test (was: New consumer time

[jira] [Updated] (KAFKA-16460) New consumer times out consuming records in consumer_test.py system test

2024-04-02 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16460: -- Summary: New consumer times out consuming records in consumer_test.py system test (was: New consumer

[jira] [Created] (KAFKA-16460) New consumer times out system test

2024-04-02 Thread Kirk True (Jira)
Kirk True created KAFKA-16460: - Summary: New consumer times out system test Key: KAFKA-16460 URL: https://issues.apache.org/jira/browse/KAFKA-16460 Project: Kafka Issue Type: Bug Compon

Re: [PR] KAFKA-16310 ListOffsets doesn't report the offset with maxTimestamp a… [kafka]

2024-04-02 Thread via GitHub
chia7712 commented on PR #15621: URL: https://github.com/apache/kafka/pull/15621#issuecomment-2032614122 @junrao thanks for additional reviews. I have addressed them except https://github.com/apache/kafka/pull/15621#discussion_r1548230600 -- This is an automated message from the Apache Gi

[jira] [Updated] (KAFKA-16459) New consumer times out join group in consumer_test.py system test

2024-04-02 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16459: -- Description: The {{consumer_test.py}} system test fails with two different errors related to consumer

[jira] [Updated] (KAFKA-16459) New consumer times out join group in consumer_test.py system test

2024-04-02 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16459: -- Description: The {{consumer_test.py}} system test fails with errors related to consumers joining the

[jira] [Updated] (KAFKA-16459) New consumer times out join group in consumer_test.py system test

2024-04-02 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16459: -- Summary: New consumer times out join group in consumer_test.py system test (was: New consumer fails t

[jira] [Updated] (KAFKA-16459) New consumer fails to join group in system tests

2024-04-02 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16459: -- Description: {{Consumers failed to join in a reasonable amount of time}} occurs in the following test

[jira] [Updated] (KAFKA-16459) New consumer fails to join group in system tests

2024-04-02 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16459: -- Summary: New consumer fails to join group in system tests (was: consumer_test.py’s static membership

[jira] [Updated] (KAFKA-16459) consumer_test.py’s static membership tests fail with new consumer

2024-04-02 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16459: -- Description: System tests failures: {noformat} test_id: kafkatest.tests.client.consumer_test.Offs

Re: [PR] KAFKA-16310 ListOffsets doesn't report the offset with maxTimestamp a… [kafka]

2024-04-02 Thread via GitHub
chia7712 commented on code in PR #15621: URL: https://github.com/apache/kafka/pull/15621#discussion_r1548258165 ## storage/src/main/java/org/apache/kafka/storage/internals/log/LogValidator.java: ## @@ -434,7 +442,8 @@ public ValidationResult validateMessagesAndAssignOffsetsComp

[jira] [Created] (KAFKA-16459) consumer_test.py’s static membership tests fail with new consumer

2024-04-02 Thread Kirk True (Jira)
Kirk True created KAFKA-16459: - Summary: consumer_test.py’s static membership tests fail with new consumer Key: KAFKA-16459 URL: https://issues.apache.org/jira/browse/KAFKA-16459 Project: Kafka

[jira] [Updated] (KAFKA-16459) consumer_test.py’s static membership tests fail with new consumer

2024-04-02 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16459: -- Description: (was: The following error is reported when running the {{test_valid_assignment}} test

Re: [PR] KAFKA-16310 ListOffsets doesn't report the offset with maxTimestamp a… [kafka]

2024-04-02 Thread via GitHub
junrao commented on code in PR #15621: URL: https://github.com/apache/kafka/pull/15621#discussion_r1548211287 ## clients/src/main/java/org/apache/kafka/common/record/MemoryRecordsBuilder.java: ## @@ -240,25 +240,40 @@ public MemoryRecords build() { return builtRecords;

[jira] [Updated] (KAFKA-16272) Update connect_distributed_test.py to support KIP-848’s group protocol config

2024-04-02 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16272: -- Fix Version/s: 4.0.0 (was: 3.8.0) > Update connect_distributed_test.py to suppo

[PR] KAFKA-15615: Improve handling of fetching during metadata updates [kafka]

2024-04-02 Thread via GitHub
appchemist opened a new pull request, #15647: URL: https://github.com/apache/kafka/pull/15647 - add 'AWAIT_UPDATE' state in FetchStates - This state makes the subscription unfetchable during metadata updates. - After a metadata update, the state becomes 'AWAIT_VALIDATION' or 'FETCH

Re: [PR] [WIP] KAFKA-16383: fix flaky IdentityReplicationIntegrationTest .testReplicateFromLatest [kafka]

2024-04-02 Thread via GitHub
johnnychhsu commented on PR #15556: URL: https://github.com/apache/kafka/pull/15556#issuecomment-2032431618 @vamossagar12 thanks for sharing! and from the build the IdentityReplicationIntegrationTest .testReplicateFromLatest passed with the fix, I think this could be the root cause, @chi

Re: [PR] MINOR: AbstractConfig cleanup Part 2 [kafka]

2024-04-02 Thread via GitHub
chia7712 commented on PR #15639: URL: https://github.com/apache/kafka/pull/15639#issuecomment-2032377734 > We should prioritize https://issues.apache.org/jira/browse/KAFKA-6527 to re-enable this test, as it would have caught this regression. sounds good to me. just test it on my local

  1   2   >