[jira] [Commented] (KAFKA-13425) KafkaConsumer#pause() will lose its effect after groupRebalance occurs, which maybe cause data loss on the consumer side

[ https://issues.apache.org/jira/browse/KAFKA-13425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17437169#comment-17437169 ] Luke Chen commented on KAFKA-13425: --- [~RivenSun], thanks for reporting this issue. But

[jira] [Comment Edited] (KAFKA-13425) KafkaConsumer#pause() will lose its effect after groupRebalance occurs, which maybe cause data loss on the consumer side

[ https://issues.apache.org/jira/browse/KAFKA-13425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17437169#comment-17437169 ] Luke Chen edited comment on KAFKA-13425 at 11/2/21, 7:37 AM: -

[jira] [Comment Edited] (KAFKA-13425) KafkaConsumer#pause() will lose its effect after groupRebalance occurs, which maybe cause data loss on the consumer side

[ https://issues.apache.org/jira/browse/KAFKA-13425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17437169#comment-17437169 ] Luke Chen edited comment on KAFKA-13425 at 11/2/21, 7:41 AM: -

[jira] [Comment Edited] (KAFKA-13425) KafkaConsumer#pause() will lose its effect after groupRebalance occurs, which maybe cause data loss on the consumer side

[ https://issues.apache.org/jira/browse/KAFKA-13425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17437169#comment-17437169 ] Luke Chen edited comment on KAFKA-13425 at 11/2/21, 7:42 AM: -

[jira] [Commented] (KAFKA-13425) KafkaConsumer#pause() will lose its effect after groupRebalance occurs, which maybe cause data loss on the consumer side

[ https://issues.apache.org/jira/browse/KAFKA-13425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17437196#comment-17437196 ] RivenSun commented on KAFKA-13425: -- Haha,  [~showuon] thank you for your reply and reco

[jira] [Comment Edited] (KAFKA-13425) KafkaConsumer#pause() will lose its effect after groupRebalance occurs, which maybe cause data loss on the consumer side

[ https://issues.apache.org/jira/browse/KAFKA-13425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17437196#comment-17437196 ] RivenSun edited comment on KAFKA-13425 at 11/2/21, 8:36 AM:

[jira] [Comment Edited] (KAFKA-13425) KafkaConsumer#pause() will lose its effect after groupRebalance occurs, which maybe cause data loss on the consumer side

[ https://issues.apache.org/jira/browse/KAFKA-13425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17437196#comment-17437196 ] RivenSun edited comment on KAFKA-13425 at 11/2/21, 8:39 AM:

[GitHub] [kafka] dajac opened a new pull request #11458: MINOR: Bump trunk to 3.2.0-SNAPSHOT

dajac opened a new pull request #11458: URL: https://github.com/apache/kafka/pull/11458 Typical version bumps on trunk following the creation of the 3.1 release branch. ### Committer Checklist (excluded from commit message) - [ ] Verify design and implementation - [ ] Verify t

[jira] [Commented] (KAFKA-13425) KafkaConsumer#pause() will lose its effect after groupRebalance occurs, which maybe cause data loss on the consumer side

[ https://issues.apache.org/jira/browse/KAFKA-13425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17437256#comment-17437256 ] RivenSun commented on KAFKA-13425: -- [~showuon] Since I was not familiar with the Kafka

[jira] [Comment Edited] (KAFKA-13425) KafkaConsumer#pause() will lose its effect after groupRebalance occurs, which maybe cause data loss on the consumer side

[ https://issues.apache.org/jira/browse/KAFKA-13425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17437256#comment-17437256 ] RivenSun edited comment on KAFKA-13425 at 11/2/21, 10:07 AM: -

[jira] [Comment Edited] (KAFKA-13425) KafkaConsumer#pause() will lose its effect after groupRebalance occurs, which maybe cause data loss on the consumer side

[ https://issues.apache.org/jira/browse/KAFKA-13425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17437256#comment-17437256 ] RivenSun edited comment on KAFKA-13425 at 11/2/21, 10:09 AM: -

[jira] [Commented] (KAFKA-13425) KafkaConsumer#pause() will lose its effect after groupRebalance occurs, which maybe cause data loss on the consumer side

[ https://issues.apache.org/jira/browse/KAFKA-13425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17437264#comment-17437264 ] Luke Chen commented on KAFKA-13425: --- [~RivenSun], dev channel refers to: [d...@kafka

[jira] [Comment Edited] (KAFKA-13425) KafkaConsumer#pause() will lose its effect after groupRebalance occurs, which maybe cause data loss on the consumer side

[ https://issues.apache.org/jira/browse/KAFKA-13425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17437264#comment-17437264 ] Luke Chen edited comment on KAFKA-13425 at 11/2/21, 10:18 AM:

[GitHub] [kafka] cadonna commented on a change in pull request #11455: KAFKA-13423: GlobalThread should not log ERROR on clean shutdown

cadonna commented on a change in pull request #11455: URL: https://github.com/apache/kafka/pull/11455#discussion_r740921447 ## File path: streams/src/main/java/org/apache/kafka/streams/KafkaStreams.java ## @@ -655,10 +656,11 @@ public synchronized void onChange(final Thread thr

[GitHub] [kafka] cadonna commented on pull request #11455: KAFKA-13423: GlobalThread should not log ERROR on clean shutdown

cadonna commented on pull request #11455: URL: https://github.com/apache/kafka/pull/11455#issuecomment-957320922 @guozhangwang AFAICS not all `setState(DEAD)` are called during normal processing in `GlobalStreamThread`. The `finally` clause in the `run()` is also called when an exception o

[GitHub] [kafka] cadonna edited a comment on pull request #11455: KAFKA-13423: GlobalThread should not log ERROR on clean shutdown

cadonna edited a comment on pull request #11455: URL: https://github.com/apache/kafka/pull/11455#issuecomment-957320922 @guozhangwang AFAICS not all `setState(DEAD)` are called during normal processing in `GlobalStreamThread`. The `finally` clause in `run()` is also called when an exceptio

[jira] [Commented] (KAFKA-13425) KafkaConsumer#pause() will lose its effect after groupRebalance occurs, which maybe cause data loss on the consumer side

[ https://issues.apache.org/jira/browse/KAFKA-13425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17437285#comment-17437285 ] RivenSun commented on KAFKA-13425: -- [~showuon]  Thank you for your reply, it is very he

[GitHub] [kafka] cadonna commented on a change in pull request #11455: KAFKA-13423: GlobalThread should not log ERROR on clean shutdown

cadonna commented on a change in pull request #11455: URL: https://github.com/apache/kafka/pull/11455#discussion_r740942926 ## File path: streams/src/main/java/org/apache/kafka/streams/KafkaStreams.java ## @@ -655,10 +656,11 @@ public synchronized void onChange(final Thread thr

[jira] [Comment Edited] (KAFKA-13425) KafkaConsumer#pause() will lose its effect after groupRebalance occurs, which maybe cause data loss on the consumer side

[ https://issues.apache.org/jira/browse/KAFKA-13425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17437285#comment-17437285 ] RivenSun edited comment on KAFKA-13425 at 11/2/21, 11:51 AM: -

[jira] [Commented] (KAFKA-13425) KafkaConsumer#pause() will lose its effect after groupRebalance occurs, which maybe cause data loss on the consumer side

[ https://issues.apache.org/jira/browse/KAFKA-13425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17437330#comment-17437330 ] Luke Chen commented on KAFKA-13425: --- > 1）My code change is *added after* > ”subscript

[GitHub] [kafka] dajac merged pull request #11458: MINOR: Bump trunk to 3.2.0-SNAPSHOT

dajac merged pull request #11458: URL: https://github.com/apache/kafka/pull/11458 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...

[GitHub] [kafka] dajac commented on pull request #11368: KAFKA-13261: Add support for custom partitioners in foreign key joins

dajac commented on pull request #11368: URL: https://github.com/apache/kafka/pull/11368#issuecomment-957503502 @mjsax Do we plan to get this PR in 3.1? It seems that the PR has been approved but not merge in time for the feature freeze. -- This is an automated message from the Apache Git

[jira] [Updated] (KAFKA-10000) Atomic commit of source connector records and offsets

[ https://issues.apache.org/jira/browse/KAFKA-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot updated KAFKA-1: Fix Version/s: (was: 3.1.0) 3.2.0 > Atomic commit of source connector recor

[jira] [Updated] (KAFKA-10733) Enforce exception thrown for KafkaProducer txn APIs

[ https://issues.apache.org/jira/browse/KAFKA-10733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot updated KAFKA-10733: Fix Version/s: (was: 3.1.0) 3.2.0 > Enforce exception thrown for KafkaProdu

[jira] [Updated] (KAFKA-6718) Rack Aware Stand-by Task Assignment for Kafka Streams

[ https://issues.apache.org/jira/browse/KAFKA-6718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot updated KAFKA-6718: --- Fix Version/s: (was: 3.1.0) 3.2.0 > Rack Aware Stand-by Task Assignment for Ka

[jira] [Commented] (KAFKA-6718) Rack Aware Stand-by Task Assignment for Kafka Streams

[ https://issues.apache.org/jira/browse/KAFKA-6718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17437334#comment-17437334 ] David Jacot commented on KAFKA-6718: The main PR for this feature hasn't been approve

[jira] [Commented] (KAFKA-10733) Enforce exception thrown for KafkaProducer txn APIs

[ https://issues.apache.org/jira/browse/KAFKA-10733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17437335#comment-17437335 ] David Jacot commented on KAFKA-10733: - Moved the target release to the next one. >

[jira] [Updated] (KAFKA-6080) Transactional EoS for source connectors

[ https://issues.apache.org/jira/browse/KAFKA-6080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot updated KAFKA-6080: --- Fix Version/s: (was: 3.1.0) 3.2.0 > Transactional EoS for source connectors >

[jira] [Commented] (KAFKA-10000) Atomic commit of source connector records and offsets

[ https://issues.apache.org/jira/browse/KAFKA-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17437336#comment-17437336 ] David Jacot commented on KAFKA-1: - Moved the target release to the next one. >

[jira] [Updated] (KAFKA-9366) Upgrade log4j to log4j2

[ https://issues.apache.org/jira/browse/KAFKA-9366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot updated KAFKA-9366: --- Fix Version/s: (was: 3.1.0) 3.2.0 > Upgrade log4j to log4j2 >

[jira] [Updated] (KAFKA-7739) Kafka Tiered Storage

[ https://issues.apache.org/jira/browse/KAFKA-7739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot updated KAFKA-7739: --- Fix Version/s: (was: 3.1.0) 3.2.0 > Kafka Tiered Storage > ---

[jira] [Commented] (KAFKA-7739) Kafka Tiered Storage

[ https://issues.apache.org/jira/browse/KAFKA-7739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17437338#comment-17437338 ] David Jacot commented on KAFKA-7739: Moved the target version to 3.2.0 since there ar

[jira] [Commented] (KAFKA-7632) Support Compression Level

[ https://issues.apache.org/jira/browse/KAFKA-7632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17437339#comment-17437339 ] David Jacot commented on KAFKA-7632: Moved the target release to 3.2.0. > Support Co

[jira] [Updated] (KAFKA-7632) Support Compression Level

[ https://issues.apache.org/jira/browse/KAFKA-7632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot updated KAFKA-7632: --- Fix Version/s: (was: 3.1.0) 3.2.0 > Support Compression Level > --

[jira] [Commented] (KAFKA-9366) Upgrade log4j to log4j2

[ https://issues.apache.org/jira/browse/KAFKA-9366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17437337#comment-17437337 ] David Jacot commented on KAFKA-9366: Moved the target release to the next one as the

[jira] [Commented] (KAFKA-12487) Sink connectors do not work with the cooperative consumer rebalance protocol

[ https://issues.apache.org/jira/browse/KAFKA-12487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17437340#comment-17437340 ] David Jacot commented on KAFKA-12487: - [~ChrisEgerton] Do we still plan to get this

[jira] [Commented] (KAFKA-12291) Fix Ignored Upgrade Tests in streams_upgrade_test.py: test_upgrade_downgrade_brokers

[ https://issues.apache.org/jira/browse/KAFKA-12291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17437342#comment-17437342 ] David Jacot commented on KAFKA-12291: - [~cadonna] Is this issue really a blocker? It

[jira] [Updated] (KAFKA-13331) Slow reassignments in 2.8 because of large number of UpdateMetadataResponseReceived(UpdateMetadataResponseData(errorCode=0),) Events

[ https://issues.apache.org/jira/browse/KAFKA-13331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot updated KAFKA-13331: Fix Version/s: (was: 3.1.0) 3.2.0 > Slow reassignments in 2.8 because of la

[jira] [Commented] (KAFKA-13331) Slow reassignments in 2.8 because of large number of UpdateMetadataResponseReceived(UpdateMetadataResponseData(errorCode=0),) Events

[ https://issues.apache.org/jira/browse/KAFKA-13331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17437343#comment-17437343 ] David Jacot commented on KAFKA-13331: - Moving the target release to 3.2. > Slow rea

[jira] [Updated] (KAFKA-12878) Support --bootstrap-server kafka-streams-application-reset

[ https://issues.apache.org/jira/browse/KAFKA-12878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot updated KAFKA-12878: Fix Version/s: (was: 3.1.0) 3.2.0 > Support --bootstrap-server kafka-stream

[jira] [Commented] (KAFKA-12878) Support --bootstrap-server kafka-streams-application-reset

[ https://issues.apache.org/jira/browse/KAFKA-12878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17437344#comment-17437344 ] David Jacot commented on KAFKA-12878: - I wasn't able to find a KIP for this feature.

[jira] [Commented] (KAFKA-9990) Supporting transactions in tiered storage

[ https://issues.apache.org/jira/browse/KAFKA-9990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17437348#comment-17437348 ] David Jacot commented on KAFKA-9990: Feature freeze for AK 3.1 has passed. Pushing to

[jira] [Updated] (KAFKA-9990) Supporting transactions in tiered storage

[ https://issues.apache.org/jira/browse/KAFKA-9990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot updated KAFKA-9990: --- Fix Version/s: (was: 3.1.0) 3.2.0 > Supporting transactions in tiered storage

[jira] [Updated] (KAFKA-9578) Kafka Tiered Storage - System Tests

[ https://issues.apache.org/jira/browse/KAFKA-9578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot updated KAFKA-9578: --- Fix Version/s: (was: 3.1.0) 3.2.0 > Kafka Tiered Storage - System Tests > ---

[jira] [Updated] (KAFKA-12622) Automate LICENSE file validation

[ https://issues.apache.org/jira/browse/KAFKA-12622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot updated KAFKA-12622: Fix Version/s: (was: 3.1.0) 3.2.0 > Automate LICENSE file validation >

[jira] [Updated] (KAFKA-9550) RemoteLogManager implementation

[ https://issues.apache.org/jira/browse/KAFKA-9550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot updated KAFKA-9550: --- Fix Version/s: (was: 3.1.0) 3.2.0 > RemoteLogManager implementation > ---

[jira] [Commented] (KAFKA-9578) Kafka Tiered Storage - System Tests

[ https://issues.apache.org/jira/browse/KAFKA-9578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17437349#comment-17437349 ] David Jacot commented on KAFKA-9578: Feature freeze for AK 3.1 has passed. Pushing to

[jira] [Commented] (KAFKA-9550) RemoteLogManager implementation

[ https://issues.apache.org/jira/browse/KAFKA-9550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17437350#comment-17437350 ] David Jacot commented on KAFKA-9550: Feature freeze for AK 3.1 has passed. Pushing to

[jira] [Updated] (KAFKA-12616) Convert integration tests to use ClusterTest

[ https://issues.apache.org/jira/browse/KAFKA-12616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot updated KAFKA-12616: Fix Version/s: (was: 3.1.0) 3.2.0 > Convert integration tests to use Cluste

[jira] [Commented] (KAFKA-9910) Implement new transaction timed out error

[ https://issues.apache.org/jira/browse/KAFKA-9910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17437351#comment-17437351 ] David Jacot commented on KAFKA-9910: Feature freeze for AK 3.1 has passed. Pushing to

[jira] [Updated] (KAFKA-9803) Allow producers to recover gracefully from transaction timeouts

[ https://issues.apache.org/jira/browse/KAFKA-9803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot updated KAFKA-9803: --- Fix Version/s: (was: 3.1.0) 3.2.0 > Allow producers to recover gracefully from

[jira] [Updated] (KAFKA-12842) Failing test: org.apache.kafka.connect.integration.ConnectWorkerIntegrationTest.testSourceTaskNotBlockedOnShutdownWithNonExistentTopic

[ https://issues.apache.org/jira/browse/KAFKA-12842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot updated KAFKA-12842: Fix Version/s: (was: 3.1.0) 3.2.0 > Failing test: > org.apache.kafka.conne

[jira] [Updated] (KAFKA-7493) Rewrite test_broker_type_bounce_at_start

[ https://issues.apache.org/jira/browse/KAFKA-7493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot updated KAFKA-7493: --- Fix Version/s: (was: 3.1.0) 3.2.0 > Rewrite test_broker_type_bounce_at_start >

[jira] [Updated] (KAFKA-9910) Implement new transaction timed out error

[ https://issues.apache.org/jira/browse/KAFKA-9910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot updated KAFKA-9910: --- Fix Version/s: (was: 3.1.0) 3.2.0 > Implement new transaction timed out error

[jira] [Updated] (KAFKA-12176) Consider changing default log.message.timestamp.difference.max.ms

[ https://issues.apache.org/jira/browse/KAFKA-12176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot updated KAFKA-12176: Fix Version/s: (was: 3.1.0) 3.2.0 > Consider changing default log.message.t

[jira] [Commented] (KAFKA-12641) Clear RemoteLogLeaderEpochState entry when it become empty.

[ https://issues.apache.org/jira/browse/KAFKA-12641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17437352#comment-17437352 ] David Jacot commented on KAFKA-12641: - Feature freeze for AK 3.1 has passed. Pushing

[jira] [Updated] (KAFKA-12641) Clear RemoteLogLeaderEpochState entry when it become empty.

[ https://issues.apache.org/jira/browse/KAFKA-12641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot updated KAFKA-12641: Fix Version/s: (was: 3.1.0) 3.2.0 > Clear RemoteLogLeaderEpochState entry w

[jira] [Commented] (KAFKA-9579) RLM fetch implementation by adding respective purgatory

[ https://issues.apache.org/jira/browse/KAFKA-9579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17437353#comment-17437353 ] David Jacot commented on KAFKA-9579: Feature freeze for AK 3.1 has passed. Pushing to

[jira] [Updated] (KAFKA-9579) RLM fetch implementation by adding respective purgatory

[ https://issues.apache.org/jira/browse/KAFKA-9579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot updated KAFKA-9579: --- Fix Version/s: (was: 3.1.0) 3.2.0 > RLM fetch implementation by adding respect

[jira] [Commented] (KAFKA-10233) KafkaConsumer polls in a tight loop if group is not authorized

[ https://issues.apache.org/jira/browse/KAFKA-10233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17437354#comment-17437354 ] David Jacot commented on KAFKA-10233: - The PR did not get any updates for a while. M

[jira] [Updated] (KAFKA-10233) KafkaConsumer polls in a tight loop if group is not authorized

[ https://issues.apache.org/jira/browse/KAFKA-10233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot updated KAFKA-10233: Fix Version/s: (was: 3.1.0) 3.2.0 > KafkaConsumer polls in a tight loop if

[jira] [Commented] (KAFKA-13130) Deprecate long based range queries in SessionStore

[ https://issues.apache.org/jira/browse/KAFKA-13130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17437356#comment-17437356 ] David Jacot commented on KAFKA-13130: - Moving it to the next release as the implemen

[jira] [Updated] (KAFKA-13130) Deprecate long based range queries in SessionStore

[ https://issues.apache.org/jira/browse/KAFKA-13130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot updated KAFKA-13130: Fix Version/s: (was: 3.1.0) 3.2.0 > Deprecate long based range queries in S

[GitHub] [kafka] mimaison commented on a change in pull request #11450: KAFKA-13414: Replace Powermock/EasyMock by Mockito in connect.storage

mimaison commented on a change in pull request #11450: URL: https://github.com/apache/kafka/pull/11450#discussion_r741054431 ## File path: connect/runtime/src/test/java/org/apache/kafka/connect/storage/FileOffsetBackingStoreTest.java ## @@ -77,21 +74,17 @@ public void teardown

[jira] [Commented] (KAFKA-13425) KafkaConsumer#pause() will lose its effect after groupRebalance occurs, which maybe cause data loss on the consumer side

[ https://issues.apache.org/jira/browse/KAFKA-13425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17437366#comment-17437366 ] RivenSun commented on KAFKA-13425: -- [~showuon] So we have reached a consensus：When the

[jira] [Commented] (KAFKA-13373) ValueTransformerWithKeySupplier doesn't work with store()

[ https://issues.apache.org/jira/browse/KAFKA-13373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17437367#comment-17437367 ] Aleksandr Sorokoumov commented on KAFKA-13373: -- [~htol] Can you please prov

[jira] [Updated] (KAFKA-13348) Allow Source Tasks to Handle Producer Exceptions

[ https://issues.apache.org/jira/browse/KAFKA-13348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Knowles Atchison Jr updated KAFKA-13348: Description: KAFKA-8586 added capture of Producer Exceptions which will kill the c

[jira] [Updated] (KAFKA-13348) Allow Source Tasks to Handle Producer Exceptions

[ https://issues.apache.org/jira/browse/KAFKA-13348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Knowles Atchison Jr updated KAFKA-13348: Description: KAFKA-8586 added capture of Producer Exceptions which will kill the c

[jira] [Updated] (KAFKA-13348) Allow Source Tasks to Handle Producer Exceptions

[ https://issues.apache.org/jira/browse/KAFKA-13348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Knowles Atchison Jr updated KAFKA-13348: Description: KAFKA-8586 added capture of Producer Exceptions which will kill the c

[GitHub] [kafka] dongjinleekr commented on a change in pull request #11430: KAFKA-13352: Kafka Client does not support passwords starting with number in jaas config

dongjinleekr commented on a change in pull request #11430: URL: https://github.com/apache/kafka/pull/11430#discussion_r741090237 ## File path: clients/src/main/java/org/apache/kafka/common/security/JaasConfig.java ## @@ -50,12 +50,24 @@ private final List configEntries;

[jira] [Commented] (KAFKA-6080) Transactional EoS for source connectors

[ https://issues.apache.org/jira/browse/KAFKA-6080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17437377#comment-17437377 ] Sönke Liebau commented on KAFKA-6080: - Are there any developments around this? I rece

[GitHub] [kafka] dongjinleekr commented on a change in pull request #11430: KAFKA-13352: Kafka Client does not support passwords starting with number in jaas config

dongjinleekr commented on a change in pull request #11430: URL: https://github.com/apache/kafka/pull/11430#discussion_r741090237 ## File path: clients/src/main/java/org/apache/kafka/common/security/JaasConfig.java ## @@ -50,12 +50,24 @@ private final List configEntries;

[GitHub] [kafka] dongjinleekr commented on a change in pull request #11430: KAFKA-13352: Kafka Client does not support passwords starting with number in jaas config

dongjinleekr commented on a change in pull request #11430: URL: https://github.com/apache/kafka/pull/11430#discussion_r741104074 ## File path: clients/src/main/java/org/apache/kafka/common/security/JaasConfig.java ## @@ -50,12 +50,24 @@ private final List configEntries;

[jira] [Assigned] (KAFKA-13183) Dropping nul key/value records upstream to repartiton topic not tracked via metrics

[ https://issues.apache.org/jira/browse/KAFKA-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aleksandr Sorokoumov reassigned KAFKA-13183: Assignee: Aleksandr Sorokoumov > Dropping nul key/value records upstream

[jira] [Commented] (KAFKA-13247) Adding functionality for loading private key entry by alias from the keystore

[ https://issues.apache.org/jira/browse/KAFKA-13247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17437398#comment-17437398 ] Dongjin Lee commented on KAFKA-13247: - Hi [~tmargaryan]  Thank you for reporting th

[jira] [Commented] (KAFKA-13425) KafkaConsumer#pause() will lose its effect after groupRebalance occurs, which maybe cause data loss on the consumer side

[ https://issues.apache.org/jira/browse/KAFKA-13425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17437413#comment-17437413 ] RivenSun commented on KAFKA-13425: -- [~showuon] In fact, the purpose of the modified co

[jira] [Commented] (KAFKA-6080) Transactional EoS for source connectors

[ https://issues.apache.org/jira/browse/KAFKA-6080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17437419#comment-17437419 ] Tom Bentley commented on KAFKA-6080: [~sliebau], [KIP-618|https://cwiki.apache.org/c

[GitHub] [kafka] jonmcewen commented on a change in pull request #8690: KAFKA-9965: Fix uneven distribution in RoundRobinPartitioner

jonmcewen commented on a change in pull request #8690: URL: https://github.com/apache/kafka/pull/8690#discussion_r741175055 ## File path: clients/src/main/java/org/apache/kafka/clients/producer/RoundRobinPartitioner.java ## @@ -65,12 +65,20 @@ public int partition(String topic

[jira] [Commented] (KAFKA-13428) server hang on shutdown

[ https://issues.apache.org/jira/browse/KAFKA-13428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17437424#comment-17437424 ] David Jacot commented on KAFKA-13428: - [~yuhuo] Thanks for reporting this. It seems

[GitHub] [kafka] C0urante commented on a change in pull request #11323: KAFKA-12226: Commit source task offsets without blocking on batch delivery

C0urante commented on a change in pull request #11323: URL: https://github.com/apache/kafka/pull/11323#discussion_r741279732 ## File path: connect/runtime/src/main/java/org/apache/kafka/connect/runtime/WorkerSourceTask.java ## @@ -474,9 +479,24 @@ public boolean commitOffsets(

[GitHub] [kafka] C0urante commented on a change in pull request #11323: KAFKA-12226: Commit source task offsets without blocking on batch delivery

C0urante commented on a change in pull request #11323: URL: https://github.com/apache/kafka/pull/11323#discussion_r741279732 ## File path: connect/runtime/src/main/java/org/apache/kafka/connect/runtime/WorkerSourceTask.java ## @@ -474,9 +479,24 @@ public boolean commitOffsets(

[GitHub] [kafka] vamossagar12 commented on pull request #11211: KAFKA-12960: Enforcing strict retention time for WindowStore and Sess…

vamossagar12 commented on pull request #11211: URL: https://github.com/apache/kafka/pull/11211#issuecomment-957932804 > Personally I'd suggest we enforce the rentention at the inner store, which means: > > 1. for built-in in-memory stores, enforce at the InMemoryXXStore level. > 2

[jira] [Updated] (KAFKA-13426) Add recordMetadata to StateStoreContext

[ https://issues.apache.org/jira/browse/KAFKA-13426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-13426: Description: KIP-791: [https://cwiki.apache.org/confluence/display/KAFKA/KIP-791%3A+Add+R

[jira] [Updated] (KAFKA-13426) Add recordMetadata to StateStoreContext

[ https://issues.apache.org/jira/browse/KAFKA-13426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-13426: Labels: kip (was: ) > Add recordMetadata to StateStoreContext > -

[GitHub] [kafka] mjsax commented on a change in pull request #11368: KAFKA-13261: Add support for custom partitioners in foreign key joins

mjsax commented on a change in pull request #11368: URL: https://github.com/apache/kafka/pull/11368#discussion_r729526952 ## File path: streams/src/main/java/org/apache/kafka/streams/kstream/TableJoined.java ## @@ -0,0 +1,119 @@ +/* + * Licensed to the Apache Software Foundati

[GitHub] [kafka] jonmcewen commented on a change in pull request #8690: KAFKA-9965: Fix uneven distribution in RoundRobinPartitioner

jonmcewen commented on a change in pull request #8690: URL: https://github.com/apache/kafka/pull/8690#discussion_r741175055 ## File path: clients/src/main/java/org/apache/kafka/clients/producer/RoundRobinPartitioner.java ## @@ -65,12 +65,20 @@ public int partition(String topic

[GitHub] [kafka] vcrfxia commented on a change in pull request #11368: KAFKA-13261: Add support for custom partitioners in foreign key joins

vcrfxia commented on a change in pull request #11368: URL: https://github.com/apache/kafka/pull/11368#discussion_r740646037 ## File path: streams/src/main/java/org/apache/kafka/streams/kstream/KTable.java ## @@ -2117,12 +2118,37 @@ * @param the key type of

[GitHub] [kafka] RivenSun2 commented on pull request #11340: KAFKA-13310 : KafkaConsumer cannot jump out of the poll method, and the…

RivenSun2 commented on pull request #11340: URL: https://github.com/apache/kafka/pull/11340#issuecomment-957138929 Hi @showuon and @guozhangwang Any suggestions for my last reply? Thanks -- This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [kafka] sglass520 edited a comment on pull request #11443: KAFKA-13411: This code enforces the creation of the correct sasl client (OAuthBear…

sglass520 edited a comment on pull request #11443: URL: https://github.com/apache/kafka/pull/11443#issuecomment-957103498 @junrao I can confirm this issue running Kafka in WildFly. The code in createSaslClient() is calling Java Security API to get the factory for specified mechanism. Howev

[GitHub] [kafka] junrao commented on pull request #11345: Allow empty last segment to have missing offset index during recovery

junrao commented on pull request #11345: URL: https://github.com/apache/kafka/pull/11345#issuecomment-956575167 @ccding : Thanks for reporting the test failure. This brings up a good point. It's kind of weird to ever have recovery point > log end offset. I am thinking that another potentia

[GitHub] [kafka] guozhangwang commented on a change in pull request #11449: MINOR: Log client disconnect events at INFO level

guozhangwang commented on a change in pull request #11449: URL: https://github.com/apache/kafka/pull/11449#discussion_r740417424 ## File path: clients/src/main/java/org/apache/kafka/clients/NetworkClient.java ## @@ -319,23 +319,29 @@ public void disconnect(String nodeId) {

[GitHub] [kafka] mimaison commented on a change in pull request #11450: KAFKA-13414: Replace Powermock/EasyMock by Mockito in connect.storage

mimaison commented on a change in pull request #11450: URL: https://github.com/apache/kafka/pull/11450#discussion_r741054431 ## File path: connect/runtime/src/test/java/org/apache/kafka/connect/storage/FileOffsetBackingStoreTest.java ## @@ -77,21 +74,17 @@ public void teardown

[GitHub] [kafka] shirenchuang commented on pull request #11453: createTopic need sort brokerMetadata

shirenchuang commented on pull request #11453: URL: https://github.com/apache/kafka/pull/11453#issuecomment-957037691 Thank you for your reply. I plan to repair the logic in kRaft together. In addition, I will add an article to explain why sorting is needed and the solution, and of course

[GitHub] [kafka] cmccabe commented on a change in pull request #11353: KAFKA-13322: Reducing amount of garbage that gets generated during a poll operation

cmccabe commented on a change in pull request #11353: URL: https://github.com/apache/kafka/pull/11353#discussion_r740554575 ## File path: clients/src/main/java/org/apache/kafka/clients/consumer/internals/SubscriptionState.java ## @@ -423,9 +423,9 @@ synchronized int numAssigne

[GitHub] [kafka] rhauch commented on a change in pull request #11323: KAFKA-12226: Commit source task offsets without blocking on batch delivery

rhauch commented on a change in pull request #11323: URL: https://github.com/apache/kafka/pull/11323#discussion_r740478689 ## File path: connect/runtime/src/main/java/org/apache/kafka/connect/runtime/WorkerSourceTask.java ## @@ -474,9 +479,24 @@ public boolean commitOffsets()

[GitHub] [kafka] guozhangwang commented on pull request #11211: KAFKA-12960: Enforcing strict retention time for WindowStore and Sess…

guozhangwang commented on pull request #11211: URL: https://github.com/apache/kafka/pull/11211#issuecomment-957002931 Personally I'd suggest we enforce the rentention at the inner store, which means: 1) for built-in in-memory stores, enforce at the InMemoryXXStore level. 2) for bu

[GitHub] [kafka] junrao commented on a change in pull request #11453: createTopic need sort brokerMetadata

junrao commented on a change in pull request #11453: URL: https://github.com/apache/kafka/pull/11453#discussion_r740573525 ## File path: core/src/main/scala/kafka/server/ZkAdminManager.scala ## @@ -152,7 +152,7 @@ class ZkAdminManager(val config: KafkaConfig,

[GitHub] [kafka] shirenchuang commented on a change in pull request #11453: createTopic need sort brokerMetadata

shirenchuang commented on a change in pull request #11453: URL: https://github.com/apache/kafka/pull/11453#discussion_r740684255 ## File path: core/src/main/scala/kafka/server/ZkAdminManager.scala ## @@ -152,7 +152,7 @@ class ZkAdminManager(val config: KafkaConfig,

[GitHub] [kafka] cadonna commented on a change in pull request #11455: KAFKA-13423: GlobalThread should not log ERROR on clean shutdown

cadonna commented on a change in pull request #11455: URL: https://github.com/apache/kafka/pull/11455#discussion_r740921447 ## File path: streams/src/main/java/org/apache/kafka/streams/KafkaStreams.java ## @@ -655,10 +656,11 @@ public synchronized void onChange(final Thread thr

[GitHub] [kafka] ableegoldman commented on a change in pull request #11424: KAFKA-13152: Replace "buffered.records.per.partition" with "input.buffer.max.bytes"

ableegoldman commented on a change in pull request #11424: URL: https://github.com/apache/kafka/pull/11424#discussion_r740700461 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/InternalTopologyBuilder.java ## @@ -385,7 +385,7 @@ public synchron

  1   2   >