Re: [PR] KAFKA-16198: Reconciliation may lose partitions when topic metadata is delayed [kafka]

2024-01-31 Thread via GitHub
lucasbru merged PR #15271: URL: https://github.com/apache/kafka/pull/15271 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] KAFKA-15675: Improve worker liveness check during Connect integration tests [kafka]

2024-01-31 Thread via GitHub
yashmayya commented on code in PR #15249: URL: https://github.com/apache/kafka/pull/15249#discussion_r1473904200 ## connect/runtime/src/test/java/org/apache/kafka/connect/util/clusters/EmbeddedConnect.java: ## @@ -963,11 +962,19 @@ public Set activeWorkers() { return

[jira] [Updated] (KAFKA-16156) System test failing for new consumer on endOffsets with negative timestamps

2024-01-31 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16156: -- Component/s: system tests > System test failing for new consumer on endOffsets with negative

[jira] [Updated] (KAFKA-16156) System test failing for new consumer on endOffsets with negative timestamps

2024-01-31 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16156: -- Labels: consumer-threading-refactor kip-848-client-support system-tests (was:

[jira] [Updated] (KAFKA-16115) AsyncKafkaConsumer: Add missing heartbeat metrics

2024-01-31 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16115: -- Labels: consumer-threading-refactor metrics (was: consumer-threading-refactor) >

[jira] [Updated] (KAFKA-16112) Review JMX metrics in Async Consumer and determine the missing ones

2024-01-31 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16112: -- Labels: consumer-threading-refactor metrics (was: consumer-threading-refactor) > Review JMX metrics

[jira] [Updated] (KAFKA-16113) AsyncKafkaConsumer: Add missing offset commit metrics

2024-01-31 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16113: -- Labels: consumer-threading-refactor metrics (was: consumer-threading-refactor) >

[jira] [Updated] (KAFKA-16142) Update metrics documentation for errors and new metrics

2024-01-31 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16142: -- Labels: consumer-threading-refactor metrics (was: consumer-threading-refactor) > Update metrics

[jira] [Updated] (KAFKA-16116) AsyncKafkaConsumer: Add missing rebalance metrics

2024-01-31 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16116: -- Labels: consumer-threading-refactor metrics (was: consumer-threading-refactor) >

[jira] [Updated] (KAFKA-16143) New metrics for KIP-848 protocol

2024-01-31 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16143: -- Labels: kip-848-client-support metrics (was: kip-848-client-support) > New metrics for KIP-848

[jira] [Updated] (KAFKA-16109) Ensure system tests cover the "simple consumer + commit" use case

2024-01-31 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16109: -- Component/s: system tests > Ensure system tests cover the "simple consumer + commit" use case >

[jira] [Updated] (KAFKA-15557) Investigate FetcherTest's/FetchRequestManager's duplicate metadata update in assignFromUserNoId

2024-01-31 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-15557: -- Labels: consumer-threading-refactor fetcher unit-tests (was: consumer-threading-refactor fetcher) >

[jira] [Updated] (KAFKA-15606) Investigate FetcherTest's/FetchRequestManager's testCompletedFetchRemoval

2024-01-31 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-15606: -- Labels: consumer-threading-refactor fetcher unit-tests (was: consumer-threading-refactor fetcher) >

[jira] [Updated] (KAFKA-15635) Investigate FetcherTest's/FetchRequestManager's testFetcherLeadMetric

2024-01-31 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-15635: -- Labels: consumer-threading-refactor fetcher unit-tests (was: consumer-threading-refactor fetcher) >

[jira] [Updated] (KAFKA-16000) Migrate MembershipManagerImplTest away from ConsumerTestBuilder

2024-01-31 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16000: -- Labels: consumer-threading-refactor unit-tests (was: consumer-threading-refactor) > Migrate

[jira] [Updated] (KAFKA-15637) Investigate FetcherTest's/FetchRequestManager's testFetchCompletedBeforeHandlerAdded

2024-01-31 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-15637: -- Labels: consumer-threading-refactor fetcher unit-tests (was: consumer-threading-refactor fetcher) >

[jira] [Updated] (KAFKA-15639) Investigate ConsumerNetworkThreadTest's testResetPositionsProcessFailureIsIgnored

2024-01-31 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-15639: -- Labels: consumer-threading-refactor unit-tests (was: consumer-threading-refactor) > Investigate

[jira] [Updated] (KAFKA-15652) Add tests to verify OffsetFetcherUtils.getOffsetResetTimestamp()

2024-01-31 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-15652: -- Labels: consumer-threading-refactor position unit-tests (was: consumer-threading-refactor position)

[jira] [Updated] (KAFKA-15991) Flaky new consumer test testGroupIdNotNullAndValid

2024-01-31 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-15991: -- Labels: consumer-threading-refactor flaky-test kip-848-client-support unit-tests (was:

[jira] [Updated] (KAFKA-15999) Migrate HeartbeatRequestManagerTest away from ConsumerTestBuilder

2024-01-31 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-15999: -- Labels: consumer-threading-refactor unit-tests (was: consumer-threading-refactor) > Migrate

[jira] [Updated] (KAFKA-15638) Investigate ConsumerNetworkThreadTest's testPollResultTimer

2024-01-31 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-15638: -- Labels: consumer-threading-refactor unit-tests (was: consumer-threading-refactor) > Investigate

[jira] [Updated] (KAFKA-16001) Migrate ConsumerNetworkThreadTest away from ConsumerTestBuilder

2024-01-31 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16001: -- Labels: consumer-threading-refactor unit-tests (was: consumer-threading-refactor) > Migrate

[jira] [Updated] (KAFKA-15636) Investigate FetcherTest's/FetchRequestManager's testFetchResponseMetrics

2024-01-31 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-15636: -- Labels: consumer-threading-refactor fetcher unit-tests (was: consumer-threading-refactor fetcher) >

[jira] [Updated] (KAFKA-14724) Port tests in FetcherTest to FetchRequestManagerTest

2024-01-31 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-14724: -- Labels: consumer-threading-refactor fetcher kip-848-e2e kip-848-preview unit-tests (was:

[jira] [Updated] (KAFKA-15634) Investigate FetcherTest's/FetchRequestManager's testQuotaMetrics

2024-01-31 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-15634: -- Labels: consumer-threading-refactor fetcher unit-tests (was: consumer-threading-refactor fetcher) >

[jira] [Updated] (KAFKA-15617) Investigate FetcherTest's/FetchRequestManager's testFetchingPendingPartitions and testInflightFetchOnPendingPartitions overlap

2024-01-31 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-15617: -- Labels: consumer-threading-refactor fetcher unit-tests (was: consumer-threading-refactor fetcher) >

[jira] [Updated] (KAFKA-15971) Re-enable consumer integration tests for new consumer

2024-01-31 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-15971: -- Component/s: (was: unit tests) > Re-enable consumer integration tests for new consumer >

[jira] [Updated] (KAFKA-15971) Re-enable consumer integration tests for new consumer

2024-01-31 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-15971: -- Labels: consumer-threading-refactor integration-tests kip-848 kip-848-preview (was:

[jira] [Updated] (KAFKA-15932) Flaky test - PlaintextConsumerTest.testSeek("kraft+kip-848","consumer")

2024-01-31 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-15932: -- Labels: consumer-threading-refactor flaky-test integration-tests kip-848-client-support (was:

[jira] [Updated] (KAFKA-15932) Flaky test - PlaintextConsumerTest.testSeek("kraft+kip-848","consumer")

2024-01-31 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-15932: -- Labels: consumer-threading-refactor flaky-test integration-tests kip-848 kip-848-client-support

[jira] [Updated] (KAFKA-15932) Flaky test - PlaintextConsumerTest.testSeek("kraft+kip-848","consumer")

2024-01-31 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-15932: -- Component/s: (was: unit tests) > Flaky test -

[jira] [Updated] (KAFKA-15986) New consumer group protocol integration test failures

2024-01-31 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-15986: -- Component/s: (was: unit tests) > New consumer group protocol integration test failures >

[jira] [Updated] (KAFKA-15991) Flaky new consumer test testGroupIdNotNullAndValid

2024-01-31 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-15991: -- Labels: consumer-threading-refactor flaky-test kip-848-client-support (was:

[jira] [Updated] (KAFKA-15515) Remove duplicated integration tests for new consumer

2024-01-31 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-15515: -- Component/s: (was: unit tests) > Remove duplicated integration tests for new consumer >

[jira] [Updated] (KAFKA-15986) New consumer group protocol integration test failures

2024-01-31 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-15986: -- Labels: consumer-threading-refactor integration-tests kip-848 kip-848-client-support (was:

[jira] [Updated] (KAFKA-15515) Remove duplicated integration tests for new consumer

2024-01-31 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-15515: -- Labels: consumer-threading-refactor integration-tests (was: consumer-threading-refactor

[jira] [Updated] (KAFKA-16167) Fix PlaintextConsumerTest.testAutoCommitOnCloseAfterWakeup

2024-01-31 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16167: -- Labels: consumer-threading-refactor integration-tests kip-848-client-support (was:

[jira] [Updated] (KAFKA-16167) Fix PlaintextConsumerTest.testAutoCommitOnCloseAfterWakeup

2024-01-31 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16167: -- Component/s: (was: unit tests) > Fix PlaintextConsumerTest.testAutoCommitOnCloseAfterWakeup >

[jira] [Updated] (KAFKA-16109) Ensure system tests cover the "simple consumer + commit" use case

2024-01-31 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16109: -- Component/s: (was: system tests) > Ensure system tests cover the "simple consumer + commit" use

[jira] [Updated] (KAFKA-16109) Ensure system tests cover the "simple consumer + commit" use case

2024-01-31 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16109: -- Labels: consumer-threading-refactor system-tests (was: consumer-threading-refactor) > Ensure system

[jira] [Updated] (KAFKA-16104) Enable additional PlaintextConsumerTest tests for new consumer

2024-01-31 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16104: -- Component/s: (was: system tests) Labels: consumer-threading-refactor integration-tests

[jira] [Updated] (KAFKA-15993) Enable max poll integration tests that depend on callback invocation

2024-01-31 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-15993: -- Component/s: (was: system tests) Labels: consumer-threading-refactor integration-tests

[jira] [Updated] (KAFKA-15848) Consumer API timeout inconsistent between ConsumerDelegate implementations

2024-01-31 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-15848: -- Component/s: (was: system tests) Labels: consumer-threading-refactor integration-tests

[jira] [Updated] (KAFKA-16023) PlaintextConsumerTest needs to wait for reconciliation to complete before proceeding

2024-01-31 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16023: -- Component/s: (was: system tests) Labels: consumer-threading-refactor integration-tests

[jira] [Updated] (KAFKA-16019) Some of the tests in PlaintextConsumer can't seem to deterministically invoke and verify the consumer callback

2024-01-31 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16019: -- Component/s: (was: system tests) Labels: consumer-threading-refactor integration-tests

[jira] [Updated] (KAFKA-16010) Fix PlaintextConsumerTest.testMultiConsumerSessionTimeoutOnStopPolling

2024-01-31 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16010: -- Component/s: (was: system tests) Labels: consumer-threading-refactor integration-tests

[jira] [Updated] (KAFKA-16009) Fix PlaintextConsumerTest.testMaxPollIntervalMsDelayInRevocation

2024-01-31 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16009: -- Component/s: (was: system tests) Labels: consumer-threading-refactor integration-tests

[jira] [Updated] (KAFKA-16008) Fix PlaintextConsumerTest.testMaxPollIntervalMs

2024-01-31 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16008: -- Component/s: (was: system tests) Labels: consumer-threading-refactor integration-tests

[jira] [Updated] (KAFKA-16134) kafka.api.PlaintextConsumerTest.testPerPartitionLagMetricsCleanUpWithSubscribe(String, String).quorum=kraft+kip848.groupProtocol=consumer is flaky

2024-01-31 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16134: -- Labels: consumer-threading-refactor integration-tests kip-848-client-support (was:

[jira] [Updated] (KAFKA-16134) kafka.api.PlaintextConsumerTest.testPerPartitionLagMetricsCleanUpWithSubscribe(String, String).quorum=kraft+kip848.groupProtocol=consumer is flaky

2024-01-31 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16134: -- Component/s: (was: system tests) >

[jira] [Updated] (KAFKA-16151) Fix PlaintextConsumerTest.testPerPartitionLeadMetricsCleanUpWithSubscribe

2024-01-31 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16151: -- Labels: consumer-threading-refactor integration-tests kip-848-client-support (was:

[jira] [Updated] (KAFKA-16011) Fix PlaintextConsumerTest.testMultiConsumerSessionTimeoutOnClose

2024-01-31 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16011: -- Labels: integration-tests kip-848-client-support timeout (was: kip-848-client-support timeout) >

[jira] [Updated] (KAFKA-16150) Fix PlaintextConsumerTest.testPerPartitionLagMetricsCleanUpWithSubscribe

2024-01-31 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16150: -- Labels: consumer-threading-refactor integration-tests kip-848-client-support (was:

[jira] [Updated] (KAFKA-16135) kafka.api.PlaintextConsumerTest.testPerPartitionLeadMetricsCleanUpWithSubscribe(String, String).quorum=kraft+kip848.groupProtocol=consumer is flaky

2024-01-31 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16135: -- Labels: consumer-threading-refactor integration-tests kip-848-client-support (was:

[jira] [Updated] (KAFKA-16150) Fix PlaintextConsumerTest.testPerPartitionLagMetricsCleanUpWithSubscribe

2024-01-31 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16150: -- Component/s: (was: system tests) > Fix

[jira] [Updated] (KAFKA-16011) Fix PlaintextConsumerTest.testMultiConsumerSessionTimeoutOnClose

2024-01-31 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16011: -- Component/s: (was: system tests) > Fix

[jira] [Updated] (KAFKA-16135) kafka.api.PlaintextConsumerTest.testPerPartitionLeadMetricsCleanUpWithSubscribe(String, String).quorum=kraft+kip848.groupProtocol=consumer is flaky

2024-01-31 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16135: -- Component/s: (was: system tests) >

[jira] [Updated] (KAFKA-16152) Fix PlaintextConsumerTest.testStaticConsumerDetectsNewPartitionCreatedAfterRestart

2024-01-31 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16152: -- Component/s: (was: system tests) > Fix >

[jira] [Updated] (KAFKA-16151) Fix PlaintextConsumerTest.testPerPartitionLeadMetricsCleanUpWithSubscribe

2024-01-31 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16151: -- Component/s: (was: system tests) > Fix

[jira] [Updated] (KAFKA-16037) Upgrade existing system tests to use new consumer

2024-01-31 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16037: -- Labels: kip-848-client-support system-tests (was: kip-848-client-support) > Upgrade existing system

[jira] [Updated] (KAFKA-16152) Fix PlaintextConsumerTest.testStaticConsumerDetectsNewPartitionCreatedAfterRestart

2024-01-31 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16152: -- Labels: consumer-threading-refactor integration-tests kip-848-client-support (was:

[jira] [Updated] (KAFKA-15691) Add new system tests to use new consumer

2024-01-31 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-15691: -- Labels: kip-848-client-support system-tests (was: kip-848-client-support) > Add new system tests to

[PR] [WIP] KAFKA-16192: Introduce usage of flexible records to coordinators [kafka]

2024-01-31 Thread via GitHub
jolshan opened a new pull request, #15303: URL: https://github.com/apache/kafka/pull/15303 Playing around with adding a transaction version feature WIP -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

Re: [PR] KAFKA-14585: Refactoring for moving the storage tool [kafka]

2024-01-31 Thread via GitHub
showuon commented on PR #15273: URL: https://github.com/apache/kafka/pull/15273#issuecomment-1920457353 > @showuon I rebased and addressed your comments. Did not remove properties definitions from KafkaConfig, because this breaks a lot of tests. I think this should be done as part of

Re: [PR] KAFKA-16157: fix topic recreation handling with offline disks [kafka]

2024-01-31 Thread via GitHub
gaurav-narula commented on code in PR #15263: URL: https://github.com/apache/kafka/pull/15263#discussion_r1473758133 ## core/src/test/scala/unit/kafka/server/ReplicaManagerTest.scala: ## @@ -4912,7 +4919,9 @@ class ReplicaManagerTest { assertTrue(fooPart eq fooPart2)

Re: [PR] KIP-909 [kafka]

2024-01-31 Thread via GitHub
github-actions[bot] commented on PR #14691: URL: https://github.com/apache/kafka/pull/14691#issuecomment-1920440845 This PR is being marked as stale since it has not had any activity in 90 days. If you would like to keep this PR alive, please ask a committer for review. If the PR has

[jira] [Created] (KAFKA-16214) No user info when SASL authentication failure

2024-01-31 Thread Luke Chen (Jira)
Luke Chen created KAFKA-16214: - Summary: No user info when SASL authentication failure Key: KAFKA-16214 URL: https://issues.apache.org/jira/browse/KAFKA-16214 Project: Kafka Issue Type: Bug

Re: [PR] KAFKA-16157: fix topic recreation handling with offline disks [kafka]

2024-01-31 Thread via GitHub
showuon commented on code in PR #15263: URL: https://github.com/apache/kafka/pull/15263#discussion_r1473746536 ## core/src/test/scala/unit/kafka/server/ReplicaManagerTest.scala: ## @@ -4912,7 +4919,9 @@ class ReplicaManagerTest { assertTrue(fooPart eq fooPart2)

Re: [PR] KAFKA-16180: Fix UMR and LAIR handling during ZK migration [kafka]

2024-01-31 Thread via GitHub
mumrah commented on code in PR #15293: URL: https://github.com/apache/kafka/pull/15293#discussion_r1473671017 ## core/src/main/scala/kafka/server/metadata/ZkMetadataCache.scala: ## @@ -65,48 +65,84 @@ case class MetadataSnapshot(partitionStates: mutable.AnyRefMap[String,

[jira] [Commented] (KAFKA-12549) Allow state stores to opt-in transactional support

2024-01-31 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17812993#comment-17812993 ] Matthias J. Sax commented on KAFKA-12549: - [~high.lee] – this ticket is superceded by

Re: [PR] KAFKA-14683 Migrate #testStartPaused to Mockito [kafka]

2024-01-31 Thread via GitHub
gharris1727 commented on code in PR #14663: URL: https://github.com/apache/kafka/pull/14663#discussion_r1473603606 ## connect/runtime/src/test/java/org/apache/kafka/connect/runtime/WorkerSinkTaskTest.java: ## @@ -1994,53 +1616,6 @@ private void expectInitializeTask() {

Re: [PR] KAFKA-15307: update/note deprecated configs [kafka]

2024-01-31 Thread via GitHub
mjsax commented on code in PR #14360: URL: https://github.com/apache/kafka/pull/14360#discussion_r1473438104 ## docs/streams/developer-guide/config-streams.html: ## @@ -1010,6 +1016,18 @@ topology.optimization + windowed.inner.class.serde + + + +

Re: [PR] KAFKA-15307: update/note deprecated configs [kafka]

2024-01-31 Thread via GitHub
mjsax commented on code in PR #14360: URL: https://github.com/apache/kafka/pull/14360#discussion_r1473419962 ## streams/src/main/java/org/apache/kafka/streams/StreamsConfig.java: ## @@ -482,7 +482,8 @@ public class StreamsConfig extends AbstractConfig { public static final

Re: [PR] KAFKA-16115: Adding missing heartbeat metrics [kafka]

2024-01-31 Thread via GitHub
philipnee commented on code in PR #15216: URL: https://github.com/apache/kafka/pull/15216#discussion_r1473330427 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/metrics/AbstractConsumerMetricsManager.java: ## @@ -0,0 +1,94 @@ +/* + * Licensed to the Apache

Re: [PR] KAFKA-16189; Extend admin to support ConsumerGroupDescribe API [kafka]

2024-01-31 Thread via GitHub
dajac commented on code in PR #15253: URL: https://github.com/apache/kafka/pull/15253#discussion_r1473247269 ## clients/src/main/java/org/apache/kafka/clients/admin/internals/DescribeConsumerGroupsHandler.java: ## @@ -158,36 +295,71 @@ public ApiResult handleResponse(

Re: [PR] MINOR: Change Connect integration StopStartLatch::await to throw TimeoutException on timeout [kafka]

2024-01-31 Thread via GitHub
C0urante closed pull request #15178: MINOR: Change Connect integration StopStartLatch::await to throw TimeoutException on timeout URL: https://github.com/apache/kafka/pull/15178 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

Re: [PR] MINOR: Change Connect integration StopStartLatch::await to throw TimeoutException on timeout [kafka]

2024-01-31 Thread via GitHub
C0urante commented on PR #15178: URL: https://github.com/apache/kafka/pull/15178#issuecomment-1919630582 This change wasn't really that valuable; the only information it added was already trivial and what one would expect to see (e.g., testing code that waited for a connector to be stopped

[PR] KAFKA-15524, KAFKA-15917: Wait for zombie sink tasks' consumers to commit offsets before trying to modify their offsets in integration tests [kafka]

2024-01-31 Thread via GitHub
C0urante opened a new pull request, #15302: URL: https://github.com/apache/kafka/pull/15302 [Jira 1](https://issues.apache.org/jira/browse/KAFKA-15524), [Jira 2](https://issues.apache.org/jira/browse/KAFKA-15917) In some rare cases, our integration tests observe that tasks are up and

Re: [PR] KAFKA-16189; Extend admin to support ConsumerGroupDescribe API [kafka]

2024-01-31 Thread via GitHub
AndrewJSchofield commented on code in PR #15253: URL: https://github.com/apache/kafka/pull/15253#discussion_r1473234152 ## clients/src/main/java/org/apache/kafka/clients/admin/internals/DescribeConsumerGroupsHandler.java: ## @@ -158,36 +295,71 @@ public ApiResult

[jira] [Commented] (KAFKA-16212) Cache partitions by TopicIdPartition instead of TopicPartition

2024-01-31 Thread Lianet Magrans (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17812824#comment-17812824 ] Lianet Magrans commented on KAFKA-16212: Similar situation and approach on the client side btw

[jira] [Created] (KAFKA-16213) KRaft should honor voterId outside of VotedState

2024-01-31 Thread Jira
José Armando García Sancio created KAFKA-16213: -- Summary: KRaft should honor voterId outside of VotedState Key: KAFKA-16213 URL: https://issues.apache.org/jira/browse/KAFKA-16213 Project:

Re: [PR] KAFKA-16168; Implement GroupCoordinator.onPartitionsDeleted [kafka]

2024-01-31 Thread via GitHub
jolshan commented on code in PR #15237: URL: https://github.com/apache/kafka/pull/15237#discussion_r1473219011 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/OffsetMetadataManager.java: ## @@ -903,6 +906,45 @@ public boolean cleanupExpiredOffsets(String

Re: [PR] KAFKA-16195: ignore metadata.log.dir failure in ZK mode [kafka]

2024-01-31 Thread via GitHub
gaurav-narula commented on code in PR #15262: URL: https://github.com/apache/kafka/pull/15262#discussion_r1473210077 ## core/src/main/scala/kafka/server/ReplicaManager.scala: ## @@ -2586,7 +2586,7 @@ class ReplicaManager(val config: KafkaConfig, // retrieve the UUID here

[jira] [Commented] (KAFKA-16212) Cache partitions by TopicIdPartition instead of TopicPartition

2024-01-31 Thread Justine Olshan (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17812822#comment-17812822 ] Justine Olshan commented on KAFKA-16212: When working on KIP-516 (topic IDs) there were many

[jira] [Assigned] (KAFKA-15524) Flaky test org.apache.kafka.connect.integration.OffsetsApiIntegrationTest.testResetSinkConnectorOffsetsZombieSinkTasks

2024-01-31 Thread Chris Egerton (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Egerton reassigned KAFKA-15524: - Assignee: Chris Egerton > Flaky test >

[jira] [Assigned] (KAFKA-15917) Flaky test - OffsetsApiIntegrationTest.testAlterSinkConnectorOffsetsZombieSinkTasks

2024-01-31 Thread Chris Egerton (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Egerton reassigned KAFKA-15917: - Assignee: Chris Egerton > Flaky test - >

Re: [PR] KAFKA-16195: ignore metadata.log.dir failure in ZK mode [kafka]

2024-01-31 Thread via GitHub
cmccabe commented on code in PR #15262: URL: https://github.com/apache/kafka/pull/15262#discussion_r1473174695 ## core/src/main/scala/kafka/server/ReplicaManager.scala: ## @@ -2586,7 +2586,7 @@ class ReplicaManager(val config: KafkaConfig, // retrieve the UUID here because

Re: [PR] KAFKA-16195: ignore metadata.log.dir failure in ZK mode [kafka]

2024-01-31 Thread via GitHub
cmccabe commented on code in PR #15262: URL: https://github.com/apache/kafka/pull/15262#discussion_r1473174695 ## core/src/main/scala/kafka/server/ReplicaManager.scala: ## @@ -2586,7 +2586,7 @@ class ReplicaManager(val config: KafkaConfig, // retrieve the UUID here because

Re: [PR] KAFKA-14412: Add statestore.uncommitted.max.bytes [kafka]

2024-01-31 Thread via GitHub
nicktelford commented on code in PR #15264: URL: https://github.com/apache/kafka/pull/15264#discussion_r1473168658 ## streams/src/main/java/org/apache/kafka/streams/StreamsConfig.java: ## Review Comment: Yeah, I can do that. I'm a little concerned that we might forget to

Re: [PR] KAFKA-14412: Add statestore.uncommitted.max.bytes [kafka]

2024-01-31 Thread via GitHub
nicktelford commented on code in PR #15264: URL: https://github.com/apache/kafka/pull/15264#discussion_r1473167769 ## streams/src/main/java/org/apache/kafka/streams/processor/internals/TaskManager.java: ## @@ -1836,6 +1841,33 @@ public void

Re: [PR] KAFKA-14412: Add statestore.uncommitted.max.bytes [kafka]

2024-01-31 Thread via GitHub
nicktelford commented on code in PR #15264: URL: https://github.com/apache/kafka/pull/15264#discussion_r1473167034 ## streams/src/main/java/org/apache/kafka/streams/processor/internals/TaskManager.java: ## @@ -1836,6 +1841,33 @@ public void

Re: [PR] KAFKA-14412: Add statestore.uncommitted.max.bytes [kafka]

2024-01-31 Thread via GitHub
nicktelford commented on code in PR #15264: URL: https://github.com/apache/kafka/pull/15264#discussion_r1473166531 ## streams/src/main/java/org/apache/kafka/streams/processor/internals/TaskManager.java: ## @@ -1836,6 +1841,33 @@ public void

Re: [PR] KAFKA-14412: Add statestore.uncommitted.max.bytes [kafka]

2024-01-31 Thread via GitHub
nicktelford commented on code in PR #15264: URL: https://github.com/apache/kafka/pull/15264#discussion_r1473165230 ## streams/src/main/java/org/apache/kafka/streams/processor/internals/TaskManager.java: ## @@ -1836,6 +1841,33 @@ public void

Re: [PR] KAFKA-16115: Adding missing heartbeat metrics [kafka]

2024-01-31 Thread via GitHub
philipnee commented on code in PR #15216: URL: https://github.com/apache/kafka/pull/15216#discussion_r1473160823 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/metrics/AbstractConsumerMetricsManager.java: ## @@ -0,0 +1,94 @@ +/* + * Licensed to the Apache

Re: [PR] KAFKA-14412: Add statestore.uncommitted.max.bytes [kafka]

2024-01-31 Thread via GitHub
nicktelford commented on code in PR #15264: URL: https://github.com/apache/kafka/pull/15264#discussion_r1473153338 ## streams/src/main/java/org/apache/kafka/streams/processor/internals/TaskManager.java: ## @@ -1097,10 +1102,10 @@ void handleRevocation(final Collection

[jira] [Assigned] (KAFKA-16212) Cache partitions by TopicIdPartition instead of TopicPartition

2024-01-31 Thread Omnia Ibrahim (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Omnia Ibrahim reassigned KAFKA-16212: - Assignee: Omnia Ibrahim > Cache partitions by TopicIdPartition instead of

Re: [PR] KAFKA-14412: Add statestore.uncommitted.max.bytes [kafka]

2024-01-31 Thread via GitHub
nicktelford commented on code in PR #15264: URL: https://github.com/apache/kafka/pull/15264#discussion_r1473141072 ## streams/src/main/java/org/apache/kafka/streams/processor/internals/TaskExecutor.java: ## @@ -157,7 +158,8 @@ int

Re: [PR] KAFKA-14412: Add statestore.uncommitted.max.bytes [kafka]

2024-01-31 Thread via GitHub
nicktelford commented on code in PR #15264: URL: https://github.com/apache/kafka/pull/15264#discussion_r1473126369 ## streams/src/main/java/org/apache/kafka/streams/processor/internals/StreamThread.java: ## @@ -1374,7 +1376,7 @@ public void signalResume() { */ int

Re: [PR] KAFKA-15018: Failing offset flush for EOS when secondary offset store writes fails for tombstone records [kafka]

2024-01-31 Thread via GitHub
C0urante commented on PR #13801: URL: https://github.com/apache/kafka/pull/13801#issuecomment-1919475280 Thanks for the in-depth analysis! I think part of the problem here stems from trying to make our internal `Future`-based API cooperate with Java's `CompleteableFuture` API. I've

Re: [PR] MINOR: Clean up core metrics, migration, network, raft, security, serializer, tools, utils, and zookeeper modules [kafka]

2024-01-31 Thread via GitHub
jlprat commented on code in PR #15279: URL: https://github.com/apache/kafka/pull/15279#discussion_r1473125018 ## core/src/main/scala/kafka/network/RequestChannel.scala: ## @@ -92,18 +92,18 @@ object RequestChannel extends Logging { val envelope:

  1   2   >