[jira] [Updated] (KAFKA-16228) Add --remote-log-metadata-decoder to kafka-dump-log.sh

2024-02-06 Thread Federico Valeri (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Federico Valeri updated KAFKA-16228: Labels: kip-required (was: ) > Add --remote-log-metadata-decoder to kafka-dump-log.sh >

[jira] [Updated] (KAFKA-16218) Partition reassignment can't complete if any target replica is out-of-sync

2024-02-06 Thread Drawxy (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Drawxy updated KAFKA-16218: --- Issue Type: Improvement (was: Bug) > Partition reassignment can't complete if any target replica is

Re: [PR] MINOR fix word spelling mistakes [kafka]

2024-02-06 Thread via GitHub
showuon merged PR #15331: URL: https://github.com/apache/kafka/pull/15331 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Created] (KAFKA-16232) kafka hangs forever in the starting process if the authorizer future is not returned

2024-02-06 Thread Luke Chen (Jira)
Luke Chen created KAFKA-16232: - Summary: kafka hangs forever in the starting process if the authorizer future is not returned Key: KAFKA-16232 URL: https://issues.apache.org/jira/browse/KAFKA-16232

[jira] [Commented] (KAFKA-12823) Remove Deprecated method KStream#through

2024-02-06 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17815089#comment-17815089 ] Matthias J. Sax commented on KAFKA-12823: - Look for ticket labeled "beginner" or "newbie":

[PR] MINOR fix word spelling mistakes [kafka]

2024-02-06 Thread via GitHub
eliasyaoyc opened a new pull request, #15331: URL: https://github.com/apache/kafka/pull/15331 - fix word spelling mistakes in KafkaRaftClient ### Committer Checklist (excluded from commit message) - [ ] Verify design and implementation - [ ] Verify test coverage and CI build

Re: [PR] KAFKA-14517: Implement regex subscriptions [kafka]

2024-02-06 Thread via GitHub
JimmyWang6 commented on PR #14327: URL: https://github.com/apache/kafka/pull/14327#issuecomment-1931122011 > Thanks for your reply! > I will remove this part of code @dajac I'm sorry that I replied with the wrong content. Here is my email address:

[PR] KAFKA-16231: Update consumer_test.py to support KIP-848’s group protocol config [kafka]

2024-02-06 Thread via GitHub
kirktrue opened a new pull request, #15330: URL: https://github.com/apache/kafka/pull/15330 Added a new optional `group_protocol` parameter to the test methods, then passed that down to the `setup_consumer` method. Unfortunately, because the new consumer can only be used with the new

[jira] [Updated] (KAFKA-14567) Kafka Streams crashes after ProducerFencedException

2024-02-06 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-14567: Description: Running a Kafka Streams application with EOS-v2. We first see a

[PR] KIP848- Add JMH Benchmarks for Client And Server Side Assignors [kafka]

2024-02-06 Thread via GitHub
rreddy-22 opened a new pull request, #15329: URL: https://github.com/apache/kafka/pull/15329 This PR contains the addition of two JMH benchmark workloads to test the performance of the different assignors present on both the client side and the new server side assignors (KIP-848).

[PR] KAFKA-16230: Update verifiable_consumer.py to support KIP-848’s group protocol config [kafka]

2024-02-06 Thread via GitHub
kirktrue opened a new pull request, #15328: URL: https://github.com/apache/kafka/pull/15328 Including the new `--group-protocol` command line option to `VerifiableConsumer` (from KAFKA-16037/#15325) if the node is running 3.7.0+ of the consumer ### Committer Checklist (excluded from

[jira] [Commented] (KAFKA-15538) Client support for java regex based subscription

2024-02-06 Thread Phuc Hong Tran (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17815041#comment-17815041 ] Phuc Hong Tran commented on KAFKA-15538: [~lianetm] I think instead of closing this ticket we

Re: [PR] KAFKA-7663: Custom Processor supplied on addGlobalStore is not used when restoring state from topic [kafka]

2024-02-06 Thread via GitHub
wcarlson5 closed pull request #15326: KAFKA-7663: Custom Processor supplied on addGlobalStore is not used when restoring state from topic URL: https://github.com/apache/kafka/pull/15326 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[PR] MINOR Fix a case where not all ACLs for a given resource are written to ZK [kafka]

2024-02-06 Thread via GitHub
mumrah opened a new pull request, #15327: URL: https://github.com/apache/kafka/pull/15327 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

[PR] KAFKA-7663: Custom Processor supplied on addGlobalStore is not used when restoring state from topic [kafka]

2024-02-06 Thread via GitHub
wcarlson5 opened a new pull request, #15326: URL: https://github.com/apache/kafka/pull/15326 The global table is reloaded but without going through the processor supplied; instead, it calls GlobalStateManagerImp#restoreState which simply stores the input topic K,V records into rocksDB.

Re: [PR] KAFKA-16226 Reduce synchronization between producer threads [kafka]

2024-02-06 Thread via GitHub
hachikuji commented on code in PR #15323: URL: https://github.com/apache/kafka/pull/15323#discussion_r1480620848 ## clients/src/main/java/org/apache/kafka/clients/producer/internals/RecordAccumulator.java: ## @@ -647,27 +647,27 @@ private long batchReady(boolean exhausted,

Re: [PR] KAFKA-16206 Fix unnecessary topic config deletion during ZK migration [kafka]

2024-02-06 Thread via GitHub
ahuang98 commented on PR #14206: URL: https://github.com/apache/kafka/pull/14206#issuecomment-1930876640 Is there a downside to having `deleteTopic` in `ZkTopicMigrationClient` not delete configs? Otherwise changing the logging level seems okay to me. -- This is an automated message

Re: [PR] KAFKA-16055: Thread unsafe use of HashMap stored in QueryableStoreProvider#storeProviders [kafka]

2024-02-06 Thread via GitHub
wcarlson5 commented on PR #15121: URL: https://github.com/apache/kafka/pull/15121#issuecomment-1930810239 @ableegoldman I think you have context on this issue. https://lists.apache.org/thread/gpct1275bfqovlckptn3lvf683qpoxol -- This is an automated message from the Apache Git

Re: [PR] KAFKA-16215; KAFKA-16178: Fix member not rejoining after error [kafka]

2024-02-06 Thread via GitHub
lianetm commented on PR #15311: URL: https://github.com/apache/kafka/pull/15311#issuecomment-1930740037 Hey @dajac , I updated this to ensure we record a failed attempt for all errors in HB. That will effectively update the received time and backoff, with the ability to skip backoff (0

[PR] KAFKA-16037: Update VerifiableConsumer to support KIP-848’s group protocol config [kafka]

2024-02-06 Thread via GitHub
kirktrue opened a new pull request, #15325: URL: https://github.com/apache/kafka/pull/15325 Add the optional `--group-protocol` command line option that can be set in the system tests There are no existing unit tests for `VerifiableConsumer`. It was tested by running the system

[jira] [Updated] (KAFKA-16231) Update consumer_test.py to support KIP-848’s group protocol config

2024-02-06 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16231: -- Description: This task is to update {{consumer_test.py}} to support the {{group.protocol}}

[jira] [Created] (KAFKA-16231) Update consumer_test.py to support KIP-848’s group protocol config

2024-02-06 Thread Kirk True (Jira)
Kirk True created KAFKA-16231: - Summary: Update consumer_test.py to support KIP-848’s group protocol config Key: KAFKA-16231 URL: https://issues.apache.org/jira/browse/KAFKA-16231 Project: Kafka

[jira] [Updated] (KAFKA-16230) Update verifiable_consumer.py to support KIP-848’s group protocol config

2024-02-06 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16230: -- Summary: Update verifiable_consumer.py to support KIP-848’s group protocol config (was: Update

[jira] [Updated] (KAFKA-16230) Update verifiable_consumer to support KIP-848’s group protocol config

2024-02-06 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16230: -- Description: This task is to update {{verifiable_consumer.py}} to support the {{group.protocol}}

[jira] [Created] (KAFKA-16230) Update verifiable_consumer to support KIP-848’s group protocol config

2024-02-06 Thread Kirk True (Jira)
Kirk True created KAFKA-16230: - Summary: Update verifiable_consumer to support KIP-848’s group protocol config Key: KAFKA-16230 URL: https://issues.apache.org/jira/browse/KAFKA-16230 Project: Kafka

[jira] [Updated] (KAFKA-16037) Update VerifiableConsumer to support KIP-848’s group protocol config

2024-02-06 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16037: -- Description: This task is to update {{VerifiableConsumer}} to support the {{group.protocol}}

[jira] [Updated] (KAFKA-16037) Update VerifiableConsumer to support KIP-848’s group protocol config

2024-02-06 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16037: -- Description: This task is to allow the the system tests so that they execute the Consumer for both

[jira] [Updated] (KAFKA-16037) Update VerifiableConsumer to support KIP-848’s group protocol config

2024-02-06 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16037: -- Summary: Update VerifiableConsumer to support KIP-848’s group protocol config (was: Upgrade existing

[jira] [Updated] (KAFKA-16037) Upgrade existing system tests to use new consumer

2024-02-06 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16037: -- Description: This task is to parameterize the system tests so that they execute the Consumer for

[jira] [Assigned] (KAFKA-16037) Upgrade existing system tests to use new consumer

2024-02-06 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True reassigned KAFKA-16037: - Assignee: Kirk True (was: Dongnuo Lyu) > Upgrade existing system tests to use new consumer >

Re: [PR] KAFKA-16215; KAFKA-16178: Fix member not rejoining after error [kafka]

2024-02-06 Thread via GitHub
lianetm commented on code in PR #15311: URL: https://github.com/apache/kafka/pull/15311#discussion_r1480405280 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/RequestState.java: ## @@ -106,6 +106,13 @@ public void onSendAttempt(final long currentTimeMs) {

[jira] [Updated] (KAFKA-16227) Console consumer fails with `IllegalStateException`

2024-02-06 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16227: -- Priority: Critical (was: Major) > Console consumer fails with `IllegalStateException` >

[jira] [Assigned] (KAFKA-16227) Console consumer fails with `IllegalStateException`

2024-02-06 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True reassigned KAFKA-16227: - Assignee: (was: Kirk True) > Console consumer fails with `IllegalStateException` >

[jira] [Updated] (KAFKA-16227) Console consumer fails with `IllegalStateException`

2024-02-06 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16227: -- Labels: kip-848-client-support (was: consumer-threading-refactor) > Console consumer fails with

[jira] [Updated] (KAFKA-16227) Console consumer fails with `IllegalStateException`

2024-02-06 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16227: -- Fix Version/s: 3.8.0 > Console consumer fails with `IllegalStateException` >

[jira] [Updated] (KAFKA-16227) Console consumer fails with `IllegalStateException`

2024-02-06 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16227: -- Component/s: consumer > Console consumer fails with `IllegalStateException` >

[jira] [Updated] (KAFKA-16227) Console consumer fails with `IllegalStateException`

2024-02-06 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16227: -- Labels: consumer-threading-refactor (was: ) > Console consumer fails with `IllegalStateException` >

Re: [PR] KAFKA-15761: KRaft support in EpochDrivenReplicationProtocolAcceptanceTest [kafka]

2024-02-06 Thread via GitHub
mimaison commented on PR #15295: URL: https://github.com/apache/kafka/pull/15295#issuecomment-1930519984 The build is still failing with Java 8 and Scala 2.12 so we can't merge this PR as is. You should be able to reproduce the issue by running: `./gradlew -PscalaVersion=2.12

Re: [PR] MINOR:Type Casting Correction AND Null Pointer Exception (NPE) Defense [kafka]

2024-02-06 Thread via GitHub
mimaison commented on code in PR #9786: URL: https://github.com/apache/kafka/pull/9786#discussion_r1480365763 ## streams/src/main/java/org/apache/kafka/streams/kstream/internals/InternalStreamsBuilder.java: ## @@ -437,7 +438,10 @@ private void rewriteSingleStoreSelfJoin(

[jira] [Assigned] (KAFKA-7663) Custom Processor supplied on addGlobalStore is not used when restoring state from topic

2024-02-06 Thread Walker Carlson (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walker Carlson reassigned KAFKA-7663: - Assignee: Walker Carlson > Custom Processor supplied on addGlobalStore is not used when

Re: [PR] MINOR: Update LICENSE-binary file [kafka]

2024-02-06 Thread via GitHub
mimaison merged PR #15322: URL: https://github.com/apache/kafka/pull/15322 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] KAFKA-16229: Fix slow expired producer id deletion [kafka]

2024-02-06 Thread via GitHub
jolshan commented on PR #15324: URL: https://github.com/apache/kafka/pull/15324#issuecomment-1930479050 Hey @jeqo thanks for taking a look and improving this area! Can we add the benchmarks from the ticket to the PR description? -- This is an automated message from the Apache Git

[jira] [Resolved] (KAFKA-16133) Commits during reconciliation always time out

2024-02-06 Thread Lianet Magrans (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lianet Magrans resolved KAFKA-16133. Fix Version/s: 3.7.0 (was: 3.8.0) Resolution: Fixed >

[jira] [Updated] (KAFKA-16229) Slow expiration of Producer IDs leading to high CPU usage

2024-02-06 Thread Jorge Esteban Quilcate Otoya (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jorge Esteban Quilcate Otoya updated KAFKA-16229: - Description: Expiration of ProducerIds is implemented with a

[PR] KAFKA-16229: Fix slow expired producer id deletion [kafka]

2024-02-06 Thread via GitHub
jeqo opened a new pull request, #15324: URL: https://github.com/apache/kafka/pull/15324 [[KAFKA-16229](https://issues.apache.org/jira/browse/KAFKA-16229)] ### Committer Checklist (excluded from commit message) - [ ] Verify design and implementation - [ ] Verify test coverage

Re: [PR] KAFKA-16215; KAFKA-16178: Fix member not rejoining after error [kafka]

2024-02-06 Thread via GitHub
AndrewJSchofield commented on code in PR #15311: URL: https://github.com/apache/kafka/pull/15311#discussion_r1480305816 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/RequestState.java: ## @@ -106,6 +106,13 @@ public void onSendAttempt(final long

[jira] [Created] (KAFKA-16229) Slow expiration of Producer IDs leading to high CPU usage

2024-02-06 Thread Jorge Esteban Quilcate Otoya (Jira)
Jorge Esteban Quilcate Otoya created KAFKA-16229: Summary: Slow expiration of Producer IDs leading to high CPU usage Key: KAFKA-16229 URL: https://issues.apache.org/jira/browse/KAFKA-16229

[jira] [Updated] (KAFKA-16228) Add --remote-log-metadata-decoder to kafka-dump-log.sh

2024-02-06 Thread Federico Valeri (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Federico Valeri updated KAFKA-16228: Description: It would be good to improve the kafka-dump-log.sh tool adding a decode flag

[jira] [Created] (KAFKA-16228) Add --remote-log-metadata-decoder to kafka-dump-log.sh

2024-02-06 Thread Federico Valeri (Jira)
Federico Valeri created KAFKA-16228: --- Summary: Add --remote-log-metadata-decoder to kafka-dump-log.sh Key: KAFKA-16228 URL: https://issues.apache.org/jira/browse/KAFKA-16228 Project: Kafka

Re: [PR] KAFKA-16215; KAFKA-16178: Fix member not rejoining after error [kafka]

2024-02-06 Thread via GitHub
lianetm commented on code in PR #15311: URL: https://github.com/apache/kafka/pull/15311#discussion_r1480240755 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/RequestState.java: ## @@ -106,6 +106,13 @@ public void onSendAttempt(final long currentTimeMs) {

[jira] [Commented] (KAFKA-16227) Console consumer fails with `IllegalStateException`

2024-02-06 Thread Lianet Magrans (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17814894#comment-17814894 ] Lianet Magrans commented on KAFKA-16227: [~kirktrue] Seems like a similar challenge came out in

Re: [PR] KAFKA-14822: Allow restricting File and Directory ConfigProviders to specific paths [kafka]

2024-02-06 Thread via GitHub
tinaselenge commented on code in PR #14995: URL: https://github.com/apache/kafka/pull/14995#discussion_r1480171669 ## clients/src/main/java/org/apache/kafka/common/config/provider/FileConfigProvider.java: ## @@ -40,7 +42,13 @@ public class FileConfigProvider implements

[jira] [Updated] (KAFKA-16227) Console consumer fails with `IllegalStateException`

2024-02-06 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot updated KAFKA-16227: Affects Version/s: 3.7.0 > Console consumer fails with `IllegalStateException` >

Re: [PR] KAFKA-15561: Client support for new SubscriptionPattern based subscription [kafka]

2024-02-06 Thread via GitHub
Phuc-Hong-Tran commented on PR #15188: URL: https://github.com/apache/kafka/pull/15188#issuecomment-1930102760 @cadonna Just for clarification, when we were talking about "implement and test everything up to the point where the field is populated", does that mean we're not gonna implement

Re: [PR] KAFKA-15761: KRaft support in EpochDrivenReplicationProtocolAcceptanceTest [kafka]

2024-02-06 Thread via GitHub
highluck commented on PR #15295: URL: https://github.com/apache/kafka/pull/15295#issuecomment-1930100354 @mimaison I tried this and that, but I think I need to study a little more. After finishing this, would it be okay to do follow-up PR work on the

[jira] [Updated] (KAFKA-16226) Java client: Performance regression in Trogdor benchmark with high partition counts

2024-02-06 Thread Mayank Shekhar Narula (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayank Shekhar Narula updated KAFKA-16226: -- Description: h1. Background

[jira] [Updated] (KAFKA-16226) Java client: Performance regression in Trogdor benchmark with high partition counts

2024-02-06 Thread Mayank Shekhar Narula (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayank Shekhar Narula updated KAFKA-16226: -- Description: h1. Background

[jira] [Updated] (KAFKA-16226) Java client: Performance regression in Trogdor benchmark with high partition counts

2024-02-06 Thread Mayank Shekhar Narula (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayank Shekhar Narula updated KAFKA-16226: -- Attachment: baseline_lock_profile.png > Java client: Performance regression

[jira] [Updated] (KAFKA-16226) Java client: Performance regression in Trogdor benchmark with high partition counts

2024-02-06 Thread Mayank Shekhar Narula (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayank Shekhar Narula updated KAFKA-16226: -- Description: h1. Background

[jira] [Updated] (KAFKA-16226) Java client: Performance regression in Trogdor benchmark with high partition counts

2024-02-06 Thread Mayank Shekhar Narula (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayank Shekhar Narula updated KAFKA-16226: -- Attachment: kafka_15415_lock_profile.png > Java client: Performance

[jira] [Updated] (KAFKA-16226) Java client: Performance regression in Trogdor benchmark with high partition counts

2024-02-06 Thread Mayank Shekhar Narula (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayank Shekhar Narula updated KAFKA-16226: -- Attachment: (was: image-20240201-105752.png) > Java client: Performance

[jira] [Updated] (KAFKA-16226) Java client: Performance regression in Trogdor benchmark with high partition counts

2024-02-06 Thread Mayank Shekhar Narula (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayank Shekhar Narula updated KAFKA-16226: -- Attachment: (was: Screenshot 2024-02-01 at 11.06.36.png) > Java client:

[jira] [Updated] (KAFKA-16226) Java client: Performance regression in Trogdor benchmark with high partition counts

2024-02-06 Thread Mayank Shekhar Narula (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayank Shekhar Narula updated KAFKA-16226: -- Description: h1. Background

[jira] [Created] (KAFKA-16227) Console consumer fails with `IllegalStateException`

2024-02-06 Thread David Jacot (Jira)
David Jacot created KAFKA-16227: --- Summary: Console consumer fails with `IllegalStateException` Key: KAFKA-16227 URL: https://issues.apache.org/jira/browse/KAFKA-16227 Project: Kafka Issue

Re: [PR] MINOR:Type Casting Correction AND Null Pointer Exception (NPE) Defense [kafka]

2024-02-06 Thread via GitHub
highluck commented on PR #9786: URL: https://github.com/apache/kafka/pull/9786#issuecomment-1930075970 @mimaison Can you review this? thanks! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[jira] [Updated] (KAFKA-16226) Java client: Performance regression in Trogdor benchmark with high partition counts

2024-02-06 Thread Mayank Shekhar Narula (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayank Shekhar Narula updated KAFKA-16226: -- Description: h1. Background

[jira] [Updated] (KAFKA-16226) Java client: Performance regression in Trogdor benchmark with high partition counts

2024-02-06 Thread Mayank Shekhar Narula (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayank Shekhar Narula updated KAFKA-16226: -- Description: h1. Background

[jira] [Updated] (KAFKA-16226) Java client: Performance regression in Trogdor benchmark with high partition counts

2024-02-06 Thread Mayank Shekhar Narula (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayank Shekhar Narula updated KAFKA-16226: -- Description: h1. Background

[jira] [Updated] (KAFKA-16226) Java client: Performance regression in Trogdor benchmark with high partition counts

2024-02-06 Thread Mayank Shekhar Narula (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayank Shekhar Narula updated KAFKA-16226: -- Attachment: image-20240201-105752.png > Java client: Performance regression

[jira] [Updated] (KAFKA-16226) Java client: Performance regression in Trogdor benchmark with high partition counts

2024-02-06 Thread Mayank Shekhar Narula (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayank Shekhar Narula updated KAFKA-16226: -- Description: h1. Background

Re: [PR] KAFKA-16066: Upgrade apacheds to 2.0.0.AM27 With apache kerby [kafka]

2024-02-06 Thread via GitHub
OmniaGM commented on code in PR #15277: URL: https://github.com/apache/kafka/pull/15277#discussion_r1480038350 ## core/src/test/scala/kafka/security/minikdc/MiniKdc.scala: ## @@ -19,38 +19,22 @@ package kafka.security.minikdc import java.io._ -import

[jira] [Updated] (KAFKA-16226) Java client: Performance regression in Trogdor benchmark with high partition counts

2024-02-06 Thread Mayank Shekhar Narula (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayank Shekhar Narula updated KAFKA-16226: -- Attachment: Screenshot 2024-02-01 at 11.06.36.png > Java client: Performance

[jira] [Updated] (KAFKA-16226) Java client: Performance regression in Trogdor benchmark with high partition counts

2024-02-06 Thread Mayank Shekhar Narula (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayank Shekhar Narula updated KAFKA-16226: -- Description: Background https://issues.apache.org/jira/browse/KAFKA-15415

Re: [PR] KAFKA-16066: Upgrade apacheds to 2.0.0.AM27 With apache kerby [kafka]

2024-02-06 Thread via GitHub
highluck commented on PR #15277: URL: https://github.com/apache/kafka/pull/15277#issuecomment-1930043014 @divijvaidya @mimaison @OmniaGM Here’s a reminder! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

Re: [PR] MINOR: Add MetadataType metric from KIP-866 #15299 [kafka]

2024-02-06 Thread via GitHub
OmniaGM commented on PR #15306: URL: https://github.com/apache/kafka/pull/15306#issuecomment-1930043205 @cmccabe you left a [comment](https://github.com/apache/kafka/pull/15299#issuecomment-1922507934 ) on the original pr #15299 stating that you are moving the discussion for KIP-866

[jira] [Updated] (KAFKA-16226) Java client: Performance regression in Trogdor benchmark with high partition counts

2024-02-06 Thread Mayank Shekhar Narula (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayank Shekhar Narula updated KAFKA-16226: -- Description: Background https://issues.apache.org/jira/browse/KAFKA-15415

[jira] [Updated] (KAFKA-16226) Java client: Performance regression in Trogdor benchmark with high partition counts

2024-02-06 Thread Mayank Shekhar Narula (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayank Shekhar Narula updated KAFKA-16226: -- Description: Background https://issues.apache.org/jira/browse/KAFKA-15415

[jira] [Updated] (KAFKA-16226) Java client: Performance regression in Trogdor benchmark with high partition counts

2024-02-06 Thread Mayank Shekhar Narula (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayank Shekhar Narula updated KAFKA-16226: -- Affects Version/s: 3.6.1 3.7.0 > Java client:

[jira] [Updated] (KAFKA-16226) Java client: Performance regression in Trogdor benchmark with high partition counts

2024-02-06 Thread Mayank Shekhar Narula (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayank Shekhar Narula updated KAFKA-16226: -- Labels: kip-951 (was: ) > Java client: Performance regression in Trogdor

[jira] [Updated] (KAFKA-16226) Java client: Performance regression in Trogdor benchmark with high partition counts

2024-02-06 Thread Mayank Shekhar Narula (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayank Shekhar Narula updated KAFKA-16226: -- Summary: Java client: Performance regression in Trogdor benchmark with high

[jira] [Updated] (KAFKA-16226) Performance regression in Trogdor benchmark with high partition counts

2024-02-06 Thread Mayank Shekhar Narula (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayank Shekhar Narula updated KAFKA-16226: -- Description: Background https://issues.apache.org/jira/browse/KAFKA-15415

[jira] [Updated] (KAFKA-16226) Performance regression in Trogdor benchmark with high partition counts

2024-02-06 Thread Mayank Shekhar Narula (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayank Shekhar Narula updated KAFKA-16226: -- Description: For KIP-951,  (was: Right now in java-client, producer-batches

[jira] [Updated] (KAFKA-16226) Performance regression in Trogdor benchmark with high partition counts

2024-02-06 Thread Mayank Shekhar Narula (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayank Shekhar Narula updated KAFKA-16226: -- Issue Type: Bug (was: Improvement) > Performance regression in Trogdor

[jira] [Updated] (KAFKA-16226) Performance regression in Trogdor benchmark with high partition counts

2024-02-06 Thread Mayank Shekhar Narula (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayank Shekhar Narula updated KAFKA-16226: -- Fix Version/s: 3.6.2 3.8.0 3.7.1

[jira] [Created] (KAFKA-16226) Performance regression in Trogdor benchmark with high partition counts

2024-02-06 Thread Mayank Shekhar Narula (Jira)
Mayank Shekhar Narula created KAFKA-16226: - Summary: Performance regression in Trogdor benchmark with high partition counts Key: KAFKA-16226 URL: https://issues.apache.org/jira/browse/KAFKA-16226

[jira] [Resolved] (KAFKA-15970) KIP-951, port newly added tests in FetcherTest.java to FetchRequestManagerTest.ajva

2024-02-06 Thread Mayank Shekhar Narula (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayank Shekhar Narula resolved KAFKA-15970. --- Resolution: Fixed > KIP-951, port newly added tests in FetcherTest.java to

[jira] [Updated] (KAFKA-16224) Fix handling of deleted topic when auto-committing before revocation

2024-02-06 Thread Lianet Magrans (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lianet Magrans updated KAFKA-16224: --- Description: Current logic for auto-committing offsets when partitions are revoked will

[PR] working change [kafka]

2024-02-06 Thread via GitHub
msn-tldr opened a new pull request, #15323: URL: https://github.com/apache/kafka/pull/15323 *More detailed description of your change, if necessary. The PR title and PR message become the squashed commit message, so use a separate comment to ping reviewers.* *Summary of

Re: [PR] KAFKA-14945: Add Serializer#serializeToByteBuffer() to reduce memory copying [kafka]

2024-02-06 Thread via GitHub
LinShunKang commented on PR #12685: URL: https://github.com/apache/kafka/pull/12685#issuecomment-1929526582 > @LinShunKang , sorry for being late. I had a quick look at #14617, it looks like the `ByteBufferSerializer#serialize` is a public API and cannot be changed without KIP. You know

Re: [PR] MINOR: Update LICENSE-binary file [kafka]

2024-02-06 Thread via GitHub
jlprat commented on PR #15322: URL: https://github.com/apache/kafka/pull/15322#issuecomment-1929371251 If you need to run this several times, you can try to omit the test suite, it will be faster :) ``` ./gradlewAll clean releaseTarGz -x test ``` -- This is an automated

[PR] MINOR: Update LICENSE-binary file [kafka]

2024-02-06 Thread via GitHub
mimaison opened a new pull request, #15322: URL: https://github.com/apache/kafka/pull/15322 Tested with: ``` $ ./gradlewAll clean releaseTarGz $ tar xzf core/build/distributions/kafka_2.13-3.8.0-SNAPSHOT.tgz $ cd kafka_2.13-3.8.0-SNAPSHOT/ $ for f in $(ls libs | grep -v

Re: [PR] KAFKA-15561: Client support for new SubscriptionPattern based subscription [kafka]

2024-02-06 Thread via GitHub
Phuc-Hong-Tran commented on PR #15188: URL: https://github.com/apache/kafka/pull/15188#issuecomment-1929317343 @cadonna @lianetm, since we're supporting for both subscribe method using java.util.regex.Pattern and SubscriptionPattern, I think we should throw a illegal heartbeat exeption

Re: [PR] MINOR: Upgrade maven artifact version to 3.9.6 [kafka]

2024-02-06 Thread via GitHub
mimaison merged PR #15309: URL: https://github.com/apache/kafka/pull/15309 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] KAFKA-16181: Use incrementalAlterConfigs when updating broker configs by kafka-configs.sh [kafka]

2024-02-06 Thread via GitHub
dajac commented on code in PR #15304: URL: https://github.com/apache/kafka/pull/15304#discussion_r1479611758 ## core/src/test/scala/integration/kafka/admin/ConfigCommandIntegrationTest.scala: ## @@ -162,19 +174,198 @@ class ConfigCommandIntegrationTest extends

Re: [PR] KAFKA-15561: Client support for new SubscriptionPattern based subscription [kafka]

2024-02-06 Thread via GitHub
Phuc-Hong-Tran commented on code in PR #15188: URL: https://github.com/apache/kafka/pull/15188#discussion_r1479598776 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/SubscriptionState.java: ## @@ -84,6 +85,9 @@ private enum SubscriptionType { /* the

Re: [PR] KAFKA-15717: Added KRaft support in LeaderEpochIntegrationTest [kafka]

2024-02-06 Thread via GitHub
mimaison commented on PR #15225: URL: https://github.com/apache/kafka/pull/15225#issuecomment-1929267278 Done, thanks -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[jira] [Assigned] (KAFKA-15717) KRaft support in LeaderEpochIntegrationTest

2024-02-06 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison reassigned KAFKA-15717: -- Assignee: appchemist > KRaft support in LeaderEpochIntegrationTest >

Re: [PR] KAFKA-16215; KAFKA-16178: Fix member not rejoining after error [kafka]

2024-02-06 Thread via GitHub
AndrewJSchofield commented on code in PR #15311: URL: https://github.com/apache/kafka/pull/15311#discussion_r1479506790 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/RequestState.java: ## @@ -106,6 +106,13 @@ public void onSendAttempt(final long

[jira] [Commented] (KAFKA-16190) Member should send full heartbeat when rejoining

2024-02-06 Thread Phuc Hong Tran (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17814698#comment-17814698 ] Phuc Hong Tran commented on KAFKA-16190: [~lianetm] I understand, thanks for the explaination.