Re: Kafka design docs

Hi Arun, The official doc should be good enough: https://kafka.apache.org/documentation/#design For detailed design doc, you can check the Kafka Improvement Proposals: https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Improvement+Proposals Thank you Luke On Thu, Feb 16, 2023 at 7:27 AM

[jira] [Resolved] (KAFKA-14708) Remove kafka.examples.Consumer dependancy on ShutdownableThread

[ https://issues.apache.org/jira/browse/KAFKA-14708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-14708. --- Fix Version/s: 3.5.0 Resolution: Fixed > Remove kafka.examples.Consumer dependa

[jira] [Resolved] (KAFKA-14695) broker will get LEADER_AND_ISR is not enabled error while ZK migrating to KRaft

[ https://issues.apache.org/jira/browse/KAFKA-14695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-14695. --- Resolution: Duplicate > broker will get LEADER_AND_ISR is not enabled error while ZK migrat

[jira] [Created] (KAFKA-14695) broker will get LEADER_AND_ISR is not enabled error while ZK migrating to KRaft

Luke Chen created KAFKA-14695: - Summary: broker will get LEADER_AND_ISR is not enabled error while ZK migrating to KRaft Key: KAFKA-14695 URL: https://issues.apache.org/jira/browse/KAFKA-14695 Project

Re: [DISCUSS] Apache Kafka 3.5.0 release

Hi Mickael, Thanks for volunteering! Luke On Thu, Feb 9, 2023 at 6:23 AM Chris Egerton wrote: > Thanks for volunteering, Mickael! > > On Wed, Feb 8, 2023 at 1:12 PM José Armando García Sancio > wrote: > > > Thanks for volunteering Mickael. > > > > -- > > -José > > >

Re: Request for access

Hi David, Your JIRA (with id: davidmariassy) and wiki account is all set. Thank you. Luke On Thu, Feb 9, 2023 at 4:46 AM David Mariassy wrote: > Hi, > > I'd like to request access to JIRA and permission to contribute to Apache > Kafka. My wiki ID is david.mariassy. If JIRA usernames don't

Re: [Possible bug] Failing to use multiple client for multiple cluster using SASL channel.

Hi Sourav, Your JIRA account is all set. Thank you. Luke On Wed, Feb 8, 2023 at 4:24 PM Sourav Biswas wrote: > Hello Chen, > > Please use followings for jira account. > > Email: sourav_biswa...@yahoo.com > > User name: bsourav85 > > Display Name: "Sourav Biswas" or "Sourav" > > > ~ Thanks > >

Re: [Possible bug] Failing to use multiple client for multiple cluster using SASL channel.

Hi Sourav, To create a JIRA account, in addition to email address, we also need your preferred username, display name. Thank you. Luke On Wed, Feb 8, 2023 at 2:01 PM Sourav Biswas wrote: > May I get a jira account > Email id: sourav_biswa...@yahoo.com > > > > > On Sunday, 5 February, 2023

Re: [DISCUSS] KIP-894: Use incrementalAlterConfigs API for syncing topic configurations

Hi Tina, Thanks for the KIP to fix the issue. Some comments: 1. In the compatibility section, you said: `By default, the new setting will be set to false so it does not change the current behaviour.` I'm confused, what is the config we need to set to `false` to avoid breaking compatibility? All

Re: Re: Request for JIRA account creation

public > fqoss > fqsnowstorm > fqfuchsia > > Thanks, > Farooq > > On 2023/02/05 06:29:54 Luke Chen wrote: > > Hi Farooq, > > > > Your wiki ID is all set. > > But for the JIRA account, the user name cannot allow the special > character: > > "

Re: Request for JIRA account creation

Hi Farooq, Your wiki ID is all set. But for the JIRA account, the user name cannot allow the special character: ".". Could you provide another user name without special characters? Thank you. Luke On Sun, Feb 5, 2023 at 2:02 AM Fq Public wrote: > Also, I would like permission to contribute to

Re: A query on log truncation.

Hi Vinoth, I'm wondering what's the use case or pain point you're trying to resolve? Like you said, the client will be notified the data is not successfully sent or propagated and handle the error, why should we keep the un-commited records? Could you elaborate more on the motivation? Thank you.

Re: [DISCUSS] Add "Security Implications" section to KIP template

Hi Chris, I like this idea. Thanks for raising this! One question to the template bullet: • Does it make Kafka or any of its components more difficult to run in a fully-secured fashion? I don't quite understand what it means. Could you elaborate on it? Thank you. Luke On Wed, Jan 11, 2023 at

[jira] [Created] (KAFKA-14604) SASL session expiration time will be overflowed when calculation

Luke Chen created KAFKA-14604: - Summary: SASL session expiration time will be overflowed when calculation Key: KAFKA-14604 URL: https://issues.apache.org/jira/browse/KAFKA-14604 Project: Kafka

Re: [ANNOUNCE] New committer: Edoardo Comar

Congratulations, Edoardo! Luke On Sat, Jan 7, 2023 at 7:58 AM Mickael Maison wrote: > Congratulations Edo! > > > On Sat, Jan 7, 2023 at 12:05 AM Jun Rao wrote: > > > > Hi, Everyone, > > > > The PMC of Apache Kafka is pleased to announce a new Kafka committer > Edoardo > > Comar. > > > >

Re: [ANNOUNCE] New committer: Justine Olshan

Congratulations, Justine! Well deserved! Luke On Fri, Dec 30, 2022 at 9:15 AM Ron Dagostino wrote: > Congratulations, Justine!Well-deserved., and I’m very happy for you. > > Ron > > > On Dec 29, 2022, at 6:13 PM, Israel Ekpo wrote: > > > > Congratulations Justine! > > > > > >> On Thu,

[jira] [Created] (KAFKA-14556) log cleaner throttler start time is correct

Luke Chen created KAFKA-14556: - Summary: log cleaner throttler start time is correct Key: KAFKA-14556 URL: https://issues.apache.org/jira/browse/KAFKA-14556 Project: Kafka Issue Type: Bug

[jira] [Resolved] (KAFKA-14553) RecordAccumulator hangs in infinite NOP loop

[ https://issues.apache.org/jira/browse/KAFKA-14553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-14553. --- Fix Version/s: 3.4.0 3.3.2 Resolution: Duplicate > RecordAccumula

Re: [ANNOUNCE] New committer: Satish Duggana

Congratulations, Satish! On Sat, Dec 24, 2022 at 4:12 AM Federico Valeri wrote: > Hi Satish, congrats! > > On Fri, Dec 23, 2022, 8:46 PM Viktor Somogyi-Vass > wrote: > > > Congrats Satish! > > > > On Fri, Dec 23, 2022, 19:38 Mickael Maison > > wrote: > > > > > Congratulations Satish! > > > >

Re: Kafka issue

Hi Amoli, > The code is working fine with 100 threads and 100 partition topic. It's good to know you have a workable solution. For 500 threads in 500 partitions, could you firstly make sure the topic is created successfully? If topic cannot be created successfully, no records will be sent even

Re: [DISCUSS] Apache Kafka 3.4.0 release

this method today. > > Ismael > > On Wed, Dec 21, 2022 at 2:22 AM Luke Chen wrote: > > > Hi Sophie and devs, > > > > KAFKA-14540 <https://issues.apache.org/jira/browse/KAFKA-14540> is > > reported > > (from Michael Marshall, thanks!) that we might w

Re: [DISCUSS] Apache Kafka 3.4.0 release

Hi Sophie and devs, KAFKA-14540 is reported (from Michael Marshall, thanks!) that we might write corrupted data to the output stream due to the wrong buffer position set in DataOutputStreamWritable#writeByteBuffer. Had a search in the project,

Re: [ANNOUNCE] New committer: Josep Prat

Congratulations, Josep! Luke On Wed, Dec 21, 2022 at 6:26 AM Viktor Somogyi-Vass wrote: > Congrats Josep! > > On Tue, Dec 20, 2022, 21:56 Matthias J. Sax wrote: > > > Congrats! > > > > On 12/20/22 12:01 PM, Josep Prat wrote: > > > Thank you all! > > > > > > ——— > > > Josep Prat > > > > > >

[jira] [Created] (KAFKA-14529) fix failed KafkaServerKRaftRegistrationTest

Luke Chen created KAFKA-14529: - Summary: fix failed KafkaServerKRaftRegistrationTest Key: KAFKA-14529 URL: https://issues.apache.org/jira/browse/KAFKA-14529 Project: Kafka Issue Type: Test

[jira] [Created] (KAFKA-14498) flaky org.apache.kafka.tools.MetadataQuorumCommandTest

Luke Chen created KAFKA-14498: - Summary: flaky org.apache.kafka.tools.MetadataQuorumCommandTest Key: KAFKA-14498 URL: https://issues.apache.org/jira/browse/KAFKA-14498 Project: Kafka Issue Type

[jira] [Created] (KAFKA-14495) Improve the RemoteIndexCacheTest

Luke Chen created KAFKA-14495: - Summary: Improve the RemoteIndexCacheTest Key: KAFKA-14495 URL: https://issues.apache.org/jira/browse/KAFKA-14495 Project: Kafka Issue Type: Sub-task

[jira] [Resolved] (KAFKA-14285) Delete quota node in zookeeper when configs are empty

[ https://issues.apache.org/jira/browse/KAFKA-14285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-14285. --- Fix Version/s: 3.4.1 3.5.0 Resolution: Fixed > Delete quota n

Re: Kafka AdminClient DEFAULT_API_TIMEOUT_MS_CONFIG property not working as expected

Hi Shruti, Are you sure it creates admin client successfully after setting default.api.timeout.ms=2000 ? It should fail at this check: https://github.com/apache/kafka/blob/trunk/clients/src/main/java/org/apache/kafka/clients/admin/KafkaAdminClient.java#L618-L621 Try also set

Re: [DISCUSS] KIP-866 ZooKeeper to KRaft Migration

Thanks for the reply. Yes, I think adding a section in Rejected Alternatives to explain the rationale why we don't support combined mode upgrade in this KIP is helpful. Thank you. Luke On Wed, Nov 30, 2022 at 8:47 AM Jun Rao wrote: > Hi, David, > > Thanks for the reply. No other comments from

Re: Granting permission for Create KIP and contribute to kafka

Hi t-mac, I've granted your JIRA account. But I can't find the wiki id: "ws" in the wiki system. Are your sure you registered with "ws" here ? Any more info you can provide to us, like account full name? Thank you.

Re: [DISCUSS] Apache Kafka 3.3.2

Thanks for volunteering! On Thu, Nov 17, 2022 at 1:07 AM José Armando García Sancio wrote: > +1. Thanks for volunteering. > > -- > -José >

Re: [DISCUSS] Apache Kafka 3.4.0 release

Hi Sophie, Here it is: KIP-881: https://cwiki.apache.org/confluence/display/KAFKA/KIP-881%3A+Rack-aware+Partition+Assignment+for+Kafka+Consumers I've helped create an entry in under discussion table in KIP page. Luke On Wed, Nov 16, 2022 at 11:18 AM Sophie Blee-Goldman wrote: > Rajini can you

Re: Permissions Request to contribute to Apache Kafka

Hi Calvin, You're all set. Thanks Luke On Tue, Nov 15, 2022 at 3:27 AM Calvin Liu wrote: > Hi, > I am working on the ticket > https://issues.apache.org/jira/browse/KAFKA-14139. > The change is worth a KIP. Can Anyone grant me the permission for KIP? > Wiki id: caliu > Jira id: CalvinLiu >

Re: Jackson CVE's in Mirror Maker 2.13-2.8.2

Hi Andrew, Kafka community will only do bug fix release for last 3 releases based on the wiki. So, there will be no newer 2.8 patch release. https://cwiki.apache.org/confluence/display/KAFKA/Time+Based+Release+Plan#TimeBasedReleasePlan-WhatIsOurEOLPolicy ? Thank you. Luke On Thu, Nov 10, 2022

Re: request to contribute to kafka

Hi Dan, Done. Thanks for the interest in Apache Kafka. Luke On Thu, Nov 10, 2022 at 3:41 PM Dan S wrote: > Hello, > > I would like to contribute to kafka, > > my wiki id, jira id, and github username are all "scanteianu" > > Thanks, > > Dan >

Re: [DISCUSS] KIP-852 Optimize calculation of size for log in remote tier

> topic > > > > > based RLMM as mentioned in the KIP. > > > > > > > > > > ~Satish. > > > > > > > > > > On Wed, 13 Jul 2022 at 18:48, Divij Vaidya < > divijvaidy...@gmail.com> > > >

[jira] [Resolved] (KAFKA-14355) Integer overflow occurs in kafka-producer-perf-test.sh (class ProducerProfrmance ).

[ https://issues.apache.org/jira/browse/KAFKA-14355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-14355. --- Fix Version/s: 3.4.0 Resolution: Fixed > Integer overflow occurs in kafka-producer-p

Re: [DISCUSS] KIP-878: Autoscaling for Statically Partitioned Streams

Hi Sophie, Thanks for the KIP. A very useful proposal! Some questions: 1. the staticPartition method in the interface is commented out. 2. For error handling, as you can imagine, there could be errors happening during partition expansion.That means, the operation would be (1) take long time to

Re: add my jira id to contributers

Hi Arun, Done. Thanks for the interest in Apache Kafka. Luke On Sun, Oct 30, 2022 at 8:42 AM Arun Raju wrote: > Can my jira id *arunbhargav * be added to the contributor list? >

Re: [DISCUSS] KIP-866 ZooKeeper to KRaft Migration

Hi David, Thanks for the good and complicated proposal! :) Some questions: 1. "MigrationReady" state: The KIP said: The KRaft quorum has been started I don't think we'll automatically enter this state after KRaft quorum started, do we? I think KRaft active controller should take over leadership

Re: [VOTE] KIP-863: Reduce Fetcher#parseRecord() memory copy

; Best, > ShunKang > > Chris Egerton 于2022年10月12日周三 23:17写道： > > > +1 (binding) > > Thanks ShunKang! > > > > On Tue, Oct 11, 2022 at 9:26 PM Luke Chen wrote: > > > > > +1 from me. > > > Thanks for the KIP. > > > > > > Luk

Re: [DISCUSS] solutions for broker OOM caused by many producer IDs

afka on *`/config/users/`* has the same behaviour. > > > What about applying limit/throttling to > *`/config/users//clients/` > *similar to what we have with client quota? This should reduce the concern > about throttling good clients, right? > > best, >

Re: [VOTE] KIP-876: Time based cluster metadata snapshots

+1 from me. Thank you Luke On Fri, Oct 14, 2022 at 11:42 PM Colin McCabe wrote: > Thanks, José! +1 (binding) > > Colin > > > On Fri, Oct 14, 2022, at 07:54, David Arthur wrote: > > Thanks for the KIP, José! > > > > +1 (binding) > > > > -David > > > > On Fri, Oct 14, 2022 at 2:48 AM David Jacot

[jira] [Created] (KAFKA-14308) metadata shell might not need to handle leader change message

Luke Chen created KAFKA-14308: - Summary: metadata shell might not need to handle leader change message Key: KAFKA-14308 URL: https://issues.apache.org/jira/browse/KAFKA-14308 Project: Kafka

[jira] [Resolved] (KAFKA-14280) quorum election random backoff always return 0 for 1st retry

[ https://issues.apache.org/jira/browse/KAFKA-14280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-14280. --- Resolution: Not A Problem Closed as not a problem   > quorum election random backoff alw

Re: [VOTE] KIP-848: The Next Generation of the Consumer Rebalance Protocol

Hi David, I made a final pass and LGTM now. +1 from me. Luke On Wed, Oct 5, 2022 at 12:32 AM Guozhang Wang wrote: > Hello David, > > I've made my final pass on the doc and I think it looks good now. +1. > > > Guozhang > > On Wed, Sep 14, 2022 at 1:37 PM Guozhang Wang wrote: > > > Thanks

Re: [DISCUSS] (continued) KIP-848: The Next Generation of the Consumer Rebalance Protocol

to the session timeout in > the worst case. Imagine that a member joins or fails during this time, > the whole process would be stuck. I am afraid storing it is the best > way here. > > Best, > David > > > On Fri, Oct 14, 2022 at 5:11 AM Luke Chen wrote: > > > > Hi Davi

Re: [DISCUSS] KIP-876: Time based cluster metadata snapshots

Hi José, Thanks for the KIP. Adding support to generate snapshot based on time makes sense to me. The only thing I'd like to point out is the compatibility section. Since this new config is default to 1 hour, which means if users explicitly set the config

Re: [DISCUSS] (continued) KIP-848: The Next Generation of the Consumer Rebalance Protocol

Hi David, A few more questions: 1. We will store the "targetAssignment" into log now. But as we know, there's max batch size limit (default 1MB), which means, we cannot support 1M partitions in one group (actually, it should be less than 60k partitions since we'll store {topicID+partition id}) by

Re: [VOTE] KIP-863: Reduce Fetcher#parseRecord() memory copy

+1 from me. Thanks for the KIP. Luke On Fri, Sep 23, 2022 at 1:50 AM Guozhang Wang wrote: > +1, thanks ShunKang. > > Though its proposed motivation is on consumer fetcher's deserialization, I > think adding an overloaded method with ByteBuffer would help with other > serde places on the client

Re: [DISCUSS] KIP-863: Reduce Fetcher#parseRecord() memory copy

Hi ShunKang, Had a quick look, I think It's a good idea. I'll check it again tomorrow, and let you know if I have any questions. Luke On Sun, Sep 25, 2022 at 3:35 PM ShunKang Lin wrote: > Hi Guozhang, > > When I try add method `default ByteBuffer serializeToByteBuffer(String > topic, Headers

[jira] [Created] (KAFKA-14287) Multi noded with kraft combined mode will fail shutdown

Luke Chen created KAFKA-14287: - Summary: Multi noded with kraft combined mode will fail shutdown Key: KAFKA-14287 URL: https://issues.apache.org/jira/browse/KAFKA-14287 Project: Kafka Issue Type

Re: [DISCUSS] solutions for broker OOM caused by many producer IDs

Bump this thread to see if there are any comments/thoughts. Thanks. Luke On Mon, Sep 26, 2022 at 11:06 AM Luke Chen wrote: > Hi devs, > > As stated in the motivation section in KIP-854 > <https://cwiki.apache.org/confluence/display/KAFKA/KIP-854+Separate+configuration+for+pro

Re: [ANNOUNCE] New committer: Deng Ziming

Congratulations Ziming!! Very well deserved! 恭喜! :) Luke On Tue, Oct 11, 2022 at 9:22 AM Sagar wrote: > Congratulations ziming! > > On Tue, 11 Oct 2022 at 4:16 AM, Bill Bejeck wrote: > > > Congrats Ziming! > > > > Regards, > > Bill > > > > On Mon, Oct 10, 2022 at 5:32 PM Ismael Juma wrote: >

[jira] [Created] (KAFKA-14284) "current-vote" metric is always leaderId under non-election state

Luke Chen created KAFKA-14284: - Summary: "current-vote" metric is always leaderId under non-election state Key: KAFKA-14284 URL: https://issues.apache.org/jira/browse/KAFKA-14284 Proj

Re: [DISCUSS] Apache Kafka 3.4.0 release

Hi Sophie, Thanks for volunteering! Luke On Thu, Oct 6, 2022 at 6:17 AM José Armando García Sancio wrote: > Thanks for volunteering Sophie. > > On Wed, Oct 5, 2022 at 3:01 PM Sophie Blee-Goldman > wrote: > > > > Hey all, > > > > I'd like to volunteer as release manager for the next feature

[jira] [Created] (KAFKA-14280) quorum election random backoff always return 0 for 1st timeout

Luke Chen created KAFKA-14280: - Summary: quorum election random backoff always return 0 for 1st timeout Key: KAFKA-14280 URL: https://issues.apache.org/jira/browse/KAFKA-14280 Project: Kafka

Re: Request to add to Kafka dev list

hello Abhishek, What's your JIRA ID here ? Also, the wiki ID here ? Please provide me these info so that I can grant your

Re: Requesting permissions to contribute to Apache Kafka

Hi Vimal, You are all set. Thanks for the interest in Apache Kafka. Luke On Tue, Oct 4, 2022 at 12:50 AM Vimal K wrote: > wiki id: *vimalinfo10* > Jira id : *vimalinfo10* > > Thanks & Regards > Vimal Krishnamoorthy >

Re: [VOTE] KIP-868 Metadata Transactions

Hi David, +1 (binding) from me. Thank you Luke On Tue, Sep 27, 2022 at 11:02 PM David Arthur wrote: > Hey folks, I'd like to start a vote on KIP-868. This proposal adds > lightweight transactions to the KRaft controller. These transactions > will allow us to generate atomic batches of records

Re: [DISCUSS] KIP-868 Metadata Transactions (new thread)

Hi David, I think there's still an unanswered question from Ziming: > I think we can also describe visibility in the MetadataShell since it is also a public interface. I think this suggestion makes sense. But I'm still +1 for current proposal. Thanks. Luke On Tue, Sep 27, 2022 at 11:11 PM

Re: Regarding Contribution to Kafka.

Hi Vimal, Before you pick up JIRA issues to work on, please contact us (reply this email is OK) to be added to the contributor list with your JIRA account username provided in the email. After that you can assign yourself to the JIRA ticket you have started working on so others will notice.

[DISCUSS] solutions for broker OOM caused by many producer IDs

Hi devs, As stated in the motivation section in KIP-854 : With idempotent producers becoming the default in Kafka, this means that unless otherwise specified, all new producers will be given

Re: [VOTE] KIP-792: Add "generation" field into consumer protocol

t; Thanks, > David > > On Thu, Mar 3, 2022 at 10:04 AM Luke Chen wrote: > > > > Thanks, Ziming! > > > > So, now, this KIP vote passed with 3 binding +1 votes (David, Tom, > > Guozhang) and 1 non-binding +1 vote (Ziming). > > The vote will be closed. >

Re: Delete quota node in zookeeper when configs are empty

Hi Junyang, Could you open a JIRA for this improvement? Also, if you're interested, welcome to submit a PR for it. Thank you. Luke On Wed, Sep 21, 2022 at 2:08 AM Junyang Liu wrote: > Hi, > > > When configuring flow control quota for users and clients, Kafka will add > a child node to

Re: CVE-2022-34917: Unauthenticated clients may cause OutOfMemoryError on Apache Kafka Brokers

What a great finding! Thanks Mickael Maison, Tom Bentley and Daniel Collins! And thanks for all the release managers who help drive all these security patch releases! Luke On Mon, Sep 19, 2022 at 11:53 PM Manikumar wrote: > Severity: High > > Description: > > A security vulnerability has

[jira] [Created] (KAFKA-14242) Hanging logManager in testReloadUpdatedFilesWithoutConfigChange test

Luke Chen created KAFKA-14242: - Summary: Hanging logManager in testReloadUpdatedFilesWithoutConfigChange test Key: KAFKA-14242 URL: https://issues.apache.org/jira/browse/KAFKA-14242 Project: Kafka

Re: [DISCUSS] KIP-868 Metadata Transactions (new thread)

Hi David, Thanks for the KIP! It's a light-weight transactional proposal for single producer, cool! +1 for it! Luke On Sat, Sep 10, 2022 at 1:14 AM David Arthur wrote: > Starting a new thread to avoid issues with mail client threading. > > Original thread follows: > > Hey folks, I'd like to

Re: KafkaConsumer refactor proposal

Hi Philip, Thanks for the write-up. Some questions: 1. You said: If we don't need a coordinator, the background thread will stay in the *initialized* state. But in the definition of *initialized, *it said: *initialized*: The background thread completes initialization, and the loop has started.

[jira] [Resolved] (KAFKA-13840) KafkaConsumer is unable to recover connection to group coordinator after commitOffsetsAsync exception

[ https://issues.apache.org/jira/browse/KAFKA-13840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-13840. --- Resolution: Fixed > KafkaConsumer is unable to recover connection to group coordinator af

[jira] [Reopened] (KAFKA-7109) KafkaConsumer should close its incremental fetch sessions on close

[ https://issues.apache.org/jira/browse/KAFKA-7109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen reopened KAFKA-7109: -- > KafkaConsumer should close its incremental fetch sessions on cl

[jira] [Created] (KAFKA-14233) Jenkins build failed with task ':core:unitTest' exit value 1

Luke Chen created KAFKA-14233: - Summary: Jenkins build failed with task ':core:unitTest' exit value 1 Key: KAFKA-14233 URL: https://issues.apache.org/jira/browse/KAFKA-14233 Project: Kafka

[jira] [Resolved] (KAFKA-14196) Duplicated consumption during rebalance, causing OffsetValidationTest to act flaky

[ https://issues.apache.org/jira/browse/KAFKA-14196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-14196. --- Resolution: Fixed > Duplicated consumption during rebalance, causing OffsetValidationTest to

[jira] [Resolved] (KAFKA-14208) KafkaConsumer#commitAsync throws unexpected WakeupException

[ https://issues.apache.org/jira/browse/KAFKA-14208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-14208. --- Resolution: Fixed > KafkaConsumer#commitAsync throws unexpected WakeupExcept

[jira] [Created] (KAFKA-14218) replace temp file handler with JUnit 5 Temporary Directory Support

Luke Chen created KAFKA-14218: - Summary: replace temp file handler with JUnit 5 Temporary Directory Support Key: KAFKA-14218 URL: https://issues.apache.org/jira/browse/KAFKA-14218 Project: Kafka

[jira] [Created] (KAFKA-14197) Kraft broker fails to startup after topic creation failure

Luke Chen created KAFKA-14197: - Summary: Kraft broker fails to startup after topic creation failure Key: KAFKA-14197 URL: https://issues.apache.org/jira/browse/KAFKA-14197 Project: Kafka Issue

[jira] [Resolved] (KAFKA-13981) metadata shell doesn't recognize some new record types

[ https://issues.apache.org/jira/browse/KAFKA-13981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-13981. --- Resolution: Duplicate > metadata shell doesn't recognize some new record ty

Re: [VOTE] KIP-860: Add client-provided option to guard against unintentional replication factor change during partition reassignments

Hi Stanislav, Thanks for the KIP. The solution looks reasonable to me. +1 from me. Thank you. Luke On Tue, Aug 23, 2022 at 6:07 AM Stanislav Kozlovski wrote: > Hello, > > I'd like to start a vote on KIP-860, which adds a client-provided option to > the AlterPartitionReassignmentsRequest that

Re: [DISCUSS] KIP-848: The Next Generation of the Consumer Rebalance Protocol

ot; assignor. I'd like to know why not uniform one? I thought usually users will choose uniform assignor (former sticky assinor) for better evenly distribution. Any other reason we choose range assignor as default? group.consumer.assignors List range, uniform The server side assignors. Thank you.

Re: [DISCUSS] KIP-848: The Next Generation of the Consumer Rebalance Protocol

Hi Sagar, I have some thoughts about Kafka Connect integrating with KIP-848, but I think we should have a separate discussion thread for the Kafka Connect KIP: Integrating Kafka Connect With New Consumer Rebalance Protocol [1], and let this discussion thread focus on consumer rebalance protocol,

Re: [DISCUSS] KIP-854 Separate configuration for producer ID expiry

+1 for internal configuration to reduce the complexity. We can externalize it if we have some requirements in the future. Thanks. Luke On Sat, Aug 20, 2022 at 2:13 AM David Jacot wrote: > Sounds good. Thanks, Justine. > > Le ven. 19 août 2022 à 19:38, Justine Olshan > > a écrit : > > > Hi

[jira] [Resolved] (KAFKA-14161) kafka-consumer-group.sh --list not list all consumer groups

[ https://issues.apache.org/jira/browse/KAFKA-14161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-14161. --- Resolution: Not A Problem > kafka-consumer-group.sh --list not list all consumer gro

Re: [VOTE] KIP-854 Separate configuration for producer ID expiry

Hi Justine, Thanks for the KIP. +1 (binding) from me. Luke On Wed, Aug 10, 2022 at 1:44 AM Tom Bentley wrote: > Hi Justine, > > Thanks again for the KIP, +1 (binding). > > > > On Tue, 9 Aug 2022 at 18:09, Jason Gustafson > wrote: > > > Thanks Justine, +1 from me. > > > > On Tue, Aug 9, 2022

Re: [ANNOUNCE] New Kafka PMC Member: A. Sophie Blee-Goldman

Congrats Sophie! :) Luke On Tue, Aug 2, 2022 at 7:56 AM Adam Bellemare wrote: > Congratulations Sophie! I’m glad to see you made as a PMC member! Well > earned. > > > On Aug 1, 2022, at 6:42 PM, Guozhang Wang wrote: > > > > Hi everyone, > > > > I'd like to introduce our new Kafka PMC member,

Re: [DISCUSS] KIP-854 Separate configuration for producer ID expiry

; > > > Thanks! > > Kirk > > > > > > > > Also, I agree with Luke that for now setting a default to -1 should be > > > good. We can look to switch to 1 day with major release. > > > > > > Thanks! > > > Sagar. > > > &

[jira] [Resolved] (KAFKA-13868) Website updates to satisfy Apache privacy policies

[ https://issues.apache.org/jira/browse/KAFKA-13868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-13868. --- Fix Version/s: 3.3.0 Resolution: Fixed > Website updates to satisfy Apache privacy polic

Re: [DISCUSS] Website changes required for Apache projects

t;> > introduction to the project. > > > >>> > > > > >>> > I took a look at the video on those pages, and I'm not sure > > > >>> > if the videos themselves are branded. It looks like the branding > > > >>> > marks

Re: [DISCUSS] KIP-854 Separate configuration for producer ID expiry

Hi Justine, Thanks for the KIP. I agree with you that we should try our best to keep backward compatibility, although our intention is to have lower producer id expiration timeout. So, I think we should keep default to -1 IMO. Maybe we change the default to 1 day in next major release (4.0)?

Re: New Jira Account - contributor list

Hi Dalibor, I've added you into the contribution list. Thanks for the interest in Apache Kafka. Luke On Wed, Jul 27, 2022 at 5:46 AM Dalibor Plavcic wrote: > Hi dev@kafka, > > I have created a new Jira account and I would like to start contributing > to the Kafka project. > > [How to

Re: [DISCUSS] Apache Kafka 3.3.0 Release

Hi Jose, I just found the KIP-831 is not listed in the v3.3 planned KIPs. It is completed and merged. Please help add it. Thank you. Luke On Fri, Jul 22, 2022 at 4:56 AM Randall Hauch wrote: > Hi, Jose. > > Thanks for driving the 3.3.0 release. > > Chris E and Chris S both mentioned >

Re: [DISCUSS] KIP-848: The Next Generation of the Consumer Rebalance Protocol

Hi David, So excited to see the consumer protocol will be renewed! Thanks for David, Guozhang, and Jason for creating this great proposal! Some comments about the protocol: 1. Will the member reconciling jump to the latest target assignment? For example, member epoch are A:1, B:2, but now the

[jira] [Resolved] (KAFKA-14024) Consumer stuck during cooperative rebalance for Commit offset in onJoinPrepare

[ https://issues.apache.org/jira/browse/KAFKA-14024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-14024. --- Resolution: Fixed > Consumer stuck during cooperative rebalance for Commit offset in onJoinPrep

[jira] [Resolved] (KAFKA-13572) Negative value for 'Preferred Replica Imbalance' metric

[ https://issues.apache.org/jira/browse/KAFKA-13572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-13572. --- Fix Version/s: 3.3.0 3.2.1 Resolution: Fixed > Negative va

Re: [DISCUSS] Apache Kafka 3.2.1 release

+1, Thanks David! On Thu, Jul 14, 2022 at 1:16 PM David Jacot wrote: > +1. Thanks David. > > Le mer. 13 juil. 2022 à 23:43, José Armando García Sancio > a écrit : > > > +1. Thanks for volunteering David. > > > > -- > > -José > > >

Re: [DISCUSS] KIP-852 Optimize calculation of size for log in remote tier

Hi Divij, Thanks for the KIP! I think it makes sense to delegate the responsibility of calculation to the specific RemoteLogMetadataManager implementation. But one thing I'm not quite sure, is that would the new `RemoteLogSizeBytes` metric be a performance overhead? Although we move the

Re: Transactions, delivery timeout and changing transactional producer behavior

Hi Daniel, Thanks for reporting the issue, and the investigation. I'm curious, so, what's your workaround for this issue? I agree with Artem, it makes sense. Please file a bug in JIRA. And looking forward to your PR! :) Thank you. Luke On Thu, Jul 7, 2022 at 3:07 AM Artem Livshits wrote: >

Re: [VOTE] KIP-851: : Add requireStable flag into ListConsumerGroupOffsetsOptions

t-extension into the KIP if you > > you cannot commit to its implementation. I think partially implemented > > KIPs make release management harder. If we can avoid implementing KIPs > > partially, we should do it. > > > > I am +1 either way. I just wanted to b

[jira] [Resolved] (KAFKA-14044) Upgrade Netty and Jackson for CVE fixes

[ https://issues.apache.org/jira/browse/KAFKA-14044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-14044. --- Fix Version/s: 3.3.0 Resolution: Fixed > Upgrade Netty and Jackson for CVE fi

Re: [VOTE] KIP-851: : Add requireStable flag into ListConsumerGroupOffsetsOptions

you for the KIP! > > > > > > I do not have strong feelings about the naming of the getter, but I > tend > > > to agree with Luke. > > > > > > Regarding, the adaptation of the kafka-consumer-group.sh script, I am > > > fine if we leave that for a future

Re: [VOTE] KIP-851: : Add requireStable flag into ListConsumerGroupOffsetsOptions

Hi Guozhang, Thanks for the KIP. Some comments: 1. I have the same question as Ziming, should we also add an option in kafka-consumer-groups.sh in this KIP? Or you'd like to keep the current scope, and other people can create a follow-up KIP to address the kafka-consumer-groups.sh script? 2. The

<    1   2   3   4   5   6   7   8   9   10   >