[jira] [Resolved] (KAFKA-14161) kafka-consumer-group.sh --list not list all consumer groups

2022-08-11 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-14161. --- Resolution: Not A Problem > kafka-consumer-group.sh --list not list all consumer gro

Re: [VOTE] KIP-854 Separate configuration for producer ID expiry

2022-08-11 Thread Luke Chen
Hi Justine, Thanks for the KIP. +1 (binding) from me. Luke On Wed, Aug 10, 2022 at 1:44 AM Tom Bentley wrote: > Hi Justine, > > Thanks again for the KIP, +1 (binding). > > > > On Tue, 9 Aug 2022 at 18:09, Jason Gustafson > wrote: > > > Thanks Justine, +1 from me. > > > > On Tue, Aug 9, 2022

Re: [ANNOUNCE] New Kafka PMC Member: A. Sophie Blee-Goldman

2022-08-01 Thread Luke Chen
Congrats Sophie! :) Luke On Tue, Aug 2, 2022 at 7:56 AM Adam Bellemare wrote: > Congratulations Sophie! I’m glad to see you made as a PMC member! Well > earned. > > > On Aug 1, 2022, at 6:42 PM, Guozhang Wang wrote: > > > > Hi everyone, > > > > I'd like to introduce our new Kafka PMC member,

Re: [DISCUSS] KIP-854 Separate configuration for producer ID expiry

2022-07-28 Thread Luke Chen
; > > > Thanks! > > Kirk > > > > > > > > Also, I agree with Luke that for now setting a default to -1 should be > > > good. We can look to switch to 1 day with major release. > > > > > > Thanks! > > > Sagar. > > > &

[jira] [Resolved] (KAFKA-13868) Website updates to satisfy Apache privacy policies

2022-07-28 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-13868. --- Fix Version/s: 3.3.0 Resolution: Fixed > Website updates to satisfy Apache privacy polic

Re: [DISCUSS] Website changes required for Apache projects

2022-07-28 Thread Luke Chen
t;> > introduction to the project. > > > >>> > > > > >>> > I took a look at the video on those pages, and I'm not sure > > > >>> > if the videos themselves are branded. It looks like the branding > > > >>> > marks

Re: [DISCUSS] KIP-854 Separate configuration for producer ID expiry

2022-07-26 Thread Luke Chen
Hi Justine, Thanks for the KIP. I agree with you that we should try our best to keep backward compatibility, although our intention is to have lower producer id expiration timeout. So, I think we should keep default to -1 IMO. Maybe we change the default to 1 day in next major release (4.0)?

Re: New Jira Account - contributor list

2022-07-26 Thread Luke Chen
Hi Dalibor, I've added you into the contribution list. Thanks for the interest in Apache Kafka. Luke On Wed, Jul 27, 2022 at 5:46 AM Dalibor Plavcic wrote: > Hi dev@kafka, > > I have created a new Jira account and I would like to start contributing > to the Kafka project. > > [How to

Re: [DISCUSS] Apache Kafka 3.3.0 Release

2022-07-21 Thread Luke Chen
Hi Jose, I just found the KIP-831 is not listed in the v3.3 planned KIPs. It is completed and merged. Please help add it. Thank you. Luke On Fri, Jul 22, 2022 at 4:56 AM Randall Hauch wrote: > Hi, Jose. > > Thanks for driving the 3.3.0 release. > > Chris E and Chris S both mentioned >

Re: [DISCUSS] KIP-848: The Next Generation of the Consumer Rebalance Protocol

2022-07-21 Thread Luke Chen
Hi David, So excited to see the consumer protocol will be renewed! Thanks for David, Guozhang, and Jason for creating this great proposal! Some comments about the protocol: 1. Will the member reconciling jump to the latest target assignment? For example, member epoch are A:1, B:2, but now the

[jira] [Resolved] (KAFKA-14024) Consumer stuck during cooperative rebalance for Commit offset in onJoinPrepare

2022-07-19 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-14024. --- Resolution: Fixed > Consumer stuck during cooperative rebalance for Commit offset in onJoinPrep

[jira] [Resolved] (KAFKA-13572) Negative value for 'Preferred Replica Imbalance' metric

2022-07-18 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-13572. --- Fix Version/s: 3.3.0 3.2.1 Resolution: Fixed > Negative va

Re: [DISCUSS] Apache Kafka 3.2.1 release

2022-07-14 Thread Luke Chen
+1, Thanks David! On Thu, Jul 14, 2022 at 1:16 PM David Jacot wrote: > +1. Thanks David. > > Le mer. 13 juil. 2022 à 23:43, José Armando García Sancio > a écrit : > > > +1. Thanks for volunteering David. > > > > -- > > -José > > >

Re: [DISCUSS] KIP-852 Optimize calculation of size for log in remote tier

2022-07-12 Thread Luke Chen
Hi Divij, Thanks for the KIP! I think it makes sense to delegate the responsibility of calculation to the specific RemoteLogMetadataManager implementation. But one thing I'm not quite sure, is that would the new `RemoteLogSizeBytes` metric be a performance overhead? Although we move the

Re: Transactions, delivery timeout and changing transactional producer behavior

2022-07-06 Thread Luke Chen
Hi Daniel, Thanks for reporting the issue, and the investigation. I'm curious, so, what's your workaround for this issue? I agree with Artem, it makes sense. Please file a bug in JIRA. And looking forward to your PR! :) Thank you. Luke On Thu, Jul 7, 2022 at 3:07 AM Artem Livshits wrote: >

Re: [VOTE] KIP-851: : Add requireStable flag into ListConsumerGroupOffsetsOptions

2022-07-06 Thread Luke Chen
t-extension into the KIP if you > > you cannot commit to its implementation. I think partially implemented > > KIPs make release management harder. If we can avoid implementing KIPs > > partially, we should do it. > > > > I am +1 either way. I just wanted to b

[jira] [Resolved] (KAFKA-14044) Upgrade Netty and Jackson for CVE fixes

2022-07-05 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-14044. --- Fix Version/s: 3.3.0 Resolution: Fixed > Upgrade Netty and Jackson for CVE fi

Re: [VOTE] KIP-851: : Add requireStable flag into ListConsumerGroupOffsetsOptions

2022-07-03 Thread Luke Chen
you for the KIP! > > > > > > I do not have strong feelings about the naming of the getter, but I > tend > > > to agree with Luke. > > > > > > Regarding, the adaptation of the kafka-consumer-group.sh script, I am > > > fine if we leave that for a future

Re: [VOTE] KIP-851: : Add requireStable flag into ListConsumerGroupOffsetsOptions

2022-06-30 Thread Luke Chen
Hi Guozhang, Thanks for the KIP. Some comments: 1. I have the same question as Ziming, should we also add an option in kafka-consumer-groups.sh in this KIP? Or you'd like to keep the current scope, and other people can create a follow-up KIP to address the kafka-consumer-groups.sh script? 2. The

Re: [DISCUSS] KIP-847: Add ProducerCount metrics

2022-06-29 Thread Luke Chen
r some thinking and discussing it offline with some folks, I > think that we don't really need partitioner level metrics. We can use > existing tools to do granular debugging. I've moved partition level > metrics to the rejected alternatives section. > > -Artem > > On Wed, Jun

Re: [DISCUSS] KIP-847: Add ProducerCount metrics

2022-06-29 Thread Luke Chen
Hi Artem, Could you elaborate more in the motivation section? I'm interested to know what kind of scenarios this metric can benefit for. What could it bring to us when a topic partition has 100 ProducerIdCount VS another topic partition has 10 ProducerIdCount? Thank you. Luke On Wed, Jun 29,

Re: [VOTE] KIP-847

2022-06-24 Thread Luke Chen
Hi Artem, Thanks for the KIP. +1 (binding) from me. In addition to the `ProducerIdCount` in motivation section, the KIP title should also be updated. Luke On Fri, Jun 24, 2022 at 8:33 PM David Jacot wrote: > Thanks for the KIP, Artem. > > I am +1 (binding). > > A small nit: ProducerIdCount

[jira] [Created] (KAFKA-14012) resource leak due to passing a "method" into the `Utils.closeQuietly` method

2022-06-20 Thread Luke Chen (Jira)
Luke Chen created KAFKA-14012: - Summary: resource leak due to passing a "method" into the `Utils.closeQuietly` method Key: KAFKA-14012 URL: https://issues.apache.org/jira/browse/KAFKA-14012

[jira] [Created] (KAFKA-14010) alterISR request won't retry when receiving retriable error

2022-06-19 Thread Luke Chen (Jira)
Luke Chen created KAFKA-14010: - Summary: alterISR request won't retry when receiving retriable error Key: KAFKA-14010 URL: https://issues.apache.org/jira/browse/KAFKA-14010 Project: Kafka Issue

Re: Granting permission for Create KIP

2022-06-19 Thread Luke Chen
Hi, I think your wiki ID should be "lith_angelo", right? I've added the permission for "lith_angelo". Let me know if you have any questions. Thanks for the interest in Apache Kafka. Luke On Sat, Jun 18, 2022 at 10:24 AM lith_angelo wrote: > Plaease grant permission for Create KIP to wiki

Re: Permission to self-assign Jira issues

2022-06-19 Thread Luke Chen
Hi Khalid Done. Thanks for the interest in Apache Kafka. Luke On Sun, Jun 19, 2022 at 4:31 PM Khalid Ouafi wrote: > Hello, > > Please grant me permission to self assign issues in Jira (username: kvfi). > > Thanks, > > K. O. >

Re: Please add me to the contributers list

2022-06-19 Thread Luke Chen
Hi 仲恩 Done. Thanks for the interest in Apache Kafka. Luke On Sun, Jun 19, 2022 at 11:35 PM 李仲恩 wrote: > Hi, kafka community > I want to contribute some code to the Kafka project. Please add me to the > contributors list. My Jira account username is "wfps1210". > Thanks. > > Chung En Lee >

Re: Permission for jira & wiki

2022-06-19 Thread Luke Chen
Hi Cathie, Done. Thanks for the interest in Apache Kafka. Luke On Sun, Jun 19, 2022 at 11:35 PM Cathie Wang wrote: > Hi: > > I want to contribute to Kafka. Please add me to contributor list. Thanks. > jira username: targetoee > wiki username: targetoee > > Regards, > Cathie Wang >

Re: Contribution req

2022-06-19 Thread Luke Chen
Hi Elxan, Done. Thanks for the interest in Apache Kafka. Luke On Mon, Jun 20, 2022 at 12:25 AM Elxan Eminov wrote: > Hi, > I'd like to request permissions to contribute to Apache Kafka, > my wiki and jira ID's are "elkkhan" > > Thanks! >

[jira] [Resolved] (KAFKA-13483) Stale Missing ISR on a partition after a zookeeper timeout

2022-06-16 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-13483. --- Fix Version/s: 3.1.0 Resolution: Fixed > Stale Missing ISR on a partition after a zookee

[jira] [Resolved] (KAFKA-13720) Few topic partitions remain under replicated after broker lose connectivity to zookeeper

2022-06-16 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-13720. --- Fix Version/s: 3.1.0 Resolution: Fixed > Few topic partitions remain under replicated af

Re: [VOTE] KIP-831: Add metric for log recovery progress

2022-06-15 Thread Luke Chen
1 from me. > > Jun > > On Mon, Jun 13, 2022 at 8:04 AM Mickael Maison > wrote: > > > +1 (binding) > > > > Thanks for the KIP! > > > > Mickael > > > > On Sun, Jun 12, 2022 at 5:26 PM Yu Kvicii wrote: > > > > > >

[jira] [Created] (KAFKA-13981) metadata shell doesn't recognize some new record types

2022-06-12 Thread Luke Chen (Jira)
Luke Chen created KAFKA-13981: - Summary: metadata shell doesn't recognize some new record types Key: KAFKA-13981 URL: https://issues.apache.org/jira/browse/KAFKA-13981 Project: Kafka Issue Type

[jira] [Resolved] (KAFKA-13891) sync group failed with rebalanceInProgress error cause rebalance many rounds in coopeartive

2022-06-12 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-13891. --- Fix Version/s: 3.3.0 Resolution: Fixed > sync group failed with rebalanceInProgress er

[jira] [Resolved] (KAFKA-13917) Avoid calling lookupCoordinator() in tight loop

2022-06-09 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-13917. --- Fix Version/s: 3.3.0 Resolution: Fixed > Avoid calling lookupCoordinator() in tight l

Re: [VOTE] KIP-831: Add metric for log recovery progress

2022-06-09 Thread Luke Chen
t; > > The proposal looks good to me. Thanks. +1 > > > > > > > > > On Tue, May 17, 2022 at 9:26 PM James Cheng > > wrote: > > > > > > > > +1 (non-binding) > > > > > > > > -James > > > > > > &g

Re: [VOTE] KIP-840: Config file option for MessageReader/MessageFormatter in ConsoleProducer/ConsoleConsumer

2022-06-09 Thread Luke Chen
Hi Alexandre, +1 (binding) from me. Thank you. Luke On Thu, Jun 9, 2022 at 10:24 AM John Roesler wrote: > Thanks for the KIP, Alexandre! > > I’m +1 (binding) > > -John > > On Wed, Jun 8, 2022, at 20:54, deng ziming wrote: > > Thank you for this KIP, > > > > +1 (non-binding) > > > > -- > >

Re: [DISCUSS] KIP-840: Config file option for MessageReader/MessageFormatter in ConsoleProducer/ConsoleConsumer

2022-06-09 Thread Luke Chen
o the KIP? >> > This was covered by the sentence "As for > --producer-property/--consumer-property with > --consumer.config/--producer.config, any value from option --property would > override value from config file." > I did add an example for this situation. > >

Re: [DISCUSS] KIP-840: Config file option for MessageReader/MessageFormatter in ConsoleProducer/ConsoleConsumer

2022-06-08 Thread Luke Chen
Hi Alexandre, Thanks for the KIP. Some comments: 1. Usually, in "Proposed Changes" section, we won't put PR link there. Maybe you can take KIP-824 as a reference. 2.

Re: Upgrade log4j to log4j2

2022-06-08 Thread Luke Chen
Hi Nicola, Here's the plan for log4j and log4j2 in Kafka project: - adopt reload4j in Kafka 3.2.0 - switch to log4j2 to Kafka 4.0.0 Thank you. Luke On Tue, Jun 7, 2022 at 11:18 PM Nozza, Nicola wrote: > Hi, > > I'm contacting you to please ask for an ETA, if it is planned, for the > release

Re: [VOTE] KIP-830: Allow disabling JMX Reporter

2022-06-08 Thread Luke Chen
Hi Mickael, Thanks for the KIP. It's a good improvement. Although it's a little weird that we introduce a "new deprecated" config, it seems like this is the best solution we can have now. +1 (binding) from me. Thank you. Luke On Thu, May 26, 2022 at 12:21 AM Ismael Juma wrote: > Thanks, +1

[jira] [Resolved] (KAFKA-13933) Stuck SSL/TLS unit tests in case of authentication failure

2022-06-05 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-13933. --- Fix Version/s: 3.3.0 Resolution: Fixed > Stuck SSL/TLS unit tests in case of authenticat

Re: [DISCUSS] KIP-846: Task-level Streams metrics for bytes/records Produced

2022-06-04 Thread Luke Chen
Hi Sophie, Sorry for the late comments. Thanks for the KIP. One question from me: In test plan section, you mentioned we'll have benchmark for potential performance regression. And in the end, you said: See #2 under Rejected Alternatives for more on this. But I didn't find there's #2 in

Re: Re-run Jenkins build

2022-06-03 Thread Luke Chen
Hi José, I think you should have the same permissions as I have, and I can login jenkins. Anyway, I can help you re-run the jenkins build. Just point me the jenkins build link. Or you can actually merge with the latest trunk to trigger the build. Thank you. Luke On Sat, Jun 4, 2022 at 5:52 AM

Re: [DISCUSS] KIP-831: Add metric for log recovery progress

2022-06-03 Thread Luke Chen
the > remaining segments for the current log assigned to a thread. Also, would it > be better to use ToRecover instead of ToRecovery? > > Thanks, > > Jun > > On Fri, Jun 3, 2022 at 1:18 AM Luke Chen wrote: > > > Hi Jun, > > > > > how do we implement kafka.log &

Re: [DISCUSS] KIP-831: Add metric for log recovery progress

2022-06-03 Thread Luke Chen
he segment level? > > Jun > > On Thu, Jun 2, 2022 at 3:39 AM Luke Chen wrote: > > > Hi Jun, > > > > Thanks for the comment. > > > > Yes, I've tried to work on this way to track the number of remaining > > segments, but it will change the design

[jira] [Resolved] (KAFKA-13718) kafka-topics describe topic with default config will show `segment.bytes` overridden config

2022-06-02 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-13718. --- Fix Version/s: 3.3.0 Resolution: Fixed > kafka-topics describe topic with default con

[jira] [Created] (KAFKA-13955) Fix failing KRaftClusterTest tests

2022-06-02 Thread Luke Chen (Jira)
Luke Chen created KAFKA-13955: - Summary: Fix failing KRaftClusterTest tests Key: KAFKA-13955 URL: https://issues.apache.org/jira/browse/KAFKA-13955 Project: Kafka Issue Type: Test

Re: [DISCUSS] KIP-831: Add metric for log recovery progress

2022-06-02 Thread Luke Chen
gt; > Thanks Luke! LGTM. > > > > On Sun, 22 May 2022 at 05:18, Luke Chen wrote: > > > > > Hi Tom and Raman, > > > > > > Thanks for your comments. > > > > > > > 1. There's not a JIRA for this KIP (or the JIRA link needs updating). >

Re: [DISCUSS] KIP-843 Adding metricOrElseCreate method to Metrics.

2022-05-31 Thread Luke Chen
KIP doesn't throw any > exceptions. Also, the KIP was an afterthought, which came up during the PR > review of this: https://github.com/apache/kafka/pull/12121 > > Let me know if that's ok. > > Thanks! > Sagar. > > On Tue, May 31, 2022 at 8:40 AM Luke Chen wrote: >

Re: [DISCUSS] KIP-843 Adding metricOrElseCreate method to Metrics.

2022-05-30 Thread Luke Chen
Hi Sagar, Thanks for the KIP. In the `Compatibility` section, you mentioned: *The changes are backward compatible and needs no deprecation/migration.* But as you said, we won't throw `IllegalArgumentException` in `addMetric` method. Isn't that the compatibility issue that should be put in

Re: [VOTE] KIP-833: Mark KRaft as Production Ready

2022-05-23 Thread Luke Chen
+1 from me. Kraft is coming!!! Luke On Tue, May 24, 2022 at 7:26 AM Israel Ekpo wrote: > +1 (non-binding) from me. > > I am very happy to finally see this. > > On Mon, May 23, 2022 at 6:08 PM Jason Gustafson > > wrote: > > > Thanks Colin. +1 from me. Very exciting! > > > > On Tue, May 17,

Re: Re: Fw: Re: how to apply to create a KIP

2022-05-23 Thread Luke Chen
/3d5o7h17ztjztjhblx4fln0wbbs1rmdq Thank you. Luke On Mon, May 23, 2022 at 4:30 PM 胡德祺 <16120...@bjtu.edu.cn> wrote: > Hi, Luke Chen. Thanks. > I have created and published the KIP: > https://cwiki.apache.org/confluence/display/KAFKA/KIP-842%3A+Add+richer+group+offset+reset+mechanisms >

Re: Requesting permissions to contribute to Kafka

2022-05-22 Thread Luke Chen
Hi, Done. Thank you. Luke On Mon, May 23, 2022 at 1:40 PM Kumud Kumar Srivatsava Tirupati < kumudkumartirup...@gmail.com> wrote: > Hi team, > I am planning to work on https://issues.apache.org/jira/browse/KAFKA-13926 > and wanted to create a KIP for the same. Requesting permissions on the >

Re: Fw: Re: how to apply to create a KIP

2022-05-22 Thread Luke Chen
HI 德祺, I've granted your permission. You are able to create KIP now. Thanks for the interest in Apache Kafka. Luke On Mon, May 23, 2022 at 9:51 AM 胡德祺 <16120...@bjtu.edu.cn> wrote: > hi, I want to apply to create a KIP. My wiki ID is "hudeqi". Please help > me add it in. > > > -原始邮件- >

Re: [DISCUSS] KIP-831: Add metric for log recovery progress

2022-05-21 Thread Luke Chen
> > rather than describing the tree you'd see in an MBean console. > > > > Kind regards, > > > > Tom > > > > On Wed, 11 May 2022 at 09:08, Luke Chen wrote: > > > > > > And if people start using RemainingLogs and RemainingSegments and >

[jira] [Created] (KAFKA-13919) Add metric for log recovery progress

2022-05-20 Thread Luke Chen (Jira)
Luke Chen created KAFKA-13919: - Summary: Add metric for log recovery progress Key: KAFKA-13919 URL: https://issues.apache.org/jira/browse/KAFKA-13919 Project: Kafka Issue Type: New Feature

Re: Kafka 2.7.0 vulnerabilities

2022-05-19 Thread Luke Chen
Hi Udit, If v3.0.0 is vulnerable to this CVE, then I believe v2.7.0 is also vulnerable, since the component used in v2.7.0 must be in the older version. Please upgrade to v3.1.1 or later. Thank you. Luke On Thu, May 19, 2022 at 6:41 PM Seth, Udit wrote: > Greetings Concerned, > Currently,

Re: [VOTE] KIP-836: Addition of Information in DescribeQuorumResponse about Voter Lag

2022-05-18 Thread Luke Chen
Hi Niket, Thanks for the KIP! +1 (binding) from me. Luke On Thu, May 19, 2022 at 8:27 AM deng ziming wrote: > +1(non-binding) > > Thanks for this KIP. > -- > Best, > Ziming > > > On May 17, 2022, at 1:14 AM, Niket Goel > wrote: > > > > Hi all, > > > > I would like to start a vote for

Re: [VOTE] KIP-835: Monitor KRaft Controller Quorum Health

2022-05-18 Thread Luke Chen
Hi José, Thanks for the KIP! +1 (binding) from me. Luke On Thu, May 19, 2022 at 2:05 AM José Armando García Sancio wrote: > Hi Guozhang, thanks for the feedback. > > > Guozhang wrote: > > Could you elaborate a bit on what does "load-processing-time-us" > measure? I > > looked through the

Re: [ANNOUNCE] Apache Kafka 3.2.0

2022-05-17 Thread Luke Chen
t; Bruno Cadonna, Chang, Chia-Ping Tsai, Chris Egerton, Colin P. Mccabe, > > > Colin Patrick McCabe, Cong Ding, David Arthur, David Jacot, David Mao, > > > defhacks, dengziming, Ed B, Edwin, florin-akermann, GauthamM-official, > > > GuoPhilipse, Guozhang Wang, Hao Li, Haoze

Re: Permission request to contribute

2022-05-17 Thread Luke Chen
Thanks Bill! @Austin, your wiki permission is set now. Thank you. Luke On Wed, May 18, 2022 at 6:40 AM Bill Bejeck wrote: > Hi Austin, > > You're all set with Jira, but at the moment it seems like there's a > connection issue with the wiki and I haven't been able to add you there > yet. >

Re: [VOTE] KIP-827: Expose logdirs total and usable space via Kafka API

2022-05-17 Thread Luke Chen
Hi Mickael, +1 (binding) from me. Thanks for the KIP! Luke On Tue, May 17, 2022 at 9:30 PM Mickael Maison wrote: > Hi, > > I'd like to start a vote on KIP-827. It proposes exposing the total > and usable space of logdirs > via the DescribeLogDirs API: > >

[jira] [Created] (KAFKA-13908) RuntimeException will be thrown in BrokerServer.startup, not the cause of exception

2022-05-17 Thread Luke Chen (Jira)
Luke Chen created KAFKA-13908: - Summary: RuntimeException will be thrown in BrokerServer.startup, not the cause of exception Key: KAFKA-13908 URL: https://issues.apache.org/jira/browse/KAFKA-13908

[jira] [Resolved] (KAFKA-13905) Fix failing ServerShutdownTest.testCleanShutdownAfterFailedStartupDueToCorruptLogs

2022-05-17 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-13905. --- Fix Version/s: 3.3.0 Resolution: Fixed > Fix fail

Re: CI on Kafka seems to be failing even on trunk branch

2022-05-16 Thread Luke Chen
Thanks for Divij's answer. One thing I'd like to add is that it'd be better if you can help investigate and fix those flaky tests. :) Thank you. Luke On Tue, May 17, 2022 at 4:14 AM Divij Vaidya wrote: > Hi Lim > > We have quite a few tests which are flaky and fail stochastically from time >

Re: [ANNOUNCE] Apache Kafka 3.1.1

2022-05-16 Thread Luke Chen
hat transform or react > >> to the streams of data. > >> > >> > >> Apache Kafka is in use at large and small companies worldwide, including > >> Capital One, Goldman Sachs, ING, LinkedIn, Netflix, Pinterest, Rabobank, > >> Target, The New York T

[jira] [Created] (KAFKA-13905) Fix failing ServerShutdownTest.testCleanShutdownAfterFailedStartupDueToCorruptLogs

2022-05-16 Thread Luke Chen (Jira)
Luke Chen created KAFKA-13905: - Summary: Fix failing ServerShutdownTest.testCleanShutdownAfterFailedStartupDueToCorruptLogs Key: KAFKA-13905 URL: https://issues.apache.org/jira/browse/KAFKA-13905 Project

[VOTE] KIP-831: Add metric for log recovery progress

2022-05-16 Thread Luke Chen
Hi all, I'd like to start a vote on KIP to expose metrics for log recovery progress. These metrics would let the admins have a way to monitor the log recovery progress. Details can be found here: https://cwiki.apache.org/confluence/display/KAFKA/KIP-831%3A+Add+metric+for+log+recovery+progress

Re: Contributor Permission

2022-05-12 Thread Luke Chen
Hi Jack, I've added you into the contribution list. Thanks for the interest in Apache Kafka. Luke On Thu, May 12, 2022 at 8:44 AM Jack Burgoyne wrote: > Hello, > > I'd like to start contributing to Kafka, could I have contributor > permission for my Jira username: jcbu2718? > > Thank you, >

Re: Request to be added to Kafka Jira project

2022-05-12 Thread Luke Chen
Hi Lim, I've added you into the contribution list in JIRA. Thanks for the interest in Apache Kafka. Luke On Thu, May 12, 2022 at 2:09 PM Lim Qingwei wrote: > Sorry, I misread, my jira id is qingwei91 > > On Thu, May 12, 2022 at 7:01 AM Lim Qingwei wrote: > > > Hi, I am looking to pick this

Re: [VOTE] KIP-834: Pause / Resume KafkaStreams Topologies

2022-05-11 Thread Luke Chen
Hi Jim, I'm +1. (please add some note in KIP about the stream resetting tool can't be used in paused state) Thanks for the KIP! Luke On Wed, May 11, 2022 at 9:09 AM Guozhang Wang wrote: > Thanks Jim. +1 from me. > > On Tue, May 10, 2022 at 4:51 PM Matthias J. Sax wrote: > > > I had one minor

Re: [DISCUSS] KIP-834: Pause / Resume KafkaStreams Topologies

2022-05-11 Thread Luke Chen
as the members and the tool will be > simultaneously trying to set the committed offsets to different values, etc. > > Jim, can you also make it a point to document this? As Luke points out, it > might be a natural thing to want to do. > > Thanks, > John > > On Wed, May 11, 2022,

Re: [DISCUSS] KIP-831: Add metric for log recovery progress

2022-05-11 Thread Luke Chen
. And if people start using > RemainingLogs and RemainingSegments and then REALLY FEEL like they need > RemainingBytes, then we can always add it in the future. > > Thanks Luke, for the detailed explanation, and for responding to my > feedback! > > -James > > Sent from my iPho

Re: [HEADS-UP] Modification to KIP Template

2022-05-11 Thread Luke Chen
Hi Mickael, +1 to add "test plan" section to KIP template. Thanks for the improvement! Luke On Tue, May 10, 2022 at 11:21 PM Mickael Maison wrote: > Hi, > > I did not see any comments nor concerns so I went ahead and added the > Test Plan section to the KIP template. > > Thanks, > Mickael > >

Re: [DISCUSS] KIP-834: Pause / Resume KafkaStreams Topologies

2022-05-11 Thread Luke Chen
Hi Jim, Thanks for the KIP. Overall LGTM! One late question: Could we run the stream resetter tool (i.e. kafka-streams-application-reset.sh) during pause state? I can imagine there's a use case that after pausing for a while, user just want to continue with the latest offset, and skipping the

Re: [DISCUSS] KIP-835: Monitor KRaft Controller Quorum Health

2022-05-11 Thread Luke Chen
Hi José, Thanks for the KIP! Some questions: 1. Jason has asked but you didn't answer: What is the default value for ` metadata.monitor.write.interval.ms`? 2. The `noopRecord` API key is `TBD`. Why can't we put the "currently used API Key nums + 1" into it? Any concern? 3. typo:

Re: [DISCUSS] KIP-831: Add metric for log recovery progress

2022-05-10 Thread Luke Chen
this week. Thank you. Luke On Fri, May 6, 2022 at 6:00 PM Luke Chen wrote: > Hi James, > > Thanks for your input. > > For the `RemainingBytesToRecovery` metric proposal, I think there's one > thing I didn't make it clear. > Currently, when log manager start up, we'll try to load

Re: Permission to contribute

2022-05-09 Thread Luke Chen
Hi Tom, You're all done. Thanks for joining us! :) Luke On Mon, May 9, 2022 at 4:47 PM Thomas Cooper wrote: > Hi, > > I would like to contribute to the project. My usernames are: > > wiki: tomncooper > jira: tomncooper > > If someone could approve access for me I would be grateful. > >

Re: [DISCUSS] KIP-831: Add metric for log recovery progress

2022-05-06 Thread Luke Chen
5 partitions, then it would make sense that > each thread has its own counter. > If the threads works on a single pool of 10 partitions, then it would > probably mean that the counter is on the pool of partitions itself, and not > on each thread. > > -James > > > On May

Re: The latest version of Kafka 3.1.0 does not support Ubuntu 14 04? The Java client cannot send a message

2022-05-05 Thread Luke Chen
Hi zw, I think Kafka should be able to run under any Linux environment. Could you share the client/broker logs for troubleshooting? Thank you. Luke On Thu, May 5, 2022 at 10:13 PM zw wrote: > Hello! My English is not very good, please forgive me. > The questions are as follows: > Install

Re: There is the mistake on kafka.apache.org

2022-05-05 Thread Luke Chen
Hi Emily, Thanks for reporting the issue. But the doc you referred to is for Kafka v0.8. This issue has been fixed in later versions (PR: https://github.com/apache/kafka/pull/2010) So, you can just check the latest version of documentation. Of course, if you're interested, welcome to submit a PR

Re: [VOTE] 3.1.1 RC1

2022-05-04 Thread Luke Chen
Hi Tom, I did: 1. check the signature and checksums 2. ran quick start with java17 + sacla2.12 3. browse java docs/documentations +1 (non-binding) Thanks for running the release. Luke On Thu, May 5, 2022 at 12:43 AM Bill Bejeck wrote: > Hi Tom, > > Thanks for running the release! > > I did

Re: [VOTE] 3.2.0 RC1

2022-05-04 Thread Luke Chen
Hi Bruno, I did: 1. check the signature and checksums 2. ran quick start with java17 + sacla2.12 3. browse java docs/documentations +1 (non-binding) Thanks for running the release. Luke On Thu, May 5, 2022 at 1:23 AM Mickael Maison wrote: > Hi Bruno, > > I checked signatures and checksums,

[jira] [Created] (KAFKA-13875) update docs to include topoicId for kafka-topics.sh --describe output

2022-05-04 Thread Luke Chen (Jira)
Luke Chen created KAFKA-13875: - Summary: update docs to include topoicId for kafka-topics.sh --describe output Key: KAFKA-13875 URL: https://issues.apache.org/jira/browse/KAFKA-13875 Project: Kafka

Re: [DISCUSS] KIP-831: Add metric for log recovery progress

2022-05-04 Thread Luke Chen
Hi devs, If there are no other comments, I'll start a vote tomorrow. Thank you. Luke On Sun, May 1, 2022 at 5:08 PM Luke Chen wrote: > Hi James, > > Sorry for the late reply. > > Yes, this is a good point, to know how many segments to be recovered if > there are some large

Re: [DISCUSS] KIP-833: Mark KRaft as Production Ready

2022-05-03 Thread Luke Chen
Hi Colin, So exciting to see the KIP to mark the Kraft production ready! Just one comment: We should make sure the period between ZK deprecation (i.e. v3.4.0) to ZK removal (i.e. v4.0.0) is not too short. Do we have any expectation for the deprecation period? After all, this is not a small

Re: Possible Bug: kafka-reassign-partitions causing the data retention time to be reset

2022-05-03 Thread Luke Chen
Hi Fared, > So I guess the process applying the retention policy (log cleaner?) uses that timestamp to check whether the segment file should be deleted or not. So I ended up with a lot more data than we were supposed to store, since we are basically doubling the retention time of all the freshly

[jira] [Resolved] (KAFKA-13865) Fix ResponseSendTimeMs metric in RequestChannel.scala was removed repeatedly

2022-05-02 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-13865. --- Fix Version/s: 3.3.0 Resolution: Fixed > Fix ResponseSendTimeMs met

Re: [DISCUSS] KIP-831: Add metric for log recovery progress

2022-05-01 Thread Luke Chen
flect partition size? Could it be > RemainingSegmentsToRecover? Or even RemainingBytesToRecover? > > -James > > Sent from my iPhone > > > On Apr 20, 2022, at 2:01 AM, Luke Chen wrote: > > > > Hi all, > > > > I'd like to propose a KIP to expose a metric

[jira] [Resolved] (KAFKA-12380) Executor in Connect's Worker is not shut down when the worker is

2022-04-28 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-12380. --- Fix Version/s: 3.3.0 Resolution: Fixed > Executor in Connect's Worker is not shut down w

Re: [kafka-clients] Re: [VOTE] 3.2.0 RC0

2022-04-28 Thread Luke Chen
Hi Bruno, I think this PR might also need to be included in next release candidate because it's a bug fix/optimization for an issue introduced in v3.2.0. https://github.com/apache/kafka/pull/12096 cc Ismael Thank you. Luke On Thu, Apr 28, 2022 at 3:36 AM Guozhang Wang wrote: > Hi Bruno, > >

Re: [VOTE] 3.1.1 RC0

2022-04-27 Thread Luke Chen
Juma wrote: > > I added a comment to that PR. Let's figure out if we need an additional > > change before doing the next RC. > > > > Ismael > > > > On Tue, Apr 12, 2022 at 7:47 PM Luke Chen wrote: > > > > > Thanks for pointing that out, David. > >

Re: Request permission to contribute to Kafka KIP

2022-04-24 Thread Luke Chen
Hi Hongwei, Done. Thanks for the interest in Apache Kafka. Luke On Sun, Apr 24, 2022 at 11:08 PM Hongtenzone John wrote: > Hi Kafka team, > I'd like to request permission to contribute to Kafka to propose a KIP. > Wiki ID: hongwei.xiangJira ID: hongwei.xiang > Thanks.Best Regards,Hongwei

Re: [DISCUSS] KIP-829: (console-consumer) add print.topic property

2022-04-24 Thread Luke Chen
e ordering of the message printed, there is no intention to > console-consumer on this topic. > > On Sun, Apr 24, 2022, 16:12 Luke Chen wrote: > > > +1 for printing anything we got without ordering. > > I can imagine the ordering of the random topics records will be > complicated > > a

Re: [DISCUSS] KIP-829: (console-consumer) add print.topic property

2022-04-24 Thread Luke Chen
arding this. > > Thank you, > > Evans > > > On Wed, Apr 20, 2022 at 1:59 PM Luke Chen wrote: > > > Hi Evans, > > > > This is a good feature that we missed before. > > +1 to add an example. > > I saw your WIP PR already added it, please put

[jira] [Resolved] (KAFKA-13852) Kafka Acl documentation bug for wildcard '*'

2022-04-24 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-13852. --- Fix Version/s: 3.3.0 Resolution: Fixed > Kafka Acl documentation bug for wildc

[jira] [Resolved] (KAFKA-13834) batch drain for nodes might have starving issue

2022-04-23 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-13834. --- Fix Version/s: 3.3.0 Resolution: Fixed > batch drain for nodes might have starving is

[DISCUSS] KIP-831: Add metric for log recovery progress

2022-04-20 Thread Luke Chen
Hi all, I'd like to propose a KIP to expose a metric for log recovery progress. This metric would let the admins have a way to monitor the log recovery progress. Details can be found here: https://cwiki.apache.org/confluence/display/KAFKA/KIP-831%3A+Add+metric+for+log+recovery+progress Any

Re: [DISCUSS] KIP-829: (console-consumer) add print.topic property

2022-04-20 Thread Luke Chen
Hi Evans, This is a good feature that we missed before. +1 to add an example. I saw your WIP PR already added it, please put them into the KIP. Thank you. Luke On Sat, Apr 16, 2022 at 7:39 AM John Roesler wrote: > Hi Evans, > > Thanks for the KIP! > > I agree with Mickael; it would be good to

<    1   2   3   4   5   6   7   8   9   10   >