[jira] [Resolved] (KAFKA-12407) Document omitted Controller Health Metrics

2021-03-04 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin resolved KAFKA-12407. -- Resolution: Fixed > Document omitted Controller Health Metr

Re: [ANNOUNCE] New Kafka PMC Members: Colin, Vahid and Manikumar

2020-01-16 Thread Dong Lin
Congratulations everyone! On Tue, Jan 14, 2020 at 9:30 AM Gwen Shapira wrote: > Hi everyone, > > I'm happy to announce that Colin McCabe, Vahid Hashemian and Manikumar > Reddy are now members of Apache Kafka PMC. > > Colin and Manikumar became committers on Sept 2018 and Vahid on Jan > 2019.

Re: [ANNOUNCE] New committer: John Roesler

2019-11-12 Thread Dong Lin
Congratulations John! On Tue, Nov 12, 2019 at 1:56 PM Guozhang Wang wrote: > Hi Everyone, > > The PMC of Apache Kafka is pleased to announce a new Kafka committer, John > Roesler. > > John has been contributing to Apache Kafka since early 2018. His main > contributions are primarily around

[jira] [Resolved] (KAFKA-9016) Warn when log dir stopped serving replicas

2019-11-08 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin resolved KAFKA-9016. - Resolution: Fixed > Warn when log dir stopped serving repli

Re: [ANNOUNCE] New committer: Mickael Maison

2019-11-07 Thread Dong Lin
Congratulations Mickael! On Thu, Nov 7, 2019 at 1:38 PM Jun Rao wrote: > Hi, Everyone, > > The PMC of Apache Kafka is pleased to announce a new Kafka committer > Mickael > Maison. > > Mickael has been contributing to Kafka since 2016. He proposed and > implemented multiple KIPs. He has also

Re: [ANNOUNCE] New Kafka PMC member: Matthias J. Sax

2019-04-18 Thread Dong Lin
Congratulations Matthias! Very well deserved! On Thu, Apr 18, 2019 at 2:35 PM Guozhang Wang wrote: > Hello Everyone, > > I'm glad to announce that Matthias J. Sax is now a member of Kafka PMC. > > Matthias has been a committer since Jan. 2018, and since then he continued > to be active in the

Re: [ANNOUNCE] New Kafka PMC member: Sriharsh Chintalapan

2019-04-18 Thread Dong Lin
Congratulations Sriharsh! On Thu, Apr 18, 2019 at 11:46 AM Jun Rao wrote: > Hi, Everyone, > > Sriharsh Chintalapan has been active in the Kafka community since he became > a Kafka committer in 2015. I am glad to announce that Harsh is now a member > of Kafka PMC. > > Congratulations, Harsh! > >

Re: [VOTE] KIP-427: Add AtMinIsr topic partition category (new metric & TopicCommand option)

2019-03-05 Thread Dong Lin
Hey Kevin, Thanks for the KIP! +1 (binding) Thanks, Dong On Tue, Mar 5, 2019 at 9:38 AM Kevin Lu wrote: > Hi All, > > I would like to start the vote thread for KIP-427: Add AtMinIsr topic > partition category (new metric & TopicCommand option). > >

Re: [DISCUSS] KIP-427: Add AtMinIsr topic partition category (new metric & TopicCommand option)

2019-02-28 Thread Dong Lin
the partition > > assignment needs to be moved. > > > > In our case, we run 4 replicas for critical topics with min.isr = 2 . > URPs > > are not really good indicator to take immediate action if one of the > > replicas is down. If 2 replicas are down and we are at

Re: [DISCUSS] KIP-427: Add AtMinIsr topic partition category (new metric & TopicCommand option)

2019-02-27 Thread Dong Lin
plies in that scenario (minIsr=1). > > Regards, > Kevin > > On Tue, Feb 26, 2019 at 5:11 PM Dong Lin wrote: > > > Hey Kevin, > > > > Thanks for the proposal! > > > > It seems that the proposed implementation does not match the motivation. > > T

Re: [DISCUSS] KIP-427: Add AtMinIsr topic partition category (new metric & TopicCommand option)

2019-02-26 Thread Dong Lin
Hey Kevin, Thanks for the proposal! It seems that the proposed implementation does not match the motivation. The motivation suggests that the operator wants to tell the planned maintenance (e.g. broker restart) from unplanned failure (e.g. network failure). But the use of the metric AtMinIsr

Re: [ANNOUNCE] New Committer: Randall Hauch

2019-02-15 Thread Dong Lin
Congratulations Randall!! On Thu, Feb 14, 2019 at 6:17 PM Guozhang Wang wrote: > Hello all, > > The PMC of Apache Kafka is happy to announce another new committer joining > the project today: we have invited Randall Hauch as a project committer and > he has accepted. > > Randall has been

Re: [ANNOUNCE] New Committer: Bill Bejeck

2019-02-15 Thread Dong Lin
Congratulations Bill!! On Wed, Feb 13, 2019 at 5:03 PM Guozhang Wang wrote: > Hello all, > > The PMC of Apache Kafka is happy to announce that we've added Bill Bejeck > as our newest project committer. > > Bill has been active in the Kafka community since 2015. He has made > significant

Re: [ANNOUNCE] New Committer: Vahid Hashemian

2019-01-15 Thread Dong Lin
Congratulations Vahid! On Tue, Jan 15, 2019 at 2:45 PM Jason Gustafson wrote: > Hi All, > > The PMC for Apache Kafka has invited Vahid Hashemian as a project > committer and > we are > pleased to announce that he has accepted! > > Vahid has made numerous contributions to the Kafka community

Re: [DISCUSS] KIP-382: MirrorMaker 2.0

2019-01-13 Thread Dong Lin
Hey Ryanne, Sorry I am late here. Thanks much for all the work! After reading through the latest KIP and all the previous discussion, I have some questions below: 1. Currently if there is topic created with "." in the topic name, would it cause correctness issue for this KIP? For example, will

[jira] [Resolved] (KAFKA-5335) Controller should batch updatePartitionReassignmentData() operation

2018-12-13 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin resolved KAFKA-5335. - Resolution: Won't Do > Controller should batch updatePartitionReassignmentData() operat

Re: [DISCUSS] KIP-382: MirrorMaker 2.0

2018-12-10 Thread Dong Lin
Hey Ryanne, Thanks much for the KIP! Though I don't have time to review this KIP in detail at this stage, I think this KIP will be very useful to Apache Kafka users (particularly global enterprise users) who need geo replication capability. Currently Kafka users have to setup and manage MM

Re: [VOTE] KIP-354 Time-based log compaction policy

2018-12-05 Thread Dong Lin
to achieve this effect gave me quite a headache. > :) > > > > > > > > > > On Mon, Nov 12, 2018 at 1:00 PM xiongqi wu > > > wrote: > > > > > > > > > > > Hi all, > > > > > > > > > > > >

Re: [DISCUSS] KIP-345: Reduce multiple consumer rebalances by specifying member id

2018-11-23 Thread Dong Lin
houghts on the upgrade path for this KIP. More > > > specifically, let's say after we have upgraded broker version to be > able > > to > > > recognize the new versions of JoinGroup request and the admin requests, > > how > > > should we upgrade the clients and enable static groups? On t

Re: [ANNOUNCE] Apache Kafka 2.1.0

2018-11-22 Thread Dong Lin
> Craig > > > On Nov 21, 2018, at 10:09 AM, Dong Lin wrote: > > > > The Apache Kafka community is pleased to announce the release for Apache > Kafka 2.1.0 > > > > > > This is a major release and includes significant features from 28 KIPs. > It contai

[ANNOUNCE] Apache Kafka 2.1.0

2018-11-21 Thread Dong Lin
Barrett, Brandon Kirchner, Bridger Howell, Chia-Ping Tsai, Colin Hicks, Colin Patrick McCabe, Dhruvil Shah, Dong Lin, Edoardo Comar, Eugen Feller, Ewen Cheslack-Postava, Filipe Agapito, Flavien Raynaud, Gantigmaa Selenge, Gardner Vickers, Gitomain, Gunnar Morling, Guozhang Wang, hashangayasri, huxi

[RESULTS] [VOTE] Release Kafka version 2.1.0

2018-11-20 Thread Dong Lin
This vote passes with 10 +1 votes (3 bindings) and no 0 or -1 votes. +1 votes PMC Members: * Guozhang Wang * Jason Gustafson * Dong Lin Committers: * Vahid Hashemian * ManiKumar Reddy Community: * Jonathan Santilli * Eno Thereska * Andras Beni * Jakub Scholz * Satish Duggana 0 votes

Re: [VOTE] 2.1.0 RC1

2018-11-20 Thread Dong Lin
verified the release and upgrade notes. I also went through the basic > quickstart. > > Great job running the release, Dong! Thanks for all the effort. > > -Jason > > On Mon, Nov 19, 2018 at 10:50 AM, Dong Lin wrote: > > > Hey Ismael, > > > > I checked

Re: [VOTE] 2.1.0 RC1

2018-11-19 Thread Dong Lin
, Nov 19, 2018 at 2:16 AM Dong Lin wrote: > Hey Ismael, > > Thanks much for catching this! Sorry I didn't catch this issue before. > > These files were uploaded by release.py scrip in the repo. kafka_2.12-2.1. > 0.mapping contains the following string and the other files are the &g

Re: [VOTE] 2.1.0 RC1

2018-11-19 Thread Dong Lin
Hey Ismael, Thanks much for catching this! Sorry I didn't catch this issue before. These files were uploaded by release.py scrip in the repo. kafka_2.12-2.1.0.mapping contains the following string and the other files are the signature and hash of the file kafka_2.12-2.1.0.mapping:

Re: [DISCUSS] KIP-388 Add observer interface to record request and response

2018-11-18 Thread Dong Lin
d pass it to the observer (e.g. use >> public void record(ObserverdInfo observedInfo)). Also, >>getProduceToTopicSizeInBytes/getProduceToTopicRecordCount/ >> >> getFetchFromTopicPartitionSizeInBytes/getFetchFromTopicPartitionRecordCount >>are very specific to one

Re: [DISCUSS] KIP-345: Reduce multiple consumer rebalances by specifying member id

2018-11-17 Thread Dong Lin
Hey Boyang, Thanks for the proposal! This is very useful. I have some comments below: 1) The motivation currently explicitly states that the goal is to improve performance for heavy state application. It seems that the motivation can be stronger with the following use-case. Currently for

Re: [DISCUSS] KIP-388 Add observer interface to record request and response

2018-11-17 Thread Dong Lin
Hey Lincong, The main concern for the original version of the KIP is that, if we expose internal classes such as RequestChannel.Request and AbstractResponse, it will be difficult to make change to those internal classes in the future. In the latest version of the KIP, it seems that user is going

Re: [VOTE] 2.1.0 RC1

2018-11-16 Thread Dong Lin
ky. > > Guozhang > > On Fri, Nov 9, 2018 at 3:33 PM Dong Lin wrote: > > > Hello Kafka users, developers and client-developers, > > > > This is the second candidate for feature release of Apache Kafka 2.1.0. > > > > This is a major version release of

[jira] [Created] (KAFKA-7651) Flaky test SaslSslAdminClientIntegrationTest.testMinimumRequestTimeouts

2018-11-16 Thread Dong Lin (JIRA)
Dong Lin created KAFKA-7651: --- Summary: Flaky test SaslSslAdminClientIntegrationTest.testMinimumRequestTimeouts Key: KAFKA-7651 URL: https://issues.apache.org/jira/browse/KAFKA-7651 Project: Kafka

[jira] [Created] (KAFKA-7649) Flaky test SslEndToEndAuthorizationTest.testNoProduceWithDescribeAcl

2018-11-16 Thread Dong Lin (JIRA)
Dong Lin created KAFKA-7649: --- Summary: Flaky test SslEndToEndAuthorizationTest.testNoProduceWithDescribeAcl Key: KAFKA-7649 URL: https://issues.apache.org/jira/browse/KAFKA-7649 Project: Kafka

[jira] [Created] (KAFKA-7648) Flaky test DeleteTopicsRequestTest.testValidDeleteTopicRequests

2018-11-16 Thread Dong Lin (JIRA)
Dong Lin created KAFKA-7648: --- Summary: Flaky test DeleteTopicsRequestTest.testValidDeleteTopicRequests Key: KAFKA-7648 URL: https://issues.apache.org/jira/browse/KAFKA-7648 Project: Kafka Issue

[jira] [Created] (KAFKA-7647) Flaky test LogCleanerParameterizedIntegrationTest.testCleansCombinedCompactAndDeleteTopic

2018-11-16 Thread Dong Lin (JIRA)
Dong Lin created KAFKA-7647: --- Summary: Flaky test LogCleanerParameterizedIntegrationTest.testCleansCombinedCompactAndDeleteTopic Key: KAFKA-7647 URL: https://issues.apache.org/jira/browse/KAFKA-7647

[jira] [Created] (KAFKA-7646) Flaky test SaslOAuthBearerSslEndToEndAuthorizationTest.testNoConsumeWithDescribeAclViaSubscribe

2018-11-16 Thread Dong Lin (JIRA)
Dong Lin created KAFKA-7646: --- Summary: Flaky test SaslOAuthBearerSslEndToEndAuthorizationTest.testNoConsumeWithDescribeAclViaSubscribe Key: KAFKA-7646 URL: https://issues.apache.org/jira/browse/KAFKA-7646

[jira] [Created] (KAFKA-7645) Fix flaky unit test for 2.1 branch

2018-11-16 Thread Dong Lin (JIRA)
Dong Lin created KAFKA-7645: --- Summary: Fix flaky unit test for 2.1 branch Key: KAFKA-7645 URL: https://issues.apache.org/jira/browse/KAFKA-7645 Project: Kafka Issue Type: Task Reporter

Re: [DISCUSS] KIP-380: Detect outdated control requests and bounced brokers using broker generation

2018-11-12 Thread Dong Lin
gt; So > > > > > > basically both of the BrokerChange event processing become no-op. > > > > > > > > > > > > > > > > > > Hope that I answer your questions. Feel free to follow up if I am > > &g

Re: [VOTE] KIP-354 Time-based log compaction policy

2018-11-09 Thread Dong Lin
Thanks for the KIP Xiongqi. LGTM. +1 (binding) One minor comment: it may be a bit better to clarify in the public interface section that the value of the newly added metric is determined based by applying that formula across all compactable segments. For example: The maximum value of

Re: [VOTE] 2.1.0 RC0

2018-11-09 Thread Dong Lin
Hey Mani, Thanks again for catching this. The issue has been fixed and the configs are properly displayed in http://kafka.apache.org/20/documentation.html#producerconfigs now. Thanks, Dong On Fri, Nov 9, 2018 at 3:53 PM Dong Lin wrote: > Hey Mani, > > Thanks for catching these! Si

Re: [VOTE] 2.1.0 RC0

2018-11-09 Thread Dong Lin
t; > On Wed, Oct 24, 2018 at 3:48 AM Andras Beni > .invalid> > > wrote: > > > > > +1 (non-binding) > > > > > > Verified signatures and checksums of release artifacts > > > Performed quickstart steps on rc artifacts (both scala 2.11 and 2.12) >

Re: [VOTE] 2.1.0 RC0

2018-11-09 Thread Dong Lin
h > > > > rerun. > > > > > > > > On Wed, Oct 24, 2018 at 3:48 AM Andras Beni > > > .invalid> > > > > wrote: > > > > > > > > > +1 (non-binding) > > > > > > > > > > Verified signatures and ch

Re: [VOTE] 2.1.0 RC0

2018-11-09 Thread Dong Lin
for RC1 when you get time. Hopefully we can officially release Apache Kafka 2.1.0 next week. Cheers, Dong On Tue, Nov 6, 2018 at 11:28 AM Dong Lin wrote: > Hey Satish, > > Yes! We will have another RC to include e.g. > https://github.com/apache/kafka/pull/5857. > > Thanks, > D

[VOTE] 2.1.0 RC1

2018-11-09 Thread Dong Lin
Hello Kafka users, developers and client-developers, This is the second candidate for feature release of Apache Kafka 2.1.0. This is a major version release of Apache Kafka. It includes 28 new KIPs and critical bug fixes. Please see the Kafka 2.1.0 release plan for more details:

Re: [VOTE] KIP-386: Standardize on Min/Avg/Max metrics' default values

2018-11-08 Thread Dong Lin
Thanks for the KIP Stanislav. +1 (binding) On Thu, Nov 8, 2018 at 2:40 PM Jun Rao wrote: > Hi, Stanislav, > > Thanks for the KIP. +1. I guess this only covers the Kafka metrics (not the > Yammer metrics). It would be useful to make this clear. > > Jun > > On Tue, Nov 6, 2018 at 1:00 AM,

[jira] [Resolved] (KAFKA-6262) KIP-232: Detect outdated metadata by adding ControllerMetadataEpoch field

2018-11-07 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin resolved KAFKA-6262. - Resolution: Duplicate The design in this Jira has been moved to KIP-320. > KIP-232: Detect outda

[jira] [Created] (KAFKA-7603) Producer should negotiate message format version with broker

2018-11-07 Thread Dong Lin (JIRA)
Dong Lin created KAFKA-7603: --- Summary: Producer should negotiate message format version with broker Key: KAFKA-7603 URL: https://issues.apache.org/jira/browse/KAFKA-7603 Project: Kafka Issue Type

Re: [DISCUSS] KIP-354 Time-based log compaction policy

2018-11-06 Thread Dong Lin
gt; Hi Dong, > > > > Thank you for your comment. See my inline comments. > > I will update the KIP shortly. > > > > Xiongqi (Wesley) Wu > > > > > > On Sun, Oct 28, 2018 at 9:17 PM Dong Lin wrote: > > > >> Hey Xiongqi, > >> > &g

[jira] [Resolved] (KAFKA-7313) StopReplicaRequest should attempt to remove future replica for the partition only if future replica exists

2018-11-06 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin resolved KAFKA-7313. - Resolution: Fixed > StopReplicaRequest should attempt to remove future replica for the partition >

[jira] [Reopened] (KAFKA-7481) Consider options for safer upgrade of offset commit value schema

2018-11-06 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin reopened KAFKA-7481: - > Consider options for safer upgrade of offset commit value sch

[jira] [Resolved] (KAFKA-7481) Consider options for safer upgrade of offset commit value schema

2018-11-06 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin resolved KAFKA-7481. - Resolution: Fixed > Consider options for safer upgrade of offset commit value sch

[jira] [Resolved] (KAFKA-7559) ConnectStandaloneFileTest system tests do not pass

2018-11-06 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin resolved KAFKA-7559. - Resolution: Fixed > ConnectStandaloneFileTest system tests do not p

Re: [VOTE] 2.1.0 RC0

2018-11-06 Thread Dong Lin
pull/5857 ? > > Thanks, > Satish. > On Thu, Nov 1, 2018 at 4:05 PM Jakub Scholz wrote: > > > > +1 (non-binding) ... I used the staged binaries and checked it with > > different clients. > > > > On Wed, Oct 24, 2018 at 10:17 AM Dong Lin wrote: > >

Re: [DISCUSS] KIP-370: Remove Orphan Partitions

2018-10-28 Thread Dong Lin
Hey Xiongqi, Thanks for the KIP. Here are some comments: 1) KIP provides two motivation for the timeout/correction phase. One motivation is to handle outdated requests. Would this still be an issue after KIP-380? The second motivation seems to be mainly for performance optimization when there is

Re: [VOTE] KIP-380: Detect outdated control requests and bounced brokers using broker generation

2018-10-28 Thread Dong Lin
; > Thanks, > > Jun > > > On Sun, Oct 21, 2018 at 2:25 PM, Mickael Maison > wrote: > > > +1( non-binding) > > Thanks for the KIP! > > > > On Sun, Oct 21, 2018, 03:31 Harsha Chintalapani wrote: > > > > > +1(binding). LGTM. > >

Re: [DISCUSS] KIP-354 Time-based log compaction policy

2018-10-28 Thread Dong Lin
gt; delete > > > > > > >> within a > > > > > > >> maximum time. > > > > > > >> > > > > > > >> One popular reason that maximum time for deletion is desirable > > > right > > > >

[VOTE] 2.1.0 RC0

2018-10-24 Thread Dong Lin
Hello Kafka users, developers and client-developers, This is the first candidate for feature release of Apache Kafka 2.1.0. This is a major version release of Apache Kafka. It includes 28 new KIPs and critical bug fixes. Please see the Kafka 2.1.0 release plan for more details:

Re: [VOTE] KIP-380: Detect outdated control requests and bounced brokers using broker generation

2018-10-20 Thread Dong Lin
Thanks much for the KIP Patrick. Looks pretty good. +1 (binding) On Fri, Oct 19, 2018 at 10:17 AM Patrick Huang wrote: > Hi All, > > I would like to call for a vote on KIP-380: > >

[jira] [Resolved] (KAFKA-7464) Fail to shutdown ReplicaManager during broker cleaned shutdown

2018-10-18 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin resolved KAFKA-7464. - Resolution: Fixed > Fail to shutdown ReplicaManager during broker cleaned shutd

Re: [DISCUSS] Apache Kafka 2.1.0 Release Plan

2018-10-16 Thread Dong Lin
Hey everyone, Thanks for all the contribution! Just a kind reminder that the code is now frozen for 2.1.0 release. Thanks, Dong On Mon, Oct 1, 2018 at 4:31 PM Dong Lin wrote: > Hey everyone, > > Hope things are going well! > > Just a kind reminder that the feature freeze tim

Re: [ANNOUNCE] New Committer: Manikumar Reddy

2018-10-11 Thread Dong Lin
Congratulations Manikumar!! On Thu, Oct 11, 2018 at 10:39 AM Jason Gustafson wrote: > Hi all, > > The PMC for Apache Kafka has invited Manikumar Reddy as a committer and we > are > pleased to announce that he has accepted! > > Manikumar has contributed 134 commits including significant work to

Re: [DISCUSS] KIP-380: Detect outdated control requests and bounced brokers using broker generation

2018-10-10 Thread Dong Lin
Hey Patrick, Thanks much for the KIP. The KIP is very well written. LGTM. +1 (binding) Thanks, Dong On Tue, Oct 9, 2018 at 11:46 PM Patrick Huang wrote: > Hi All, > > Please find the below KIP which proposes the concept of broker generation > to resolve issues caused by controller missing

Re: [VOTE] KIP-291: Have separate queues for control requests and data requests

2018-10-09 Thread Dong Lin
Hey Lucas, Thanks for the KIP. Looks good overall. +1 I have two trivial comments which may be a bit useful to reader. - Can we include the default value for the new config in Public Interface section? Typically the default value of the new config is an important part of public interface and we

[jira] [Created] (KAFKA-7484) Fix test SuppressionDurabilityIntegrationTest.shouldRecoverBufferAfterShutdown()

2018-10-05 Thread Dong Lin (JIRA)
Dong Lin created KAFKA-7484: --- Summary: Fix test SuppressionDurabilityIntegrationTest.shouldRecoverBufferAfterShutdown() Key: KAFKA-7484 URL: https://issues.apache.org/jira/browse/KAFKA-7484 Project: Kafka

New release branch 2.1.0

2018-10-04 Thread Dong Lin
Hello Kafka developers and users, As promised in the release plan https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=91554044, we now have a release branch for 2.1.0 release. Trunk will soon be bumped to 2.2.0-SNAPSHOT. I'll be going over the JIRAs to move every non-blocker from

[jira] [Resolved] (KAFKA-7441) Allow LogCleanerManager.resumeCleaning() to be used concurrently

2018-10-04 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin resolved KAFKA-7441. - Resolution: Fixed > Allow LogCleanerManager.resumeCleaning() to be used concurren

[jira] [Resolved] (KAFKA-7096) Consumer should drop the data for unassigned topic partitions

2018-10-03 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin resolved KAFKA-7096. - Resolution: Fixed > Consumer should drop the data for unassigned topic partiti

[jira] [Resolved] (KAFKA-6045) All access to log should fail if log is closed

2018-10-03 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin resolved KAFKA-6045. - Resolution: Won't Fix > All access to log should fail if log is clo

[jira] [Resolved] (KAFKA-5950) AdminClient should retry based on returned error codes

2018-10-03 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin resolved KAFKA-5950. - Resolution: Fixed Per comment in the PR, it appears that the issue has been addressed in KAFKA-6299

[jira] [Resolved] (KAFKA-5857) Excessive heap usage on controller node during reassignment

2018-10-03 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin resolved KAFKA-5857. - Resolution: Cannot Reproduce In general we need heapdump to investigate the issue. Since we don't have

[jira] [Resolved] (KAFKA-5018) LogCleaner tests to verify behaviour of message format v2

2018-10-02 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin resolved KAFKA-5018. - Resolution: Won't Do > LogCleaner tests to verify behaviour of message format

[jira] [Reopened] (KAFKA-5018) LogCleaner tests to verify behaviour of message format v2

2018-10-02 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin reopened KAFKA-5018: - > LogCleaner tests to verify behaviour of message format

[jira] [Resolved] (KAFKA-6761) Reduce Kafka Streams Footprint

2018-10-02 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin resolved KAFKA-6761. - Resolution: Fixed > Reduce Kafka Streams Footpr

[jira] [Resolved] (KAFKA-6438) NSEE while concurrently creating and deleting a topic

2018-10-02 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin resolved KAFKA-6438. - Resolution: Won't Fix > NSEE while concurrently creating and deleting a to

[jira] [Resolved] (KAFKA-6415) KafkaLog4jAppender deadlocks when logging from producer network thread

2018-10-02 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin resolved KAFKA-6415. - Resolution: Fixed > KafkaLog4jAppender deadlocks when logging from producer network thr

[jira] [Resolved] (KAFKA-7406) Naming Join and Grouping Repartition Topics

2018-10-02 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin resolved KAFKA-7406. - Resolution: Fixed > Naming Join and Grouping Repartition Top

Re: [DISCUSS] Apache Kafka 2.1.0 Release Plan

2018-10-01 Thread Dong Lin
. Cheers, Dong On Wed, 26 Sep 2018 at 1:06 AM Dong Lin wrote: > Hey Edoardo, > > Certainly, let's add it to this release since it has passed vote. KIP-81 > was previously marked as WIP for 2.0.0 release. I updated to be WIP for > 2.1.0 release in > https://cwiki.apache.org/conflu

[jira] [Reopened] (KAFKA-4218) Enable access to key in ValueTransformer

2018-10-01 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin reopened KAFKA-4218: - Thanks for working on this [~jeyhunkarimov]! For KIP-149, currently there are 4 PRs: - [https://github.com

Re: [VOTE] KIP-232: Detect outdated metadata using leaderEpoch and partitionEpoch

2018-09-30 Thread Dong Lin
KIP-320 was accepted. Thus, I am wondering what the status > of this KIP is? > > -Matthias > > On 7/11/18 10:59 AM, Dong Lin wrote: > > Hey Jun, > > > > Certainly. We can discuss later after KIP-320 settles. > > > > Thanks! > > Dong > > > >

[jira] [Created] (KAFKA-7441) Allow LogCleanerManager.resumeCleaning() to be used concurrently

2018-09-25 Thread Dong Lin (JIRA)
Dong Lin created KAFKA-7441: --- Summary: Allow LogCleanerManager.resumeCleaning() to be used concurrently Key: KAFKA-7441 URL: https://issues.apache.org/jira/browse/KAFKA-7441 Project: Kafka Issue

Re: [DISCUSS] KIP-232: Detect outdated metadata by adding ControllerMetadataEpoch field

2018-09-25 Thread Dong Lin
For record purpose, this KIP is closed as its design has been merged into KIP-320. See https://cwiki.apache.org/confluence/display/KAFKA/KIP-320%3A+Allow+fetchers+to+detect+and+handle+log+truncation . On Wed, Jan 31, 2018 at 12:16 AM Dong Lin wrote: > Hey Jun, Jason, > > Thank

Re: [VOTE] KIP-232: Detect outdated metadata using leaderEpoch and partitionEpoch

2018-09-25 Thread Dong Lin
For record purpose, this KIP is closed as its design has been merged into KIP-320. See https://cwiki.apache.org/confluence/display/KAFKA/KIP-320%3A+Allow+fetchers+to+detect+and+handle+log+truncation .

Re: [DISCUSS] Apache Kafka 2.1.0 Release Plan

2018-09-25 Thread Dong Lin
amend the wiki ? > -- > Edoardo Comar > IBM Event Streams > IBM UK Ltd, Hursley Park, SO21 2JN > > > > > From:Dong Lin > To:dev , Users , > kafka-clients > Date:25/09/2018 08:17 > Subject

Re: [ANNOUNCE] New committer: Colin McCabe

2018-09-25 Thread Dong Lin
Congratulations Colin!! Very well deserved! On Tue, Sep 25, 2018 at 1:39 AM Ismael Juma wrote: > Hi all, > > The PMC for Apache Kafka has invited Colin McCabe as a committer and we are > pleased to announce that he has accepted! > > Colin has contributed 101 commits and 8 KIPs including

Re: [DISCUSS] Apache Kafka 2.1.0 Release Plan

2018-09-25 Thread Dong Lin
to the next release after Oct 1. Regards, Dong On Tue, Sep 25, 2018 at 12:02 AM Dong Lin wrote: > cc us...@kafka.apache.org and kafka-clie...@googlegroups.com > > On Sun, Sep 9, 2018 at 5:31 PM Dong Lin wrote: > >> Hi all, >> >> I would like to be the release manager f

Re: [DISCUSS] Apache Kafka 2.1.0 Release Plan

2018-09-25 Thread Dong Lin
cc us...@kafka.apache.org and kafka-clie...@googlegroups.com On Sun, Sep 9, 2018 at 5:31 PM Dong Lin wrote: > Hi all, > > I would like to be the release manager for our next time-based feature > release 2.1.0. > > The recent Kafka release history can be found at > htt

[jira] [Resolved] (KAFKA-7332) Improve error message when trying to produce message without key for compacted topic

2018-09-18 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin resolved KAFKA-7332. - Resolution: Fixed > Improve error message when trying to produce message without key for > com

[jira] [Resolved] (KAFKA-7322) Fix race condition between log cleaner thread and log retention thread when topic cleanup policy is updated

2018-09-18 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin resolved KAFKA-7322. - Resolution: Fixed > Fix race condition between log cleaner thread and log retention thread when >

Re: [VOTE] KIP-110: Add Codec for ZStandard Compression

2018-09-17 Thread Dong Lin
Hey Dongjin, The KIP passes vote after having 3 binding +1 votes and more binding +1 votes than -1 votes. So it is not necessary to have more vote for this KIP. Thanks, Dong On Mon, Sep 17, 2018 at 5:37 PM, Dongjin Lee wrote: > @Ismael > > +3 (binding), +3 (non-binding) until now. Do we need

[jira] [Resolved] (KAFKA-5690) kafka-acls command should be able to list per principal

2018-09-17 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin resolved KAFKA-5690. - Resolution: Fixed > kafka-acls command should be able to list per princi

Re: [DISCUSS] Apache Kafka 2.1.0 Release Plan

2018-09-17 Thread Dong Lin
release! > > > > > > On Sun, Sep 9, 2018 at 5:57 PM, Ismael Juma wrote: > > > > > >> Thanks for volunteering Dong! > > >> > > >> Ismael > > >> > > >> On Sun, 9 Sep 2018, 17:32 Dong Lin, wrote: > > >> &

Re: [VOTE] KIP-357: Add support to list ACLs per principal

2018-09-16 Thread Dong Lin
Thanks for the KIP Manikumar. The feature makes sense. +1 (binding) On Mon, Sep 10, 2018 at 7:07 AM, Manikumar wrote: > Bump! > > On Tue, Sep 4, 2018 at 11:58 PM Adam Bellemare > wrote: > > > +1 (non binding) - would really like to see this one. > > > > On Mon, Sep 3, 2018 at 12:18 PM,

[jira] [Reopened] (KAFKA-5690) kafka-acls command should be able to list per principal

2018-09-16 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin reopened KAFKA-5690: - > kafka-acls command should be able to list per princi

[jira] [Resolved] (KAFKA-5690) kafka-acls command should be able to list per principal

2018-09-16 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin resolved KAFKA-5690. - Resolution: Fixed > kafka-acls command should be able to list per princi

[DISCUSS] Apache Kafka 2.1.0 Release Plan

2018-09-09 Thread Dong Lin
Hi all, I would like to be the release manager for our next time-based feature release 2.1.0. The recent Kafka release history can be found at https://cwiki.apache.org/confluence/display/KAFKA/Future+release+plan. The release plan (with open issues and planned KIPs) for 2.1.0 can be found at

[jira] [Resolved] (KAFKA-7333) Protocol changes for KIP-320

2018-09-09 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin resolved KAFKA-7333. - Resolution: Fixed > Protocol changes for KIP-320 > > >

[jira] [Resolved] (KAFKA-6082) consider fencing zookeeper updates with controller epoch zkVersion

2018-09-07 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin resolved KAFKA-6082. - Resolution: Fixed > consider fencing zookeeper updates with controller epoch zkVers

[jira] [Resolved] (KAFKA-7211) MM should handle timeouts in commitSync

2018-09-04 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin resolved KAFKA-7211. - Resolution: Fixed > MM should handle timeouts in commitS

Re: [VOTE] KIP-359: Verify leader epoch in produce requests

2018-08-30 Thread Dong Lin
Thanks for the KIP! +1 (binding) On Thu, Aug 30, 2018 at 3:56 PM, Jason Gustafson wrote: > Hi All, > > I'd like to start the vote on KIP-359: https://cwiki.apache.org/ > confluence/display/KAFKA/KIP-359%3A+Verify+leader+epoch+in+ > produce+requests. > Thanks in advance for reviewing. > >

[jira] [Reopened] (KAFKA-7295) Fix RequestHandlerAvgIdlePercent metric calculation

2018-08-29 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin reopened KAFKA-7295: - > Fix RequestHandlerAvgIdlePercent metric calculat

[jira] [Resolved] (KAFKA-7295) Fix RequestHandlerAvgIdlePercent metric calculation

2018-08-29 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin resolved KAFKA-7295. - Resolution: Fixed The issue is mitigated in https://issues.apache.org/jira/browse/KAFKA-7354 >

[jira] [Resolved] (KAFKA-7354) Fix IdlePercent and NetworkProcessorAvgIdlePercent metric calculation

2018-08-29 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin resolved KAFKA-7354. - Resolution: Fixed > Fix IdlePercent and NetworkProcessorAvgIdlePercent metric calculat

  1   2   3   4   5   6   7   8   9   10   >