Re: [kafka-clients] [VOTE] 1.1.1 RC2

Hi Dong, it seems that the kafka-streams-quickstart artifacts are missing. Is it just me or is the RC incomplete? -Matthias On 6/29/18 4:07 PM, Rajini Sivaram wrote: > Hi Dong, > > +1 (binding) > > Verified binary using quick start, ran tests from source, checked > release notes. > >

[VOTE] 1.0.2 RC1

Hello Kafka users, developers and client-developers, This is the second candidate for release of Apache Kafka 1.0.2. This is a bug fix release addressing 27 tickets: https://cwiki.apache.org/confluence/display/KAFKA/Release+Plan+1.0.2 Release notes for the 1.0.2 release:

Re: [VOTE] KIP-291: Have separate queues for control requests and data requests

bq. which is hard coded to be 300 milliseconds Have you considered making the duration configurable ? The comparison at the end of your email seems to be copied where tabular form is lost. Do you mind posting that part again ? Thanks On Fri, Jun 29, 2018 at 4:53 PM, Lucas Wang wrote: > Hi

Re: [VOTE] KIP-291: Have separate queues for control requests and data requests

Hi Jun, Thanks for your comments. 1. I just replied in the discussion thread about the positive change this KIP can still bring if implemented on the latest trunk, which includes the async ZK operations for KAFKA-5642. The evaluation is done using an integration test. In production, we have not

Re: [kafka-clients] [VOTE] 0.11.0.3 RC0

Hi Matthias, +1 (binding) Verified binary using quick start, verified source by building and running tests, checked release notes. Thanks for running the release! Regards, Rajini On Fri, Jun 29, 2018 at 11:07 PM, Jun Rao wrote: > Hi, Matthias, > > Thanks for running the release. Verified

Re: [DISCUSS] KIP-326: Schedulable KTable as Graph source

Repasting my comment from the other email thread: -- Flávio, thanks for creating this KIP. I think this "single-aggregation" use case is common enough that we should consider how to efficiently supports it: for example, for KSQL that's built on top of Streams, we've seen

Re: [VOTE] KIP-280: Enhanced log compaction

Hi Luis, Regarding the minor suggest, I agree it would be better to make it as mandatory, but it might be a bit tricky because it is a conditional mandatory one depending on the other config's value. Would like to see your updated PR. Regarding the KIP itself, both Matthias and myself can recast

Re: [kafka-clients] [VOTE] 1.1.1 RC2

Hi Dong, +1 (binding) Verified binary using quick start, ran tests from source, checked release notes. Thanks for running the release! Regards, Rajini On Fri, Jun 29, 2018 at 11:11 PM, Jun Rao wrote: > Hi, Dong, > > Thanks for running the release. Verified quickstart on scala 2.12 binary.

Build failed in Jenkins: kafka-trunk-jdk8 #2784

See Changes: [wangguoz] KAFKA-6986: Export Admin Client metrics through Stream Threads (#5210) [jason] HOTFIX: KAFKA-7097; Set create time default to -1L in VerifiableProducer

[jira] [Created] (KAFKA-7122) Data is lost when ZooKeeper times out

Nick Lipple created KAFKA-7122: -- Summary: Data is lost when ZooKeeper times out Key: KAFKA-7122 URL: https://issues.apache.org/jira/browse/KAFKA-7122 Project: Kafka Issue Type: Bug

Re: [kafka-clients] [VOTE] 1.1.1 RC2

Hi, Dong, Thanks for running the release. Verified quickstart on scala 2.12 binary. +1 Jun On Thu, Jun 28, 2018 at 6:12 PM, Dong Lin wrote: > Hello Kafka users, developers and client-developers, > > This is the second candidate for release of Apache Kafka 1.1.1. > > Apache Kafka 1.1.1 is a

Re: [kafka-clients] [VOTE] 0.11.0.3 RC0

Hi, Matthias, Thanks for running the release. Verified quickstart on scala 2.12 binary. +1 Jun On Fri, Jun 22, 2018 at 3:14 PM, Matthias J. Sax wrote: > Hello Kafka users, developers and client-developers, > > This is the first candidate for release of Apache Kafka 0.11.0.3. > > This is a bug

Re: [DISCUSS] KIP-291: Have separate queues for control requests and data requests

Hi Eno, Sorry for the delay in getting the experiment results. Here is a link to the positive impact achieved by implementing the proposed change: https://docs.google.com/document/d/1ge2jjp5aPTBber6zaIT9AdhWFWUENJ3JO6Zyu4f9tgQ/edit?usp=sharing Please take a look when you have time and let me know

Re: [kafka-clients] [VOTE] 0.10.2.2 RC1

Hi, Matthias, Thanks for running the release. Verified quickstart on scala 2.12 binary. +1 Jun On Fri, Jun 22, 2018 at 6:43 PM, Matthias J. Sax wrote: > Hello Kafka users, developers and client-developers, > > This is the second candidate for release of Apache Kafka 0.10.2.2. > > Note, that

Re: [VOTE] 1.0.2 RC0

Thanks for pointing out Jason. I double checked and there was a bug in the release script. The artifact were not built. I'll roll a new RC. -Matthias On 6/29/18 2:01 PM, Jason Gustafson wrote: > Hey Matthias, > > I don't see the artifacts for scala 2.12. Did they not get uploaded? > >

Re: [DISCUSS] KIP-328: Ability to suppress updates for KTables

Thanks for the explanation, that does make sense. I have some questions on operations, but I'll just wait for the PR and tests. Thanks, Bill On Wed, Jun 27, 2018 at 8:14 PM John Roesler wrote: > Hi Bill, > > Thanks for the review! > > Your question is very much applicable to the KIP and not

[jira] [Created] (KAFKA-7121) Intermittently, Connectors fail to assign tasks and keep retrying every second forever.

Gwen Shapira created KAFKA-7121: --- Summary: Intermittently, Connectors fail to assign tasks and keep retrying every second forever. Key: KAFKA-7121 URL: https://issues.apache.org/jira/browse/KAFKA-7121

Re: [VOTE] 1.0.2 RC0

Hey Matthias, I don't see the artifacts for scala 2.12. Did they not get uploaded? Thanks, Jason On Fri, Jun 29, 2018 at 12:41 PM, Guozhang Wang wrote: > +1 (binding), checked release note, java doc, and ran unit tests on source > tgz. > > > Guozhang > > On Mon, Jun 25, 2018 at 8:05 PM

Re: [VOTE] 0.10.2.2 RC1

+1 Ran test suite. Checked signatures. On Fri, Jun 29, 2018 at 10:21 AM, Jason Gustafson wrote: > +1 (binding). I checked release notes, documentation, and went through the > quickstart. > > Thanks Matthias! > > On Fri, Jun 22, 2018 at 6:43 PM, Matthias J. Sax > wrote: > > > Hello Kafka

[jira] [Resolved] (KAFKA-6986) Export Admin Client metrics through Stream Threads

[ https://issues.apache.org/jira/browse/KAFKA-6986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-6986. -- Resolution: Fixed Fix Version/s: 2.1.0 > Export Admin Client metrics through Stream

Re: [VOTE] KIP-330: Add retentionPeriod in SessionBytesStoreSupplier

Thx. That makes sense. Just want to make sure the KIP clearly covers it. +1 (binding) I am only +1 because I think that there are no users customizing a session store supplier. This KIP goes into 2.1 what is a minor release that should not contain any breaking changes. We need to be careful

Re: [VOTE] KIP-324: Add method to get metrics() in AdminClient

Sure, now we have 5 binding +1 votes and 2 non-biding +1 votes. Since we have more than three binding votes and no -1 votes, I guess KIP-324 is accepted? If so, I will then update the PR and the wiki. P.S. Guozhang, is this still needs to be worked on?

Re: [VOTE] KIP-330: Add retentionPeriod in SessionBytesStoreSupplier

Thanks Matthias, thanks for the comments! Ack on all of them and have updated the wiki: https://cwiki.apache.org/confluence/display/KAFKA/KIP-330:+Add+retentionPeriod+in+SessionBytesStoreSupplier Regarding the impact of this KIP, here's what I'm thinking: 1. For users of DSL, with customized

[jira] [Created] (KAFKA-7120) When Connect throws CONFLICT error for REST requests, it will help to see more details

Gwen Shapira created KAFKA-7120: --- Summary: When Connect throws CONFLICT error for REST requests, it will help to see more details Key: KAFKA-7120 URL: https://issues.apache.org/jira/browse/KAFKA-7120

Re: [DISCUSS] KIP-326: Schedulable KTable as Graph source

Hi Flávio, Thanks for creating the KIP. I agree with Guozhang on comparing the pros and cons of the approach he outlined vs the one in the proposed KIP. I also have a few clarification questions on the current KIP Will the triggering mechanism always be time, or would it make sense to expand

Re: [VOTE] KIP-324: Add method to get metrics() in AdminClient

Yes, please feel free to conclude this thread with a tally. Guozhang On Fri, Jun 29, 2018 at 11:53 AM Yishun Guan wrote: > Hi All, > > Since it has been 72 hrs. Should we go ahead and accept this KIP? Thanks. > > Best > Yishun > > On Wed, Jun 27, 2018, 4:14 PM Yishun Guan wrote: > > > I see!

Re: [VOTE] 1.0.2 RC0

+1 (binding), checked release note, java doc, and ran unit tests on source tgz. Guozhang On Mon, Jun 25, 2018 at 8:05 PM Manikumar wrote: > +1 (non-binding) Verified tests, quick start, producer/consumer perf tests. > > On Sat, Jun 23, 2018 at 2:25 AM Ted Yu wrote: > > > +1 > > > > Ran test

Re: [VOTE] KIP-324: Add method to get metrics() in AdminClient

Hi All, Since it has been 72 hrs. Should we go ahead and accept this KIP? Thanks. Best Yishun On Wed, Jun 27, 2018, 4:14 PM Yishun Guan wrote: > I see! Thanks. -Yishun > > On Wed, Jun 27, 2018, 4:10 PM Guozhang Wang wrote: > >> Hi Yishun, >> >> We need to wait at least 72 business hours with

Kafka cannot connect to broker

Hey Everyone, I have been experiencing some problems and have not been able to find sufficient documentation online to help me figure out the root cuase. I have a 3 node kafka cluster set up on 3 different Windows 2012 servers. The cluster runs perfectly fine, ingesting data that is being sent

RE: [VOTE] 0.10.2.2 RC1

Sorry everyone, I meant to change the subject of this email but forgot to before I sent it. I did not mean to hijack this thread. I apologize for the interruption. -Steve -Original Message- From: Coluccio, Stephen Sent: Friday, June 29, 2018 2:05 PM To: Kafka Users Cc: dev ;

Re: [VOTE] 0.10.2.2 RC1

+1 (binding). Verified java docs, and ran the unit tests with the source tgz. Guozhang On Fri, Jun 29, 2018 at 10:22 AM Jason Gustafson wrote: > +1 (binding). I checked release notes, documentation, and went through the > quickstart. > > Thanks Matthias! > > On Fri, Jun 22, 2018 at 6:43 PM,

[VOTE] 2.0.0 RC1

Hello Kafka users, developers and client-developers, This is the second candidate for release of Apache Kafka 2.0.0. This is a major version release of Apache Kafka. It includes 40 new KIPs and several critical bug fixes. Please see the 2.0.0 release plan for more details:

RE: [VOTE] 0.10.2.2 RC1

Hey Everyone, I have been experiencing some problems and have not been able to find sufficient documentation online to help me figure out the root cuase. I have a 3 node kafka cluster set up on 3 different Windows 2012 servers. The cluster runs perfectly fine, ingesting data that is being sent

Re: [VOTE] KIP-291: Have separate queues for control requests and data requests

Hi, Lucas, Thanks for the KIP. A few comments below. 1. As Eno mentioned in the discussion thread, I am wondering how much of this is still an issue after KAFKA-5642. With that fix, the requests from the controller to the brokers are batched in all the common cases. Have you deployed Kafka 1.1?

Re: [DISCUSS] KIP-326: Schedulable KTable as Graph source

Flavio, thanks for cleaning up the KIP number collision. With regard to KIP-328 (https://cwiki.apache.org/confluence/display/KAFKA/KIP-328%3A+Ability+to+suppress+updates+for+KTables) I am wondering how both relate to each other? Any thoughts? -Matthias On 6/29/18 10:23 AM,

Re: [DISCUSS] KIP-320: Allow fetchers to detect and handle log truncation

Hey Dong, Thanks for the feedback. The first three points are easy: 1. Yes, we should be consistent. 2. Yes, I will add this. 3. Yes, I think we should document the changes to the committed offset schema. I meant to do this, but it slipped my mind. The latter questions are tougher. One option I

Build failed in Jenkins: kafka-0.10.2-jdk7 #221

See Changes: [jason] MINOR: Use kill_java_processes when killing ConsoleConsumer in system -- [...truncated 160.27 KB...] kafka.server.MetadataCacheTest >

Re: [VOTE] KIP-330: Add retentionPeriod in SessionBytesStoreSupplier

The KIP says: > In WindowBytesStoreSupplier, we will add: Should it be `SessionBytesStoreSupplier` ? What do you mean by > Users customizing the SessionBytesStoreSupplier should not implement this function. From my understanding, this is a breaking change for all users implementing a custom

Re: [DISCUSS] KIP-320: Allow fetchers to detect and handle log truncation

Regarding points 4) and 5) above, motivation for the alternative APIs is that, if we decide that leaderEpoch is equally important as offset in identifying a message, then it may be reasonable to always specify it wherever offset is currently required in the consumer API to identify a message, e.g.

Build failed in Jenkins: kafka-1.1-jdk7 #158

See Changes: [jason] MINOR: Use kill_java_processes when killing ConsoleConsumer in system -- Started by an SCM change [EnvInject] - Loading node environment variables.

Re: Please, add me to the committers!

Daniele, thanks for your interest in working on Kafka! Being a committer has a very special meaning in the Apache world: - https://www.apache.org/dev/committers.html - https://cwiki.apache.org/confluence/display/KAFKA/Bylaws Thus, when you start to work on Kafka, you are a contributor. You

Re: [DISCUSS] KIP-320: Allow fetchers to detect and handle log truncation

Hey Jason, Thanks for the update. It looks pretty good. Just some minor comments below: 1) The KIP adds new error code "LOG_TRUNCATION" and new exception TruncatedPartitionException. Can we make the name more consistent, e.g. LogTruncationException? 2) Do we need to add

Re: [DISCUSS] KIP-323: Schedulable KTable as Graph source

Guozhang, Please go to https://lists.apache.org/thread.html/e93499c918df3a3985c6da8e0f240e286f7ba321b6e532705f994a59@%3Cdev.kafka.apache.org%3E so we can continue this thread. Someone else got this KIP number while I was registering it, so the actual number is KIP-326. I already copied your

Re: [DISCUSS] KIP-326: Schedulable KTable as Graph source

Just copying a follow up from another thread to here (sorry about the mess): From: Guozhang Wang Subject: Re: [DISCUSS] KIP-323: Schedulable KTable as Graph source Date: 2018/06/25 22:24:17 List: dev@kafka.apache.org Flávio, thanks for creating this KIP. I think this "single-aggregation" use

Build failed in Jenkins: kafka-0.11.0-jdk7 #386

See Changes: [jason] MINOR: Use kill_java_processes when killing ConsoleConsumer in system -- Started by an SCM change [EnvInject] - Loading node environment variables.

Re: [VOTE] 0.10.2.2 RC1

+1 (binding). I checked release notes, documentation, and went through the quickstart. Thanks Matthias! On Fri, Jun 22, 2018 at 6:43 PM, Matthias J. Sax wrote: > Hello Kafka users, developers and client-developers, > > This is the second candidate for release of Apache Kafka 0.10.2.2. > >

Re: [VOTE] KIP-312: Add Overloaded StreamsBuilder Build Method to Accept java.util.Properties

72 hours have passed, so I'm going to close out the vote. KIP-312 is accepted with the following votes: +1 (binding) Dongjin Lee, Damian Guy, Guozhang Wang, and Matthias J. Sax +1 (community) Ted Yu, Bill Bejeck -1 none Thanks to all for participating. -Bill On Wed, Jun 27, 2018 at 2:14 AM

Re: [VOTE] KIP-308: Support dynamic update of max.connections.per.ip/max.connections.per.ip.overrides configs

+1 Thanks Manikumar! On Fri, Jun 29, 2018 at 8:37 AM, Rajini Sivaram wrote: > +1 (binding) > > Thanks for the KIP, Manikumar! > > On Fri, Jun 29, 2018 at 4:23 PM, Dong Lin wrote: > > > +1 > > > > Thanks! > > > > On Fri, 29 Jun 2018 at 7:36 AM Ted Yu wrote: > > > > > +1 > > > > > > On Fri,

Re: [VOTE] KIP-308: Support dynamic update of max.connections.per.ip/max.connections.per.ip.overrides configs

+1 (binding) Thanks for the KIP, Manikumar! On Fri, Jun 29, 2018 at 4:23 PM, Dong Lin wrote: > +1 > > Thanks! > > On Fri, 29 Jun 2018 at 7:36 AM Ted Yu wrote: > > > +1 > > > > On Fri, Jun 29, 2018 at 7:29 AM, Manikumar > > wrote: > > > > > Hi All, > > > > > > I would like to start voting on

Re: [VOTE] KIP-308: Support dynamic update of max.connections.per.ip/max.connections.per.ip.overrides configs

+1 Thanks! On Fri, 29 Jun 2018 at 7:36 AM Ted Yu wrote: > +1 > > On Fri, Jun 29, 2018 at 7:29 AM, Manikumar > wrote: > > > Hi All, > > > > I would like to start voting on KIP-308 which would add support for > dynamic > > update of max.connections.per.ip/max.connections.per.ip.overrides

Re: [DISCUSS] KIP-323: Schedulable KTable as Graph source

Just to let you guys know, this KIP was actually registered under the number 326: https://cwiki.apache.org/confluence/display/KAFKA/KIP-326%3A+Schedulable+KTable+as+Graph+source On 2018/06/25 17:13:12, Flávio Stutz wrote: > Hey, guys, I've just started a KIP discussion here: > >

Re: [DISCUSS] KIP-326: Schedulable KTable as Graph source

Actually this was intended to be registered under the number 323, but someone else catch this number while the proposal was being edited. The correct number and URL of the KIP is: https://cwiki.apache.org/confluence/display/KAFKA/KIP-326%3A+Schedulable+KTable+as+Graph+source On 2018/06/26

Re: [VOTE] 2.0.0 RC0

I am rolling out another RC for 2.0 today since we had some critical fixes, most notably https://issues.apache.org/jira/browse/KAFKA-7104 and https://issues.apache.org/jira/browse/KAFKA-7112. Many thanks to everyone who tested and voted for RC0. Please help test RC1 which will be available later

[jira] [Resolved] (KAFKA-6268) Tools should now swallow exceptions like resolving network names

[ https://issues.apache.org/jira/browse/KAFKA-6268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram resolved KAFKA-6268. --- Resolution: Duplicate Fix Version/s: (was: 2.1.0) 2.0.0 Fixed

[jira] [Resolved] (KAFKA-7111) Review the NetworkClient log level used

[ https://issues.apache.org/jira/browse/KAFKA-7111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram resolved KAFKA-7111. --- Resolution: Fixed Reviewer: Rajini Sivaram Fix Version/s: 2.0.0 > Review the

Re: [VOTE] KIP-308: Support dynamic update of max.connections.per.ip/max.connections.per.ip.overrides configs

+1 On Fri, Jun 29, 2018 at 7:29 AM, Manikumar wrote: > Hi All, > > I would like to start voting on KIP-308 which would add support for dynamic > update of max.connections.per.ip/max.connections.per.ip.overrides configs > >

Please, add me to the committers!

Hello guys, I would be glad to help the project! Can I be added as commiter? Kind Regards, Daniele Ascione

[VOTE] KIP-308: Support dynamic update of max.connections.per.ip/max.connections.per.ip.overrides configs

Hi All, I would like to start voting on KIP-308 which would add support for dynamic update of max.connections.per.ip/max.connections.per.ip.overrides configs https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=85474993 Thanks,

[jira] [Resolved] (KAFKA-7112) StreamThread does not check for state again after pollRequests()

[ https://issues.apache.org/jira/browse/KAFKA-7112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram resolved KAFKA-7112. --- Resolution: Fixed Fix Version/s: 2.0.0 > StreamThread does not check for state again

[jira] [Created] (KAFKA-7119) Intermittent test failure with GSSAPI authentication failure

Rajini Sivaram created KAFKA-7119: - Summary: Intermittent test failure with GSSAPI authentication failure Key: KAFKA-7119 URL: https://issues.apache.org/jira/browse/KAFKA-7119 Project: Kafka

[jira] [Resolved] (KAFKA-7028) super.users doesn't work with custom principals

[ https://issues.apache.org/jira/browse/KAFKA-7028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram resolved KAFKA-7028. --- Resolution: Fixed Reviewer: Rajini Sivaram Fix Version/s: (was: 2.1.0)

[jira] [Resolved] (KAFKA-7115) InMemoryKeyValueLoggedStore does not flush the changelog

[ https://issues.apache.org/jira/browse/KAFKA-7115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hashan Gayasri Udugahapattuwa resolved KAFKA-7115. -- Resolution: Not A Problem This the expected behaviour >