[jira] [Created] (KAFKA-7118) Currently, it was discovered that KafkaConsumer's close() method might not be multi-thread safe when multiple cores are calling the same consumer.

2018-06-28 Thread Richard Yu (JIRA)
Richard Yu created KAFKA-7118: - Summary: Currently, it was discovered that KafkaConsumer's close() method might not be multi-thread safe when multiple cores are calling the same consumer. Key: KAFKA-7118 URL:

Re: [VOTE] 1.1.1 RC2

2018-06-28 Thread Ted Yu
+1 Ran test suite which passed. On Thu, Jun 28, 2018 at 6:12 PM, Dong Lin wrote: > Hello Kafka users, developers and client-developers, > > This is the second candidate for release of Apache Kafka 1.1.1. > > Apache Kafka 1.1.1 is a bug-fix release for the 1.1 branch that was first > released

Jenkins build is back to normal : kafka-trunk-jdk8 #2780

2018-06-28 Thread Apache Jenkins Server
See

Re: [VOTE] 1.1.1 RC1

2018-06-28 Thread Dong Lin
Thanks for catching this Odin! Now I check the release process again, I realized that I should have used release.py instead of doing every step manually. So a few steps were missed. Most notably the kafka_2.11-1.1.1.tgz generated for RC1 were compiled with Java 8 instead of Java 7. Thus a new

[VOTE] 1.1.1 RC2

2018-06-28 Thread Dong Lin
Hello Kafka users, developers and client-developers, This is the second candidate for release of Apache Kafka 1.1.1. Apache Kafka 1.1.1 is a bug-fix release for the 1.1 branch that was first released with 1.1.0 about 3 months ago. We have fixed about 25 issues since that release. A few of the

[jira] [Resolved] (KAFKA-6944) Add system tests testing the new throttling behavior using older clients/brokers

2018-06-28 Thread Jon Lee (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jon Lee resolved KAFKA-6944. Resolution: Fixed > Add system tests testing the new throttling behavior using older > clients/brokers >

[jira] [Resolved] (KAFKA-7097) VerifiableProducer does not work properly with --message-create-time argument

2018-06-28 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-7097. -- Resolution: Fixed Assignee: Ted Yu Reviewer: Guozhang Wang Fix

Re: [DISCUSS] KIP-325: Extend Consumer Group Command to Show Beginning Offsets

2018-06-28 Thread Jason Gustafson
Hey Gwen/Vahid, I think that use case makes sense, but isn't it a little odd to go through the consumer group tool? I would expect to find something like that from the kafka-topics tool instead. I don't feel too strongly about it, but I hate to complicate the tool by adding the need to query

Build failed in Jenkins: kafka-trunk-jdk8 #2779

2018-06-28 Thread Apache Jenkins Server
See Changes: [github] MINOR: KAFKA-7112: Only resume restoration if state is still -- [...truncated 867.19 KB...] kafka.zookeeper.ZooKeeperClientTest >

Re: [DISCUSS] KIP-325: Extend Consumer Group Command to Show Beginning Offsets

2018-06-28 Thread Vahid S Hashemian
Hi James, Thanks for the feedback. I updated the KIP and added some of the benefits of this improvement (including some that you mentioned). Regards. --Vahid From: James Cheng To: dev@kafka.apache.org Date: 06/27/2018 09:13 PM Subject:Re: [DISCUSS] KIP-325: Extend Consumer

[jira] [Created] (KAFKA-7117) Allow AclCommand to use AdminClient API

2018-06-28 Thread Manikumar (JIRA)
Manikumar created KAFKA-7117: Summary: Allow AclCommand to use AdminClient API Key: KAFKA-7117 URL: https://issues.apache.org/jira/browse/KAFKA-7117 Project: Kafka Issue Type: Improvement

Re: [VOTE] KIP-330: Add retentionPeriod in SessionBytesStoreSupplier

2018-06-28 Thread John Roesler
+1 On Thu, Jun 28, 2018 at 4:39 AM Damian Guy wrote: > +1 > > On Thu, 28 Jun 2018 at 02:16 Ted Yu wrote: > > > +1 > > > > On Wed, Jun 27, 2018 at 4:40 PM, Bill Bejeck wrote: > > > > > +1 > > > > > > -Bill > > > > > > On Wed, Jun 27, 2018 at 7:39 PM Guozhang Wang > > wrote: > > > > > > >

[jira] [Resolved] (KAFKA-7116) Provide separate SSL configs for Kafka Broker replication

2018-06-28 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sriharsha Chintalapani resolved KAFKA-7116. --- Resolution: Implemented Thanks [~ijuma] > Provide separate SSL configs for

[jira] [Created] (KAFKA-7116) Provide separate SSL configs for Kafka Broker replication

2018-06-28 Thread Sriharsha Chintalapani (JIRA)
Sriharsha Chintalapani created KAFKA-7116: - Summary: Provide separate SSL configs for Kafka Broker replication Key: KAFKA-7116 URL: https://issues.apache.org/jira/browse/KAFKA-7116 Project:

Re: [VOTE] KIP-313: Add KStream.flatTransform and KStream.flatTransformValues

2018-06-28 Thread Guozhang Wang
+1 (binding), thanks Bruno. Guozhang On Thu, Jun 28, 2018 at 3:02 AM, Damian Guy wrote: > +1 > > On Mon, 25 Jun 2018 at 02:16 Matthias J. Sax > wrote: > > > +1 (binding) > > > > > > -Matthias > > > > On 6/22/18 10:25 AM, Bill Bejeck wrote: > > > Thanks for the KIP, +1. > > > > > > -Bill > >

Re: Help with first contribution

2018-06-28 Thread Nikolay Izhikov
Hello, Matthias! > Did you filter for JIRAs with label "newbie" or "beginner"? "newbie" as it mentioned in "how to contribute" guide. Seems, many of them already discussed or assigned. Can you, please, suggest one? > What component of Kafka do you want to work on/interests you most?

Re: Help with first contribution

2018-06-28 Thread Matthias J. Sax
Nikolay, thanks for your interest in contribution to Kafka! Did you filter for JIRAs with label "newbie" or "beginner"? What component of Kafka do you want to work on/interests you most? -Matthias On 6/28/18 3:20 AM, Nikolay Izhikov wrote: > Hello, guys. > > I'm experienced java/scala

Re: [VOTE] KIP-319: Replace numSegments to segmentInterval in Streams window configurations

2018-06-28 Thread John Roesler
Thanks for voting, everyone. KIP-319 has passed with 3 binding (Guozhang, Matthias, Damian) and 3 non-binding votes (Ted, Bill, and me!). If you wish to review the implementation, I plan to build on the draft PR: https://github.com/apache/kafka/pull/5257 Thanks again, -John On Thu, Jun 28,

[jira] [Resolved] (KAFKA-6809) connections-created metric does not behave as expected

2018-06-28 Thread Rajini Sivaram (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram resolved KAFKA-6809. --- Resolution: Fixed Reviewer: Rajini Sivaram Fix Version/s: (was: 2.1.0)

Re: [VOTE] KIP-280: Enhanced log compaction

2018-06-28 Thread Luís Cabral
Hi, Thank you all for having a look! The KIP is now updated with the result of these late discussions, though I did take some liberty with this part: - If the "compaction.strategy.header" configuration is not set (or is blank), then the compaction strategy will fallback to "offset";

Re: [VOTE] KIP-280: Enhanced log compaction

2018-06-28 Thread Ted Yu
+1 On Thu, Jun 28, 2018 at 4:56 AM, Luís Cabral wrote: > Hi Ted, > Can I also get your input on this? > > bq. +1 from my side for using `compaction.strategy` with values > "offset","timestamp" and "header" and `compaction.strategy.header` > -Matthias > > bq. +1 from me as well. > -Guozhang > >

Re: [VOTE] KIP-280: Enhanced log compaction

2018-06-28 Thread Luís Cabral
Hi Ted, Can I also get your input on this? bq. +1 from my side for using `compaction.strategy` with values "offset","timestamp" and "header" and `compaction.strategy.header` -Matthias bq. +1 from me as well. -Guozhang  Cheers, Luis

[jira] [Created] (KAFKA-7115) InMemoryKeyValueLoggedStore does not flush the changelog

2018-06-28 Thread Hashan Gayasri Udugahapattuwa (JIRA)
Hashan Gayasri Udugahapattuwa created KAFKA-7115: Summary: InMemoryKeyValueLoggedStore does not flush the changelog Key: KAFKA-7115 URL: https://issues.apache.org/jira/browse/KAFKA-7115

[jira] [Resolved] (KAFKA-7099) KafkaLog4jAppender - not sending any message with level DEBUG

2018-06-28 Thread Manikumar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-7099. -- Resolution: Duplicate Resolving this as duplicate of  KAFKA-6415.  Please post your

Help with first contribution

2018-06-28 Thread Nikolay Izhikov
Hello, guys. I'm experienced java/scala engineer. I want to contribute to kafka. I read the documentation and look over jira tickets. Seems it's not easy to find a right issue to start contributing with. Can you, please, suggest some ticket(s) or JIRA filters I can take and solve.

[jira] [Created] (KAFKA-7114) Kafka Not sending few partitions messages to consumers

2018-06-28 Thread Gnanasoundari (JIRA)
Gnanasoundari created KAFKA-7114: Summary: Kafka Not sending few partitions messages to consumers Key: KAFKA-7114 URL: https://issues.apache.org/jira/browse/KAFKA-7114 Project: Kafka Issue

Re: [VOTE] KIP-313: Add KStream.flatTransform and KStream.flatTransformValues

2018-06-28 Thread Damian Guy
+1 On Mon, 25 Jun 2018 at 02:16 Matthias J. Sax wrote: > +1 (binding) > > > -Matthias > > On 6/22/18 10:25 AM, Bill Bejeck wrote: > > Thanks for the KIP, +1. > > > > -Bill > > > > On Fri, Jun 22, 2018 at 1:08 PM Ted Yu wrote: > > > >> +1 > >> > >> On Fri, Jun 22, 2018 at 2:50 AM, Bruno Cadonna

Re: [VOTE] KIP-330: Add retentionPeriod in SessionBytesStoreSupplier

2018-06-28 Thread Damian Guy
+1 On Thu, 28 Jun 2018 at 02:16 Ted Yu wrote: > +1 > > On Wed, Jun 27, 2018 at 4:40 PM, Bill Bejeck wrote: > > > +1 > > > > -Bill > > > > On Wed, Jun 27, 2018 at 7:39 PM Guozhang Wang > wrote: > > > > > Hello folks, > > > > > > I'd like to start a voting thread on KIP-330. I've intentionally

Re: [VOTE] KIP-277 - Fine Grained ACL for CreateTopics API

2018-06-28 Thread Edoardo Comar
Hi Guozhang, I am not sure we want to ensure that 'create' should implies 'read' and 'write' as I can imagine an administrative role with authoprity to create/delete but not to read (or write) topic data. I would agree that 'create' should imply 'describe' though, as one such admin should be

Re: [VOTE] KIP-319: Replace numSegments to segmentInterval in Streams window configurations

2018-06-28 Thread Damian Guy
+1 On Tue, 26 Jun 2018 at 17:22 Bill Bejeck wrote: > +1 > > On Mon, Jun 25, 2018 at 11:07 PM Matthias J. Sax > wrote: > > > +1 (binding) > > > > On 6/25/18 3:00 PM, Guozhang Wang wrote: > > > +1 > > > > > > On Mon, Jun 25, 2018 at 2:58 PM, Ted Yu wrote: > > > > > >> +1 > > >> > > >> On Mon,