Re: [VOTE] KIP-237: More Controller Health Metrics

2018-01-03 Thread Becket Qin
+1. Thanks for the KIP. On Wed, Jan 3, 2018 at 9:28 AM, Manikumar wrote: > +1 (non-binding) > > Thanks > > On Wed, Jan 3, 2018 at 10:48 PM, Jun Rao wrote: > > > Hi, Dong, > > > > Thanks for the KIP. +1 > > > > Jun > > > > On Mon, Dec 18, 2017 at

[jira] [Created] (KAFKA-6421) consumer group can't show when use kafka-consumer-groups tool if the leader of __consumer_offsets partition for this group changed

2018-01-03 Thread yuemeng (JIRA)
yuemeng created KAFKA-6421: -- Summary: consumer group can't show when use kafka-consumer-groups tool if the leader of __consumer_offsets partition for this group changed Key: KAFKA-6421 URL:

Re: [DISCUSS] KIP-232: Detect outdated metadata by adding ControllerMetadataEpoch field

2018-01-03 Thread Dong Lin
Hey Jun, Thanks much for the explanation. I understand the advantage of partition_epoch over metadata_epoch. My current concern is that the use of leader_epoch and the partition_epoch requires us considerable change to consumer's public API to take care of the case where user stores offset

Re: [DISCUSS] KIP-227: Introduce Incremental FetchRequests to Increase Partition Scalability

2018-01-03 Thread Becket Qin
Hi Colin, I see. I was under the impression that the sessions are immutable and they are actually not. Then I don't have further concerns over the KIP. We can incrementally do the future optimization. One minor thing, the KIP is still using epoch instead of sequence number in some places. We may

Re: 'Create' permissions for cwiki

2018-01-03 Thread Jun Rao
Hi, Sean, Thanks for your interest. Just gave you the wiki permission. Jun On Wed, Jan 3, 2018 at 3:29 PM, Sean Policarpio < sean.policar...@simplemachines.com.au> wrote: > Hi, > Can I please get page creation permissions for my ID 'kdrakon' so that I > can make a KIP? > > Cheers > Sean > > >

Jenkins build is back to normal : kafka-trunk-jdk9 #288

2018-01-03 Thread Apache Jenkins Server
See

'Create' permissions for cwiki

2018-01-03 Thread Sean Policarpio
Hi, Can I please get page creation permissions for my ID 'kdrakon' so that I can make a KIP? Cheers Sean -- Sean Policarpio | Principal Consultant s...@simplemachines.com.au simplemachines.com.au Level 2, 145 William Street, Sydney NSW 2010

Re: [VOTE] KIP-239 Add queryableStoreName() to GlobalKTable

2018-01-03 Thread Richard Yu
There are 3 binding votes and 2 nonbinding votes in favor of KIP-239. Binding: Guozhang Wang Damian Guy Ewen Cheslack-Postava Nonbinding: Matthias J. Sax Bill Bejeck This would close this voting thread. On Tue, Jan 2, 2018 at 10:24 PM, Matthias J. Sax wrote: >

Re: [DISCUSS] KIP-231: Improve the Required ACL of ListGroups API

2018-01-03 Thread Vahid S Hashemian
Thanks for the feedback and vote Ewen! Happy new year! --Vahid From: Ewen Cheslack-Postava To: dev@kafka.apache.org Date: 01/02/2018 09:49 PM Subject:Re: [DISCUSS] KIP-231: Improve the Required ACL of ListGroups API Late to the game here, but I'm +1 on

Jenkins build is back to normal : kafka-trunk-jdk8 #2307

2018-01-03 Thread Apache Jenkins Server
See

Jenkins build is back to normal : kafka-trunk-jdk7 #3073

2018-01-03 Thread Apache Jenkins Server
See

Build failed in Jenkins: kafka-trunk-jdk9 #287

2018-01-03 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-6256: fix flaky test [rajinisivaram] KAFKA-6415; Use WARN log level for Metadata in system test -- [...truncated 1.44 MB...]

Question Regarding seek() in KafkaConsumer

2018-01-03 Thread Sagar
Hi, I have a use case where in I need exactly once processing for data across various topics. So, this means that in case of errors, the next time poll() method runs, it should start off from the exact same record. The approach I have used is, 1) Call poll() and get a list of records. 2) For

Re: [VOTE] KIP-226 - Dynamic Broker Configuration

2018-01-03 Thread Rajini Sivaram
Hi Jason, Thank you for reviewing and voting. Thanks, I had missed the rename. Have updated the KIP. The configs can be defined in the static server.properties or in ZooKeeper. If a ZK config cannot be decoded (or is not valid), we log an error and revert to the static config or default. When

Re: [DISCUSS] KIP-227: Introduce Incremental FetchRequests to Increase Partition Scalability

2018-01-03 Thread Colin McCabe
On Tue, Jan 2, 2018, at 23:49, Becket Qin wrote: > Thanks for the reply, Colin. > > My concern for the reinitialization is potential churn rather than > efficiency. The current KIP proposal uses the time and priority based > protection to avoid thrashing, but it is not clear to me if that is >

[jira] [Created] (KAFKA-6420) Adding Msys support

2018-01-03 Thread Pas (JIRA)
Pas created KAFKA-6420: -- Summary: Adding Msys support Key: KAFKA-6420 URL: https://issues.apache.org/jira/browse/KAFKA-6420 Project: Kafka Issue Type: Improvement Components: tools

Re: [VOTE] KIP-226 - Dynamic Broker Configuration

2018-01-03 Thread Jason Gustafson
+1 Thanks for the KIP. One minor nit: I think we changed ConfigSource.TOPIC_CONFIG to ConfigSource.DYNAMIC_TOPIC_CONFIG in the PR. As far as updating secrets, I wasn't sure I understand how that will work. Do the password configs accept multiple values? On Wed, Jan 3, 2018 at 2:58 AM, Rajini

Re: [VOTE] KIP-243: Make ProducerConfig and ConsumerConfig constructors public

2018-01-03 Thread Colin McCabe
On Thu, Dec 21, 2017, at 10:28, Jason Gustafson wrote: > Hey Matthias, > > Let me suggest an alternative. As you have mentioned, these config classes > do not give users much benefit currently. Maybe we change that? I think > many users would appreciate having a builder for configuration since it

Re: [VOTE] KIP-237: More Controller Health Metrics

2018-01-03 Thread Manikumar
+1 (non-binding) Thanks On Wed, Jan 3, 2018 at 10:48 PM, Jun Rao wrote: > Hi, Dong, > > Thanks for the KIP. +1 > > Jun > > On Mon, Dec 18, 2017 at 2:03 PM, Dong Lin wrote: > > > Hi all, > > > > Since there are no more outstanding comments, I would like

Re: [VOTE] KIP-237: More Controller Health Metrics

2018-01-03 Thread Jun Rao
Hi, Dong, Thanks for the KIP. +1 Jun On Mon, Dec 18, 2017 at 2:03 PM, Dong Lin wrote: > Hi all, > > Since there are no more outstanding comments, I would like to start voting > thread for KIP-237: > https://cwiki.apache.org/confluence/display/KAFKA/KIP- >

Re: [VOTE] KIP-226 - Dynamic Broker Configuration

2018-01-03 Thread Rajini Sivaram
Hi Jun, Thank you for reviewing and voting. 50. I have updated the KIP to describe how the secret may be changed. All dynamically configurable passwords and per-broker configs. So the secret can be different across brokers and updated using rolling restart. In order to update the secret, each

Re: [DISCUSS]KIP-216: IQ should throw different exceptions for different errors

2018-01-03 Thread vito jeng
Matthias, Thank you for your response. I think you are right. We need to look at the state both of KafkaStreams and StreamThread. After further understanding of KafkaStreams thread and state store, I am currently rewriting the KIP. --- Vito On Fri, Dec 29, 2017 at 4:32 AM, Matthias J. Sax