[jira] [Created] (KAFKA-5590) Delete Kafka Topic Complete Failed After Enable Ranger Kafka Plugin

2017-07-13 Thread Chaofeng Zhao (JIRA)
Chaofeng Zhao created KAFKA-5590: Summary: Delete Kafka Topic Complete Failed After Enable Ranger Kafka Plugin Key: KAFKA-5590 URL: https://issues.apache.org/jira/browse/KAFKA-5590 Project: Kafka

Re: [VOTE] KIP-168: Add TotalTopicCount metric per cluster

2017-07-13 Thread Joel Koshy
+1 On Thu, Jul 13, 2017 at 12:24 PM, Vahid S Hashemian < vahidhashem...@us.ibm.com> wrote: > +1 (non-binding) > > > > > From: Dong Lin > To: dev@kafka.apache.org > Date: 07/12/2017 10:43 AM > Subject:Re: [VOTE] KIP-168: Add TotalTopicCount metric per cluster > > > > +1 (non-bindi

Re: [ANNOUNCE] New Kafka PMC member Ismael Juma

2017-07-13 Thread James Cheng
Congrats Ismael! -James > On Jul 5, 2017, at 1:55 PM, Jun Rao wrote: > > Hi, Everyone, > > Ismael Juma has been active in the Kafka community since he became > a Kafka committer about a year ago. I am glad to announce that Ismael is > now a member of Kafka PMC. > > Congratulations, Ismael! >

[DISCUSS] KIP-177 Consumer perf tool should count rebalance time

2017-07-13 Thread Hu Xi
Hi all, I opened up a new KIP (KIP-177) concerning consumer perf tool counting and showing rebalance time in the output. Be free to leave your comments here. Thanks in advance.

Re: Clarification on KafkaConsumer manual partition assignment

2017-07-13 Thread venkata sastry akella
Lets a consumer not part of a group , is assigning partitiions manually in one consumer is going to effect the other consumers part of a consumer group? On Thu, Jul 13, 2017 at 10:36 AM, Paolo Patierno wrote: > Assigning partitions manually has no relation with consumer groups. I mean > ... a co

Re: [DISCUSS] KIP-169 Lag-Aware Partition Assignment Strategy

2017-07-13 Thread Vahid S Hashemian
Hi Grant, Thank you for the KIP. Very well written and easy to understand. One question I have after reading the KIP: What are we targeting by using a Lag Aware assignment assignor? Is the goal to speed up consuming all messages from a topic? If that is the case, it sounds to me that assigning

Re: [VOTE] KIP-168: Add TotalTopicCount metric per cluster

2017-07-13 Thread Vahid S Hashemian
+1 (non-binding) From: Dong Lin To: dev@kafka.apache.org Date: 07/12/2017 10:43 AM Subject:Re: [VOTE] KIP-168: Add TotalTopicCount metric per cluster +1 (non-binding) On Wed, Jul 12, 2017 at 10:04 AM, Abhishek Mendhekar < abhishek.mendhe...@gmail.com> wrote: > Hello Kafka

Re: Clarification on KafkaConsumer manual partition assignment

2017-07-13 Thread venkata sastry akella
Here is the link: https://kafka.apache.org/0100/javadoc/org/apache/kafka/clients/consumer/KafkaConsumer.html#manualassignment On Thu, Jul 13, 2017 at 11:28 AM, M. Manna wrote: > "A consumer doesn't need to be part of a consumer group" > - where do you see this documented please ? > > On 13 Jul

Re: Clarification on KafkaConsumer manual partition assignment

2017-07-13 Thread M. Manna
"A consumer doesn't need to be part of a consumer group" - where do you see this documented please ? On 13 Jul 2017 6:36 pm, "Paolo Patierno" wrote: Assigning partitions manually has no relation with consumer groups. I mean ... a consumer doesn't need to be part of a consumer group (so specifyin

Re: Clarification on KafkaConsumer manual partition assignment

2017-07-13 Thread Paolo Patierno
Assigning partitions manually has no relation with consumer groups. I mean ... a consumer doesn't need to be part of a consumer group (so specifying group.id) for having a partition assigned manually. From: venkata sastry akella Sent: Thursday, July 13, 2017 7:09

Clarification on KafkaConsumer manual partition assignment

2017-07-13 Thread venkata sastry akella
KafkaConsumer API doc has the following statement. "Note that it isn't possible to mix manual partition assignment (i.e. using assign ) with dynamic partition assignment through

New AdmiClient no rack awareness support

2017-07-13 Thread Paolo Patierno
Hi devs, can you confirm that executing a "racks aware" replicas assignment is not possible with the new AdminClient ? It seems that the current Scala TopicCommand tool recovers information about brokers and related racks then check the rack aware mode requested by user. In any case it passes

Re: Apply for access for Kafka KIP creation permission

2017-07-13 Thread Guozhang Wang
Hi Xi, Have granted you the permissions. Guozhang On Wed, Jul 12, 2017 at 7:58 PM, Hu Xi wrote: > Apply for access for KIP creation permission. > > > WikiID: huxi_2b > > Email: huxi...@hotmail.com > -- -- Guozhang

Re: [ANNOUNCE] New Kafka PMC member Ismael Juma

2017-07-13 Thread Becket Qin
Congrats, Ismael! On Mon, Jul 10, 2017 at 6:37 AM, Neha Narkhede wrote: > Very well deserved. Congratulations Ismael! > On Mon, Jul 10, 2017 at 6:33 AM Viktor Somogyi > wrote: > > > Congrats Ismael :) > > > > On Fri, Jul 7, 2017 at 6:59 PM, Konstantine Karantasis < > > konstant...@confluent.io>

Re: [VOTE] KIP-134: Delay initial consumer group rebalance

2017-07-13 Thread Becket Qin
I am a little hesitant to add the configuration to the client. It would be more flexible but this seems not the thing that users should worry about (I imagine many people would simply set backoff to 0 just for fast rebalance). I am wondering if the following variant of the current solution will add

Re: [VOTE] KIP-167: Add interface for the state store restoration process

2017-07-13 Thread Eno Thereska
+1 (non-binding). Thanks Bill. Eno > On 12 Jul 2017, at 09:12, Bill Bejeck wrote: > > All, > > Now that we've concluded a second round of discussion on KIP-167, I'd like > to start a vote. > > > Thanks, > Bill > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-167%3A+Add+interface+fo

Re: [ANNOUNCE] New Kafka PMC member Jason Gustafson

2017-07-13 Thread Becket Qin
Congratulations, Jason! On Wed, Jul 12, 2017 at 7:05 PM, Kamal C wrote: > Congrats Jason! > > On 13-Jul-2017 00:32, "Jun Rao" wrote: > > > Congratulations, Jason! > > > > Jun > > > > On Tue, Jul 11, 2017 at 10:32 PM, Guozhang Wang > > wrote: > > > > > Hi Everyone, > > > > > > Jason Gustafson h

Comments on JIRAs

2017-07-13 Thread Tom Bentley
The project recently switched from all JIRA events being sent to the dev mailling list, to just issue creations. This seems like a good thing because the dev mailling list was very noisy before, and if you want to see all the JIRA comments etc you can subscribe to the JIRA list. If you don't subscr

[jira] [Resolved] (KAFKA-5589) Bump dependency of Kafka 0.10.x to the latest one

2017-07-13 Thread Piotr Nowojski (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski resolved KAFKA-5589. --- Resolution: Not A Problem Sorry, created an issue in wrong project. > Bump dependency of Kafk

[jira] [Created] (KAFKA-5589) Bump dependency of Kafka 0.10.x to the latest one

2017-07-13 Thread Piotr Nowojski (JIRA)
Piotr Nowojski created KAFKA-5589: - Summary: Bump dependency of Kafka 0.10.x to the latest one Key: KAFKA-5589 URL: https://issues.apache.org/jira/browse/KAFKA-5589 Project: Kafka Issue Type:

Kafka doc : official repo or web site repo ?

2017-07-13 Thread Paolo Patierno
Hi guys, I have big doubt on where is the doc and what to do for upgrading that. I see the docs folder in the Kafka repo (but even there I have a PR opened for one month on Kafka Connect not yet merged) but then I see the Kafka web site repo where there is the same doc. Reading the new Kafka S

[GitHub] kafka pull request #3525: KAFKA-5431: cleanSegments should not set length fo...

2017-07-13 Thread huxihx
GitHub user huxihx opened a pull request: https://github.com/apache/kafka/pull/3525 KAFKA-5431: cleanSegments should not set length for cleanable segment files For a compacted topic with preallocate enabled, during log cleaning, LogCleaner.cleanSegments does not have to pre-allocate

[GitHub] kafka pull request #3524: KAFKA-5588: uselss --new-consumer option

2017-07-13 Thread ppatierno
GitHub user ppatierno opened a pull request: https://github.com/apache/kafka/pull/3524 KAFKA-5588: uselss --new-consumer option Get rid of the --new-consumer option for the ConsoleConsumer You can merge this pull request into a Git repository by running: $ git pull https://gith

[jira] [Created] (KAFKA-5588) ConsumerConsole : uselss --new-consumer option

2017-07-13 Thread Paolo Patierno (JIRA)
Paolo Patierno created KAFKA-5588: - Summary: ConsumerConsole : uselss --new-consumer option Key: KAFKA-5588 URL: https://issues.apache.org/jira/browse/KAFKA-5588 Project: Kafka Issue Type: Bu