[jira] [Commented] (KAFKA-1932) kafka topic (creation) templates

2015-03-30 Thread Ahmet AKYOL (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14386327#comment-14386327 ] Ahmet AKYOL commented on KAFKA-1932: ~ Third party solution, rest proxy from Confluent

[jira] [Comment Edited] (KAFKA-1932) kafka topic (creation) templates

2015-03-30 Thread Ahmet AKYOL (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14386327#comment-14386327 ] Ahmet AKYOL edited comment on KAFKA-1932 at 3/30/15 7:43 AM: -

[jira] [Comment Edited] (KAFKA-1932) kafka topic (creation) templates

2015-03-30 Thread Ahmet AKYOL (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14386327#comment-14386327 ] Ahmet AKYOL edited comment on KAFKA-1932 at 3/30/15 7:48 AM: -

[jira] [Comment Edited] (KAFKA-1932) kafka topic (creation) templates

2015-03-30 Thread Ahmet AKYOL (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14386327#comment-14386327 ] Ahmet AKYOL edited comment on KAFKA-1932 at 3/30/15 7:52 AM: -

[jira] [Comment Edited] (KAFKA-1932) kafka topic (creation) templates

2015-03-30 Thread Ahmet AKYOL (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14386327#comment-14386327 ] Ahmet AKYOL edited comment on KAFKA-1932 at 3/30/15 8:41 AM: -

Re: zookeeper usage in kafka offset commit / fetch requests

2015-03-30 Thread svante karlsson
Just to close this, I found out that the broker handles the request different depending on whether you specify api version 0 or 1. If using V1 the broker commits the offsets to internal topic. /svante

Can I be added as a contributor?

2015-03-30 Thread Brock Noland
Hi, Could I be added as a contributor and to confluence? I am brocknoland on JIRA and brockn at gmail on confluence. Cheers! Brock

[jira] [Commented] (KAFKA-2046) Delete topic still doesn't work

2015-03-30 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14386942#comment-14386942 ] Jay Kreps commented on KAFKA-2046: -- Hmm, so we have a configuration which, if you set it

Re: [DISCUSSION] Keep docs updated per jira

2015-03-30 Thread Jay Kreps
Yeah that sounds good to me. That would involve someone converting us over to the templating system we chose (something like Jenkyll would be easy since it allows inline HTML, so we'd just have to replace the apache includes). It's also quite possible that Apache has solved the whole SVN/website de

Kafka confusion

2015-03-30 Thread Jay Kreps
Gwen had a really good blog post on confusing things about Kafka: http://ingest.tips/2015/03/26/what-is-confusing-about-kafka/ A lot of these are in-flight now (e.g. consumer) or finished (e.g. delete topic, kind of, and non-sticky producer partitioning). Do we have bugs for the rest? It would be

[jira] [Resolved] (KAFKA-1932) kafka topic (creation) templates

2015-03-30 Thread Jiangjie Qin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin resolved KAFKA-1932. - Resolution: Duplicate [~liqusha] The requirement looks also covered in KIP-4. Close for now. Pleas

Re: [VOTE] KIP-7 Security - IP Filtering

2015-03-30 Thread Brock Noland
I think it is acceptable for KIP-11 to allow additional network based authorization. However I do feel that most user will want something simpler and thus I don't feel KIP-11 should require network based authorization by default. For example postgres allows something similar to what is being discu

[jira] [Created] (KAFKA-2076) Add an API to new consumer to allow user get high watermark of partitions.

2015-03-30 Thread Jiangjie Qin (JIRA)
Jiangjie Qin created KAFKA-2076: --- Summary: Add an API to new consumer to allow user get high watermark of partitions. Key: KAFKA-2076 URL: https://issues.apache.org/jira/browse/KAFKA-2076 Project: Kafka

Re: [jira] [Issue Comment Deleted] (KAFKA-1716) hang during shutdown of ZookeeperConsumerConnector

2015-03-30 Thread Mayuresh Gharat
You can take a look at this : https://issues.apache.org/jira/browse/KAFKA-1848 Thanks, Mayuresh On Sun, Mar 29, 2015 at 4:45 PM, Jiangjie Qin (JIRA) wrote: > > [ > https://issues.apache.org/jira/browse/KAFKA-1716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel > ] > > J

Re: Kafka confusion

2015-03-30 Thread Gwen Shapira
I was planning on doing a re-poll about a month after every release :) Maybe it can be part of the release activity. Gwen On Mon, Mar 30, 2015 at 10:26 AM, Jay Kreps wrote: > Gwen had a really good blog post on confusing things about Kafka: > http://ingest.tips/2015/03/26/what-is-confusing-abou

[jira] [Commented] (KAFKA-873) Consider replacing zkclient with curator (with zkclient-bridge)

2015-03-30 Thread Aaron Dixon (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387303#comment-14387303 ] Aaron Dixon commented on KAFKA-873: --- I've recently worked zkclient bridge to get a new re

[jira] [Commented] (KAFKA-1809) Refactor brokers to allow listening on multiple ports and IPs

2015-03-30 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387348#comment-14387348 ] Joel Koshy commented on KAFKA-1809: --- Thanks for the ping - yes I would like to take a lo

[jira] [Resolved] (KAFKA-1634) Improve semantics of timestamp in OffsetCommitRequests and update documentation

2015-03-30 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy resolved KAFKA-1634. --- Resolution: Fixed Yes I think that makes more sense > Improve semantics of timestamp in OffsetCommitR

[jira] [Commented] (KAFKA-2068) Replace OffsetCommit Request/Response with org.apache.kafka.common.requests equivalent

2015-03-30 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387360#comment-14387360 ] Joel Koshy commented on KAFKA-2068: --- Yes I think we can merge KAFKA-1841 changes from 0.

[jira] [Comment Edited] (KAFKA-873) Consider replacing zkclient with curator (with zkclient-bridge)

2015-03-30 Thread Aaron Dixon (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387303#comment-14387303 ] Aaron Dixon edited comment on KAFKA-873 at 3/30/15 8:48 PM: I r

[jira] [Updated] (KAFKA-2041) Add ability to specify a KeyClass for KafkaLog4jAppender

2015-03-30 Thread Benoy Antony (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benoy Antony updated KAFKA-2041: Attachment: kafka-2041-002.patch > Add ability to specify a KeyClass for KafkaLog4jAppender > --

[jira] [Commented] (KAFKA-2041) Add ability to specify a KeyClass for KafkaLog4jAppender

2015-03-30 Thread Benoy Antony (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387407#comment-14387407 ] Benoy Antony commented on KAFKA-2041: - modified _Keyer_ interface to change the functi

[jira] [Created] (KAFKA-2077) Add ability to specify a TopicPicker class for KafkaLog4jApender

2015-03-30 Thread Benoy Antony (JIRA)
Benoy Antony created KAFKA-2077: --- Summary: Add ability to specify a TopicPicker class for KafkaLog4jApender Key: KAFKA-2077 URL: https://issues.apache.org/jira/browse/KAFKA-2077 Project: Kafka

[jira] [Updated] (KAFKA-2077) Add ability to specify a TopicPicker class for KafkaLog4jApender

2015-03-30 Thread Benoy Antony (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benoy Antony updated KAFKA-2077: Attachment: kafka-2077-001.patch Attached patch adds a new new Parameter _topicClass_ . This will ac

Review Request 32650: Patch for KAFKA-2000

2015-03-30 Thread Sriharsha Chintalapani
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/32650/ --- Review request for kafka. Bugs: KAFKA-2000 https://issues.apache.org/jira/b

[jira] [Updated] (KAFKA-2000) Delete consumer offsets from kafka once the topic is deleted

2015-03-30 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sriharsha Chintalapani updated KAFKA-2000: -- Attachment: KAFKA-2000.patch > Delete consumer offsets from kafka once the topic

[jira] [Updated] (KAFKA-2000) Delete consumer offsets from kafka once the topic is deleted

2015-03-30 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sriharsha Chintalapani updated KAFKA-2000: -- Reviewer: Joel Koshy > Delete consumer offsets from kafka once the topic is dele

[jira] [Updated] (KAFKA-2000) Delete consumer offsets from kafka once the topic is deleted

2015-03-30 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sriharsha Chintalapani updated KAFKA-2000: -- Status: Patch Available (was: Open) > Delete consumer offsets from kafka once t

[jira] [Commented] (KAFKA-2000) Delete consumer offsets from kafka once the topic is deleted

2015-03-30 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387479#comment-14387479 ] Sriharsha Chintalapani commented on KAFKA-2000: --- Created reviewboard https:/

RE: Metrics package discussion

2015-03-30 Thread Aditya Auradkar
If we do plan to use the network code in client, I think that is a good reason in favor of migration. It will be unnecessary to have metrics from multiple libraries coexist since our users will have to start monitoring these new metrics anyway. I also agree with Jay that in multi-tenant cluster

[jira] [Created] (KAFKA-2078) Getting Selector [WARN] Error in I/O with host java.io.EOFException

2015-03-30 Thread Aravind (JIRA)
Aravind created KAFKA-2078: -- Summary: Getting Selector [WARN] Error in I/O with host java.io.EOFException Key: KAFKA-2078 URL: https://issues.apache.org/jira/browse/KAFKA-2078 Project: Kafka Issue

[jira] [Commented] (KAFKA-1716) hang during shutdown of ZookeeperConsumerConnector

2015-03-30 Thread David Chu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387543#comment-14387543 ] David Chu commented on KAFKA-1716: -- Yes, from what I can tell, if I just start up my cons

[jira] [Commented] (KAFKA-2078) Getting Selector [WARN] Error in I/O with host java.io.EOFException

2015-03-30 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387551#comment-14387551 ] Sriharsha Chintalapani commented on KAFKA-2078: --- [~aravind2015] can you atta

[GitHub] kafka pull request: curator + exhibitor integration

2015-03-30 Thread atdixon
GitHub user atdixon opened a pull request: https://github.com/apache/kafka/pull/53 curator + exhibitor integration My motivation for introducing curator to kafka was to get optional exhibitor support, however I noticed this is also a solution to ticket KAFKA-873 (https://issues.ap

[jira] [Commented] (KAFKA-873) Consider replacing zkclient with curator (with zkclient-bridge)

2015-03-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387573#comment-14387573 ] ASF GitHub Bot commented on KAFKA-873: -- GitHub user atdixon opened a pull request:

[jira] [Commented] (KAFKA-873) Consider replacing zkclient with curator (with zkclient-bridge)

2015-03-30 Thread Aaron Dixon (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387578#comment-14387578 ] Aaron Dixon commented on KAFKA-873: --- As promised, here is a PR integrating curator (+ opt

[jira] [Created] (KAFKA-2079) Support exhibitor

2015-03-30 Thread Aaron Dixon (JIRA)
Aaron Dixon created KAFKA-2079: -- Summary: Support exhibitor Key: KAFKA-2079 URL: https://issues.apache.org/jira/browse/KAFKA-2079 Project: Kafka Issue Type: Improvement Reporter: Aar

[jira] [Commented] (KAFKA-2079) Support exhibitor

2015-03-30 Thread Aaron Dixon (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387592#comment-14387592 ] Aaron Dixon commented on KAFKA-2079: A proposed solution: https://github.com/apache/ka

[jira] [Commented] (KAFKA-2078) Getting Selector [WARN] Error in I/O with host java.io.EOFException

2015-03-30 Thread Aravind (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387612#comment-14387612 ] Aravind commented on KAFKA-2078: Hi, thanks for replying. below are the details: Producer

[jira] [Comment Edited] (KAFKA-2078) Getting Selector [WARN] Error in I/O with host java.io.EOFException

2015-03-30 Thread Aravind (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387612#comment-14387612 ] Aravind edited comment on KAFKA-2078 at 3/30/15 11:41 PM: -- Hi, th

[jira] [Comment Edited] (KAFKA-2078) Getting Selector [WARN] Error in I/O with host java.io.EOFException

2015-03-30 Thread Aravind (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387612#comment-14387612 ] Aravind edited comment on KAFKA-2078 at 3/30/15 11:44 PM: -- Hi, th

[jira] [Comment Edited] (KAFKA-2078) Getting Selector [WARN] Error in I/O with host java.io.EOFException

2015-03-30 Thread Aravind (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387612#comment-14387612 ] Aravind edited comment on KAFKA-2078 at 3/30/15 11:44 PM: -- Hi Har

[jira] [Commented] (KAFKA-1910) Refactor KafkaConsumer

2015-03-30 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387652#comment-14387652 ] Joel Koshy commented on KAFKA-1910: --- [~guozhang] this patch modified some of the behavio

[jira] [Reopened] (KAFKA-1910) Refactor KafkaConsumer

2015-03-30 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy reopened KAFKA-1910: --- Reopening for the doc update and clarification on the change in error code. > Refactor KafkaConsumer > --

Re: [DISCUSSION] Keep docs updated per jira

2015-03-30 Thread Joel Koshy
Also for the wikis - those should probably correspond to the latest released version right? So for e.g., if we add or modify the protocol on trunk we can add it to the wiki but mark it with some highlight or similar just to make it clear that it is a change on trunk only. Thanks, Joel On Thu, Ma

[jira] [Commented] (KAFKA-2077) Add ability to specify a TopicPicker class for KafkaLog4jApender

2015-03-30 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387690#comment-14387690 ] Sriharsha Chintalapani commented on KAFKA-2077: --- [~benoyantony] It will be h

Re: Metrics package discussion

2015-03-30 Thread Jun Rao
If we are committed to migrating the broker side metrics to KM for the next release, we will need to (1) have a story on supporting common reporters (as listed in KAFKA-1930), and (2) see if the current histogram support is good enough for measuring things like request time. Thanks, Jun On Mon,

Re: Review Request 32650: Patch for KAFKA-2000

2015-03-30 Thread Gwen Shapira
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/32650/#review78310 --- Ship it! Very nice fix :) - Gwen Shapira On March 30, 2015, 9:47

[jira] [Commented] (KAFKA-1646) Improve consumer read performance for Windows

2015-03-30 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387828#comment-14387828 ] Sriharsha Chintalapani commented on KAFKA-1646: --- [~jkreps] Any guidance on t

Re: Metrics package discussion

2015-03-30 Thread Gwen Shapira
(1) It will be interesting to see what others use for monitoring integration, to see what is already covered with existing JMX integrations and what needs special support. (2) I think the migration story is more important - this is a non-compatible change, right? So we can't do it in 0.8.3 timefra

Re: Review Request 32650: Patch for KAFKA-2000

2015-03-30 Thread Onur Karaman
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/32650/#review78337 --- This might be out of scope for this JIRA, but I think if the deleted

[jira] [Commented] (KAFKA-2059) ZookeeperConsumerConnectorTest.testBasic trasient failure

2015-03-30 Thread Fangmin Lv (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14388046#comment-14388046 ] Fangmin Lv commented on KAFKA-2059: --- Hi Guozhang, Is this failure repeatable? How often