[jira] [Created] (KAFKA-1768) Expose version via JMX

2014-11-12 Thread Otis Gospodnetic (JIRA)
Otis Gospodnetic created KAFKA-1768: --- Summary: Expose version via JMX Key: KAFKA-1768 URL: https://issues.apache.org/jira/browse/KAFKA-1768 Project: Kafka Issue Type: Improvement Affect

Request for subscription

2014-11-12 Thread Sampath Tulava
Hi, Can I subscribe for this mailing list Thanks, Sampath

[jira] [Resolved] (KAFKA-1555) provide strong consistency with reasonable availability

2014-11-12 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein resolved KAFKA-1555. -- Resolution: Fixed > provide strong consistency with reasonable availability > --

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-11-12 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209151#comment-14209151 ] Jun Rao commented on KAFKA-1555: Thanks for the doc patch. Committed to svn after fixing a

[jira] [Updated] (KAFKA-1762) Update max-inflight-request doc string

2014-11-12 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy updated KAFKA-1762: -- Summary: Update max-inflight-request doc string (was: Enforce MAX_IN_FLIGHT_REQUESTS_PER_CONNECTION to

[jira] [Commented] (KAFKA-1752) add --replace-broker option

2014-11-12 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209072#comment-14209072 ] Neha Narkhede commented on KAFKA-1752: -- bq. So it looks like we actually want --add-b

[jira] [Updated] (KAFKA-1762) Update max-inflight-request doc string

2014-11-12 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy updated KAFKA-1762: -- Resolution: Fixed Status: Resolved (was: Patch Available) > Update max-inflight-request doc str

[jira] [Commented] (KAFKA-1481) Stop using dashes AND underscores as separators in MBean names

2014-11-12 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209055#comment-14209055 ] Joel Koshy commented on KAFKA-1481: --- (1) and (4) seem equivalent (i.e., AllTopics vs Agg

[jira] [Commented] (KAFKA-1729) add doc for Kafka-based offset management in 0.8.2

2014-11-12 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209071#comment-14209071 ] Jun Rao commented on KAFKA-1729: Thanks for the patch. A few comments. 1. We need to make

Re: Kafka consumer transactional support

2014-11-12 Thread Falabella, Anthony
I didn't realize there was a commitOffset() method on the high level consumer (the code is abstracted by the Spring Integration classes). Yes, this actually suits my needs and I was able to get it to work for my use case. Thank you very much - that was extremely helpful. In case it's of any use

Jenkins build is back to normal : Kafka-trunk #328

2014-11-12 Thread Apache Jenkins Server
See

[jira] [Commented] (KAFKA-1762) Enforce MAX_IN_FLIGHT_REQUESTS_PER_CONNECTION to 1 in MirrorMaker

2014-11-12 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14208940#comment-14208940 ] Joel Koshy commented on KAFKA-1762: --- Committed the doc change to trunk > Enforce MAX_IN

Re: Review Request 27834: Fix KAFKA-1762: add comment on risks using a larger value of max.inflight.requests than 1, in KAFKA-1650 we will add another comment about its risk of data loss

2014-11-12 Thread Joel Koshy
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/27834/#review61123 --- Ship it! clients/src/main/java/org/apache/kafka/clients/producer/P

Re: Review Request 27890: Patch for KAFKA-1764

2014-11-12 Thread Guozhang Wang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/27890/#review61099 --- Ship it! Ship It! - Guozhang Wang On Nov. 12, 2014, 10:05 p.m.,

[jira] [Commented] (KAFKA-1282) Disconnect idle socket connection in Selector

2014-11-12 Thread nicu marasoiu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14208810#comment-14208810 ] nicu marasoiu commented on KAFKA-1282: -- I want, yes, I will add a few tests this week

Re: Review Request 27684: Patch for KAFKA-1743

2014-11-12 Thread Jun Rao
> On Nov. 10, 2014, 7:50 p.m., Jun Rao wrote: > > core/src/main/scala/kafka/consumer/ConsumerConnector.scala, lines 76-80 > > > > > > We will also need to change the interface in ConsumerConnector from > > > >

[jira] [Commented] (KAFKA-1764) ZookeeperConsumerConnector could put multiple shutdownCommand to the same data chunk queue.

2014-11-12 Thread Jiangjie Qin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14208788#comment-14208788 ] Jiangjie Qin commented on KAFKA-1764: - Updated reviewboard https://reviews.apache.org/

[jira] [Updated] (KAFKA-1764) ZookeeperConsumerConnector could put multiple shutdownCommand to the same data chunk queue.

2014-11-12 Thread Jiangjie Qin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated KAFKA-1764: Attachment: KAFKA-1764_2014-11-12_14:05:35.patch > ZookeeperConsumerConnector could put multiple shu

Re: Review Request 27890: Patch for KAFKA-1764

2014-11-12 Thread Jiangjie Qin
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/27890/ --- (Updated Nov. 12, 2014, 10:05 p.m.) Review request for kafka. Bugs: KAFKA-176

Re: Kafka consumer transactional support

2014-11-12 Thread Jun Rao
Yes, the new consumer api will solve your probably better. Before that's ready, another option is to use the commitOffset() api in the high level consumer. It doesn't take any offset though. So, to prevent message loss during consumer failure, you will need to make sure all iterated messages are fu

Re: Kafka consumer transactional support

2014-11-12 Thread Falabella, Anthony
Hi Jun, Thanks for taking a look at my issue and also for updating the future release plan Wiki page. My use case is to use Kafka as if it were a JMS provider (messaging use case). I'm currently using Kafka 0.8.1.1 with Java and specifically the Spring Integration Kafka Inbound Channel Adapter

[jira] [Commented] (KAFKA-1173) Using Vagrant to get up and running with Apache Kafka

2014-11-12 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14208515#comment-14208515 ] Ewen Cheslack-Postava commented on KAFKA-1173: -- [~joestein] To be honest, I'm

[jira] [Updated] (KAFKA-1173) Using Vagrant to get up and running with Apache Kafka

2014-11-12 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-1173: - Attachment: KAFKA-1173_2014-11-12_11:32:09.patch > Using Vagrant to get up and run

[jira] [Commented] (KAFKA-1173) Using Vagrant to get up and running with Apache Kafka

2014-11-12 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14208512#comment-14208512 ] Ewen Cheslack-Postava commented on KAFKA-1173: -- Updated reviewboard https://r

Re: Review Request 27735: Patch for KAFKA-1173

2014-11-12 Thread Ewen Cheslack-Postava
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/27735/ --- (Updated Nov. 12, 2014, 7:32 p.m.) Review request for kafka. Bugs: KAFKA-1173

[jira] [Commented] (KAFKA-1481) Stop using dashes AND underscores as separators in MBean names

2014-11-12 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14208497#comment-14208497 ] Jun Rao commented on KAFKA-1481: 65. The following are some of the choices that we have.

[jira] [Created] (KAFKA-1767) /admin/reassign_partitions deleted before reassignment completes

2014-11-12 Thread Ryan Berdeen (JIRA)
Ryan Berdeen created KAFKA-1767: --- Summary: /admin/reassign_partitions deleted before reassignment completes Key: KAFKA-1767 URL: https://issues.apache.org/jira/browse/KAFKA-1767 Project: Kafka

- Re: Kafka consumer transactional support

2014-11-12 Thread Falabella, Anthony
Hi Jun, Thanks for taking a look at my issue and also for updating the future release plan Wiki page. My use case is to use Kafka as if it were a JMS provider (messaging use case). I'm currently using Kafka 0.8.1.1 with Java and specifically the Spring Integration Kafka Inbound Channel Adapter

[jira] [Comment Edited] (KAFKA-1481) Stop using dashes AND underscores as separators in MBean names

2014-11-12 Thread Vladimir Tretyakov (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14208284#comment-14208284 ] Vladimir Tretyakov edited comment on KAFKA-1481 at 11/12/14 5:54 PM: ---

[jira] [Commented] (KAFKA-1650) Mirror Maker could lose data on unclean shutdown.

2014-11-12 Thread Jiangjie Qin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14208327#comment-14208327 ] Jiangjie Qin commented on KAFKA-1650: - Updated reviewboard https://reviews.apache.org/

[jira] [Updated] (KAFKA-1650) Mirror Maker could lose data on unclean shutdown.

2014-11-12 Thread Jiangjie Qin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated KAFKA-1650: Attachment: KAFKA-1650_2014-11-12_09:51:30.patch > Mirror Maker could lose data on unclean shutdown.

Re: Review Request 25995: Patch for KAKFA-1650

2014-11-12 Thread Jiangjie Qin
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/25995/ --- (Updated Nov. 12, 2014, 5:51 p.m.) Review request for kafka. Summary (updated

Re: Review Request 25995: Patch for KAFKA-1650

2014-11-12 Thread Jiangjie Qin
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/25995/ --- (Updated Nov. 12, 2014, 5:51 p.m.) Review request for kafka. Summary (updated

[jira] [Commented] (KAFKA-1684) Implement TLS/SSL authentication

2014-11-12 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14208321#comment-14208321 ] Jun Rao commented on KAFKA-1684: Gwen, Thanks for the comment. Having 3 different ports i

[jira] [Commented] (KAFKA-1481) Stop using dashes AND underscores as separators in MBean names

2014-11-12 Thread Vladimir Tretyakov (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14208284#comment-14208284 ] Vladimir Tretyakov commented on KAFKA-1481: --- Maybe somebody can answer my last q

[jira] [Commented] (KAFKA-1173) Using Vagrant to get up and running with Apache Kafka

2014-11-12 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14208281#comment-14208281 ] Joe Stein commented on KAFKA-1173: -- [~ewencp] I am +1 on the virtual box parts to the pat

[jira] [Commented] (KAFKA-1737) Document required ZkSerializer for ZkClient used with AdminUtils

2014-11-12 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14208275#comment-14208275 ] Guozhang Wang commented on KAFKA-1737: -- Hi Vivek, Here are my thoughts: since curren

Re: Kafka Command Line & Shell

2014-11-12 Thread Guozhang Wang
Thanks Joe. I will read the wiki page. On Tue, Nov 11, 2014 at 11:47 PM, Joe Stein wrote: > I started writing this up on the wiki > > https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Command+Line+and+Related+Improvements > > Instead of starting a new thread I figure just continue this one

Re: Review Request 27890: Patch for KAFKA-1764

2014-11-12 Thread Guozhang Wang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/27890/#review61001 --- Could you also remove the line in consumer that sends back the shutd

Re: Review Request 27684: Patch for KAFKA-1743

2014-11-12 Thread Manikumar Reddy O
> On Nov. 10, 2014, 7:50 p.m., Jun Rao wrote: > > core/src/main/scala/kafka/consumer/ConsumerConnector.scala, lines 76-80 > > > > > > We will also need to change the interface in ConsumerConnector from > > > >

[jira] [Updated] (KAFKA-1667) topic-level configuration not validated

2014-11-12 Thread Dmytro Kostiuchenko (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmytro Kostiuchenko updated KAFKA-1667: --- Attachment: (was: KAFKA-1667.patch) > topic-level configuration not validated > -

[jira] [Updated] (KAFKA-1667) topic-level configuration not validated

2014-11-12 Thread Dmytro Kostiuchenko (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmytro Kostiuchenko updated KAFKA-1667: --- Status: Patch Available (was: Open) > topic-level configuration not validated >

[jira] [Commented] (KAFKA-1667) topic-level configuration not validated

2014-11-12 Thread Dmytro Kostiuchenko (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207968#comment-14207968 ] Dmytro Kostiuchenko commented on KAFKA-1667: Can't assign issue to myself. Get

Re: Review Request 27634: Patch for KAFKA-1667

2014-11-12 Thread Dmytro Kostiuchenko
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/27634/ --- (Updated Nov. 12, 2014, 11:49 a.m.) Review request for kafka. Bugs: KAFKA-166

[jira] [Updated] (KAFKA-1667) topic-level configuration not validated

2014-11-12 Thread Dmytro Kostiuchenko (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmytro Kostiuchenko updated KAFKA-1667: --- Attachment: KAFKA-1667_2014-11-12_12:49:11.patch > topic-level configuration not vali

[jira] [Commented] (KAFKA-1667) topic-level configuration not validated

2014-11-12 Thread Dmytro Kostiuchenko (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207957#comment-14207957 ] Dmytro Kostiuchenko commented on KAFKA-1667: Updated reviewboard https://revie

[jira] [Comment Edited] (KAFKA-1752) add --replace-broker option

2014-11-12 Thread Dmitry Pekar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207900#comment-14207900 ] Dmitry Pekar edited comment on KAFKA-1752 at 11/12/14 10:31 AM:

[jira] [Commented] (KAFKA-1752) add --replace-broker option

2014-11-12 Thread Dmitry Pekar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207900#comment-14207900 ] Dmitry Pekar commented on KAFKA-1752: - [~gwenshap] That, probably, could be implemente

[jira] [Commented] (KAFKA-1737) Document required ZkSerializer for ZkClient used with AdminUtils

2014-11-12 Thread Vivek Madani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207798#comment-14207798 ] Vivek Madani commented on KAFKA-1737: - Hi - Did you mean to enforce ZkStringSerializer