Re: How to recover from ConsumerRebalanceFailedException ?

2014-11-18 Thread Jun Rao
Is your ZK service alive at that point? If not, you just need to monitor the ZK server properly. Thanks, Jun On Mon, Nov 17, 2014 at 2:30 PM, Bhavesh Mistry wrote: > Hi Kafka Team, > > > I get following exception due to ZK/Network issues intermittently. How do > I recover from consumer thread

Build failed in Jenkins: Kafka-trunk #335

2014-11-18 Thread Apache Jenkins Server
See Changes: [junrao] kafka-1743; ConsumerConnector.commitOffsets in 0.8.2 is not backward compatible; patched by Manikumar Reddy; reviewed by Jun Rao -- [...truncated 2085 lines...] kafka.admin.Adm

[jira] [Updated] (KAFKA-1743) ConsumerConnector.commitOffsets in 0.8.2 is not backward compatible

2014-11-18 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-1743: --- Resolution: Fixed Status: Resolved (was: Patch Available) Thanks for the patch. +1. Committed to trun

[jira] [Updated] (KAFKA-1785) Consumer offset checker should show the offset manager and offsets partition

2014-11-18 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy updated KAFKA-1785: -- Fix Version/s: 0.8.2 > Consumer offset checker should show the offset manager and offsets partition > --

[jira] [Created] (KAFKA-1785) Consumer offset checker should show the offset manager and offsets partition

2014-11-18 Thread Joel Koshy (JIRA)
Joel Koshy created KAFKA-1785: - Summary: Consumer offset checker should show the offset manager and offsets partition Key: KAFKA-1785 URL: https://issues.apache.org/jira/browse/KAFKA-1785 Project: Kafka

Re: Review Request 28025: Patch for KAFKA-345

2014-11-18 Thread Joel Koshy
> On Nov. 19, 2014, 12:01 a.m., Jun Rao wrote: > > core/src/main/scala/kafka/consumer/ZookeeperConsumerConnector.scala, lines > > 166-169 > > > > > > Should this be added to the ConsumerConnector interface? > > >

Re: How to recover from ConsumerRebalanceFailedException ?

2014-11-18 Thread Bhavesh Mistry
Hi Kakfa team, So just monitor "ZkClient-EventThread *" threads via ThreadInfo[] threads = ManagementFactory.getThreadMXBean().; and if this ZkClient-EventThread

Re: Review Request 28025: Patch for KAFKA-345

2014-11-18 Thread Jiangjie Qin
> On Nov. 18, 2014, 6:28 p.m., Joel Koshy wrote: > > core/src/main/scala/kafka/javaapi/consumer/ConsumerRebalanceListener.java, > > line 47 > > > > > > * I think we can just combine this patch with the mirror maker >

[jira] [Commented] (KAFKA-1173) Using Vagrant to get up and running with Apache Kafka

2014-11-18 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14217099#comment-14217099 ] Ewen Cheslack-Postava commented on KAFKA-1173: -- [~joestein] I fixed the issue

[jira] [Commented] (KAFKA-1173) Using Vagrant to get up and running with Apache Kafka

2014-11-18 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14217083#comment-14217083 ] Ewen Cheslack-Postava commented on KAFKA-1173: -- Updated reviewboard https://r

[jira] [Updated] (KAFKA-1173) Using Vagrant to get up and running with Apache Kafka

2014-11-18 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-1173: - Attachment: KAFKA-1173_2014-11-18_16:01:33.patch > Using Vagrant to get up and run

Re: Review Request 27735: Patch for KAFKA-1173

2014-11-18 Thread Ewen Cheslack-Postava
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/27735/ --- (Updated Nov. 19, 2014, 12:01 a.m.) Review request for kafka. Bugs: KAFKA-117

Re: Review Request 28025: Patch for KAFKA-345

2014-11-18 Thread Jun Rao
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28025/#review62058 --- Thanks for the patch. A few comments below. core/src/main/scala/ka

[jira] [Created] (KAFKA-1783) Missing slash in documentation for the Zookeeper paths in ZookeeperConsumerConnector

2014-11-18 Thread Jean-Francois Im (JIRA)
Jean-Francois Im created KAFKA-1783: --- Summary: Missing slash in documentation for the Zookeeper paths in ZookeeperConsumerConnector Key: KAFKA-1783 URL: https://issues.apache.org/jira/browse/KAFKA-1783

[jira] [Updated] (KAFKA-1783) Missing slash in documentation for the Zookeeper paths in ZookeeperConsumerConnector

2014-11-18 Thread Jean-Francois Im (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Francois Im updated KAFKA-1783: Attachment: kafka-missing-doc-slash.patch Patch that adds the missing slash for the consumer

[jira] [Created] (KAFKA-1784) Implement a ConsumerOffsetClient library

2014-11-18 Thread Joel Koshy (JIRA)
Joel Koshy created KAFKA-1784: - Summary: Implement a ConsumerOffsetClient library Key: KAFKA-1784 URL: https://issues.apache.org/jira/browse/KAFKA-1784 Project: Kafka Issue Type: New Feature

[jira] [Updated] (KAFKA-1731) add config/jmx changes in 0.8.2 doc

2014-11-18 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy updated KAFKA-1731: -- Priority: Blocker (was: Major) > add config/jmx changes in 0.8.2 doc >

[jira] [Updated] (KAFKA-1728) update 082 docs

2014-11-18 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy updated KAFKA-1728: -- Priority: Blocker (was: Major) > update 082 docs > --- > > Key: KAFKA-1728

[jira] [Updated] (KAFKA-1730) add the doc for the new java producer in 0.8.2

2014-11-18 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy updated KAFKA-1730: -- Priority: Blocker (was: Major) > add the doc for the new java producer in 0.8.2 > -

[jira] [Updated] (KAFKA-1580) Reject producer requests to internal topics

2014-11-18 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy updated KAFKA-1580: -- Priority: Critical (was: Blocker) > Reject producer requests to internal topics > -

[jira] [Updated] (KAFKA-1580) Reject producer requests to internal topics

2014-11-18 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy updated KAFKA-1580: -- Priority: Blocker (was: Major) > Reject producer requests to internal topics >

[jira] [Updated] (KAFKA-1282) Disconnect idle socket connection in Selector

2014-11-18 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy updated KAFKA-1282: -- Fix Version/s: (was: 0.9.0) 0.8.2 This is already in 0.8.2 so we should incorpora

[jira] [Commented] (KAFKA-1782) Junit3 Misusage

2014-11-18 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14216825#comment-14216825 ] Guozhang Wang commented on KAFKA-1782: -- For more information: http://www.asjava.com/

[jira] [Updated] (KAFKA-1728) update 082 docs

2014-11-18 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy updated KAFKA-1728: -- Fix Version/s: 0.8.2 > update 082 docs > --- > > Key: KAFKA-1728 >

[jira] [Created] (KAFKA-1782) Junit3 Misusage

2014-11-18 Thread Guozhang Wang (JIRA)
Guozhang Wang created KAFKA-1782: Summary: Junit3 Misusage Key: KAFKA-1782 URL: https://issues.apache.org/jira/browse/KAFKA-1782 Project: Kafka Issue Type: Bug Reporter: Guozhang

Re: Review Request 28025: Patch for KAFKA-345

2014-11-18 Thread Joel Koshy
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28025/#review61964 --- Overall this looks good except for a naming suggestion and removal o

[jira] [Updated] (KAFKA-1755) Improve error handling in log cleaner

2014-11-18 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy updated KAFKA-1755: -- Assignee: Joel Koshy > Improve error handling in log cleaner > - > >

[jira] [Updated] (KAFKA-1755) Improve error handling in log cleaner

2014-11-18 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy updated KAFKA-1755: -- Summary: Improve error handling in log cleaner (was: Log cleaner thread should not exit on errors) > I

[jira] [Commented] (KAFKA-1755) Log cleaner thread should not exit on errors

2014-11-18 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14216486#comment-14216486 ] Joel Koshy commented on KAFKA-1755: --- There are a couple of issues that I was thinking of

[jira] [Assigned] (KAFKA-1774) REPL and Shell Client for Admin Message RQ/RP

2014-11-18 Thread Andrii Biletskyi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrii Biletskyi reassigned KAFKA-1774: --- Assignee: Andrii Biletskyi > REPL and Shell Client for Admin Message RQ/RP >

[jira] [Updated] (KAFKA-1772) Add an Admin message type for request response

2014-11-18 Thread Andrii Biletskyi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrii Biletskyi updated KAFKA-1772: Attachment: KAFKA-1772.patch > Add an Admin message type for request response >

[jira] [Commented] (KAFKA-1772) Add an Admin message type for request response

2014-11-18 Thread Andrii Biletskyi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14216456#comment-14216456 ] Andrii Biletskyi commented on KAFKA-1772: - Created reviewboard https://reviews.apa

[jira] [Updated] (KAFKA-1772) Add an Admin message type for request response

2014-11-18 Thread Andrii Biletskyi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrii Biletskyi updated KAFKA-1772: Status: Patch Available (was: Open) > Add an Admin message type for request response >

Review Request 28175: Patch for KAFKA-1772

2014-11-18 Thread Andrii Biletskyi
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28175/ --- Review request for kafka. Bugs: KAFKA-1772 https://issues.apache.org/jira/b

[jira] [Commented] (KAFKA-1768) Expose version via JMX

2014-11-18 Thread Otis Gospodnetic (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14216224#comment-14216224 ] Otis Gospodnetic commented on KAFKA-1768: - I think this was done in KAFKA-1481 now

[jira] [Commented] (KAFKA-1751) handle "broker not exists" and "topic not exists" scenarios

2014-11-18 Thread Dmitry Pekar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14216158#comment-14216158 ] Dmitry Pekar commented on KAFKA-1751: - [~nehanarkhede] could you please review my patc

[jira] [Commented] (KAFKA-1481) Stop using dashes AND underscores as separators in MBean names

2014-11-18 Thread Vladimir Tretyakov (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14215868#comment-14215868 ] Vladimir Tretyakov commented on KAFKA-1481: --- Thx a lot guys, will try prepare pa