Re: Question about Kafka code contribution guidelines

2013-03-28 Thread Jun Rao
All committers have to file the following agreement: http://www.apache.org/licenses/icla.txt Contributor submits patches to a jira. The patches will be reviewed and if accepted, they will be checked in by a committer. If a contributor makes significant contribution, he/she will be nominated as a c

[jira] [Created] (KAFKA-841) Merge the partition and replica state machines into a single unified state machine in the controller

2013-03-28 Thread Neha Narkhede (JIRA)
Neha Narkhede created KAFKA-841: --- Summary: Merge the partition and replica state machines into a single unified state machine in the controller Key: KAFKA-841 URL: https://issues.apache.org/jira/browse/KAFKA-841

[jira] [Commented] (KAFKA-840) Controller tries to perform preferred replica election on failover before state machines have started up

2013-03-28 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13617001#comment-13617001 ] Neha Narkhede commented on KAFKA-840: - Thanks for the patch. In addition to fixing the

[jira] [Updated] (KAFKA-831) Controller does not send the complete list of partitions to a newly started broker

2013-03-28 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-831: Attachment: kafka-831-v2.patch Ack, you're right. The optimization of sending the leader and isr req

[jira] [Closed] (KAFKA-832) 0.8 Consumer prevents rebalance if consumer thread is blocked or slow

2013-03-28 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede closed KAFKA-832. --- > 0.8 Consumer prevents rebalance if consumer thread is blocked or slow >

[jira] [Commented] (KAFKA-831) Controller does not send the complete list of partitions to a newly started broker

2013-03-28 Thread Swapnil Ghike (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13616843#comment-13616843 ] Swapnil Ghike commented on KAFKA-831: - One way to avoid it could be that in the Online/

[jira] [Commented] (KAFKA-831) Controller does not send the complete list of partitions to a newly started broker

2013-03-28 Thread Swapnil Ghike (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13616827#comment-13616827 ] Swapnil Ghike commented on KAFKA-831: - This patch may not fix the issue. In the Offline

[jira] [Updated] (KAFKA-832) 0.8 Consumer prevents rebalance if consumer thread is blocked or slow

2013-03-28 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-832: -- Resolution: Fixed Fix Version/s: 0.8 Status: Resolved (was: Patch Available) Thanks for the r

[jira] [Closed] (KAFKA-831) Controller does not send the complete list of partitions to a newly started broker

2013-03-28 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede closed KAFKA-831. --- > Controller does not send the complete list of partitions to a newly started > broker >

[jira] [Updated] (KAFKA-831) Controller does not send the complete list of partitions to a newly started broker

2013-03-28 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-831: Resolution: Fixed Status: Resolved (was: Patch Available) Thanks for the review, checked in

[jira] [Resolved] (KAFKA-814) Controller should not throw exception when a preferred replica is already the leader for a partition

2013-03-28 Thread Sriram Subramanian (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sriram Subramanian resolved KAFKA-814. -- Resolution: Fixed > Controller should not throw exception when a preferred replica i

[jira] [Closed] (KAFKA-814) Controller should not throw exception when a preferred replica is already the leader for a partition

2013-03-28 Thread Sriram Subramanian (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sriram Subramanian closed KAFKA-814. > Controller should not throw exception when a preferred replica is already the > leader fo

[jira] [Commented] (KAFKA-831) Controller does not send the complete list of partitions to a newly started broker

2013-03-28 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13616806#comment-13616806 ] Jun Rao commented on KAFKA-831: --- Thanks for the patch. +1. > Controller does

[jira] [Commented] (KAFKA-826) Make Kafka 0.8 depend on metrics 2.2.0 instead of 3.x

2013-03-28 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13616783#comment-13616783 ] Joel Koshy commented on KAFKA-826: -- Thank you for looking into this. Metrics 2.x had a few

[jira] [Updated] (KAFKA-831) Controller does not send the complete list of partitions to a newly started broker

2013-03-28 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-831: Attachment: kafka-831-v1.patch - The fix is to switch the order of leader election and sending the l

[jira] [Updated] (KAFKA-831) Controller does not send the complete list of partitions to a newly started broker

2013-03-28 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-831: Status: Patch Available (was: Open) > Controller does not send the complete list of partitions

[jira] [Commented] (KAFKA-832) 0.8 Consumer prevents rebalance if consumer thread is blocked or slow

2013-03-28 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13616742#comment-13616742 ] Neha Narkhede commented on KAFKA-832: - +1, very well thought out. I think shutting down

[jira] [Updated] (KAFKA-826) Make Kafka 0.8 depend on metrics 2.2.0 instead of 3.x

2013-03-28 Thread Dragos Manolescu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dragos Manolescu updated KAFKA-826: --- Labels: build kafka-0.8 metrics (was: kafka-0.8) Status: Patch Available (was: Open) dif

[jira] [Updated] (KAFKA-840) Controller tries to perform preferred replica election on failover before state machines have started up

2013-03-28 Thread Swapnil Ghike (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Swapnil Ghike updated KAFKA-840: Attachment: kafka-840.patch I think the right solution is to move initializeAndMaybeTriggerPartit

[jira] [Created] (KAFKA-840) Controller tries to perform preferred replica election on failover before state machines have started up

2013-03-28 Thread Swapnil Ghike (JIRA)
Swapnil Ghike created KAFKA-840: --- Summary: Controller tries to perform preferred replica election on failover before state machines have started up Key: KAFKA-840 URL: https://issues.apache.org/jira/browse/KAFKA-840

Question about Kafka code contribution guidelines

2013-03-28 Thread Roshanak Afsarifard
Dear Kafka development team, First of all thank you for all your efforts on Kafka. We are considering using Kafka in our software. In order to do so, we need your help to understand the processes in place to manage Intellectual Property, code ownership, and provenance in this project. Can y

[jira] Subscription: outstanding kafka patches

2013-03-28 Thread jira
Issue Subscription Filter: outstanding kafka patches (64 issues) The list of outstanding kafka patches Subscriber: kafka-mailing-list Key Summary KAFKA-832 0.8 Consumer prevents rebalance if consumer thread is blocked or slow https://issues.apache.org/jira/browse/KAF

[jira] [Created] (KAFKA-839) Race condition between flushInterval and flushSchedulerInterval

2013-03-28 Thread Jason Rosenberg (JIRA)
Jason Rosenberg created KAFKA-839: - Summary: Race condition between flushInterval and flushSchedulerInterval Key: KAFKA-839 URL: https://issues.apache.org/jira/browse/KAFKA-839 Project: Kafka

[jira] [Updated] (KAFKA-832) 0.8 Consumer prevents rebalance if consumer thread is blocked or slow

2013-03-28 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-832: -- Attachment: kafka-832.patch Attach a patch, which addresses the deadlock in the following way. 1. AbstractFetch

[jira] [Updated] (KAFKA-832) 0.8 Consumer prevents rebalance if consumer thread is blocked or slow

2013-03-28 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-832: -- Status: Patch Available (was: Open) > 0.8 Consumer prevents rebalance if consumer thread is blocked or slow

Re: Kafka 0.8 release schedule?

2013-03-28 Thread Dragos Manolescu
Thank you Neha! I may be able to help with KAFKA-826... -Dragos On 3/28/13 11:22 AM, "Neha Narkhede" wrote: >Dragos, > >I just created a ticket tracking Kafka 0.8 beta release. The main >blocker is https://issues.apache.org/jira/browse/KAFKA-826 and >https://issues.apache.org/jira/browse/KAFKA-

Re: Kafka 0.8 release schedule?

2013-03-28 Thread Neha Narkhede
Dragos, I just created a ticket tracking Kafka 0.8 beta release. The main blocker is https://issues.apache.org/jira/browse/KAFKA-826 and https://issues.apache.org/jira/browse/KAFKA-330. KAFKA-330 is expecting a patch this week and work on KAFKA-826 has not started. We can release as soon as that i

[jira] [Created] (KAFKA-838) Update design document to match Kafka 0.8 design

2013-03-28 Thread Neha Narkhede (JIRA)
Neha Narkhede created KAFKA-838: --- Summary: Update design document to match Kafka 0.8 design Key: KAFKA-838 URL: https://issues.apache.org/jira/browse/KAFKA-838 Project: Kafka Issue Type: Sub-ta

[jira] [Created] (KAFKA-837) Add 0.7->0.8 migration steps doc

2013-03-28 Thread Neha Narkhede (JIRA)
Neha Narkhede created KAFKA-837: --- Summary: Add 0.7->0.8 migration steps doc Key: KAFKA-837 URL: https://issues.apache.org/jira/browse/KAFKA-837 Project: Kafka Issue Type: Sub-task Affects V

[jira] [Created] (KAFKA-836) Update quickstart for Kafka 0.8

2013-03-28 Thread Neha Narkhede (JIRA)
Neha Narkhede created KAFKA-836: --- Summary: Update quickstart for Kafka 0.8 Key: KAFKA-836 URL: https://issues.apache.org/jira/browse/KAFKA-836 Project: Kafka Issue Type: Sub-task Affects Ve

[jira] [Created] (KAFKA-834) Update Kafka 0.8 website documentation

2013-03-28 Thread Neha Narkhede (JIRA)
Neha Narkhede created KAFKA-834: --- Summary: Update Kafka 0.8 website documentation Key: KAFKA-834 URL: https://issues.apache.org/jira/browse/KAFKA-834 Project: Kafka Issue Type: Task Affects

[jira] [Created] (KAFKA-835) Update 0.8 configs on the website

2013-03-28 Thread Neha Narkhede (JIRA)
Neha Narkhede created KAFKA-835: --- Summary: Update 0.8 configs on the website Key: KAFKA-835 URL: https://issues.apache.org/jira/browse/KAFKA-835 Project: Kafka Issue Type: Sub-task Affects

[jira] [Assigned] (KAFKA-826) Make Kafka 0.8 depend on metrics 2.2.0 instead of 3.x

2013-03-28 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede reassigned KAFKA-826: --- Assignee: Jun Rao > Make Kafka 0.8 depend on metrics 2.2.0 instead of 3.x > --

[jira] [Created] (KAFKA-833) Kafka 0.8 beta release

2013-03-28 Thread Neha Narkhede (JIRA)
Neha Narkhede created KAFKA-833: --- Summary: Kafka 0.8 beta release Key: KAFKA-833 URL: https://issues.apache.org/jira/browse/KAFKA-833 Project: Kafka Issue Type: Task Affects Versions: 0.8

Kafka 0.8 release schedule?

2013-03-28 Thread Dragos Manolescu
Hi -- Jun's Apachecon 2013 slides give March as the expected release for 0.8. I've seen on this list a number of blockers being worked on, and Jira shows a total of 29 blockers/critical/major issues. Could someone with a good grip on these issues and the dev team's velocity please share the lat

[jira] [Created] (KAFKA-832) 0.8 Consumer prevents rebalance if consumer thread is blocked or slow

2013-03-28 Thread Neha Narkhede (JIRA)
Neha Narkhede created KAFKA-832: --- Summary: 0.8 Consumer prevents rebalance if consumer thread is blocked or slow Key: KAFKA-832 URL: https://issues.apache.org/jira/browse/KAFKA-832 Project: Kafka

[jira] [Closed] (KAFKA-829) Mirror maker needs to share the migration tool request channel

2013-03-28 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede closed KAFKA-829. --- > Mirror maker needs to share the migration tool request channel > --

[jira] [Updated] (KAFKA-829) Mirror maker needs to share the migration tool request channel

2013-03-28 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-829: Resolution: Fixed Status: Resolved (was: Patch Available) Changed the visibility of Produce

[jira] [Commented] (KAFKA-829) Mirror maker needs to share the migration tool request channel

2013-03-28 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13616406#comment-13616406 ] Jun Rao commented on KAFKA-829: --- Thanks for the patch. +1. Just one minor comment. Should Pro

[jira] [Created] (KAFKA-831) Controller does not send the complete list of partitions to a newly started broker

2013-03-28 Thread Neha Narkhede (JIRA)
Neha Narkhede created KAFKA-831: --- Summary: Controller does not send the complete list of partitions to a newly started broker Key: KAFKA-831 URL: https://issues.apache.org/jira/browse/KAFKA-831 Project:

[jira] [Closed] (KAFKA-828) Preferred Replica Election does not delete the admin path on controller failover

2013-03-28 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede closed KAFKA-828. --- > Preferred Replica Election does not delete the admin path on controller > failover > --

[jira] [Resolved] (KAFKA-828) Preferred Replica Election does not delete the admin path on controller failover

2013-03-28 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede resolved KAFKA-828. - Resolution: Fixed Committed patch v4 > Preferred Replica Election does not delete

[jira] [Commented] (KAFKA-828) Preferred Replica Election does not delete the admin path on controller failover

2013-03-28 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13616364#comment-13616364 ] Neha Narkhede commented on KAFKA-828: - Thanks for the patch ! +1 > Pre

[jira] [Commented] (KAFKA-253) Refactor the async producer to have only one queue instead of one queue per broker in a Kafka cluster

2013-03-28 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13616361#comment-13616361 ] Jun Rao commented on KAFKA-253: --- No. Since most of the development happens on 0.8, we are onl

Re: 0.8 build problems

2013-03-28 Thread David Arthur
Turns out I needed to remove ~/.sbt Not sure why, or what that means, but it's working now -David On 2/21/13 8:05 PM, Derek Chen-Becker wrote: Reviewed. I added my comments on the ticket. Thanks! On Thu, Feb 21, 2013 at 5:03 PM, Swapnil Ghike wrote: Hi Derek, We probably have a patch for