[jira] [Updated] (KAFKA-514) Replication with Leader Failure Test: Log segment files checksum mismatch

2012-10-05 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-514: -- Attachment: kafka-514_v2.patch Attach patch v2 (includes v1 changes). This is just a temporary fix for kafka-55

[jira] [Commented] (KAFKA-551) Log.truncateTo() may need to trucate immutable log segment

2012-10-05 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13470900#comment-13470900 ] Jun Rao commented on KAFKA-551: --- Currently, we mark the first n-1 segments as read-only chann

[jira] [Updated] (KAFKA-510) broker needs to know the replication factor per partition

2012-10-05 Thread Yang Ye (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Ye updated KAFKA-510: -- Attachment: kafka_510_v4.diff I still use toString() instead of toZkString() in leaderAndISR, because I find w

[jira] [Commented] (KAFKA-551) Log.truncateTo() may need to trucate immutable log segment

2012-10-05 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13470879#comment-13470879 ] Jay Kreps commented on KAFKA-551: - I think the simplest solution would just be to open all

[jira] [Created] (KAFKA-551) Log.truncateTo() may need to trucate immutable log segment

2012-10-05 Thread Jun Rao (JIRA)
Jun Rao created KAFKA-551: - Summary: Log.truncateTo() may need to trucate immutable log segment Key: KAFKA-551 URL: https://issues.apache.org/jira/browse/KAFKA-551 Project: Kafka Issue Type: Bug

[jira] [Created] (KAFKA-550) Wildcarded consumption is single-threaded

2012-10-05 Thread Joel Koshy (JIRA)
Joel Koshy created KAFKA-550: Summary: Wildcarded consumption is single-threaded Key: KAFKA-550 URL: https://issues.apache.org/jira/browse/KAFKA-550 Project: Kafka Issue Type: Bug Rep

[jira] [Commented] (KAFKA-549) ConsumerOffsetChecker does not deal with hostnames published in zookeeper

2012-10-05 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13470834#comment-13470834 ] Joel Koshy commented on KAFKA-549: -- +1 Thanks for the patch. I'll get this checked-in to

[jira] [Commented] (KAFKA-514) Replication with Leader Failure Test: Log segment files checksum mismatch

2012-10-05 Thread John Fung (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13470790#comment-13470790 ] John Fung commented on KAFKA-514: - Thanks Jun for the fix. * This testcase consistently fa

[jira] [Updated] (KAFKA-514) Replication with Leader Failure Test: Log segment files checksum mismatch

2012-10-05 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-514: -- Attachment: kafka-514_v1.patch This seems to be the same problem as in kafka-525, which is supposed to be fixed

[jira] [Updated] (KAFKA-42) Support rebalancing the partitions with replication

2012-10-05 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-42?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-42: - Comment: was deleted (was: This seems to be the same problem as in kafka-525, which is supposed to be fixed in kaf

[jira] [Updated] (KAFKA-42) Support rebalancing the partitions with replication

2012-10-05 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-42?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-42: - Attachment: (was: kafka-514_v1.patch) > Support rebalancing the partitions with replication > -

[jira] [Updated] (KAFKA-42) Support rebalancing the partitions with replication

2012-10-05 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-42?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-42: - Attachment: kafka-514_v1.patch This seems to be the same problem as in kafka-525, which is supposed to be fixed in

Re: [DISCUSS] Kafka graduation resolution

2012-10-05 Thread Jun Rao
Alan, Committer list is now updated. Could you sign off? Thanks, Jun On Wed, Sep 26, 2012 at 3:50 PM, Alan D. Cabrera wrote: > > On Sep 26, 2012, at 3:18 PM, Jakob Homan wrote: > > > OK, everybody's good to go. I'll add the new three new committers in the > > text to be VOTED on and call the

[jira] [Commented] (KAFKA-514) Replication with Leader Failure Test: Log segment files checksum mismatch

2012-10-05 Thread John Fung (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13470753#comment-13470753 ] John Fung commented on KAFKA-514: - Uploaded kafka-514-reproduce-issue.patch to reproduce th

[jira] [Updated] (KAFKA-514) Replication with Leader Failure Test: Log segment files checksum mismatch

2012-10-05 Thread John Fung (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Fung updated KAFKA-514: Attachment: kafka-514-reproduce-issue.patch > Replication with Leader Failure Test: Log segment files ch

[jira] [Updated] (KAFKA-549) ConsumerOffsetChecker does not deal with hostnames published in zookeeper

2012-10-05 Thread Bob Cotton (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Cotton updated KAFKA-549: - Fix Version/s: (was: 0.7.2) > ConsumerOffsetChecker does not deal with hostnames published in zook

[jira] [Updated] (KAFKA-549) ConsumerOffsetChecker does not deal with hostnames published in zookeeper

2012-10-05 Thread Bob Cotton (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Cotton updated KAFKA-549: - Attachment: KAFKA-549-hostnames-in-zookeeper.diff > ConsumerOffsetChecker does not deal with hostnames

[jira] [Updated] (KAFKA-549) ConsumerOffsetChecker does not deal with hostnames published in zookeeper

2012-10-05 Thread Bob Cotton (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Cotton updated KAFKA-549: - Fix Version/s: 0.7.2 Labels: patch (was: ) Status: Patch Available (was: Open)

[jira] [Created] (KAFKA-549) ConsumerOffsetChecker does not deal with hostnames published in zookeeper

2012-10-05 Thread Bob Cotton (JIRA)
Bob Cotton created KAFKA-549: Summary: ConsumerOffsetChecker does not deal with hostnames published in zookeeper Key: KAFKA-549 URL: https://issues.apache.org/jira/browse/KAFKA-549 Project: Kafka

[jira] [Commented] (KAFKA-504) UnsatisfiedLinkError causes snappy unit tests to fail on hudson server

2012-10-05 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13470659#comment-13470659 ] Joe Stein commented on KAFKA-504: - patch applies cleanly, tests passed, lets see how it goe

[jira] [Updated] (KAFKA-506) Store logical offset in log

2012-10-05 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps updated KAFKA-506: Attachment: KAFKA-506-phase-2-v5.patch Rebased patch and improved error message for the MessageSizeTooLargeE

[jira] [Commented] (KAFKA-502) Simplify setup / initialization in replication_basic_test.py

2012-10-05 Thread John Fung (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13470614#comment-13470614 ] John Fung commented on KAFKA-502: - Uploaded kafka-v6.patch with the following change: 51.

snappy unit test failure patch

2012-10-05 Thread Jay Kreps
Guys, There is a patch here that would avoid this snappy unit test failure that we keep having: https://issues.apache.org/jira/browse/KAFKA-504 It is < 10 lines long and waiting for a review. -Jay

[jira] [Updated] (KAFKA-502) Simplify setup / initialization in replication_basic_test.py

2012-10-05 Thread John Fung (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Fung updated KAFKA-502: Attachment: kafka-502-v6.patch > Simplify setup / initialization in replication_basic_test.py >

[jira] [Commented] (KAFKA-544) Retain key in producer

2012-10-05 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13470610#comment-13470610 ] Jay Kreps commented on KAFKA-544: - After looking at the code I think there is a fair amount

[jira] [Updated] (KAFKA-546) Fix commit() in zk consumer for compressed messages

2012-10-05 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps updated KAFKA-546: Summary: Fix commit() in zk consumer for compressed messages (was: Fix commit() in zk consumer) > Fix

[jira] [Commented] (KAFKA-506) Store logical offset in log

2012-10-05 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13470497#comment-13470497 ] Jay Kreps commented on KAFKA-506: - jkreps-mn:kafka-git jkreps$ git pull remote: Counting ob

Re: producer changes

2012-10-05 Thread Jay Kreps
Okay, I looked into this more. I think there are actually a number of changes that should be made here, and it might be better to really think it through and do a more serious project to get this right. So three things to discuss: - I propose we make no change in the producer api in 0.8. Return

[jira] [Commented] (KAFKA-502) Simplify setup / initialization in replication_basic_test.py

2012-10-05 Thread John Fung (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13470473#comment-13470473 ] John Fung commented on KAFKA-502: - Thanks Jun for reviewing. Uploaded kafka-v5.patch with t

[jira] [Updated] (KAFKA-502) Simplify setup / initialization in replication_basic_test.py

2012-10-05 Thread John Fung (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Fung updated KAFKA-502: Attachment: kafka-502-v5.patch > Simplify setup / initialization in replication_basic_test.py >

[jira] [Commented] (KAFKA-510) broker needs to know the replication factor per partition

2012-10-05 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13470437#comment-13470437 ] Jun Rao commented on KAFKA-510: --- Thanks for the patch. A few more comments: 30. KafkaApis: T

[jira] [Closed] (KAFKA-508) split out partiondata from fetchresponse and producerrequest

2012-10-05 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein closed KAFKA-508. --- committed patch removing the extends typo i had left in as Joel caught, thanks! << we should be able to remove pa

[jira] [Updated] (KAFKA-508) split out partiondata from fetchresponse and producerrequest

2012-10-05 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-508: Resolution: Fixed Status: Resolved (was: Patch Available) > split out partiondata from fetchres

Re: Community growth ...

2012-10-05 Thread Jun Rao
Benson, Thanks for checking. Since Apache Kafka was started, we have added 3 new committers, each from a different company. The adoption of Kafka has also been increasing significantly. In the Oct report, we just documented the incremental change since last quater. Now that we are preparing for gr

[jira] [Created] (KAFKA-548) remove partition from ProducerRequestPartitionData and FetchResponsePartitionData

2012-10-05 Thread Joe Stein (JIRA)
Joe Stein created KAFKA-548: --- Summary: remove partition from ProducerRequestPartitionData and FetchResponsePartitionData Key: KAFKA-548 URL: https://issues.apache.org/jira/browse/KAFKA-548 Project: Kafka

[jira] [Updated] (KAFKA-474) support changing host/port of a broker

2012-10-05 Thread David Arthur (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Arthur updated KAFKA-474: --- Attachment: KAFKA-474.patch Something as simple as this? > support changing host/port

[jira] [Updated] (KAFKA-547) The ConsumerStats MBean name should include the groupid

2012-10-05 Thread Michael Tamm (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Tamm updated KAFKA-547: --- Attachment: 0001-consumer-stats-MBean-name-includes-the-group-id-now.patch I have attached a patch whi

[jira] [Created] (KAFKA-547) The ConsumerStats MBean name should include the groupid

2012-10-05 Thread Michael Tamm (JIRA)
Michael Tamm created KAFKA-547: -- Summary: The ConsumerStats MBean name should include the groupid Key: KAFKA-547 URL: https://issues.apache.org/jira/browse/KAFKA-547 Project: Kafka Issue Type: I