[jira] [Created] (KAFKA-536) Kafka async appender/producer looses most messages

2012-09-28 Thread nicu marasoiu (JIRA)
nicu marasoiu created KAFKA-536: --- Summary: Kafka async appender/producer looses most messages Key: KAFKA-536 URL: https://issues.apache.org/jira/browse/KAFKA-536 Project: Kafka Issue Type: Bug

Re: [VOTE] Release Kafka 0.7.2-incubating (Candidate 4)

2012-09-28 Thread Jun Rao
+1. Checked LICENSE and NOTICE. Quickstart commands work. Thanks, Jun On Wed, Sep 26, 2012 at 6:06 PM, Joe Stein wrote: > Hello, > > This is the fourth candidate for the third incubator release for Apache > Kafka, version 0.7.2-incubating > > This release fixes the following issues > > http://

[jira] [Created] (KAFKA-537) expose clientId and correlationId in ConsumerConfig

2012-09-28 Thread Jun Rao (JIRA)
Jun Rao created KAFKA-537: - Summary: expose clientId and correlationId in ConsumerConfig Key: KAFKA-537 URL: https://issues.apache.org/jira/browse/KAFKA-537 Project: Kafka Issue Type: Bug C

[jira] [Updated] (KAFKA-532) Multiple controllers can co-exist during soft failures

2012-09-28 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-532: Attachment: kafka-532-v1.patch Introduced a controller generation/epoch that increments after a succ

[jira] [Updated] (KAFKA-532) Multiple controllers can co-exist during soft failures

2012-09-28 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-532: Status: Patch Available (was: In Progress) > Multiple controllers can co-exist during soft fail

Re: [VOTE] Release Kafka 0.7.2-incubating (Candidate 4)

2012-09-28 Thread Jay Kreps
+1 -Jay On Fri, Sep 28, 2012 at 8:28 AM, Jun Rao wrote: > +1. Checked LICENSE and NOTICE. Quickstart commands work. > > Thanks, > > Jun > > On Wed, Sep 26, 2012 at 6:06 PM, Joe Stein wrote: > > > Hello, > > > > This is the fourth candidate for the third incubator release for Apache > > Kafka,

Re: [VOTE] Release Kafka 0.7.2-incubating (Candidate 4)

2012-09-28 Thread Joel Koshy
Rat fails on the system_test/common/util.sh as it is missing the license. Joel On Friday, September 28, 2012, Jay Kreps wrote: > +1 > > -Jay > > On Fri, Sep 28, 2012 at 8:28 AM, Jun Rao > > wrote: > > > +1. Checked LICENSE and NOTICE. Quickstart commands work. > > > > Thanks, > > > > Jun > > > >

[jira] [Commented] (KAFKA-528) IndexOutOfBoundsException thrown by kafka.consumer.ConsumerFetcherThread

2012-09-28 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13465852#comment-13465852 ] Jay Kreps commented on KAFKA-528: - +1 Lgtm. You made the logging for leaderAndIsr request

[jira] [Updated] (KAFKA-509) server should shut down on encountering invalid highwatermark file

2012-09-28 Thread Yang Ye (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Ye updated KAFKA-509: -- Attachment: kafka_509_v1.diff 1 If tempHwFile already exists, we can just overwrite it since we know hwFile is

[jira] [Updated] (KAFKA-506) Store logical offset in log

2012-09-28 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps updated KAFKA-506: Attachment: KAFKA-506-phase-2-v2.patch > Store logical offset in log > --- > >

[jira] [Updated] (KAFKA-506) Store logical offset in log

2012-09-28 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps updated KAFKA-506: Attachment: (was: KAFKA-506-phase-2-v2.patch) > Store logical offset in log > --

[jira] [Updated] (KAFKA-506) Store logical offset in log

2012-09-28 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps updated KAFKA-506: Attachment: KAFKA-506-phase-2-v2.patch > Store logical offset in log > --- > >

[jira] [Commented] (KAFKA-502) Simplify setup / initialization in replication_basic_test.py

2012-09-28 Thread John Fung (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13465896#comment-13465896 ] John Fung commented on KAFKA-502: - kafka-502-v1.patch This patch contains changes for the

MULTI FETCH RESPONSE Wire Format for Kafka 0.7.1

2012-09-28 Thread Milind Parikh
What is the wire format for MULTI-FETCH *RESPONSE* *given *that the SINGLE-FETCH RESPONSE LOOKS like this: RESPONSE_HEADER ResponseLength:32/integer ErrorCode:16/integer MESSAGES

[jira] [Commented] (KAFKA-506) Store logical offset in log

2012-09-28 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13465936#comment-13465936 ] Jay Kreps commented on KAFKA-506: - Three preliminary comments from Neha while she does deep

Re: [DISCUSS] Kafka graduation resolution

2012-09-28 Thread Joel Koshy
Updated the list. Thanks, Joel On Wed, Sep 26, 2012 at 3:50 PM, Alan D. Cabrera wrote: > > On Sep 26, 2012, at 3:18 PM, Jakob Homan wrote: > > > OK, everybody's good to go. I'll add the new three new committers in the > > text to be VOTED on and call the vote soon. Before that, though, there'

[jira] [Updated] (KAFKA-502) Simplify setup / initialization in replication_basic_test.py

2012-09-28 Thread John Fung (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Fung updated KAFKA-502: Attachment: kafka-502-v1.patch > Simplify setup / initialization in replication_basic_test.py >

[jira] [Updated] (KAFKA-502) Simplify setup / initialization in replication_basic_test.py

2012-09-28 Thread John Fung (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Fung updated KAFKA-502: Status: Patch Available (was: Open) > Simplify setup / initialization in replication_basic_test.py > --

[jira] [Comment Edited] (KAFKA-502) Simplify setup / initialization in replication_basic_test.py

2012-09-28 Thread John Fung (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13465896#comment-13465896 ] John Fung edited comment on KAFKA-502 at 9/29/12 9:37 AM: -- kafka-5

[jira] [Commented] (KAFKA-506) Store logical offset in log

2012-09-28 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13465976#comment-13465976 ] Neha Narkhede commented on KAFKA-506: - 2 additions to the preliminary comments - - 3 un

Re: MULTI FETCH RESPONSE Wire Format for Kafka 0.7.1

2012-09-28 Thread Milind Parikh
After doing a little wire-snooping of the data, it appears that the MULTI-FETCH RESPONSE is EXACTLY the same as the SINGLE-FETCH. If this is correct, how does one advance to the next offset for each one of the topic-partition combo if reading multiple topic-partitions in parallel; given that the i

[jira] [Commented] (KAFKA-528) IndexOutOfBoundsException thrown by kafka.consumer.ConsumerFetcherThread

2012-09-28 Thread John Fung (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13466002#comment-13466002 ] John Fung commented on KAFKA-528: - Tested kafka-528.patch with rev. 1389460 and there is no

[jira] [Comment Edited] (KAFKA-528) IndexOutOfBoundsException thrown by kafka.consumer.ConsumerFetcherThread

2012-09-28 Thread John Fung (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13466002#comment-13466002 ] John Fung edited comment on KAFKA-528 at 9/29/12 10:21 AM: --- 1. Te

[jira] [Updated] (KAFKA-529) kafka.server.ReplicaFetcherThread: java.lang.IndexOutOfBoundsException

2012-09-28 Thread John Fung (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Fung updated KAFKA-529: Priority: Blocker (was: Major) > kafka.server.ReplicaFetcherThread: java.lang.IndexOutOfBoundsException

Re: [VOTE] Release Kafka 0.7.2-incubating (Candidate 4)

2012-09-28 Thread Joe Stein
confirmed, will open JIRA, commit file with the license header and role RC5 I will also add to my notes to make sure to run and review rat before packaging a release I am also going to add the apache license to the sbt script it seems appropriate if we are going through and updating this same rat

Re: [VOTE] Release Kafka 0.7.2-incubating (Candidate 4)

2012-09-28 Thread Joel Koshy
Thanks Joe. That sounds good - I didn't notice sbt. Joel On Fri, Sep 28, 2012 at 4:54 PM, Joe Stein wrote: > confirmed, will open JIRA, commit file with the license header and role RC5 > > I will also add to my notes to make sure to run and review rat before > packaging a release > > I am also

[jira] [Created] (KAFKA-538) missing apache header in sbt and util.h

2012-09-28 Thread Joe Stein (JIRA)
Joe Stein created KAFKA-538: --- Summary: missing apache header in sbt and util.h Key: KAFKA-538 URL: https://issues.apache.org/jira/browse/KAFKA-538 Project: Kafka Issue Type: Improvement

[jira] [Updated] (KAFKA-538) missing apache header in sbt and util.h

2012-09-28 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-538: Attachment: KAFKA-538.patch > missing apache header in sbt and util.h >

[jira] [Updated] (KAFKA-538) missing apache header in sbt and util.h

2012-09-28 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-538: Status: Patch Available (was: Open) > missing apache header in sbt and util.h > ---

[jira] [Updated] (KAFKA-538) missing apache license header in sbt and util.h

2012-09-28 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-538: Summary: missing apache license header in sbt and util.h (was: missing apache header in sbt and util.h)

[jira] [Updated] (KAFKA-538) missing apache license header in sbt and util.h

2012-09-28 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-538: Resolution: Fixed Status: Resolved (was: Patch Available) committed to trunk, 0.7.2, 0.8

[jira] [Closed] (KAFKA-538) missing apache license header in sbt and util.h

2012-09-28 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein closed KAFKA-538. --- > missing apache license header in sbt and util.h > --- > >

[jira] [Updated] (KAFKA-528) IndexOutOfBoundsException thrown by kafka.consumer.ConsumerFetcherThread

2012-09-28 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-528: -- Attachment: kafka-528_v2.patch Attach patch v2. Fixed one additional bug in KafkaController. The bug is that Ma

[jira] [Comment Edited] (KAFKA-528) IndexOutOfBoundsException thrown by kafka.consumer.ConsumerFetcherThread

2012-09-28 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13466086#comment-13466086 ] Jun Rao edited comment on KAFKA-528 at 9/29/12 1:14 PM: Attach patc

[VOTE] Release Kafka 0.7.2-incubating (Candidate 5)

2012-09-28 Thread Joe Stein
Hello, This is the fifth candidate for the third incubator release for Apache Kafka, version 0.7.2-incubating. This release fixes the following issues http://people.apache.org/~joestein/kafka-0.7.2-incubating-candidate-5/RELEASE-NOTES.html *** Please download, test and vote by Monday October, 1s