[jira] [Commented] (KAFKA-202) Make the request processing in kafka asynchonous

2012-01-05 Thread Jun Rao (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13181141#comment-13181141 ] Jun Rao commented on KAFKA-202: --- Overall, the patch looks good. Some comments: 1. KafkaServe

[jira] [Updated] (KAFKA-228) Reduce duplicate messages served by the kafka consumer for uncompressed topics to 0

2012-01-05 Thread Neha Narkhede (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-228: Attachment: kafka-228-v3.patch This patch addresses the comments on patch v1 and includes the change

[jira] [Commented] (KAFKA-228) Reduce duplicate messages served by the kafka consumer for uncompressed topics to 0

2012-01-05 Thread Neha Narkhede (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13181038#comment-13181038 ] Neha Narkhede commented on KAFKA-228: - kafka-228-v2.patch had a bunch of compilation er

[jira] [Updated] (KAFKA-241) ConsumerIterator throws a IllegalStateException after a ConsumerTimeout occurs

2012-01-05 Thread Neha Narkhede (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-241: Labels: newbie (was: ) > ConsumerIterator throws a IllegalStateException after a ConsumerTimeou

Re: skype meeting on replication roadmap

2012-01-05 Thread Jun Rao
Alan, This is fair. The purpose of the meeting is to explain the jiras related to replication and how people can help. I will post meeting minutes after the call. Thanks, Jun On Thu, Jan 5, 2012 at 4:57 PM, Alan D. Cabrera wrote: > I need to point out my personal understanding of the paramete

Re: skype meeting on replication roadmap

2012-01-05 Thread Alan D. Cabrera
I need to point out my personal understanding of the parameters of a conference call meeting. Conference calls can be useful to facilitate design discussions though their use is not encouraged at ASF. It's important that participants understand and abide by the following guidelines: - while c

[jira] [Updated] (KAFKA-241) ConsumerIterator throws a IllegalStateException after a ConsumerTimeout occurs

2012-01-05 Thread Patricio Echague (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patricio Echague updated KAFKA-241: --- Attachment: consumerIteratorTestCase.java > ConsumerIterator throws a IllegalStateExceptio

Re: skype meeting on replication roadmap

2012-01-05 Thread Alan D. Cabrera
I need to point out my personal understanding of the parameters of a conference call meeting. Conference calls can be useful to facilitate design discussions though their use is not encouraged at ASF. It's important that participants understand and abide by the following guidelines: - while c

[jira] [Created] (KAFKA-241) ConsumerIterator throws a IllegalStateException after a ConsumerTimeout occurs

2012-01-05 Thread Patricio Echague (Created) (JIRA)
ConsumerIterator throws a IllegalStateException after a ConsumerTimeout occurs -- Key: KAFKA-241 URL: https://issues.apache.org/jira/browse/KAFKA-241 Project: Kafka

[jira] [Updated] (KAFKA-227) Add Broker Failure Test for a Single Host

2012-01-05 Thread Neha Narkhede (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-227: Resolution: Fixed Status: Resolved (was: Patch Available) > Add Broker Failure Test for

Any chance on getting Kafka published to Maven?

2012-01-05 Thread Alan D. Cabrera
Just wondering. Regards, Alan

[jira] [Commented] (KAFKA-227) Add Broker Failure Test for a Single Host

2012-01-05 Thread Neha Narkhede (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13181000#comment-13181000 ] Neha Narkhede commented on KAFKA-227: - I made the svn propset changes and committed thi

KAFKA-202

2012-01-05 Thread Jay Kreps
We were holding off on the socket server refactoring until after the release was out. Could someone review that patch now so we can get it applied. It is biggish and it is a big pain to keep it rebased so if I could get a review that would be awesome. https://issues.apache.org/jira/browse/KAFKA-20

[jira] [Updated] (KAFKA-202) Make the request processing in kafka asynchonous

2012-01-05 Thread Jay Kreps (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps updated KAFKA-202: Attachment: KAFKA-202-v3.patch Updated patch to current trunk. > Make the request processin

[jira] [Commented] (KAFKA-238) add a getTopicMetaData method in broker and expose it to producer

2012-01-05 Thread Jun Rao (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13180855#comment-13180855 ] Jun Rao commented on KAFKA-238: --- I can see it's useful for the api to support a list of topic

[jira] [Commented] (KAFKA-232) ConsumerConnector has no access to "getOffsetsBefore"

2012-01-05 Thread Edward Capriolo (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13180851#comment-13180851 ] Edward Capriolo commented on KAFKA-232: --- Interesting idea. I am not sure that will wo

[jira] [Commented] (KAFKA-232) ConsumerConnector has no access to "getOffsetsBefore"

2012-01-05 Thread Jun Rao (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13180841#comment-13180841 ] Jun Rao commented on KAFKA-232: --- Do you think you can add meta data in the message itself so

[jira] [Commented] (KAFKA-227) Add Broker Failure Test for a Single Host

2012-01-05 Thread Neha Narkhede (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13180801#comment-13180801 ] Neha Narkhede commented on KAFKA-227: - This is a great patch ! Just one comment. The *s

[jira] [Updated] (KAFKA-227) Add Broker Failure Test for a Single Host

2012-01-05 Thread John Fung (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Fung updated KAFKA-227: Attachment: KAFKA-227-v3.patch KAFKA-227-v3.patch has the following changes: 1. Terminating processes clean

[jira] [Commented] (KAFKA-238) add a getTopicMetaData method in broker and expose it to producer

2012-01-05 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13180736#comment-13180736 ] Jay Kreps commented on KAFKA-238: - One general recommendation I have is that we think about

Re: skype meeting on replication roadmap

2012-01-05 Thread Jun Rao
Hi, everyone, So far, the following people have sent me their skype id: Joe, David, Jeffrey, and Andrew. So the meeting is on. I encourage everyone to look at the design doc in kafka-50 and the new wire format at https://cwiki.apache.org/confluence/display/KAFKA/New+Wire+Format+Proposalbefore th

[jira] [Issue Comment Edited] (KAFKA-238) add a getTopicMetaData method in broker and expose it to producer

2012-01-05 Thread Neha Narkhede (Issue Comment Edited) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13180715#comment-13180715 ] Neha Narkhede edited comment on KAFKA-238 at 1/5/12 7:07 PM: - A

[jira] [Commented] (KAFKA-50) kafka intra-cluster replication support

2012-01-05 Thread Jun Rao (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-50?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13180712#comment-13180712 ] Jun Rao commented on KAFKA-50: -- Here is a breakdown of all the jiras and their dependencies: 1

[jira] Subscription: outstanding kafka patches

2012-01-05 Thread jira
Issue Subscription Filter: outstanding kafka patches (13 issues) The list of outstanding kafka patches Subscriber: kafka-mailing-list Key Summary KAFKA-228 Reduce duplicate messages served by the kafka consumer for uncompressed topics to 0 https://issues.apache.org/j

[jira] [Created] (KAFKA-240) implement new producer and consumer request format

2012-01-05 Thread Jun Rao (Created) (JIRA)
implement new producer and consumer request format -- Key: KAFKA-240 URL: https://issues.apache.org/jira/browse/KAFKA-240 Project: Kafka Issue Type: Sub-task Components: core

[jira] [Created] (KAFKA-239) Wire existing producer and consumer to use the new ZK data structure

2012-01-05 Thread Jun Rao (Created) (JIRA)
Wire existing producer and consumer to use the new ZK data structure Key: KAFKA-239 URL: https://issues.apache.org/jira/browse/KAFKA-239 Project: Kafka Issue Type: Sub-task

[jira] [Commented] (KAFKA-238) add a getTopicMetaData method in broker and expose it to producer

2012-01-05 Thread Jun Rao (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13180677#comment-13180677 ] Jun Rao commented on KAFKA-238: --- We can potentially piggy-back auto topic creation on the get

[jira] [Created] (KAFKA-238) add a getTopicMetaData method in broker and expose it to producer

2012-01-05 Thread Jun Rao (Created) (JIRA)
add a getTopicMetaData method in broker and expose it to producer -- Key: KAFKA-238 URL: https://issues.apache.org/jira/browse/KAFKA-238 Project: Kafka Issue Type: Sub-task

[jira] [Updated] (KAFKA-237) create/delete ZK path for a topic in an admin tool

2012-01-05 Thread Jun Rao (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-237: -- Component/s: core > create/delete ZK path for a topic in an admin tool > ---

[jira] [Created] (KAFKA-237) create/delete ZK path for a topic in an admin tool

2012-01-05 Thread Jun Rao (Created) (JIRA)
create/delete ZK path for a topic in an admin tool -- Key: KAFKA-237 URL: https://issues.apache.org/jira/browse/KAFKA-237 Project: Kafka Issue Type: Sub-task Reporter: Jun Rao Thi

[jira] [Updated] (KAFKA-50) kafka intra-cluster replication support

2012-01-05 Thread Jun Rao (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-50?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-50: - Attachment: kafka_replication_detailed_design_v2.pdf Attach v2 of the detailed design doc. Made 2 minor changes: 1

[jira] [Commented] (KAFKA-235) Add a 'log.file.age' configuration parameter to force rotation of log files after they've reached a certain age

2012-01-05 Thread Jun Rao (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13180532#comment-13180532 ] Jun Rao commented on KAFKA-235: --- This seems like a useful feature, in particular for kafka-23

[jira] [Commented] (KAFKA-236) Make 'autooffset.reset' accept a delay in addition to {smallest,largest}

2012-01-05 Thread Jun Rao (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13180528#comment-13180528 ] Jun Rao commented on KAFKA-236: --- To reset the offset, under the cover, we use getLastestOffs

[jira] [Created] (KAFKA-236) Make 'autooffset.reset' accept a delay in addition to {smallest,largest}

2012-01-05 Thread Mathias Herberts (Created) (JIRA)
Make 'autooffset.reset' accept a delay in addition to {smallest,largest} Key: KAFKA-236 URL: https://issues.apache.org/jira/browse/KAFKA-236 Project: Kafka Issue Type:

[jira] [Created] (KAFKA-235) Add a 'log.file.age' configuration parameter to force rotation of log files after they've reached a certain age

2012-01-05 Thread Mathias Herberts (Created) (JIRA)
Add a 'log.file.age' configuration parameter to force rotation of log files after they've reached a certain age --- Key: KAFKA-235 URL: https://issues.apac