[jira] [Updated] (KAFKA-267) Enhance ProducerPerformance to generate unique random Long value for payload

2012-11-01 Thread Yang Ye (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Ye updated KAFKA-267: -- Attachment: kafka_267_additional.diff This is a follow up patch in order to simulate real data load. Before we

[jira] [Updated] (KAFKA-491) KafkaRequestHandler needs to handle exceptions

2012-11-01 Thread Yang Ye (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Ye updated KAFKA-491: -- Attachment: kafka-491-v2.diff Fixed comments 1.1, 1.2, 1.4, 2 For 1.3, It seems not easy to do that, if we hav

[jira] [Updated] (KAFKA-577) extend DumpLogSegments to verify consistency btw data and index

2012-11-01 Thread Yang Ye (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Ye updated KAFKA-577: -- Attachment: kafka_577_v3.diff cache all verification failure and print out at the end, not verified by real da

[jira] [Created] (KAFKA-598) decouple fetch size from max message size

2012-11-01 Thread Jun Rao (JIRA)
Jun Rao created KAFKA-598: - Summary: decouple fetch size from max message size Key: KAFKA-598 URL: https://issues.apache.org/jira/browse/KAFKA-598 Project: Kafka Issue Type: Bug Components:

[jira] [Commented] (KAFKA-574) KafkaController unnecessarily reads leaderAndIsr info from ZK

2012-11-01 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13488810#comment-13488810 ] Jun Rao commented on KAFKA-574: --- Thanks for patch v2. Just one more comment: 20. ReplicaSate

[jira] [Commented] (KAFKA-545) Add a Performance Suite for the Log subsystem

2012-11-01 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13488832#comment-13488832 ] Jay Kreps commented on KAFKA-545: - Same test now with 20 seconds worth of data accumulating

[jira] [Commented] (KAFKA-545) Add a Performance Suite for the Log subsystem

2012-11-01 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13488843#comment-13488843 ] Neha Narkhede commented on KAFKA-545: - Makes sense, are the reads in your test using NI

[jira] [Commented] (KAFKA-545) Add a Performance Suite for the Log subsystem

2012-11-01 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1344#comment-1344 ] Jay Kreps commented on KAFKA-545: - Yes, for the above data everything is done on a FileChan

[jira] [Commented] (KAFKA-532) Multiple controllers can co-exist during soft failures

2012-11-01 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13488893#comment-13488893 ] Jun Rao commented on KAFKA-532: --- Thanks for patch v3. The overall approach seems to work. Som

[jira] Subscription: outstanding kafka patches

2012-11-01 Thread jira
Issue Subscription Filter: outstanding kafka patches (56 issues) The list of outstanding kafka patches Subscriber: kafka-mailing-list Key Summary KAFKA-593 Empty log index file created when it shouldn't be empty https://issues.apache.org/jira/browse/KAFKA-593 KAFKA-58

[jira] [Commented] (KAFKA-545) Add a Performance Suite for the Log subsystem

2012-11-01 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13488985#comment-13488985 ] Jay Kreps commented on KAFKA-545: - Okay, wrote some tests for lockin MappedByteBuffer and F

[jira] [Assigned] (KAFKA-596) LogSegment.firstAppendTime not reset after truncate to

2012-11-01 Thread Swapnil Ghike (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Swapnil Ghike reassigned KAFKA-596: --- Assignee: Swapnil Ghike > LogSegment.firstAppendTime not reset after truncate to > ---

[jira] [Updated] (KAFKA-596) LogSegment.firstAppendTime not reset after truncate to

2012-11-01 Thread Swapnil Ghike (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Swapnil Ghike updated KAFKA-596: Attachment: kafka-596.patch Yes, that's a pretty sharp observation. The current time based roll poli

[jira] [Assigned] (KAFKA-546) Fix commit() in zk consumer for compressed messages

2012-11-01 Thread Swapnil Ghike (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Swapnil Ghike reassigned KAFKA-546: --- Assignee: Swapnil Ghike > Fix commit() in zk consumer for compressed messages > --

[jira] [Updated] (KAFKA-574) KafkaController unnecessarily reads leaderAndIsr info from ZK

2012-11-01 Thread Prashanth Menon (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashanth Menon updated KAFKA-574: -- Attachment: KAFKA-574-v3.patch Thanks for the review, Jun. I've attached a new patch. 20. Wow,

[jira] [Commented] (KAFKA-532) Multiple controllers can co-exist during soft failures

2012-11-01 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13489181#comment-13489181 ] Neha Narkhede commented on KAFKA-532: - >> 34. KafkaController: There seems to be a tric

[jira] [Commented] (KAFKA-188) Support multiple data directories

2012-11-01 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13489184#comment-13489184 ] Jun Rao commented on KAFKA-188: --- +1 on patch v8. Thanks, > Support multiple

[jira] [Updated] (KAFKA-546) Fix commit() in zk consumer for compressed messages

2012-11-01 Thread Swapnil Ghike (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Swapnil Ghike updated KAFKA-546: Attachment: kafka-546-v1.patch 1. ConsumerIterator skips messages that have already been fetched. 2

[jira] [Comment Edited] (KAFKA-546) Fix commit() in zk consumer for compressed messages

2012-11-01 Thread Swapnil Ghike (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13489191#comment-13489191 ] Swapnil Ghike edited comment on KAFKA-546 at 11/2/12 1:34 AM: --

[jira] [Commented] (KAFKA-513) Add state change log to Kafka brokers

2012-11-01 Thread Swapnil Ghike (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13489201#comment-13489201 ] Swapnil Ghike commented on KAFKA-513: - Hi Prashanth, How far along are you in this ji

[jira] [Resolved] (KAFKA-491) KafkaRequestHandler needs to handle exceptions

2012-11-01 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-491. --- Resolution: Fixed Thanks for patch v2. +1. Committed to 0.8. > KafkaRequestHandler needs to h

[jira] [Closed] (KAFKA-491) KafkaRequestHandler needs to handle exceptions

2012-11-01 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao closed KAFKA-491. - > KafkaRequestHandler needs to handle exceptions > -- > >

[jira] [Commented] (KAFKA-513) Add state change log to Kafka brokers

2012-11-01 Thread Prashanth Menon (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13489205#comment-13489205 ] Prashanth Menon commented on KAFKA-513: --- Hi guys - still haven't had an opportunity t

[jira] [Updated] (KAFKA-577) extend DumpLogSegments to verify consistency btw data and index

2012-11-01 Thread Yang Ye (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Ye updated KAFKA-577: -- Attachment: kafka_577_v4.diff 1. also "do it in batch" for dumpLog() function 2. use scala HashMap instead of

[jira] [Updated] (KAFKA-593) Empty log index file created when it shouldn't be empty

2012-11-01 Thread Yang Ye (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Ye updated KAFKA-593: -- Attachment: kafka_593_v1.diff Basically the problem was during restarting the server and truncation from exist

[jira] [Commented] (KAFKA-577) extend DumpLogSegments to verify consistency btw data and index

2012-11-01 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13489255#comment-13489255 ] Jun Rao commented on KAFKA-577: --- A couple of more comments for patch v4. 40. LinkedList is s

[jira] [Commented] (KAFKA-593) Empty log index file created when it shouldn't be empty

2012-11-01 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13489260#comment-13489260 ] Jun Rao commented on KAFKA-593: --- Thanks for the patch. A couple of comments: 1. Log.rollToOf

[jira] [Commented] (KAFKA-596) LogSegment.firstAppendTime not reset after truncate to

2012-11-01 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13489266#comment-13489266 ] Jun Rao commented on KAFKA-596: --- Thanks for the patch. A couple of comments: 1. Log.maybeRo

Re: Maintainer system?

2012-11-01 Thread Jun Rao
I think that's a good idea. It will be good to have at least 2 maintainers per component. I'd encourage more people to review patches. The more patches one reviews, the more familiar he/she is with the components. Thanks, Jun On Thu, Oct 4, 2012 at 1:13 PM, Jay Kreps wrote: > Hey guys, > > Th