[jira] [Issue Comment Edited] (KAFKA-320) testZKSendWithDeadBroker fails intermittently due to ZKNodeExistsException

2012-03-29 Thread Jun Rao (Issue Comment Edited) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13241396#comment-13241396 ] Jun Rao edited comment on KAFKA-320 at 3/29/12 5:21 PM: That

[jira] [Commented] (KAFKA-320) testZKSendWithDeadBroker fails intermittently due to ZKNodeExistsException

2012-03-29 Thread Jun Rao (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13241396#comment-13241396 ] Jun Rao commented on KAFKA-320: --- That's a good finding. We should probably patch i

Re: max bytes

2012-03-29 Thread Jun Rao
Here is another thought. An alternative is to take the fetch.size in consumer config and divide it among all partitions. Initially, this can be just simple even distribution. Later on, we can be a bit smarter and give larger partitions larger fetch size. Thanks, Jun On Thu, Mar 29, 2012 at 1:51

[jira] [Commented] (KAFKA-249) Separate out Kafka mirroring into a stand-alone app

2012-03-27 Thread Jun Rao (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13240166#comment-13240166 ] Jun Rao commented on KAFKA-249: --- Thanks for the patch. Some comments: 1. For fu

[jira] [Resolved] (KAFKA-305) SyncProducer does not correctly timeout

2012-03-26 Thread Jun Rao (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-305. --- Resolution: Fixed Fix Version/s: 0.8 Assignee: Prashanth Menon Prashanth, Thanks for the

[jira] [Commented] (KAFKA-318) update zookeeper dependency to 3.3.5

2012-03-26 Thread Jun Rao (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13238470#comment-13238470 ] Jun Rao commented on KAFKA-318: --- Pierre-Yves, Thanks for the patch. Could you summarize

[jira] [Created] (KAFKA-316) disallow recursively compressed message

2012-03-23 Thread Jun Rao (Created) (JIRA)
disallow recursively compressed message --- Key: KAFKA-316 URL: https://issues.apache.org/jira/browse/KAFKA-316 Project: Kafka Issue Type: Improvement Components: core Reporter: Jun

[jira] [Updated] (KAFKA-315) enable shallow iterator in ByteBufferMessageSet to allow mirroing data without decompression

2012-03-23 Thread Jun Rao (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-315: -- Status: Patch Available (was: Open) patch attached. > enable shallow iterator

[jira] [Updated] (KAFKA-315) enable shallow iterator in ByteBufferMessageSet to allow mirroing data without decompression

2012-03-23 Thread Jun Rao (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-315: -- Attachment: kafka-315.patch > enable shallow iterator in ByteBufferMessageSet to allow mirroing d

[jira] [Created] (KAFKA-315) enable shallow iterator in ByteBufferMessageSet to allow mirroing data without decompression

2012-03-23 Thread Jun Rao (Created) (JIRA)
Project: Kafka Issue Type: Improvement Components: core Reporter: Jun Rao Assignee: Jun Rao Fix For: 0.7.1 Attachments: kafka-315.patch Currently, the iterator of ByteBufferMessageSet does deep iteration, ie, if messages are

[jira] [Commented] (KAFKA-305) SyncProducer does not correctly timeout

2012-03-23 Thread Jun Rao (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13237021#comment-13237021 ] Jun Rao commented on KAFKA-305: --- If this is indeed a ZK issue, we can probably check/

[jira] [Commented] (KAFKA-305) SyncProducer does not correctly timeout

2012-03-23 Thread Jun Rao (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13236782#comment-13236782 ] Jun Rao commented on KAFKA-305: --- Prashanth, v2 patch looks good. As for 5, I do

[jira] [Commented] (KAFKA-307) Refactor server code to remove interdependencies between LogManager and KafkaZooKeeper

2012-03-23 Thread Jun Rao (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13236734#comment-13236734 ] Jun Rao commented on KAFKA-307: --- +1 on patch v3. > Refactor server

[jira] [Commented] (KAFKA-307) Refactor server code to remove interdependencies between LogManager and KafkaZooKeeper

2012-03-22 Thread Jun Rao (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13236175#comment-13236175 ] Jun Rao commented on KAFKA-307: --- Thanks for patch v2. Looks cleaner. A couple of o

[jira] [Commented] (KAFKA-307) Refactor server code to remove interdependencies between LogManager and KafkaZooKeeper

2012-03-22 Thread Jun Rao (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13235707#comment-13235707 ] Jun Rao commented on KAFKA-307: --- Overall looks good. Some suggestions: 1. KafkaSe

[jira] [Commented] (KAFKA-309) Bug in FileMessageSet's append API can corrupt on disk log

2012-03-22 Thread Jun Rao (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13235679#comment-13235679 ] Jun Rao commented on KAFKA-309: --- +1 on the patch. > Bug in FileMessa

[jira] [Commented] (KAFKA-310) Incomplete message set validation checks in kafka.log.Log's append API can corrupt on disk log

2012-03-22 Thread Jun Rao (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13235675#comment-13235675 ] Jun Rao commented on KAFKA-310: --- +1 on v2. > Incomplete mess

[jira] [Commented] (KAFKA-310) Incomplete message set validation checks in kafka.log.Log's append API can corrupt on disk log

2012-03-22 Thread Jun Rao (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13235636#comment-13235636 ] Jun Rao commented on KAFKA-310: --- ByteBufferMessageSet.validBytes currently makes a

[jira] [Commented] (KAFKA-305) SyncProducer does not correctly timeout

2012-03-22 Thread Jun Rao (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13235614#comment-13235614 ] Jun Rao commented on KAFKA-305: --- Prashant, 2. If you want to make sure that a broke

[jira] [Commented] (KAFKA-300) Implement leader election

2012-03-21 Thread Jun Rao (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13234541#comment-13234541 ] Jun Rao commented on KAFKA-300: --- +1 on patch v2. > Implement

[jira] [Commented] (KAFKA-296) Update Go Client to new version of Go

2012-03-20 Thread Jun Rao (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13234017#comment-13234017 ] Jun Rao commented on KAFKA-296: --- Also, could you add some basic unit tests for the go cl

[jira] [Updated] (KAFKA-303) Dead code in the Log4j appender

2012-03-20 Thread Jun Rao (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-303: -- Resolution: Fixed Fix Version/s: 0.7.1 Status: Resolved (was: Patch Available) Jose, Thanks

[jira] [Resolved] (KAFKA-279) kafka-console-producer does not take in customized values of --batch-size or --timeout

2012-03-20 Thread Jun Rao (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-279. --- Resolution: Fixed Fix Version/s: 0.7.1 Assignee: Jun Rao Edward, Thanks for the review. Just

[jira] [Commented] (KAFKA-305) SyncProducer does not correctly timeout

2012-03-20 Thread Jun Rao (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13233969#comment-13233969 ] Jun Rao commented on KAFKA-305: --- Prashanth, Thanks for the patch. This is very useful.

[jira] [Commented] (KAFKA-300) Implement leader election

2012-03-20 Thread Jun Rao (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13233885#comment-13233885 ] Jun Rao commented on KAFKA-300: --- Thanks for the patch. Some comments: 1. KafkaZookeeper:

[jira] [Updated] (KAFKA-292) broker deletes all file segments when cleaning up an empty log segment

2012-03-18 Thread Jun Rao (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-292: -- Resolution: Fixed Status: Resolved (was: Patch Available) Committed to trunk

[jira] [Reopened] (KAFKA-296) Update Go Client to new version of Go

2012-03-14 Thread Jun Rao (Reopened) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao reopened KAFKA-296: --- Actually, I have to revert the commit since the patch didn't apply cleanly. ! clients/go/tools/of

[jira] [Updated] (KAFKA-296) Update Go Client to new version of Go

2012-03-14 Thread Jun Rao (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-296: -- Resolution: Fixed Fix Version/s: 0.7.1 Status: Resolved (was: Patch Available) Thanks for

[jira] [Updated] (KAFKA-49) Add acknowledgement to the produce request.

2012-03-13 Thread Jun Rao (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-49?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-49: - Resolution: Fixed Status: Resolved (was: Patch Available) Thanks for the patch Prashanth. Just committed

[jira] [Commented] (KAFKA-296) Update Go Client to new version of Go

2012-03-13 Thread Jun Rao (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13228865#comment-13228865 ] Jun Rao commented on KAFKA-296: --- I can't seem to apply the patch. Could you rebase?

[jira] [Commented] (KAFKA-49) Add acknowledgement to the produce request.

2012-03-13 Thread Jun Rao (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-49?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13228845#comment-13228845 ] Jun Rao commented on KAFKA-49: -- Prashanth, I am ready to commit your patch. A couple th

[jira] [Commented] (KAFKA-45) Broker startup, leader election, becoming a leader/follower for intra-cluster replication

2012-03-13 Thread Jun Rao (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-45?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13228774#comment-13228774 ] Jun Rao commented on KAFKA-45: -- If there are 2 followers and leader receives ack from

[jira] [Commented] (KAFKA-49) Add acknowledgement to the produce request.

2012-03-08 Thread Jun Rao (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-49?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13225845#comment-13225845 ] Jun Rao commented on KAFKA-49: -- 1. Or we can just treat noacks the same as act=1 for

[jira] [Commented] (KAFKA-49) Add acknowledgement to the produce request.

2012-03-08 Thread Jun Rao (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-49?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13225321#comment-13225321 ] Jun Rao commented on KAFKA-49: -- Prashanth, Thanks for the patch. Overall, it looks pr

[jira] [Updated] (KAFKA-220) LogManager test fails on linux

2012-03-08 Thread Jun Rao (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-220: -- Resolution: Fixed Status: Resolved (was: Patch Available) committed to trunk

[jira] [Commented] (KAFKA-273) Occassional GZIP errors on the server while writing compressed data to disk

2012-03-07 Thread Jun Rao (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13224538#comment-13224538 ] Jun Rao commented on KAFKA-273: --- The patch for EOF looks fine. We probably need to do

Re: ProducerPool - KAFKA-240

2012-03-07 Thread Jun Rao
Jeffrey, Yes, we can get that started. Just be aware that there could be minor tweaks to the wire protocol in the next few months. Thanks, Jun On Wed, Mar 7, 2012 at 7:02 AM, Jeffrey Damick wrote: > So now that kafka-240 is complete, shall we go ahead and start updating the > clients? i'll sta

[jira] [Commented] (KAFKA-273) Occassional GZIP errors on the server while writing compressed data to disk

2012-03-06 Thread Jun Rao (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13223525#comment-13223525 ] Jun Rao commented on KAFKA-273: --- We have also seem the following gzip issue. Is that

Re: svn commit: r1296577 - in /incubator/kafka/branches/0.8/core/src: main/scala/kafka/api/ main/scala/kafka/javaapi/ main/scala/kafka/javaapi/message/ main/scala/kafka/javaapi/producer/ main/scala/ka

2012-03-06 Thread Jun Rao
Joe, 0.8 now has compilation error after this check in. It seems that you forgot to check in a new file. See my comment in kafka-240. Could you fix this? Thanks, Jun On Fri, Mar 2, 2012 at 9:46 PM, wrote: > Author: joestein > Date: Sat Mar 3 05:46:43 2012 > New Revision: 1296577 > > URL: htt

[jira] [Commented] (KAFKA-240) implement new producer and consumer request format

2012-03-06 Thread Jun Rao (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13223436#comment-13223436 ] Jun Rao commented on KAFKA-240: --- I got a compilation error on 0.8. /home/

Re: i committed KAFKA-284 but can't resolve JIRA

2012-03-06 Thread Jun Rao
Added you to the committer list of kafka jira. Hopefully you can resolve jiras now. Thanks, Jun On Wed, Feb 29, 2012 at 6:49 PM, Joe Stein wrote: > I don't have access it seems so can't resolve > https://issues.apache.org/jira/browse/KAFKA-284 > > my username=charmalloc > > thanx > > /* > Joe

[jira] [Commented] (KAFKA-49) Add acknowledgement to the produce request.

2012-03-06 Thread Jun Rao (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-49?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13223407#comment-13223407 ] Jun Rao commented on KAFKA-49: -- Prashanth, Yes, that's actually a real bug. I

[jira] [Commented] (KAFKA-294) "Path length must be > 0" error during startup

2012-03-06 Thread Jun Rao (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13223331#comment-13223331 ] Jun Rao commented on KAFKA-294: --- Are you using namespace in ZK connection string? If so,

[jira] [Updated] (KAFKA-220) LogManager test fails on linux

2012-03-05 Thread Jun Rao (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-220: -- Assignee: Jun Rao Status: Patch Available (was: Open) Attach a patch by setting lastmodifiedtime

[jira] [Updated] (KAFKA-220) LogManager test fails on linux

2012-03-05 Thread Jun Rao (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-220: -- Attachment: kafka-220.patch > LogManager test fails on li

Re: Contributor Lic. Question

2012-03-05 Thread Jun Rao
Yes, I think so. Thanks, Jun On Mon, Mar 5, 2012 at 2:59 PM, Andrew Psaltis wrote: > All, > > We are interested in contributing to Kafka and wanted to clarify if the > following Corporate Contributor License Agreement: > > http://www.apache.org/licenses/cla-corporate.txt > > Is the correct one

[jira] [Commented] (KAFKA-49) Add acknowledgement to the produce request.

2012-03-05 Thread Jun Rao (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-49?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13222779#comment-13222779 ] Jun Rao commented on KAFKA-49: -- The current defaulteventhandler already refreshes t

[jira] [Updated] (KAFKA-292) broker deletes all file segments when cleaning up an empty log segment

2012-03-05 Thread Jun Rao (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-292: -- Attachment: kafka-292_v2.patch Attach patch v2. There is already a unit test for this. Just need to add the

[jira] [Commented] (KAFKA-49) Add acknowledgement to the produce request.

2012-03-05 Thread Jun Rao (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-49?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13222700#comment-13222700 ] Jun Rao commented on KAFKA-49: -- Prashanth, That's a good question. Initially, I

[jira] [Updated] (KAFKA-292) broker deletes all file segments when cleaning up an empty log segment

2012-03-02 Thread Jun Rao (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-292: -- Attachment: kafka-292.patch > broker deletes all file segments when cleaning up an empty log segm

[jira] [Updated] (KAFKA-292) broker deletes all file segments when cleaning up an empty log segment

2012-03-02 Thread Jun Rao (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-292: -- Status: Patch Available (was: Open) patch attached. > broker deletes all file segments w

[jira] [Created] (KAFKA-292) broker deletes all file segments when cleaning up an empty log segment

2012-03-02 Thread Jun Rao (Created) (JIRA)
Components: core Reporter: Jun Rao Assignee: Jun Rao Fix For: 0.7.1 Attachments: kafka-292.patch Suppose that a log has only one log segment left and it's empty. If that segment expires and is deleted, we roll out a new segment of the

[jira] [Commented] (KAFKA-240) implement new producer and consumer request format

2012-03-02 Thread Jun Rao (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13221452#comment-13221452 ] Jun Rao commented on KAFKA-240: --- Joe, When the client creates a ProduceRequest, we d

[jira] [Commented] (KAFKA-240) implement new producer and consumer request format

2012-03-02 Thread Jun Rao (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13221318#comment-13221318 ] Jun Rao commented on KAFKA-240: --- Yes, however, that information is not passed

[jira] [Commented] (KAFKA-240) implement new producer and consumer request format

2012-03-02 Thread Jun Rao (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13221183#comment-13221183 ] Jun Rao commented on KAFKA-240: --- Joe, kafka-239 has been committed to the 0.8 branch.

[jira] [Updated] (KAFKA-239) Wire existing producer and consumer to use the new ZK data structure

2012-03-02 Thread Jun Rao (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-239: -- Resolution: Fixed Fix Version/s: 0.8 Status: Resolved (was: Patch Available) > W

[jira] [Updated] (KAFKA-50) kafka intra-cluster replication support

2012-03-02 Thread Jun Rao (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-50?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-50: - Attachment: kafka_replication_highlevel_design.docx > kafka intra-cluster replication supp

[jira] [Updated] (KAFKA-50) kafka intra-cluster replication support

2012-03-02 Thread Jun Rao (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-50?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-50: - Attachment: kafka_replication_detailed_design_v2.docx Attach the word doc of the design. > ka

[jira] [Commented] (KAFKA-239) Wire existing producer and consumer to use the new ZK data structure

2012-03-01 Thread Jun Rao (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13220297#comment-13220297 ] Jun Rao commented on KAFKA-239: --- +1 on the patch. For 2, I was interpreting Host as a

[jira] [Commented] (KAFKA-50) kafka intra-cluster replication support

2012-03-01 Thread Jun Rao (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-50?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13220290#comment-13220290 ] Jun Rao commented on KAFKA-50: -- Yes, we can start a new wiki for each of the sub-jiras

[jira] [Updated] (KAFKA-240) implement new producer and consumer request format

2012-03-01 Thread Jun Rao (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-240: -- Attachment: kafka-240_unittestfix_delta.patch Joe, There are 2 reasons why the unit test fails. 1. Some

[jira] [Commented] (KAFKA-239) Wire existing producer and consumer to use the new ZK data structure

2012-03-01 Thread Jun Rao (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13220155#comment-13220155 ] Jun Rao commented on KAFKA-239: --- Please address items 2 and 11. For 4, I am fine leaving

[jira] [Commented] (KAFKA-239) Wire existing producer and consumer to use the new ZK data structure

2012-02-29 Thread Jun Rao (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13219370#comment-13219370 ] Jun Rao commented on KAFKA-239: --- 1. ZkUtils.getTopicPartitionsPath: There are a co

[jira] [Updated] (KAFKA-290) use propertyExists to test if both broker.list and zk.connect are present

2012-02-28 Thread Jun Rao (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-290: -- Attachment: kafka-290_v3.patch Attach patch v3 that requires either broker.lost or zk.connect to be present

[jira] [Updated] (KAFKA-290) use propertyExists to test if both broker.list and zk.connect are present

2012-02-28 Thread Jun Rao (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-290: -- Attachment: kafka-290_v2.patch Attach patch v2. > use propertyExists to test if b

[jira] [Updated] (KAFKA-290) use propertyExists to test if both broker.list and zk.connect are present

2012-02-28 Thread Jun Rao (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-290: -- Affects Version/s: 0.7.1 Status: Patch Available (was: Open) patch attached

[jira] [Updated] (KAFKA-290) use propertyExists to test if both broker.list and zk.connect are present

2012-02-28 Thread Jun Rao (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-290: -- Attachment: kafka-290.patch > use propertyExists to test if both broker.list and zk.connect are pres

[jira] [Created] (KAFKA-290) use propertyExists to test if both broker.list and zk.connect are present

2012-02-28 Thread Jun Rao (Created) (JIRA)
Type: Improvement Reporter: Jun Rao Assignee: Jun Rao -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more

Re: Incubator PMC/Board report for Apr 2012 ([ppmc])

2012-02-27 Thread Jun Rao
Joe, As a new committer, do you want to do the report this time? Thanks, Jun On Mon, Feb 27, 2012 at 8:16 PM, Alan D. Cabrera wrote: > Any takers? > > > Regards, > Alan > > > On Feb 23, 2012, at 5:14 AM, Marvin wrote: > > > > > > > Dear podling, > > > > This email was sent by an automated syst

[jira] [Updated] (KAFKA-285) Increase maximum value of log.retention.size

2012-02-27 Thread Jun Rao (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-285: -- Resolution: Fixed Status: Resolved (was: Patch Available) Thanks for the patch, Elben. Just committed

Re: broken unit tests on 0.8 branch

2012-02-27 Thread Jun Rao
; > > > > > nnarkhed-ld:kafka-239-topic-metadata nnarkhed$ svn log -l 5 > > > > r1244650 | junrao | 2012-02-15 11:08:08 -0800 (Wed, 15 Feb 2012) | 1 line > > &

[jira] [Commented] (KAFKA-249) Separate out Kafka mirroring into a stand-alone app

2012-02-27 Thread Jun Rao (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13217513#comment-13217513 ] Jun Rao commented on KAFKA-249: --- Could we support subscribing to wildcard topics directl

[jira] [Commented] (KAFKA-240) implement new producer and consumer request format

2012-02-27 Thread Jun Rao (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13217500#comment-13217500 ] Jun Rao commented on KAFKA-240: --- If you are not addressing #8 in this jira, we can trac

[jira] [Updated] (KAFKA-286) consumer sometimes don't release partition ownership properly in ZK during rebalance

2012-02-27 Thread Jun Rao (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-286: -- Resolution: Fixed Status: Resolved (was: Patch Available) Thanks for the review. Just committed this

[jira] [Commented] (KAFKA-286) consumer sometimes don't release partition ownership properly in ZK during rebalance

2012-02-27 Thread Jun Rao (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13217375#comment-13217375 ] Jun Rao commented on KAFKA-286: --- Will this happen? It doesn't seem possible to me.

[jira] [Commented] (KAFKA-279) kafka-console-producer does not take in customized values of --batch-size or --timeout

2012-02-27 Thread Jun Rao (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13217331#comment-13217331 ] Jun Rao commented on KAFKA-279: --- That typically means that you are sending data at a

[jira] [Updated] (KAFKA-286) consumer sometimes don't release partition ownership properly in ZK during rebalance

2012-02-27 Thread Jun Rao (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-286: -- Attachment: kafka-286_v2.patch That's a good point. What can happen is that we may delete ZK paths th

[jira] [Updated] (KAFKA-283) add jmx beans in broker to track # of failed requests

2012-02-25 Thread Jun Rao (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-283: -- Resolution: Fixed Status: Resolved (was: Patch Available) Thanks for the review. Just committed this

[jira] [Updated] (KAFKA-286) consumer sometimes don't release partition ownership properly in ZK during rebalance

2012-02-25 Thread Jun Rao (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-286: -- Attachment: kafka-286.patch > consumer sometimes don't release partition ownership properly in Z

[jira] [Updated] (KAFKA-286) consumer sometimes don't release partition ownership properly in ZK during rebalance

2012-02-25 Thread Jun Rao (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-286: -- Status: Patch Available (was: Open) Patch attached. > consumer sometimes don't

[jira] [Created] (KAFKA-286) consumer sometimes don't release partition ownership properly in ZK during rebalance

2012-02-25 Thread Jun Rao (Created) (JIRA)
oject: Kafka Issue Type: Bug Components: core Reporter: Jun Rao Assignee: Jun Rao Fix For: 0.7.1 -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators:

[jira] [Commented] (KAFKA-44) Various ZK listeners to support intra-cluster replication

2012-02-24 Thread Jun Rao (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-44?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13215728#comment-13215728 ] Jun Rao commented on KAFKA-44: -- It may be possible, but this can be a bit tricky. When

[jira] [Updated] (KAFKA-283) add jmx beans in broker to track # of failed requests

2012-02-23 Thread Jun Rao (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-283: -- Status: Patch Available (was: Open) patch attached. > add jmx beans in broker to track #

[jira] [Updated] (KAFKA-283) add jmx beans in broker to track # of failed requests

2012-02-23 Thread Jun Rao (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-283: -- Attachment: kafka-283.patch > add jmx beans in broker to track # of failed reque

[jira] [Created] (KAFKA-283) add jmx beans in broker to track # of failed requests

2012-02-23 Thread Jun Rao (Created) (JIRA)
: core Reporter: Jun Rao Assignee: Jun Rao Fix For: 0.7.1 Attachments: kafka-283.patch -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure

[jira] [Resolved] (KAFKA-277) Add a shallow iterator to the ByteBufferMessageSet, which is only used in SynchProducer.verifyMessageSize() function

2012-02-23 Thread Jun Rao (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-277. --- Resolution: Fixed Fix Version/s: 0.7.1 Thanks for the patch. It looks good. Just committed to trunk

[jira] [Assigned] (KAFKA-277) Add a shallow iterator to the ByteBufferMessageSet, which is only used in SynchProducer.verifyMessageSize() function

2012-02-23 Thread Jun Rao (Assigned) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao reassigned KAFKA-277: - Assignee: Yang Ye > Add a shallow iterator to the ByteBufferMessageSet, which is only used

Re: theoritical question, what if kafka was written in plane jane java?

2012-02-23 Thread Jun Rao
We use scala collections very heavily. There is probably some overhead in that. However, I am not sure if it's significant. Compared to disk I/Os and network overhead, the scala overhead is probably negligible. Jun On Thu, Feb 23, 2012 at 12:11 PM, S Ahmed wrote: > Excluding the fact it would p

[jira] [Commented] (KAFKA-46) Commit thread, ReplicaFetcherThread for intra-cluster replication

2012-02-22 Thread Jun Rao (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-46?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13213817#comment-13213817 ] Jun Rao commented on KAFKA-46: -- Some notes on the implementation: 1. If required_acks f

[jira] [Created] (KAFKA-281) support multiple root log directories

2012-02-22 Thread Jun Rao (Created) (JIRA)
support multiple root log directories - Key: KAFKA-281 URL: https://issues.apache.org/jira/browse/KAFKA-281 Project: Kafka Issue Type: Improvement Components: core Reporter: Jun Rao

[jira] [Created] (KAFKA-280) change on-disk log layout to {log.dir}/topicname/partitionid

2012-02-22 Thread Jun Rao (Created) (JIRA)
Components: core Affects Versions: 0.8 Reporter: Jun Rao Currently, the on-disk layout is {log.dir}/topicname-partitionid. The problem is that there is no appropriate place to store topicname level information such as topic version. An alternative layout is {log.dir}/topicname

[jira] [Commented] (KAFKA-44) Various ZK listeners to support intra-cluster replication

2012-02-21 Thread Jun Rao (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-44?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13213283#comment-13213283 ] Jun Rao commented on KAFKA-44: -- Not sure if I follow exactly what you are proposing here

[jira] [Commented] (KAFKA-45) Broker startup, leader election, becoming a leader/follower for intra-cluster replication

2012-02-21 Thread Jun Rao (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-45?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13213033#comment-13213033 ] Jun Rao commented on KAFKA-45: -- Prashanth, That's a good question. We'd like to

[jira] [Commented] (KAFKA-44) Various ZK listeners to support intra-cluster replication

2012-02-21 Thread Jun Rao (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-44?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13213002#comment-13213002 ] Jun Rao commented on KAFKA-44: -- Prshanth, This seems like a good idea to me. Ideally,

Re: Countandra 0.6 uses Apache Kafka

2012-02-21 Thread Jun Rao
Milind, Thanks for the info. Could you update the wiki to report your usage? Jun On Mon, Feb 20, 2012 at 6:57 PM, Milind Parikh wrote: > http://www.countandra.org/?q=node/19 > > Thanks for the excellent work! > > Regards > Milind >

[jira] [Commented] (KAFKA-277) Add a shallow iterator to the ByteBufferMessageSet, which is only used in SynchProducer.verifyMessageSize() function

2012-02-21 Thread Jun Rao (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13212738#comment-13212738 ] Jun Rao commented on KAFKA-277: --- Also, please add a unit test for this. Use a max_mes

[jira] [Commented] (KAFKA-48) Implement optional "long poll" support in fetch request

2012-02-20 Thread Jun Rao (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-48?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13212329#comment-13212329 ] Jun Rao commented on KAFKA-48: -- Overall, the patch looks good. Some comments

[jira] [Updated] (KAFKA-255) A tool to UPDATE Zookeeper partition-offset with input from a file

2012-02-20 Thread Jun Rao (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-255: -- Resolution: Fixed Fix Version/s: 0.7.1 Status: Resolved (was: Patch Available) Thanks John

[jira] [Updated] (KAFKA-254) A tool to GET Zookeeper partition-offset and output to files

2012-02-20 Thread Jun Rao (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-254: -- Resolution: Fixed Fix Version/s: 0.7.1 Status: Resolved (was: Patch Available) Thanks John

[jira] [Updated] (KAFKA-279) kafka-console-producer does not take in customized values of --batch-size or --timeout

2012-02-20 Thread Jun Rao (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-279: -- Attachment: kafka-279.patch Milind, Attached is a patch to trunk. Could you try it out and see if it fixes

<    4   5   6   7   8   9   10   11   12   13   >