[jira] [Commented] (KAFKA-1459) kafka.tools.ConsumerOffsetChecker throws NoNodeException

2014-05-23 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14007968#comment-14007968 ] Sriharsha Chintalapani commented on KAFKA-1459: --- Created reviewboard https:/

[jira] [Updated] (KAFKA-1459) kafka.tools.ConsumerOffsetChecker throws NoNodeException

2014-05-23 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sriharsha Chintalapani updated KAFKA-1459: -- Attachment: KAFKA-1459.patch > kafka.tools.ConsumerOffsetChecker throws NoNodeE

Review Request 21883: Patch for KAFKA-1459

2014-05-23 Thread Sriharsha Chintalapani
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/21883/ --- Review request for kafka. Bugs: KAFKA-1459 https://issues.apache.org/jira/b

[jira] [Created] (KAFKA-1469) Util.abs function does not return correct absolute values for negative values

2014-05-23 Thread Joel Koshy (JIRA)
Joel Koshy created KAFKA-1469: - Summary: Util.abs function does not return correct absolute values for negative values Key: KAFKA-1469 URL: https://issues.apache.org/jira/browse/KAFKA-1469 Project: Kafka

[jira] [Commented] (KAFKA-924) Specify console consumer properties via a single --property command line parameter

2014-05-23 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14007753#comment-14007753 ] Sriharsha Chintalapani commented on KAFKA-924: -- Updated reviewboard https://re

[jira] [Updated] (KAFKA-924) Specify console consumer properties via a single --property command line parameter

2014-05-23 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sriharsha Chintalapani updated KAFKA-924: - Attachment: KAFKA-924_2014-05-23_14:47:30.patch > Specify console consumer propert

Re: Review Request 21616: Patch for KAFKA-924

2014-05-23 Thread Sriharsha Chintalapani
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/21616/ --- (Updated May 23, 2014, 9:47 p.m.) Review request for kafka. Bugs: KAFKA-924

[jira] [Commented] (KAFKA-1468) Improve perf tests

2014-05-23 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14007705#comment-14007705 ] Jay Kreps commented on KAFKA-1468: -- Created reviewboard https://reviews.apache.org/r/2187

[jira] [Updated] (KAFKA-1468) Improve perf tests

2014-05-23 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps updated KAFKA-1468: - Attachment: KAFKA-1468.patch > Improve perf tests > -- > > Key: KAFKA-146

Review Request 21878: KAFKA-1468: Misc. improvements to test scripts from benchmarking

2014-05-23 Thread Jay Kreps
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/21878/ --- Review request for kafka. Bugs: KAFKA-1468 https://issues.apache.org/jira/b

[jira] [Resolved] (KAFKA-1466) Kafka server is hung after throwing "Attempt to swap the new high watermark file with the old one failed"

2014-05-23 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy resolved KAFKA-1466. --- Resolution: Cannot Reproduce Not sure if it would help but perhaps you can include your file system,

[jira] [Commented] (KAFKA-1466) Kafka server is hung after throwing "Attempt to swap the new high watermark file with the old one failed"

2014-05-23 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14007674#comment-14007674 ] Joel Koshy commented on KAFKA-1466: --- You seem to have a replication factor of 1 for test

[jira] [Commented] (KAFKA-1466) Kafka server is hung after throwing "Attempt to swap the new high watermark file with the old one failed"

2014-05-23 Thread Arup Malakar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14007651#comment-14007651 ] Arup Malakar commented on KAFKA-1466: - [~fancyrao] couldn't reproduce the error. It we

Re: Topic Partitioning Strategy For Large Data

2014-05-23 Thread Joel Koshy
Take a look at: https://cwiki.apache.org/confluence/display/KAFKA/FAQ#FAQ-HowdoIchoosethenumberofpartitionsforatopic? On Fri, May 23, 2014 at 12:49:39PM -0700, Bhavesh Mistry wrote: > Hi Kafka Users, > > > > We are trying to transport 4TB data per day on single topic. It is > operation applica

Topic Partitioning Strategy For Large Data

2014-05-23 Thread Bhavesh Mistry
Hi Kafka Users, We are trying to transport 4TB data per day on single topic. It is operation application logs.How do we estimate number of partitions and partitioning strategy? Our goal is to drain (from consumer side) from the Kafka Brokers as soon as messages arrive (keep the lag as min

[jira] [Created] (KAFKA-1468) Improve perf tests

2014-05-23 Thread Jay Kreps (JIRA)
Jay Kreps created KAFKA-1468: Summary: Improve perf tests Key: KAFKA-1468 URL: https://issues.apache.org/jira/browse/KAFKA-1468 Project: Kafka Issue Type: Bug Reporter: Jay Kreps Th

[jira] [Resolved] (KAFKA-1467) Fixes small documentation typos

2014-05-23 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps resolved KAFKA-1467. -- Resolution: Fixed Thanks for the patch! Committed. > Fixes small documentation typos > ---

[jira] [Commented] (KAFKA-1466) Kafka server is hung after throwing "Attempt to swap the new high watermark file with the old one failed"

2014-05-23 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14007422#comment-14007422 ] Jun Rao commented on KAFKA-1466: Hmm, that's weird. Haven't seen the file swapping failing

Re: Review Request 21663: Patch for KAFKA-1456

2014-05-23 Thread Jun Rao
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/21663/#review43842 --- Thanks for the patch. Could we add the new codec in ProducerCompress

[jira] [Updated] (KAFKA-1467) Fixes small documentation typos

2014-05-23 Thread Brian Chhun (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Chhun updated KAFKA-1467: --- Description: Fixes a minor typo in the log compaction section of the documentation. Also includes se

[jira] [Updated] (KAFKA-1467) Fixes small documentation typos

2014-05-23 Thread Brian Chhun (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Chhun updated KAFKA-1467: --- Attachment: KAFKA-1467-log-compaction-typo.diff KAFKA-1467-consistent-zookeeper-letter

[jira] [Created] (KAFKA-1467) Fixes small documentation typos

2014-05-23 Thread Brian Chhun (JIRA)
Brian Chhun created KAFKA-1467: -- Summary: Fixes small documentation typos Key: KAFKA-1467 URL: https://issues.apache.org/jira/browse/KAFKA-1467 Project: Kafka Issue Type: Bug Component

[jira] [Commented] (KAFKA-1438) Migrate kafka client tools

2014-05-23 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14007278#comment-14007278 ] Sriharsha Chintalapani commented on KAFKA-1438: --- Created reviewboard https:/

Review Request 21865: Patch for KAFKA-1438

2014-05-23 Thread Sriharsha Chintalapani
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/21865/ --- Review request for kafka. Bugs: KAFKA-1438 https://issues.apache.org/jira/b

[jira] [Updated] (KAFKA-1438) Migrate kafka client tools

2014-05-23 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sriharsha Chintalapani updated KAFKA-1438: -- Attachment: KAFKA-1438.patch > Migrate kafka client tools > ---