Re: Review Request 22063: Patch for KAFKA-1472

2014-05-29 Thread Guozhang Wang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/22063/#review44334 --- clients/src/main/java/org/apache/kafka/clients/producer/internals/S

[jira] [Commented] (KAFKA-1316) Refactor Sender

2014-05-29 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14013340#comment-14013340 ] Guozhang Wang commented on KAFKA-1316: -- This makes sense. > Refactor Sender > --

[jira] [Commented] (KAFKA-1475) Kafka consumer stops LeaderFinder/FetcherThreads, but application does not know

2014-05-29 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14013336#comment-14013336 ] Guozhang Wang commented on KAFKA-1475: -- This is a valid point, and it is a little tri

[jira] [Reopened] (KAFKA-1454) Update for a Scala 2.11 build

2014-05-29 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein reopened KAFKA-1454: -- Assignee: Joe Stein > Update for a Scala 2.11 build > - > >

Re: Producer Side Metric Details

2014-05-29 Thread Bhavesh Mistry
There seems to be bug in reporting that is what I did. I registered each producer with different client id. Thanks, Bhavesh On Thu, May 29, 2014 at 8:36 PM, Jun Rao wrote: > You need to configure each producer with a different client.id. > > Thanks, > > Jun > > > On Thu, May 29, 2014 at 5:38

Re: Producer Side Metric Details

2014-05-29 Thread Jun Rao
You need to configure each producer with a different client.id. Thanks, Jun On Thu, May 29, 2014 at 5:38 PM, Bhavesh Mistry wrote: > We have 4 producers (for 4 topics) within one JVM and all of them > configured with same broker list. Each one of the producer has client.id > configured as to

[jira] [Created] (KAFKA-1476) Get a list of consumer groups

2014-05-29 Thread Ryan Williams (JIRA)
Ryan Williams created KAFKA-1476: Summary: Get a list of consumer groups Key: KAFKA-1476 URL: https://issues.apache.org/jira/browse/KAFKA-1476 Project: Kafka Issue Type: Wish Compon

[jira] [Updated] (KAFKA-924) Specify console consumer properties via a single --property command line parameter

2014-05-29 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sriharsha Chintalapani updated KAFKA-924: - Attachment: KAFKA-924_2014-05-29_18:40:10.patch > Specify console consumer propert

[jira] [Commented] (KAFKA-924) Specify console consumer properties via a single --property command line parameter

2014-05-29 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14013199#comment-14013199 ] Sriharsha Chintalapani commented on KAFKA-924: -- Updated reviewboard https://re

Re: Review Request 21616: Patch for KAFKA-924

2014-05-29 Thread Sriharsha Chintalapani
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/21616/ --- (Updated May 30, 2014, 1:40 a.m.) Review request for kafka. Bugs: KAFKA-924

[jira] [Updated] (KAFKA-924) Specify console consumer properties via a single --property command line parameter

2014-05-29 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sriharsha Chintalapani updated KAFKA-924: - Attachment: KAFKA-924_2014-05-29_18:34:13.patch > Specify console consumer propert

Re: Review Request 21616: Patch for KAFKA-924

2014-05-29 Thread Sriharsha Chintalapani
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/21616/ --- (Updated May 30, 2014, 1:34 a.m.) Review request for kafka. Bugs: KAFKA-924

[jira] [Commented] (KAFKA-924) Specify console consumer properties via a single --property command line parameter

2014-05-29 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14013191#comment-14013191 ] Sriharsha Chintalapani commented on KAFKA-924: -- Updated reviewboard https://re

Exception kafka.common.NotLeaderForPartitionException

2014-05-29 Thread Bhavesh Mistry
Hi Kafka User Group, We have recently changed the “message.max.bytes” to 2MB and rebooted all the brokers at once. After this, we are getting “kafka.common.NotLeaderForPartitionException” on both Producer side and consumer side. How do I fix this, I have restarted producer and consumer appli

Re: Producer Side Metric Details

2014-05-29 Thread Bhavesh Mistry
We have 4 producers (for 4 topics) within one JVM and all of them configured with same broker list. Each one of the producer has client.id configured as topic name. When I see the JMX console, I see that " *ProducerRequestMetric*" JMX have issue, it takes the last client.id config and report the

[jira] [Commented] (KAFKA-1215) Rack-Aware replica assignment option

2014-05-29 Thread Jorge Ortiz (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14013151#comment-14013151 ] Jorge Ortiz commented on KAFKA-1215: Any update on this? We're deploying Kafka on AWS

[jira] [Commented] (KAFKA-1472) Add the compression ratio metrics in the new producer

2014-05-29 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14012984#comment-14012984 ] Dong Lin commented on KAFKA-1472: - Hi Guozhang, thanks for noting the problem. The reviewb

[jira] [Issue Comment Deleted] (KAFKA-1472) Add the compression ratio metrics in the new producer

2014-05-29 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-1472: Comment: was deleted (was: Created reviewboard against branch origin/trunk) > Add the compression ratio m

[jira] [Updated] (KAFKA-1472) Add the compression ratio metrics in the new producer

2014-05-29 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-1472: Attachment: (was: KAFKA-1472.patch) > Add the compression ratio metrics in the new producer > -

[jira] [Updated] (KAFKA-1472) Add the compression ratio metrics in the new producer

2014-05-29 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-1472: Attachment: KAFKA-1472.patch > Add the compression ratio metrics in the new producer >

[jira] [Updated] (KAFKA-1475) Kafka consumer stops LeaderFinder/FetcherThreads, but application does not know

2014-05-29 Thread Hang Qi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hang Qi updated KAFKA-1475: --- Description: We encounter an issue of consumers not consuming messages in production. ( this consumer has it

[jira] [Commented] (KAFKA-1472) Add the compression ratio metrics in the new producer

2014-05-29 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14012968#comment-14012968 ] Dong Lin commented on KAFKA-1472: - Created reviewboard https://reviews.apache.org/r/22063/

[jira] [Updated] (KAFKA-1475) Kafka consumer stops LeaderFinder/FetcherThreads, but application does not know

2014-05-29 Thread Hang Qi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hang Qi updated KAFKA-1475: --- Description: We encounter an issue of consumers not consuming messages in production. ( this consumer has it

[jira] [Updated] (KAFKA-1475) Kafka consumer stops LeaderFinder/FetcherThreads, but application does not know

2014-05-29 Thread Hang Qi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hang Qi updated KAFKA-1475: --- Description: We encounter an issue of consumers not consuming messages in production. ( this consumer has it

[jira] [Updated] (KAFKA-1475) Kafka consumer stops LeaderFinder/FetcherThreads, but application does not know

2014-05-29 Thread Hang Qi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hang Qi updated KAFKA-1475: --- Description: We encounter an issue of consumers not consuming messages in production. ( this consumer has it

Review Request 22063: Patch for KAFKA-1472

2014-05-29 Thread Dong Lin
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/22063/ --- Review request for kafka. Bugs: KAFKA-1472 https://issues.apache.org/jira/b

[jira] [Created] (KAFKA-1475) Kafka consumer stops LeaderFinder/FetcherThreads, but application does not know

2014-05-29 Thread Hang Qi (JIRA)
Hang Qi created KAFKA-1475: -- Summary: Kafka consumer stops LeaderFinder/FetcherThreads, but application does not know Key: KAFKA-1475 URL: https://issues.apache.org/jira/browse/KAFKA-1475 Project: Kafka

[jira] [Work stopped] (KAFKA-1472) Add the compression ratio metrics in the new producer

2014-05-29 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-1472 stopped by Dong Lin. > Add the compression ratio metrics in the new producer > - > >

[jira] [Work started] (KAFKA-1472) Add the compression ratio metrics in the new producer

2014-05-29 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-1472 started by Dong Lin. > Add the compression ratio metrics in the new producer > - > >

[jira] [Commented] (KAFKA-1472) Add the compression ratio metrics in the new producer

2014-05-29 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14012835#comment-14012835 ] Guozhang Wang commented on KAFKA-1472: -- Hello Dong, it seems the reviewboard is not s

[jira] [Commented] (KAFKA-1100) metrics shouldn't have generation/timestamp specific names

2014-05-29 Thread Otis Gospodnetic (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14012726#comment-14012726 ] Otis Gospodnetic commented on KAFKA-1100: - Any chance we could set Fix Version to

[jira] [Comment Edited] (KAFKA-1100) metrics shouldn't have generation/timestamp specific names

2014-05-29 Thread Otis Gospodnetic (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14012726#comment-14012726 ] Otis Gospodnetic edited comment on KAFKA-1100 at 5/29/14 7:01 PM: --

[jira] Subscription: outstanding kafka patches

2014-05-29 Thread jira
Issue Subscription Filter: outstanding kafka patches (92 issues) The list of outstanding kafka patches Subscriber: kafka-mailing-list Key Summary KAFKA-1471 Add Producer Unit Tests for LZ4 and LZ4HC compression https://issues.apache.org/jira/browse/KAFKA-1471 KAFKA-1468 Impro

[jira] [Updated] (KAFKA-1472) Add the compression ratio metrics in the new producer

2014-05-29 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-1472: Attachment: KAFKA-1472.patch > Add the compression ratio metrics in the new producer >

[jira] [Updated] (KAFKA-1472) Add the compression ratio metrics in the new producer

2014-05-29 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-1472: Attachment: (was: KAFKA-1472.patch) > Add the compression ratio metrics in the new producer > -

[jira] [Updated] (KAFKA-1472) Add the compression ratio metrics in the new producer

2014-05-29 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-1472: Attachment: (was: KAFKA-1472.patch) > Add the compression ratio metrics in the new producer > -

[jira] [Issue Comment Deleted] (KAFKA-1472) Add the compression ratio metrics in the new producer

2014-05-29 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-1472: Comment: was deleted (was: Created reviewboard against branch origin/trunk) > Add the compression ratio m

[jira] [Commented] (KAFKA-1180) WhiteList topic filter gets a NullPointerException on complex Regex

2014-05-29 Thread Jason Rosenberg (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14012741#comment-14012741 ] Jason Rosenberg commented on KAFKA-1180: I see this is marked now for 0.8.2. Is t

[jira] [Issue Comment Deleted] (KAFKA-1472) Add the compression ratio metrics in the new producer

2014-05-29 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-1472: Comment: was deleted (was: Created reviewboard against branch origin/trunk) > Add the compression ratio m

[jira] [Updated] (KAFKA-1472) Add the compression ratio metrics in the new producer

2014-05-29 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-1472: Attachment: KAFKA-1472.patch > Add the compression ratio metrics in the new producer >

[jira] [Updated] (KAFKA-1472) Add the compression ratio metrics in the new producer

2014-05-29 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-1472: Attachment: KAFKA-1472.patch > Add the compression ratio metrics in the new producer >

[jira] [Commented] (KAFKA-1472) Add the compression ratio metrics in the new producer

2014-05-29 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14012734#comment-14012734 ] Dong Lin commented on KAFKA-1472: - Created reviewboard against branch origin/trunk > Add

[jira] [Commented] (KAFKA-1472) Add the compression ratio metrics in the new producer

2014-05-29 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14012735#comment-14012735 ] Dong Lin commented on KAFKA-1472: - Created reviewboard against branch origin/trunk > Add

[jira] [Commented] (KAFKA-1472) Add the compression ratio metrics in the new producer

2014-05-29 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14012736#comment-14012736 ] Dong Lin commented on KAFKA-1472: - Created reviewboard against branch origin/trunk > Add

[jira] [Commented] (KAFKA-1466) Kafka server is hung after throwing "Attempt to swap the new high watermark file with the old one failed"

2014-05-29 Thread Arup Malakar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14012677#comment-14012677 ] Arup Malakar commented on KAFKA-1466: - [~junrao] no it wasn't wrapped in any container

Build failed in Jenkins: Kafka-trunk #194

2014-05-29 Thread Apache Jenkins Server
See Changes: [neha.narkhede] KAFKA-1459 follow up minor patch -- [...truncated 1195 lines...] java.net.BindException: Address already in use at sun.nio.ch.Net.bind(Native Method) a

Re: Review Request 21878: Patch for KAFKA-1468

2014-05-29 Thread Guozhang Wang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/21878/#review44266 --- core/src/main/scala/kafka/server/RequestPurgatory.scala

[jira] [Updated] (KAFKA-1472) Add the compression ratio metrics in the new producer

2014-05-29 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy updated KAFKA-1472: -- Assignee: Dong Lin > Add the compression ratio metrics in the new producer > --

Re: Review Request 21616: Patch for KAFKA-924

2014-05-29 Thread Sriharsha Chintalapani
> On May 29, 2014, 4:19 a.m., Jun Rao wrote: > > There seems to be a bunch of white space changes. Could we remove them? > > Neha Narkhede wrote: > Jun, it seems to me that we had whitespaces before that this patch infact > removes. looks like my editor did that. If whitespace changes are

[jira] [Commented] (KAFKA-1459) kafka.tools.ConsumerOffsetChecker throws NoNodeException

2014-05-29 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14012515#comment-14012515 ] Neha Narkhede commented on KAFKA-1459: -- Checked in the follow up patch as well > kaf

Re: Review Request 21616: Patch for KAFKA-924

2014-05-29 Thread Neha Narkhede
> On May 29, 2014, 4:19 a.m., Jun Rao wrote: > > There seems to be a bunch of white space changes. Could we remove them? Jun, it seems to me that we had whitespaces before that this patch infact removes. - Neha --- This is an automatic

Re: Review Request 21878: Patch for KAFKA-1468

2014-05-29 Thread Jun Rao
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/21878/#review44261 --- Ship it! clients/src/main/java/org/apache/kafka/clients/tools/Prod

[jira] [Updated] (KAFKA-1474) Fix a document typo "in in" --> "in"

2014-05-29 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-1474: --- Resolution: Fixed Assignee: Chengwei Yang Status: Resolved (was: Patch Available) Thanks for t

Re: Security mechanism (kerberos) in Kafka

2014-05-29 Thread Jun Rao
Security is on our to-do list. Our current plan is to complete the new consumer first in the next 2-3 months. We probably can take on the security feature afterwards. Thanks, Jun On Thu, May 29, 2014 at 7:37 AM, Pogontsev, Roman < roman.pogont...@morganstanley.com> wrote: > Hi, > > Our team ha

Security mechanism (kerberos) in Kafka

2014-05-29 Thread Pogontsev, Roman
Hi, Our team has a plan to use Kafka but it was my understanding that so far it doesn't support any security mechanism (Kerberos). Could you please clarify do you have plan to implement it in the future? Thanks, Roman Pogontsev NOTICE: Morgan Stanley is not ac