[jira] [Commented] (KAFKA-1902) fix MetricName so that Yammer reporter can work correctly

2015-01-27 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14293919#comment-14293919 ] Jun Rao commented on KAFKA-1902: Thanks for the explanation. A couple of things: (1) Since

Re: [VOTE] 0.8.2.0 Candidate 2 (with the correct links)

2015-01-27 Thread Jun Rao
Hi, Everyone, We identified a blocker issue related to Yammer jmx reporter ( https://issues.apache.org/jira/browse/KAFKA-1902). We are addressing this issue right now. Once it's resolved, we will roll out a new RC for voting. Thanks, Jun On Mon, Jan 26, 2015 at 5:14 PM, Otis Gospodnetic

[jira] [Comment Edited] (KAFKA-1902) fix MetricName so that Yammer reporter can work correctly

2015-01-27 Thread Jason Rosenberg (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14293840#comment-14293840 ] Jason Rosenberg edited comment on KAFKA-1902 at 1/27/15 7:34 PM:

[jira] [Assigned] (KAFKA-1888) Add a rolling upgrade system test

2015-01-27 Thread Abhishek Nigam (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Nigam reassigned KAFKA-1888: - Assignee: Abhishek Nigam Add a rolling upgrade system test

[jira] [Commented] (KAFKA-1902) fix MetricName so that Yammer reporter can work correctly

2015-01-27 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14294289#comment-14294289 ] Jun Rao commented on KAFKA-1902: In Kafka, topic/group/clientId can include only -, _ and

[jira] [Commented] (KAFKA-1902) fix MetricName so that Yammer reporter can work correctly

2015-01-27 Thread Jason Rosenberg (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14294287#comment-14294287 ] Jason Rosenberg commented on KAFKA-1902: Actually, a red flag here too, is why are

[jira] [Commented] (KAFKA-1902) fix MetricName so that Yammer reporter can work correctly

2015-01-27 Thread Jason Rosenberg (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14294261#comment-14294261 ] Jason Rosenberg commented on KAFKA-1902: [~jjkoshy] I did mean to just replace all

[jira] [Commented] (KAFKA-1902) fix MetricName so that Yammer reporter can work correctly

2015-01-27 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14294286#comment-14294286 ] Jun Rao commented on KAFKA-1902: Is graphite the only reporter using scope? t seems that

[jira] [Commented] (KAFKA-1902) fix MetricName so that Yammer reporter can work correctly

2015-01-27 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14294239#comment-14294239 ] Joel Koshy commented on KAFKA-1902: --- I meant mytopic$with$dot.myclientId$with$dot fix

[DISCUSSION] generate explicit error/failing metrics

2015-01-27 Thread Steven Wu
To illustrate my point, I will use allTopicsOwnedPartitionsCount guage from ZookeeperConsumerConnector as an example. It captures number of partitions for a topic that has been assigned owner for the consumer group. let's say that I have a topic with 9 partitions. this metrics should normally

[jira] [Commented] (KAFKA-1902) fix MetricName so that Yammer reporter can work correctly

2015-01-27 Thread Kyle Banker (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14294545#comment-14294545 ] Kyle Banker commented on KAFKA-1902: [~junrao] Agree that the dot may not be common,

Re: Review Request 27799: New consumer

2015-01-27 Thread Guozhang Wang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/27799/#review69936 --- patch -p1 patch-file does not do the renaming of

[jira] [Commented] (KAFKA-1902) fix MetricName so that Yammer reporter can work correctly

2015-01-27 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14294474#comment-14294474 ] Jun Rao commented on KAFKA-1902: Making the replacing character configurable is actually

[jira] [Commented] (KAFKA-1902) fix MetricName so that Yammer reporter can work correctly

2015-01-27 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14294499#comment-14294499 ] Joel Koshy commented on KAFKA-1902: --- Jun - to answer your earlier question. I took a

Registry used for yammer metrics in Kafka

2015-01-27 Thread Sumit Rangwala
IIUC, Kafka uses the default registry in yammer metrics to create all kafka related metrics. We observed a scenario where we found that our default registry was getting populated by the metrics created by kafka which in turn was causing other issues down the line. Just wanted to ask if there was a

[jira] [Comment Edited] (KAFKA-1902) fix MetricName so that Yammer reporter can work correctly

2015-01-27 Thread Kyle Banker (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14294309#comment-14294309 ] Kyle Banker edited comment on KAFKA-1902 at 1/27/15 10:23 PM: --

[jira] [Comment Edited] (KAFKA-1902) fix MetricName so that Yammer reporter can work correctly

2015-01-27 Thread Kyle Banker (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14294309#comment-14294309 ] Kyle Banker edited comment on KAFKA-1902 at 1/27/15 10:25 PM: --

[jira] [Commented] (KAFKA-1901) Move Kafka version to be generated in code by build (instead of in manifest)

2015-01-27 Thread Jason Rosenberg (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14293913#comment-14293913 ] Jason Rosenberg commented on KAFKA-1901: At the very least, this could be updated

[jira] [Commented] (KAFKA-1902) fix MetricName so that Yammer reporter can work correctly

2015-01-27 Thread Jason Rosenberg (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14294332#comment-14294332 ] Jason Rosenberg commented on KAFKA-1902: +1 fix MetricName so that Yammer

Re: Review Request 27799: New consumer

2015-01-27 Thread Onur Karaman
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/27799/#review69737 --- minor nitpicks

[jira] [Updated] (KAFKA-1729) add doc for Kafka-based offset management in 0.8.2

2015-01-27 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy updated KAFKA-1729: -- Attachment: KAFKA-1729.patch add doc for Kafka-based offset management in 0.8.2

[jira] [Commented] (KAFKA-1729) add doc for Kafka-based offset management in 0.8.2

2015-01-27 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14294645#comment-14294645 ] Joel Koshy commented on KAFKA-1729: --- Created reviewboard

[jira] [Commented] (KAFKA-1729) add doc for Kafka-based offset management in 0.8.2

2015-01-27 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14294647#comment-14294647 ] Joel Koshy commented on KAFKA-1729: --- (Uploaded above patch since we will most likely

Re: Registry used for yammer metrics in Kafka

2015-01-27 Thread Joel Koshy
I think having dedicated registries would have been a better choice - it sort of just ended up like this. We made note of this in KAFKA-1567 as well if you read through those comments but concluded that it will be a larger refactoring at this point - which may not be worth it since we intend to

Re: [DISCUSSION] generate explicit error/failing metrics

2015-01-27 Thread Joel Koshy
I'm not sure if I'm misunderstanding the suggestion, but this metric was ever intended for alerts. Some metrics are more for informational purposes than for setting up alerts. In fact it is possible for some consumers to have zero owned partitions if there are fewer partitions than consumers in

[jira] [Commented] (KAFKA-1235) Enable server to indefinitely retry on controlled shutdown

2015-01-27 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14294761#comment-14294761 ] Guozhang Wang commented on KAFKA-1235: -- The patch is actually already committed on

[jira] [Resolved] (KAFKA-1235) Enable server to indefinitely retry on controlled shutdown

2015-01-27 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-1235. -- Resolution: Fixed Fix Version/s: (was: 0.9.0) 0.8.2 Enable

[jira] [Commented] (KAFKA-1901) Move Kafka version to be generated in code by build (instead of in manifest)

2015-01-27 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14294838#comment-14294838 ] Joe Stein commented on KAFKA-1901: -- Can we collect that info during a meta data fetch for

[jira] [Commented] (KAFKA-1902) fix MetricName so that Yammer reporter can work correctly

2015-01-27 Thread Otis Gospodnetic (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14294733#comment-14294733 ] Otis Gospodnetic commented on KAFKA-1902: - bq. It's unfortunate it seems graphite

Re: Review Request 30321: Patch for kafka-1902

2015-01-27 Thread Guozhang Wang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/30321/#review69814 --- core/src/main/scala/kafka/metrics/KafkaMetricsGroup.scala

[jira] [Created] (KAFKA-1902) fix MetricName so that Yammer reporter can work correctly

2015-01-27 Thread Jun Rao (JIRA)
Jun Rao created KAFKA-1902: -- Summary: fix MetricName so that Yammer reporter can work correctly Key: KAFKA-1902 URL: https://issues.apache.org/jira/browse/KAFKA-1902 Project: Kafka Issue Type: Bug

Review Request 30321: Patch for kafka-1902

2015-01-27 Thread Jun Rao
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/30321/ --- Review request for kafka. Bugs: kafka-1902

Re: Review Request 28769: Patch for KAFKA-1809

2015-01-27 Thread Eric Olander
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28769/#review69804 --- Some of my comments are outside of the scope of this review, so

[jira] [Commented] (KAFKA-1902) fix MetricName so that Yammer reporter can work correctly

2015-01-27 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14293747#comment-14293747 ] Jun Rao commented on KAFKA-1902: Created reviewboard

[jira] [Updated] (KAFKA-1902) fix MetricName so that Yammer reporter can work correctly

2015-01-27 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-1902: --- Status: Patch Available (was: Open) fix MetricName so that Yammer reporter can work correctly

[jira] [Updated] (KAFKA-1902) fix MetricName so that Yammer reporter can work correctly

2015-01-27 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-1902: --- Attachment: kafka-1902.patch fix MetricName so that Yammer reporter can work correctly

[jira] [Commented] (KAFKA-1902) fix MetricName so that Yammer reporter can work correctly

2015-01-27 Thread Jason Rosenberg (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14293840#comment-14293840 ] Jason Rosenberg commented on KAFKA-1902: In the yammer metric reporter (which is

[jira] [Comment Edited] (KAFKA-1902) fix MetricName so that Yammer reporter can work correctly

2015-01-27 Thread Jason Rosenberg (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14293840#comment-14293840 ] Jason Rosenberg edited comment on KAFKA-1902 at 1/27/15 5:30 PM:

[jira] [Commented] (KAFKA-1902) fix MetricName so that Yammer reporter can work correctly

2015-01-27 Thread Kyle Banker (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14293854#comment-14293854 ] Kyle Banker commented on KAFKA-1902: This definitely fixes the issue. I'm now seeing

Re: Review Request 30321: Patch for kafka-1902

2015-01-27 Thread Manikumar Reddy O
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/30321/#review69813 --- Ship it! Ship It! - Manikumar Reddy O On Jan. 27, 2015, 4:16

[jira] [Commented] (KAFKA-1792) change behavior of --generate to produce assignment config with fair replica distribution and minimal number of reassignments

2015-01-27 Thread Dmitry Pekar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14293825#comment-14293825 ] Dmitry Pekar commented on KAFKA-1792: - Updated reviewboard

[jira] [Updated] (KAFKA-1792) change behavior of --generate to produce assignment config with fair replica distribution and minimal number of reassignments

2015-01-27 Thread Dmitry Pekar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitry Pekar updated KAFKA-1792: Attachment: KAFKA-1792_2015-01-27_19:09:27.patch change behavior of --generate to produce

[jira] [Comment Edited] (KAFKA-1792) change behavior of --generate to produce assignment config with fair replica distribution and minimal number of reassignments

2015-01-27 Thread Dmitry Pekar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14293825#comment-14293825 ] Dmitry Pekar edited comment on KAFKA-1792 at 1/27/15 5:12 PM: --

Re: Review Request 30321: Patch for kafka-1902

2015-01-27 Thread Eric Olander
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/30321/#review69940 --- core/src/main/scala/kafka/metrics/KafkaMetricsGroup.scala

Review Request 30355: 0.8.2 javaapi offset management API improvements

2015-01-27 Thread Joel Koshy
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/30355/ --- Review request for kafka. Bugs: KAFKA-1729