[GitHub] storm pull request #2490: STORM-2840: Getting resource availability from pre...

2018-01-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/storm/pull/2490 ---

[GitHub] storm issue #2494: STORM-2880 Minor optimisation about kafka spout.

2018-01-03 Thread OuYangLiang
Github user OuYangLiang commented on the issue: https://github.com/apache/storm/pull/2494 @HeartSaVioR thanks, you can't see previous patch because I've squashed to one commit. ---

[GitHub] storm issue #2498: STORM-2881: Explicitly specify the curator dependencies i...

2018-01-03 Thread HeartSaVioR
Github user HeartSaVioR commented on the issue: https://github.com/apache/storm/pull/2498 Maybe we could file a blocker issue for Storm 2.0.0 and allow this patch. Filed https://issues.apache.org/jira/browse/STORM-2882 for that. ---

[GitHub] storm pull request #2491: STORM-2872: TestRebalance can be flaky - fixing

2018-01-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/storm/pull/2491 ---

[GitHub] storm pull request #2312: YSTORM-2725: Generic Resource Scheduling - initial...

2018-01-03 Thread govind-menon
Github user govind-menon closed the pull request at: https://github.com/apache/storm/pull/2312 ---

[GitHub] storm pull request #2500: STORM-2876: Work around memory leak, and try to sp...

2018-01-03 Thread revans2
GitHub user revans2 opened a pull request: https://github.com/apache/storm/pull/2500 STORM-2876: Work around memory leak, and try to speed up tests The actual fix is just the changes in storm-hdfs/pom.xml But this added 1 min to the build time on a decently powerful box. So to com

[GitHub] storm issue #2498: STORM-2881: Explicitly specify the curator dependencies i...

2018-01-03 Thread HeartSaVioR
Github user HeartSaVioR commented on the issue: https://github.com/apache/storm/pull/2498 It doesn't represent we decided to not relocate. We just didn't decide it, and it should be done within releasing 2.0.0. ---

[GitHub] storm issue #2498: STORM-2881: Explicitly specify the curator dependencies i...

2018-01-03 Thread HeartSaVioR
Github user HeartSaVioR commented on the issue: https://github.com/apache/storm/pull/2498 https://mail-archives.apache.org/mod_mbox/incubator-storm-dev/201703.mbox/%3ccaf5108gjjqzsyywcp99bgpgec7tufe-tbt9fi0m78ah8rkm...@mail.gmail.com%3E You can follow up the discussion to see

[GitHub] storm issue #2498: STORM-2881: Explicitly specify the curator dependencies i...

2018-01-03 Thread arunmahadevan
Github user arunmahadevan commented on the issue: https://github.com/apache/storm/pull/2498 @HeartSaVioR , any reason why we dont relocate in 2.0.0 vs 1.x ? If not users would hit issues with conflicting versions (like curator). ---

[GitHub] storm issue #2498: STORM-2881: Explicitly specify the curator dependencies i...

2018-01-03 Thread HeartSaVioR
Github user HeartSaVioR commented on the issue: https://github.com/apache/storm/pull/2498 In master branch we don't relocate any dependencies so it will make conflict anyway. Looks like this case represents that we should have a solution for 2.0.0 sooner. ---

[GitHub] storm pull request #2499: STORM-2881: Explicitly specify the curator depende...

2018-01-03 Thread arunmahadevan
GitHub user arunmahadevan opened a pull request: https://github.com/apache/storm/pull/2499 STORM-2881: Explicitly specify the curator dependencies in storm-druid pom https://github.com/apache/storm/pull/2498 applied to 1.x branch. You can merge this pull request into a Git repositor

[GitHub] storm issue #2499: STORM-2881: Explicitly specify the curator dependencies i...

2018-01-03 Thread arunmahadevan
Github user arunmahadevan commented on the issue: https://github.com/apache/storm/pull/2499 ping @omkreddy , @HeartSaVioR ---

[GitHub] storm issue #2498: STORM-2881: Explicitly specify the curator dependencies i...

2018-01-03 Thread arunmahadevan
Github user arunmahadevan commented on the issue: https://github.com/apache/storm/pull/2498 ping @omkreddy , @HeartSaVioR ---

[GitHub] storm pull request #2498: STORM-2881: Explicitly specify the curator depende...

2018-01-03 Thread arunmahadevan
GitHub user arunmahadevan opened a pull request: https://github.com/apache/storm/pull/2498 STORM-2881: Explicitly specify the curator dependencies in storm-druid pom You can merge this pull request into a Git repository by running: $ git pull https://github.com/arunmahadevan/s

[GitHub] storm pull request #2203: STORM-2153: New Metrics Reporting API

2018-01-03 Thread ptgoetz
Github user ptgoetz commented on a diff in the pull request: https://github.com/apache/storm/pull/2203#discussion_r159519245 --- Diff: storm-core/src/jvm/org/apache/storm/utils/DisruptorQueue.java --- @@ -65,7 +66,7 @@ private static final Object INTERRUPT = new Object();

[GitHub] storm pull request #2203: STORM-2153: New Metrics Reporting API

2018-01-03 Thread ptgoetz
Github user ptgoetz commented on a diff in the pull request: https://github.com/apache/storm/pull/2203#discussion_r159515622 --- Diff: storm-core/src/jvm/org/apache/storm/utils/DisruptorQueue.java --- @@ -65,7 +66,7 @@ private static final Object INTERRUPT = new Object();

[GitHub] storm pull request #2203: STORM-2153: New Metrics Reporting API

2018-01-03 Thread srdo
Github user srdo commented on a diff in the pull request: https://github.com/apache/storm/pull/2203#discussion_r159514108 --- Diff: storm-core/src/jvm/org/apache/storm/utils/DisruptorQueue.java --- @@ -65,7 +66,7 @@ private static final Object INTERRUPT = new Object();

[GitHub] storm pull request #2480: STORM-2867: Add consumer lag metrics to KafkaSpout

2018-01-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/storm/pull/2480 ---

[GitHub] storm pull request #2495: STORM-2867: Add consumer lag metrics to KafkaSpout

2018-01-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/storm/pull/2495 ---

[GitHub] storm issue #2495: STORM-2867: Add consumer lag metrics to KafkaSpout

2018-01-03 Thread srdo
Github user srdo commented on the issue: https://github.com/apache/storm/pull/2495 I believe we don't need to wait 24 hours since this is just port work. Will merge shortly. ---

[GitHub] storm issue #2480: STORM-2867: Add consumer lag metrics to KafkaSpout

2018-01-03 Thread arunmahadevan
Github user arunmahadevan commented on the issue: https://github.com/apache/storm/pull/2480 +1 ---

[GitHub] storm issue #2495: STORM-2867: Add consumer lag metrics to KafkaSpout

2018-01-03 Thread arunmahadevan
Github user arunmahadevan commented on the issue: https://github.com/apache/storm/pull/2495 @omkreddy , thanks for the patch. +1 ---

[GitHub] storm issue #2467: STORM-2860: Add Kerberos support to Solr bolt

2018-01-03 Thread omkreddy
Github user omkreddy commented on the issue: https://github.com/apache/storm/pull/2467 PR for master: https://github.com/apache/storm/pull/2497 ---

[GitHub] storm pull request #2497: STORM-2860: Add Kerberos support to Solr bolt

2018-01-03 Thread omkreddy
GitHub user omkreddy opened a pull request: https://github.com/apache/storm/pull/2497 STORM-2860: Add Kerberos support to Solr bolt You can merge this pull request into a Git repository by running: $ git pull https://github.com/omkreddy/storm kerberos-solr-bolt-master1 Altern

[GitHub] storm pull request #2496: STORM-2858 1.x

2018-01-03 Thread srdo
GitHub user srdo opened a pull request: https://github.com/apache/storm/pull/2496 STORM-2858 1.x 1.x version of https://github.com/apache/storm/pull/2462 I didn't think we needed this initially since asprintf isn't used in 1.x, but it looks like the build is failing on 1.x

[GitHub] storm pull request #2489: STORM-2874 1.x: Minor refactoring of backpressure ...

2018-01-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/storm/pull/2489 ---

[GitHub] storm issue #2494: STORM-2880 Minor optimisation about kafka spout.

2018-01-03 Thread OuYangLiang
Github user OuYangLiang commented on the issue: https://github.com/apache/storm/pull/2494 @srdo I still think it makes senses, and made a few changes, please review it again, thanks. ---

[GitHub] storm issue #2495: STORM-2867: Add consumer lag metrics to KafkaSpout

2018-01-03 Thread omkreddy
Github user omkreddy commented on the issue: https://github.com/apache/storm/pull/2495 @srdo squashed the commits. ---

[GitHub] storm issue #2495: STORM-2867: Add consumer lag metrics to KafkaSpout

2018-01-03 Thread srdo
Github user srdo commented on the issue: https://github.com/apache/storm/pull/2495 Thanks, this looks good. +1, if you squash to one commit we should be able to merge soon. Please also squash the 1.x version. ---

[GitHub] storm pull request #2480: STORM-2867: Add consumer lag metrics to KafkaSpout

2018-01-03 Thread omkreddy
Github user omkreddy commented on a diff in the pull request: https://github.com/apache/storm/pull/2480#discussion_r159413588 --- Diff: external/storm-kafka-client/src/main/java/org/apache/storm/kafka/spout/KafkaSpout.java --- @@ -144,10 +147,37 @@ public void open(Map conf, Topol

[GitHub] storm issue #2495: STORM-2867: Add consumer lag metrics to KafkaSpout

2018-01-03 Thread omkreddy
Github user omkreddy commented on the issue: https://github.com/apache/storm/pull/2495 @srdo Thanks for the review. Fixed the checkstyle issues. ---

[GitHub] storm issue #2467: STORM-2860: Add Kerberos support to Solr bolt

2018-01-03 Thread omkreddy
Github user omkreddy commented on the issue: https://github.com/apache/storm/pull/2467 Updated the PR for 1.x. Will raise PR for master ---

[GitHub] storm pull request #2467: STORM-2860: Add Kerberos support to Solr bolt

2018-01-03 Thread omkreddy
Github user omkreddy commented on a diff in the pull request: https://github.com/apache/storm/pull/2467#discussion_r159409982 --- Diff: external/storm-solr/src/main/java/org/apache/storm/solr/schema/builder/RestJsonSchemaBuilderV2.java --- @@ -0,0 +1,127 @@ +/** + * Licens

[GitHub] storm pull request #2467: STORM-2860: Add Kerberos support to Solr bolt

2018-01-03 Thread omkreddy
Github user omkreddy commented on a diff in the pull request: https://github.com/apache/storm/pull/2467#discussion_r159409508 --- Diff: external/storm-solr/README.md --- @@ -171,7 +194,7 @@ Querying Solr for these patterns, you will see the values that have been indexe

[GitHub] storm issue #2494: STORM-2880 Minor optimisation about kafka spout.

2018-01-03 Thread srdo
Github user srdo commented on the issue: https://github.com/apache/storm/pull/2494 Bikeshedding incoming: I'm not sure this is better. The two methods in ProcessingGuarantee are just named variants of equals. I think we might as well just replace the checks in KafkaSpout with

[GitHub] storm issue #2495: STORM-2867: Add consumer lag metrics to KafkaSpout

2018-01-03 Thread srdo
Github user srdo commented on the issue: https://github.com/apache/storm/pull/2495 There are checkstyle violations, you can find the list in storm-kafka-client/target/checkstyle-violations.xml. Other than that this looks good. ---

[GitHub] storm pull request #2480: STORM-2867: Add consumer lag metrics to KafkaSpout

2018-01-03 Thread srdo
Github user srdo commented on a diff in the pull request: https://github.com/apache/storm/pull/2480#discussion_r159407800 --- Diff: external/storm-kafka-client/src/main/java/org/apache/storm/kafka/spout/KafkaSpout.java --- @@ -144,10 +147,37 @@ public void open(Map conf, TopologyC

[GitHub] storm issue #2480: STORM-2867: Add consumer lag metrics to KafkaSpout

2018-01-03 Thread omkreddy
Github user omkreddy commented on the issue: https://github.com/apache/storm/pull/2480 @srdo Raised PR for master : https://github.com/apache/storm/pull/2495 ---

[GitHub] storm pull request #2495: STORM-2867: Add consumer lag metrics to KafkaSpout

2018-01-03 Thread omkreddy
GitHub user omkreddy opened a pull request: https://github.com/apache/storm/pull/2495 STORM-2867: Add consumer lag metrics to KafkaSpout You can merge this pull request into a Git repository by running: $ git pull https://github.com/omkreddy/storm kafka-metrics-apache-master

[GitHub] storm pull request #2494: STORM-2880 Minor optimisation about kafka spout.

2018-01-03 Thread OuYangLiang
GitHub user OuYangLiang opened a pull request: https://github.com/apache/storm/pull/2494 STORM-2880 Minor optimisation about kafka spout. Based on the **single responsibility principle**, method `isAtLeastOnceProcessing()` should reside in `KafkaSpoutConfig` rather than `KafkaSpout