Re: Does Storm work with Spring

Hi Ravi , I was able to make an Integration with Spring but the problem is that I have to autowire for every bolt and spout . That means that even if i parallelize spout and bolt it will get started to each instance . Is there some way that I only have to do for bolts and spouts once (I mean if I

[jira] [Commented] (STORM-893) Resource Aware Scheduling

[ https://issues.apache.org/jira/browse/STORM-893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14946169#comment-14946169 ] ASF GitHub Bot commented on STORM-893: -- Github user jerrypeng commented on the pull re

[GitHub] storm pull request: [STORM-893] Resource Aware Scheduling

Github user jerrypeng commented on the pull request: https://github.com/apache/storm/pull/746#issuecomment-146066442 @zhuoliu Thanks for your review. I think just push a commit that I think address all your comments --- If your project is set up for it, you can reply to this email a

[jira] [Commented] (STORM-893) Resource Aware Scheduling

[ https://issues.apache.org/jira/browse/STORM-893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14946167#comment-14946167 ] ASF GitHub Bot commented on STORM-893: -- Github user jerrypeng commented on a diff in t

[GitHub] storm pull request: [STORM-893] Resource Aware Scheduling

Github user jerrypeng commented on a diff in the pull request: https://github.com/apache/storm/pull/746#discussion_r41347393 --- Diff: storm-core/src/jvm/backtype/storm/scheduler/resource/strategies/ResourceAwareStrategy.java --- @@ -0,0 +1,478 @@ +/** + * Licensed to the

[GitHub] storm pull request: [STORM-893] Resource Aware Scheduling

Github user jerrypeng commented on a diff in the pull request: https://github.com/apache/storm/pull/746#discussion_r41347451 --- Diff: storm-core/src/jvm/backtype/storm/utils/Utils.java --- @@ -18,10 +18,7 @@ package backtype.storm.utils; import backtype.storm.Config

[jira] [Commented] (STORM-893) Resource Aware Scheduling

[ https://issues.apache.org/jira/browse/STORM-893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14946164#comment-14946164 ] ASF GitHub Bot commented on STORM-893: -- Github user jerrypeng commented on a diff in t

[jira] [Commented] (STORM-893) Resource Aware Scheduling

[ https://issues.apache.org/jira/browse/STORM-893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14946163#comment-14946163 ] ASF GitHub Bot commented on STORM-893: -- Github user jerrypeng commented on a diff in t

[GitHub] storm pull request: [STORM-893] Resource Aware Scheduling

Github user jerrypeng commented on a diff in the pull request: https://github.com/apache/storm/pull/746#discussion_r41347349 --- Diff: storm-core/src/jvm/backtype/storm/scheduler/resource/strategies/ResourceAwareStrategy.java --- @@ -0,0 +1,478 @@ +/** + * Licensed to the

[jira] [Commented] (STORM-350) Update disruptor to latest version (3.2.1)

[ https://issues.apache.org/jira/browse/STORM-350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14946088#comment-14946088 ] ASF GitHub Bot commented on STORM-350: -- Github user HeartSaVioR commented on the pull

[GitHub] storm pull request: STORM-350: Upgrade to newer version of disrupt...

Github user HeartSaVioR commented on the pull request: https://github.com/apache/storm/pull/750#issuecomment-146045675 @revans2 It just dropped throughput when tuples are being failed. It occurred nearly end of performance test, so I'd like to test it again with longer test d

[jira] [Commented] (STORM-1084) Improve Storm config validation process to use java annotations instead of *_SCHEMA format

[ https://issues.apache.org/jira/browse/STORM-1084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945967#comment-14945967 ] ASF GitHub Bot commented on STORM-1084: --- GitHub user jerrypeng opened a pull request

[GitHub] storm pull request: [STORM-1084] - Improve Storm config validation...

GitHub user jerrypeng opened a pull request: https://github.com/apache/storm/pull/785 [STORM-1084] - Improve Storm config validation process to use java annotations instead of *_SCHEMA format So currently we specify validators: public static final String STORM_MESSAGING_NET

[jira] [Commented] (STORM-1015) Store Kafka offsets with Kafka's consumer offset management api

[ https://issues.apache.org/jira/browse/STORM-1015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945839#comment-14945839 ] ASF GitHub Bot commented on STORM-1015: --- Github user hsun-cnnxty commented on the pu

[GitHub] storm pull request: [STORM-1015] Allow Kafka offsets to be saved u...

Github user hsun-cnnxty commented on the pull request: https://github.com/apache/storm/pull/705#issuecomment-146006292 @choang thanks for the code review. Your comment on sharing the kafka store for all partitions is really helpful and I was able to cleanup a lot of unnecessary logic.

[jira] [Commented] (STORM-1015) Store Kafka offsets with Kafka's consumer offset management api

[ https://issues.apache.org/jira/browse/STORM-1015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945836#comment-14945836 ] ASF GitHub Bot commented on STORM-1015: --- Github user choang commented on the pull re

[GitHub] storm pull request: [STORM-1015] Allow Kafka offsets to be saved u...

Github user choang commented on the pull request: https://github.com/apache/storm/pull/705#issuecomment-146005945 looks really good. just had a few nits that shouldn't block. I also don't have a vote, so you'll need to find a proper reviewer :) --- If your project is set up for it,

[jira] [Commented] (STORM-1015) Store Kafka offsets with Kafka's consumer offset management api

[ https://issues.apache.org/jira/browse/STORM-1015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945831#comment-14945831 ] ASF GitHub Bot commented on STORM-1015: --- Github user choang commented on a diff in t

[GitHub] storm pull request: [STORM-1015] Allow Kafka offsets to be saved u...

Github user choang commented on a diff in the pull request: https://github.com/apache/storm/pull/705#discussion_r41324097 --- Diff: external/storm-kafka/src/jvm/storm/kafka/ZkStateStore.java --- @@ -54,50 +56,76 @@ public CuratorFramework getCurator() { return _curator;

[jira] [Commented] (STORM-1015) Store Kafka offsets with Kafka's consumer offset management api

[ https://issues.apache.org/jira/browse/STORM-1015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945827#comment-14945827 ] ASF GitHub Bot commented on STORM-1015: --- Github user choang commented on a diff in t

[GitHub] storm pull request: [STORM-1015] Allow Kafka offsets to be saved u...

Github user choang commented on a diff in the pull request: https://github.com/apache/storm/pull/705#discussion_r41323806 --- Diff: external/storm-kafka/src/jvm/storm/kafka/PartitionManager.java --- @@ -252,28 +253,26 @@ public void fail(Long offset) { public void commit()

[jira] [Commented] (STORM-1015) Store Kafka offsets with Kafka's consumer offset management api

[ https://issues.apache.org/jira/browse/STORM-1015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945818#comment-14945818 ] ASF GitHub Bot commented on STORM-1015: --- Github user choang commented on a diff in t

[GitHub] storm pull request: [STORM-1015] Allow Kafka offsets to be saved u...

Github user choang commented on a diff in the pull request: https://github.com/apache/storm/pull/705#discussion_r41323220 --- Diff: external/storm-kafka/src/jvm/storm/kafka/KafkaStateStore.java --- @@ -0,0 +1,220 @@ +package storm.kafka; + +import com.google.common.colle

[jira] [Commented] (STORM-1091) Add unit test for tick tuples to HiveBolt and HdfsBolt

[ https://issues.apache.org/jira/browse/STORM-1091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945807#comment-14945807 ] ASF GitHub Bot commented on STORM-1091: --- Github user HeartSaVioR commented on the pu

[GitHub] storm pull request: STORM-1091: Add tick tuple unit tests for hdfs...

Github user HeartSaVioR commented on the pull request: https://github.com/apache/storm/pull/784#issuecomment-146001197 +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] storm pull request: fix bin/storm's inconsistent indentation and i...

Github user erikdw commented on the pull request: https://github.com/apache/storm/pull/751#issuecomment-145997708 @HeartSaVioR : thanks for accepting & merging! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your proj

[jira] [Commented] (STORM-1090) Nimbus HA should support `storm.local.hostname`

[ https://issues.apache.org/jira/browse/STORM-1090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945768#comment-14945768 ] ASF GitHub Bot commented on STORM-1090: --- Github user HeartSaVioR commented on the pu

[GitHub] storm pull request: [STORM-1090] Nimbus HA should support `storm.l...

Github user HeartSaVioR commented on the pull request: https://github.com/apache/storm/pull/783#issuecomment-145997525 +1 Config.STORM_LOCAL_HOSTNAME is already used for supervisors/workers to report its hostname to nimbus, so it makes sense for nimbuses to report its hostname by

[GitHub] storm pull request: advance kafka offset when deserializer yields ...

Github user HeartSaVioR commented on the pull request: https://github.com/apache/storm/pull/758#issuecomment-145993674 +1, too. @prokopowicz Since this is a bug, I'd like to record this to JIRA issue before merging. Could you file a JIRA, please? --- If your project is set u

[GitHub] storm pull request: fix bin/storm's inconsistent indentation and i...

Github user HeartSaVioR commented on the pull request: https://github.com/apache/storm/pull/751#issuecomment-145992723 @erikdw Thanks for making it consistent, I merged into master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] storm pull request: fix bin/storm's inconsistent indentation and i...

Github user asfgit closed the pull request at: https://github.com/apache/storm/pull/751 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[GitHub] storm pull request: fix bin/storm's inconsistent indentation and i...

Github user HeartSaVioR commented on the pull request: https://github.com/apache/storm/pull/751#issuecomment-145991606 +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] storm pull request: STORM-1091: Add tick tuple unit tests for hdfs...

GitHub user dossett opened a pull request: https://github.com/apache/storm/pull/784 STORM-1091: Add tick tuple unit tests for hdfs and hive bolts As I mentioned in the JIRA, I relocated MockTupleHelpers from storm-starter to the test module of storm-core. This required some pom cha

[jira] [Commented] (STORM-1091) Add unit test for tick tuples to HiveBolt and HdfsBolt

[ https://issues.apache.org/jira/browse/STORM-1091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945656#comment-14945656 ] ASF GitHub Bot commented on STORM-1091: --- GitHub user dossett opened a pull request:

[jira] [Assigned] (STORM-1091) Add unit test for tick tuples to HiveBolt and HdfsBolt

[ https://issues.apache.org/jira/browse/STORM-1091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Dossett reassigned STORM-1091: Assignee: Aaron Dossett > Add unit test for tick tuples to HiveBolt and HdfsBolt >

[jira] [Created] (STORM-1091) Add unit test for tick tuples to HiveBolt and HdfsBolt

Aaron Dossett created STORM-1091: Summary: Add unit test for tick tuples to HiveBolt and HdfsBolt Key: STORM-1091 URL: https://issues.apache.org/jira/browse/STORM-1091 Project: Apache Storm I

[jira] [Commented] (STORM-1090) Nimbus HA should support `storm.local.hostname`

[ https://issues.apache.org/jira/browse/STORM-1090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945535#comment-14945535 ] ASF GitHub Bot commented on STORM-1090: --- GitHub user schonfeld opened a pull request

[GitHub] storm pull request: [STORM-1090] Nimbus HA should support `storm.l...

GitHub user schonfeld opened a pull request: https://github.com/apache/storm/pull/783 [STORM-1090] Nimbus HA should support `storm.local.hostname` Nimbus HA's `NimbusInfo` class relies on each nimbus's hostname for network reachability. This is a show-stopper in situations that util

[jira] [Updated] (STORM-1090) Nimbus HA should support `storm.local.hostname`

[ https://issues.apache.org/jira/browse/STORM-1090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Schonfeld updated STORM-1090: - Description: Nimbus HA's `NimbusInfo` class relies on each nimbus's hostname for network r

[jira] [Created] (STORM-1090) Nimbus HA should support `storm.local.hostname`

Michael Schonfeld created STORM-1090: Summary: Nimbus HA should support `storm.local.hostname` Key: STORM-1090 URL: https://issues.apache.org/jira/browse/STORM-1090 Project: Apache Storm

Exception Stack Trace for Local Cluster

Hi , I am running a local cluster on my dev machine . I see whenever something fails due to some exception in my code or library that I am using , I just get this message on console {"timeStamp":1444154764709,"host":"mum-1agrag-m.local","tid":"Thread-11-rabbitMqSpout","loglevel":"error","msg":"As

[jira] [Created] (STORM-1089) Add tool for recording and playback of storm traces

Robert Joseph Evans created STORM-1089: -- Summary: Add tool for recording and playback of storm traces Key: STORM-1089 URL: https://issues.apache.org/jira/browse/STORM-1089 Project: Apache Storm

[jira] [Commented] (STORM-893) Resource Aware Scheduling

[ https://issues.apache.org/jira/browse/STORM-893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945269#comment-14945269 ] ASF GitHub Bot commented on STORM-893: -- Github user zhuoliu commented on a diff in the

[GitHub] storm pull request: [STORM-893] Resource Aware Scheduling

Github user zhuoliu commented on a diff in the pull request: https://github.com/apache/storm/pull/746#discussion_r41285663 --- Diff: storm-core/src/jvm/backtype/storm/utils/Utils.java --- @@ -18,10 +18,7 @@ package backtype.storm.utils; import backtype.storm.Config;

[jira] [Commented] (STORM-893) Resource Aware Scheduling

[ https://issues.apache.org/jira/browse/STORM-893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945238#comment-14945238 ] ASF GitHub Bot commented on STORM-893: -- Github user zhuoliu commented on a diff in the

[jira] [Commented] (STORM-893) Resource Aware Scheduling

[ https://issues.apache.org/jira/browse/STORM-893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945243#comment-14945243 ] ASF GitHub Bot commented on STORM-893: -- Github user zhuoliu commented on a diff in the

[GitHub] storm pull request: [STORM-893] Resource Aware Scheduling

Github user zhuoliu commented on a diff in the pull request: https://github.com/apache/storm/pull/746#discussion_r41283467 --- Diff: storm-core/src/jvm/backtype/storm/scheduler/resource/strategies/ResourceAwareStrategy.java --- @@ -0,0 +1,478 @@ +/** + * Licensed to the Ap

[GitHub] storm pull request: [STORM-893] Resource Aware Scheduling

Github user zhuoliu commented on a diff in the pull request: https://github.com/apache/storm/pull/746#discussion_r41283265 --- Diff: storm-core/src/jvm/backtype/storm/scheduler/resource/strategies/ResourceAwareStrategy.java --- @@ -0,0 +1,478 @@ +/** + * Licensed to the Ap

[GitHub] storm pull request: STORM-997: Add proxy user functionality for st...

Github user revans2 commented on the pull request: https://github.com/apache/storm/pull/692#issuecomment-145868091 @priyank5485 You are correct that the name-node needs to be configured to explicitly allow super users and/or groups and optionally restrict those to specific hosts. My

[jira] [Commented] (STORM-997) Add support for user specified UGI - (UserGroupInformation) for storm hdfs connector

[ https://issues.apache.org/jira/browse/STORM-997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945073#comment-14945073 ] ASF GitHub Bot commented on STORM-997: -- Github user revans2 commented on the pull requ