Storm vs Spark Streaming Tech Evaluation

Hi All, The data platform team at Inmobi recently performed an extensive evaluation exercise in the process of finalizing the real-time Stream processing stack as the choice of our platform. We have captured all the details of our evaluation as the following series of 4 blogs which have been

[jira] [Commented] (STORM-1022) disconnectiong between workers

[ https://issues.apache.org/jira/browse/STORM-1022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14963167#comment-14963167 ] vishnu rao commented on STORM-1022: --- I came across the same exception while using STORM

[GitHub] storm pull request: STORM-1118: Added test to compare latency vs. ...

Github user kishorvpatil commented on the pull request: https://github.com/apache/storm/pull/805#issuecomment-149225741 LGTM. +1. `storm-metrics` would be useful sub-module to keep up our efforts with improving storm metrics. --- If your project is set up for it, you can reply to

[GitHub] storm pull request: Windows fork option

Github user JamisonWhite commented on the pull request: https://github.com/apache/storm/pull/335#issuecomment-149218263 Closing pull request because other contributors have updated the python files for Windows. --- If your project is set up for it, you can reply to this email and

[GitHub] storm pull request: Windows fork option

Github user JamisonWhite closed the pull request at: https://github.com/apache/storm/pull/335 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[jira] [Commented] (STORM-1117) Show Visualization broken : Missing visualization-init route in UI

[ https://issues.apache.org/jira/browse/STORM-1117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14963328#comment-14963328 ] ASF GitHub Bot commented on STORM-1117: --- Github user revans2 commented on the pull request:

[GitHub] storm pull request: [STORM-1117] Adds visualization-init route pre...

Github user revans2 commented on the pull request: https://github.com/apache/storm/pull/804#issuecomment-149218963 +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] storm pull request: Storm-697: Support for Emitting Kafka Message ...

Github user mjtieman commented on the pull request: https://github.com/apache/storm/pull/454#issuecomment-149210877 @HeartSaVioR Mind taking a look at these changes to determine if they should be merged? --- If your project is set up for it, you can reply to this email and have your

[jira] [Commented] (STORM-1119) Create access logging for all daemons

[ https://issues.apache.org/jira/browse/STORM-1119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14963334#comment-14963334 ] ASF GitHub Bot commented on STORM-1119: --- Github user revans2 commented on the pull request:

Re: Could Storm config dispatcher like akka?

Renkai, The execution models between storm and akka are rather different.  Storm has dedicated threads for each executor, although multiple tasks (bolt/spout instances) can share the same executor thread.  We rely on the OS to do the right thing in scheduling threads to run.  Akka is using an

[jira] [Commented] (STORM-1118) Add Test for latency vs throughput

[ https://issues.apache.org/jira/browse/STORM-1118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14963364#comment-14963364 ] ASF GitHub Bot commented on STORM-1118: --- Github user kishorvpatil commented on the pull request:

[GitHub] storm pull request: [STORM-1093] Launching Workers with resources ...

Github user revans2 commented on a diff in the pull request: https://github.com/apache/storm/pull/790#discussion_r42380191 --- Diff: conf/defaults.yaml --- @@ -140,7 +140,8 @@ supervisor.memory.capacity.mb: 3072.0 supervisor.cpu.capacity: 400.0 ### worker.* configs

[jira] [Commented] (STORM-1093) Launching Workers with resources specified in resource-aware schedulers

[ https://issues.apache.org/jira/browse/STORM-1093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14963410#comment-14963410 ] ASF GitHub Bot commented on STORM-1093: --- Github user revans2 commented on a diff in the pull

Re: Does Storm work with Spring

Hi Ravi , Need your help . So I created a local cluster and deployed my topology to it . Inside my Spout and Bolts , I am launching a Spring Boot application wrapped inside a singleton to initialise my context . Unfortunately , it appears to me that it is not working : and annotations like

Re: Does Storm work with Spring

you may have to tell Spring that ur .yaml file is ur resource file. Ravi. On Mon, Oct 19, 2015 at 3:25 PM, Ankur Garg wrote: > Hi Ravi , > > Need your help . So I created a local cluster and deployed my topology to > it . Inside my Spout and Bolts , I am launching a

[jira] [Commented] (STORM-1022) disconnectiong between workers

[ https://issues.apache.org/jira/browse/STORM-1022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14963506#comment-14963506 ] vishnu rao commented on STORM-1022: --- hi Robert, The Stack trace provided is of the Metric Consumer I

[jira] [Commented] (STORM-1022) disconnectiong between workers

[ https://issues.apache.org/jira/browse/STORM-1022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14963534#comment-14963534 ] Robert Joseph Evans commented on STORM-1022: Yes exactly. I'm not really sure how that

[jira] [Commented] (STORM-1022) disconnectiong between workers

[ https://issues.apache.org/jira/browse/STORM-1022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14963542#comment-14963542 ] vishnu rao commented on STORM-1022: --- hi Robert, the scenario i mentioned lead to the same exception

[jira] [Commented] (STORM-1093) Launching Workers with resources specified in resource-aware schedulers

[ https://issues.apache.org/jira/browse/STORM-1093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14963510#comment-14963510 ] ASF GitHub Bot commented on STORM-1093: --- Github user revans2 commented on the pull request:

[GitHub] storm pull request: [STORM-1093] Launching Workers with resources ...

Github user revans2 commented on the pull request: https://github.com/apache/storm/pull/790#issuecomment-149258631 The code looks good the tests all pass I am +1 on this. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[jira] [Commented] (STORM-1093) Launching Workers with resources specified in resource-aware schedulers

[ https://issues.apache.org/jira/browse/STORM-1093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14963968#comment-14963968 ] ASF GitHub Bot commented on STORM-1093: --- Github user asfgit closed the pull request at:

[jira] [Resolved] (STORM-1093) Launching Workers with resources specified in resource-aware schedulers

[ https://issues.apache.org/jira/browse/STORM-1093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhuo Liu resolved STORM-1093. - Resolution: Fixed Merged. > Launching Workers with resources specified in resource-aware schedulers >

[GitHub] storm pull request: [STORM-1093] Launching Workers with resources ...

Github user asfgit closed the pull request at: https://github.com/apache/storm/pull/790 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (STORM-1093) Launching Workers with resources specified in resource-aware schedulers

[ https://issues.apache.org/jira/browse/STORM-1093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14963964#comment-14963964 ] ASF GitHub Bot commented on STORM-1093: --- Github user knusbaum commented on the pull request:

[GitHub] storm pull request: [STORM-1093] Launching Workers with resources ...

Github user knusbaum commented on the pull request: https://github.com/apache/storm/pull/790#issuecomment-149330539 +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] storm pull request: STORM-1118: Added test to compare latency vs. ...

Github user jerrypeng commented on the pull request: https://github.com/apache/storm/pull/805#issuecomment-149334480 +1 this is going to be very useful when attempting to profile storm performance and underlying hardware performance --- If your project is set up for it, you can

[jira] [Commented] (STORM-1118) Add Test for latency vs throughput

[ https://issues.apache.org/jira/browse/STORM-1118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14963982#comment-14963982 ] ASF GitHub Bot commented on STORM-1118: --- Github user jerrypeng commented on the pull request:

[jira] [Commented] (STORM-1073) SequenceFileBolt can end up in an unrecoverable state

[ https://issues.apache.org/jira/browse/STORM-1073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14964045#comment-14964045 ] ASF GitHub Bot commented on STORM-1073: --- Github user dossett commented on the pull request:

[jira] [Commented] (STORM-1119) Create access logging for all daemons

[ https://issues.apache.org/jira/browse/STORM-1119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14963978#comment-14963978 ] ASF GitHub Bot commented on STORM-1119: --- Github user jerrypeng commented on the pull request:

[GitHub] storm pull request: [STORM-1119] Create access logging for all dae...

Github user jerrypeng commented on the pull request: https://github.com/apache/storm/pull/806#issuecomment-149334001 +1 nicely done --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] storm pull request: STORM-1073: Refactor AbstractHdfsBolt

Github user dossett commented on the pull request: https://github.com/apache/storm/pull/767#issuecomment-149346069 @arunmahadevan @harshach Do either of you have additional feedback on this PR? Thank you! --- If your project is set up for it, you can reply to this email and have

[jira] [Commented] (STORM-1110) System Components Page is not available

[ https://issues.apache.org/jira/browse/STORM-1110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14964121#comment-14964121 ] ASF GitHub Bot commented on STORM-1110: --- Github user kishorvpatil closed the pull request at:

[jira] [Commented] (STORM-1110) System Components Page is not available

[ https://issues.apache.org/jira/browse/STORM-1110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14964120#comment-14964120 ] ASF GitHub Bot commented on STORM-1110: --- Github user kishorvpatil commented on the pull request:

[jira] [Commented] (STORM-1111) Fix Validation for lots of different configs

[ https://issues.apache.org/jira/browse/STORM-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14963820#comment-14963820 ] ASF GitHub Bot commented on STORM-: --- Github user jerrypeng commented on the pull request:

[GitHub] storm pull request: STORM-720: Storm.cmd should return ERRORLEVEL ...

Github user rtandonmsft commented on a diff in the pull request: https://github.com/apache/storm/pull/476#discussion_r42408922 --- Diff: bin/storm.cmd --- @@ -90,6 +90,7 @@ ) set path=%PATH%;%STORM_BIN_DIR%;%STORM_SBIN_DIR% call start /b "%storm-command%"

[jira] [Commented] (STORM-720) Storm.cmd should return ERRORLEVEL before exiting main block

[ https://issues.apache.org/jira/browse/STORM-720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14963797#comment-14963797 ] ASF GitHub Bot commented on STORM-720: -- Github user rtandonmsft commented on a diff in the pull

[jira] [Commented] (STORM-1110) System Components Page is not available

[ https://issues.apache.org/jira/browse/STORM-1110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14964122#comment-14964122 ] ASF GitHub Bot commented on STORM-1110: --- GitHub user kishorvpatil reopened a pull request:

[GitHub] storm pull request: [STORM-1110] Fix Component Page for system com...

Github user kishorvpatil commented on the pull request: https://github.com/apache/storm/pull/799#issuecomment-149356704 testing travis build.. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

Re: [VOTE] Release Apache Storm 0.9.6

OK, well I hadn't seen this happen before downloading the release candidate. For 697059e958879c4daae5f4db57ce9abc04e81bd7: * Verified sigs & sums * built the source and ran all tests * deployed the tarball and ran word_count -1: HeartSaVioR says STORM-996 does affect 0.9.x, then I agree it is a

Re: [VOTE] Release Apache Storm 0.9.6

Yeah, message-in-order is also critical for me since our team relies on that. Since we fixed this for now (by backporting), it will be fine for next RC. 2015-10-20 6:49 GMT+09:00 Derek Dagit : > OK, well I hadn't seen this happen before downloading the release >

[jira] [Commented] (STORM-1110) System Components Page is not available

[ https://issues.apache.org/jira/browse/STORM-1110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14964181#comment-14964181 ] ASF GitHub Bot commented on STORM-1110: --- Github user HeartSaVioR commented on the pull request:

[jira] [Updated] (STORM-1093) Launching Workers with resources specified in resource-aware schedulers

[ https://issues.apache.org/jira/browse/STORM-1093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated STORM-1093: Fix Version/s: 0.11.0 > Launching Workers with resources specified in resource-aware schedulers >

[GitHub] storm pull request: [STORM-1110] Fix Component Page for system com...

Github user HeartSaVioR commented on the pull request: https://github.com/apache/storm/pull/799#issuecomment-149365765 Since there're so many random test failures for now, we may be OK to treat test is passed when more than one of two Travis build are success. --- If your project is

[GitHub] storm pull request: [STORM-1110] Fix Component Page for system com...

GitHub user kishorvpatil reopened a pull request: https://github.com/apache/storm/pull/799 [STORM-1110] Fix Component Page for system components - Remove redundant method `system-id?` - as is calls into static `Utils/isSystemId` - All System components are of type bolts. You

[GitHub] storm pull request: [STORM-1110] Fix Component Page for system com...

Github user kishorvpatil closed the pull request at: https://github.com/apache/storm/pull/799 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[jira] [Commented] (STORM-885) Heartbeat Server (Pacemaker)

[ https://issues.apache.org/jira/browse/STORM-885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14964303#comment-14964303 ] Jungtaek Lim commented on STORM-885: [~knusbaum] I just would like to see its progress, as I'm a fan of

[jira] [Commented] (STORM-1073) SequenceFileBolt can end up in an unrecoverable state

[ https://issues.apache.org/jira/browse/STORM-1073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14964475#comment-14964475 ] ASF GitHub Bot commented on STORM-1073: --- Github user arunmahadevan commented on the pull request:

[GitHub] storm pull request: STORM-1073: Refactor AbstractHdfsBolt

Github user arunmahadevan commented on the pull request: https://github.com/apache/storm/pull/767#issuecomment-149425136 looks good to me --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

Re: Does Storm work with Spring

Hi John , input.rabbitmq.port is being defined inside a yml file placed inside my config folder which is in one of the dependent projects which my project references . Ironically , when I run this on LocalCluster everything works absolutely fine . Only when I send it to the cluster is when the

[jira] [Commented] (STORM-1111) Fix Validation for lots of different configs

[ https://issues.apache.org/jira/browse/STORM-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14963579#comment-14963579 ] ASF GitHub Bot commented on STORM-: --- GitHub user jerrypeng opened a pull request:

[GitHub] storm pull request: [STORM-1111] - Fix Validation for lots of diff...

GitHub user jerrypeng opened a pull request: https://github.com/apache/storm/pull/807 [STORM-] - Fix Validation for lots of different configs You can merge this pull request into a Git repository by running: $ git pull https://github.com/jerrypeng/storm STORM-