Re: Storm is unable to connect to the network or localhost

2015-04-16 Thread Shivendra Singh
Having ip mappings in /etc/hosts is often a remedy for such issues. Maybe it can help. From: Nathan Leung mailto:ncle...@gmail.com>> Reply-To: "user@storm.apache.org" mailto:user@storm.apache.org>> Date: Thursday, April 16, 2015 at 3:30 PM To: user mailto:user@storm

Re: Storm is unable to connect to the network or localhost

2015-04-16 Thread Nathan Leung
The storm process is run by the same user that the supervisor is running as. On Thu, Apr 16, 2015 at 6:24 PM, Zotti, Ryan J. wrote: > I've written a topology in Kafka and Storm. The topology works great until > I try to make a Bolt that tries to either connect to the internet (via a > restful AP

RE: Storm is unable to connect to the network or localhost

2015-04-16 Thread Zotti, Ryan J.
I've written a topology in Kafka and Storm. The topology works great until I try to make a Bolt that tries to either connect to the internet (via a restful API) or localhost (MongoDB) -- Storm is not able to connect to either. Does anyone know why this might happen? Is Kafka interfering somehow?

Re: Workaround until https://issues.apache.org/jira/browse/STORM-573 is fixed in a release

2015-04-16 Thread 임정택
You can refer https://github.com/apache/storm/pull/308 and below code. (def TEST-TIMEOUT-MS (let [timeout (System/getenv "STORM_TEST_TIMEOUT_MS")] (parse-int (if timeout timeout "5000" Cause of some reasons, it relies system environment variable, not JVM property. 2015-04-17 2:33 GMT+

Concurrent requests to DRPC

2015-04-16 Thread Douglas Alan
Hi. We want to make a Storm topology than handles DRPC requests, and we want the requests to be handled concurrently. I.e., if a DRPC request comes into the topology at time T0 that takes a long time to complete (let's say 100 seconds), we don't want this request to block another request that comes

RE: Regarding Storm Trident

2015-04-16 Thread Brunner, Bill
Its all in here: https://storm.apache.org/documentation/Trident-API-Overview.html -Original Message- From: Gaurav Agarwal [mailto:gaurav130...@gmail.com] Sent: Thursday, April 16, 2015 2:05 PM To: user@storm.apache.org Subject: Re: Regarding Storm Trident i am aware of thse docs but if

Re: Supervisor repeatedly killing worker

2015-04-16 Thread Grant Overby (groverby)
I’m not, and If I had to guess I’d say it’s likely something is going wrong with the heartbeats, but how can I go about finding out? From: Paul Poulosky mailto:ppoul...@yahoo-inc.com>> Reply-To: "user@storm.apache.org" mailto:user@storm.apache.org>>, Paul Poulosk

Re: Supervisor repeatedly killing worker

2015-04-16 Thread Paul Poulosky
Are you sure the worker is writing heartbeats and the supervisor is reading them? On Thursday, April 16, 2015 1:36 PM, Grant Overby (groverby) wrote: The supervisor is reporting the worker “still hasn’t started” even though the worker is up and appears to be working. After timeo

Supervisor repeatedly killing worker

2015-04-16 Thread Grant Overby (groverby)
The supervisor is reporting the worker “still hasn’t started” even though the worker is up and appears to be working. After timeout, the supervisor kills and restarts the worker. I set the timeouts really high (10 mins) to see what would happen. I though maybe a GC pause or something. The worke

Re: Regarding Storm Trident

2015-04-16 Thread Gaurav Agarwal
i am aware of thse docs but if i have to check something about trident multireduce, merge and other methods like this where we need to go.. On 4/16/15, Jake K. Dodd wrote: > https://storm.apache.org/documentation/Trident-tutorial.html > > https://storm.apache.org/documentation/Trident-API-Overvie

Re: Regarding Storm Trident

2015-04-16 Thread Jake K. Dodd
https://storm.apache.org/documentation/Trident-tutorial.html https://storm.apache.org/documentation/Trident-API-Overview.html https://storm.apache.org/documentation/Trident-state Best Jake K Dodd > On Apr 16, 2015, at 12:36, Gaurav Agarwal wrote: > > -- Forwarded message -- >

Regarding Storm Trident

2015-04-16 Thread Gaurav Agarwal
-- Forwarded message -- From: Gaurav Agarwal Date: Thu, 16 Apr 2015 22:40:27 +0530 Subject: Regarding Storm Trident To: us...@storm.apache.org Hello I am trying to implement trident Stream,merge,multireduce and other functions in my code . But there is no proper documentation th

Re: Workaround until https://issues.apache.org/jira/browse/STORM-573 is fixed in a release

2015-04-16 Thread Mark Tomko
Setting the property using System.setProperty does not work, but setting the property in the shell does seem to. One thing that I notice is that if a worker process dies, it kills the entire JVM. I'm running my tests from SBT at the moment, and when the exception is thrown, I'm getting dropped bac

Re: Stuck while running storm in local mode:

2015-04-16 Thread Nishu
Since this is parsing error in storm.yaml file, check whether you have any tabspace in file. Try to remove all tab or space and rewrite. Then it should work fine. You can also validate your yaml file on yamlLint . On Thu, Apr 16, 2015 at 6:35 PM, Gaurav Pandey wrote: >

extract storm example from 0.9.4

2015-04-16 Thread alexey yakubovich
Hi, my first time, with Storm mailing list. Good to meet you guys. How to extract the example projects from latest storm distribution (0.9.4) and have each example as a separate maven project (in eclipse)?Or, may be somebody can point me some example of storm/kafka that already have all dependenc

Using Storm with Kundera to write into Cassandra/HBase

2015-04-16 Thread Spico Florin
Hello! Does anyone used Kundera ( https://github.com/impetus-opensource/Kundera/wiki/Getting-Started-in-5-minutes) to write/read data from/to Cassadra/HBase? Any suggestions or github example will be appreciated. Thanks. Florin

Stuck while running storm in local mode:

2015-04-16 Thread Gaurav Pandey
I am configuring Cassendra 1.0 on CentOS 5.7 but getting stacked when running the command "cassandra -f". Here is the error message- Caused by: expected '', but found BlockMappingStart in 'reader', line 24, column 1: storm.zookeeper.port: 2181 ^ at org.yaml.snakeyaml.parser.ParserI

Re: Workaround until https://issues.apache.org/jira/browse/STORM-573 is fixed in a release

2015-04-16 Thread 임정택
Hello. You can try set system environment "STORM_TEST_TIMEOUT_MS" and run your test. It'll bind to TEST_TIMEOUT_MS and it's default timeout value of complete-topology. Hope this helps. Regards. Jungtaek Lim (HeartSaVioR) 2015-04-16 1:08 GMT+09:00 Mark Tomko : > Hi, > > I'm working on some test

RE: how to get spout to re-emit in trident

2015-04-16 Thread Brunner, Bill
You would throw a FailedException From: 王天驹 [mailto:wangtianju@gmail.com] Sent: Thursday, April 16, 2015 4:39 AM To: user@storm.apache.org Subject: how to get spout to re-emit in trident hi, I am new to trident, when we use low level storm api, we call fail(tuple) to tell spout to re-emit tu

Storm 0.9.4 on yarn

2015-04-16 Thread Sandeep Samudrala
I was running storm on yarn using "https://github.com/yahoo/storm-yarn"; but yahoo storm on yarn was integrated with storm-0.9.0-wip21, which is bit older version. We tried patching storm 0.9.4 with storm-on-yarn and then deploy storm on yarn cluster.The Storm UI shows up with. "Page not found" I

An exception occured while executing the Java class. java.lang.InterruptedException

2015-04-16 Thread Chun Yuen Lim
I get my Apache Storm from http://mirror.symnds.com/software/Apache/storm/apache-storm-0.9.3/apache-storm-0.9.3.tar.gz I never modified any thing in the /home/user/storm/examples/storm-starter/ directory. When I run mvn exec:java -D storm.topology=storm.starter.WordCountTopology in the /home/user

how to get spout to re-emit in trident

2015-04-16 Thread 王天驹
hi, I am new to trident, when we use low level storm api, we call fail(tuple) to tell spout to re-emit tuple what shall we do in trident to get the spout to re-emit? throw a runtime exception? thx

Re: ShellBolt / Bash invocation: Source environment variables

2015-04-16 Thread Johannes Hugo Kitschke
To answer my own question (maybe it's useful for someone else): My findings are: - bash is launched as non-login, non-interactive shell for the shell bolt - in this mode bash looks for a path/file in the environment variable 'BASH_ENV', if it exists that file is sourced - now I only had to creat