Re: Passing a JVM variable to a spout (or bolt)

2017-05-08 Thread Paul Poulosky
Use the topology.worker.childopts setting to pass in jvm arguments On Monday, May 8, 2017 8:09 AM, "Hannum, Daniel" wrote: Hi,   I see a lot of conflicting into online about this, so hopefully the experts can help. I have a secure KafkaSpout (version 1.1.0 of both Storm and storm-ka

Re: open file in spout with python

2017-01-23 Thread Paul Poulosky
It's hard to know how to debug this without instrumentation.  Do you know what's failing?  Are you bundling the file you want to read with your topology, otherwise it will have be installed on every node running a supervisor. On Saturday, January 21, 2017 10:41 PM, sam mohel wrote: I

Re: Storm benchmarks

2016-11-04 Thread Paul Poulosky
IEEE Xplore Document - Benchmarking Streaming Computation Engines: Storm, Flink and Spark Streaming | | | IEEE Xplore Document - Benchmarking Streaming Computation Engines: Storm, Flink and Spark Streaming Streaming data processing has been gaining attention due to its application int

Re: Pacemaker enable problem

2016-09-06 Thread Paul Poulosky
One pacemaker is sufficient, and it does not have to be located on a node with a supervisor, or nimbus.  But it can be as long as there is no port conflict. On Tuesday, September 6, 2016 2:51 AM, Chen Junfeng wrote: I try to enable pacemaker following the instruction:To get Pacemake

Re: drpc server can't started

2016-03-10 Thread Paul Poulosky
Is something else bound to that port? On Thursday, March 10, 2016 1:09 AM, tkg_cangkul wrote: i start it from ambari ui. and then i got that message error on it's log. On 10/03/16 13:52, sam mohel wrote: I'm new to storm . I hope I can help you  Did you run command if drpc as r

Re: Storm DRPC over HTTP

2016-02-10 Thread Paul Poulosky
It is implemented. You can test it out in the example topology BasicDRPCTopology. curl http://hostname.for.dprc:/drpc/myfunctionname/hello Should return "hello!" FYI,Paul On Wednesday, February 10, 2016 2:21 PM, Victor Kovrizhkin wrote: Good day everyone!  Right now I’m looking into St

Re: Kafka spout showing error in storm

2015-11-24 Thread Paul Poulosky
You might want to see if tuples are backing up and eating up memory, or if one of your components in the worker is holding on to stale references, and preventing them from being reaped. You can add the -XX:HeapDumpPath=/path/to/heapdumps -XX:HeapDumpOnOutOfMemoryError arguments to your worker ch

Re: deploying storm topology

2015-07-27 Thread Paul Poulosky
Hi, It would be helpful to know what you are trying to do.  :-) Are you using hosted storm?   What cluster are you using? Are you trying to run a a sample topology? Are you trying to run your own topology? What error messages are you getting? Etc.  Etc. You could file a support request jira under p

Re: Need Your Help Urgent!*

2015-05-14 Thread Paul Poulosky
The best documentation is here Guaranteeing Message Processing |   | |   | |   |   |   |   |   | | Guaranteeing Message ProcessingToggle navigation Apache Storm Home About About Contributing Bylaws Download Documentation News Guarante... | | | | View on storm.apache.org | Preview by Yahoo | | |

Re: Supervisor repeatedly killing worker

2015-04-16 Thread Paul Poulosky
Are you sure the worker is writing heartbeats and the supervisor is reading them? On Thursday, April 16, 2015 1:36 PM, Grant Overby (groverby) wrote: The supervisor is reporting the worker “still hasn’t started” even though the worker is up and appears to be working. After timeo

Re: Hadoop and HBase configuration files location (inside the topology jar?)

2014-10-21 Thread Paul Poulosky
is parameter, on which config file does it go? Instead, we tried setting the "java.library.path" parameter file in "storm.yaml" to point to "/etc/hadoop/conf" and "/etc/hbase/conf" (the location of the local Hadoop/HBase config files), but it didn't work

Re: Hadoop and HBase configuration files location (inside the topology jar?)

2014-10-20 Thread Paul Poulosky
Couldn’t you set topology.classpath to include the location of the file? It would have to be installed in the same location on every worker node. From: Noam Cohen mailto:noam.co...@acuityads.com>> Reply-To: "user@storm.apache.org" mailto:user@storm.apache.org>> Da