Tick Tuple not functioning in apache storm 0.9.4

Hi, I have recently migrated storm version from 0.8.2 to 0.9.4. In 0.8.2 I had implemented tick tuple functionality in a bolt in my code. Tick tuple code in the bolt class is given below: private static boolean isTickTuple(Tuple tuple) { return tuple.getSourceComponent().equals(Con

cannot see all supervisor nodes from the web UI

Hi All, I am new to Storm. I deployed Storm with one ZooKeeper node, one nimbus node and two supervisor nodes. However, after I started the nimbus and supervisor daemons on different nodes, respectively, I can only see one slave node under the "Supervisor summary" tab of the Storm web UI. More

Re: Is there an upgrade process for storm?

hi, all: What about the storm-dir and related zk node? should be cleared before updating ? thank you > 在 2015年6月30日，02:11，Dillian Murphey 写道： > > Thank you! > > On Fri, Jun 26, 2015 at 5:11 PM, 임정택 > wrote: > Please note that it is just our team's approac

Re: Storm Async loop problem and Netty-Client connection failed

Hi. Seems like these are logs which occurs in progress of connecting. (We may want to lower its log level cause it doesn't mean we give up to connect, just attempting.) Your worker should print either "Giving up to connect to ", or "connection established to ". Former means that worker gave up c

Re: How to configure Storm log level

- Did your workers restarted after changing log level? - Could you check your workers to have -Dlogback.configurationFile option, and it's pointing to modified file? 2015-07-02 9:04 GMT+09:00 张炜 : > Thanks a lot, 임정택. > > It's my my bad: This is also set but I missed pasting it. > > > >

Re: How to configure Storm log level

Thanks a lot, 임정택. It's my my bad: This is also set but I missed pasting it. Also I restarted storm after I change the settings. What else could be the problem? Regards, Sai On Thu, Jul 2, 2015 at 8:00 AM, 임정택 wrote: > Hi, > > You have to modify root logger tag's level to WARN to

Storm Async loop problem and Netty-Client connection failed

Hi all, I met strange problems and below are some typical log output. Could you please help me know where the problem is? Or could anyone guide me which areas that I can start to investigate and where to find related materials? These things look very internal to me that I don't know where to start

Re: How to configure Storm log level

Hi, You have to modify root logger tag's level to WARN to make your worker write less logs. Normally you don't need to adjust access / metrics logger's level cause it is relatively small. Hope this helps. Thanks, Jungtaek Lim (HeartSaVioR) 2015-07-02 8:50 GMT+09:00 张炜 : > Hi all, > Storm

How to configure Storm log level

Hi all, Storm is really putting a lot of information so it's hard to find our own messages. I have used slf4j logger to log the message that I want to track, at level WARN and ERROR. What I have done to configure in Storm is: 1). in topology setDebug(false) 2) in storm/logback/cluster.xml change l

Re: Use case of localOrShuffleGrouping?

If your bolts are evenly spread and there is at least one on each worker using localOrShuffleGrouping can be a huge optimization. Consider this example. You have 10 bolt A tasks, 10 bolt B tasks, and 10 workers. Each worker has 1 of each task. Bolt b subscribes to bolt a. In shuffle grouping,

Use case of localOrShuffleGrouping?

I understand the difference between "shuffle grouping" and "local or shuffle grouping". But I haven't yet come across any instances where I would prefer using localOrShuffleGrouping instead of shuffleGrouping. The way I see it, shuffleGrouping helps increasing the concurrency if the tasks of a g

Re: AWS Hostnames not resolving properly Netty-Client-ip-10

I went with all local IP addresses, and that seems to work. I was use the public DNS alias ec2-54-x-y-z. I changed it to the local addresses 10.x.y.z. I typically use the public DNS alias like ec2-54-x-y-z because that gets resolved to local addresses if they can, which is kind of nice, but guess

Re: Cluster autoscaling in Storm?

Never mind, I didn't look closely enough at the docs The rebalance options are "optional" and the /0 at the end is the seconds to wait before it does the rebalance. :P On Tue, Jun 30, 2015 at 5:44 PM, Dillian Murphey wrote: > Actually, can someone explain the replace REST API. > > curl -i -b

Re: Storm meetup in Seattle

Please post a link to a live feed channel or video of the meetup held later. Regards, On Tue, Jun 30, 2015 at 6:22 AM, Parth Brahmbhatt < pbrahmbh...@hortonworks.com> wrote: > Hi Storm users and devs, > > We have started a meet up for storm and kafka users and devs. > http://www.meetup.com/Apa

Re: storm ui problem

徐鹏, You are correct, and this is fixed in 0.10.x: https://issues.apache.org/jira/browse/STORM-728 We can back-port this if necessary. -- Derek From: 임정택 To: "user@storm.apache.org" Sent: Wednesday, July 1, 2015 7:56 AM Subject: Re: storm ui problem

Re: Storm_cassandra

Thanks Brian. I will try this one. Thank you! On Monday, June 29, 2015, Brian O'Neill wrote: > > You may want to use storm-cassandra-cql, especially if you are interacting > with the table data via CQL. > > Take a look at the examples, and let me know if you need additional help: > https://githu

Re: storm ui problem

Hi! What version do you use? Thanks, Jungtaek Lim (HeartSaVioR) 2015-07-01 12:31 GMT+09:00 徐鹏 : > hi: > I found a weird problem which shown in the picture. > Base on my understanding, the number of tuple emited and the number of > tuple transfered of the spout should be swaped. > Correct me if

Re: How to send acknowledgement to clients using storm?

Ooops.. so sorry.. I was evaluating Spark as well for this purpose. :) Thanks for the quick answer. Some part of the puzzle has been solved now. Regards, Chandrash3khar Kotekar Mobile - +91 8600011455 On Wed, Jul 1, 2015 at 5:49 PM, Matthias J. Sax < mj...@informatik.hu-berlin.de> wrote: > Hi,

Re: How to send acknowledgement to clients using storm?

Hi, I guess you refer to Apache Storm (not Spark ;)) In Storm, there is no special support to notify your client (as far as I know). The right place to implement the notification should be the method Spout.ack(). I guess you are using a provided KafkaSpout. Thus, you could extend KafkaSpout with

How to send acknowledgement to clients using storm?

Hi, My application is going to have following flow. client -> apache kafka -> Apache Spark -> HBase. I would like to know what is the best way to send acknowledgement to clients using Apache spark for their message? Should my client systems be listening on some port for acknowledgement? Can Spa

Re: Implications of using Storm without Kafka

You can use any data source but you have to have *a* data source. In particular, if you want to have exactly-once semantics you need a data source that can support that. What's the volume of messages you'll be handling though? It may be that you'll be better off just writing from your server app.

Implications of using Storm without Kafka

Hi, I want to implement Storm for real time message processing in my project. I have observed that many people use 'Apache Kafka' along with 'Storm'. In my project client applications will send messages to server side and server side is supposed to authenticate messages, process them and store in