Re: Should I always make a copy of the data in Tuple during execute()?

2015-05-15 Thread Banias H
Thanks Nathan. Your info is appreciated. On Fri, May 15, 2015 at 6:36 AM, Nathan Leung ncle...@gmail.com wrote: You should not get this if you're creating a new object every time. The rule of thumb is that data in tuples should be considered immutable; you can break the rule but it requires

Re: Should I always make a copy of the data in Tuple during execute()?

2015-05-15 Thread Nathan Leung
You should not get this if you're creating a new object every time. The rule of thumb is that data in tuples should be considered immutable; you can break the rule but it requires care otherwise you will encounter subtle problems. Given your timeline, this only makes sense if you reuse an object

Re: Need help

2015-05-15 Thread Jeffery Maass
See the 0.9.4 release codebase @ https://github.com/apache/storm/tree/v0.9.4 There is a project called Storm Starter @ https://github.com/apache/storm/tree/v0.9.4/examples/storm-starter Thank you for your time! + Jeff Maass maas...@gmail.com linkedin.com/in/jeffmaass

Re: Hibernate + Storm

2015-05-15 Thread Fan Jiang
Yes, Enno is right about JDBC. Because JDBC is blocking in nature and JDBC operations could be frequently performed when you are working on a RDBMS in Java, limiting them will potentially improve the topology's throughput. Fan 2015-05-15 9:32 GMT-04:00 Enno Shioji eshi...@gmail.com: JDBC

Re: No of Records Processed By Topology Per second ???

2015-05-15 Thread Jeffery Maass
Ashish: Take a look at these videos: Learning Storm: - https://www.youtube.com/watch?v=iLZrYPbNypg - InfoChimps - uses storm quite a bit - covers storm networking / buffering - https://www.youtube.com/watch?v=bdps8tE0gYo - This is

RE: Need help

2015-05-15 Thread Rajesh_Kalluri
Dell - Internal Use - Confidential If you learn better by reading a book try http://www.manning.com/sallen/. It starts with basics and ramps up to reliable message processing and beyond. From: Jeffery Maass [mailto:maas...@gmail.com] Sent: Friday, May 15, 2015 10:18 AM To: user@storm.apache.org

Re: How to implement static initialization in storm for several topolgies

2015-05-15 Thread Nathan Leung
Lazy initialized singleton. Let the os release the memory when you're done :). On May 15, 2015 6:44 PM, Dzmitry Viarzhbitski dzmitry.viarzhbit...@gmail.com wrote: Let's I assume that I have several topologies in the same jar which are using some cache. I need to init cache (cache subscribed

Re: How to implement static initialization in storm for several topolgies

2015-05-15 Thread Nathan Leung
Sorry misread original email. If you need to share across topologies then you should consider something like memcache. On May 15, 2015 6:52 PM, wrote: Lazy initialized singleton. Let the os release the memory when you're done :). On May 15, 2015 6:44 PM, Dzmitry Viarzhbitski

Re: How to implement static initialization in storm for several topolgies

2015-05-15 Thread Dzmitry Viarzhbitski
I have cache synchronized with other machines by TCP/IP but I don't know: 1) where to init it (in bolt prepare? Is it possible to do it for worker?) 2) and how to dispose it (caches uses a connection to remote http server, it's better to close it after all topologies will be deactivated). I

Re: Hibernate + Storm

2015-05-15 Thread Thiago Kronig
Also, it is usually better to hit once the database and fetch a batch of tuples, that in turn will be serialized (inside the Hibernate context), then splitted in bolts and so forth. On Fri, May 15, 2015 at 11:03 AM Mason Yu computerhon...@gmail.com wrote: Blocking is the antithesis to

Re: Need help

2015-05-15 Thread Asif Ihsan
That project doesn't do anything about message delivery. I have to make sure guaranteed processing of the message sent by the spout to bolt. On Fri, May 15, 2015 at 5:33 PM, Jeffery Maass maas...@gmail.com wrote: See the 0.9.4 release codebase @ https://github.com/apache/storm/tree/v0.9.4

Re: Need help

2015-05-15 Thread Enno Shioji
Try this? https://github.com/wurstmeister/storm-kafka-0.8-plus-test/blob/master/src/main/java/storm/kafka/trident/SentenceAggregationTopology.java On Fri, May 15, 2015 at 3:51 PM, Asif Ihsan asifihsan.ih...@gmail.com wrote: That project doesn't do anything about message delivery. I have to make

Re: error in the cluster

2015-05-15 Thread Jeffery Maass
Like I said, it's only a feeling I have. Is the disk full? df -h How many open connections are there / grouped by state: netstat -nat | awk '{print $6}' | sort | uniq -c | sort -n run top - see what the processor utilization is are you monitoring the storm worker box? What does the monitoring

Re: error in the cluster

2015-05-15 Thread Hadi Sotudeh
can you explain more? What do you mean by look at the health of the underlying OS?

error in the cluster

2015-05-15 Thread Hadi Sotudeh
Hi I've submitted my project to the cluster after a while I've got the following output: Any idea? 2015-05-15 22:47:33 o.a.c.f.s.ConnectionStateManager [INFO] State change: SUSPENDED 2015-05-15 22:47:34 o.a.z.ClientCnxn [INFO] Opening socket connection to server

Re: Need help

2015-05-15 Thread Asif Ihsan
Thank you all. On Fri, May 15, 2015 at 8:42 PM, rajesh_kall...@dellteam.com wrote: *Dell - Internal Use - Confidential * If you learn better by reading a book try http://www.manning.com/sallen/. It starts with basics and ramps up to reliable message processing and beyond. *From:*