Storm Production usage (case studies)

2014-12-12 Thread Spico Florin
Hello! I would like to know that besides the companies mentioned on the documentation (http://storm.apache.org/documentation/Powered-By.html), if they are any companies that have deployed Storm on production and what were their case study (the way that is also described in the documentation).

null pointer at DisruptorQueue

2014-12-12 Thread Ernesto Reinaldo Barreiro
Hi, I'm relatively new to Storm, a couple of months using it. So, excuse any stupid question I might post :-) I have a somewhat complex topology... At some point while developing it I have made some change that is producing following exception -

Re: null pointer at DisruptorQueue

2014-12-12 Thread Ernesto Reinaldo Barreiro
Hi. This seem to be related to the fact that there are other threads (some custom threads) interacting with my custom bolts. Removing them fixes the problem. Side note: my bolts accumulate data and at some point when new data arrive they dump this accumulated data... if no new data arrives at

Re: null pointer at DisruptorQueue

2014-12-12 Thread Ernesto Reinaldo Barreiro
Michel, On Fri, Dec 12, 2014 at 5:10 PM, Michael Rose mich...@fullcontact.com wrote: Hi Ernesto, Have multi-threaded bolts is fine as long as you synchronize on the OutputCollector before emitting/acking. That'll solve your issue. Thanks for your answer! Even if the thread is not a Storm

Re: null pointer at DisruptorQueue

2014-12-12 Thread Michael Rose
That's correct. Normally you use OutputCollector in a single thread (the executor thread for the bolt). If your bolt is multithreaded, just synchronize the entire collector no matter what thread you're emitting/acking/failing from. Michael Rose (@Xorlev https://twitter.com/xorlev) Senior Platform

Is it possible to 'force' a topology ID to a specific value?

2014-12-12 Thread Sheldon White
I’m currently looking at ways to leverage the Storm HTTP APIs to monitor the health of our storm cluster and a running topology in particular. I can get all the statistics I need when I know a particular topology ID, parsing the json returned from a URL like:

Re: write data to file then bulk copy to database

2014-12-12 Thread Sa Li
Here I found if I use a RandomTupleSpout which implements IBatchSpout to replace OpaqueTridentKafkaSpout, static class RandomTupleSpout implements IBatchSpout { private transient Random random; private static final int BATCH = 1000; @Override