Backpressure with fieldsgrouping

Hi, We have a topology which consumes data generated by multiple applications via Kafka. The data for one application is aggregated in a single bolt task using fieldsgrouping. All applications push data at different rates so some executors of the bolt are busier/overloaded than others and

Storm logger file

Hi, On Storm UI, we have an option to enable logger for specific classes using the following section - [image: Screen Shot 2019-04-05 at 5.30.21 PM.png] This is great but every time we redeploy our topology, we have to redefine all our loggers in the UI again which is quite a bit of work if

Re: Storm-Hive : lock acquiring problem

ld be a way for users to explicitly specify which hive release they want to use storm-hive with. The documentation for storm-hive should also be updated to reflect this requirement. Happy to provide prs if that sounds like a good idea. Thanks. On Fri, Jun 8, 2018 at 3:21 PM, Abhishek Raj wrote:

Re: Storm-Hive : lock acquiring problem

Hi. We faced a similar problem earlier when trying HiveBolt in storm with hive on emr. We were seeing java.lang.IllegalStateException: Unexpected DataOperationType: UNSET > agentInfo=Unknown txnid:130551 in hive logs. Any help here would be appreciated. On Fri, Jun 8, 2018 at 10:26 AM, Milind

Re: Stateful topology hangs

is > *literally* stuck? If you have monitoring of the topic's consumption on > kafka then it should be obvious. If you do not then you could use > Wireshark's cmdline tool called tshark to sniff kafka requests and see if > the same offset is being requested. > > - Erik

Stateful bolts

Hi. I was looking into state management which looks like a really cool feature but I am wondering if it'd be right for my use case. One of the bolts does bulk updates to database and stores the update information temporarily in

Re: Storm 1.0.2 - Nimbus reporting Gzip failure in spite of resetting Storm and Zookeeper state

Try changing "storm.zookeeper.root" in your storm.yaml and restarting storm daemons. Thanks, Abhishek On Oct 28, 2016 1:06 PM, "Øystein Larsen" wrote: > Hi! I'm having trouble running Nimbus following a systems upgrade of my > Ubuntu 14.04 server yesterday. I've tried

Re: Error when running pacemaker.

uilt jar > - run pacemaker and nimbus with JDK 7 > - see it reappears > > If it works perfectly, I guess that's the cause. If then please file an > issue so that we can track it. > > Please let me know you'd like me to test this. > > Thanks, > Jungtaek Lim (HeartSaVioR) >

Error when running pacemaker.

Hello, I am using storm 1.0.2. When I start the pacemaker daemon and then start nimbus, I see the following error in pacemaker.log repetitively and can't submit topologies. WARNING: An exception was thrown by a user handler while handling an >> exception event ([id: 0xa4126833, /127.0.0.1:43693

Re: Some bolts stop processing after a while.

ugg...@gmail.com> wrote: > Hi Abhishek, > Did you check whether spout is really emitting messages? > > On Thu, Aug 4, 2016 at 5:42 PM, Abhishek Raj <abhishek@saavn.com> > wrote: > >> Thanks for the quick response. According to storm documentation, if a >> wor

Re: Some bolts stop processing after a while.

or an ack. Design change recommended. > > On Thu, Aug 4, 2016 at 2:35 PM, Abhishek Raj <abhishek@saavn.com> > wrote: > >> Hi. >> >> We are using storm 0.9.4. Our topology consists of a linear chain of 1 >> spout and 8 bolts. In the 4th bolt we call an ext

Some bolts stop processing after a while.

Hi. We are using storm 0.9.4. Our topology consists of a linear chain of 1 spout and 8 bolts. In the 4th bolt we call an external bolt written in php which emits to 5th bolt after some processing. We are seeing that after some time, the 6th, 7th and 8th bolt completely stop processing. The

RE: No logs directory in apache storm on Mavericks

of nimbus and supervisor logs files. find / -name nimbus*log* find / -name supervisor*log* On 5/30/15, Abhishek Raj abhishekra...@outlook.com wrote: @skgadalay by ./logs I meant logs directory in apache storm. @Jeffery Maass, I tried that, the log files don't appear inside the folder even

RE: No logs directory in apache storm on Mavericks

/users/373418/maassql + On Thu, May 28, 2015 at 10:17 AM, Abhishek Raj abhishekra...@outlook.com wrote: Hi Jeff. Thanks for the response. I've checked ${storm.log.dir} and it seems to be set correctly. I verified the logs directory in the startup script (bin/storm) as well

RE: Trident and Kafka - Examples

Hi Ashish. You might find this helpful. https://github.com/apache/storm/tree/master/external/storm-kafka#trident-spout From: ashish.us...@gmail.com Date: Thu, 28 May 2015 17:25:46 -0400 Subject: Trident and Kafka - Examples To: user@storm.apache.org Hi , Are there any examples of Trident and

RE: No logs directory in apache storm on Mavericks

uncompressed Storm ), look at ./logback/cluster.xml You will see that logs write to a variable, ${storm.log.dir} Thank you for your time! + Jeff Maass linkedin.com/in/jeffmaass stackoverflow.com/users/373418/maassql + On Thu, May 28, 2015 at 3:52 AM, Abhishek Raj