Re: Looking for professionnal consulting on Apache Storm

2018-01-12 Thread Jason Kania
Hi Michaël, I cannot speak for your time zone, but I am from Ottawa, Canada and have contracted on Storm before. When we needed further deep expertise, we used Hortonworks who had French speakers at the time. I am not a French speaker myself. Cheers, Jason On Friday, January 12, 2018, 11:

Re: [SURVEY] What version of Storm are you using?

2016-08-17 Thread Jason Kania
Hi, Our building automation company uses 0.9.6. We are not using the latest version because we need stability over new functionality. We would always prefer to try upgrading after a few patch revisions have been delivered. Thanks, Jason From: P. Taylor Goetz To: user@storm.apache.org Se

Re: Debugging tuples being replayed despite acks

2016-08-09 Thread Jason Kania
Thanks for the response. The code is essentially: logger.warn( "tuple received: {}", tuple);outputCollector.ack(tuple);return; It doesn't go any further either when I step through it or run it directly. From: Priyank Shah To: "user@storm.apache.org" ; Jason Kania

Debugging tuples being replayed despite acks

2016-08-09 Thread Jason Kania
Hello, I would appreciate any suggestions as nobody seems to have answered my previous requests for assistance. I am currently using 0.10.0 and am having serious difficulties. I am unable to upgrade at present and have looked for any bugs on this issue with no luck. I am trying to figure out why

Storm Kafka retention of in progress messages

2016-08-08 Thread Jason Kania
Hello, I am wondering how long the Kafka Spout retains a reference to messages that are in progress but have not been acked. I have a situation where I am getting no failed messages in the UI but getting many retries when the topology is restarted. I am wondering if the Kafka Spout might be forg

KafkaSpout not receiving new messages until restart

2016-08-04 Thread Jason Kania
Hello, I am using Storm 0.10.0 and have an application pulling content off a Kafka topic via the Kafka spout but after some time nothing is being injected. However, after a restart of the topic, more messages come in for a while. I have done my best to confirm that there are no tuple timeouts by

Re: Connection refused during topology deployment

2016-06-28 Thread Jason Kania
Thanks for the suggestion. All the configuration is using IP addresses at this point. Are you suggesting more than ensuring that /etc/hosts and hostname map properly? Thanks, Jason From: Jacob Johansen To: user@storm.apache.org; Jason Kania Sent: Tuesday, June 28, 2016 9:13 PM

Connection refused during topology deployment

2016-06-28 Thread Jason Kania
Hello, I am currently getting a "Connection refused" exception when the supervisor attempts to download the topology from Nimbus. I have checked that the Thrift port is open and accessible on Nimbus from the node where the Supervisor is running. Are there any suggestions on how to diagnose this?

Netty disconnects

2016-06-16 Thread Jason Kania
We have a topology where a job can take up to several minutes to complete and are encountering a situation in which we are getting frequent netty dropped messages. The result is that we have to timeout each message which is causing the system to be idle a lot of the time. I am wondering if there

Re: Access to storm fieldsGrouping hashing method in bolt/spout

2016-06-11 Thread Jason Kania
Hi Satish, Thanks for the response. That does sound something like what we need. We'll give it shot to see if covers our use case. Thanks, Jason From: Satish Duggana To: user@storm.apache.org; Jason Kania Sent: Saturday, June 11, 2016 1:10 PM Subject: Re: Access to

Re: Access to storm fieldsGrouping hashing method in bolt/spout

2016-06-10 Thread Jason Kania
ext ctx,     String producer-component-id,     String output-stream-id,     String receiver-component-id,     List tuple); -Matthias On 06/08/2016 07:02 PM, Jason Kania wrote: > Hello, > > I am wondering if there is a means to access the hashing method/function > that storm

Access to storm fieldsGrouping hashing method in bolt/spout

2016-06-08 Thread Jason Kania
Hello, I am wondering if there is a means to access the hashing method/function that storm applies for the fieldsGrouping method. I would like to generate a token that will hash back to the current node so that subsequent processing can come back to the same node . I realize that generating an a

How to configure broker ids in storm kafka?

2016-02-29 Thread Jason Kania
Hello, I am trying to run storm-kafka with multiple zookeeper and kafka nodes, but I am getting "Node /brokers/ids/0 does not exist". In my case, /brokers/ids/8 and /brokers/ids/9 exist as per my kafka configuration. I cannot seem to find out how to configure storm-kafka to look for these broker

Re: Question About Emitted, Transferred and Acked Bolts

2015-02-23 Thread Jason Kania
To: user ; Jason Kania Sent: Monday, February 23, 2015 4:52 PM Subject: Re: Question About Emitted, Transferred and Acked Bolts If your processing takes a long time they may be timing out. On Mon, Feb 23, 2015 at 4:35 PM, Jason Kania wrote: Thanks for the suggestion. My traffic is only

Re: Question About Emitted, Transferred and Acked Bolts

2015-02-23 Thread Jason Kania
n the bolts themselves. That is why I thought it strange. From: Michael Rose To: "user@storm.apache.org" ; Jason Kania Sent: Monday, February 23, 2015 4:24 PM Subject: Re: Question About Emitted, Transferred and Acked Bolts Do you have enough ackers to keep up with your tra

Re: Question About Emitted, Transferred and Acked Bolts

2015-02-23 Thread Jason Kania
Michael, That's good to know. I was unaware. That said, if execution of a bolt has not occurred, I would still expect a 0 emit count and acks not to be falling behind the emits by much. My acks are half my emits. From: Michael Rose To: "user@storm.apache.org" ; Jason

Re: Question About Emitted, Transferred and Acked Bolts

2015-02-23 Thread Jason Kania
I have two comments to add: 1) Is there any JIRA for invalid metrics values? I did not see one. I am running with bolts having breakpoints and long before my bolts are every entered, the metrics indicate that these bolts already have more than 100 emits. I have thought to raise a JIRA on this bu

Re: Storm-Kafka and KeeperErrorCode = NoNode

2014-10-15 Thread Jason Kania
I guess the next question is where it doesn't exist. If I run kafka-topics.sh script, I get a list of topics that includes the one that I am using. Thanks, Jason From: Deepak Subhramanian To: user@storm.apache.org; Jason Kania C

Storm-Kafka and KeeperErrorCode = NoNode

2014-10-15 Thread Jason Kania
Hello, I suspect that their is an open JIRA report on this but have not found it although I have found a number of related jiras but none that directly matches. I am getting the following Exception on startup with a topology that uses the storm kafka spout: storm-kafka-0.9.2-incubating.jar j