Re: Next version of storm?

2016-03-30 Thread Tech Id
STORM-971 is another good fix we would like to have. Would appreciate if someone can suggest when is next version of storm scheduled? Thanks for helping, Regards Tid On Sat, Mar 12, 2016 at 6:23 AM, Craig Charleton

Re: external/storm-elasticsearch - upgrade requested

2016-03-30 Thread Aaron . Dossett
Size of cluster is TBD, but we ultimately want to ingest tens of millions of events per minute. On Mar 30, 2016, at 1:31 PM, Tech Id > wrote: Hey Aaron, Do you have a target throughput that you want to achieve through ES-Bolt ? How

Re: Storm KafkaSpout Integration

2016-03-30 Thread Spico Florin
hi, i think the problem that you have is that you have stup one partition per topic, but you try to conume with 10 kafka task spouts. check this lines builder.setSpout("words", new KafkaSpout(kafkaConfig), 10); 10 represents the task parslellism for the spout, that shoul be in the case of kafka

Re: external/storm-elasticsearch - upgrade requested

2016-03-30 Thread Tech Id
Hey Aaron, Do you have a target throughput that you want to achieve through ES-Bolt ? How many storm machines you plan to run your topology on? Thanks On Wed, Mar 30, 2016 at 10:53 AM, Aaron.Dossett wrote: > In setting up a storm -> ES topology today I ran across

Re: Combining group by and time window

2016-03-30 Thread Spico Florin
hello! from storm perspective, regarding window functionality, storm 1.0 will add the implementation for window bolt. there is a verry good article regarding on hortonwork what kind of functionality is provided. please have a look at

Re: external/storm-elasticsearch - upgrade requested

2016-03-30 Thread Aaron . Dossett
In setting up a storm -> ES topology today I ran across that same fact. The EsIndexBolt is also synchronous mode only, with no option for asynch. This week I'll evaluate adding batching/async to storm-elasticsearch or switching to ES-hadoop for my use use cases. From: Tech Id

Fw: Combining group by and time window

2016-03-30 Thread Maria Musterfrau
Does anyone have an idea?   Thank you in advance.   Regards, Daniela   Gesendet: Montag, 28. März 2016 um 21:06 Uhr Von: "Maria Musterfrau" An: user@storm.apache.org Betreff: Combining group by and time window Hi,   I have a stream with time series data from

Re: external/storm-elasticsearch - upgrade requested

2016-03-30 Thread Tech Id
I think elasticsearch-hadoop has a good number of options to tune and those are documented well too. (See https://www.elastic.co/guide/en/elasticsearch/hadoop/current/configuration.html ) One thing I see in favor of the elasticsearch-hadoop is that it provides batching without Trident. This could

Which version of Storm is Hbase (1.1.1) and Kafka (0.8.2.1) compatible with?

2016-03-30 Thread Fabian Schreiber
Hi guys,   is there a version of Storm that is compatible with Hbase v.1.1.1 and Kafka v.0.8.2.1?   How do I find out with which versions of Kafka and Hbase  Storm v.0.96 is compatible with?   Thanks for your help!   Cheers, Fabian

Re: Storm KafkaSpout Integration

2016-03-30 Thread Sai Dilip Reddy Kiralam
Hi david, Can I know how many partitions you are having? statement I have given to you is default.if you are running with no of partitions make sure you give same number eg: if you are running with two partitions change the number to 2 in the statement .

RE: Storm KafkaSpout Integration

2016-03-30 Thread david kavanagh
Thanks for the reply! I added the line as you suggested but there is still no difference unfortunately. I am just guessing at this stage but judging by the output below it, it seems like it is something to do with the partitioning or the offset.The warnings start by staying that there are more

Integrating Kafkaspout and python bolt

2016-03-30 Thread Neeraj Kumar
Hi I am trying implement a topology in which a kafka spout provides input to a python bolt. The input will be a sentence and python bolt will split it into words. However when I submit the topology I get the below error in storm UI. As I am new to storm I am not able to figure out its meaning.

Storm UI does not show statistics of "acked" tuples,

2016-03-30 Thread shahab
Hello, I am using Kafka-Storm (0.10.0) spout in storm (0.9.4) topology and i noticed that I can not see the statistics of acked/failed tuples in the UI. is there any settings that I messed up with or this is just due to incompatibility between kafka-storm spout and storm? best, /Shahab

Re: 答复: Best way to Submit a Job to Storm Topology

2016-03-30 Thread Erik Weathers
Can you please be more specific? i.e., which jars are considered duplicate? Can you provide a stack trace? What version of storm are you using? There have been a lot of changes regarding storm-core's shading of internal dependencies. - Erik On Tue, Mar 29, 2016 at 10:34 PM, Vineet Mishra