partitionPersist Example

2014-05-01 Thread Dan
Is there an example of using partitionPersist to persist data to ElasticSearch and/or Cassandra? Preferably somethingslightly more complicated than the canonical WordCount example Much obliged-Dan Cieslak

RE: Kryo

2014-05-16 Thread Dan
Just curious - is there a ballpark ETA for 0.9.2? > Date: Fri, 16 May 2014 22:51:30 +0200 > From: michael+st...@michael-noll.com > To: user@storm.incubator.apache.org > Subject: Re: Kryo > > And to add to what Osman said, the upcoming Storm 0.9.2 version will be > using Kryo 2.21. There are two

RE: Time Partitioning of Tuples

2014-06-06 Thread Dan
You might look at Esper. I believe someone has even embedded Esper into Storm -Dan Date: Fri, 6 Jun 2014 15:40:08 -0700 Subject: Re: Time Partitioning of Tuples From: jkp...@ucdavis.edu To: user@storm.incubator.apache.org Hi Kyle, I'm looking for a real-time batch processing tool. In my

RE: Time Partitioning of Tuples

2014-06-08 Thread Dan
I've not used it, but you might look at: https://github.com/buildlackey/cep/tree/master/esper%2Bstorm%2Bkafka -Dan From: l.p.pe...@newcastle.ac.uk To: user@storm.incubator.apache.org Subject: RE: Time Partitioning of Tuples Date: Sun, 8 Jun 2014 21:40:37 + Hi, Is there anybody wh

RE: Apache Storm vs Apache Spark

2014-06-09 Thread Dan
Where would Akka fit on the Storm/Spark spectrum? ThanksDan Date: Mon, 9 Jun 2014 15:48:49 -0700 Subject: Re: Apache Storm vs Apache Spark From: ora...@gmail.com To: user@storm.incubator.apache.org Thanks Taylor. Storm seems more flexible in terms of its framework in that it provides key primiti

RE: Extracting Performance Metrics

2014-06-16 Thread Dan
Be careful when using Coda Hale's Metrics package when measuring latency. Consider using Gil Tene'sHigh Dynamic Range Histogram instead: http://hdrhistogram.github.io/HdrHistogram/ -Dan From: and...@parsely.com Date: Mon, 16 Jun 2014 18:20:11 -0400 Subject: Re: Extracting Performance

RE: Extracting Performance Metrics

2014-06-19 Thread Dan
user@storm.incubator.apache.org What kind of issues does Metrics have that leads you to recommend HdrHistogram? On Jun 16, 2014 6:57 PM, "Dan" wrote: Be careful when using Coda Hale's Metrics package when measuring latency. Consider using Gil Tene'sHigh Dynamic Range

RE: Distribute Spout output among all bolts

2014-07-16 Thread Dan
Why don't you use something like logstash to pump the file into kafka and readthe kafka spout to read the topic? -Dan From: andreas.gramme...@gmail.com Date: Thu, 17 Jul 2014 04:24:23 +0300 Subject: Re: Distribute Spout output among all bolts To: user@storm.incubator.apache.org Let me rep

Re: date time in tuple

2014-03-27 Thread Dan Guja
Try this: (DateTime)tuple.getValueByField("myDateTimeFieldName"); On Thu, Mar 27, 2014 at 8:50 AM, michael campbell < michael.campb...@dsl.pipex.com> wrote: > > How do you put a datetime, let's say a jodatime datetime value, in a tuple? > > How do you get a datetime out of a tuple, what sort of

Re: date time in tuple

2014-03-27 Thread Dan Guja
Also it might be worth reading: https://github.com/nathanmarz/storm/wiki/Serialization On Thu, Mar 27, 2014 at 9:01 AM, Dan Guja wrote: > Try this: > (DateTime)tuple.getValueByField("myDateTimeFieldName"); > > > On Thu, Mar 27, 2014 at 8:50 AM, michael c

Re: [VOTE] Storm Logo Contest - Final Round

2014-06-09 Thread Dan Fundatureanu
#10 - 4 pts. #6 - 1 pts. On Mon, Jun 9, 2014 at 2:38 PM, P. Taylor Goetz wrote: > This is a call to vote on selecting the winning Storm logo from the 3 > finalists. > > The three candidates are: > > * [No. 6 - Alec Bartos]( > http://storm.incubator.apache.org/2014/04/23/logo-abartos.html) >

Re: Storm Cassandra and the CassandraCounterBatchingBolt

2014-02-11 Thread Dan DeCapria, CivicScience
n_a","column_b",...etc.}), which should update Cassandra's stormks::mycf: myCassKey[aCassColumnNameWCounter] += 1L, myCassKey[bCassColumnNameWCounter] += 1L. Hope this helps towards fixing your issue, -Dan package com.civicscience.storm.weblog.bolt; import backty

Re: Storm 0.9.0.1 and Zookeeper 3.4.5 hung issue.

2014-02-14 Thread Dan DeCapria, CivicScience
What version of java are you using? I recall reading some NIO exceptions related to using openJDK_1.6. I'd recommend Oracle 7u51. -Dan On Fri, Feb 14, 2014 at 1:16 PM, Derek Dagit wrote: > Some changes to storm code are necessary for this. > > See https://github.com/apache/i

Re: Working Kafka Spout example

2014-03-04 Thread Dan DeCapria, CivicScience
.0 and 0.4.0 versions: basically, your SpoutConfig() object now takes "spoutConfig.startOffsetTime = kafka.api.OffsetRequest.EarliestTime();" or some variant. Hope this helps, -Dan On Tue, Mar 4, 2014 at 9:17 AM, Danijel Schiavuzzi wrote: > Hi Binita, > > You seem to be using Ka

Re: [VOTE] Storm Logo Contest - Final Round

2014-06-09 Thread Dan DeCapria, CivicScience
#9 - 1 pt. #10 - 4 pts. -Dan On Mon, Jun 9, 2014 at 2:38 PM, P. Taylor Goetz wrote: > This is a call to vote on selecting the winning Storm logo from the 3 > finalists. > > The three candidates are: > > * [No. 6 - Alec Bartos]( > http://storm.incubator.apache.org/2014/04

Extending Storm's KafkaSpout, Cannot Override declareOutputFields

2014-09-18 Thread Dan DeCapria, CivicScience
' stream if I do not override the declareOutputFields() method. Details below. Thanks in advance for you help, -Dan Details: The extended class CSKafkaSpout has the override method for declareOutputFields(OutputFieldsDeclarer declarer) but it doesn't appear to be called? A consolidated

Re: Cassandra bolt

2014-09-25 Thread Dan DeCapria, CivicScience
ger; import org.slf4j.LoggerFactory; /** * CassandraWriterBolt.java * CQL Prepared Statement Writer to Cassandra Cluster as Storm Bolt. * * @author Dan DeCapria, Copyright (c) 2011-2014 * @since 19 August 2014 * @version 0.1, 26 August 2014 */ public class CassandraWriterBolt extends BaseRich