RE: Can Storm write an Aggregate Record to Postgres or SQL Server?

2014-04-08 Thread Neil Carroll
Many thanks! From: cody.a@gmail.com Date: Tue, 8 Apr 2014 15:05:48 -0500 Subject: Re: Can Storm write an Aggregate Record to Postgres or SQL Server? To: user@storm.incubator.apache.org Can you elaborate on how you want to "aggregate" data? If each log entry is essentially a ti

Re: Can Storm write an Aggregate Record to Postgres or SQL Server?

2014-04-08 Thread Cody A. Ray
Can you elaborate on how you want to "aggregate" data? If each log entry is essentially a timestamp, a transaction type (since you mentioned this), and a numerical value (which you cant to sum during the 5-minute window), then you don't need tick tuples. The way we do aggregation is by mapping a t

RE: Can Storm write an Aggregate Record to Postgres or SQL Server?

2014-04-08 Thread Huang, Roger
Neil, Take a look at using "tick tuples" http://nathanmarz.github.io/storm/doc/backtype/storm/Config.html#TOPOLOGY_TICK_TUPLE_FREQ_SECS and the Storm RDBMS bolt https://github.com/nathanmarz/storm-contrib/tree/master/storm-rdbms -Roger From: Neil Carroll [mailto:carroll_n...@hotmail.com] Sent: