Re: Kafka Streams Usage Patterns

2017-06-24 Thread Michal Borowiecki
Hi all, Another pattern I think is worth adding is a sliding-windowed message reordering and de-duplicating processor. The outline I have in mind is based on this (just the timestamp would come from the record context - in this question the timestamp was in the body of the message): https:

Re: Kafka Streams Usage Patterns

2017-05-27 Thread Jay Kreps
This is great! -Jay On Sat, May 27, 2017 at 12:47 PM, Michal Borowiecki < michal.borowie...@openbet.com> wrote: > Hi all, > > I've updated the wiki page with a draft pattern for consecutively growing > time-windowed aggregations which was discussed some time ago on this > mailing list. > > I'm y

Re: Kafka Streams Usage Patterns

2017-05-27 Thread Michal Borowiecki
Hi all, I've updated the wiki page with a draft pattern for consecutively growing time-windowed aggregations which was discussed some time ago on this mailing list. I'm yet to add the part that cleans up the stores using punctuations. Stay tuned. On a somewhat similar subject, I've been w

Kafka Streams Usage Patterns

2017-05-09 Thread Matthias J. Sax
Hi, I started a new Wiki page to collect some common usage patterns for Kafka Streams. Right now, it contains a quick example on "how to compute average". Hope we can collect more example like this! https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Stream+Usage+Patterns -Matthias sign