Kafka Streams windowed aggregation

2016-10-05 Thread Davood Rafiei
Hi, I want to do windowed aggregation with streams library. However, I get the output from particular operator immediately, independent of window size. This makes sense for unlimited windows or sometimes for event time windows. However, for ingestion time or processing time windows, users may

Re: Kafka Streams multi-node

2016-07-26 Thread Davood Rafiei
08:08 PM, David Garcia wrote: > > > http://docs.confluent.io/3.0.0/streams/architecture.html#parallelism-model > > > > you shouldn’t have to do anything. Simply starting a new thread will > “rebalance” your streaming job. The job coordinates with tasks through >

Kafka Streams multi-node

2016-07-26 Thread Davood Rafiei
Hi, I am newbie in Kafka and Kafka-Streams. I read documentation to get information how it works in multi-node environment. As a result I want to run streams library on cluster that consists of more than one node. >From what I understood, I try to resolve the following conflicts: - Streams is a

Re: Groupby Operator

2016-06-17 Thread Davood Rafiei
.map((key, value) -> KeyValue.pair(value, value)) > .countByKey(Serdes.String(), "counted"); > counted.to(Serdes.String(), Serdes.Long(), outputTopic); > > Output: > new KeyValue<>("message1", 1L), > new KeyValue<>("message1",

Groupby Operator

2016-06-16 Thread Davood Rafiei
Hi, I am trying to use groupby operator in simple example. However, I get strange results. I have inputs on "test" topic like: (Long, String) 1Message_1 1Message_1 2Message_2 3Message_3 4Message_4 I want to get counts of each value. So: Message_1 2 Message_1 1 Message_2 1