Re: Problem with kafka-streams aggregate windowedBy

2019-01-27 Thread Vincenzo D'Amore
Hi Pavel, did you understood why do you have such strange behaviour? On Tue, Oct 30, 2018 at 12:22 PM Pavel Koroliov wrote: > I'm sorry guy's. Aggregation works fine, but i've found new problem with > *groupByKey()*. After restart application some aggregations starts from > beginning, although t

Re: Problem with kafka-streams aggregate windowedBy

2018-10-30 Thread Pavel Koroliov
I'm sorry guy's. Aggregation works fine, but i've found new problem with *groupByKey()*. After restart application some aggregations starts from beginning, although this key already has aggregated data. And some aggregations continue to summarize data. This is very strange, I did not expect such be

Re: Problem with kafka-streams aggregate windowedBy

2018-10-29 Thread Matthias J. Sax
Make sure to call `KafkaStreams#close()` to get the latest offsets committed. Beside this, you can check the consumer and Streams logs in DEBUG mode, to see what offset is picked up (or not). -Matthias On 10/29/18 11:43 AM, Patrik Kleindl wrote: > Hi > How long does your application run? More t

Re: Problem with kafka-streams aggregate windowedBy

2018-10-29 Thread Patrik Kleindl
Hi How long does your application run? More than the 60 seconds you set for commit interval? Have a look at https://sematext.com/opensee/m/Kafka/uyzND1SdDRMgROjn?subj=Re+Kafka+Streams+why+aren+t+offsets+being+committed+ and check if your offsets are really comitted Best regards Patrik > Am 29.

Re: Problem with kafka-streams aggregate windowedBy

2018-10-29 Thread Pavel Koroliov
Hi No, my application id doesn't change пн, 29 окт. 2018 г. в 19:11, Patrik Kleindl : > Hi > Does your applicationId change? > Best regards > Patrik > > > Am 29.10.2018 um 13:28 schrieb Pavel Koroliov : > > > > Hi everyone! I use kafka-streams, and i have a problem when i use > > windowedBy. Ever

Re: Problem with kafka-streams aggregate windowedBy

2018-10-29 Thread Patrik Kleindl
Hi Does your applicationId change? Best regards Patrik > Am 29.10.2018 um 13:28 schrieb Pavel Koroliov : > > Hi everyone! I use kafka-streams, and i have a problem when i use > windowedBy. Everything works well until I restart the application. After > restarting my aggregation starts from beginn

Problem with kafka-streams aggregate windowedBy

2018-10-29 Thread Pavel Koroliov
Hi everyone! I use kafka-streams, and i have a problem when i use windowedBy. Everything works well until I restart the application. After restarting my aggregation starts from beginning. Code bellow: > > StreamsBuilder builder = new StreamsBuilder() > KStream stream = builder.stream(topic,