Re: Application state persistence in Kafka

2021-05-20 Thread Urko Lekuona
Hello Mangat, I am using Kstreams, does this make a difference? Anyways, I've read about stateful stream processing here: https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Streams+Internal+Data+Management I think I can manage to solve my issue using changelog topics for my state store. I'll

Re: Application state persistence in Kafka

2021-05-17 Thread mangat rai
Urko, You can enable changelog topics for your state store. This will enable the application to persist the data to a Kafka topic. Next time when application start, it will first build it's state by using this topic. Are you using Kstreams or the low-level processor API? Regards, Mangat On Mon,

Application state persistence in Kafka

2021-05-17 Thread Urko Lekuona
Hello, I have a question regarding the use of Kafka/Kafka Streams to store the state of a stateful application. My application is filtering on a stream based on a value from the previous event of the stream. For example, if the previous car with the same model was red, this car cannot be red. Pre