Re: Rewind Kafka Stream consumer offset by timestamp

Thanks Matthias! My comments below. Regards, Jorge. El lun., 30 ene. 2017 a las 18:40, Matthias J. Sax () escribió: > It would be enough, IMHO :) > > However, we need to discuss some details about this. > > 1) we could extend the reset tool with an flag

Re: Rewind Kafka Stream consumer offset by timestamp

It would be enough, IMHO :) However, we need to discuss some details about this. 1) we could extend the reset tool with an flag --start-from-offsets and the user can specify an offset per partition This would give the most flexibility, but it is hard to use. Especially if you have many

Re: Rewind Kafka Stream consumer offset by timestamp

Thanks Eno and Matthias for your feedback! I've check KIP-95 and Matthias blog post ( https://www.confluent.io/blog/data-reprocessing-with-kafka-streams-resetting-a-streams-application/) and I have a clearer idea on how stream internals work. In a general use-case, following Application Reset

Re: Rewind Kafka Stream consumer offset by timestamp

You can always built you own little tool similar to StreamsResetter.java to get this done. Ie, you set the committed offset "manually" based on timestamps before you start your application. But as Eno mentioned, you need to think carefully about what a consistent reset point would be because you

Re: Rewind Kafka Stream consumer offset by timestamp

Hi Jorge, This is currently not possible, but it is likely to be considered for discussion. One challenge is that, if you have multiple topics, it is difficult to rewind them all back to a consistent point in time. KIP-95, currently under discussion, is handling the slightly different issue,

Rewind Kafka Stream consumer offset by timestamp

Hi everyone, I was wondering if its possible to rewind consumers offset in Kafka Stream using timestamp as with `offsetsForTimes(Map timestampsToSearch)` in KafkaConsumer. I know its possible to go back to `earliest` offset in topic or `latest`, but would be useful to go