Re: Restarting a failed kafka application

2016-12-17 Thread Eno Thereska
Hi Sachin, I think Matthias meant that you can chance the compaction configuration parameters when you create the topic, but you're right, by default you shouldn't need to do anything since the topic will be eventually compacted automatically. Eno > On 17 Dec 2016, at 08:23, Sachin Mittal wr

Re: Restarting a failed kafka application

2016-12-17 Thread Sachin Mittal
Understood. What I understand so far is that by default changelog topics are compacted. So why do we need to compact these topics ourselves. Won't stream application take care of this. Thanks Sachin On 17 Dec 2016 11:47 a.m., "Matthias J. Sax" wrote: > If a Streams application is shutdown via

Re: Restarting a failed kafka application

2016-12-16 Thread Matthias J. Sax
If a Streams application is shutdown via KafkaStream#close() it should be able to reuse local store on restart. As you mention that you application fails, I assume that some exception happens within Streams and you catch this exception with an uncaught exception handler to trigger some shutdown fo

Restarting a failed kafka application

2016-12-16 Thread Sachin Mittal
Hi I had a question. Say stream application fails. We handle the shutdown gracefully. We fix the issue and simply restart it without any application reset. So we don't delete any internal changelog table or local state stores. So once it is restarted does it create a new internal store by replaying