ktable implemented as compacted topic?

2016-05-05 Thread Spico Florin
hello! i would like to ask you if ktable is using as backend storage a compacted topic ? i have read here http://www.confluent.io/blog/introducing-kafka-streams-stream-processing-made-simple thtat a ktable is at its base a compacted topic if i would like to have the messages from ktable be persi

Re: ktable implemented as compacted topic?

2016-05-06 Thread Guozhang Wang
Hello, KTable's changelog is using log compaction by default instead of log deletion. But we are adding mechanism to to let users configure their changelog topics. Guozhang On Thu, May 5, 2016 at 12:00 PM, Spico Florin wrote: > hello! > i would like to ask you if ktable is using as backend

Re: ktable implemented as compacted topic?

2016-05-06 Thread Spico Florin
hi! thank you very much for your answer. what is unclear for me if can query the ktable using the keys and what is the relation between ktable and rocksdb? i look forward for your answers. regards, florin On Friday, May 6, 2016, Guozhang Wang wrote: > Hello, > > KTable's changelog is using lo

Re: ktable implemented as compacted topic?

2016-05-07 Thread Guozhang Wang
Hello, 1. KTable is an API class that only exists in the Kafka Streams DSL, in which users cannot directly query it by key, but can use operators like joins and aggregates that will query the KTable internal for the operation. 2. When involved in stateful operations like joins, KTable is usually