TTL changes - Are they retroactive?

2014-11-20 Thread Parag Shah
Hi all, I had a question about TTL changes to a topic’s configuration. When I make the change and restart kafka, will kafka apply the changes to all existing messages on disk retroactively or would it do it only for new messages entering the topic? Regards Parag

Are logs portable?

2014-11-20 Thread Parag Shah
Hi all, This question is related to node recovery. Say, there is a hardware failure and the node cannot be brought up. But I can access the hard drives and recover the data. Is it possible for me to stash the contents of the /tmp/kafka-logs/ onto another instance and have it be a

Large Messages

2014-11-17 Thread Parag Shah
Hi all, I am fairly new to Kafka and need some general advice on handling large messages. My message sizes range from 20k – 10M, with most of my messages upto 250K, with some messages ranging in sizes up to 20M. I am wondering if there is some kind of streaming support in Kafka. I have