Hi Karin, 1. Kafka does not support TTL for individual messages, only the topic. From the documentation: The Kafka cluster retains all published messages—whether or not they have been consumed—for a configurable period of time. For example if the log retention is set to two days, then for the two days after a message is published it is available for consumption, after which it will be discarded to free up space. Kafka's performance is effectively constant with respect to data size so retaining lots of data is not a problem.
2. Kafka does not support backpressure. One of the main reasons to use Kafka is to avoid having to implement backpressure. Producers produce at their own pace, consumers consume at their pace. This is by design. 3 and 4. You should have a look at KStreams: http://www.confluent.io/blog/introducing-kafka-streams-stream-processing-made-simple 5. From https://engineering.linkedin.com/kafka/benchmarking-apache-kafka-2-million-writes-second-three-cheap-machines: Note that unlike most messaging systems the log is always persistent. Messages are immediately written to the filesystem when they are received. All messages are immediately written to disk. No configuration is required. – Best regards, Radek Gruchalski ra...@gruchalski.com On August 24, 2016 at 4:26:15 PM, Herwerth Karin (CI/OSW3) ( karin.herwe...@de.bosch.com) wrote: Dear Sir or Madam, I'm a beginner in Apache Kafka and have questions which I don't get it from the documentation. 1. If you set a Time To Live to a topic and to a message, which Time To Live is prioritized? 2. Supports Apache Kafka a mechanism to stop the publisher if the subscriber is too slow? 3. Is there a possibility of a script engine? Does Kafka supports the implementation and execution of self-made scripts? 4. Is there a possibility to join topics or partitions? 5. Support Kafka such a following mechanism: A mechanism to control whether each write to the store will also call sync on the file system to ensure all data is written to the disk. I hope I will get support. Thanks in advance. Mit freundlichen Grüßen / Best regards Karin Herwerth EAI Development (CI/OSW3) Robert Bosch GmbH | Postfach 30 02 20 | 70442 Stuttgart | GERMANY | www.bosch.com<http://www.bosch.com> Sitz: Stuttgart, Registergericht: Amtsgericht Stuttgart, HRB 14000; Aufsichtsratsvorsitzender: Franz Fehrenbach; Geschäftsführung: Dr. Volkmar Denner, Dr. Stefan Asenkerschbaumer, Dr. Rolf Bulander, Dr. Stefan Hartung, Dr. Markus Heyn, Dr. Dirk Hoheisel, Christoph Kübel, Uwe Raschke, Dr. Werner Struth, Peter Tyroller
