First time building a streaming app and I need help understanding how to build out my use case

Hello, everyone. I feel like I have a use case that it is well suited to the Kafka streaming paradigm, but I'm having a difficult time understanding how certain aspects will work as I'm prototyping. So here's my use case: Service 1 assigns a job to a user which is published as an event to Kafka

Re: Newb Trying to Publish via Kafka CLI

This worked. Huge thanks!

WakeupException while commitSync

Hello. I noticed that sometimes offsets were committed even though commitSync threw WakeupException. Is it correct consumer behavior? Thanks

RE: Repeating UNKNOWN_PRODUCER_ID errors for Kafka streams applications

Hi Guozhang, I've checked the log-cleaner.log on the brokers for cleanup of repartition topics for the event-rule-engine application, but I found no reports of frequent cleanup there. Also forgive me if I am wrong, because I don’t understand the exact mechanics of the log cleanup processes. Bu

Re: Continuing of Kafka producer transaction after producer restart

It's hacked in Apache Flink using reflection: https://github.com/apache/flink/blob/c7bf460b15ff1501f1d0ffa24ad5a074032bc503/flink-connectors/flink-connector-kafka/src/main/java/org/apache/flink/streaming/connectors/kafka/internal/FlinkKafkaInternalProducer.java#L138-L164 It would be nice to have th