Hello,
I need to parallel-process messages with per key ordering guarantees so
I have kafka topic with keyed messages and multiple partitions. The need
has arised to process some messages with higher priority, so I thought
of adding a second topic where the messages with higher priority will be
sent.
The consumer maintains per key state in memory and also publishes
changes to compacted topic. Now, if I add the second topic for the
higher priority messages, is there some way to guarantee that when one
instance of consumer subscribes to both topics, it will get all messages
for some particular key, from both topics? I want to avoid the situation
when message for some particular key arrive at one consumer from the low
priority topic, and another consumer from the high priority topic.
Hope its clear, thank you
