Hello,

I am building a kafka stream application consuming a log compacted topic of
12 partitions. Each message has a String key and a json body, the json body
contains a date field.
I have made a custom Transformer in my topology that consumes this stream,
immediately forward the document where the date is in the past and keep in
the state the documents where the date is in the future. Then with a
Ponctuator, I am looking to the state and eventually forwarding documents
when the date is changing.
The current key I use for my state is the date, and it is not related to
the message key. Is it problematic ? I would like to avoid repartitioning
by date because it would be unbalanced

Best,
Vincent

Reply via email to