Hi community, In my pipeline, I am using KafkaIO to read and write. The source topic has 4 partitions and pipeline parallelism is 1.
I noticed from consumer lag metrics, it will consume from 1 partition until all the messages from that partition is processed then it will consume from another partition. Is this the expected behavior? Runner is Flink. Thanks a lot! Eleanore