Hi, Is there a way to run multiple flink jobs with the same Kafka group.id and have them join the same consumer group?
It seems that setting the group.id using KafkaSource.builder().set_group_id() does not have the effect of creating an actual consumer group in Kafka. Running the same flink job with the same group.id, consuming from the same topic, will result in both flink jobs receiving the same messages from the topic, rather than only one of the jobs receiving the messages (as would be expected for consumers in a consumer group normally with Kafka). Is this a design choice, and is there a way to configure it so messages can be split across two jobs using the same “group.id”? Thanks in advance, Ben Information in this email including any attachments may be privileged, confidential and is intended exclusively for the addressee. The views expressed may not be official policy, but the personal views of the originator. If you have received it in error, please notify the sender by return e-mail and delete it from your system. You should not reproduce, distribute, store, retransmit, use or disclose its contents to anyone. Please note we reserve the right to monitor all e-mail communication through our internal and external networks. SKY and the SKY marks are trademarks of Sky Limited and Sky International AG and are used under licence. Sky UK Limited (Registration No. 2906991), Sky-In-Home Service Limited (Registration No. 2067075), Sky Subscribers Services Limited (Registration No. 2340150) and Sky CP Limited (Registration No. 9513259) are direct or indirect subsidiaries of Sky Limited (Registration No. 2247735). All of the companies mentioned in this paragraph are incorporated in England and Wales and share the same registered office at Grant Way, Isleworth, Middlesex TW7 5QD
