Pierre Villard created NIFI-15464:
-------------------------------------
Summary: ConsumeKafka processor causes duplicate message
processing during consumer group rebalance due to missing offset commit in
onPartitionsRevoked
Key: NIFI-15464
URL: https://issues.apache.org/jira/browse/NIFI-15464
Project: Apache NiFi
Issue Type: Bug
Reporter: Pierre Villard
Assignee: Pierre Villard
The new ConsumeKafka processor (using Kafka3ConnectionService) causes duplicate
message processing when a consumer group rebalance occurs (e.g., when a
consumer starts or stops). Unlike the legacy ConsumeKafka_2_6 processor which
commits pending offsets during the onPartitionsRevoked callback, the new
Kafka3ConsumerService only performs a rollback, causing uncommitted but
already-processed messages to be reprocessed by other consumers in the group.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
