Edoardo Comar created KAFKA-15144: ------------------------------------- Summary: Checkpoint downstreamOffset stuck to 1 Key: KAFKA-15144 URL: https://issues.apache.org/jira/browse/KAFKA-15144 Project: Kafka Issue Type: Bug Components: mirrormaker Reporter: Edoardo Comar Attachments: edo-connect-mirror-maker-sourcetarget.properties
Steps to reproduce : Start source cluster Start target cluster start connect-mirror-maker.sh using a config like the attached create topic in source cluster produce a few messages consume them all with autocmiit enabled then dumping the Checkpoint topic content e.g. % bin/kafka-console-consumer.sh --bootstrap-server localhost:9192 --topic source.checkpoints.internal --from-beginning --formatter org.apache.kafka.connect.mirror.formatters.CheckpointFormatter Checkpoint\{consumerGroupId=edogroup, topicPartition=source.vf-mirroring-test-edo-0, upstreamOffset=3, downstreamOffset=1, metadata=} the downstreamOffset remains at 1, while, in a fresh cluster pair like with the source topic created while MM2 is running, I'd expect the downstreamOffset to match the upstreamOffset. dumping the offset sync topic % bin/kafka-console-consumer.sh --bootstrap-server localhost:9192 --topic mm2-offset-syncs.source.internal --from-beginning --formatter org.apache.kafka.connect.mirror.formatters.OffsetSyncFormatter shows matching initial offsets OffsetSync\{topicPartition=vf-mirroring-test-edo-0, upstreamOffset=0, downstreamOffset=0} -- This message was sent by Atlassian Jira (v8.20.10#820010)