fvaleri commented on PR #15561: URL: https://github.com/apache/kafka/pull/15561#issuecomment-2009370898
To make it easier to review, I'm adding the output of the new example behavior with 1 partition, 1 processor, max.poll.records = 1, and forcing random exceptions. ```sh $ examples/bin/exactly-once-demo.sh 1 1 10 main - Deleted topics: [input-topic, output-topic] main - Waiting for topics metadata cleanup main - Created topics: [input-topic, output-topic] producer - Sample: record(0, test0), partition(input-topic-0), offset(0) producer - Sample: record(1, test1), partition(input-topic-0), offset(1) producer - Sample: record(2, test2), partition(input-topic-0), offset(2) producer - Sample: record(3, test3), partition(input-topic-0), offset(3) producer - Sample: record(4, test4), partition(input-topic-0), offset(4) producer - Sample: record(5, test5), partition(input-topic-0), offset(5) producer - Sample: record(6, test6), partition(input-topic-0), offset(6) producer - Sample: record(7, test7), partition(input-topic-0), offset(7) producer - Sample: record(8, test8), partition(input-topic-0), offset(8) producer - Sample: record(9, test9), partition(input-topic-0), offset(9) producer - Sent 10 records processor-0 - Processing new records processor-0 - Assigned partitions: [input-topic-0] >>> partition 0, offset 0 processor-0 - Aborting transaction: Boom! processor-0 - Remaining records: 10 >>> partition 0, offset 0 processor-0 - Aborting transaction: Boom! processor-0 - Remaining records: 10 >>> partition 0, offset 0 processor-0 - Remaining records: 9 >>> partition 0, offset 1 processor-0 - Aborting transaction: Boom! processor-0 - Remaining records: 9 >>> partition 0, offset 1 processor-0 - Remaining records: 8 >>> partition 0, offset 2 processor-0 - Remaining records: 7 >>> partition 0, offset 3 processor-0 - Aborting transaction: Boom! processor-0 - Remaining records: 7 >>> partition 0, offset 3 processor-0 - Aborting transaction: Boom! processor-0 - Remaining records: 7 >>> partition 0, offset 3 processor-0 - Aborting transaction: Boom! processor-0 - Remaining records: 7 >>> partition 0, offset 3 processor-0 - Aborting transaction: Boom! processor-0 - Remaining records: 7 >>> partition 0, offset 3 processor-0 - Aborting transaction: Boom! processor-0 - Remaining records: 7 >>> partition 0, offset 3 processor-0 - Aborting transaction: Boom! processor-0 - Skipping record after 5 retries: test3-ok processor-0 - Remaining records: 6 >>> partition 0, offset 4 processor-0 - Remaining records: 5 >>> partition 0, offset 5 processor-0 - Remaining records: 4 >>> partition 0, offset 6 processor-0 - Remaining records: 3 >>> partition 0, offset 7 processor-0 - Aborting transaction: Boom! processor-0 - Remaining records: 3 >>> partition 0, offset 7 processor-0 - Aborting transaction: Boom! processor-0 - Remaining records: 3 >>> partition 0, offset 7 processor-0 - Aborting transaction: Boom! processor-0 - Remaining records: 3 >>> partition 0, offset 7 processor-0 - Aborting transaction: Boom! processor-0 - Remaining records: 3 >>> partition 0, offset 7 processor-0 - Aborting transaction: Boom! processor-0 - Remaining records: 3 >>> partition 0, offset 7 processor-0 - Aborting transaction: Boom! processor-0 - Skipping record after 5 retries: test7-ok processor-0 - Remaining records: 2 >>> partition 0, offset 8 processor-0 - Aborting transaction: Boom! processor-0 - Remaining records: 2 >>> partition 0, offset 8 processor-0 - Aborting transaction: Boom! processor-0 - Remaining records: 2 >>> partition 0, offset 8 processor-0 - Remaining records: 1 >>> partition 0, offset 9 processor-0 - Remaining records: 0 processor-0 - Revoked partitions: [input-topic-0] processor-0 - Processed 8 records consumer - Subscribed to output-topic consumer - Assigned partitions: [output-topic-0] consumer - Sample: record(0, test0-ok), partition(output-topic-0), offset(3) consumer - Sample: record(1, test1-ok), partition(output-topic-0), offset(7) consumer - Sample: record(2, test2-ok), partition(output-topic-0), offset(9) consumer - Sample: record(4, test4-ok), partition(output-topic-0), offset(23) consumer - Sample: record(5, test5-ok), partition(output-topic-0), offset(25) consumer - Sample: record(6, test6-ok), partition(output-topic-0), offset(27) consumer - Sample: record(8, test8-ok), partition(output-topic-0), offset(45) consumer - Sample: record(9, test9-ok), partition(output-topic-0), offset(47) main - Timeout after 2 minutes waiting for output read consumer - Revoked partitions: [output-topic-0] consumer - Fetched 8 records ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
