Magnus Reftel created KAFKA-5390: ------------------------------------ Summary: First records in batch rejected but others accepted when rolling log Key: KAFKA-5390 URL: https://issues.apache.org/jira/browse/KAFKA-5390 Project: Kafka Issue Type: Bug Affects Versions: 0.10.2.1 Reporter: Magnus Reftel Attachments: kafka-sequence.tar.gz
When sending a sequence of records in a batch right when the broker needs to roll a new segment, it's possible for the first few records to fail, while other records in the batch are accepted. If records have dependencies on earlier records, e.g. in the case of a sequence of events in an event-sourced system, then a producer cannot use the batching functionality, since it then risks consumers receiving a record without first receiving the records it depends on. See attached testcase (kafka-sequence.tar.gz). -- This message was sent by Atlassian JIRA (v6.3.15#6346)