Donal Magennis created HDDS-15564:
-------------------------------------
Summary: Implement async send for the kafka events
Key: HDDS-15564
URL: https://issues.apache.org/jira/browse/HDDS-15564
Project: Apache Ozone
Issue Type: New Feature
Reporter: Donal Magennis
The initial implementation in OMEventListenerKafkaPublisher sequentially blocks
via Future.get() on every event dispatch which is sub-optimal.
This was the simplest approach to ensure that the checkpoint is correctly
aligned with what has been sent. We should implement a non blocking kafka send
which retains safe update of the checkpointing position.
We can do this with a sliding window approach where the checkpoint
(seekPosition) only advances up to the highest contiguous successfully
acknowledged transaction index, preserving strict at-least-once delivery
guarantees.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
