Naman-Katiyar opened a new pull request, #41328: URL: https://github.com/apache/beam/pull/41328
Fixes apache/beam#18023 The batch Pub/Sub sink declared the id label on the outgoing bundle but never set the corresponding attribute on messages, so retries could not be deduplicated. When an id label is configured and a message does not already carry that attribute, generate a deterministic id from the message content (UUID.nameUUIDFromBytes) and set it, so redeliveries of a bundle can be deduplicated by Pub/Sub. Tests: added PubsubSinkTest cases that verify a deterministic id is set when the id label is missing (stable across two identical messages) and that an id supplied by the format function is preserved. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
