codope commented on issue #7282: URL: https://github.com/apache/hudi/issues/7282#issuecomment-1325069667
@kazdy This is an interesting proposal. The main role of precombine field is to merge records and deduplicate. To break ties between two records with same key, we can use the latest processing time as a factor. I think a better way would be to provide a configurable precombine strategy class with a default strategy based on event processing time. My suggestion would be to take this up in devlist mail and put up a PR. I would be happy to help along the way. cc @xushiyan @nsivabalan @danny0405 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
