[
https://issues.apache.org/jira/browse/HUDI-1278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-1278:
-----------------------------
Labels: user-support-issues (was: core-flow-ds sev:normal
user-support-issues)
> Need a generic payload class which can skip late arriving data based on
> specific fields
> ---------------------------------------------------------------------------------------
>
> Key: HUDI-1278
> URL: https://issues.apache.org/jira/browse/HUDI-1278
> Project: Apache Hudi
> Issue Type: New Feature
> Components: deltastreamer
> Affects Versions: 0.9.0
> Reporter: Balaji Varadarajan
> Assignee: shenh062326
> Priority: Major
> Labels: user-support-issues
> Fix For: 0.11.0
>
>
> Context :
> [https://lists.apache.org/thread.html/rd5d805d29c2f704d8ff2729457d27bca42e890bc01fc8e5e1f1943e3%40%3Cdev.hudi.apache.org%3E]
> We need to implement a Payload class (like OverwriteWithLatestAvroPayload)
> which will skip late arriving data.
> Notes:
> # combineAndGetUpdateValue() would need work
> # The ordering needs to be specified based on 1 or more fields and should be
> configurable.
>
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
