[ 
https://issues.apache.org/jira/browse/HUDI-6654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ethan Guo updated HUDI-6654:
----------------------------
    Summary: Add new log blocker header type to store record positions  (was: 
Encode record positions in log blocks)

> Add new log blocker header type to store record positions
> ---------------------------------------------------------
>
>                 Key: HUDI-6654
>                 URL: https://issues.apache.org/jira/browse/HUDI-6654
>             Project: Apache Hudi
>          Issue Type: New Feature
>            Reporter: Ethan Guo
>            Assignee: Ethan Guo
>            Priority: Blocker
>             Fix For: 0.14.0
>
>
> To support position-based merging of base and log files, we need to encode 
> positions in the log blocks so that the positions can be used directly, 
> without having to deserialize records or delete keys for OverwriteWithLatest 
> payload, or with ordering values required only for 
> `DefaultHoodieRecordPayload` supporting event time based streaming.  We add a 
> new `HeaderMetadataType` to store the positions in the log block header.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to