[ https://issues.apache.org/jira/browse/HUDI-6654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ethan Guo updated HUDI-6654: ---------------------------- Summary: Add new log blocker header type to store record positions (was: Encode record positions in log blocks) > Add new log blocker header type to store record positions > --------------------------------------------------------- > > Key: HUDI-6654 > URL: https://issues.apache.org/jira/browse/HUDI-6654 > Project: Apache Hudi > Issue Type: New Feature > Reporter: Ethan Guo > Assignee: Ethan Guo > Priority: Blocker > Fix For: 0.14.0 > > > To support position-based merging of base and log files, we need to encode > positions in the log blocks so that the positions can be used directly, > without having to deserialize records or delete keys for OverwriteWithLatest > payload, or with ordering values required only for > `DefaultHoodieRecordPayload` supporting event time based streaming. We add a > new `HeaderMetadataType` to store the positions in the log block header. -- This message was sent by Atlassian Jira (v8.20.10#820010)