JingsongLi opened a new pull request, #10681: URL: https://github.com/apache/paimon/pull/10681
Sorted Data Evolution output needs to retain each row's old RowID so index maintenance can bind it to the new RowID assigned at commit. Add a versioned streaming sidecar format and a bounded Flink writer that splits the mappings using actual prepared output file boundaries, including buffered and spilled writes. The writer removes the hidden RowID from stored columns, validates partition and output ownership, and cleans both prepared data and earlier mappings if sidecar creation fails. Production clustering hookup follows in the index-maintenance PR. Split from #10667 after #10680. Validation: 4 mapping-format cases and 5 Flink writer cases passed locally with static checks enabled. Coverage includes file rolling, direct/buffered/spilled writes, empty output, corrupt mappings and partial failure cleanup. Independent review completed. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
