infvg opened a new issue, #13219: URL: https://github.com/apache/gluten/issues/13219
### Description ## Description This list is for tracking tasks needed for Iceberg V3 support for the Velox backend. If there's anything missing, let me know. If you'd like to take up any task, go ahead. Some of these tasks might require a Velox PR first. ## Tasks - [x] Support top-level column `initial-default` reads - #12537 - [ ] Support nested column initial-default reads. - [ ] Support native deletion-vector reads from Puffin files - #13217 - [ ] Support native deletion-vector writes and integration with merge-on-read `DELETE`, `UPDATE`, and `MERGE` - #12629 , #12628 - [ ] Include merging existing deletes, replacing previous DVs, and handling position deletes retained after a v2->v3 upgrade. - [ ] Support native equality-delete reads for v3 tables - #12418 (top level) - [ ] Support native reads of the row-lineage columns `_row_id` and `_last_updated_sequence_number`, including inherited values. - [ ] Support correct row-lineage write semantics for native appends, rewrites, and row-level operations, including inheritance for new rows, preservation for unchanged rows, and sequence-number inheritance for modified rows. - [ ] Honor Iceberg `write-default` semantics for omitted fields in native write paths, including nested fields. - [ ] Support native reads and writes of `variant` on supported Spark 4.x profiles. - [ ] Support `unknown` columns: return null on reads and omit them from physical data files. - [ ] Integrate native file reads and writes with Iceberg table encryption, including the required encryption-provider and file-key metadata handoff. ### Gluten version main branch -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
