osscm opened a new pull request, #17426: URL: https://github.com/apache/iceberg/pull/17426
Reference implementation of the SCALAR index type defined in apache/iceberg PR #16961 (Secondary Index Specification, Peter Vary). PR #16961 defines the SCALAR index type, HASH and IDENTITY transforms, Index Metadata JSON, Tracking File (Avro), and Leaf File (Parquet) formats but does not yet include a working implementation. This PR provides the first end-to-end implementation. Layers implemented: - IndexMetadata and IndexSnapshot interfaces + JSON parsers - IndexCatalog interface with CAS concurrency + InMemoryIndexCatalog - IndexMetadataIO: read/write index metadata JSON via FileIO - TrackingFileWriter and TrackingFileReader (Avro) - HashTransform, LeafFileMetadata, ScalarIndexCommitter 25/25 unit tests passing. Builds on: https://github.com/apache/iceberg/pull/16961 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
