FANNG1 opened a new pull request, #13359: URL: https://github.com/apache/gravitino/pull/13359
### What changes were proposed in this pull request? This PR adds a generic VectorType with numeric or nested vector elements and a positive or unspecified (-1) dimension. It adds JSON and OpenAPI support, maps Lance FixedSizeList fields to VectorType, and updates the Lance documentation and tests. ### Why are the changes needed? Vector columns need a common Gravitino representation rather than catalog-specific external types. The generic model also preserves unspecified dimensions for systems whose array metadata does not carry a dimension. Fix: #13337 ### Does this PR introduce _any_ user-facing change? Yes. Java and REST metadata APIs accept and return vector types such as vector(float,768) and vector(vector(float,768),32). Lance requires a specified positive dimension when writing a vector. ### How was this patch tested? - ./gradlew :api:test --tests org.apache.gravitino.rel.TestTypes - ./gradlew :common:test --tests org.apache.gravitino.json.TestJsonUtils - ./gradlew :lance:lance-common:test --tests org.apache.gravitino.lance.common.ops.gravitino.TestLanceDataTypeConverter - ./gradlew :catalogs:catalog-lakehouse-generic:test --tests org.apache.gravitino.catalog.lakehouse.lance.TestLanceTableOperations - ./gradlew :docs:build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
