cshuo opened a new issue, #19820: URL: https://github.com/apache/hudi/issues/19820
## Feature Description Add support for writing Hudi VECTOR columns from Flink when Lance is selected as the base file format. Flink users should be able to declare top-level ARRAY<FLOAT> or ARRAY<DOUBLE> columns as VECTOR using the existing hoodie.vector.columns option and write them to Hudi tables backed by Lance files. The resulting files must remain compatible with the existing Spark Lance VECTOR support so that data can be read across engines. ## Expected Behavior - FLOAT and DOUBLE VECTOR columns can be written to Lance base files. - Nullable VECTOR columns are supported. - Vector dimensions are validated during writes and invalid values fail with a clear error. - Regular ARRAY columns continue to behave as regular Lance arrays. - Lance files preserve the metadata required to identify VECTOR columns. - INT8 VECTOR writes fail with a clear unsupported-type error, consistent with current Spark Lance support. ## Scope This work reuses the existing Flink VECTOR configuration and Hudi VECTOR data model. It does not add new public configuration or support nested VECTOR columns, INT8 VECTOR columns on Lance, or Lance schema evolution. Parent tracking issue: #19053 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
