GitHub user cshuo added a comment to the discussion: RFC-99: Hudi Type System
@rahil-c I think the type mapping from engines to hudi need not to be 1-1, BINARY type can be used for ordinary binary field and can also be used to represent a BLOB field. What we need to accomplish is to pass the BLOB type information from engine to Hudi. This transmission doesn't need to be explicitly specifying the BLOB type in the engine DDL; it can also be achieved through other means, such as using configuration like 'hoodie.table.blob-fields' to specify that a BINARY field should be treated as a BLOB type in Hudi. Btw, maybe we should also add `VARIANT` to the type list, which is already supported in [spark 4.0](https://spark.apache.org/releases/spark-release-4-0-0.html) and [flink 2.1](https://nightlies.apache.org/flink/flink-docs-release-2.1/release-notes/flink-2.1/). GitHub link: https://github.com/apache/hudi/discussions/14253#discussioncomment-14966632 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
