Surbhi-Vijay opened a new issue, #11371: URL: https://github.com/apache/incubator-gluten/issues/11371
### Description Spark-4.0 has added new data type `VariantType`. The support for VariantType and variant shredded data has been added to parquet reader and writer. Refer: - https://issues.apache.org/jira/browse/SPARK-50614 - [[SPARK-48495](https://issues.apache.org/jira/browse/SPARK-48495)][SQL][DOCS] Describe shredding scheme for Variant - [[SPARK-50614](https://issues.apache.org/jira/browse/SPARK-50614)][SQL] Add Variant shredding support for Parquet - [[SPARK-54454](https://issues.apache.org/jira/browse/SPARK-54454)][SQL] Enable variant shredding and variant logical type annotation configs by default This feature has been enabled by default in Spark. Currently, since Gluten does not support `VariantType`, corresponding spark plan falls back to Spark. ### Gluten version None -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
