I see that spark 3.1.1 or prior does not use V2 Datasource for Parquet due to one of the reasons as per the documentation on the method fallbackFileFormat 1. V2 may cause regression 2. Catalog support is required and under development
Any information when the support for V2 for Parquet will be made available. Can I get more details about this or any other JIRA ticket I can track -- Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/ --------------------------------------------------------------------- To unsubscribe e-mail: user-unsubscr...@spark.apache.org