Hey everyone, I was wondering what the plans are for Spark's built-in v2 file data sources in Spark 4.
Concretely, is the plan for Spark 4 to continue defaulting to the built-in v1 data sources? And if yes, what are the blockers for defaulting to v2? I see, just as example, that writing Hive-partitions is not supported in v2. Are there other blockers or outstanding discussions? Regards, Will