Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/21123#discussion_r204264532 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala --- @@ -1191,6 +1191,20 @@ object SQLConf { .timeConf(TimeUnit.MILLISECONDS) .createWithDefault(100) + val DISABLED_V2_FILE_DATA_SOURCE_READERS = buildConf("spark.sql.disabledV2FileDataSourceReaders") --- End diff -- Hm.... are we going to leave this out for 2.4, and target to completely migrate in 3.0? Do you guys also plan to migrate them within 2.4? Looks there's not much gain by doing this change alone when the release is being close.
--- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org