This is an automated email from the ASF dual-hosted git repository.
gengliang pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.
from 982f72f [SPARK-30238][SQL] hive partition pruning can only support
string and integral types
add 5114389 [SPARK-30107][SQL] Expose nested schema pruning to all V2
sources
No new revisions were added by this update.
Summary of changes:
.../sql/execution/datasources/SchemaPruning.scala | 36 ------------------
.../execution/datasources/v2/FileScanBuilder.scala | 8 +++-
.../execution/datasources/v2/PushDownUtils.scala | 36 ++++++++++++++----
.../datasources/v2/V2ScanRelationPushDown.scala | 31 ++++++++++-----
.../datasources/v2/orc/OrcScanBuilder.scala | 2 +
.../v2/parquet/ParquetScanBuilder.scala | 2 +
.../spark/sql/FileBasedDataSourceSuite.scala | 17 +++++++++
.../execution/datasources/SchemaPruningSuite.scala | 44 ++++++++++++++++++++++
.../sql/execution/datasources/csv/CSVSuite.scala | 18 +++++++++
9 files changed, 140 insertions(+), 54 deletions(-)
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
