This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git.
from 4fd585d [SPARK-30008][SQL] The dataType of collect_list/collect_set aggs should be ArrayType(_, false) add a58d91b [SPARK-29768][SQL] Column pruning through nondeterministic expressions No new revisions were added by this update. Summary of changes: .../spark/sql/catalyst/planning/patterns.scala | 101 +++++++++++++++++--- .../sql/catalyst/planning/ScanOperationSuite.scala | 104 +++++++++++++++++++++ .../execution/datasources/DataSourceStrategy.scala | 8 +- .../execution/datasources/FileSourceStrategy.scala | 4 +- .../datasources/v2/V2ScanRelationPushDown.scala | 4 +- .../datasources/FileSourceStrategySuite.scala | 35 ++++++- .../apache/spark/sql/sources/PrunedScanSuite.scala | 4 + 7 files changed, 235 insertions(+), 25 deletions(-) create mode 100644 sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/planning/ScanOperationSuite.scala --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org