venkata91 commented on pull request #33350: URL: https://github.com/apache/spark/pull/33350#issuecomment-887171471
@viirya @sunchao It seems like the refactor caused couple of tests in `PruneFileSourcePartitionsSuite` tests to fail. Seems like the refactor from Hive tables to datasource is causing issues. I think this test `SPARK-35985 push filters for empty read schema - returns all the files under the partition with DSV2 therefore failing ` `SPARK-36128: spark.sql.hive.metastorePartitionPruning should work for file data sources` - this test checks for `HiveCatalogMetrics.METRIC_PARTITIONS_FETCHED.getCount` since the tests are now moved, this is becoming 0. Please take a look. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
