rdtr opened a new pull request, #13261: URL: https://github.com/apache/gluten/pull/13261
## What changes are proposed in this pull request? Re-enables 6 of the 11 Spark 4.2 tests in #13180 that #13163 disabled. This is a test-only change. - `GlutenDisableUnnecessaryBucketedScanWithoutHiveSupportSuiteAE`: "Aggregates with no groupby over tables having 1 BUCKET, return multiple rows" and the 4 "SPARK-32859: disable unnecessary bucketed table scan" tests. Since SPARK-54301, `checkNumBucketedScan` collects the query before it inspects the plan, so with AQE it inspects the final plan. Under Gluten that plan has `FileSourceScanExecTransformer` instead of `FileSourceScanExec`, and the check found no bucketed scan. The Gluten suite now overrides `checkNumBucketedScan` to count bucketed scans of both classes. - `GlutenHiveQuerySuite` "ADD JAR command 2": SPARK-56353 removed the `assume` on `TestUDTF.jar`, so the test now runs. It loads a data file through `TestHive.getHiveFile`, which resolves to a path inside the spark-hive test jar that `LOAD DATA` cannot read. The Gluten version of the test loads the file from the Hive test resources instead, as the existing Gluten "ADD FILE command" test does. The other 5 tests stay disabled until their fixes land: - `GlutenParquetIOSuite` "SPARK-54220: NullType": https://github.com/facebookincubator/velox/pull/19461 - "SPARK-55857: Enabling/disabling ignoreMissingFiles" in the Parquet and ORC V1/V2 query suites: #13207 Part of #13180. ## How was this patch tested? The changed tests compile on Spark 4.2. The Spark 4.2 UT CI runs the re-enabled tests. ## Was this patch authored or co-authored using generative AI tooling? Generated-by: Claude Code (Claude Opus 5.5) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
