felipepessoto opened a new pull request, #13036: URL: https://github.com/apache/gluten/pull/13036
## What changes are proposed in this pull request? References #12743. Patch Delta v4.2.0 after cloning so `DeltaParquetFileFormatSuite.generateData` sets `parquet.block.rows=10000` in addition to its existing 50 KiB block-size target. The fixture writes 20,000 highly compressible integer rows. Gluten forwards `parquet.block.size`, but Velox bases the byte flush decision on compressed buffered bytes, so the fixture can remain a single row group and fail before exercising the deletion-vector reads. The independent row-count cap deterministically creates at least two row groups while keeping Gluten's native writer enabled. Remove the 24 `DeltaParquetFileFormatSuite` and `DeltaParquetFileFormatWithPredicatePushdownSuite` tests from the known-failure baseline, reducing it from 707 to 683 entries. The source patch is guarded so Delta source drift fails setup explicitly instead of silently losing coverage. ## How was this patch tested? - `bash -n .github/workflows/util/delta-spark-ut/setup-delta.sh` - Applied the exact `sed` transformation to the upstream Delta v4.2.0 source and verified exactly one correctly indented `parquet.block.rows` setting was inserted - Verified the baseline contains 683 non-comment entries and no entries for either affected suite - `git diff --check` The full native Delta test matrix is delegated to CI. The repository header checker could not run locally because Python is unavailable in this Windows environment; both modified files retain their existing ASF headers. ## Was this patch authored or co-authored using generative AI tooling? Generated-by: GitHub Copilot App 1.0.84-5 Fixes: #12743 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
