IcebreakerSA opened a new pull request, #12934: URL: https://github.com/apache/gravitino/pull/12934
### What changes were proposed in this pull request? Format the result of Iceberg's `rewrite_data_files` procedure according to the number of columns returned. The three base statistics are always read, while failed-file and removed-delete-file counts are included only when present. Add regression tests for three-, four-, and five-column Spark rows. ### Why are the changes needed? A three-column result currently falls into the four-column branch and reads column index 3. This throws `ArrayIndexOutOfBoundsException` after the rewrite has already succeeded, causing the job to report a failure. Fix: #12479 ### Does this PR introduce _any_ user-facing change? The built-in Iceberg rewrite-data-files job now completes successfully when the procedure returns three result columns. It logs every statistic available in the returned row. There are no API or configuration changes. ### How was this patch tested? - Added unit tests for three-, four-, and five-column Spark rows. - Verified that the three-column regression test fails on the original implementation with `ArrayIndexOutOfBoundsException` and passes after the fix. - Ran `:maintenance:jobs:check -PskipTrinoConnector=true -PskipITs -PskipDockerTests=true` on Ubuntu: 141 tests passed with no failures, errors, or skipped tests. Validation run: https://github.com/IcebreakerSA/gravitino/actions/runs/33892876102 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
