lasdf1234 opened a new pull request, #13268:
URL: https://github.com/apache/gravitino/pull/13268
### What changes were proposed in this pull request?
Cherry-pick apache/gravitino#13134 onto `branch-1.3`:
1. Fail built-in Iceberg jobs when Iceberg Spark runtime classes are missing
after `SparkSession` creation.
2. Document the `iceberg-spark-runtime` prerequisite and fail-fast behavior.
3. Name real CLI flags (`--updater-options`, `--spark-conf`, `--options`) in
JSON parse errors; document dangling optional template flags.
**Cherry-pick notes**
- Upstream: apache/gravitino#13134 / `35c184d2d`
- Target: `branch-1.3`
- `IcebergExpireSnapshotsJob` is not on `branch-1.3`, so that job/test pair
from upstream was omitted. `IcebergJobUtils` is added for Rewrite / Update
Stats.
### Why are the changes needed?
Without Iceberg Spark runtime, Spark only warns and jobs continue without
Iceberg support. Backport the fail-fast check and docs to the 1.3 line.
Fix: #13133
### Does this PR introduce _any_ user-facing change?
Same as #13134 for jobs present on `branch-1.3` (rewrite + update-stats):
non-zero exit when runtime is missing; clearer docs/errors.
### How was this patch tested?
```bash
./gradlew :maintenance:jobs:test \
--tests org.apache.gravitino.maintenance.jobs.iceberg.TestIcebergJobUtils \
--tests
org.apache.gravitino.maintenance.jobs.iceberg.TestIcebergUpdateStatsJob \
--tests
org.apache.gravitino.maintenance.jobs.iceberg.TestIcebergRewriteDataFilesJob \
-PskipITs -PskipDockerTests=true
```
Made with [Cursor](https://cursor.com)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
