rangareddy commented on issue #17240:
URL: https://github.com/apache/hudi/issues/17240#issuecomment-5369622677
**Closing this as obsolete: the configuration it reports against is no
longer supported.**
This report is a single link to a GitHub Actions run for the job
`integration-tests (spark2.4, spark-2.4.4/spark-2.4.4-bin-hadoop2.7.tgz)`.
**Spark 2.4 is no longer supported in Hudi.** Support for Spark 2 and Scala
2.11 was removed by PR #11788 (`[HUDI-8089] Remove support for Spark2 and
Scala2.11 from Hudi`, merged 2024-10-04), with follow-ups #12079 (`[HUDI-8089]
Remove spark2 file`) and #13187 (removing the spark2 bundle from the
staged-bundle validation script).
On current `master` the only Spark profiles are:
| profile | Spark version |
| --- | --- |
| `spark3.3` | 3.3.4 |
| `spark3.4` | 3.4.3 |
| `spark3` / `spark3.5` | 3.5.5 (default) |
| `spark4.0` | 4.0.2 |
| `spark4.1` | 4.1.1 |
| `spark4.2` | 4.2.0 |
There is no Spark 2.x profile, no `hudi-spark2` module, and no Spark 2.4 CI
job. (Two vestigial `skip.hudi-spark2.unit.tests` properties survive in the
root pom with no module behind them, which is worth tidying separately.)
So the failing job named here cannot recur, and the linked run has expired,
so the original output is no longer retrievable either. There is no named test
in the description to carry forward.
If integration tests are still flaky on a supported Spark line, please open
a fresh issue with the specific test, the Spark profile, and a link to a recent
run. Two existing issues already track integration-test health and may be the
better home for that:
- #17221 - failing unit tests in `hudi-integ-test`
- #17276 - `ITTestHoodieSanity` and `ITTestHoodieSyncCommand` are fully
`@Disabled("HUDI-8274")`
Closing as obsolete.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
