GitHub user xushiyan closed the discussion with a comment: Drop Java 8 support and move to Java 11/17?
To clarify the support matrix, in the next release Hudi 1.2, since we're dropping java 8, moving to 11 or 17 has different implications of engine integration compatibility. Below is a support matrix: | Engine | Versions | Min Runtime JVM | Java 11 Compile Target | Java 17 Compile Target | Notes | |----------|-------------------------|-----------------|------------------------|------------------------|-------| | Spark | 3.3.x, 3.4.x, 3.5.x | Java 8 (11 recommended) | ✅ Compatible | ✅ Compatible | Users may run on Java 8/11/17. | | Spark | 4.x | Java 17 | ✅ Compatible | ✅ Compatible | **Scala 2.13 only**. | | Flink | 1.18.x, 1.19.x, 1.20.x | Java 8 (11 recommended) | ✅ Compatible | ⚠️ Requires Java 17 runtime (beta) | Java 17 is beta in 1.18–1.20. | | Flink | 2.0.x | Java 11 | ✅ Compatible | ✅ Compatible | Java 17 default; Java 11 minimum. | | Hive | 3.x (EOL) | Java 8 | ⚠️ Incompatible | ⚠️ Incompatible | no official support for running with java11+ runtime; may work but only with latest Hadoop | | Hive | 4.0.x | Java 8 | ⚠️ Incompatible | ⚠️ Incompatible | no official support for running with java11+ runtime; may work but only with latest Hadoop | | Hive | 4.1.x | Java 17 | ✅ Compatible | ✅ Compatible | | | Hive | 4.2.x | Java 21 | ✅ Compatible | ✅ Compatible | | | Trino | 472+ | Java 23/24 | ✅ Compatible | ✅ Compatible | | | PrestoDB | 0.273–0.286 | Java 11 | ✅ Compatible | ⚠️ Requires Java 17 runtime | | | PrestoDB | 0.287+ | Java 17 | ✅ Compatible | ✅ Compatible | | Based on flink 1.18-1.20 only having beta support to work with java 17, moving to java 11 is safer. Also note that Hive support needs further verification, going with java 11 or 17 would require extra setup or dropping support before hive 4.1. GitHub link: https://github.com/apache/hudi/discussions/13835#discussioncomment-15152452 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
