Hi Spark devs, According to the Spark 3.5 release notes, Spark 4 will no longer support Java 8 and 11 (link <https://spark.apache.org/releases/spark-release-3-5-0.html#upcoming-removal> ).
My company is using Spark on Yarn with Java 8 now. When considering a future upgrade to Spark 4, one issue we face is that the latest version of Hadoop (3.3) does not yet support Java 17. There is an open ticket ( HADOOP-17177 <https://issues.apache.org/jira/browse/HADOOP-17177>) for this issue, which has been open for over two years. My question is: Does the release of Spark 4 depend on the availability of Java 17 support in Hadoop? Additionally, do we have a rough estimate for the release of Spark 4? Thanks! Cheers, Jason Xu
