yadavay-amzn commented on PR #55720: URL: https://github.com/apache/spark/pull/55720#issuecomment-4491799480
@dongjoon-hyun Thanks for confirming the JDK 25 + UBI 10 environment. The production fix (Storage.InMemory) is JDK-independent as it's pure ammonite/Scala code with no Arrow/Netty dependency. The test failure is because spark-shell --remote initializes Arrow, which hits the Netty memoryAddress() incompatibility on JDK 25. Based on my understanding, this would affect any test that launches spark-shell on JDK 25, not just ours. I've submitted [PR #55999](https://github.com/apache/spark/pull/55999) to skip the test on JDK 25+ with an assume() guard. Please let me know if that is sufficient for now or if you'd like to disable the test some other way. Also filed [SPARK-56955](https://issues.apache.org/jira/browse/SPARK-56955) to track the underlying Arrow/Netty JDK 25 issue separately. @attilapiros Could you please keep me honest here on the production change (Storage.InMemory in ConnectRepl.scala) has no JDK-version sensitivity? It should be safe on all JDKs since it's just ammonite cache configuration, right? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
