[ https://issues.apache.org/jira/browse/SPARK-31531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17091170#comment-17091170 ]
Hyukjin Kwon commented on SPARK-31531: -------------------------------------- Spark does not support Java 11 in Spark 2.x. It will be supported in Spark 3. > sun.misc.Cleaner sun.nio.ch.DirectBuffer.cleaner() method not found during > spark-submit > --------------------------------------------------------------------------------------- > > Key: SPARK-31531 > URL: https://issues.apache.org/jira/browse/SPARK-31531 > Project: Spark > Issue Type: Bug > Components: Spark Submit > Affects Versions: 2.4.5 > Reporter: shayoni Halder > Priority: Major > Attachments: error.PNG > > > I am trying to run the following Spark submit from a VM using Yarn cluster > mode. > ./spark-submit --master yarn --deploy-mode client test_spark_yarn.py > The VM has java version 11 and spark-2.4.5 while the yarn cluster java 8 and > spark-2.4.0. I am getting the error below: > !error.PNG! -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org