[jira] [Created] (SPARK-46909) Could not initialize class org.apache.spark.unsafe.array.ByteArrayMethods error in JDK 21

[Johnny Sohn (Jira)]

Johnny Sohn created SPARK-46909:
-----------------------------------

             Summary: Could not initialize class 
org.apache.spark.unsafe.array.ByteArrayMethods error in JDK 21
                 Key: SPARK-46909
                 URL: https://issues.apache.org/jira/browse/SPARK-46909
             Project: Spark
          Issue Type: Bug
          Components: Spark Core
    Affects Versions: 3.3.1
            Reporter: Johnny Sohn


Trying to run spark on JDK 21, and we're getting this exception
{code:java}
Caused by: java.lang.NoClassDefFoundError: Could not initialize class 
org.apache.spark.unsafe.array.ByteArrayMethods
        at 
org.apache.spark.memory.MemoryManager.defaultPageSizeBytes$lzycompute(MemoryManager.scala:264)
        at 
org.apache.spark.memory.MemoryManager.defaultPageSizeBytes(MemoryManager.scala:254)
        at 
org.apache.spark.memory.MemoryManager.$anonfun$pageSizeBytes$1(MemoryManager.scala:273)
        at 
scala.runtime.java8.JFunction0$mcJ$sp.apply(JFunction0$mcJ$sp.java:23)
        at scala.Option.getOrElse(Option.scala:189)
        at org.apache.spark.memory.MemoryManager.<init>(MemoryManager.scala:273)
        at 
org.apache.spark.memory.UnifiedMemoryManager.<init>(UnifiedMemoryManager.scala:58)
        at 
org.apache.spark.memory.UnifiedMemoryManager$.apply(UnifiedMemoryManager.scala:207)
        at org.apache.spark.SparkEnv$.create(SparkEnv.scala:320)
        at org.apache.spark.SparkEnv$.createDriverEnv(SparkEnv.scala:194)
        at org.apache.spark.SparkContext.createSparkEnv(SparkContext.scala:279)
        at org.apache.spark.SparkContext.<init>(SparkContext.scala:464)
        at 
org.apache.spark.api.java.JavaSparkContext.<init>(JavaSparkContext.scala:58)
        at 
Caused by: java.lang.ExceptionInInitializerError: Exception 
java.lang.ExceptionInInitializerError [in thread "skir-0"]
        at 
org.apache.spark.unsafe.array.ByteArrayMethods.<clinit>(ByteArrayMethods.java:56)
        at 
org.apache.spark.memory.MemoryManager.defaultPageSizeBytes$lzycompute(MemoryManager.scala:264)
        at 
org.apache.spark.memory.MemoryManager.defaultPageSizeBytes(MemoryManager.scala:254)
        at 
org.apache.spark.memory.MemoryManager.$anonfun$pageSizeBytes$1(MemoryManager.scala:273)
        at 
scala.runtime.java8.JFunction0$mcJ$sp.apply(JFunction0$mcJ$sp.java:23)
        at scala.Option.getOrElse(Option.scala:189)
        at org.apache.spark.memory.MemoryManager.<init>(MemoryManager.scala:273)
        at 
org.apache.spark.memory.UnifiedMemoryManager.<init>(UnifiedMemoryManager.scala:58)
        at 
org.apache.spark.memory.UnifiedMemoryManager$.apply(UnifiedMemoryManager.scala:207)
        at org.apache.spark.SparkEnv$.create(SparkEnv.scala:320)
        at org.apache.spark.SparkEnv$.createDriverEnv(SparkEnv.scala:194)
        at org.apache.spark.SparkContext.createSparkEnv(SparkContext.scala:279)
        at org.apache.spark.SparkContext.<init>(SparkContext.scala:464)
        at 
org.apache.spark.api.java.JavaSparkContext.<init>(JavaSparkContext.scala:58)
        at  {code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org