camper42 commented on issue #6437:
URL: https://github.com/apache/kyuubi/issues/6437#issuecomment-2141576700
@wForget
```
24/05/31 17:14:53 ERROR SparkSQLEngine:
Spark application name:
kyuubi_CONNECTION_SPARK_SQL_camper42_43ac361b-3028-416f-ad3a-3a2438f4b39b
application ID: spark-5e63469a46dd4360bfc1e02187dbdfe0
application tags:
application web UI:
http://spark-73dd2d8fcdedc2e0-driver-svc.kyuubi.svc:4040
master: k8s://https://10.104.0.1:443
version: 3.5.1
driver: [cpu: 2, mem: 8g]
executor: [cpu: 4, mem: 10g, maxNum: 25]
Start time: Fri May 31 17:14:25 CST 2024
End time: Fri May 31 17:14:53 CST 2024
User: camper42 (shared mode: CONNECTION)
State: STOPPED
Diagnostic: Failed to start SparkSQLEngine: JuiceFS initialized failed
for jfs:///
org.apache.kyuubi.KyuubiException: Failed to start SparkSQLEngine: JuiceFS
initialized failed for jfs:///
at
org.apache.kyuubi.engine.spark.SparkSQLEngine$.$anonfun$startEngine$1(SparkSQLEngine.scala:371)
at
org.apache.kyuubi.engine.spark.SparkSQLEngine$.$anonfun$startEngine$1$adapted(SparkSQLEngine.scala:340)
at scala.Option.foreach(Option.scala:407)
at
org.apache.kyuubi.engine.spark.SparkSQLEngine$.startEngine(SparkSQLEngine.scala:340)
at
org.apache.kyuubi.engine.spark.SparkSQLEngine$.main(SparkSQLEngine.scala:405)
at
org.apache.kyuubi.engine.spark.SparkSQLEngine.main(SparkSQLEngine.scala)
at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
at
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown
Source)
at java.base/java.lang.reflect.Method.invoke(Unknown Source)
at
org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
at
org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:1029)
at
org.apache.spark.deploy.SparkSubmit.$anonfun$submit$2(SparkSubmit.scala:169)
at
org.apache.spark.deploy.SparkHadoopUtil$$anon$1.run(SparkHadoopUtil.scala:62)
at
org.apache.spark.deploy.SparkHadoopUtil$$anon$1.run(SparkHadoopUtil.scala:61)
at java.base/java.security.AccessController.doPrivileged(Unknown Source)
at java.base/javax.security.auth.Subject.doAs(Unknown Source)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1878)
at
org.apache.spark.deploy.SparkHadoopUtil.runAsSparkUser(SparkHadoopUtil.scala:61)
at
org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:169)
at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:217)
at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:91)
at
org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:1120)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:1129)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
Caused by: java.io.IOException: JuiceFS initialized failed for jfs:///
at
com.juicefs.JuiceFileSystemImpl.initialize(JuiceFileSystemImpl.java:544)
at
org.apache.hadoop.fs.FilterFileSystem.initialize(FilterFileSystem.java:98)
at com.juicefs.JuiceFileSystem.initialize(JuiceFileSystem.java:241)
at
org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:3469)
at org.apache.hadoop.fs.FileSystem.access$300(FileSystem.java:174)
at
org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:3574)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:3521)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:540)
at org.apache.hadoop.fs.Path.getFileSystem(Path.java:365)
at
org.apache.kyuubi.engine.spark.SparkSQLEngine.start(SparkSQLEngine.scala:96)
at
org.apache.kyuubi.engine.spark.SparkSQLEngine$.$anonfun$startEngine$1(SparkSQLEngine.scala:358)
... 24 more```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
