JagadeeshNagella commented on pull request #167: URL: https://github.com/apache/incubator-livy/pull/167#issuecomment-644405922
> Hi @JagadeeshNagella , > First I would suggest start from checking K8s cluster API version you re using. Please refer [this answer](https://stackoverflow.com/questions/61538791/run-spark-example-on-kubernetes-failed/61575925#61575925) for the details. I have changed k8s client version to 4.9.2 and rebuild Livy code. I solved most of the issues and now I am running into new issue . any idea ? 20/06/15 21:21:23 INFO BatchSessionManager: Registered new session 4 20/06/15 21:21:23 INFO SparkKubernetesApp: Finished monitoring application livy-batch-4-0aaOeygf with state STARTING Exception in thread "kubernetesAppMonitorThread-org.apache.livy.utils.SparkKubernetesApp@7ff7e85e" java.lang.NoClassDefFoundError: Could not initialize class io.fabric8.kubernetes.client.dsl.internal.PodOperationsImpl at io.fabric8.kubernetes.client.DefaultKubernetesClient.pods(DefaultKubernetesClient.java:204) at org.apache.livy.utils.LivyKubernetesClient$$anonfun$getApplications$4.apply(SparkKubernetesApp.scala:360) at org.apache.livy.utils.LivyKubernetesClient$$anonfun$getApplications$4.apply(SparkKubernetesApp.scala:364) at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234) at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234) at scala.collection.immutable.List.foreach(List.scala:392) at scala.collection.TraversableLike$class.map(TraversableLike.scala:234) at scala.collection.immutable.List.map(List.scala:296) at org.apache.livy.utils.LivyKubernetesClient.getApplications(SparkKubernetesApp.scala:360) at org.apache.livy.utils.SparkKubernetesApp$$anonfun$5.apply(SparkKubernetesApp.scala:245) at org.apache.livy.utils.SparkKubernetesApp$$anonfun$5.apply(SparkKubernetesApp.scala:245) at scala.util.Try$.apply(Try.scala:192) at org.apache.livy.utils.SparkKubernetesApp$.org$apache$livy$utils$SparkKubernetesApp$$withRetry(SparkKubernetesApp.scala:98) at org.apache.livy.utils.SparkKubernetesApp.org$apache$livy$utils$SparkKubernetesApp$$getAppFromTag(SparkKubernetesApp.scala:245) at org.apache.livy.utils.SparkKubernetesApp$$anonfun$1.apply$mcV$sp(SparkKubernetesApp.scala:161) at org.apache.livy.Utils$$anon$1.run(Utils.scala:97) 20/06/15 21:21:28 INFO LineBufferedStream: Exception in thread "main" java.lang.IllegalArgumentException: basedir must be absolute: local:/opt/livy/.ivy/local 20/06/15 21:21:28 INFO LineBufferedStream: at org.apache.ivy.util.Checks.checkAbsolute(Checks.java:48) 20/06/15 21:21:28 INFO LineBufferedStream: at org.apache.ivy.plugins.repository.file.FileRepository.setBaseDir(FileRepository.java:135) 20/06/15 21:21:28 INFO LineBufferedStream: at org.apache.ivy.plugins.repository.file.FileRepository.<init>(FileRepository.java:44) 20/06/15 21:21:28 INFO LineBufferedStream: at org.apache.spark.deploy.SparkSubmitUtils$.createRepoResolvers(SparkSubmit.scala:1056) 20/06/15 21:21:28 INFO LineBufferedStream: at org.apache.spark.deploy.SparkSubmitUtils$.buildIvySettings(SparkSubmit.scala:1142) 20/06/15 21:21:28 INFO LineBufferedStream: at org.apache.spark.deploy.DependencyUtils$.resolveMavenDependencies(DependencyUtils.scala:51) 20/06/15 21:21:28 INFO LineBufferedStream: at org.apache.spark.deploy.SparkSubmit.prepareSubmitEnvironment(SparkSubmit.scala:304) 20/06/15 21:21:28 INFO LineBufferedStream: at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:774) 20/06/15 21:21:28 INFO LineBufferedStream: at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:161) 20/06/15 21:21:28 INFO LineBufferedStream: at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:184) 20/06/15 21:21:28 INFO LineBufferedStream: at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86) 20/06/15 21:21:28 INFO LineBufferedStream: at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:920) 20/06/15 21:21:28 INFO LineBufferedStream: at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:929) 20/06/15 21:21:28 INFO LineBufferedStream: at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) 20/06/15 21:21:28 WARN BatchSession$: spark-submit exited with code 1 ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
