wangrupeng created KYLIN-4632:
---------------------------------
Summary: No such element exception:spark.driver.cores
Key: KYLIN-4632
URL: https://issues.apache.org/jira/browse/KYLIN-4632
Project: Kylin
Issue Type: Bug
Components: Spark Engine
Affects Versions: v4.0.0-beta
Reporter: wangrupeng
Assignee: wangrupeng
Fix For: v4.0.0-beta
When submit a build job, it throws an exception. But the build job still can
run successfully.
20/07/10 14:06:29 WARN SparkApplication: Error occurred when check resource.
Ignore it and try to submit this job.
java.util.NoSuchElementException: spark.driver.cores
at org.apache.spark.SparkConf$$anonfun$get$1.apply(SparkConf.scala:245)
at org.apache.spark.SparkConf$$anonfun$get$1.apply(SparkConf.scala:245)
at scala.Option.getOrElse(Option.scala:121)
at org.apache.spark.SparkConf.get(SparkConf.scala:245)
at org.apache.spark.utils.ResourceUtils$.checkResource(ResourceUtils.scala:71)
at org.apache.spark.utils.ResourceUtils.checkResource(ResourceUtils.scala)
at
org.apache.kylin.engine.spark.application.SparkApplication.execute(SparkApplication.java:156)
at
org.apache.kylin.engine.spark.application.SparkApplication.execute(SparkApplication.java:76)
at org.apache.spark.application.JobWorker$$anon$2.run(JobWorker.scala:55)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
