[
https://issues.apache.org/jira/browse/KYLIN-5849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17898506#comment-17898506
]
Guoliang Sun commented on KYLIN-5849:
-------------------------------------
Users need to use Kylin-embedded Spark or there will be problems.
> File does not exist: /apache-kylin-4.0.4-bin-spark3/conf/fairscheduler.xml
> ---------------------------------------------------------------------------
>
> Key: KYLIN-5849
> URL: https://issues.apache.org/jira/browse/KYLIN-5849
> Project: Kylin
> Issue Type: Bug
> Reporter: Duma
> Priority: Critical
> Attachments: kylin.out
>
>
> When I attempt to start kylin is failing to start due to this error below. I
> am using Spark 3.2.4 that was already installed. I am not using spark within
> the kylin installation directory. Please help
> [Thread-24661] INFO org.sparkproject.jetty.server.AbstractConnector - Stopped
> Spark@3edb1cb3\{HTTP/1.1, (http/1.1)}{0.0.0.0:4041}
> [Thread-24661] INFO org.apache.spark.ui.SparkUI - Stopped Spark web UI at
> http://bg-data-master:4041
> [dispatcher-event-loop-7] INFO
> org.apache.spark.MapOutputTrackerMasterEndpoint -
> MapOutputTrackerMasterEndpoint stopped!
> [Thread-24661] INFO org.apache.spark.storage.memory.MemoryStore - MemoryStore
> cleared
> [Thread-24661] INFO org.apache.spark.storage.BlockManager - BlockManager
> stopped
> [Thread-24661] INFO org.apache.spark.storage.BlockManagerMaster -
> BlockManagerMaster stopped
> [Thread-24661] WARN org.apache.spark.metrics.MetricsSystem - Stopping a
> MetricsSystem that is not running
> [dispatcher-event-loop-12] INFO
> org.apache.spark.scheduler.OutputCommitCoordinator$OutputCommitCoordinatorEndpoint
> - OutputCommitCoordinator stopped!
> [Thread-24661] INFO org.apache.spark.SparkContext - Successfully stopped
> SparkContext
> {color:#FF0000}*[Thread-24661] ERROR org.apache.spark.sql.SparderContext -
> Error for initializing spark*{color}
> {color:#FF0000}*org.apache.spark.SparkException: External scheduler cannot be
> instantiated*{color}
> {color:#FF0000} *at*{color}
> org.apache.spark.SparkContext$.org$apache$spark$SparkContext$$createTaskScheduler(SparkContext.scala:2989)
> at org.apache.spark.SparkContext.<init>(SparkContext.scala:569)
> at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2700)
> at
> org.apache.spark.sql.KylinSession$KylinBuilder.$anonfun$getOrCreateKylinSession$2(KylinSession.scala:102)
> at scala.Option.getOrElse(Option.scala:189)
> at
> org.apache.spark.sql.KylinSession$KylinBuilder.getOrCreateKylinSession(KylinSession.scala:96)
> at
> org.apache.spark.sql.SparderContext$$anon$1.run(SparderContext.scala:145)
> at java.lang.Thread.run(Thread.java:750)
> {color:#FF0000}*Caused by: java.io.FileNotFoundException: File does not
> exist:
> /data1/kylin/apache-kylin-4.0.4-bin-spark3/conf/fairscheduler.xml*{color}
> at
> org.apache.hadoop.hdfs.server.namenode.INodeFile.valueOf(INodeFile.java:86)
> at
> org.apache.hadoop.hdfs.server.namenode.INodeFile.valueOf(INodeFile.java:76)
> Caused by:
> org.apache.hadoop.ipc.RemoteException(java.io.FileNotFoundException): File
> does not exist:
> /data1/kylin/apache-kylin-4.0.4-bin-spark3/conf/fairscheduler.xml
> at org.ap at
> org.apache.hadoop.hdfs.server.namenode.INodeFile.valueOf(INodeFile.java:86)
> at
> org.apache.hadoop.hdfs.server.namenode.INodeFile.valueOf(INodeFile.java:76)
> at
> org.apache.hadoop.hdfs.server.namenode.FSDirStatAndListingOp.getBlockLocations(FSDirStatAndListingOp.java:156)
> at
> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocations(FSNamesystem.java:2002)
> at
> org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getBlockLocations(NameNodeRpcServer.java:773)
> at
> org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getBlockLocations(ClientNamenodeProtocolServerSideTranslatorPB.java:442)
> at
> org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
