Sorry for late reply,
If you can execuet "ls -al /opt/apache-kylin-5.0.0-beta-bin/spark/jars/ | wc
-l", is the output equal to 287 ?
And could you please send your log files, including:
- /opt/apache-kylin-5.0.0-beta-bin/logs/stderr
- /opt/apache-kylin-5.0.0-beta-bin/logs/stdout
--
Best wishes to you !
From ：Xiaoxiang Yu
At 2023-09-01 23:40:24, "Singh Sonu" <sonusingh.javat...@gmail.com> wrote:
> Hi Experts,
>
>I was trying to setup the new Kylin 5.0.0 Beta version and got stuck with
>the below error:
>Kylin 5.0.0 Alpha is working completely fine in my environment.
>
>Looking for your immediate response.
>Thanks in advance.
>
>Error -
>============================================================================
>Checking check-1200-hadoop-conf.sh
>----------------------------------------------------------------------------
>Checking hadoop conf dir...
>WARNING: log4j.properties is not found. HADOOP_CONF_DIR may be incomplete.
>Turn on verbose mode.
>Turn on verbose mode.
>KYLIN_HOME is:/opt/apache-kylin-5.0.0-beta-bin
>KYLIN_CONFIG_FILE is:/opt/apache-kylin-5.0.0-beta-bin/conf/kylin.properties
>SPARK_HOME is:/opt/apache-kylin-5.0.0-beta-bin/spark
>KYLIN_JVM_SETTINGS is -server -Xms1g -Xmx8g -XX:+UseG1GC
>-XX:MaxGCPauseMillis=200 -XX:G1HeapRegionSize=16m -XX:+PrintFlagsFinal
>-XX:+PrintReferenceGC -verbose:gc -XX:+PrintGCDetails
>-XX:+PrintGCTimeStamps -XX:+PrintGCDateStamps -XX:+PrintAdaptiveSizePolicy
>-XX:+UnlockDiagnosticVMOptions -XX:+G1SummarizeConcMark
> -Xloggc:/opt/apache-kylin-5.0.0-beta-bin/logs/kylin.gc.%p
> -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=10 -XX:GCLogFileSize=64M
>-XX:-OmitStackTraceInFastThrow
>-Dlog4j2.contextSelector=org.apache.logging.log4j.core.async.AsyncLoggerContextSelector
>-DAsyncLogger.RingBufferSize=8192
>KYLIN_DEBUG_SETTINGS is not set, will not enable remote debuging
>KYLIN_LD_LIBRARY_SETTINGS is not set, it is okay unless you want to specify
>your own native path
>WARNING: log4j.properties is not found. HADOOP_CONF_DIR may be incomplete.
>SPARK_HDP_VERSION is set to 'hadoop'
>/opt/apache-kylin-5.0.0-beta-bin/sbin/do-check-and-prepare-spark.sh: line
>103: /opt/apache-kylin-5.0.0-beta-bin/spark/spark_hdp_version: No such file
>or directory
>cat: /opt/apache-kylin-5.0.0-beta-bin/spark/spark_hdp_version: No such file
>or directory
>cp: cannot stat '/opt/apache-kylin-5.0.0-beta-bin/spark': No such file or
>directory
>/opt/apache-kylin-5.0.0-beta-bin/sbin/do-check-and-prepare-spark.sh: line
>172: /opt/apache-kylin-5.0.0-beta-bin/spark/spark_hdp_version: No such file
>or directory
>hadoop Spark jars exchange SUCCESS
>SPARK_HDP_VERSION save in PATH
>/opt/apache-kylin-5.0.0-beta-bin/spark/spark_hdp_version
>Export SPARK_HOME to /opt/apache-kylin-5.0.0-beta-bin/spark
>Checking hadoop config dir /opt/apache-kylin-5.0.0-beta-bin/hadoop_conf
>Exception in thread "main" java.lang.NoClassDefFoundError:
>org/apache/hadoop/conf/Configuration
> at
>org.apache.kylin.tool.hadoop.CheckHadoopConfDir.getLocalFSAndHitUGIForTheFirstTime(CheckHadoopConfDir.java:84)
> at
>org.apache.kylin.tool.hadoop.CheckHadoopConfDir.main(CheckHadoopConfDir.java:54)
>Caused by: java.lang.ClassNotFoundException:
>org.apache.hadoop.conf.Configuration
> at java.net.URLClassLoader.findClass(URLClassLoader.java:387)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:418)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:351)
> ... 2 more
>ERROR: Check HADOOP_CONF_DIR failed. Please correct hadoop configurations.
>ESC[31mERROR: Check HADOOP_CONF_DIR failed. Please correct hadoop
>configurations.ESC[0m
>
>
>Regards,
>Sonu
