Hi Experts,
I was trying to setup the new Kylin 5.0.0 Beta version and got stuck with
the below error:
Kylin 5.0.0 Alpha is working completely fine in my environment.
Looking for your immediate response.
Thanks in advance.
Error -
============================================================================
Checking check-1200-hadoop-conf.sh
----------------------------------------------------------------------------
Checking hadoop conf dir...
WARNING: log4j.properties is not found. HADOOP_CONF_DIR may be incomplete.
Turn on verbose mode.
Turn on verbose mode.
KYLIN_HOME is:/opt/apache-kylin-5.0.0-beta-bin
KYLIN_CONFIG_FILE is:/opt/apache-kylin-5.0.0-beta-bin/conf/kylin.properties
SPARK_HOME is:/opt/apache-kylin-5.0.0-beta-bin/spark
KYLIN_JVM_SETTINGS is -server -Xms1g -Xmx8g -XX:+UseG1GC
-XX:MaxGCPauseMillis=200 -XX:G1HeapRegionSize=16m -XX:+PrintFlagsFinal
-XX:+PrintReferenceGC -verbose:gc -XX:+PrintGCDetails
-XX:+PrintGCTimeStamps -XX:+PrintGCDateStamps -XX:+PrintAdaptiveSizePolicy
-XX:+UnlockDiagnosticVMOptions -XX:+G1SummarizeConcMark
-Xloggc:/opt/apache-kylin-5.0.0-beta-bin/logs/kylin.gc.%p
-XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=10 -XX:GCLogFileSize=64M
-XX:-OmitStackTraceInFastThrow
-Dlog4j2.contextSelector=org.apache.logging.log4j.core.async.AsyncLoggerContextSelector
-DAsyncLogger.RingBufferSize=8192
KYLIN_DEBUG_SETTINGS is not set, will not enable remote debuging
KYLIN_LD_LIBRARY_SETTINGS is not set, it is okay unless you want to specify
your own native path
WARNING: log4j.properties is not found. HADOOP_CONF_DIR may be incomplete.
SPARK_HDP_VERSION is set to 'hadoop'
/opt/apache-kylin-5.0.0-beta-bin/sbin/do-check-and-prepare-spark.sh: line
103: /opt/apache-kylin-5.0.0-beta-bin/spark/spark_hdp_version: No such file
or directory
cat: /opt/apache-kylin-5.0.0-beta-bin/spark/spark_hdp_version: No such file
or directory
cp: cannot stat '/opt/apache-kylin-5.0.0-beta-bin/spark': No such file or
directory
/opt/apache-kylin-5.0.0-beta-bin/sbin/do-check-and-prepare-spark.sh: line
172: /opt/apache-kylin-5.0.0-beta-bin/spark/spark_hdp_version: No such file
or directory
hadoop Spark jars exchange SUCCESS
SPARK_HDP_VERSION save in PATH
/opt/apache-kylin-5.0.0-beta-bin/spark/spark_hdp_version
Export SPARK_HOME to /opt/apache-kylin-5.0.0-beta-bin/spark
Checking hadoop config dir /opt/apache-kylin-5.0.0-beta-bin/hadoop_conf
Exception in thread "main" java.lang.NoClassDefFoundError:
org/apache/hadoop/conf/Configuration
at
org.apache.kylin.tool.hadoop.CheckHadoopConfDir.getLocalFSAndHitUGIForTheFirstTime(CheckHadoopConfDir.java:84)
at
org.apache.kylin.tool.hadoop.CheckHadoopConfDir.main(CheckHadoopConfDir.java:54)
Caused by: java.lang.ClassNotFoundException:
org.apache.hadoop.conf.Configuration
at java.net.URLClassLoader.findClass(URLClassLoader.java:387)
at java.lang.ClassLoader.loadClass(ClassLoader.java:418)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352)
at java.lang.ClassLoader.loadClass(ClassLoader.java:351)
... 2 more
ERROR: Check HADOOP_CONF_DIR failed. Please correct hadoop configurations.
ESC[31mERROR: Check HADOOP_CONF_DIR failed. Please correct hadoop
configurations.ESC[0m
Regards,
Sonu
