Hi Xiaoxiang, This issue is resolved. Thanks for your response.
The problem was that the spark-download-user.sh script was not able to rename the spark-newton folder to spark and add required jar changes. with regards, Sonu Kumar Singh On Fri, Sep 8, 2023 at 12:31 PM Xiaoxiang Yu <x...@apache.org> wrote: > Sorry for late reply, > > If you can execuet "ls -al /opt/apache-kylin-5.0.0-beta-bin/spark/jars/ | > wc -l", is the output equal to 287 ? > > And could you please send your log files, including: > - /opt/apache-kylin-5.0.0-beta-bin/logs/stderr > - /opt/apache-kylin-5.0.0-beta-bin/logs/stdout > > -- > *Best wishes to you ! * > *From ：**Xiaoxiang Yu* > > > > At 2023-09-01 23:40:24, "Singh Sonu" <sonusingh.javat...@gmail.com> wrote: > > Hi Experts, > > > >I was trying to setup the new Kylin 5.0.0 Beta version and got stuck with > >the below error: > >Kylin 5.0.0 Alpha is working completely fine in my environment. > > > >Looking for your immediate response. > >Thanks in advance. > > > >Error - > >============================================================================ > >Checking check-1200-hadoop-conf.sh > >---------------------------------------------------------------------------- > >Checking hadoop conf dir... > >WARNING: log4j.properties is not found. HADOOP_CONF_DIR may be incomplete. > >Turn on verbose mode. > >Turn on verbose mode. > >KYLIN_HOME is:/opt/apache-kylin-5.0.0-beta-bin > >KYLIN_CONFIG_FILE is:/opt/apache-kylin-5.0.0-beta-bin/conf/kylin.properties > >SPARK_HOME is:/opt/apache-kylin-5.0.0-beta-bin/spark > >KYLIN_JVM_SETTINGS is -server -Xms1g -Xmx8g -XX:+UseG1GC > >-XX:MaxGCPauseMillis=200 -XX:G1HeapRegionSize=16m -XX:+PrintFlagsFinal > >-XX:+PrintReferenceGC -verbose:gc -XX:+PrintGCDetails > >-XX:+PrintGCTimeStamps -XX:+PrintGCDateStamps -XX:+PrintAdaptiveSizePolicy > >-XX:+UnlockDiagnosticVMOptions -XX:+G1SummarizeConcMark > > -Xloggc:/opt/apache-kylin-5.0.0-beta-bin/logs/kylin.gc.%p > > -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=10 -XX:GCLogFileSize=64M > >-XX:-OmitStackTraceInFastThrow > >-Dlog4j2.contextSelector=org.apache.logging.log4j.core.async.AsyncLoggerContextSelector > >-DAsyncLogger.RingBufferSize=8192 > >KYLIN_DEBUG_SETTINGS is not set, will not enable remote debuging > >KYLIN_LD_LIBRARY_SETTINGS is not set, it is okay unless you want to specify > >your own native path > >WARNING: log4j.properties is not found. HADOOP_CONF_DIR may be incomplete. > >SPARK_HDP_VERSION is set to 'hadoop' > >/opt/apache-kylin-5.0.0-beta-bin/sbin/do-check-and-prepare-spark.sh: line > >103: /opt/apache-kylin-5.0.0-beta-bin/spark/spark_hdp_version: No such file > >or directory > >cat: /opt/apache-kylin-5.0.0-beta-bin/spark/spark_hdp_version: No such file > >or directory > >cp: cannot stat '/opt/apache-kylin-5.0.0-beta-bin/spark': No such file or > >directory > >/opt/apache-kylin-5.0.0-beta-bin/sbin/do-check-and-prepare-spark.sh: line > >172: /opt/apache-kylin-5.0.0-beta-bin/spark/spark_hdp_version: No such file > >or directory > >hadoop Spark jars exchange SUCCESS > >SPARK_HDP_VERSION save in PATH > >/opt/apache-kylin-5.0.0-beta-bin/spark/spark_hdp_version > >Export SPARK_HOME to /opt/apache-kylin-5.0.0-beta-bin/spark > >Checking hadoop config dir /opt/apache-kylin-5.0.0-beta-bin/hadoop_conf > >Exception in thread "main" java.lang.NoClassDefFoundError: > >org/apache/hadoop/conf/Configuration > > at > >org.apache.kylin.tool.hadoop.CheckHadoopConfDir.getLocalFSAndHitUGIForTheFirstTime(CheckHadoopConfDir.java:84) > > at > >org.apache.kylin.tool.hadoop.CheckHadoopConfDir.main(CheckHadoopConfDir.java:54) > >Caused by: java.lang.ClassNotFoundException: > >org.apache.hadoop.conf.Configuration > > at java.net.URLClassLoader.findClass(URLClassLoader.java:387) > > at java.lang.ClassLoader.loadClass(ClassLoader.java:418) > > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) > > at java.lang.ClassLoader.loadClass(ClassLoader.java:351) > > ... 2 more > >ERROR: Check HADOOP_CONF_DIR failed. Please correct hadoop configurations. > >ESC[31mERROR: Check HADOOP_CONF_DIR failed. Please correct hadoop > >configurations.ESC[0m > > > > > >Regards, > >Sonu > >
