Unable to start yarn services using the new hadoop-dist tar stitching module ----------------------------------------------------------------------------
Key: HADOOP-7752 URL: https://issues.apache.org/jira/browse/HADOOP-7752 Project: Hadoop Common Issue Type: Bug Components: build Affects Versions: 0.23.0, 0.24.0 Reporter: Ahmed Radwan Using the maven target: $mvn package -Pdist -DskipTests I am seeing the following error when trying to start the resourcemanager: $ bin/yarn-daemon.sh start resourcemanager starting resourcemanager, logging to /home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/bin/../logs/yarn-ahmed-resourcemanager-ubuntu.out /usr/lib/jvm/java-6-sun/bin/java -Dproc_resourcemanager -Xmx1000m -Dhadoop.log.dir=/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/bin/../logs -Dyarn.log.dir=/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/bin/../logs -Dhadoop.log.file=yarn-ahmed-resourcemanager-ubuntu.log -Dyarn.log.file=yarn-ahmed-resourcemanager-ubuntu.log -Dyarn.home.dir=/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/bin/.. -Dhadoop.root.logger=INFO,DRFA -Dyarn.root.logger=INFO,DRFA -classpath /home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/conf/:~/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/conf/::/usr/lib/jvm/java-6-sun/lib/tools.jar:/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/share/hadoop/common/*:/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/share/hadoop/common/lib/*:/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/share/hadoop/hdfs/*:/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/share/hadoop/hdfs/lib/*:/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/bin/../modules/*:/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/bin/../lib/*:~/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/conf//rm-config/log4j.properties org.apache.hadoop.yarn.server.resourcemanager.ResourceManager Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/yarn/server/resourcemanager/ResourceManager Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.yarn.server.resourcemanager.ResourceManager at java.net.URLClassLoader$1.run(URLClassLoader.java:202) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:190) at java.lang.ClassLoader.loadClass(ClassLoader.java:306) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) at java.lang.ClassLoader.loadClass(ClassLoader.java:247) Could not find the main class: org.apache.hadoop.yarn.server.resourcemanager.ResourceManager. Program will exit. Seems there are some missing jars in the modules directory in the dist: $ ls -al modules/ total 476 drwxr-xr-x 2 ahmed ahmed 4096 2011-10-17 00:56 . drwxr-xr-x 11 ahmed ahmed 4096 2011-10-17 00:58 .. -rwxr-xr-x 1 ahmed ahmed 347941 2011-10-17 00:56 hadoop-mapreduce-client-app-0.24.0-SNAPSHOT.jar -rwxr-xr-x 1 ahmed ahmed 79364 2011-10-17 00:56 hadoop-mapreduce-client-hs-0.24.0-SNAPSHOT.jar -rwxr-xr-x 1 ahmed ahmed 30720 2011-10-17 00:56 hadoop-mapreduce-client-jobclient-0.24.0-SNAPSHOT.jar -rwxr-xr-x 1 ahmed ahmed 15358 2011-10-17 00:56 hadoop-mapreduce-client-shuffle-0.24.0-SNAPSHOT.jar -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira