It looks like the Avro 1.3.2 JAR was included in the tar ball built in the mapreduce project. It's present in lib in the unzipped tarball. However, even if I remove it, the error still happens.
Matei On Aug 11, 2011, at 3:47 PM, Mahadev Konar wrote: > Haoyuan, > Thats an issue with having avro 1.3.2 jar in the classpath. Please > see if you have that version of 1.3.2 jar in the classpath and remove > it. We use 1.4 avro jar which isnt compatible with 1.3.2. > > hope that helps! > mahadev > > On Thu, Aug 11, 2011 at 3:36 PM, Haoyuan Li <haoyuan...@gmail.com> wrote: >> I downloaded the latest version: r1156719. and then redid from the scratch. >> Now, the nodemanager and run well. However, I got into the same state as >> Matei when I tried to run ResourceManager. Any help will be appreciated. >> Best, >> Haoyuan >> The followings are output. >> ============ The output from .out log file ================= >> Exception in thread "main" java.lang.IllegalStateException: For this >> operation, current State must be STARTED instead of INITED >> at >> org.apache.hadoop.yarn.service.AbstractService.ensureCurrentState(AbstractService.java:101) >> at >> org.apache.hadoop.yarn.service.AbstractService.stop(AbstractService.java:69) >> at >> org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher.stop(ApplicationMasterLauncher.java:90) >> at >> org.apache.hadoop.yarn.service.CompositeService.stop(CompositeService.java:89) >> at >> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.stop(ResourceManager.java:423) >> at >> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:495) >> ===================================================== >> =========== the output from .log log file =================== >> 2011-08-11 15:25:38,357 INFO >> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Resource >> Manager is starting... >> 2011-08-11 15:25:38,878 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: >> Registering class >> org.apache.hadoop.yarn.server.resourcemanager.scheduler.event.SchedulerEventType >> for class >> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$SchedulerEventDispatcher >> 2011-08-11 15:25:38,879 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: >> Registering class >> org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppEventType for class >> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationEventDispatcher >> 2011-08-11 15:25:38,880 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: >> Registering class >> org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptEventType >> for class >> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher >> 2011-08-11 15:25:38,881 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: >> Registering class >> org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeEventType for >> class >> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$NodeEventDispatcher >> 2011-08-11 15:25:38,904 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: >> Registering class >> org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncherEventType >> for class >> org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher >> 2011-08-11 15:25:38,907 INFO org.apache.hadoop.yarn.service.AbstractService: >> Service:Dispatcher is inited. >> 2011-08-11 15:25:38,907 INFO org.apache.hadoop.yarn.service.AbstractService: >> Service:org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.ContainerAllocationExpirer >> is inited. >> 2011-08-11 15:25:38,935 INFO org.apache.hadoop.yarn.service.AbstractService: >> Service:AMLivelinessMonitor is inited. >> 2011-08-11 15:25:38,936 INFO org.apache.hadoop.util.HostsFileReader: >> Refreshing hosts (include/exclude) list >> 2011-08-11 15:25:38,936 INFO org.apache.hadoop.yarn.service.AbstractService: >> Service:org.apache.hadoop.yarn.server.resourcemanager.NodesListManager is >> inited. >> 2011-08-11 15:25:38,936 INFO org.apache.hadoop.yarn.service.AbstractService: >> Service:org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$SchedulerEventDispatcher >> is inited. >> 2011-08-11 15:25:38,936 INFO org.apache.hadoop.yarn.service.AbstractService: >> Service:NMLivelinessMonitor is inited. >> 2011-08-11 15:25:38,940 INFO org.apache.hadoop.yarn.service.AbstractService: >> Service:org.apache.hadoop.yarn.server.resourcemanager.ResourceTrackerService >> is inited. >> 2011-08-11 15:25:38,941 INFO org.apache.hadoop.yarn.service.AbstractService: >> Service:org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService >> is inited. >> 2011-08-11 15:25:38,941 INFO org.apache.hadoop.yarn.service.AbstractService: >> Service:org.apache.hadoop.yarn.server.resourcemanager.ClientRMService is >> inited. >> 2011-08-11 15:25:38,941 INFO org.apache.hadoop.yarn.service.AbstractService: >> Service:org.apache.hadoop.yarn.server.resourcemanager.AdminService is >> inited. >> 2011-08-11 15:25:38,965 INFO org.apache.hadoop.yarn.service.AbstractService: >> Service:org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher >> is inited. >> 2011-08-11 15:25:38,965 INFO org.apache.hadoop.yarn.service.AbstractService: >> Service:ResourceManager is inited. >> 2011-08-11 15:25:39,057 INFO org.mortbay.log: Logging to >> org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via >> org.mortbay.log.Slf4jLog >> 2011-08-11 15:25:39,125 INFO org.apache.hadoop.http.HttpServer: Added global >> filter 'safety' (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter) >> 2011-08-11 15:25:39,128 INFO org.apache.hadoop.http.HttpServer: Added filter >> static_user_filter >> (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to >> context WepAppsContext >> 2011-08-11 15:25:39,128 INFO org.apache.hadoop.http.HttpServer: Added filter >> static_user_filter >> (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to >> context static >> 2011-08-11 15:25:39,128 INFO org.apache.hadoop.http.HttpServer: Added filter >> static_user_filter >> (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to >> context logs >> 2011-08-11 15:25:39,131 INFO org.apache.hadoop.http.HttpServer: Added global >> filter 'guice' (class=com.google.inject.servlet.GuiceFilter) >> 2011-08-11 15:25:39,131 INFO org.apache.hadoop.http.HttpServer: Port >> returned by webServer.getConnectors()[0].getLocalPort() before open() is -1. >> Opening the listener on 8088 >> 2011-08-11 15:25:39,136 INFO org.apache.hadoop.http.HttpServer: >> listener.getLocalPort() returned 8088 >> webServer.getConnectors()[0].getLocalPort() returned 8088 >> 2011-08-11 15:25:39,136 INFO org.apache.hadoop.http.HttpServer: Jetty bound >> to port 8088 >> 2011-08-11 15:25:39,136 INFO org.mortbay.log: jetty-6.1.26 >> 2011-08-11 15:25:39,160 INFO org.mortbay.log: Extract >> jar:file:/home/haoyuan/hadoop/trunk/hadoop-mapreduce-1.0-SNAPSHOT/modules/yarn-common-1.0-SNAPSHOT.jar!/webapps/yarn >> to /tmp/Jetty_0_0_0_0_8088_yarn____yzuv81/webapp >> 2011-08-11 15:25:39,238 INFO org.mortbay.log: NO JSP Support for /, did not >> find org.apache.jasper.servlet.JspServlet >> 2011-08-11 15:25:39,319 INFO org.mortbay.log: Started >> SelectChannelConnector@0.0.0.0:8088 >> 2011-08-11 15:25:39,320 INFO org.apache.hadoop.yarn.webapp.WebApps: Web app >> /yarn started at 8088 >> 2011-08-11 15:25:39,568 INFO org.apache.hadoop.yarn.webapp.WebApps: >> Registered webapp guice modules >> 2011-08-11 15:25:39,589 WARN org.apache.hadoop.metrics2.impl.MetricsConfig: >> Cannot locate configuration: tried >> hadoop-metrics2-resourcemanager.properties,hadoop-metrics2.properties >> 2011-08-11 15:25:39,626 INFO >> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period >> at 10 second(s). >> 2011-08-11 15:25:39,626 INFO >> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: ResourceManager metrics >> system started >> 2011-08-11 15:25:39,627 INFO >> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Registered source >> QueueMetrics,q0=default >> 2011-08-11 15:25:39,627 INFO >> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Registered source >> UgiMetrics >> 2011-08-11 15:25:39,628 INFO org.apache.hadoop.yarn.service.AbstractService: >> Service:Dispatcher is started. >> 2011-08-11 15:25:39,629 INFO org.apache.hadoop.yarn.service.AbstractService: >> Service:org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.ContainerAllocationExpirer >> is started. >> 2011-08-11 15:25:39,629 INFO org.apache.hadoop.yarn.service.AbstractService: >> Service:AMLivelinessMonitor is started. >> 2011-08-11 15:25:39,629 INFO org.apache.hadoop.yarn.service.AbstractService: >> Service:org.apache.hadoop.yarn.server.resourcemanager.NodesListManager is >> started. >> 2011-08-11 15:25:39,629 INFO org.apache.hadoop.yarn.service.AbstractService: >> Service:org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$SchedulerEventDispatcher >> is started. >> 2011-08-11 15:25:39,629 INFO org.apache.hadoop.yarn.service.AbstractService: >> Service:NMLivelinessMonitor is started. >> 2011-08-11 15:25:39,629 INFO org.apache.hadoop.yarn.service.AbstractService: >> Service:org.apache.hadoop.yarn.server.resourcemanager.ResourceTrackerService >> is started. >> 2011-08-11 15:25:39,630 INFO org.apache.hadoop.yarn.ipc.YarnRPC: Creating >> YarnRPC for null >> 2011-08-11 15:25:39,631 INFO org.apache.hadoop.yarn.ipc.HadoopYarnRPC: >> Creating a HadoopYarnProtoRpc server for protocol interface >> org.apache.hadoop.yarn.server.api.ResourceTracker with 10 handlers >> 2011-08-11 15:25:39,631 INFO org.apache.hadoop.yarn.ipc.HadoopYarnRPC: >> Configured SecurityInfo class name is >> org.apache.hadoop.yarn.server.RMNMSecurityInfoClass >> 2011-08-11 15:25:44,651 INFO org.apache.hadoop.ipc.Server: Starting Socket >> Reader #1 for port 8025 >> 2011-08-11 15:25:44,663 INFO >> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Registered source >> RpcActivityForPort8025 >> 2011-08-11 15:25:44,668 INFO >> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Registered source >> RpcDetailedActivityForPort8025 >> 2011-08-11 15:25:44,670 ERROR >> org.apache.hadoop.yarn.service.CompositeService: Error starting services >> ResourceManager >> java.lang.NoSuchMethodError: org.apache.avro.ipc.Server.start()V >> at >> org.apache.hadoop.yarn.server.resourcemanager.ResourceTrackerService.start(ResourceTrackerService.java:128) >> at >> org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:68) >> at >> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.start(ResourceManager.java:392) >> at >> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:491) >> 2011-08-11 15:25:44,670 INFO org.apache.hadoop.yarn.service.AbstractService: >> Service:NMLivelinessMonitor is stopped. >> 2011-08-11 15:25:44,671 INFO >> org.apache.hadoop.yarn.util.AbstractLivelinessMonitor: NMLivelinessMonitor >> thread interrupted >> 2011-08-11 15:25:44,671 ERROR >> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Returning, >> interrupted : java.lang.InterruptedException >> 2011-08-11 15:25:44,671 INFO org.apache.hadoop.yarn.service.AbstractService: >> Service:org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$SchedulerEventDispatcher >> is stopped. >> 2011-08-11 15:25:44,671 INFO org.apache.hadoop.yarn.service.AbstractService: >> Service:org.apache.hadoop.yarn.server.resourcemanager.NodesListManager is >> stopped. >> 2011-08-11 15:25:44,671 INFO org.apache.hadoop.yarn.service.AbstractService: >> Service:AMLivelinessMonitor is stopped. >> 2011-08-11 15:25:44,671 INFO org.apache.hadoop.yarn.service.AbstractService: >> Service:org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.ContainerAllocationExpirer >> is stopped. >> 2011-08-11 15:25:44,671 INFO >> org.apache.hadoop.yarn.util.AbstractLivelinessMonitor: AMLivelinessMonitor >> thread interrupted >> 2011-08-11 15:25:44,671 INFO >> org.apache.hadoop.yarn.util.AbstractLivelinessMonitor: >> org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.ContainerAllocationExpirer >> thread interrupted >> 2011-08-11 15:25:44,671 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: >> AsyncDispatcher thread interrupted >> java.lang.InterruptedException >> at >> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:1961) >> at >> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1996) >> at >> java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399) >> at >> org.apache.hadoop.yarn.event.AsyncDispatcher$1.run(AsyncDispatcher.java:69) >> at java.lang.Thread.run(Thread.java:662) >> 2011-08-11 15:25:44,672 INFO org.apache.hadoop.yarn.service.AbstractService: >> Service:Dispatcher is stopped. >> 2011-08-11 15:25:44,672 ERROR >> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Error >> starting RM >> org.apache.hadoop.yarn.YarnException: Failed to Start ResourceManager >> at >> org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:80) >> at >> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.start(ResourceManager.java:392) >> at >> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:491) >> Caused by: java.lang.NoSuchMethodError: org.apache.avro.ipc.Server.start()V >> at >> org.apache.hadoop.yarn.server.resourcemanager.ResourceTrackerService.start(ResourceTrackerService.java:128) >> at >> org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:68) >> ... 2 more >> 2011-08-11 15:25:44,673 INFO org.mortbay.log: Stopped >> SelectChannelConnector@0.0.0.0:8088 >> 2011-08-11 15:25:44,775 INFO >> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Stopping ResourceManager >> metrics system... >> 2011-08-11 15:25:44,776 INFO >> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Stopping metrics source >> QueueMetrics,q0=default >> 2011-08-11 15:25:44,776 INFO >> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Stopping metrics source >> UgiMetrics >> 2011-08-11 15:25:44,776 INFO >> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Stopping metrics source >> RpcActivityForPort8025 >> 2011-08-11 15:25:44,776 INFO >> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Stopping metrics source >> RpcDetailedActivityForPort8025 >> 2011-08-11 15:25:44,777 INFO >> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: ResourceManager metrics >> system stopped. >> 2011-08-11 15:25:44,777 INFO >> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: ResourceManager metrics >> system shutdown complete. >> ===================================================== >> On Thu, Aug 11, 2011 at 2:07 PM, Mahadev Konar <maha...@hortonworks.com> >> wrote: >>> >>> Matei, >>> Are you sure you are using the latest common from trunk? The ClientCache >>> was recently added within the last few weeks. >>> Looks like its using some old version of hadoop common. >>> >>> Also the sl4j errors should be fixed in the latest MR-279 branch. >>> >>> thanks >>> mahadev >>> >>> On Aug 11, 2011, at 1:52 PM, Matei Zaharia wrote: >>> >>>> I get a similar error on Mac OS X. I've built YARN and extracted the >>>> tarball to a directory, but when I run bin/yarn-daemon.sh start >>>> nodemanager, >>>> it prints the following to its log (apologies for the long trace): >>>> >>>> log4j:WARN No appenders could be found for logger >>>> (org.apache.hadoop.metrics2.impl.MetricsSystemImpl). >>>> log4j:WARN Please initialize the log4j system properly. >>>> log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for >>>> more info. >>>> Exception in thread "main" org.apache.hadoop.yarn.YarnException: Failed >>>> to Start org.apache.hadoop.yarn.server.nodemanager.NodeManager >>>> at >>>> org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:80) >>>> at >>>> org.apache.hadoop.yarn.server.nodemanager.NodeManager.start(NodeManager.java:146) >>>> at >>>> org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:191) >>>> Caused by: org.apache.avro.AvroRuntimeException: >>>> org.apache.hadoop.yarn.YarnException: >>>> java.lang.reflect.InvocationTargetException >>>> at >>>> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.start(NodeStatusUpdaterImpl.java:140) >>>> at >>>> org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:68) >>>> ... 2 more >>>> Caused by: org.apache.hadoop.yarn.YarnException: >>>> java.lang.reflect.InvocationTargetException >>>> at >>>> org.apache.hadoop.yarn.factories.impl.pb.RpcClientFactoryPBImpl.getClient(RpcClientFactoryPBImpl.java:70) >>>> at >>>> org.apache.hadoop.yarn.ipc.HadoopYarnProtoRPC.getProxy(HadoopYarnProtoRPC.java:35) >>>> at >>>> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.getRMClient(NodeStatusUpdaterImpl.java:158) >>>> at >>>> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.registerWithRM(NodeStatusUpdaterImpl.java:163) >>>> at >>>> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.start(NodeStatusUpdaterImpl.java:136) >>>> ... 3 more >>>> Caused by: java.lang.reflect.InvocationTargetException >>>> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native >>>> Method) >>>> at >>>> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39) >>>> at >>>> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27) >>>> at java.lang.reflect.Constructor.newInstance(Constructor.java:513) >>>> at >>>> org.apache.hadoop.yarn.factories.impl.pb.RpcClientFactoryPBImpl.getClient(RpcClientFactoryPBImpl.java:67) >>>> ... 7 more >>>> Caused by: java.lang.NoClassDefFoundError: >>>> org/apache/hadoop/ipc/ClientCache >>>> at >>>> org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine.<clinit>(ProtoOverHadoopRpcEngine.java:63) >>>> at java.lang.Class.forName0(Native Method) >>>> at java.lang.Class.forName(Class.java:247) >>>> at >>>> org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:1108) >>>> at >>>> org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1160) >>>> at org.apache.hadoop.ipc.RPC.getProtocolEngine(RPC.java:94) >>>> at org.apache.hadoop.ipc.RPC.getProtocolProxy(RPC.java:422) >>>> at org.apache.hadoop.ipc.RPC.getProtocolProxy(RPC.java:368) >>>> at org.apache.hadoop.ipc.RPC.getProtocolProxy(RPC.java:333) >>>> at org.apache.hadoop.ipc.RPC.getProtocolProxy(RPC.java:461) >>>> at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:442) >>>> at >>>> org.apache.hadoop.yarn.server.api.impl.pb.client.ResourceTrackerPBClientImpl.<init>(ResourceTrackerPBClientImpl.java:32) >>>> ... 12 more >>>> Caused by: java.lang.ClassNotFoundException: >>>> org.apache.hadoop.ipc.ClientCache >>>> at java.net.URLClassLoader$1.run(URLClassLoader.java:202) >>>> at java.security.AccessController.doPrivileged(Native Method) >>>> at java.net.URLClassLoader.findClass(URLClassLoader.java:190) >>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:306) >>>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) >>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:247) >>>> ... 24 more >>>> >>>> In addition, if I try to start resourcemanager instead, it logs: >>>> >>>> SLF4J: Class path contains multiple SLF4J bindings. >>>> SLF4J: Found binding in >>>> [jar:file:/Users/matei/workspace/MR-279/common/build/ivy/lib/Hadoop-Common/common/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] >>>> SLF4J: Found binding in >>>> [jar:file:/Users/matei/workspace/MR-279-deploy/hadoop-mapreduce-1.0-SNAPSHOT/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] >>>> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an >>>> explanation. >>>> log4j:WARN No appenders could be found for logger >>>> (org.apache.hadoop.metrics2.lib.MutableMetricsFactory). >>>> log4j:WARN Please initialize the log4j system properly. >>>> log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for >>>> more info. >>>> Exception in thread "main" java.lang.IllegalStateException: For this >>>> operation, current State must be STARTED instead of INITED >>>> at >>>> org.apache.hadoop.yarn.service.AbstractService.ensureCurrentState(AbstractService.java:101) >>>> at >>>> org.apache.hadoop.yarn.service.AbstractService.stop(AbstractService.java:69) >>>> at >>>> org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher.stop(ApplicationMasterLauncher.java:90) >>>> at >>>> org.apache.hadoop.yarn.service.CompositeService.stop(CompositeService.java:89) >>>> at >>>> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.stop(ResourceManager.java:423) >>>> at >>>> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:493) >>>> >>>> I don't know where the multiple SLF4J versions are coming from because I >>>> checked out common, hdfs and mapreduce at the same time. >>>> >>>> Matei >>>> >>>> >>>> >>>> >>>> On Aug 11, 2011, at 2:01 AM, Vinod KV wrote: >>>> >>>>> >>>>> >>>>> Report YARN_* and HADOOP_* variables that you've set before starting >>>>> the daemons. >>>>> >>>>> Also run 'bin/yarn classpath' and post the output of that command too. >>>>> If the output doesn't contain >>>>> yarn-server-resourcemanager-1.0-SNAPSHOT.jar, >>>>> you are missing something. >>>>> >>>>> +Vinod >>>>> >>>>> >>>>> On Thursday 11 August 2011 01:57 AM, Haoyuan Li wrote: >>>>>> Hi, >>>>>> >>>>>> When I ran ResourceManager or NodeManager as steps here >>>>>> >>>>>> http://svn.apache.org/repos/asf/hadoop/common/branches/MR-279/mapreduce/INSTALL >>>>>> . >>>>>> It has main class can't be found exception... I attached the shell >>>>>> output >>>>>> here. Any help will be appreciated! >>>>>> >>>>>> Thanks, >>>>>> >>>>>> Haoyuan >>>>>> >>>>>> haoyuan@hya:~/hadoop/hadoop-mapreduce-1.0-SNAPSHOT$ >>>>>> ./bin/yarn-daemon.sh >>>>>> start resourcemanager >>>>>> starting resourcemanager, logging to >>>>>> >>>>>> /home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../logs/yarn-haoyuan-resourcemanager-hya.out >>>>>> /usr/lib/jvm/java-6-sun/bin/java -Dproc_resourcemanager -Xmx1000m >>>>>> >>>>>> -Dhadoop.log.dir=/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../logs >>>>>> >>>>>> -Dyarn.log.dir=/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../logs >>>>>> -Dhadoop.log.file=yarn-haoyuan-resourcemanager-hya.log >>>>>> -Dyarn.log.file=yarn-haoyuan-resourcemanager-hya.log -Dyarn.home.dir= >>>>>> -Dyarn.id.str=haoyuan -Dhadoop.root.logger=INFO,DRFA >>>>>> -Dyarn.root.logger=INFO,DRFA -Dyarn.policy.file=hadoop-policy.xml >>>>>> >>>>>> -Dhadoop.log.dir=/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../logs >>>>>> >>>>>> -Dyarn.log.dir=/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../logs >>>>>> -Dhadoop.log.file=yarn-haoyuan-resourcemanager-hya.log >>>>>> -Dyarn.log.file=yarn-haoyuan-resourcemanager-hya.log >>>>>> >>>>>> -Dyarn.home.dir=/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/.. >>>>>> -Dhadoop.root.logger=INFO,DRFA -Dyarn.root.logger=INFO,DRFA -classpath >>>>>> >>>>>> /home/haoyuan/hadoop/conf:/home/haoyuan/hadoop/conf:/usr/lib/jvm/java-6-sun/lib/tools.jar:/home/haoyuan/hadoop/trunk/common/hadoop-*.jar:/home/haoyuan/hadoop/trunk/common/lib/*.jar:/home/haoyuan/hadoop/trunk/common/share/hadoop/common/*.jar:/home/haoyuan/hadoop/trunk/common/share/hadoop/common/lib/*.jar:/home/haoyuan/hadoop/trunk/common/share/hadoop/hdfs/*.jar:/home/haoyuan/hadoop/trunk/hdfs/hadoop-*.jar:/home/haoyuan/hadoop/trunk/hdfs/lib/*.jar:/home/haoyuan/hadoop/trunk/hdfs/build/classes:/home/haoyuan/hadoop/trunk/hdfs/hadoop-*.jar:/home/haoyuan/hadoop/trunk/hdfs/lib/*.jar:/home/haoyuan/hadoop/trunk/mapreduce/build/classes:/home/haoyuan/hadoop/trunk/mapreduce/build:/home/haoyuan/hadoop/trunk/mapreduce/build/test/classes:/home/haoyuan/hadoop/trunk/mapreduce/build/tools:/home/haoyuan/hadoop/trunk/mapreduce/lib/*.jar:/home/haoyuan/hadoop/trunk/mapreduce/*.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/aopalliance-1.0.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/asm-3.2.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/aspectjrt-1.6.5.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/avro-1.3.2.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/avro-1.4.1.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/clover-3.0.2.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/commons-beanutils-1.7.0.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/commons-beanutils-core-1.8.0.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/commons-cli-1.2.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/commons-codec-1.4.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/commons-collections-3.2.1.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/commons-configuration-1.6.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/commons-digester-1.8.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/commons-httpclient-3.1.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/commons-lang-2.5.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/commons-logging-1.0.4.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/commons-logging-api-1.0.4.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/commons-math-2.1.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/commons-net-1.4.1.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/core-3.1.1.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/guava-r09.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/guice-2.0.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/guice-servlet-2.0.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/hadoop-annotations-0.23.0-SNAPSHOT.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/jackson-core-asl-1.4.2.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/jackson-mapper-asl-1.4.2.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/jdiff-1.0.9.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/jets3t-0.6.1.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/jetty-6.1.26.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/jetty-util-6.1.26.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/jsp-api-2.1.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/junit-4.8.2.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/kfs-0.3.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/log4j-1.2.15.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/netty-3.2.3.Final.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/oro-2.0.8.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/paranamer-2.2.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/paranamer-ant-2.2.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/paranamer-generator-2.2.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/protobuf-java-2.4.0a.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/qdox-1.10.1.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/servlet-api-2.5.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/slf4j-api-1.6.1.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/slf4j-log4j12-1.6.1.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/xmlenc-0.52.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../modules/hadoop-mapreduce-client-app-1.0-SNAPSHOT.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../modules/hadoop-mapreduce-client-common-1.0-SNAPSHOT.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../modules/hadoop-mapreduce-client-core-1.0-SNAPSHOT.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../modules/hadoop-mapreduce-client-hs-1.0-SNAPSHOT.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../modules/hadoop-mapreduce-client-jobclient-1.0-SNAPSHOT.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../modules/hadoop-mapreduce-client-shuffle-1.0-SNAPSHOT.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../modules/yarn-api-1.0-SNAPSHOT.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../modules/yarn-common-1.0-SNAPSHOT.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../modules/yarn-server-common-1.0-SNAPSHOT.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../modules/yarn-server-nodemanager-1.0-SNAPSHOT.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../modules/yarn-server-resourcemanager-1.0-SNAPSHOT.jar:/home/haoyuan/hadoop/conf/rm-config/log4j.properties >>>>>> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager >>>>>> Exception in thread "main" java.lang.NoClassDefFoundError: >>>>>> org/apache/hadoop/conf/Configuration >>>>>> Caused by: java.lang.ClassNotFoundException: >>>>>> org.apache.hadoop.conf.Configuration >>>>>> at java.net.URLClassLoader$1.run(URLClassLoader.java:202) >>>>>> at java.security.AccessController.doPrivileged(Native Method) >>>>>> at java.net.URLClassLoader.findClass(URLClassLoader.java:190) >>>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:306) >>>>>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) >>>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:247) >>>>>> Could not find the main class: >>>>>> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager. >>>>>> Program will >>>>>> exit. >>>>>> >>>>> >>>>> >>>> >>> >> >>
