<property>
<name>yarn.scheduler.capacity.resource-calculator</name>
<value>org.apache.hadoop.yarn.util.resource.DefaultResourceCalculator</value>
<description>
The ResourceCalculator implementation to be used to compare
Resources in the scheduler.
The default i.e. DefaultResourceCalculator only uses Memory while
DominantResourceCalculator uses dominant-resource to compare
multi-dimensional resources such as Memory, CPU etc.
</description>
</property>
inside capacity-scheduler.xml
Thanks,
Omkar Joshi
*Hortonworks Inc.* <http://www.hortonworks.com>
On Mon, Nov 18, 2013 at 5:34 PM, YouPeng Yang <yypvsxf19870...@gmail.com>wrote:
> Hi
> It does not work.
> I do not find the yarn.scheduler.capacity.resource-calculator
> property in the
> hadoop-2.2.0/share/doc/hadoop/hadoop-yarn/hadoop-yarn-common/yarn-default.xml.
> Is it the right property?
>
> Anyone could give me any suggestion about the exception?
>
>
> 2013/11/15 Rob Blah <tmp5...@gmail.com>
>
>> "Can you check the config entry for yarn.scheduler.capacity.resource-
>> calculator ?
>> It should point to org.apache.hadoop.yarn.util.resource.
>> DefaultResourceCalculator"
>>
>> Answer provided by Ted Yu in thread "DefaultResourceCalculator class not
>> found, ResourceManager fails to start."
>>
>> regards
>>
>>
>>
>> 2013/11/15 YouPeng Yang <yypvsxf19870...@gmail.com>
>>
>>>
>>> Hi all
>>>
>>> It‘s wierd to failed to start my yarn resourcemanager with an
>>> exception[1].
>>>
>>> I aslo do some google, someone also encountered this problem with no
>>> solved answer.
>>> I check the src ,there is actually no the DefaultResourceCalculator
>>> in
>>> package :org.apache.hadoop.yarn.server.resourcemanager.resource,however
>>> I found the DefaultResourceCalculator in
>>> org.apache.hadoop.yarn.util.resource
>>>
>>> why we miss the class?
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> [1]-------------------------------------------------------------------------------------------------------------
>>> 2013-11-15 17:41:46,755 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
>>> hadoop-metrics2.properties
>>> 2013-11-15 17:41:46,876 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
>>> period at 10 second(s).
>>> 2013-11-15 17:41:46,877 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: ResourceManager metrics
>>> system started
>>> 2013-11-15 17:41:47,013 INFO org.apache.hadoop.service.AbstractService:
>>> Service ResourceManager failed in state INITED; cause:
>>> java.lang.RuntimeException: java.lang.RuntimeException:
>>> java.lang.ClassNotFoundException: Class
>>> org.apache.hadoop.yarn.server.resourcemanager.resource.DefaultResourceCalculator
>>> not found
>>> java.lang.RuntimeException: java.lang.RuntimeException:
>>> java.lang.ClassNotFoundException: Class
>>> org.apache.hadoop.yarn.server.resourcemanager.resource.DefaultResourceCalculator
>>> not found
>>> at
>>> org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1752)
>>> at
>>> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacitySchedulerConfiguration.getResourceCalculator(CapacitySchedulerConfiguration.java:333)
>>> at
>>> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.reinitialize(CapacityScheduler.java:263)
>>> at
>>> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceInit(ResourceManager.java:249)
>>> at
>>> org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
>>> at
>>> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:871)
>>> Caused by: java.lang.RuntimeException: java.lang.ClassNotFoundException:
>>> Class
>>> org.apache.hadoop.yarn.server.resourcemanager.resource.DefaultResourceCalculator
>>> not found
>>> at
>>> org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1720)
>>> at
>>> org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1744)
>>> ... 5 more
>>> Caused by: java.lang.ClassNotFoundException: Class
>>> org.apache.hadoop.yarn.server.resourcemanager.resource.DefaultResourceCalculator
>>> not found
>>> at
>>> org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:1626)
>>> at
>>> org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1718)
>>> ... 6 more
>>> 2013-11-15 17:41:47,030 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Stopping ResourceManager
>>> metrics system...
>>> 2013-11-15 17:41:47,032 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: ResourceManager metrics
>>> system stopped.
>>> 2013-11-15 17:41:47,032 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: ResourceManager metrics
>>> system shutdown complete.
>>> 2013-11-15 17:41:47,034 FATAL
>>> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Error
>>> starting ResourceManager
>>> java.lang.RuntimeException: java.lang.RuntimeException:
>>> java.lang.ClassNotFoundException: Class
>>> org.apache.hadoop.yarn.server.resourcemanager.resource.DefaultResourceCalculator
>>> not found
>>> at
>>> org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1752)
>>> at
>>> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacitySchedulerConfiguration.getResourceCalculator(CapacitySchedulerConfiguration.java:333)
>>> at
>>> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.reinitialize(CapacityScheduler.java:263)
>>> at
>>> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceInit(ResourceManager.java:249)
>>> at
>>> org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
>>> at
>>> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:871)
>>> Caused by: java.lang.RuntimeException: java.lang.ClassNotFoundException:
>>> Class
>>> org.apache.hadoop.yarn.server.resourcemanager.resource.DefaultResourceCalculator
>>> not found
>>> at
>>> org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1720)
>>> at
>>> org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1744)
>>> ... 5 more
>>> Caused by: java.lang.ClassNotFoundException: Class
>>> org.apache.hadoop.yarn.server.resourcemanager.resource.DefaultResourceCalculator
>>> not found
>>> at
>>> org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:1626)
>>> at
>>> org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1718)
>>> ... 6 more
>>>
>>
>>
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
