A single RM per-node. It seems the second RM to start is the one that
registers the Myriad-Alpha framework with Mesos. But both RM's are still
in standby state - when I activate one RM, then I get the error, but the
Mesos framework still show the other as the location of the framework.
It goes something like Š
Start rm1
Start rm2 -> rm2 registers the myriad framework
Both RM's are in standby
rm1 standby
rm2 standby
rm1 - to active - Get the errorŠ
yarn rmadmin -transitionToActive rm1
Operation failed: Error when transitioning to Active mode
at
org.apache.hadoop.yarn.server.resourcemanager.AdminService.transitionToActi
ve(AdminService.java:304)
at
org.apache.hadoop.ha.protocolPB.HAServiceProtocolServerSideTranslatorPB.tra
nsitionToActive(HAServiceProtocolServerSideTranslatorPB.java:107)
at
org.apache.hadoop.ha.proto.HAServiceProtocolProtos$HAServiceProtocolService
$2.callBlockingMethod(HAServiceProtocolProtos.java:4460)
at
org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(Prot
obufRpcEngine.java:619)
at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:962)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2039)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2035)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.j
ava:1628)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2033)
Caused by: org.apache.hadoop.ha.ServiceFailedException: Failed to
initialize myriad
at
org.apache.hadoop.yarn.server.resourcemanager.AdminService.refreshAll(Admin
Service.java:626)
at
org.apache.hadoop.yarn.server.resourcemanager.AdminService.transitionToActi
ve(AdminService.java:297)
... 10 more
--
Jonathan (Bill) Sparks
Software Architecture
Cray Inc.
On 6/22/15 3:05 PM, "Santosh Marella" <smare...@maprtech.com> wrote:
>The cause for the exception shows "Address already in use". And looks like
>the 'address" in question is the webserver for Myriad.
>
>Can you please check if you are spinning up two ResourceManagers on the
>same node? That's currently not supported.
>
>Santosh
>
>On Mon, Jun 22, 2015 at 12:48 PM, Bill Sparks <jspa...@cray.com> wrote:
>
>> I thought I'd ask before diving into it more, but is YARN HA
>> ResourceManager and myriad/mesos supported?
>>
>> The reason why I ask, is that I just brought up YARN HA
>>ResourceManager(s)
>> and the resourcemanager fails to start and the stack trace has myriad
>>on it.
>>
>> 15/06/22 13:17:47 INFO service.AbstractService: Service
>>
>>org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairSchedule
>>r
>> failed in state INITED; cause: java.lang.RuntimeException: Failed to
>> initialize myriad
>> java.lang.RuntimeException: Failed to initialize myriad
>> at
>>
>>com.ebay.myriad.scheduler.yarn.interceptor.MyriadInitializationIntercepto
>>r.init(MyriadInitializationInterceptor.java:34)
>> at
>>
>>com.ebay.myriad.scheduler.yarn.interceptor.CompositeInterceptor.init(Comp
>>ositeInterceptor.java:63)
>> at
>>
>>com.ebay.myriad.scheduler.yarn.MyriadFairScheduler.serviceInit(MyriadFair
>>Scheduler.java:37)
>> at
>>org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
>> at
>>
>>org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.j
>>ava:107)
>> at
>>
>>org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$RMActiveSer
>>vices.serviceInit(ResourceManager.java:573)
>> at
>>org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
>> at
>>
>>org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.createAndIn
>>itActiveServices(ResourceManager.java:1004)
>> at
>>
>>org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceInit
>>(ResourceManager.java:270)
>> at
>>org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
>> at
>>
>>org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(Resour
>>ceManager.java:1225)
>> Caused by: java.net.BindException: Address already in use
>> at sun.nio.ch.Net.bind0(Native Method)
>> at sun.nio.ch.Net.bind(Net.java:344)
>> at sun.nio.ch.Net.bind(Net.java:336)
>> at
>>
>>sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:199)
>> at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)
>> at
>>
>>org.mortbay.jetty.nio.SelectChannelConnector.open(SelectChannelConnector.
>>java:216)
>> at
>>
>>org.mortbay.jetty.nio.SelectChannelConnector.doStart(SelectChannelConnect
>>or.java:315)
>> at
>>org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
>> at org.mortbay.jetty.Server.doStart(Server.java:235)
>> at
>>org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
>> at com.ebay.myriad.webapp.MyriadWebServer.start(MyriadWebServer.java:50)
>> at com.ebay.myriad.Main.initWebApp(Main.java:109)
>> at com.ebay.myriad.Main.run(Main.java:86)
>> at com.ebay.myriad.Main.initialize(Main.java:68)
>> at
>>
>>com.ebay.myriad.scheduler.yarn.interceptor.MyriadInitializationIntercepto
>>r.init(MyriadInitializationInterceptor.java:31)
>> ... 10 more
>>
>> --
>> Jonathan (Bill) Sparks
>> Software Architecture
>> Cray Inc.
>>
