Most likely this: https://issues.apache.org/jira/browse/CLOUDSTACK-6893
I'm not aware of a manual workaround, perhaps someone else is.
--
Erik
On Wed, Aug 27, 2014 at 11:12 AM, Ugo Vasi <ugo.v...@procne.it> wrote:
> Hi all,
> we are trying to upgrade a cloustack 4.3 installation to a 4.4 version.
> Manager and agents (and ssvm and cpvm) runs in a new version and seems to
> be OK but virtual routers are still 4.3.0.
>
> I tried to reboot a router but this does not restart it gives me these
> error messages:
>
> ...
> 2014-08-27 10:50:01,328 DEBUG [c.c.a.t.Request]
> (AgentManager-Handler-5:null) Seq 1-7961519716260912076: Processing: {
> Ans: , MgmtId: 240206110326297, via: 1, Ver: v1, Flags: 10,
> [{"com.cloud.agent.api.Answer":{"result":false,"details":"No enum
> constant com.cloud.hypervisor.kvm.resource.LibvirtVMDef.DiskDef.
> diskCacheMode.none","wait":0}},{"com.cloud.agent.api.Answer"
> :{"result":false,"details":"Stopped by previous failure","wait":0}},{"com.
> cloud.agent.api.Answer":{"result":false,"details":"Stopped by previous
> failure","wait":0}},{"com.cloud.agent.api.Answer":{"
> result":false,"details":"Stopped by previous failure","wait":0}},{"com.
> cloud.agent.api.Answer":{"result":false,"details":"Stopped by previous
> failure","wait":0}},{"com.cloud.agent.api.Answer":{"
> result":false,"details":"Stopped by previous failure","wait":0}},{"com.
> cloud.agent.api.Answer":{"result":false,"details":"Stopped by previous
> failure","wait":0}},{"com.cloud.agent.api.Answer":{"
> result":false,"details":"Stopped by previous failure","wait":0}},{"com.
> cloud.agent.api.Answer":{"result":false,"details":"Stopped by previous
> failure","wait":0}},{"com.cloud.agent.api.Answer":{"
> result":false,"details":"Stopped by previous failure","wait":0}},{"com.
> cloud.agent.api.Answer":{"result":false,"details":"Stopped by previous
> failure","wait":0}},{"com.cloud.agent.api.Answer":{"
> result":false,"details":"Stopped by previous failure","wait":0}},{"com.
> cloud.agent.api.Answer":{"result":false,"details":"Stopped by previous
> failure","wait":0}}] }
> 2014-08-27 10:50:01,328 DEBUG [c.c.a.t.Request]
> (Work-Job-Executor-13:ctx-3a10ee96
> job-120/job-121 ctx-2cd18d35) Seq 1-7961519716260912076: Received: { Ans: ,
> MgmtId: 240206110326297, via: 1, Ver: v1, Flags: 10, { Answer, Answer,
> Answer, Answer, Answer, Answer, Answer, Answer, Answer, Answer, Answer,
> Answer, Answer } }
> 2014-08-27 10:50:01,367 ERROR [c.c.v.VirtualMachineManagerImpl]
> (Work-Job-Executor-13:ctx-3a10ee96 job-120/job-121 ctx-2cd18d35) Failed
> to start instance VM[DomainRouter|r-12-VM]
> com.cloud.utils.exception.CloudRuntimeException: Unable to get answer
> that is of class com.cloud.agent.api.StartAnswer
> at com.cloud.agent.manager.Commands.getAnswer(Commands.java:80)
> at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(
> VirtualMachineManagerImpl.java:1019)
> at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(
> VirtualMachineManagerImpl.java:5190)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> ...
>
> 2014-08-27 10:50:01,829 DEBUG [c.c.c.CapacityManagerImpl]
> (Work-Job-Executor-13:ctx-3a10ee96 job-120/job-121 ctx-2cd18d35) release
> mem from host: 1, old used: 2952790016,reserved: 0, total: 50640633856; new
> used: 2818572288,reserved:0; movedfromreserved: false,moveToReserveredfalse
> 2014-08-27 10:50:01,865 ERROR [c.c.v.VmWorkJobHandlerProxy]
> (Work-Job-Executor-13:ctx-3a10ee96 job-120/job-121 ctx-2cd18d35)
> Invocation exception, caused by:
> com.cloud.exception.AgentUnavailableException:
> Resource [Host:1] is unreachable: Host 1: Unable to start instance due to
> Unable to get answer that is of class com.cloud.agent.api.StartAnswer
> 2014-08-27 10:50:01,866 INFO [c.c.v.VmWorkJobHandlerProxy]
> (Work-Job-Executor-13:ctx-3a10ee96 job-120/job-121 ctx-2cd18d35) Rethrow
> exception com.cloud.exception.AgentUnavailableException: Resource
> [Host:1] is unreachable: Host 1: Unable to start instance due to Unable to
> get answer that is of class com.cloud.agent.api.StartAnswer
> 2014-08-27 10:50:01,866 DEBUG [c.c.v.VmWorkJobDispatcher]
> (Work-Job-Executor-13:ctx-3a10ee96 job-120/job-121) Done with run of VM
> work job: com.cloud.vm.VmWorkStart for VM 12, job origin: 120
> 2014-08-27 10:50:01,867 ERROR [c.c.v.VmWorkJobDispatcher]
> (Work-Job-Executor-13:ctx-3a10ee96 job-120/job-121) Unable to complete
> AsyncJobVO {id:121, userId: 2, accountId: 2, instanceType: null,
> instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo:
> rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oA
> BGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50
> UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5n
> L0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYX
> ZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-
> AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS
> 91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-
> ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-
> AAN4cAAAAAAAAAACAAAAAAAAAAIAAAAAAAAADHQAGVZpcnR1YWxNYWNoaW5l
> TWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwc3IAEWphdmEudXRpbC5IYXNo
> TWFwBQfawcMWYNEDAAJGAApsb2FkRmFjdG9ySQAJdGhyZXNob2xkeHA_
> QAAAAAAADHcIAAAAEAAAAAF0AA5SZXN0YXJ0TmV0d29ya3QAP3JPMEFCWE55
> QUJGcVlYWmhMbXhoYm1jdVFtOXZiR1ZoYnMwZ2NvRFZuUHJ1QWdBQldnQUZkbUZzZFdWNGNBRXhw,
> cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0,
> result: null, initMsid: 240206110326297, completeMsid: null, lastUpdated:
> null, lastPolled: null, created: Wed Aug 27 10:49:59 CEST 2014}, job
> origin:120
> com.cloud.exception.AgentUnavailableException: Resource [Host:1] is
> unreachable: Host 1: Unable to start instance due to Unable to get answer
> that is of class com.cloud.agent.api.StartAnswer
> at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(
> VirtualMachineManagerImpl.java:1105)
> at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(
> VirtualMachineManagerImpl.java:5190)
> ....
>
> I tried to destroy the router but the new one fails to start in the same
> way.
>
> The other router (4.3.0 version) is still working but I have not tried to
> restart it.
>
> Of course the vmon the network with the router ko can not get out of the
> network.
>
> Management run on ubuntu 12.04, Agents run on ubuntu 14.04. In another
> similar installation of cloudstack 4.3 it's all quite ok (I found a problem
> with a guest network, see 'Unable to start a VM due to insufficient
> capacity' precedent mailing list messages).
>
> --
>
> U g o V a s i <ugo.v...@procne.it>
> P r o c n e s.r.l >)
> via Cotonificio 45 33010 Tavagnacco IT
> phone: +390432486523 fax: +390432486523
>
> Le informazioni contenute in questo messaggio sono riservate e
> confidenziali ed è vietata la diffusione in qualunque modo eseguita.
> Qualora Lei non fosse la persona a cui il presente messaggio è
> destinato, La invitiamo ad eliminarlo e a non leggerlo, dandocene
> gentilmente comunicazione.
> Per qualsiasi informazione si prega di contattare supp...@procne.it .
> Rif. D.L. 196/2003
>
>
