Thanks for responding Makrand, This error is occurring as soon as system VM gets downloaded and started and tries to download the CentOS5.5-KVM(No GUI) template. And I have also tried giving other HTTP URLs for registering but still, the PKIX path building error pops up.
I have attached a part of the log, have a look. On Mon, Dec 18, 2017 at 5:29 PM Makrand <makrandsa...@gmail.com> wrote: > Hello Jagdish, > > What is source URL of template you're trying to register? > > And when exactly this error is appearing? Immediately after you try to > register a template? > > > -- > Makrand > > > On Fri, Dec 15, 2017 at 1:01 PM, Jagdish Patil <jagdishpatil...@gmail.com> > wrote: > > > Hey Guys, > > > > I am facing the following issue with this configuration: > > > > *Configuration:* > > CloudStack Version: 4.9 > > OS: CentOS 6.8(X86_64) > > Hypervisor: KVM > > CIDR:24 > > > > *Issue:* > > > > *Failed to register template: 4fe0b968-e02a-11e7-939c-f8a9632f48e1 with > > error: sun.security.validator.ValidatorException: PKIX path building > > failed: sun.security.provider.certpath.SunCertPathBuilderException: > unable > > to find valid certification path to requested target* > > > > There are solutions given by multiple peoples on the internet but none of > > them are helping me. Please help. > > > > Thank You, > > Jagdish Patil, > > (B.Tech-Cloud Based Application: IBM) > > M:8735828606 <087358%2028606> <087358%2028606> > > E:jagdishpatil...@gmail.com > > >
2017-12-13 23:54:08,357 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-1:ctx-50b2a87e job-12/job-16 ctx-ca176482) (logid:1af01289) Publish async job-16 complete on message bus 2017-12-13 23:54:08,357 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-1:ctx-50b2a87e job-12/job-16 ctx-ca176482) (logid:1af01289) Wake up jobs related to job-16 2017-12-13 23:54:08,357 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-1:ctx-50b2a87e job-12/job-16 ctx-ca176482) (logid:1af01289) Update db status for job-16 2017-12-13 23:54:08,359 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-1:ctx-50b2a87e job-12/job-16 ctx-ca176482) (logid:1af01289) Wake up jobs joined with job-16 and disjoin all subjobs created from job- 16 2017-12-13 23:54:08,579 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-1:ctx-50b2a87e job-12/job-16) (logid:1af01289) Done with run of VM work job: com.cloud.vm.VmWorkStart for VM 2, job origin: 12 2017-12-13 23:54:08,579 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-1:ctx-50b2a87e job-12/job-16) (logid:1af01289) Done executing com.cloud.vm.VmWorkStart for job-16 2017-12-13 23:54:08,581 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-1:ctx-50b2a87e job-12/job-16) (logid:1af01289) Remove job-16 from job monitoring 2017-12-13 23:54:08,754 DEBUG [c.c.a.SecondaryStorageVmAlertAdapter] (secstorage-1:ctx-085700c7) (logid:208be3b0) received secondary storage vm alert 2017-12-13 23:54:08,755 DEBUG [c.c.a.SecondaryStorageVmAlertAdapter] (secstorage-1:ctx-085700c7) (logid:208be3b0) Secondary Storage Vm is up, zone: Zone1, secStorageVm: s-2-VM, public IP: 172.16.0.113, private IP: 172.16.0.110 2017-12-13 23:54:08,756 WARN [o.a.c.alerts] (secstorage-1:ctx-085700c7) (logid:208be3b0) alertType:: 19 // dataCenterId:: 1 // podId:: 1 // clusterId:: null // message:: Secondary Storage Vm up in zone: Zone1, secStorageVm: s-2-VM, public IP: 172.16.0.113, private IP: 172.16.0.110 2017-12-13 23:54:08,993 INFO [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-085700c7) (logid:208be3b0) Secondary storage vm s-2-VM is started 2017-12-13 23:54:08,993 INFO [o.a.c.s.PremiumSecondaryStorageManagerImpl] (secstorage-1:ctx-085700c7) (logid:208be3b0) Primary secondary storage is not even started, wait until next turn 2017-12-13 23:54:09,016 DEBUG [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-89e6698a) (logid:ef8a2b1d) Zone 1 is ready to launch secondary storage VM 2017-12-13 23:54:09,858 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-754725c3) (logid:17ae7b53) Begin cleanup expired async-jobs 2017-12-13 23:54:09,866 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-754725c3) (logid:17ae7b53) End cleanup expired async-jobs 2017-12-13 23:54:15,371 DEBUG [c.c.a.t.Request] (AgentManager-Handler-2:null) (logid:) Seq -1-0: Scheduling the first command { Cmd , MgmtId: -1, via: -1, Ver: v1, Flags: 101, [{"com.cloud.agent.api.StartupSecondaryStorageCommand":{"type":"SecondaryStorage","dataCenter":"1","pod":"1","guid":"s-2-VM-NfsSecondaryStorageResource","name":"s-2-VM","version":"4.9.3.0","iqn":"NoIqn","publicIpAddress":"172.16.0.113","publicNetmask":"255.255.255.0","publicMacAddress":"06:77:fc:00:00:0c","privateIpAddress":"172.16.0.110","privateMacAddress":"06:e3:0c:00:00:09","privateNetmask":"255.255.255.0","storageIpAddress":"172.16.0.110","storageNetmask":"255.255.255.0","storageMacAddress":"06:e3:0c:00:00:09","resourceName":"NfsSecondaryStorageResource","wait":0}}] } 2017-12-13 23:54:15,373 DEBUG [c.c.a.t.Request] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Seq -1-0: Processing the first command { Cmd , MgmtId: -1, via: -1, Ver: v1, Flags: 101, [{"com.cloud.agent.api.StartupSecondaryStorageCommand":{"type":"SecondaryStorage","dataCenter":"1","pod":"1","guid":"s-2-VM-NfsSecondaryStorageResource","name":"s-2-VM","version":"4.9.3.0","iqn":"NoIqn","publicIpAddress":"172.16.0.113","publicNetmask":"255.255.255.0","publicMacAddress":"06:77:fc:00:00:0c","privateIpAddress":"172.16.0.110","privateMacAddress":"06:e3:0c:00:00:09","privateNetmask":"255.255.255.0","storageIpAddress":"172.16.0.110","storageNetmask":"255.255.255.0","storageMacAddress":"06:e3:0c:00:00:09","resourceName":"NfsSecondaryStorageResource","wait":0}}] } 2017-12-13 23:54:15,380 DEBUG [c.c.r.ResourceManagerImpl] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Dispatching resource state event CREATE_HOST_VO_FOR_CONNECTED to BaremetalDhcpManagerImpl 2017-12-13 23:54:15,380 DEBUG [c.c.r.ResourceManagerImpl] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Dispatching resource state event CREATE_HOST_VO_FOR_CONNECTED to NetworkUsageManagerImpl 2017-12-13 23:54:15,380 DEBUG [c.c.r.ResourceManagerImpl] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Dispatching resource state event CREATE_HOST_VO_FOR_CONNECTED to BaremetalPxeManagerImpl 2017-12-13 23:54:15,380 DEBUG [c.c.r.ResourceManagerImpl] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Dispatching resource state event CREATE_HOST_VO_FOR_CONNECTED to Ovs 2017-12-13 23:54:15,380 DEBUG [c.c.r.ResourceManagerImpl] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Dispatching resource state event CREATE_HOST_VO_FOR_CONNECTED to PaloAltoExternalFirewallElement 2017-12-13 23:54:15,380 DEBUG [c.c.r.ResourceManagerImpl] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Dispatching resource state event CREATE_HOST_VO_FOR_CONNECTED to GloboDnsElement 2017-12-13 23:54:15,380 DEBUG [c.c.r.ResourceManagerImpl] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Dispatching resource state event CREATE_HOST_VO_FOR_CONNECTED to BigSwitchBcfElement 2017-12-13 23:54:15,380 DEBUG [c.c.r.ResourceManagerImpl] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Dispatching resource state event CREATE_HOST_VO_FOR_CONNECTED to KvmServerDiscoverer 2017-12-13 23:54:15,380 DEBUG [c.c.r.ResourceManagerImpl] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Dispatching resource state event CREATE_HOST_VO_FOR_CONNECTED to PremiumSecondaryStorageManagerImpl 2017-12-13 23:54:15,447 WARN [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-3:null) (logid:) Throwing away a request because it came through as the first command on a connect: Seq 0-1: { Cmd , MgmtId: -1, via: 0, Ver: v1, Flags: 11, [{"com.cloud.agent.api.PingStorageCommand":{"changes":{},"hostType":"Storage","hostId":0,"wait":0}}] } 2017-12-13 23:54:15,496 DEBUG [c.c.r.ResourceState] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Resource state update: [id = 2; name = s-2-VM; old state = Enabled; event = InternalCreated; new state = Enabled] 2017-12-13 23:54:15,496 DEBUG [c.c.h.Status] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Transition:[Resource state = Enabled, Agent event = AgentConnected, Host id = 2, name = s-2-VM] 2017-12-13 23:54:15,584 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) create ClusteredAgentAttache for 2 2017-12-13 23:54:15,586 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Sending Connect to listener: XcpServerDiscoverer 2017-12-13 23:54:15,586 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Sending Connect to listener: HypervServerDiscoverer 2017-12-13 23:54:15,586 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Sending Connect to listener: SecondaryStorageListener 2017-12-13 23:54:15,586 INFO [c.c.s.s.SecondaryStorageListener] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Received a host startup notification com.cloud.agent.api.StartupSecondaryStorageCommand 2017-12-13 23:54:15,604 DEBUG [c.c.a.t.Request] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Seq 2-3998070569198157825: Sending { Cmd , MgmtId: 217771979204453, via: 2(s-2-VM), Ver: v1, Flags: 100111, [{"com.cloud.agent.api.SecStorageSetupCommand":{"store":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://172.16.0.101/export/secondary","_role":"Image"}},"secUrl":"nfs://172.16.0.101/export/secondary","postUploadKey":"p1aEfVdoQOG9Bv1FlxtgMU922D27OkmT0v1PZgE6r8jFsKgrp9iedc7Zd7OE3MddC217uA7oHaWP_OGi4a0uwA","wait":0}}] } 2017-12-13 23:54:17,206 DEBUG [c.c.a.t.Request] (AgentManager-Handler-4:null) (logid:) Seq 2-3998070569198157825: Processing: { Ans: , MgmtId: 217771979204453, via: 2, Ver: v1, Flags: 110, [{"com.cloud.agent.api.SecStorageSetupAnswer":{"_dir":"5bd64279-12b2-33b8-bd9c-cda38ebbf606","result":true,"details":"success","wait":0}}] } 2017-12-13 23:54:17,207 DEBUG [c.c.a.m.AgentAttache] (AgentManager-Handler-4:null) (logid:) Seq 2-3998070569198157825: No more commands found 2017-12-13 23:54:17,207 DEBUG [c.c.a.t.Request] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Seq 2-3998070569198157825: Received: { Ans: , MgmtId: 217771979204453, via: 2(s-2-VM), Ver: v1, Flags: 110, { SecStorageSetupAnswer } } 2017-12-13 23:54:17,207 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Details from executing class com.cloud.agent.api.SecStorageSetupCommand: success 2017-12-13 23:54:17,253 DEBUG [o.a.c.s.SecondaryStorageManagerImpl] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Successfully programmed secondary storage nfs://172.16.0.101/export/secondary in secondary storage VM s-2-VM 2017-12-13 23:54:17,266 DEBUG [c.c.a.t.Request] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Seq 2-3998070569198157826: Sending { Cmd , MgmtId: 217771979204453, via: 2(s-2-VM), Ver: v1, Flags: 100011, [{"com.cloud.agent.api.SecStorageFirewallCfgCommand":{"isAppendAIp":false,"wait":0}}] } 2017-12-13 23:54:17,325 DEBUG [c.c.a.t.Request] (AgentManager-Handler-5:null) (logid:) Seq 2-3998070569198157826: Processing: { Ans: , MgmtId: 217771979204453, via: 2, Ver: v1, Flags: 10, [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}}] } 2017-12-13 23:54:17,326 DEBUG [c.c.a.t.Request] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Seq 2-3998070569198157826: Received: { Ans: , MgmtId: 217771979204453, via: 2(s-2-VM), Ver: v1, Flags: 10, { Answer } } 2017-12-13 23:54:17,326 DEBUG [o.a.c.s.SecondaryStorageManagerImpl] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Successfully programmed firewall rules into s-2-VM 2017-12-13 23:54:17,337 DEBUG [c.c.a.t.Request] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Seq 2-3998070569198157827: Sending { Cmd , MgmtId: 217771979204453, via: 2(s-2-VM), Ver: v1, Flags: 100111, [{"com.cloud.agent.api.SecStorageVMSetupCommand":{"allowedInternalSites":[],"copyUserName":"cloud","copyPassword":"JTXYahq5ET8n","wait":0}}] } 2017-12-13 23:54:17,441 DEBUG [c.c.a.t.Request] (AgentManager-Handler-6:null) (logid:) Seq 2-3998070569198157827: Processing: { Ans: , MgmtId: 217771979204453, via: 2, Ver: v1, Flags: 110, [{"com.cloud.agent.api.Answer":{"result":true,"details":"","wait":0}}] } 2017-12-13 23:54:17,442 DEBUG [c.c.a.m.AgentAttache] (AgentManager-Handler-6:null) (logid:) Seq 2-3998070569198157827: No more commands found 2017-12-13 23:54:17,442 DEBUG [c.c.a.t.Request] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Seq 2-3998070569198157827: Received: { Ans: , MgmtId: 217771979204453, via: 2(s-2-VM), Ver: v1, Flags: 110, { Answer } } 2017-12-13 23:54:17,442 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Details from executing class com.cloud.agent.api.SecStorageVMSetupCommand: 2017-12-13 23:54:17,442 DEBUG [o.a.c.s.SecondaryStorageManagerImpl] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Successfully programmed http auth into s-2-VM 2017-12-13 23:54:17,442 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Sending Connect to listener: DeploymentPlanningManagerImpl 2017-12-13 23:54:17,442 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Sending Connect to listener: NetworkOrchestrator 2017-12-13 23:54:17,442 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Sending Connect to listener: ClusteredVirtualMachineManagerImpl 2017-12-13 23:54:17,442 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Sending Connect to listener: StoragePoolMonitor 2017-12-13 23:54:17,442 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Sending Connect to listener: SecurityGroupListener 2017-12-13 23:54:17,442 INFO [c.c.n.s.SecurityGroupListener] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Received a host startup notification 2017-12-13 23:54:17,442 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Sending Connect to listener: DirectNetworkStatsListener 2017-12-13 23:54:17,442 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Sending Connect to listener: DownloadListener 2017-12-13 23:54:17,449 DEBUG [c.c.h.o.r.Ovm3HypervisorGuru] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) getCommandHostDelegation: class com.cloud.agent.api.storage.ListVolumeCommand 2017-12-13 23:54:17,449 DEBUG [c.c.h.XenServerGuru] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) getCommandHostDelegation: class com.cloud.agent.api.storage.ListVolumeCommand 2017-12-13 23:54:17,452 DEBUG [c.c.a.t.Request] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Seq 2-3998070569198157828: Sending { Cmd , MgmtId: 217771979204453, via: 2(s-2-VM), Ver: v1, Flags: 100111, [{"com.cloud.agent.api.storage.ListVolumeCommand":{"store":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://172.16.0.101/export/secondary","_role":"Image"}},"secUrl":"nfs://172.16.0.101/export/secondary","wait":0}}] } 2017-12-13 23:54:17,539 DEBUG [c.c.a.t.Request] (AgentManager-Handler-7:null) (logid:) Seq 2-3998070569198157828: Processing: { Ans: , MgmtId: 217771979204453, via: 2, Ver: v1, Flags: 110, [{"com.cloud.agent.api.storage.ListVolumeAnswer":{"secUrl":"nfs://172.16.0.101/export/secondary","templateInfos":{},"result":true,"details":"success","wait":0}}] } 2017-12-13 23:54:17,539 DEBUG [c.c.a.m.AgentAttache] (AgentManager-Handler-7:null) (logid:) Seq 2-3998070569198157828: No more commands found 2017-12-13 23:54:17,539 DEBUG [c.c.a.t.Request] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Seq 2-3998070569198157828: Received: { Ans: , MgmtId: 217771979204453, via: 2(s-2-VM), Ver: v1, Flags: 110, { ListVolumeAnswer } } 2017-12-13 23:54:17,545 DEBUG [c.c.h.o.r.Ovm3HypervisorGuru] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) getCommandHostDelegation: class com.cloud.agent.api.storage.ListTemplateCommand 2017-12-13 23:54:17,545 DEBUG [c.c.h.XenServerGuru] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) getCommandHostDelegation: class com.cloud.agent.api.storage.ListTemplateCommand 2017-12-13 23:54:17,548 DEBUG [c.c.a.t.Request] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Seq 2-3998070569198157829: Sending { Cmd , MgmtId: 217771979204453, via: 2(s-2-VM), Ver: v1, Flags: 100111, [{"com.cloud.agent.api.storage.ListTemplateCommand":{"store":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://172.16.0.101/export/secondary","_role":"Image"}},"wait":0}}] } 2017-12-13 23:54:17,707 DEBUG [c.c.a.t.Request] (AgentManager-Handler-8:null) (logid:) Seq 2-3998070569198157829: Processing: { Ans: , MgmtId: 217771979204453, via: 2, Ver: v1, Flags: 110, [{"com.cloud.agent.api.storage.ListTemplateAnswer":{"secUrl":"nfs://172.16.0.101/export/secondary","templateInfos":{"routing-3":{"templateName":"routing-3","installPath":"template/tmpl/1/3/c6dc00f5-24f5-4179-8d32-48c5d6f7f158.qcow2","size":349341696,"physicalSize":349341696,"id":3,"isPublic":true,"isCorrupted":false}},"result":true,"details":"success","wait":0}}] } 2017-12-13 23:54:17,707 DEBUG [c.c.a.m.AgentAttache] (AgentManager-Handler-8:null) (logid:) Seq 2-3998070569198157829: No more commands found 2017-12-13 23:54:17,707 DEBUG [c.c.a.t.Request] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Seq 2-3998070569198157829: Received: { Ans: , MgmtId: 217771979204453, via: 2(s-2-VM), Ver: v1, Flags: 110, { ListTemplateAnswer } } 2017-12-13 23:54:17,716 INFO [o.a.c.s.i.TemplateServiceImpl] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Template Sync did not find routing-1 on image store 1, may request download based on available hypervisor types 2017-12-13 23:54:17,717 INFO [o.a.c.s.i.TemplateServiceImpl] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Template Sync found routing-3 already in the image store 2017-12-13 23:54:17,866 INFO [o.a.c.s.i.TemplateServiceImpl] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Template Sync did not find centos55-x86_64 on image store 1, may request download based on available hypervisor types 2017-12-13 23:54:17,866 INFO [o.a.c.s.i.TemplateServiceImpl] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Removing leftover template centos55-x86_64 entry from template store table 2017-12-13 23:54:17,954 INFO [o.a.c.s.i.TemplateServiceImpl] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Template Sync did not find centos56-x86_64-xen on image store 1, may request download based on available hypervisor types 2017-12-13 23:54:17,956 INFO [o.a.c.s.i.TemplateServiceImpl] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Template Sync did not find centos64-x64 on image store 1, may request download based on available hypervisor types 2017-12-13 23:54:17,957 INFO [o.a.c.s.i.TemplateServiceImpl] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Template Sync did not find centos53-x64 on image store 1, may request download based on available hypervisor types 2017-12-13 23:54:17,958 INFO [o.a.c.s.i.TemplateServiceImpl] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Template Sync did not find routing-8 on image store 1, may request download based on available hypervisor types 2017-12-13 23:54:17,959 INFO [o.a.c.s.i.TemplateServiceImpl] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Template Sync did not find routing-9 on image store 1, may request download based on available hypervisor types 2017-12-13 23:54:17,961 INFO [o.a.c.s.i.TemplateServiceImpl] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Template Sync did not find routing-10 on image store 1, may request download based on available hypervisor types 2017-12-13 23:54:17,962 INFO [o.a.c.s.i.TemplateServiceImpl] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Template Sync did not find centos7-x86_64-lxc on image store 1, may request download based on available hypervisor types 2017-12-13 23:54:17,963 INFO [o.a.c.s.i.TemplateServiceImpl] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Template Sync did not find routing-12 on image store 1, may request download based on available hypervisor types 2017-12-13 23:54:17,965 INFO [o.a.c.s.i.TemplateServiceImpl] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Skip downloading template centos7-x86_64-lxc since current data center does not have hypervisor LXC 2017-12-13 23:54:17,965 INFO [o.a.c.s.i.TemplateServiceImpl] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Skip downloading template routing-10 since current data center does not have hypervisor LXC 2017-12-13 23:54:17,965 INFO [o.a.c.s.i.TemplateServiceImpl] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Skip downloading template centos64-x64 since current data center does not have hypervisor Hyperv 2017-12-13 23:54:17,965 INFO [o.a.c.s.i.TemplateServiceImpl] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Skip downloading template routing-9 since current data center does not have hypervisor Hyperv 2017-12-13 23:54:17,965 INFO [o.a.c.s.i.TemplateServiceImpl] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Skip downloading template routing-8 since current data center does not have hypervisor VMware 2017-12-13 23:54:17,965 INFO [o.a.c.s.i.TemplateServiceImpl] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Skip downloading template routing-12 since current data center does not have hypervisor Ovm3 2017-12-13 23:54:17,965 INFO [o.a.c.s.i.TemplateServiceImpl] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Skip downloading template centos53-x64 since current data center does not have hypervisor VMware 2017-12-13 23:54:17,965 INFO [o.a.c.s.i.TemplateServiceImpl] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Skip downloading template routing-1 since current data center does not have hypervisor XenServer 2017-12-13 23:54:17,965 INFO [o.a.c.s.i.TemplateServiceImpl] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Skip downloading template centos56-x86_64-xen since current data center does not have hypervisor XenServer 2017-12-13 23:54:17,966 INFO [o.a.c.s.i.TemplateServiceImpl] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Downloading template centos55-x86_64 to image store nfs://172.16.0.101/export/secondary 2017-12-13 23:54:18,066 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) template 4 is not in store:1, type:Image 2017-12-13 23:54:18,179 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) template 4 is already in store:1, type:Image 2017-12-13 23:54:18,282 DEBUG [o.a.c.s.i.BaseImageStoreDriverImpl] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Downloading template to data store 1 2017-12-13 23:54:18,300 DEBUG [o.a.c.s.i.BaseImageStoreDriverImpl] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Performing image store createTemplate async callback 2017-12-13 23:54:18,769 DEBUG [c.c.h.o.r.Ovm3HypervisorGuru] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) getCommandHostDelegation: class org.apache.cloudstack.storage.command.DownloadCommand 2017-12-13 23:54:18,769 DEBUG [c.c.h.XenServerGuru] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) getCommandHostDelegation: class org.apache.cloudstack.storage.command.DownloadCommand 2017-12-13 23:54:18,769 DEBUG [o.a.c.s.RemoteHostEndPoint] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Sending command org.apache.cloudstack.storage.command.DownloadCommand to host: 2 2017-12-13 23:54:18,773 DEBUG [c.c.a.t.Request] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Seq 2-3998070569198157830: Sending { Cmd , MgmtId: 217771979204453, via: 2(s-2-VM), Ver: v1, Flags: 100011, [{"org.apache.cloudstack.storage.command.DownloadCommand":{"hvm":false,"description":"CentOS 5.5(64-bit) no GUI (KVM)","checksum":"ed0e788280ff2912ea40f7f91ca7a249","maxDownloadSizeInBytes":53687091200,"id":4,"resourceType":"TEMPLATE","installPath":"template/tmpl/1/4","_store":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://172.16.0.101/export/secondary","_role":"Image"}},"url":"http://download.cloud.com/releases/2.2.0/eec2209b-9875-3c8d-92be-c001bd8a0faf.qcow2.bz2","format":"QCOW2","accountId":1,"name":"centos55-x86_64","secUrl":"nfs://172.16.0.101/export/secondary","wait":0}}] } 2017-12-13 23:54:18,782 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Sending Connect to listener: SshKeysDistriMonitor 2017-12-13 23:54:18,782 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Sending Connect to listener: VpcVirtualNetworkApplianceManagerImpl 2017-12-13 23:54:18,784 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Sending Connect to listener: LocalStoragePoolListener 2017-12-13 23:54:18,784 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Sending Connect to listener: UploadListener 2017-12-13 23:54:18,784 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Sending Connect to listener: BehindOnPingListener 2017-12-13 23:54:18,784 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Sending Connect to listener: SetHostParamsListener 2017-12-13 23:54:18,784 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Sending Connect to listener: StorageCapacityListener 2017-12-13 23:54:18,784 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Sending Connect to listener: ComputeCapacityListener 2017-12-13 23:54:18,784 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Sending Connect to listener: SshKeysDistriMonitor 2017-12-13 23:54:18,784 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Sending Connect to listener: VirtualNetworkApplianceManagerImpl 2017-12-13 23:54:18,786 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Sending Connect to listener: ConsoleProxyListener 2017-12-13 23:54:18,794 DEBUG [c.c.a.t.Request] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Seq 2-3998070569198157831: Sending { Cmd , MgmtId: 217771979204453, via: 2(s-2-VM), Ver: v1, Flags: 100111, [{"com.cloud.agent.api.ReadyCommand":{"dcId":1,"hostId":2,"wait":0}}] } 2017-12-13 23:54:18,803 DEBUG [c.c.a.t.Request] (AgentManager-Handler-10:null) (logid:) Seq 2-3998070569198157831: Processing: { Ans: , MgmtId: 217771979204453, via: 2, Ver: v1, Flags: 110, [{"com.cloud.agent.api.ReadyAnswer":{"result":true,"wait":0}}] } 2017-12-13 23:54:18,803 DEBUG [c.c.a.m.AgentAttache] (AgentManager-Handler-10:null) (logid:) Seq 2-3998070569198157831: No more commands found 2017-12-13 23:54:18,803 DEBUG [c.c.a.t.Request] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Seq 2-3998070569198157831: Received: { Ans: , MgmtId: 217771979204453, via: 2(s-2-VM), Ver: v1, Flags: 110, { ReadyAnswer } } 2017-12-13 23:54:18,804 DEBUG [c.c.h.Status] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Transition:[Resource state = Enabled, Agent event = Ready, Host id = 2, name = s-2-VM] 2017-12-13 23:54:18,898 DEBUG [c.c.a.t.Request] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Seq 2-3998070569198157832: Sending { Cmd , MgmtId: 217771979204453, via: 2(s-2-VM), Ver: v1, Flags: 100111, [{"com.cloud.agent.api.ReadyCommand":{"dcId":1,"hostId":2,"wait":0}}] } 2017-12-13 23:54:18,947 DEBUG [c.c.a.t.Request] (AgentManager-Handler-11:null) (logid:) Seq 2-3998070569198157832: Processing: { Ans: , MgmtId: 217771979204453, via: 2, Ver: v1, Flags: 110, [{"com.cloud.agent.api.ReadyAnswer":{"result":true,"wait":0}}] } 2017-12-13 23:54:18,947 DEBUG [c.c.a.m.AgentAttache] (AgentManager-Handler-11:null) (logid:) Seq 2-3998070569198157832: No more commands found 2017-12-13 23:54:18,947 DEBUG [c.c.a.t.Request] (AgentConnectTaskPool-2:ctx-7b13a14b) (logid:68e5381f) Seq 2-3998070569198157832: Received: { Ans: , MgmtId: 217771979204453, via: 2(s-2-VM), Ver: v1, Flags: 110, { ReadyAnswer } } 2017-12-13 23:54:19,858 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-5c210dc8) (logid:02dd26fc) Begin cleanup expired async-jobs 2017-12-13 23:54:19,866 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-5c210dc8) (logid:02dd26fc) End cleanup expired async-jobs 2017-12-13 23:54:20,337 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-f3351220) (logid:162ac6ac) Found 0 routers to update status. 2017-12-13 23:54:20,339 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-f3351220) (logid:162ac6ac) Found 0 VPC networks to update Redundant State. 2017-12-13 23:54:20,340 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-f3351220) (logid:162ac6ac) Found 0 networks to update RvR status. 2017-12-13 23:54:22,250 DEBUG [c.c.a.t.Request] (AgentManager-Handler-9:null) (logid:) Seq 2-3998070569198157830: Processing: { Ans: , MgmtId: 217771979204453, via: 2, Ver: v1, Flags: 10, [{"com.cloud.agent.api.storage.DownloadAnswer":{"jobId":"1be9e3e4-c574-42c5-bc0c-3ece1728f2ed","downloadPct":0,"errorString":"sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target","downloadStatus":"DOWNLOAD_ERROR","downloadPath":"/mnt/SecStorage/5bd64279-12b2-33b8-bd9c-cda38ebbf606/template/tmpl/1/4/dnld1172069869285740499tmp_","installPath":"template/tmpl/1/4","templateSize":0,"templatePhySicalSize":0,"checkSum":"ed0e788280ff2912ea40f7f91ca7a249","result":true,"details":"sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target","wait":0}}] } 2017-12-13 23:54:24,477 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-12:null) (logid:) Ping from 1(srvr1.cloud.priv) 2017-12-13 23:54:24,478 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (AgentManager-Handler-12:null) (logid:) Process host VM state report from ping process. host: 1 2017-12-13 23:54:24,481 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (AgentManager-Handler-12:null) (logid:) Process VM state report. host: 1, number of records in report: 1 2017-12-13 23:54:24,482 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (AgentManager-Handler-12:null) (logid:) VM state report. host: 1, vm id: 2, power state: PowerOn 2017-12-13 23:54:24,582 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (AgentManager-Handler-12:null) (logid:) VM state report is updated. host: 1, vm id: 2, power state: PowerOn 2017-12-13 23:54:24,594 DEBUG [c.c.c.CapacityManagerImpl] (AgentManager-Handler-12:null) (logid:) VM state transitted from :Running to Running with event: FollowAgentPowerOnReportvm's original host id: 1 new host id: 1 host id before state transition: 1 2017-12-13 23:54:24,597 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (AgentManager-Handler-12:null) (logid:) Done with process of VM state report. host: 1 2017-12-13 23:54:29,856 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-5e7b6377) (logid:a9aeaa6e) Begin cleanup expired async-jobs 2017-12-13 23:54:29,862 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-5e7b6377) (logid:a9aeaa6e) End cleanup expired async-jobs 2017-12-13 23:54:32,253 DEBUG [o.a.c.s.i.BaseImageStoreDriverImpl] (RemoteHostEndPoint-1:ctx-75b3771e) (logid:3f696e76) Performing image store createTemplate async callback 2017-12-13 23:54:32,535 WARN [o.a.c.alerts] (RemoteHostEndPoint-1:ctx-75b3771e) (logid:3f696e76) alertType:: 28 // dataCenterId:: 1 // podId:: null // clusterId:: null // message:: Failed to register template: 4fe0b968-e02a-11e7-939c-f8a9632f48e1 with error: sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target 2017-12-13 23:54:32,634 ERROR [o.a.c.s.i.BaseImageStoreDriverImpl] (RemoteHostEndPoint-1:ctx-75b3771e) (logid:3f696e76) Failed to register template: 4fe0b968-e02a-11e7-939c-f8a9632f48e1 with error: sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target 2017-12-13 23:54:33,545 DEBUG [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-27ec674a) (logid:a3e73564) Zone 1 is ready to launch secondary storage VM 2017-12-13 23:54:33,682 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-7bb0198a) (logid:2c4ec4aa) Zone 1 is ready to launch console proxy 2017-12-13 23:54:33,682 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-7bb0198a) (logid:2c4ec4aa) Expand console proxy standby capacity for zone Zone1 2017-12-13 23:54:33,685 INFO [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-7bb0198a) (logid:2c4ec4aa) Found a stopped console proxy, starting it. Vm id : 3 2017-12-13 23:54:33,847 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (consoleproxy-1:ctx-7bb0198a) (logid:2c4ec4aa) Sync job-20 execution on object VmWorkJobQueue.3