Hi,
Actually that's the whole log. Above it just job starting. I have
attached the missing part of the log. Which tables do you need from
the database?
There are multiple records with allocated/creating inside
volume_store_ref. There is nothing that's looks wrong with
volumes/snapshots/snapshot_store_ref.
On Thu, May 10, 2018 at 9:27 PM, Suresh Kumar Anaparti
<sureshkumar.anapa...@gmail.com> wrote:
> Hi Darius,
>
> From the logs, I could observe that image volume is already in the creating
> state and trying to use the same for copying the volume between pools. So,
> state transition failed. Could you please provide the complete log for the
> usecase to root cause the issue. Also, include volumes and snapshots db
> details for the mentioned volume and snapshot.
>
> -Suresh
>
>
> On Thu, May 10, 2018 at 1:22 PM, Daznis <daz...@gmail.com> wrote:
>
>> Snapshots work fine. I can make a snapshot -> convert it to template
>> and start the VM on a new node from that template. When I needed to
>> move one VM for balance purposes. But I want to fix the migration
>> process. I have attached the error log to this email. Maybe I'm
>> looking at the wrong place were I get the error?
>>
>> On Wed, May 9, 2018 at 9:23 PM, Marc-Aurèle Brothier <ma...@exoscale.ch>
>> wrote:
>> > Can you try to perform a snapshot of the volume on VM's that are on your
>> > host, to see if they get copied correctly other the NFS too.
>> >
>> > Otherwise you need to look into the management logs to catch the
>> exception
>> > (stack trace) to have a better understanding of the issue.
>> >
>> > On Wed, May 9, 2018 at 1:58 PM, Daznis <daz...@gmail.com> wrote:
>> >
>> >> Hello,
>> >>
>> >>
>> >> Yeah it's offline. I'm running 4.9.2 version. Running it on the same
>> >> zone with the only NFS secondary storage.
>> >>
>> >> On Wed, May 9, 2018 at 10:49 AM, Marc-Aurèle Brothier <
>> ma...@exoscale.ch>
>> >> wrote:
>> >> > Hi Darius,
>> >> >
>> >> > Are you trying to perform an offline migration within the same zone,
>> >> > meaning that the source and destination hosts have the same set of NFS
>> >> > secondary storage ?
>> >> >
>> >> > Marc-Aurèle
>> >> >
>> >> > On Tue, May 8, 2018 at 3:37 PM, Daznis <daz...@gmail.com> wrote:
>> >> >
>> >> >> Hi,
>> >> >>
>> >> >>
>> >> >> I'm having an issue while migrating offline vm disk within local
>> >> >> storages. The particular error that has be baffled is "Can't find
>> >> >> staging storage in zone". From what I have gather "staging storage"
>> >> >> referred to secondary storage in cloudstack and it's working
>> perfectly
>> >> >> fine with both the source and destination node. Not sure where to go
>> >> >> next. Any help would be appreciated.
>> >> >>
>> >> >>
>> >> >> Regards,
>> >> >> Darius
>> >> >>
>> >>
>>
2018-05-10 09:41:38,382 DEBUG [c.c.a.ApiServlet]
(catalina-exec-11:ctx-bcc608a4) (logid:4600778d) ===START=== 172.16.16.34 --
GET
command=migrateVirtualMachine&storageid=cc86b3e2-3a7d-4025-b1c4-b3ad19e4a566&virtualmachineid=f52b6905-f6b5-46bd-bed9-2fa169e2b83a&response=json&_=1525938294460
2018-05-10 09:41:38,430 INFO [o.a.c.f.j.i.AsyncJobMonitor]
(API-Job-Executor-3:ctx-64fdce4d job-2148) (logid:cb2e3ab2) Add job-2148 into
job monitoring
2018-05-10 09:41:38,433 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(catalina-exec-11:ctx-bcc608a4 ctx-9456d552) (logid:4600778d) submit async
job-2148, details: AsyncJobVO {id:2148, userId: 2, accountId: 2, instanceType:
None, instanceId: null, cmd:
org.apache.cloudstack.api.command.admin.vm.MigrateVMCmd, cmdInfo:
{"virtualmachineid":"f52b6905-f6b5-46bd-bed9-2fa169e2b83a","response":"json","ctxUserId":"2","httpmethod":"GET","ctxStartEventId":"15250","ctxDetails":"{\"interface
com.cloud.vm.VirtualMachine\":\"f52b6905-f6b5-46bd-bed9-2fa169e2b83a\",\"interface
com.cloud.storage.StoragePool\":\"cc86b3e2-3a7d-4025-b1c4-b3ad19e4a566\"}","ctxAccountId":"2","cmdEventType":"VM.MIGRATE","storageid":"cc86b3e2-3a7d-4025-b1c4-b3ad19e4a566","_":"1525938294460"},
cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result:
null, initMsid: 159304575802479, completeMsid: null, lastUpdated: null,
lastPolled: null, created: null}
2018-05-10 09:41:38,434 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(API-Job-Executor-3:ctx-64fdce4d job-2148) (logid:132e1fe7) Executing
AsyncJobVO {id:2148, userId: 2, accountId: 2, instanceType: None, instanceId:
null, cmd: org.apache.cloudstack.api.command.admin.vm.MigrateVMCmd, cmdInfo:
{"virtualmachineid":"f52b6905-f6b5-46bd-bed9-2fa169e2b83a","response":"json","ctxUserId":"2","httpmethod":"GET","ctxStartEventId":"15250","ctxDetails":"{\"interface
com.cloud.vm.VirtualMachine\":\"f52b6905-f6b5-46bd-bed9-2fa169e2b83a\",\"interface
com.cloud.storage.StoragePool\":\"cc86b3e2-3a7d-4025-b1c4-b3ad19e4a566\"}","ctxAccountId":"2","cmdEventType":"VM.MIGRATE","storageid":"cc86b3e2-3a7d-4025-b1c4-b3ad19e4a566","_":"1525938294460"},
cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result:
null, initMsid: 159304575802479, completeMsid: null, lastUpdated: null,
lastPolled: null, created: null}
2018-05-10 09:41:38,434 DEBUG [c.c.a.ApiServlet] (catalina-exec-11:ctx-bcc608a4
ctx-9456d552) (logid:4600778d) ===END=== 172.16.16.34 -- GET
command=migrateVirtualMachine&storageid=cc86b3e2-3a7d-4025-b1c4-b3ad19e4a566&virtualmachineid=f52b6905-f6b5-46bd-bed9-2fa169e2b83a&response=json&_=1525938294460
2018-05-10 09:41:38,485 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(API-Job-Executor-3:ctx-64fdce4d job-2148 ctx-85c3e5dc) (logid:132e1fe7) Sync
job-2149 execution on object VmWorkJobQueue.19
2018-05-10 09:41:38,541 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(AsyncJobMgr-Heartbeat-1:ctx-8fed9b1c) (logid:d37a1106) Execute sync-queue
item: SyncQueueItemVO {id:1005, queueId: 50, contentType: AsyncJob, contentId:
2149, lastProcessMsid: 159304575802479, lastprocessNumber: 31, lastProcessTime:
Thu May 10 09:41:38 SAST 2018, created: Thu May 10 09:41:38 SAST 2018}
2018-05-10 09:41:38,543 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(AsyncJobMgr-Heartbeat-1:ctx-8fed9b1c) (logid:d37a1106) Schedule queued job-2149
2018-05-10 09:41:38,549 INFO [o.a.c.f.j.i.AsyncJobMonitor]
(Work-Job-Executor-3:ctx-69344343 job-2148/job-2149) (logid:c7cfc86e) Add
job-2149 into job monitoring
2018-05-10 09:41:38,554 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(Work-Job-Executor-3:ctx-69344343 job-2148/job-2149) (logid:132e1fe7) Executing
AsyncJobVO {id:2149, userId: 2, accountId: 2, instanceType: null, instanceId:
null, cmd: com.cloud.vm.VmWorkStorageMigration, cmdInfo:
rO0ABXNyACNjb20uY2xvdWQudm0uVm1Xb3JrU3RvcmFnZU1pZ3JhdGlvboeRn3LBtueeAgABTAAKZGVzdFBvb2xJZHQAEExqYXZhL2xhbmcvTG9uZzt4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1ldAASTGphdmEvbGFuZy9TdHJpbmc7eHAAAAAAAAAAAgAAAAAAAAACAAAAAAAAABN0ABlWaXJ0dWFsTWFjaGluZU1hbmFnZXJJbXBsc3IADmphdmEubGFuZy5Mb25nO4vkkMyPI98CAAFKAAV2YWx1ZXhyABBqYXZhLmxhbmcuTnVtYmVyhqyVHQuU4IsCAAB4cAAAAAAAAAAB,
cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result:
null, initMsid: 159304575802479, completeMsid: null, lastUpdated: null,
lastPolled: null, created: Thu May 10 09:41:38 SAST 2018}
2018-05-10 09:41:38,555 DEBUG [c.c.v.VmWorkJobDispatcher]
(Work-Job-Executor-3:ctx-69344343 job-2148/job-2149) (logid:132e1fe7) Run VM
work job: com.cloud.vm.VmWorkStorageMigration for VM 19, job origin: 2148
2018-05-10 09:41:38,556 DEBUG [c.c.v.VmWorkJobHandlerProxy]
(Work-Job-Executor-3:ctx-69344343 job-2148/job-2149 ctx-cfe56a50)
(logid:132e1fe7) Execute VM work job:
com.cloud.vm.VmWorkStorageMigration{"destPoolId":1,"userId":2,"accountId":2,"vmId":19,"handlerName":"VirtualMachineManagerImpl"}
2018-05-10 09:41:38,569 DEBUG [c.c.c.CapacityManagerImpl]
(Work-Job-Executor-3:ctx-69344343 job-2148/job-2149 ctx-cfe56a50)
(logid:132e1fe7) VM state transitted from :Stopped to Migrating with event:
StorageMigrationRequestedvm's original host id: 5 new host id: null host id
before state transition: null
2018-05-10 09:41:38,594 DEBUG [o.a.c.s.m.AncientDataMotionStrategy]
(Work-Job-Executor-3:ctx-69344343 job-2148/job-2149 ctx-cfe56a50)
(logid:132e1fe7) copyAsync inspecting src type VOLUME copyAsync inspecting dest
type VOLUME
2018-05-10 09:41:38,598 DEBUG [o.a.c.s.c.a.StorageCacheRandomAllocator]
(Work-Job-Executor-3:ctx-69344343 job-2148/job-2149 ctx-cfe56a50)
(logid:132e1fe7) Can't find staging storage in zone: 2
