Hi,
has job ²snapshot remove from primary² same job-ID or logid as snapshot process has? Here is latest snapshot log for logid:f2cbdadb 2018-10-10 20:00:58,759 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-91:ctx-383c6cf4 job-29198) (logid:f2cbdadb) Executing AsyncJobVO {id:29198, userId: 1, accountId: 10, instanceType: Snapshot, instanceId: 180, cmd: org.apache.cloudstack.api.command.user.snapshot.CreateSnapshotCmd, cmdInfo: {"policyid":"53","ctxUserId":"1","volumeid":"924","ctxStartEventId":"1","id ":"180","ctxAccountId":"10"}, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 19873467853209, completeMsid: null, lastUpdated: null, lastPolled: null, created: null} 2018-10-10 20:00:58,766 DEBUG [c.c.u.AccountManagerImpl] (API-Job-Executor-91:ctx-383c6cf4 job-29198 ctx-b559e6db) (logid:f2cbdadb) Access to Acct[049bd243-386a-49e5-8215-70594e665951-sami] granted to Acct[049bd243-386a-49e5-8215-70594e665951-sami] by DomainChecker 2018-10-10 20:00:58,822 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-91:ctx-383c6cf4 job-29198 ctx-b559e6db) (logid:f2cbdadb) Sync job-29199 execution on object VmWorkJobQueue.252 2018-10-10 20:00:59,940 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-36:ctx-138e84ea job-29198/job-29199) (logid:f2cbdadb) Executing AsyncJobVO {id:29199, userId: 1, accountId: 10, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkTakeVolumeSnapshot, cmdInfo: rO0ABXNyACVjb20uY2xvdWQudm0uVm1Xb3JrVGFrZVZvbHVtZVNuYXBzaG90BL5gG4Li1c8CAAZ aAAthc3luY0JhY2t1cFoACXF1aWVzY2VWbUwADGxvY2F0aW9uVHlwZXQAKUxjb20vY2xvdWQvc3 RvcmFnZS9TbmFwc2hvdCRMb2NhdGlvblR5cGU7TAAIcG9saWN5SWR0ABBMamF2YS9sYW5nL0xvb mc7TAAKc25hcHNob3RJZHEAfgACTAAIdm9sdW1lSWRxAH4AAnhyABNjb20uY2xvdWQudm0uVm1X b3Jrn5m2VvAlZ2sCAARKAAlhY2NvdW50SWRKAAZ1c2VySWRKAAR2bUlkTAALaGFuZGxlck5hbWV 0ABJMamF2YS9sYW5nL1N0cmluZzt4cAAAAAAAAAAKAAAAAAAAAAEAAAAAAAAA_HQAFFZvbHVtZU FwaVNlcnZpY2VJbXBsAABwc3IADmphdmEubGFuZy5Mb25nO4vkkMyPI98CAAFKAAV2YWx1ZXhyA BBqYXZhLmxhbmcuTnVtYmVyhqyVHQuU4IsCAAB4cAAAAAAAAAA1c3EAfgAHAAAAAAAAALRzcQB- AAcAAAAAAAADnA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 19873467853209, completeMsid: null, lastUpdated: null, lastPolled: null, created: Wed Oct 10 20:00:58 EEST 2018} 2018-10-10 20:00:59,941 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-36:ctx-138e84ea job-29198/job-29199) (logid:f2cbdadb) Run VM work job: com.cloud.vm.VmWorkTakeVolumeSnapshot for VM 252, job origin: 29198 2018-10-10 20:00:59,942 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-36:ctx-138e84ea job-29198/job-29199 ctx-1f9eb415) (logid:f2cbdadb) Execute VM work job: com.cloud.vm.VmWorkTakeVolumeSnapshot{"volumeId":924,"policyId":53,"snapsho tId":180,"quiesceVm":false,"asyncBackup":false,"userId":1,"accountId":10,"v mId":252,"handlerName":"VolumeApiServiceImpl"} 2018-10-10 20:01:00,021 DEBUG [c.c.h.o.r.Ovm3HypervisorGuru] (Work-Job-Executor-36:ctx-138e84ea job-29198/job-29199 ctx-1f9eb415) (logid:f2cbdadb) getCommandHostDelegation: class org.apache.cloudstack.storage.command.CreateObjectCommand 2018-10-10 20:01:00,021 DEBUG [c.c.h.XenServerGuru] (Work-Job-Executor-36:ctx-138e84ea job-29198/job-29199 ctx-1f9eb415) (logid:f2cbdadb) We are returning the default host to execute commands because the command is not of Copy type. 2018-10-10 20:01:00,023 DEBUG [c.c.a.t.Request] (Work-Job-Executor-36:ctx-138e84ea job-29198/job-29199 ctx-1f9eb415) (logid:f2cbdadb) Seq 140-3328441599603612624: Sending { Cmd , MgmtId: 19873467853209, via: 140(xenserver-69), Ver: v1, Flags: 100011, [{"org.apache.cloudstack.storage.command.CreateObjectCommand":{"data":{"org .apache.cloudstack.storage.to.SnapshotObjectTO":{"volume":{"uuid":"284eadd7 -c29a-423f-94eb-da4c548ad945","volumeType":"ROOT","dataStore":{"org.apache. cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"8700cdda-f60b-35cc-93b7- 3160058b481a","id":16,"poolType":"NetworkFilesystem","host":"10.10.1.33","p ath":"/pool6/primary6","port":2049,"url":"NetworkFilesystem://10.10.1.33/po ol6/primary6/?ROLE=Primary&STOREUUID=8700cdda-f60b-35cc-93b7-3160058b481a", "isManaged":false}},"name":"ROOT-252","size":21474836480,"path":"b81b00cc-6 a68-42a1-94c0-7f4089b79973","volumeId":924,"vmName":"i-4-252-VM","accountId ":10,"format":"VHD","provisioningType":"THIN","id":924,"deviceId":0,"hyperv isorType":"XenServer"},"parentSnapshotPath":"41c73e2d-a4e0-4256-9bb7-1ee907 c877ff","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO": {"uuid":"8700cdda-f60b-35cc-93b7-3160058b481a","id":16,"poolType":"NetworkF ilesystem","host":"10.10.1.33","path":"/pool6/primary6","port":2049,"url":" NetworkFilesystem://10.10.1.33/pool6/primary6/?ROLE=Primary&STOREUUID=8700c dda-f60b-35cc-93b7-3160058b481a","isManaged":false}},"vmName":"i-4-252-VM", "name":"VM-server_ROOT-252_20181010170058","hypervisorType":"XenServer","id ":180,"quiescevm":false,"parents":["41c73e2d-a4e0-4256-9bb7-1ee907c877ff"], "physicalSize":0}},"wait":0}}] } 2018-10-10 20:01:00,023 DEBUG [c.c.a.t.Request] (Work-Job-Executor-36:ctx-138e84ea job-29198/job-29199 ctx-1f9eb415) (logid:f2cbdadb) Seq 140-3328441599603612624: Executing: { Cmd , MgmtId: 19873467853209, via: 140(xenserver-69), Ver: v1, Flags: 100011, [{"org.apache.cloudstack.storage.command.CreateObjectCommand":{"data":{"org .apache.cloudstack.storage.to.SnapshotObjectTO":{"volume":{"uuid":"284eadd7 -c29a-423f-94eb-da4c548ad945","volumeType":"ROOT","dataStore":{"org.apache. cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"8700cdda-f60b-35cc-93b7- 3160058b481a","id":16,"poolType":"NetworkFilesystem","host":"10.10.1.33","p ath":"/pool6/primary6","port":2049,"url":"NetworkFilesystem://10.10.1.33/po ol6/primary6/?ROLE=Primary&STOREUUID=8700cdda-f60b-35cc-93b7-3160058b481a", "isManaged":false}},"name":"ROOT-252","size":21474836480,"path":"b81b00cc-6 a68-42a1-94c0-7f4089b79973","volumeId":924,"vmName":"i-4-252-VM","accountId ":10,"format":"VHD","provisioningType":"THIN","id":924,"deviceId":0,"hyperv isorType":"XenServer"},"parentSnapshotPath":"41c73e2d-a4e0-4256-9bb7-1ee907 c877ff","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO": {"uuid":"8700cdda-f60b-35cc-93b7-3160058b481a","id":16,"poolType":"NetworkF ilesystem","host":"10.10.1.33","path":"/pool6/primary6","port":2049,"url":" NetworkFilesystem://10.10.1.33/pool6/primary6/?ROLE=Primary&STOREUUID=8700c dda-f60b-35cc-93b7-3160058b481a","isManaged":false}},"vmName":"i-4-252-VM", "name":"VM-server_ROOT-252_20181010170058","hypervisorType":"XenServer","id ":180,"quiescevm":false,"parents":["41c73e2d-a4e0-4256-9bb7-1ee907c877ff"], "physicalSize":0}},"wait":0}}] } 2018-10-10 20:01:01,813 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-471:ctx-77f75805) (logid:f2cbdadb) Seq 140-3328441599603612624: Response Received: 2018-10-10 20:01:01,813 DEBUG [c.c.a.t.Request] (DirectAgent-471:ctx-77f75805) (logid:f2cbdadb) Seq 140-3328441599603612624: Processing: { Ans: , MgmtId: 19873467853209, via: 140(xenserver-69), Ver: v1, Flags: 10, [{"org.apache.cloudstack.storage.command.CreateObjectAnswer":{"data":{"org. apache.cloudstack.storage.to.SnapshotObjectTO":{"path":"4ede3269-0d3b-4599- aa66-0a9a6e523201","id":0,"quiescevm":false,"physicalSize":0}},"result":tru e,"wait":0}}] } 2018-10-10 20:01:01,814 DEBUG [c.c.a.t.Request] (Work-Job-Executor-36:ctx-138e84ea job-29198/job-29199 ctx-1f9eb415) (logid:f2cbdadb) Seq 140-3328441599603612624: Received: { Ans: , MgmtId: 19873467853209, via: 140(xenserver-69), Ver: v1, Flags: 10, { CreateObjectAnswer } } 2018-10-10 20:01:01,941 DEBUG [o.a.c.s.m.AncientDataMotionStrategy] (Work-Job-Executor-36:ctx-138e84ea job-29198/job-29199 ctx-1f9eb415) (logid:f2cbdadb) copyAsync inspecting src type SNAPSHOT copyAsync inspecting dest type SNAPSHOT 2018-10-10 20:01:02,008 ERROR [o.a.c.s.e.DefaultEndPointSelector] (Work-Job-Executor-36:ctx-138e84ea job-29198/job-29199 ctx-1f9eb415) (logid:f2cbdadb) IR24 select BACKUPSNAPSHOT from primary to secondary 180 dest=180 2018-10-10 20:01:02,015 DEBUG [c.c.h.o.r.Ovm3HypervisorGuru] (Work-Job-Executor-36:ctx-138e84ea job-29198/job-29199 ctx-1f9eb415) (logid:f2cbdadb) getCommandHostDelegation: class org.apache.cloudstack.storage.command.CopyCommand 2018-10-10 20:01:02,015 DEBUG [c.c.h.XenServerGuru] (Work-Job-Executor-36:ctx-138e84ea job-29198/job-29199 ctx-1f9eb415) (logid:f2cbdadb) We are returning the default host to execute commands because the source and destination objects are not NFS type. 2018-10-10 20:01:02,016 DEBUG [c.c.a.t.Request] (Work-Job-Executor-36:ctx-138e84ea job-29198/job-29199 ctx-1f9eb415) (logid:f2cbdadb) Seq 139-3695766444211015001: Sending { Cmd , MgmtId: 19873467853209, via: 139(xenserver-67), Ver: v1, Flags: 100111, [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache .cloudstack.storage.to.SnapshotObjectTO":{"path":"4ede3269-0d3b-4599-aa66-0 a9a6e523201","volume":{"uuid":"284eadd7-c29a-423f-94eb-da4c548ad945","volum eType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataSto reTO":{"uuid":"8700cdda-f60b-35cc-93b7-3160058b481a","id":16,"poolType":"Ne tworkFilesystem","host":"10.10.1.33","path":"/pool6/primary6","port":2049," url":"NetworkFilesystem://10.10.1.33/pool6/primary6/?ROLE=Primary&STOREUUID =8700cdda-f60b-35cc-93b7-3160058b481a","isManaged":false}},"name":"ROOT-252 ","size":21474836480,"path":"b81b00cc-6a68-42a1-94c0-7f4089b79973","volumeI d":924,"vmName":"i-4-252-VM","accountId":10,"format":"VHD","provisioningTyp e":"THIN","id":924,"deviceId":0,"hypervisorType":"XenServer"},"parentSnapsh otPath":"41c73e2d-a4e0-4256-9bb7-1ee907c877ff","dataStore":{"org.apache.clo udstack.storage.to.PrimaryDataStoreTO":{"uuid":"8700cdda-f60b-35cc-93b7-316 0058b481a","id":16,"poolType":"NetworkFilesystem","host":"10.10.1.33","path ":"/pool6/primary6","port":2049,"url":"NetworkFilesystem://10.10.1.33/pool6 /primary6/?ROLE=Primary&STOREUUID=8700cdda-f60b-35cc-93b7-3160058b481a","is Managed":false}},"vmName":"i-4-252-VM","name":"VM-server_ROOT-252_201810101 70058","hypervisorType":"XenServer","id":180,"quiescevm":false,"parents":[" 41c73e2d-a4e0-4256-9bb7-1ee907c877ff"],"physicalSize":0}},"destTO":{"org.ap ache.cloudstack.storage.to.SnapshotObjectTO":{"path":"snapshots/10/924","vo lume":{"uuid":"284eadd7-c29a-423f-94eb-da4c548ad945","volumeType":"ROOT","d ataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"8 700cdda-f60b-35cc-93b7-3160058b481a","id":16,"poolType":"NetworkFilesystem" ,"host":"10.10.1.33","path":"/pool6/primary6","port":2049,"url":"NetworkFil esystem://10.10.1.33/pool6/primary6/?ROLE=Primary&STOREUUID=8700cdda-f60b-3 5cc-93b7-3160058b481a","isManaged":false}},"name":"ROOT-252","size":2147483 6480,"path":"b81b00cc-6a68-42a1-94c0-7f4089b79973","volumeId":924,"vmName": "i-4-252-VM","accountId":10,"format":"VHD","provisioningType":"THIN","id":9 24,"deviceId":0,"hypervisorType":"XenServer"},"parentSnapshotPath":"snapsho ts/10/924/40fc7082-9035-4762-ad8c-e4f8aa03d69c.vhd","dataStore":{"com.cloud .agent.api.to.NfsTO":{"_url":"nfs://10.10.1.33/pool4/secondary","_role":"Im age"}},"vmName":"i-4-252-VM","name":"VM-server_ROOT-252_20181010170058","hy pervisorType":"XenServer","id":180,"quiescevm":false,"parents":["snapshots/ 10/924/40fc7082-9035-4762-ad8c-e4f8aa03d69c.vhd"],"physicalSize":0}},"execu teInSequence":true,"options":{"fullSnapshot":"false"},"options2":{},"wait": 28800}}] } 2018-10-10 20:01:02,017 DEBUG [c.c.a.t.Request] (Work-Job-Executor-36:ctx-138e84ea job-29198/job-29199 ctx-1f9eb415) (logid:f2cbdadb) Seq 139-3695766444211015001: Executing: { Cmd , MgmtId: 19873467853209, via: 139(xenserver-67), Ver: v1, Flags: 100111, [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache .cloudstack.storage.to.SnapshotObjectTO":{"path":"4ede3269-0d3b-4599-aa66-0 a9a6e523201","volume":{"uuid":"284eadd7-c29a-423f-94eb-da4c548ad945","volum eType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataSto reTO":{"uuid":"8700cdda-f60b-35cc-93b7-3160058b481a","id":16,"poolType":"Ne tworkFilesystem","host":"10.10.1.33","path":"/pool6/primary6","port":2049," url":"NetworkFilesystem://10.10.1.33/pool6/primary6/?ROLE=Primary&STOREUUID =8700cdda-f60b-35cc-93b7-3160058b481a","isManaged":false}},"name":"ROOT-252 ","size":21474836480,"path":"b81b00cc-6a68-42a1-94c0-7f4089b79973","volumeI d":924,"vmName":"i-4-252-VM","accountId":10,"format":"VHD","provisioningTyp e":"THIN","id":924,"deviceId":0,"hypervisorType":"XenServer"},"parentSnapsh otPath":"41c73e2d-a4e0-4256-9bb7-1ee907c877ff","dataStore":{"org.apache.clo udstack.storage.to.PrimaryDataStoreTO":{"uuid":"8700cdda-f60b-35cc-93b7-316 0058b481a","id":16,"poolType":"NetworkFilesystem","host":"10.10.1.33","path ":"/pool6/primary6","port":2049,"url":"NetworkFilesystem://10.10.1.33/pool6 /primary6/?ROLE=Primary&STOREUUID=8700cdda-f60b-35cc-93b7-3160058b481a","is Managed":false}},"vmName":"i-4-252-VM","name":"VM-server_ROOT-252_201810101 70058","hypervisorType":"XenServer","id":180,"quiescevm":false,"parents":[" 41c73e2d-a4e0-4256-9bb7-1ee907c877ff"],"physicalSize":0}},"destTO":{"org.ap ache.cloudstack.storage.to.SnapshotObjectTO":{"path":"snapshots/10/924","vo lume":{"uuid":"284eadd7-c29a-423f-94eb-da4c548ad945","volumeType":"ROOT","d ataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"8 700cdda-f60b-35cc-93b7-3160058b481a","id":16,"poolType":"NetworkFilesystem" ,"host":"10.10.1.33","path":"/pool6/primary6","port":2049,"url":"NetworkFil esystem://10.10.1.33/pool6/primary6/?ROLE=Primary&STOREUUID=8700cdda-f60b-3 5cc-93b7-3160058b481a","isManaged":false}},"name":"ROOT-252","size":2147483 6480,"path":"b81b00cc-6a68-42a1-94c0-7f4089b79973","volumeId":924,"vmName": "i-4-252-VM","accountId":10,"format":"VHD","provisioningType":"THIN","id":9 24,"deviceId":0,"hypervisorType":"XenServer"},"parentSnapshotPath":"snapsho ts/10/924/40fc7082-9035-4762-ad8c-e4f8aa03d69c.vhd","dataStore":{"com.cloud .agent.api.to.NfsTO":{"_url":"nfs://10.10.1.33/pool4/secondary","_role":"Im age"}},"vmName":"i-4-252-VM","name":"VM-server_ROOT-252_20181010170058","hy pervisorType":"XenServer","id":180,"quiescevm":false,"parents":["snapshots/ 10/924/40fc7082-9035-4762-ad8c-e4f8aa03d69c.vhd"],"physicalSize":0}},"execu teInSequence":true,"options":{"fullSnapshot":"false"},"options2":{},"wait": 28800}}] } 2018-10-10 20:01:36,587 DEBUG [c.c.h.x.r.CitrixResourceBase] (DirectAgent-149:ctx-5d298873) (logid:f2cbdadb) Host 10.10.1.67 OpaqueRef:9bee59f7-483e-a69b-d455-6383b4fa39cf: Removing SR 2018-10-10 20:01:36,601 DEBUG [c.c.h.x.r.CitrixResourceBase] (DirectAgent-149:ctx-5d298873) (logid:f2cbdadb) Host 10.10.1.67 OpaqueRef:e14a95d1-fd13-7925-a017-aea16ef75fc3: Unplugging pbd 2018-10-10 20:01:37,163 DEBUG [c.c.h.x.r.CitrixResourceBase] (DirectAgent-149:ctx-5d298873) (logid:f2cbdadb) Host 10.10.1.67 OpaqueRef:9bee59f7-483e-a69b-d455-6383b4fa39cf: Forgetting 2018-10-10 20:01:37,172 DEBUG [c.c.h.x.r.XenServerStorageProcessor] (DirectAgent-149:ctx-5d298873) (logid:f2cbdadb) Successfully destroyed snapshot on volume: b81b00cc-6a68-42a1-94c0-7f4089b79973 execept this current snapshot 4ede3269-0d3b-4599-aa66-0a9a6e523201 2018-10-10 20:01:37,172 INFO [c.c.h.x.r.XenServerStorageProcessor] (DirectAgent-149:ctx-5d298873) (logid:f2cbdadb) New snapshot details: SnapshotTO[datastore=null|volume=null|pathsnapshots/10/924/782c2533-9e47-4f 67-b965-ff40e6959c28.vhd] 2018-10-10 20:01:37,172 INFO [c.c.h.x.r.XenServerStorageProcessor] (DirectAgent-149:ctx-5d298873) (logid:f2cbdadb) New snapshot physical utilization: 451809792 2018-10-10 20:01:37,172 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-149:ctx-5d298873) (logid:f2cbdadb) Seq 139-3695766444211015001: Response Received: 2018-10-10 20:01:37,172 DEBUG [c.c.a.t.Request] (DirectAgent-149:ctx-5d298873) (logid:f2cbdadb) Seq 139-3695766444211015001: Processing: { Ans: , MgmtId: 19873467853209, via: 139(xenserver-67), Ver: v1, Flags: 110, [{"org.apache.cloudstack.storage.command.CopyCmdAnswer":{"newData":{"org.ap ache.cloudstack.storage.to.SnapshotObjectTO":{"path":"snapshots/10/924/782c 2533-9e47-4f67-b965-ff40e6959c28.vhd","parentSnapshotPath":"snapshots/10/92 4/40fc7082-9035-4762-ad8c-e4f8aa03d69c.vhd","id":0,"quiescevm":false,"physi calSize":451809792}},"result":true,"wait":0}}] } 2018-10-10 20:01:37,173 DEBUG [c.c.a.t.Request] (Work-Job-Executor-36:ctx-138e84ea job-29198/job-29199 ctx-1f9eb415) (logid:f2cbdadb) Seq 139-3695766444211015001: Received: { Ans: , MgmtId: 19873467853209, via: 139(xenserver-67), Ver: v1, Flags: 110, { CopyCmdAnswer } } 2018-10-10 20:01:37,174 DEBUG [c.c.a.m.AgentAttache] (DirectAgent-149:ctx-5d298873) (logid:f2cbdadb) Seq 139-3695766444211015001: No more commands found 2018-10-10 20:01:37,224 DEBUG [c.c.s.s.SnapshotManagerImpl] (Work-Job-Executor-36:ctx-138e84ea job-29198/job-29199 ctx-1f9eb415) (logid:f2cbdadb) Max snaps: 2 exceeded for snapshot policy with Id: 53. Deleting oldest snapshot: 152 2018-10-10 20:01:37,228 DEBUG [c.c.u.AccountManagerImpl] (Work-Job-Executor-36:ctx-138e84ea job-29198/job-29199 ctx-1f9eb415) (logid:f2cbdadb) Access to com.cloud.storage.SnapshotVO$$EnhancerByCGLIB$$a643c04@12127de8 granted to Acct[049bd243-386a-49e5-8215-70594e665951-sami] by DomainChecker 2018-10-10 20:01:37,248 DEBUG [o.a.c.s.s.XenserverSnapshotStrategy] (Work-Job-Executor-36:ctx-138e84ea job-29198/job-29199 ctx-1f9eb415) (logid:f2cbdadb) delete snapshot chain for snapshot: 152 2018-10-10 20:01:37,249 DEBUG [o.a.c.s.s.XenserverSnapshotStrategy] (Work-Job-Executor-36:ctx-138e84ea job-29198/job-29199 ctx-1f9eb415) (logid:f2cbdadb) Snapshot: 152 doesn't have children, so it's ok to delete it and its parents 2018-10-10 20:01:37,287 DEBUG [c.c.h.o.r.Ovm3HypervisorGuru] (Work-Job-Executor-36:ctx-138e84ea job-29198/job-29199 ctx-1f9eb415) (logid:f2cbdadb) getCommandHostDelegation: class org.apache.cloudstack.storage.command.DeleteCommand 2018-10-10 20:01:37,287 DEBUG [c.c.h.XenServerGuru] (Work-Job-Executor-36:ctx-138e84ea job-29198/job-29199 ctx-1f9eb415) (logid:f2cbdadb) We are returning the default host to execute commands because the command is not of Copy type. 2018-10-10 20:01:37,288 DEBUG [c.c.a.t.Request] (Work-Job-Executor-36:ctx-138e84ea job-29198/job-29199 ctx-1f9eb415) (logid:f2cbdadb) Seq 161-629659522901785138: Sending { Cmd , MgmtId: 19873467853209, via: 161(s-712-VM), Ver: v1, Flags: 100011, [{"org.apache.cloudstack.storage.command.DeleteCommand":{"data":{"org.apach e.cloudstack.storage.to.SnapshotObjectTO":{"path":"snapshots/10/924/14645f6 a-bcce-42f8-a7a2-d93cceb5f00a.vhd","volume":{"uuid":"284eadd7-c29a-423f-94e b-da4c548ad945","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.sto rage.to.PrimaryDataStoreTO":{"uuid":"8700cdda-f60b-35cc-93b7-3160058b481a", "id":16,"poolType":"NetworkFilesystem","host":"10.10.1.33","path":"/pool6/p rimary6","port":2049,"url":"NetworkFilesystem://10.10.1.33/pool6/primary6/? ROLE=Primary&STOREUUID=8700cdda-f60b-35cc-93b7-3160058b481a","isManaged":fa lse}},"name":"ROOT-252","size":21474836480,"path":"b81b00cc-6a68-42a1-94c0- 7f4089b79973","volumeId":924,"vmName":"i-4-252-VM","accountId":10,"format": "VHD","provisioningType":"THIN","id":924,"deviceId":0,"hypervisorType":"Xen Server"},"parentSnapshotPath":"snapshots/10/924/e98b594d-d2ae-4ba9-8507-04f 811b265c8.vhd","dataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://1 0.10.1.34/pool8/secondary8","_role":"Image"}},"vmName":"i-4-252-VM","name": "VM-server_ROOT-252_20181008170058","hypervisorType":"XenServer","id":152," quiescevm":false,"parents":["snapshots/10/924/fc51ac67-2bcd-4adf-b1a2-0e9b0 ec1ce1b.vhd","snapshots/10/924/5684cebc-50bb-4837-8996-2490ba4ee441.vhd","s napshots/10/924/946cc6fb-cc2b-4d8a-888d-b8bcaf787171.vhd","snapshots/10/924 /e98b594d-d2ae-4ba9-8507-04f811b265c8.vhd"],"physicalSize":0}},"wait":0}}] } 2018-10-10 20:01:37,368 DEBUG [c.c.a.t.Request] (Work-Job-Executor-36:ctx-138e84ea job-29198/job-29199 ctx-1f9eb415) (logid:f2cbdadb) Seq 161-629659522901785138: Received: { Ans: , MgmtId: 19873467853209, via: 161(s-712-VM), Ver: v1, Flags: 10, { Answer } } 2018-10-10 20:01:37,379 DEBUG [o.a.c.s.s.XenserverSnapshotStrategy] (Work-Job-Executor-36:ctx-138e84ea job-29198/job-29199 ctx-1f9eb415) (logid:f2cbdadb) Snapshot: 143 doesn't have children, so it's ok to delete it and its parents 2018-10-10 20:01:37,413 DEBUG [c.c.h.o.r.Ovm3HypervisorGuru] (Work-Job-Executor-36:ctx-138e84ea job-29198/job-29199 ctx-1f9eb415) (logid:f2cbdadb) getCommandHostDelegation: class org.apache.cloudstack.storage.command.DeleteCommand 2018-10-10 20:01:37,413 DEBUG [c.c.h.XenServerGuru] (Work-Job-Executor-36:ctx-138e84ea job-29198/job-29199 ctx-1f9eb415) (logid:f2cbdadb) We are returning the default host to execute commands because the command is not of Copy type. 2018-10-10 20:01:37,415 DEBUG [c.c.a.t.Request] (Work-Job-Executor-36:ctx-138e84ea job-29198/job-29199 ctx-1f9eb415) (logid:f2cbdadb) Seq 161-629659522901785139: Sending { Cmd , MgmtId: 19873467853209, via: 161(s-712-VM), Ver: v1, Flags: 100011, [{"org.apache.cloudstack.storage.command.DeleteCommand":{"data":{"org.apach e.cloudstack.storage.to.SnapshotObjectTO":{"path":"snapshots/10/924/e98b594 d-d2ae-4ba9-8507-04f811b265c8.vhd","volume":{"uuid":"284eadd7-c29a-423f-94e b-da4c548ad945","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.sto rage.to.PrimaryDataStoreTO":{"uuid":"8700cdda-f60b-35cc-93b7-3160058b481a", "id":16,"poolType":"NetworkFilesystem","host":"10.10.1.33","path":"/pool6/p rimary6","port":2049,"url":"NetworkFilesystem://10.10.1.33/pool6/primary6/? ROLE=Primary&STOREUUID=8700cdda-f60b-35cc-93b7-3160058b481a","isManaged":fa lse}},"name":"ROOT-252","size":21474836480,"path":"b81b00cc-6a68-42a1-94c0- 7f4089b79973","volumeId":924,"vmName":"i-4-252-VM","accountId":10,"format": "VHD","provisioningType":"THIN","id":924,"deviceId":0,"hypervisorType":"Xen Server"},"parentSnapshotPath":"snapshots/10/924/946cc6fb-cc2b-4d8a-888d-b8b caf787171.vhd","dataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://1 0.10.1.34/pool8/secondary8","_role":"Image"}},"vmName":"i-4-252-VM","name": "VM-server_ROOT-252_20181007170057","hypervisorType":"XenServer","id":143," quiescevm":false,"parents":["snapshots/10/924/fc51ac67-2bcd-4adf-b1a2-0e9b0 ec1ce1b.vhd","snapshots/10/924/5684cebc-50bb-4837-8996-2490ba4ee441.vhd","s napshots/10/924/946cc6fb-cc2b-4d8a-888d-b8bcaf787171.vhd"],"physicalSize":0 }},"wait":0}}] } 2018-10-10 20:01:37,452 DEBUG [c.c.a.t.Request] (Work-Job-Executor-36:ctx-138e84ea job-29198/job-29199 ctx-1f9eb415) (logid:f2cbdadb) Seq 161-629659522901785139: Received: { Ans: , MgmtId: 19873467853209, via: 161(s-712-VM), Ver: v1, Flags: 10, { Answer } } 2018-10-10 20:01:37,462 DEBUG [o.a.c.s.s.XenserverSnapshotStrategy] (Work-Job-Executor-36:ctx-138e84ea job-29198/job-29199 ctx-1f9eb415) (logid:f2cbdadb) Snapshot: 134 doesn't have children, so it's ok to delete it and its parents 2018-10-10 20:01:37,493 DEBUG [c.c.h.o.r.Ovm3HypervisorGuru] (Work-Job-Executor-36:ctx-138e84ea job-29198/job-29199 ctx-1f9eb415) (logid:f2cbdadb) getCommandHostDelegation: class org.apache.cloudstack.storage.command.DeleteCommand 2018-10-10 20:01:37,493 DEBUG [c.c.h.XenServerGuru] (Work-Job-Executor-36:ctx-138e84ea job-29198/job-29199 ctx-1f9eb415) (logid:f2cbdadb) We are returning the default host to execute commands because the command is not of Copy type. 2018-10-10 20:01:37,495 DEBUG [c.c.a.t.Request] (Work-Job-Executor-36:ctx-138e84ea job-29198/job-29199 ctx-1f9eb415) (logid:f2cbdadb) Seq 161-629659522901785140: Sending { Cmd , MgmtId: 19873467853209, via: 161(s-712-VM), Ver: v1, Flags: 100011, [{"org.apache.cloudstack.storage.command.DeleteCommand":{"data":{"org.apach e.cloudstack.storage.to.SnapshotObjectTO":{"path":"snapshots/10/924/946cc6f b-cc2b-4d8a-888d-b8bcaf787171.vhd","volume":{"uuid":"284eadd7-c29a-423f-94e b-da4c548ad945","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.sto rage.to.PrimaryDataStoreTO":{"uuid":"8700cdda-f60b-35cc-93b7-3160058b481a", "id":16,"poolType":"NetworkFilesystem","host":"10.10.1.33","path":"/pool6/p rimary6","port":2049,"url":"NetworkFilesystem://10.10.1.33/pool6/primary6/? ROLE=Primary&STOREUUID=8700cdda-f60b-35cc-93b7-3160058b481a","isManaged":fa lse}},"name":"ROOT-252","size":21474836480,"path":"b81b00cc-6a68-42a1-94c0- 7f4089b79973","volumeId":924,"vmName":"i-4-252-VM","accountId":10,"format": "VHD","provisioningType":"THIN","id":924,"deviceId":0,"hypervisorType":"Xen Server"},"parentSnapshotPath":"snapshots/10/924/5684cebc-50bb-4837-8996-249 0ba4ee441.vhd","dataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://1 0.10.1.34/pool8/secondary8","_role":"Image"}},"vmName":"i-4-252-VM","name": "VM-server_ROOT-252_20181006170057","hypervisorType":"XenServer","id":134," quiescevm":false,"parents":["snapshots/10/924/fc51ac67-2bcd-4adf-b1a2-0e9b0 ec1ce1b.vhd","snapshots/10/924/5684cebc-50bb-4837-8996-2490ba4ee441.vhd"]," physicalSize":0}},"wait":0}}] } 2018-10-10 20:01:37,535 DEBUG [c.c.a.t.Request] (Work-Job-Executor-36:ctx-138e84ea job-29198/job-29199 ctx-1f9eb415) (logid:f2cbdadb) Seq 161-629659522901785140: Received: { Ans: , MgmtId: 19873467853209, via: 161(s-712-VM), Ver: v1, Flags: 10, { Answer } } 2018-10-10 20:01:37,546 DEBUG [o.a.c.s.s.XenserverSnapshotStrategy] (Work-Job-Executor-36:ctx-138e84ea job-29198/job-29199 ctx-1f9eb415) (logid:f2cbdadb) Snapshot: 125 doesn't have children, so it's ok to delete it and its parents 2018-10-10 20:01:37,573 DEBUG [c.c.h.o.r.Ovm3HypervisorGuru] (Work-Job-Executor-36:ctx-138e84ea job-29198/job-29199 ctx-1f9eb415) (logid:f2cbdadb) getCommandHostDelegation: class org.apache.cloudstack.storage.command.DeleteCommand 2018-10-10 20:01:37,573 DEBUG [c.c.h.XenServerGuru] (Work-Job-Executor-36:ctx-138e84ea job-29198/job-29199 ctx-1f9eb415) (logid:f2cbdadb) We are returning the default host to execute commands because the command is not of Copy type. 2018-10-10 20:01:37,574 DEBUG [c.c.a.t.Request] (Work-Job-Executor-36:ctx-138e84ea job-29198/job-29199 ctx-1f9eb415) (logid:f2cbdadb) Seq 161-629659522901785141: Sending { Cmd , MgmtId: 19873467853209, via: 161(s-712-VM), Ver: v1, Flags: 100011, [{"org.apache.cloudstack.storage.command.DeleteCommand":{"data":{"org.apach e.cloudstack.storage.to.SnapshotObjectTO":{"path":"snapshots/10/924/5684ceb c-50bb-4837-8996-2490ba4ee441.vhd","volume":{"uuid":"284eadd7-c29a-423f-94e b-da4c548ad945","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.sto rage.to.PrimaryDataStoreTO":{"uuid":"8700cdda-f60b-35cc-93b7-3160058b481a", "id":16,"poolType":"NetworkFilesystem","host":"10.10.1.33","path":"/pool6/p rimary6","port":2049,"url":"NetworkFilesystem://10.10.1.33/pool6/primary6/? ROLE=Primary&STOREUUID=8700cdda-f60b-35cc-93b7-3160058b481a","isManaged":fa lse}},"name":"ROOT-252","size":21474836480,"path":"b81b00cc-6a68-42a1-94c0- 7f4089b79973","volumeId":924,"vmName":"i-4-252-VM","accountId":10,"format": "VHD","provisioningType":"THIN","id":924,"deviceId":0,"hypervisorType":"Xen Server"},"parentSnapshotPath":"snapshots/10/924/fc51ac67-2bcd-4adf-b1a2-0e9 b0ec1ce1b.vhd","dataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://1 0.10.1.34/pool8/secondary8","_role":"Image"}},"vmName":"i-4-252-VM","name": "VM-server_ROOT-252_20181005170057","hypervisorType":"XenServer","id":125," quiescevm":false,"parents":["snapshots/10/924/fc51ac67-2bcd-4adf-b1a2-0e9b0 ec1ce1b.vhd"],"physicalSize":0}},"wait":0}}] } 2018-10-10 20:01:37,667 DEBUG [c.c.a.t.Request] (Work-Job-Executor-36:ctx-138e84ea job-29198/job-29199 ctx-1f9eb415) (logid:f2cbdadb) Seq 161-629659522901785141: Received: { Ans: , MgmtId: 19873467853209, via: 161(s-712-VM), Ver: v1, Flags: 10, { Answer } } 2018-10-10 20:01:37,678 DEBUG [o.a.c.s.s.XenserverSnapshotStrategy] (Work-Job-Executor-36:ctx-138e84ea job-29198/job-29199 ctx-1f9eb415) (logid:f2cbdadb) Snapshot: 116 doesn't have children, so it's ok to delete it and its parents 2018-10-10 20:01:37,700 DEBUG [c.c.h.o.r.Ovm3HypervisorGuru] (Work-Job-Executor-36:ctx-138e84ea job-29198/job-29199 ctx-1f9eb415) (logid:f2cbdadb) getCommandHostDelegation: class org.apache.cloudstack.storage.command.DeleteCommand 2018-10-10 20:01:37,700 DEBUG [c.c.h.XenServerGuru] (Work-Job-Executor-36:ctx-138e84ea job-29198/job-29199 ctx-1f9eb415) (logid:f2cbdadb) We are returning the default host to execute commands because the command is not of Copy type. 2018-10-10 20:01:37,702 DEBUG [c.c.a.t.Request] (Work-Job-Executor-36:ctx-138e84ea job-29198/job-29199 ctx-1f9eb415) (logid:f2cbdadb) Seq 161-629659522901785142: Sending { Cmd , MgmtId: 19873467853209, via: 161(s-712-VM), Ver: v1, Flags: 100011, [{"org.apache.cloudstack.storage.command.DeleteCommand":{"data":{"org.apach e.cloudstack.storage.to.SnapshotObjectTO":{"path":"snapshots/10/924/fc51ac6 7-2bcd-4adf-b1a2-0e9b0ec1ce1b.vhd","volume":{"uuid":"284eadd7-c29a-423f-94e b-da4c548ad945","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.sto rage.to.PrimaryDataStoreTO":{"uuid":"8700cdda-f60b-35cc-93b7-3160058b481a", "id":16,"poolType":"NetworkFilesystem","host":"10.10.1.33","path":"/pool6/p rimary6","port":2049,"url":"NetworkFilesystem://10.10.1.33/pool6/primary6/? ROLE=Primary&STOREUUID=8700cdda-f60b-35cc-93b7-3160058b481a","isManaged":fa lse}},"name":"ROOT-252","size":21474836480,"path":"b81b00cc-6a68-42a1-94c0- 7f4089b79973","volumeId":924,"vmName":"i-4-252-VM","accountId":10,"format": "VHD","provisioningType":"THIN","id":924,"deviceId":0,"hypervisorType":"Xen Server"},"dataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://10.10.1 .34/pool8/secondary8","_role":"Image"}},"vmName":"i-4-252-VM","name":"VM-se rver_ROOT-252_20181004170057","hypervisorType":"XenServer","id":116,"quiesc evm":false,"physicalSize":0}},"wait":0}}] } 2018-10-10 20:01:45,260 DEBUG [c.c.a.t.Request] (Work-Job-Executor-36:ctx-138e84ea job-29198/job-29199 ctx-1f9eb415) (logid:f2cbdadb) Seq 161-629659522901785142: Received: { Ans: , MgmtId: 19873467853209, via: 161(s-712-VM), Ver: v1, Flags: 10, { Answer } } 2018-10-10 20:01:45,288 DEBUG [c.c.r.ResourceLimitManagerImpl] (Work-Job-Executor-36:ctx-138e84ea job-29198/job-29199 ctx-1f9eb415) (logid:f2cbdadb) Updating resource Type = snapshot count for Account = 10 Operation = decreasing Amount = 1 2018-10-10 20:01:45,300 DEBUG [c.c.r.ResourceLimitManagerImpl] (Work-Job-Executor-36:ctx-138e84ea job-29198/job-29199 ctx-1f9eb415) (logid:f2cbdadb) Updating resource Type = secondary_storage count for Account = 10 Operation = decreasing Amount = 434999808 2018-10-10 20:01:45,332 DEBUG [c.c.r.ResourceLimitManagerImpl] (Work-Job-Executor-36:ctx-138e84ea job-29198/job-29199 ctx-1f9eb415) (logid:f2cbdadb) Updating resource Type = secondary_storage count for Account = 10 Operation = decreasing Amount = 21023026688 2018-10-10 20:01:45,343 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-36:ctx-138e84ea job-29198/job-29199 ctx-1f9eb415) (logid:f2cbdadb) Done executing VM work job: com.cloud.vm.VmWorkTakeVolumeSnapshot{"volumeId":924,"policyId":53,"snapsho tId":180,"quiesceVm":false,"asyncBackup":false,"userId":1,"accountId":10,"v mId":252,"handlerName":"VolumeApiServiceImpl"} 2018-10-10 20:01:45,343 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-36:ctx-138e84ea job-29198/job-29199 ctx-1f9eb415) (logid:f2cbdadb) Complete async job-29199, jobStatus: SUCCEEDED, resultCode: 0, result: rO0ABXNyAA5qYXZhLmxhbmcuTG9uZzuL5JDMjyPfAgABSgAFdmFsdWV4cgAQamF2YS5sYW5nLk5 1bWJlcoaslR0LlOCLAgAAeHAAAAAAAAAAtA 2018-10-10 20:01:45,344 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-36:ctx-138e84ea job-29198/job-29199 ctx-1f9eb415) (logid:f2cbdadb) Publish async job-29199 complete on message bus 2018-10-10 20:01:45,344 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-36:ctx-138e84ea job-29198/job-29199 ctx-1f9eb415) (logid:f2cbdadb) Wake up jobs related to job-29199 2018-10-10 20:01:45,344 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-36:ctx-138e84ea job-29198/job-29199 ctx-1f9eb415) (logid:f2cbdadb) Update db status for job-29199 2018-10-10 20:01:45,345 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-36:ctx-138e84ea job-29198/job-29199 ctx-1f9eb415) (logid:f2cbdadb) Wake up jobs joined with job-29199 and disjoin all subjobs created from job- 29199 2018-10-10 20:01:45,355 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-36:ctx-138e84ea job-29198/job-29199) (logid:f2cbdadb) Done with run of VM work job: com.cloud.vm.VmWorkTakeVolumeSnapshot for VM 252, job origin: 29198 2018-10-10 20:01:45,355 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-36:ctx-138e84ea job-29198/job-29199) (logid:f2cbdadb) Done executing com.cloud.vm.VmWorkTakeVolumeSnapshot for job-29199 2018-10-10 20:01:45,357 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-36:ctx-138e84ea job-29198/job-29199) (logid:f2cbdadb) Remove job-29199 from job monitoring 2018-10-10 20:01:45,394 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-91:ctx-383c6cf4 job-29198 ctx-b559e6db) (logid:f2cbdadb) Complete async job-29198, jobStatus: SUCCEEDED, resultCode: 0, result: org.apache.cloudstack.api.response.SnapshotResponse/snapshot/{"id":"b87589b 5-e1f0-4303-9cbb-870b2c06ace5","account":"sami","domainid":"2947e215-4889-4 06d-b0a9-b8d82de1a276","domain":"VM-DOMAIN","snapshottype":"DAILY","volumei d":"284eadd7-c29a-423f-94eb-da4c548ad945","volumename":"ROOT-252","volumety pe":"ROOT","created":"2018-10-10T20:00:58+0300","name":"VM-server_ROOT-252_ 20181010170058","intervaltype":"DAILY","state":"BackedUp","physicalsize":45 1809792,"zoneid":"533c8f88-2637-4c0e-8210-e0a355b62d82","tags":[],"revertab le":false,"ostypeid":"da491b96-3748-11e5-a683-121326fde999","osdisplayname" :"CentOS 6.5 (64-bit)","virtualsize":21474836480} 2018-10-10 20:01:45,394 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-91:ctx-383c6cf4 job-29198 ctx-b559e6db) (logid:f2cbdadb) Publish async job-29198 complete on message bus 2018-10-10 20:01:45,394 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-91:ctx-383c6cf4 job-29198 ctx-b559e6db) (logid:f2cbdadb) Wake up jobs related to job-29198 2018-10-10 20:01:45,394 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-91:ctx-383c6cf4 job-29198 ctx-b559e6db) (logid:f2cbdadb) Update db status for job-29198 2018-10-10 20:01:45,395 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-91:ctx-383c6cf4 job-29198 ctx-b559e6db) (logid:f2cbdadb) Wake up jobs joined with job-29198 and disjoin all subjobs created from job- 29198 2018-10-10 20:01:45,403 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-91:ctx-383c6cf4 job-29198) (logid:f2cbdadb) Done executing org.apache.cloudstack.api.command.user.snapshot.CreateSnapshotCmd for job-29198 2018-10-10 20:01:45,403 INFO [o.a.c.f.j.i.AsyncJobMonitor] (API-Job-Executor-91:ctx-383c6cf4 job-29198) (logid:f2cbdadb) Remove job-29198 from job monitoring 10.10.2018 19.18, "Andrei Mikhailovsky" <and...@arhont.com.INVALID>: >Hi > >I can confirm that I am also having this issue on 4.11.1.0. To be honest, >this issue was always present for me as far as I remember. > >Kind of an urgent issue to fix to stop people running out of space. > >Cheers > >----- Original Message ----- >> From: "Rafael Weingärtner" <rafaelweingart...@gmail.com> >> To: "users" <users@cloudstack.apache.org> >> Sent: Wednesday, 10 October, 2018 16:24:54 >> Subject: Re: VM Snapshot not removed from primary SR > >> Well, I am almost sure I have seen a PR fixing something like you >>describe, >> I thought that it went into 4.11.1.0.However, only with a more in depth >> debugging I would be able to confirm your problem. >> >> Are you seeing any unexpected exception in your log files? >> >> On Wed, Oct 10, 2018 at 11:54 AM Sami Rajala (FAPPS) >><sami.raj...@fapps.com> >> wrote: >> >>> Hi, >>> >>> CS running on 4.11.1.0 and does not work. >>> >>> BR >>> -sami >>> >>> >>> 10.10.2018 16.49, "Rafael Weingärtner" <rafaelweingart...@gmail.com>: >>> >>> >If I am not mistaken, this has already been fixed in 4.11.1.0 >>> > >>> >On Wed, Oct 10, 2018 at 10:31 AM Sami Rajala <sami.raj...@fapps.com> >>> >wrote: >>> > >>> >> Hi, >>> >> >>> >> >>> >> I have got zero advice for this. >>> >> >>> >> "I have had weird issue since I updated CS from 4.9 to 4.10. >>> >> CS does not delete/remove temporary snapshot from primary SR and I >>>have >>> >> had to removed it by manual time to time, before 30 snapshot limit >>>has >>> >> reached. >>> >> + doesn't CS not update secondary_storege count on snapshot_count >>>table² >>> >> >>> >> >>> >> >>> >> >>> >> Now I have a situation where Xenserver has 19 snapshot on primary >>>SR for >>> >> each VM + resource count for ²secondary_storege² in database >>>increase >>> >>all >>> >> the time per account. >>> >> ACS storage cleaner removed old snapshots from secondary when they >>> >>getting >>> >> old, but thats all, not decrease resource count for >>> ²secondary_storege² >>> >> with value of deleted snapshot ( or not remove snapshot from >>>primary SR >>> >> after snapshot has created and copied to secondary ) >>> >> >>> >> I have still delete primary snapshot by manual + give a new value >>>for >>> >> ²secondary_storege² before they reach limit. >>> >> >>> >> has anyone got this kind of issue? any fix >>> >> >>> >> BR >>> >> -sami