Re: Issue with Snapshots

2021-03-09 Thread Edward St Pierre
Hi, Yes it was working on the previous version which 4.13 Regards On Mon, 8 Mar 2021 at 13:02, Gabriel Bräscher wrote: > Hi, > > I think that we might have a bug on snapshot backed up on secondary. I have > checked my tests and the image on secondary storage is not deleted as well; > it has b

Re: Issue with Snapshots

2021-03-08 Thread Gabriel Bräscher
Hi, I think that we might have a bug on snapshot backed up on secondary. I have checked my tests and the image on secondary storage is not deleted as well; it has been passed more than enough time for CloudStack cleanup sec storage garbage. One question. Was it working before upgrading to 4.15? Wh

Re: Issue with Snapshots

2021-03-05 Thread Edward St Pierre
Hi, Thanks for that information and pointers on where to look, I have checked it out and the data was also on the secondary storage and the storage VM is mounting the NFS servers etc. (I have redeployed it just incase) I have gone through some of the older snapshots that are not getting removed,

Re: Issue with Snapshots

2021-03-05 Thread Gabriel Bräscher
Before seeing the last reply I had just tested on CloudStack 4.15 + Ceph + KVM, and it worked fine; however, I did the test with one snapshot of the volume. Maybe the scheduled/incremental snapshotting adds a different variable to the equation. >From my tests, the DB holds one reference as Ready o

Re: Issue with Snapshots

2021-03-05 Thread Edward St Pierre
Hi The issue happens multiple snapshots, I have run a test with scheduled hourly volume snapshots for a test, here are the logs: 2021-03-05 10:03:43,277 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-26:ctx-65993d1d job-6141/job-6142 ctx-43a8373c) (logid:fc7d7320) Execute VM work job: c

Re: Issue with Snapshots

2021-03-04 Thread Gabriel Bräscher
There was an open issue indeed but a PR solved it for 4.15. The issue reported on this email looks a bit different than the ones I have seen. Background on a recent issue: - Issue #4498 "RBD Snapshot fails when snapshot.backup.to.secondary: true" has been fixed by PR #4568 "kvm: Fix double-escape

Re: Issue with Snapshots

2021-03-04 Thread Rakesh v
If I remember properly there is already an issue raised for it in github Sent from my iPhone > On Mar 4, 2021, at 9:48 PM, Andrija Panic wrote: > > @Gabriel Beims Bräscher does this rings any bells > for you? I haven't played with Ceph / snap clean-up issue on 4.15 myself. > > Best, > >> On

Re: Issue with Snapshots

2021-03-04 Thread Andrija Panic
@Gabriel Beims Bräscher does this rings any bells for you? I haven't played with Ceph / snap clean-up issue on 4.15 myself. Best, On Tue, 2 Mar 2021 at 17:16, Edward St Pierre wrote: > Hi All, > > I Wonder if someone could help me. > > Currently using ceph for primary storage and have > 'snaps

Issue with Snapshots

2021-03-02 Thread Edward St Pierre
Hi All, I Wonder if someone could help me. Currently using ceph for primary storage and have 'snapshot.backup.to.secondary' enabled. Since upgrading to 4.15 the volume snapshots do not seem to be getting deleted from the secondary storage. Could this be a bug? Also when logged in as the main a