Re: ACS 4.15.1 Migration between NFS Secondary storage servers interrupted
I found why the other templates didn't were migrated on 2nd sec storage server Mgmt Server was blocked on template vm id1 (system vm template) In fact in initialised sys template vm from ACS mgmt server to 2nd sec storage server with : cloud-install-sys-tmplt So it was blocked to this operation Finally i tried to help ACS server, moving the template id1 folder from 1st sec storage to 2nd sec storage I finally got the other templates downloaded onto my 2nd sec storage server But after restarting ACS mgmt server, the template id1 folder has been deleted on both secondary storage servers I still have entries on BDD for template id1 on store_id 1 and store_id 2, but the folder does not exist anymore ! :/ How can i get back my system vm template ? i cant start any system vm routers Thanks for your help Regards, Benoit Le mar. 26 oct. 2021 à 16:56, Pearl d'Silva a écrit : > One way to identify it would be to check the vm_template table for > templates that are marked as public but do not have a url (i.e., null) - > such templates should be migrated, but maybe skipped, as in 4.15, public > templates aren't migrated as they get downloaded on all stores in a zone. > However, such templates i.e., templates created from volumes / snapshots > that are marked as public do not get synced. This was addressed in > https://github.com/apache/cloudstack/pull/5404 > > > Thanks, > > From: benoit lair > Sent: Tuesday, October 26, 2021 8:01 PM > To: users@cloudstack.apache.org > Subject: Re: ACS 4.15.1 Migration between NFS Secondary storage servers > interrupted > > Hi Pearl, > > I am checking the logs of the mgmt server > About the possibility the template came from a volume, is there way to > check this in database ? > > Regards, Benoit > > Le mar. 26 oct. 2021 à 14:53, Pearl d'Silva a > écrit : > > > Hi Benoit, > > > > Can you please check the logs to see if the specific data objects were > > skipped from being migrated because they couldn't be accomodated on the > > destination store. Also, were these templates that were left behind > created > > from volumes / snapshots - in that case, in 4.15, it is a known issue to > > skip those files, and has been addressed in 4.16. > > > > Thanks, > > Pearl > > ____________ > > From: benoit lair > > Sent: Tuesday, October 26, 2021 5:35 PM > > To: users@cloudstack.apache.org ; > > d...@cloudstack.apache.org > > Subject: Re: ACS 4.15.1 Migration between NFS Secondary storage servers > > interrupted > > > > Hello Guys, > > > > I have still the problem on ACS 4.15 > > I am trying to migrate my first nfs secondary storage server to another > nfs > > server > > ACS says in the events the migration is IMAGE.STORE.MIGRATE.DATA : > > Successfully > > completed migrating Image store data. Migrating files/data objects from : > > NFS Secondary storage 001 to: [NFS Secondary storage 002] > > > > However, there are still templates hosted on the primary nfs server > > > > any ideas why the migration does not work as expected ? > > > > Regards, Benoit > > Le mer. 20 oct. 2021 à 15:24, benoit lair a > écrit > > : > > > > > Hello, > > > > > > I am trying to migrate my first NFS secondary storage to a second NFS > one > > > I asked for a migration with a migration policy "complete" > > > The job is working but finishes before migrating all the data > > > > > > I had to relaunch the migration which continues > > > > > > Any ideas ? > > > > > > Regards, Benoit > > > > > > > > > > > > > > >
Re: ACS 4.15.1 Migration between NFS Secondary storage servers interrupted
One way to identify it would be to check the vm_template table for templates that are marked as public but do not have a url (i.e., null) - such templates should be migrated, but maybe skipped, as in 4.15, public templates aren't migrated as they get downloaded on all stores in a zone. However, such templates i.e., templates created from volumes / snapshots that are marked as public do not get synced. This was addressed in https://github.com/apache/cloudstack/pull/5404 Thanks, From: benoit lair Sent: Tuesday, October 26, 2021 8:01 PM To: users@cloudstack.apache.org Subject: Re: ACS 4.15.1 Migration between NFS Secondary storage servers interrupted Hi Pearl, I am checking the logs of the mgmt server About the possibility the template came from a volume, is there way to check this in database ? Regards, Benoit Le mar. 26 oct. 2021 à 14:53, Pearl d'Silva a écrit : > Hi Benoit, > > Can you please check the logs to see if the specific data objects were > skipped from being migrated because they couldn't be accomodated on the > destination store. Also, were these templates that were left behind created > from volumes / snapshots - in that case, in 4.15, it is a known issue to > skip those files, and has been addressed in 4.16. > > Thanks, > Pearl > > From: benoit lair > Sent: Tuesday, October 26, 2021 5:35 PM > To: users@cloudstack.apache.org ; > d...@cloudstack.apache.org > Subject: Re: ACS 4.15.1 Migration between NFS Secondary storage servers > interrupted > > Hello Guys, > > I have still the problem on ACS 4.15 > I am trying to migrate my first nfs secondary storage server to another nfs > server > ACS says in the events the migration is IMAGE.STORE.MIGRATE.DATA : > Successfully > completed migrating Image store data. Migrating files/data objects from : > NFS Secondary storage 001 to: [NFS Secondary storage 002] > > However, there are still templates hosted on the primary nfs server > > any ideas why the migration does not work as expected ? > > Regards, Benoit > Le mer. 20 oct. 2021 à 15:24, benoit lair a écrit > : > > > Hello, > > > > I am trying to migrate my first NFS secondary storage to a second NFS one > > I asked for a migration with a migration policy "complete" > > The job is working but finishes before migrating all the data > > > > I had to relaunch the migration which continues > > > > Any ideas ? > > > > Regards, Benoit > > > > > >
Re: ACS 4.15.1 Migration between NFS Secondary storage servers interrupted
Hi Pearl, I am checking the logs of the mgmt server About the possibility the template came from a volume, is there way to check this in database ? Regards, Benoit Le mar. 26 oct. 2021 à 14:53, Pearl d'Silva a écrit : > Hi Benoit, > > Can you please check the logs to see if the specific data objects were > skipped from being migrated because they couldn't be accomodated on the > destination store. Also, were these templates that were left behind created > from volumes / snapshots - in that case, in 4.15, it is a known issue to > skip those files, and has been addressed in 4.16. > > Thanks, > Pearl > > From: benoit lair > Sent: Tuesday, October 26, 2021 5:35 PM > To: users@cloudstack.apache.org ; > d...@cloudstack.apache.org > Subject: Re: ACS 4.15.1 Migration between NFS Secondary storage servers > interrupted > > Hello Guys, > > I have still the problem on ACS 4.15 > I am trying to migrate my first nfs secondary storage server to another nfs > server > ACS says in the events the migration is IMAGE.STORE.MIGRATE.DATA : > Successfully > completed migrating Image store data. Migrating files/data objects from : > NFS Secondary storage 001 to: [NFS Secondary storage 002] > > However, there are still templates hosted on the primary nfs server > > any ideas why the migration does not work as expected ? > > Regards, Benoit > Le mer. 20 oct. 2021 à 15:24, benoit lair a écrit > : > > > Hello, > > > > I am trying to migrate my first NFS secondary storage to a second NFS one > > I asked for a migration with a migration policy "complete" > > The job is working but finishes before migrating all the data > > > > I had to relaunch the migration which continues > > > > Any ideas ? > > > > Regards, Benoit > > > > > >
Re: ACS 4.15.1 Migration between NFS Secondary storage servers interrupted
Hi Benoit, Can you please check the logs to see if the specific data objects were skipped from being migrated because they couldn't be accomodated on the destination store. Also, were these templates that were left behind created from volumes / snapshots - in that case, in 4.15, it is a known issue to skip those files, and has been addressed in 4.16. Thanks, Pearl From: benoit lair Sent: Tuesday, October 26, 2021 5:35 PM To: users@cloudstack.apache.org ; d...@cloudstack.apache.org Subject: Re: ACS 4.15.1 Migration between NFS Secondary storage servers interrupted Hello Guys, I have still the problem on ACS 4.15 I am trying to migrate my first nfs secondary storage server to another nfs server ACS says in the events the migration is IMAGE.STORE.MIGRATE.DATA : Successfully completed migrating Image store data. Migrating files/data objects from : NFS Secondary storage 001 to: [NFS Secondary storage 002] However, there are still templates hosted on the primary nfs server any ideas why the migration does not work as expected ? Regards, Benoit Le mer. 20 oct. 2021 à 15:24, benoit lair a écrit : > Hello, > > I am trying to migrate my first NFS secondary storage to a second NFS one > I asked for a migration with a migration policy "complete" > The job is working but finishes before migrating all the data > > I had to relaunch the migration which continues > > Any ideas ? > > Regards, Benoit >
Re: ACS 4.15.1 Migration between NFS Secondary storage servers interrupted
Hello Guys, I have still the problem on ACS 4.15 I am trying to migrate my first nfs secondary storage server to another nfs server ACS says in the events the migration is IMAGE.STORE.MIGRATE.DATA : Successfully completed migrating Image store data. Migrating files/data objects from : NFS Secondary storage 001 to: [NFS Secondary storage 002] However, there are still templates hosted on the primary nfs server any ideas why the migration does not work as expected ? Regards, Benoit Le mer. 20 oct. 2021 à 15:24, benoit lair a écrit : > Hello, > > I am trying to migrate my first NFS secondary storage to a second NFS one > I asked for a migration with a migration policy "complete" > The job is working but finishes before migrating all the data > > I had to relaunch the migration which continues > > Any ideas ? > > Regards, Benoit >
ACS 4.15.1 Migration between NFS Secondary storage servers interrupted
Hello, I am trying to migrate my first NFS secondary storage to a second NFS one I asked for a migration with a migration policy "complete" The job is working but finishes before migrating all the data I had to relaunch the migration which continues Any ideas ? Regards, Benoit