I have just restarted the management server, and the templates copy process has begin to the new NFS server...
Will update. On 16 December 2013 16:14, Andrija Panic <andrija.pa...@gmail.com> wrote: > HI Geoff, > I have just added new NFS secondary storage to CS. > Can you please tell, when shall I expect all existing ISOs and templates > to be copied over (start being copied...) - so far, I can observe NO > network traffic. > Is this maybe configurable like purge thread, or similar ? I have also > issues the script for checking the SSVM ( > /usr/local/cloud/systemvm/ssvm-check.sh) and have no problems so far. > > More important, I can confirm that I do NOT have checksum inside the > "template.properties" on public templates, only on system templates... > And I can confirm that I do not have public templates being replicated on > all NFS storages...that is strange. ISOs do get replicated, but public > templates does not... > Is this a bug or what...? I can not observer any errors in management > log... > > Thanks, > Andrija > > > > On 13 December 2013 20:10, Andrija Panic <andrija.pa...@gmail.com> wrote: > >> Thank you very much, I will check... that... funny thing, I search for >> files created in last i.e. 1 hour, and there is only one file created on 1 >> NFS, no files created on other NFSs. >> >> Thanks >> >> Sent from Google Nexus 4 >> On Dec 13, 2013 6:06 PM, "Geoff Higginbottom" < >> geoff.higginbot...@shapeblue.com> wrote: >> >>> The templates get unique names, however they are in the same folder >>> structure. >>> >>> e.g. >>> >>> My S1 has >>> \\IPADDRESS\lonsec\template\tmpl\1\5 >>> >>> And my S2 has >>> \\IPADDDRESS\lonsec2\template\tmpl\1\5 >>> >>> Note that the '1' is the account ID of the user who created the >>> template, in this case 'system' as this is a system vm template, the '5' is >>> simply the 5th template created on this system >>> >>> The two template.properties files contain the following >>> >>> S1 template.properties file >>> # >>> #Mon May 20 14:11:06 UTC 2013 >>> filename=d015ebd8-5395-31a5-9648-a179062885d8.vhd >>> vhd=true >>> id=5 >>> vhd.filename=d015ebd8-5395-31a5-9648-a179062885d8.vhd >>> public=true >>> uniquename=centos56-x86_64-xen >>> vhd.virtualsize=21474836480 >>> virtualsize=21474836480 >>> checksum=905cec879afd9c9d22ecc8036131a180 >>> hvm=false >>> description=CentOS 5.6(64-bit) no GUI (XenServer) >>> vhd.size=1758786048 >>> size=1758786048 >>> >>> S1 template.properties file >>> # >>> #Wed Nov 21 23:14:59 UTC 2012 >>> filename=8b106378-7d6d-31b3-aab7-bfc85ef97884.vhd >>> vhd=true >>> id=5 >>> vhd.filename=8b106378-7d6d-31b3-aab7-bfc85ef97884.vhd >>> public=true >>> uniquename=centos56-x86_64-xen >>> vhd.virtualsize=21474836480 >>> virtualsize=21474836480 >>> checksum=905cec879afd9c9d22ecc8036131a180 >>> hvm=false >>> description=CentOS 5.6(64-bit) no GUI (XenServer) >>> vhd.size=1758786048 >>> size=1758786048 >>> dsa >>> >>> Note that the line >>> checksum=905cec879afd9c9d22ecc8036131a180 >>> is common to both, you will also find this value in the db in table >>> cloud.vm_template >>> This is the link to the template on disk, and the one referenced in the >>> DB >>> >>> You can also see from the dates within the two properties files, that >>> this template was originally deployed back in may, but when I added the 2nd >>> Secondary Storage Node in November, the template was automatically copied >>> across. >>> >>> Hopefully all this info helps you. >>> >>> Regards >>> >>> Geoff Higginbottom >>> >>> D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581 >>> >>> geoff.higginbot...@shapeblue.com >>> >>> -----Original Message----- >>> From: Andrija Panic [mailto:andrija.pa...@gmail.com] >>> Sent: 13 December 2013 16:47 >>> To: users@cloudstack.apache.org >>> Subject: Re: Merging/Removing Secondary Storage NFS >>> >>> Hi Jeff, thanks for that detailed explanation, I'm on the KVM by the >>> way... >>> For the *volume* snaphost, I can see that real snapshot exist localy (I >>> say real snaphost, not clone), but also the clone is created on 1 of those >>> NFS servers... >>> >>> Can you somehow instruct me to check if new template I have just >>> created, is actualy copied on all 3 NFS hosts (all3 NFS are online, and >>> working >>> fine) ? >>> Template is only 4GB of real size on the host, and it should be very >>> quickly copied to where it shoyld be. (my IO and netowrk traffic are pretty >>> low in general). >>> >>> Should the templates files be created on all 3 NFS storages, with the >>> same file name? Or can I see this somehow from the database...I'm trying to >>> decode it by myself, but can't figure this out... >>> >>> Thanks again, >>> Andrija >>> >>> >>> >>> >>> On 13 December 2013 17:35, Geoff Higginbottom < >>> geoff.higginbot...@shapeblue.com> wrote: >>> >>> > Andrija, >>> > >>> > The design is that any Public Template, or ISO gets copied to every >>> > secondary storage in the zone. The copying is undertaken by the SSVM >>> > and will obviously take some time if you have just added a 2nd Public >>> > ISO or Template, so your copy process may not have finished. >>> > >>> > For 4.2 'Snapshots' are now even more confusing than ever. We now >>> have: >>> > >>> > 1. VM Snapshots (ESXi & XenServer Only) these are true Hypervisor >>> > Snapshots, enabling quick roll back to the Snapshot, including Memory >>> State. >>> > 2. Volume Snapshots (better thought of as Volume Backups) >>> > >>> > VM Snapshots remain on Primary Storage to enable the quick roll-back >>> > to Snapshot to work. >>> > Volume Snapshots (backups) get copied to Secondary Storage. If you >>> > have more than one Secondary Storage available, the first backup is >>> > copied to one of the Secondary Storage volumes, chosen at random, then >>> > all subsequent backups are always copied to the same Secondary Storage >>> > volume >>> > >>> > Regards >>> > >>> > Geoff Higginbottom >>> > >>> > D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581 >>> > >>> > geoff.higginbot...@shapeblue.com >>> > >>> > -----Original Message----- >>> > From: Andrija Panic [mailto:andrija.pa...@gmail.com] >>> > Sent: 13 December 2013 16:29 >>> > To: users@cloudstack.apache.org >>> > Subject: Re: Merging/Removing Secondary Storage NFS >>> > >>> > HI Geoff, >>> > But, I have verified that my public templates are storaged only on 1 >>> > host... (at least based on file name of the template on one of those >>> > host - these file names does NOT exist on other 2 NFS hosts...) Any >>> clue ? >>> > >>> > Can you also confirm that now in 4.2, since snaphost are really a >>> > snapshots, they are not moved to secondary storage, but exist localy >>> > on the primary storage next to the original image they were created >>> > from (I can see this with lsof and qemu-img info). >>> > >>> > Thanks >>> > >>> > >>> > On 13 December 2013 17:21, Geoff Higginbottom < >>> > geoff.higginbot...@shapeblue.com> wrote: >>> > >>> > > You don’t need to copy Public Templates from S1 to S2 if they have >>> > > both been on line as Public Templates are always copied to every sec >>> > > storage in the zone >>> > > >>> > > Regards >>> > > >>> > > Geoff Higginbottom >>> > > >>> > > D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581 >>> > > >>> > > geoff.higginbot...@shapeblue.com >>> > > >>> > > -----Original Message----- >>> > > From: Andrija Panic [mailto:andrija.pa...@gmail.com] >>> > > Sent: 13 December 2013 16:11 >>> > > To: users@cloudstack.apache.org >>> > > Subject: Re: Merging/Removing Secondary Storage NFS >>> > > >>> > > Just to correct myself: that guide: tells nice job for migrating >>> > > snapshots. >>> > > >>> > > But I'm confused why only private templates should be migrated, why >>> > > not also the public ones? >>> > > >>> > > Quote from the page: >>> > > *"Note*: You must copy only private templates on Secondary storage >>> > > host S2 to S1." >>> > > And the whole guide is about migrating those private templates >>> > > (these are mostly system VM templates and such) >>> > > >>> > > What about public templates? I have predefined some public >>> > > templates, that as far as I can see, are only storaged on some of my >>> 3 NFS hosts... >>> > > ? >>> > > >>> > > Thanks >>> > > >>> > > >>> > > >>> > > On 13 December 2013 16:51, Andrija Panic <andrija.pa...@gmail.com> >>> > wrote: >>> > > >>> > > > HI, >>> > > > >>> > > > anyone has good doc/procedure for removing old NFS (migrate >>> > > > everything to new NFS server) ? >>> > > > >>> > > > I was thinking of editing the database - dump to sql file, search, >>> > > > replace old IP address with new IP address, and rsync everything >>> > > > from old NFS to new NFS, keeping the same directory structure. >>> > > > Then import the edited dump file. >>> > > > >>> > > > I also found some Citrix's guide, but that does not seem to >>> > > > migrate everything (only the system VM templates, as per my >>> > > > understanding after reading the docs...) >>> > > > http://support.citrix.com/article/CTX135229 >>> > > > >>> > > > Thanks. >>> > > > >>> > > > -- >>> > > > >>> > > > Andrija Panić >>> > > > -------------------------------------- >>> > > > http://admintweets.com >>> > > > -------------------------------------- >>> > > > >>> > > >>> > > >>> > > >>> > > -- >>> > > >>> > > Andrija Panić >>> > > -------------------------------------- >>> > > http://admintweets.com >>> > > -------------------------------------- >>> > > This email and any attachments to it may be confidential and are >>> > > intended solely for the use of the individual to whom it is >>> addressed. >>> > > Any views or opinions expressed are solely those of the author and >>> > > do not necessarily represent those of Shape Blue Ltd or related >>> > > companies. If you are not the intended recipient of this email, you >>> > > must neither take any action based upon its contents, nor copy or >>> > > show it to anyone. Please contact the sender if you believe you have >>> > > received this email in error. Shape Blue Ltd is a company >>> > > incorporated in England & Wales. ShapeBlue Services India LLP is a >>> > > company incorporated in India and is operated under license from >>> > > Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company >>> > > incorporated in Brasil and is operated under license from Shape Blue >>> > > Ltd. ShapeBlue is a >>> > registered trademark. >>> > > >>> > >>> > >>> > >>> > -- >>> > >>> > Andrija Panić >>> > -------------------------------------- >>> > http://admintweets.com >>> > -------------------------------------- >>> > This email and any attachments to it may be confidential and are >>> > intended solely for the use of the individual to whom it is addressed. >>> > Any views or opinions expressed are solely those of the author and do >>> > not necessarily represent those of Shape Blue Ltd or related >>> > companies. If you are not the intended recipient of this email, you >>> > must neither take any action based upon its contents, nor copy or show >>> > it to anyone. Please contact the sender if you believe you have >>> > received this email in error. Shape Blue Ltd is a company incorporated >>> > in England & Wales. ShapeBlue Services India LLP is a company >>> > incorporated in India and is operated under license from Shape Blue >>> > Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in >>> > Brasil and is operated under license from Shape Blue Ltd. ShapeBlue is >>> a registered trademark. >>> > >>> >>> >>> >>> -- >>> >>> Andrija Panić >>> -------------------------------------- >>> http://admintweets.com >>> -------------------------------------- >>> This email and any attachments to it may be confidential and are >>> intended solely for the use of the individual to whom it is addressed. Any >>> views or opinions expressed are solely those of the author and do not >>> necessarily represent those of Shape Blue Ltd or related companies. If you >>> are not the intended recipient of this email, you must neither take any >>> action based upon its contents, nor copy or show it to anyone. Please >>> contact the sender if you believe you have received this email in error. >>> Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue >>> Services India LLP is a company incorporated in India and is operated under >>> license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a >>> company incorporated in Brasil and is operated under license from Shape >>> Blue Ltd. ShapeBlue is a registered trademark. >>> >> > > > -- > > Andrija Panić > -------------------------------------- > http://admintweets.com > -------------------------------------- > -- Andrija Panić -------------------------------------- http://admintweets.com --------------------------------------
