Any update on this ? Why does CS does not get into account that all ISOs are replicated on all NFS storages, and simply skip querying for their existance while deleting SS NFS ? Should I try to delete all lines with ISOs that reference the old SS to be removed ?
Thanks, On 16 December 2013 22:33, Andrija Panic <andrija.pa...@gmail.com> wrote: > Yes that is true, but it was ISOs copy (they are also located under > /templates/ folder, so I though it was really templates that were being > copied, but instead it was ISOs...) > I need to migrate all 3 NFSs to new one, and it seems like I'm going to > change database, which is not really my prefered way... > > > On 16 December 2013 22:27, Nitin Mehta <nitin.me...@citrix.com> wrote: > >> This is definitely not expected. But, in the thread below I see you >> writing that the restarting MS initiated template copy. Is that not the >> case ? >> >> On 16/12/13 11:58 AM, "Andrija Panic" <andrija.pa...@gmail.com> wrote: >> >> >Well, only ISOs have been copied to the new NFS storage... no other >> >templates... >> > >> >Is this expected behaviour or should I consider this a bug ? >> > >> >Any clue on troubleshooting this ? >> > >> > >> >On 16 December 2013 17:05, Andrija Panic <andrija.pa...@gmail.com> >> wrote: >> > >> >> I have just restarted the management server, and the templates copy >> >> process has begin to the new NFS server... >> >> >> >> Will update. >> >> >> >> >> >> On 16 December 2013 16:14, Andrija Panic <andrija.pa...@gmail.com> >> >>wrote: >> >> >> >>> HI Geoff, >> >>> I have just added new NFS secondary storage to CS. >> >>> Can you please tell, when shall I expect all existing ISOs and >> >>>templates >> >>> to be copied over (start being copied...) - so far, I can observe NO >> >>> network traffic. >> >>> Is this maybe configurable like purge thread, or similar ? I have also >> >>> issues the script for checking the SSVM ( >> >>> /usr/local/cloud/systemvm/ssvm-check.sh) and have no problems so far. >> >>> >> >>> More important, I can confirm that I do NOT have checksum inside the >> >>> "template.properties" on public templates, only on system templates... >> >>> And I can confirm that I do not have public templates being replicated >> >>>on >> >>> all NFS storages...that is strange. ISOs do get replicated, but public >> >>> templates does not... >> >>> Is this a bug or what...? I can not observer any errors in management >> >>> log... >> >>> >> >>> Thanks, >> >>> Andrija >> >>> >> >>> >> >>> >> >>> On 13 December 2013 20:10, Andrija Panic <andrija.pa...@gmail.com> >> >>>wrote: >> >>> >> >>>> Thank you very much, I will check... that... funny thing, I search >> for >> >>>> files created in last i.e. 1 hour, and there is only one file created >> >>>>on 1 >> >>>> NFS, no files created on other NFSs. >> >>>> >> >>>> Thanks >> >>>> >> >>>> Sent from Google Nexus 4 >> >>>> On Dec 13, 2013 6:06 PM, "Geoff Higginbottom" < >> >>>> geoff.higginbot...@shapeblue.com> wrote: >> >>>> >> >>>>> The templates get unique names, however they are in the same folder >> >>>>> structure. >> >>>>> >> >>>>> e.g. >> >>>>> >> >>>>> My S1 has >> >>>>> \\IPADDRESS\lonsec\template\tmpl\1\5 >> >>>>> >> >>>>> And my S2 has >> >>>>> \\IPADDDRESS\lonsec2\template\tmpl\1\5 >> >>>>> >> >>>>> Note that the '1' is the account ID of the user who created the >> >>>>> template, in this case 'system' as this is a system vm template, the >> >>>>>'5' is >> >>>>> simply the 5th template created on this system >> >>>>> >> >>>>> The two template.properties files contain the following >> >>>>> >> >>>>> S1 template.properties file >> >>>>> # >> >>>>> #Mon May 20 14:11:06 UTC 2013 >> >>>>> filename=d015ebd8-5395-31a5-9648-a179062885d8.vhd >> >>>>> vhd=true >> >>>>> id=5 >> >>>>> vhd.filename=d015ebd8-5395-31a5-9648-a179062885d8.vhd >> >>>>> public=true >> >>>>> uniquename=centos56-x86_64-xen >> >>>>> vhd.virtualsize=21474836480 >> >>>>> virtualsize=21474836480 >> >>>>> checksum=905cec879afd9c9d22ecc8036131a180 >> >>>>> hvm=false >> >>>>> description=CentOS 5.6(64-bit) no GUI (XenServer) >> >>>>> vhd.size=1758786048 >> >>>>> size=1758786048 >> >>>>> >> >>>>> S1 template.properties file >> >>>>> # >> >>>>> #Wed Nov 21 23:14:59 UTC 2012 >> >>>>> filename=8b106378-7d6d-31b3-aab7-bfc85ef97884.vhd >> >>>>> vhd=true >> >>>>> id=5 >> >>>>> vhd.filename=8b106378-7d6d-31b3-aab7-bfc85ef97884.vhd >> >>>>> public=true >> >>>>> uniquename=centos56-x86_64-xen >> >>>>> vhd.virtualsize=21474836480 >> >>>>> virtualsize=21474836480 >> >>>>> checksum=905cec879afd9c9d22ecc8036131a180 >> >>>>> hvm=false >> >>>>> description=CentOS 5.6(64-bit) no GUI (XenServer) >> >>>>> vhd.size=1758786048 >> >>>>> size=1758786048 >> >>>>> dsa >> >>>>> >> >>>>> Note that the line >> >>>>> checksum=905cec879afd9c9d22ecc8036131a180 >> >>>>> is common to both, you will also find this value in the db in table >> >>>>> cloud.vm_template >> >>>>> This is the link to the template on disk, and the one referenced in >> >>>>>the >> >>>>> DB >> >>>>> >> >>>>> You can also see from the dates within the two properties files, >> that >> >>>>> this template was originally deployed back in may, but when I added >> >>>>>the 2nd >> >>>>> Secondary Storage Node in November, the template was automatically >> >>>>>copied >> >>>>> across. >> >>>>> >> >>>>> Hopefully all this info helps you. >> >>>>> >> >>>>> Regards >> >>>>> >> >>>>> Geoff Higginbottom >> >>>>> >> >>>>> D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581 >> >>>>> >> >>>>> geoff.higginbot...@shapeblue.com >> >>>>> >> >>>>> -----Original Message----- >> >>>>> From: Andrija Panic [mailto:andrija.pa...@gmail.com] >> >>>>> Sent: 13 December 2013 16:47 >> >>>>> To: users@cloudstack.apache.org >> >>>>> Subject: Re: Merging/Removing Secondary Storage NFS >> >>>>> >> >>>>> Hi Jeff, thanks for that detailed explanation, I'm on the KVM by the >> >>>>> way... >> >>>>> For the *volume* snaphost, I can see that real snapshot exist localy >> >>>>>(I >> >>>>> say real snaphost, not clone), but also the clone is created on 1 of >> >>>>>those >> >>>>> NFS servers... >> >>>>> >> >>>>> Can you somehow instruct me to check if new template I have just >> >>>>> created, is actualy copied on all 3 NFS hosts (all3 NFS are online, >> >>>>>and >> >>>>> working >> >>>>> fine) ? >> >>>>> Template is only 4GB of real size on the host, and it should be very >> >>>>> quickly copied to where it shoyld be. (my IO and netowrk traffic are >> >>>>>pretty >> >>>>> low in general). >> >>>>> >> >>>>> Should the templates files be created on all 3 NFS storages, with >> the >> >>>>> same file name? Or can I see this somehow from the database...I'm >> >>>>>trying to >> >>>>> decode it by myself, but can't figure this out... >> >>>>> >> >>>>> Thanks again, >> >>>>> Andrija >> >>>>> >> >>>>> >> >>>>> >> >>>>> >> >>>>> On 13 December 2013 17:35, Geoff Higginbottom < >> >>>>> geoff.higginbot...@shapeblue.com> wrote: >> >>>>> >> >>>>> > Andrija, >> >>>>> > >> >>>>> > The design is that any Public Template, or ISO gets copied to >> every >> >>>>> > secondary storage in the zone. The copying is undertaken by the >> >>>>>SSVM >> >>>>> > and will obviously take some time if you have just added a 2nd >> >>>>>Public >> >>>>> > ISO or Template, so your copy process may not have finished. >> >>>>> > >> >>>>> > For 4.2 'Snapshots' are now even more confusing than ever. We now >> >>>>> have: >> >>>>> > >> >>>>> > 1. VM Snapshots (ESXi & XenServer Only) these are true Hypervisor >> >>>>> > Snapshots, enabling quick roll back to the Snapshot, including >> >>>>>Memory >> >>>>> State. >> >>>>> > 2. Volume Snapshots (better thought of as Volume Backups) >> >>>>> > >> >>>>> > VM Snapshots remain on Primary Storage to enable the quick >> >>>>>roll-back >> >>>>> > to Snapshot to work. >> >>>>> > Volume Snapshots (backups) get copied to Secondary Storage. If >> you >> >>>>> > have more than one Secondary Storage available, the first backup >> is >> >>>>> > copied to one of the Secondary Storage volumes, chosen at random, >> >>>>>then >> >>>>> > all subsequent backups are always copied to the same Secondary >> >>>>>Storage >> >>>>> > volume >> >>>>> > >> >>>>> > Regards >> >>>>> > >> >>>>> > Geoff Higginbottom >> >>>>> > >> >>>>> > D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581 >> >>>>> > >> >>>>> > geoff.higginbot...@shapeblue.com >> >>>>> > >> >>>>> > -----Original Message----- >> >>>>> > From: Andrija Panic [mailto:andrija.pa...@gmail.com] >> >>>>> > Sent: 13 December 2013 16:29 >> >>>>> > To: users@cloudstack.apache.org >> >>>>> > Subject: Re: Merging/Removing Secondary Storage NFS >> >>>>> > >> >>>>> > HI Geoff, >> >>>>> > But, I have verified that my public templates are storaged only on >> >>>>>1 >> >>>>> > host... (at least based on file name of the template on one of >> >>>>>those >> >>>>> > host - these file names does NOT exist on other 2 NFS hosts...) >> Any >> >>>>> clue ? >> >>>>> > >> >>>>> > Can you also confirm that now in 4.2, since snaphost are really a >> >>>>> > snapshots, they are not moved to secondary storage, but exist >> >>>>>localy >> >>>>> > on the primary storage next to the original image they were >> created >> >>>>> > from (I can see this with lsof and qemu-img info). >> >>>>> > >> >>>>> > Thanks >> >>>>> > >> >>>>> > >> >>>>> > On 13 December 2013 17:21, Geoff Higginbottom < >> >>>>> > geoff.higginbot...@shapeblue.com> wrote: >> >>>>> > >> >>>>> > > You don't need to copy Public Templates from S1 to S2 if they >> >>>>>have >> >>>>> > > both been on line as Public Templates are always copied to every >> >>>>>sec >> >>>>> > > storage in the zone >> >>>>> > > >> >>>>> > > Regards >> >>>>> > > >> >>>>> > > Geoff Higginbottom >> >>>>> > > >> >>>>> > > D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581 >> >>>>> > > >> >>>>> > > geoff.higginbot...@shapeblue.com >> >>>>> > > >> >>>>> > > -----Original Message----- >> >>>>> > > From: Andrija Panic [mailto:andrija.pa...@gmail.com] >> >>>>> > > Sent: 13 December 2013 16:11 >> >>>>> > > To: users@cloudstack.apache.org >> >>>>> > > Subject: Re: Merging/Removing Secondary Storage NFS >> >>>>> > > >> >>>>> > > Just to correct myself: that guide: tells nice job for >> migrating >> >>>>> > > snapshots. >> >>>>> > > >> >>>>> > > But I'm confused why only private templates should be migrated, >> >>>>>why >> >>>>> > > not also the public ones? >> >>>>> > > >> >>>>> > > Quote from the page: >> >>>>> > > *"Note*: You must copy only private templates on Secondary >> >>>>>storage >> >>>>> > > host S2 to S1." >> >>>>> > > And the whole guide is about migrating those private templates >> >>>>> > > (these are mostly system VM templates and such) >> >>>>> > > >> >>>>> > > What about public templates? I have predefined some public >> >>>>> > > templates, that as far as I can see, are only storaged on some >> of >> >>>>> my 3 NFS hosts... >> >>>>> > > ? >> >>>>> > > >> >>>>> > > Thanks >> >>>>> > > >> >>>>> > > >> >>>>> > > >> >>>>> > > On 13 December 2013 16:51, Andrija Panic >> >>>>><andrija.pa...@gmail.com> >> >>>>> > wrote: >> >>>>> > > >> >>>>> > > > HI, >> >>>>> > > > >> >>>>> > > > anyone has good doc/procedure for removing old NFS (migrate >> >>>>> > > > everything to new NFS server) ? >> >>>>> > > > >> >>>>> > > > I was thinking of editing the database - dump to sql file, >> >>>>>search, >> >>>>> > > > replace old IP address with new IP address, and rsync >> >>>>>everything >> >>>>> > > > from old NFS to new NFS, keeping the same directory structure. >> >>>>> > > > Then import the edited dump file. >> >>>>> > > > >> >>>>> > > > I also found some Citrix's guide, but that does not seem to >> >>>>> > > > migrate everything (only the system VM templates, as per my >> >>>>> > > > understanding after reading the docs...) >> >>>>> > > > http://support.citrix.com/article/CTX135229 >> >>>>> > > > >> >>>>> > > > Thanks. >> >>>>> > > > >> >>>>> > > > -- >> >>>>> > > > >> >>>>> > > > Andrija Panić >> >>>>> > > > -------------------------------------- >> >>>>> > > > http://admintweets.com >> >>>>> > > > -------------------------------------- >> >>>>> > > > >> >>>>> > > >> >>>>> > > >> >>>>> > > >> >>>>> > > -- >> >>>>> > > >> >>>>> > > Andrija Panić >> >>>>> > > -------------------------------------- >> >>>>> > > http://admintweets.com >> >>>>> > > -------------------------------------- >> >>>>> > > This email and any attachments to it may be confidential and are >> >>>>> > > intended solely for the use of the individual to whom it is >> >>>>> addressed. >> >>>>> > > Any views or opinions expressed are solely those of the author >> >>>>>and >> >>>>> > > do not necessarily represent those of Shape Blue Ltd or related >> >>>>> > > companies. If you are not the intended recipient of this email, >> >>>>>you >> >>>>> > > must neither take any action based upon its contents, nor copy >> or >> >>>>> > > show it to anyone. Please contact the sender if you believe you >> >>>>>have >> >>>>> > > received this email in error. Shape Blue Ltd is a company >> >>>>> > > incorporated in England & Wales. ShapeBlue Services India LLP is >> >>>>>a >> >>>>> > > company incorporated in India and is operated under license from >> >>>>> > > Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company >> >>>>> > > incorporated in Brasil and is operated under license from Shape >> >>>>>Blue >> >>>>> > > Ltd. ShapeBlue is a >> >>>>> > registered trademark. >> >>>>> > > >> >>>>> > >> >>>>> > >> >>>>> > >> >>>>> > -- >> >>>>> > >> >>>>> > Andrija Panić >> >>>>> > -------------------------------------- >> >>>>> > http://admintweets.com >> >>>>> > -------------------------------------- >> >>>>> > This email and any attachments to it may be confidential and are >> >>>>> > intended solely for the use of the individual to whom it is >> >>>>>addressed. >> >>>>> > Any views or opinions expressed are solely those of the author and >> >>>>>do >> >>>>> > not necessarily represent those of Shape Blue Ltd or related >> >>>>> > companies. If you are not the intended recipient of this email, >> you >> >>>>> > must neither take any action based upon its contents, nor copy or >> >>>>>show >> >>>>> > it to anyone. Please contact the sender if you believe you have >> >>>>> > received this email in error. Shape Blue Ltd is a company >> >>>>>incorporated >> >>>>> > in England & Wales. ShapeBlue Services India LLP is a company >> >>>>> > incorporated in India and is operated under license from Shape >> Blue >> >>>>> > Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated >> >>>>>in >> >>>>> > Brasil and is operated under license from Shape Blue Ltd. >> ShapeBlue >> >>>>> is a registered trademark. >> >>>>> > >> >>>>> >> >>>>> >> >>>>> >> >>>>> -- >> >>>>> >> >>>>> Andrija Panić >> >>>>> -------------------------------------- >> >>>>> http://admintweets.com >> >>>>> -------------------------------------- >> >>>>> This email and any attachments to it may be confidential and are >> >>>>> intended solely for the use of the individual to whom it is >> >>>>>addressed. Any >> >>>>> views or opinions expressed are solely those of the author and do >> not >> >>>>> necessarily represent those of Shape Blue Ltd or related companies. >> >>>>>If you >> >>>>> are not the intended recipient of this email, you must neither take >> >>>>>any >> >>>>> action based upon its contents, nor copy or show it to anyone. >> Please >> >>>>> contact the sender if you believe you have received this email in >> >>>>>error. >> >>>>> Shape Blue Ltd is a company incorporated in England & Wales. >> >>>>>ShapeBlue >> >>>>> Services India LLP is a company incorporated in India and is >> >>>>>operated under >> >>>>> license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a >> >>>>> company incorporated in Brasil and is operated under license from >> >>>>>Shape >> >>>>> Blue Ltd. ShapeBlue is a registered trademark. >> >>>>> >> >>>> >> >>> >> >>> >> >>> -- >> >>> >> >>> Andrija Panić >> >>> -------------------------------------- >> >>> http://admintweets.com >> >>> -------------------------------------- >> >>> >> >> >> >> >> >> >> >> -- >> >> >> >> Andrija Panić >> >> -------------------------------------- >> >> http://admintweets.com >> >> -------------------------------------- >> >> >> > >> > >> > >> >-- >> > >> >Andrija Panić >> >-------------------------------------- >> > http://admintweets.com >> >-------------------------------------- >> >> > > > -- > > Andrija Panić > -------------------------------------- > http://admintweets.com > -------------------------------------- > -- Andrija Panić -------------------------------------- http://admintweets.com --------------------------------------
