RE: Network architecture
Dear Paul / Remi, Thank you for your feedback and the bounding advice. We'll go on this direction. @Remi, you are right about KVM. Right now, we still use XenServer because Snapshots and backup solutions. If KVM does the job properly, we might make a try on this new zone. Do you have any feedback migrating instances from a xenserver zone to a kvm zone ? (should we only un-install xentools, export vm as template and download in the new zone ? Or is it a more complexe process ?) Thanks again. --- Grégoire Lamodière T/ + 33 6 76 27 03 31 F/ + 33 1 75 43 89 71 -Message d'origine- De : Paul Angus [mailto:paul.an...@shapeblue.com] Envoyé : mercredi 5 juillet 2017 21:05 À : users@cloudstack.apache.org Objet : RE: Network architecture Hi Grégoire, With those NICs (and without any other background). I'd go with bonding your 1G NICs together and your 10G NICs together, put primary and secondary storage over the 10G. Mgmt traffic is minimal and spread over all of your hosts, so would be public traffic, so these would be fine over the bonded 1Gbs links. Finally guest traffic, this would normally be fine over the 1Gb links, especially if you throttle the traffic a little, unless you know that you'll have especially high guest traffic. Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Grégoire Lamodière [mailto:g.lamodi...@dimsi.fr] Sent: 04 July 2017 21:15 To: users@cloudstack.apache.org Subject: Network architecture Dear All, In the process of implementing a new CS advanced zone (4.9.2), I am wondering about the best network architecture to implement. Any idea / advice would be highly appreciated. 1/ Each host has 4 networks adapters, 2 x 1 Gbe, 2 x 10 Gbe 2/ The PR Store is nfs based 10 Gbe 3/ The sec Store is nfs based 10 Gbe 4/ Maximum network offering is 1 Gbit to Internet 5/ Hypervisor Xen 7 6/ Hardware Hp Blade c7000 Right now, my choice would be : 1/ Bound the 2 gigabit networks cards and use the bound for mgmt + public 2/ Use 1 10Gbe for storage network (operations on sec Store) 3/ Use 1 10 Gbe for guest traffic (and pr store traffic by design) This architecture sounds good in terms of performance (using 10 Gbe where it makes sense, redundancy on mgmt + public with bound). Another option would be to bound the 2 10 Gbe interfaces, and use Xen Label to manage Storage and guest on the same physical network. This choice would give us faileover on storage and guest traffic, but I am wondering if performances would be badly affected. Do you have any feedback on this ? Thanks all. Best Regards. --- Grégoire Lamodière T/ + 33 6 76 27 03 31 F/ + 33 1 75 43 89 71
RE: Network architecture
Hi Grégoire, With those NICs (and without any other background). I'd go with bonding your 1G NICs together and your 10G NICs together, put primary and secondary storage over the 10G. Mgmt traffic is minimal and spread over all of your hosts, so would be public traffic, so these would be fine over the bonded 1Gbs links. Finally guest traffic, this would normally be fine over the 1Gb links, especially if you throttle the traffic a little, unless you know that you'll have especially high guest traffic. Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Grégoire Lamodière [mailto:g.lamodi...@dimsi.fr] Sent: 04 July 2017 21:15 To: users@cloudstack.apache.org Subject: Network architecture Dear All, In the process of implementing a new CS advanced zone (4.9.2), I am wondering about the best network architecture to implement. Any idea / advice would be highly appreciated. 1/ Each host has 4 networks adapters, 2 x 1 Gbe, 2 x 10 Gbe 2/ The PR Store is nfs based 10 Gbe 3/ The sec Store is nfs based 10 Gbe 4/ Maximum network offering is 1 Gbit to Internet 5/ Hypervisor Xen 7 6/ Hardware Hp Blade c7000 Right now, my choice would be : 1/ Bound the 2 gigabit networks cards and use the bound for mgmt + public 2/ Use 1 10Gbe for storage network (operations on sec Store) 3/ Use 1 10 Gbe for guest traffic (and pr store traffic by design) This architecture sounds good in terms of performance (using 10 Gbe where it makes sense, redundancy on mgmt + public with bound). Another option would be to bound the 2 10 Gbe interfaces, and use Xen Label to manage Storage and guest on the same physical network. This choice would give us faileover on storage and guest traffic, but I am wondering if performances would be badly affected. Do you have any feedback on this ? Thanks all. Best Regards. --- Grégoire Lamodière T/ + 33 6 76 27 03 31 F/ + 33 1 75 43 89 71
RE: DISCUSS : Vmware to Cloudstack migration support
There used to be a XenConvert utility that you do that conversion for you. I'm not sure that its about anymore, but a bit of googling might dig up a copy. Alternatively there are linux and Windows versions of qemu-img convert , which usually does a pretty good job of disk image conversions Otherwise you could use a P2V backup/recovery tool with an agent that runs inside your VMs Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Shreya Nair [mailto:shreya.n...@opcito.com] Sent: 05 July 2017 09:22 To: users@cloudstack.apache.org Subject: Re: DISCUSS : Vmware to Cloudstack migration support Hi Oliver, We are trying to migrate the vSphere environment to cloudstack (based on XenServer) due to some internal product dependency which can be addressed by the CloudStack environment. Thanks & Regards, Shreya On Tue, Jul 4, 2017 at 10:27 PM, Oliver Dzombic wrote: > Hi, > > just our of intrest: > > Why do you want to go away from vmware ? > > And why do you prefere xen and not kvm ( which is as you already > experienced much more tricky compared to kvm ) ? > > > -- > Mit freundlichen Gruessen / Best regards > > Oliver Dzombic > IP-Interactive > > mailto:i...@ip-interactive.de > > Anschrift: > > IP Interactive UG ( haftungsbeschraenkt ) Zum Sonnenberg 1-3 > 63571 Gelnhausen > > HRB 93402 beim Amtsgericht Hanau > Geschäftsführung: Oliver Dzombic > > Steuer Nr.: 35 236 3622 1 > UST ID: DE274086107 > > > Am 04.07.2017 um 13:22 schrieb Shreya Nair: > > Hello, > > > > My team is working on a Vmware to Cloudstack migration task. The > CloudStack > > environment is set up on the Xenserver hypervisor. > > > > We are able to export a VM on vsphere to OVF template which also > > provides the OVF, VMDK disk image(s) and MF file for the particular VM. > > In order to create a CloudStack Template from these files, it can be > > done by 2 methods, namely, template creation from VHD(as the > > underlying hypervisor is XenServer) or template creation from ISO. > > > > VHD Template creation: > > - The VMDK file (Obtained after export OVF operation of the VM) is > > converted to VHD format with VBoxManage.exe tool that is available > > with VirtualBox. > > - The VHD file can be used to create a CloudStack template and > > instantiate a VM. > > > > > > ISO Template creation: > > - The OVF file (Obtained after export OVF operation of the VM) is > imported > > to Citrix XenCenter. > > - XenCenter runs Operating system Fixup on the imported OVF file > > and creates a modified ISO file. > > - The modified ISO file can be used for creating a template and > > instantiate a VM > > > > However, the newly created VM has booting issues as it requires "You > might > > have to change the root from /dev/hd[a-d] to /dev/xvd[a-d]" > > Is there an alternate way or support to migrate a vSphere VM to > CloudStack? > > Or a method to change the partitioning on the hard disk from sd[a-d] > > to xvd[a-d] > > > > > > > > Thanks & Regards, > > > > Shreya > > >
Re: Network architecture
Hi, My advise is to make it as resilient as possible while keeping it simple. Using a single 10g nic towards primary storage means all your VMs will go down/are halted/risk corruption when the switch is rebooted for maintenance, or dies etc. I’d always use a mlag/port channel with 2x10G towards different switches. Then you can also use them active/active if your switches support it. We’re using Arista, and that can handle this well. Having redundancy on public without having redundancy on the backend doesn’t really help in my opinion. Is there a specific reason to use XenServer? KVM is very mature these days and I’d recommend it over XenServer. I’ve hunderds of both running and in my experience KVM is faster on the same hardware and has less issues to deal with. XenServer will work, for sure. I just think KVM (for example on CentOS7) will give you a better experience. Regards, Remi On 04/07/2017, 22:15, "Grégoire Lamodière" wrote: Dear All, In the process of implementing a new CS advanced zone (4.9.2), I am wondering about the best network architecture to implement. Any idea / advice would be highly appreciated. 1/ Each host has 4 networks adapters, 2 x 1 Gbe, 2 x 10 Gbe 2/ The PR Store is nfs based 10 Gbe 3/ The sec Store is nfs based 10 Gbe 4/ Maximum network offering is 1 Gbit to Internet 5/ Hypervisor Xen 7 6/ Hardware Hp Blade c7000 Right now, my choice would be : 1/ Bound the 2 gigabit networks cards and use the bound for mgmt + public 2/ Use 1 10Gbe for storage network (operations on sec Store) 3/ Use 1 10 Gbe for guest traffic (and pr store traffic by design) This architecture sounds good in terms of performance (using 10 Gbe where it makes sense, redundancy on mgmt + public with bound). Another option would be to bound the 2 10 Gbe interfaces, and use Xen Label to manage Storage and guest on the same physical network. This choice would give us faileover on storage and guest traffic, but I am wondering if performances would be badly affected. Do you have any feedback on this ? Thanks all. Best Regards. --- Grégoire Lamodière T/ + 33 6 76 27 03 31 F/ + 33 1 75 43 89 71
database issue while upgrading db schema with schema-4910to4920.sql
Hi,
While testing the upgrade to 4.10.0 I ran to a DB upgrade issue, logs
below...
Basically,
the storeproc fail to be execute event manually with following error:
mysql> CALL
`cloud`.`IDEMPOTENT_INSERT_GUESTOS_HYPERVISOR_MAPPING`('Xenserver',
'7.0.0', 'CentOS 4.5 (32-bit)', 1, 0);
ERROR 1267 (HY000): Illegal mix of collations (utf8_general_ci,IMPLICIT)
and (utf8_unicode_ci,IMPLICIT) for operation '='
but If I ran this command:
mysql> ALTER TABLE guest_os_hypervisor CONVERT TO CHARACTER SET utf8
COLLATE utf8_unicode_ci;
Query OK, 2378 rows affected (0.17 sec)
Then the storeproc succeed and the database upgrade up to 4.10 will succeed.
So does anyone got that behavior too ? if so I think it would worth adding
this to our release notes?
Thanks,
management-server.log:
2017-07-05 12:59:32,687 DEBUG [c.c.u.s.Script] (localhost-startStop-1:null)
(logid:) Absolute path =
/usr/share/cloudstack-management/setup/db/schema-4910to4920.sql
2017-07-05 12:59:32,687 DEBUG [c.c.u.d.ScriptRunner]
(localhost-startStop-1:null) (logid:) -- Licensed to the Apache Software
Foundation (ASF) under one
2017-07-05 12:59:32,687 DEBUG [c.c.u.d.ScriptRunner]
(localhost-startStop-1:null) (logid:) -- or more contributor license
agreements. See the NOTICE file
2017-07-05 12:59:32,687 DEBUG [c.c.u.d.ScriptRunner]
(localhost-startStop-1:null) (logid:) -- distributed with this work for
additional information
2017-07-05 12:59:32,687 DEBUG [c.c.u.d.ScriptRunner]
(localhost-startStop-1:null) (logid:) -- regarding copyright ownership.
The ASF licenses this file
2017-07-05 12:59:32,687 DEBUG [c.c.u.d.ScriptRunner]
(localhost-startStop-1:null) (logid:) -- to you under the Apache License,
Version 2.0 (the
2017-07-05 12:59:32,687 DEBUG [c.c.u.d.ScriptRunner]
(localhost-startStop-1:null) (logid:) -- "License"); you may not use this
file except in compliance
2017-07-05 12:59:32,687 DEBUG [c.c.u.d.ScriptRunner]
(localhost-startStop-1:null) (logid:) -- with the License. You may obtain
a copy of the License at
2017-07-05 12:59:32,687 DEBUG [c.c.u.d.ScriptRunner]
(localhost-startStop-1:null) (logid:) --
2017-07-05 12:59:32,687 DEBUG [c.c.u.d.ScriptRunner]
(localhost-startStop-1:null) (logid:) --
http://www.apache.org/licenses/LICENSE-2.0
2017-07-05 12:59:32,687 DEBUG [c.c.u.d.ScriptRunner]
(localhost-startStop-1:null) (logid:) --
2017-07-05 12:59:32,687 DEBUG [c.c.u.d.ScriptRunner]
(localhost-startStop-1:null) (logid:) -- Unless required by applicable law
or agreed to in writing,
2017-07-05 12:59:32,687 DEBUG [c.c.u.d.ScriptRunner]
(localhost-startStop-1:null) (logid:) -- software distributed under the
License is distributed on an
2017-07-05 12:59:32,687 DEBUG [c.c.u.d.ScriptRunner]
(localhost-startStop-1:null) (logid:) -- "AS IS" BASIS, WITHOUT WARRANTIES
OR CONDITIONS OF ANY
2017-07-05 12:59:32,687 DEBUG [c.c.u.d.ScriptRunner]
(localhost-startStop-1:null) (logid:) -- KIND, either express or implied.
See the License for the
2017-07-05 12:59:32,687 DEBUG [c.c.u.d.ScriptRunner]
(localhost-startStop-1:null) (logid:) -- specific language governing
permissions and limitations
2017-07-05 12:59:32,687 DEBUG [c.c.u.d.ScriptRunner]
(localhost-startStop-1:null) (logid:) -- under the License.
2017-07-05 12:59:32,687 DEBUG [c.c.u.d.ScriptRunner]
(localhost-startStop-1:null) (logid:) --;
2017-07-05 12:59:32,687 DEBUG [c.c.u.d.ScriptRunner]
(localhost-startStop-1:null) (logid:) -- Schema upgrade from 4.9.1.0 to
4.9.2.0;
2017-07-05 12:59:32,687 DEBUG [c.c.u.d.ScriptRunner]
(localhost-startStop-1:null) (logid:) --;
2017-07-05 12:59:32,687 DEBUG [c.c.u.d.ScriptRunner]
(localhost-startStop-1:null) (logid:) --;
2017-07-05 12:59:32,687 DEBUG [c.c.u.d.ScriptRunner]
(localhost-startStop-1:null) (logid:) -- Stored procedure to do idempotent
insert;
2017-07-05 12:59:32,687 DEBUG [c.c.u.d.ScriptRunner]
(localhost-startStop-1:null) (logid:) --;
2017-07-05 12:59:32,687 DEBUG [c.c.u.d.ScriptRunner]
(localhost-startStop-1:null) (logid:) DROP PROCEDURE IF EXISTS
`cloud`.`IDEMPOTENT_INSERT_GUESTOS_HYPERVISOR_MAPPING`
2017-07-05 12:59:32,691 DEBUG [c.c.u.d.ScriptRunner]
(localhost-startStop-1:null) (logid:) CREATE PROCEDURE
`cloud`.`IDEMPOTENT_INSERT_GUESTOS_HYPERVISOR_MAPPING`(
IN in_hypervisor_type VARCHAR(32), IN
in_hypervisor_version VARCHAR(32), IN
in_guest_os_name VARCHAR(255), IN
in_guest_os_id BIGINT(20) UNSIGNED, IN
is_user_defined int(1) UNSIGNED) BEGIN IF NOT EXISTS ((SELECT *
FROM `cloud`.`guest_os_hypervisor` WHERE
hypervisor_type=in_hypervisor_type AND
hypervisor_version=in_hypervisor_version AND guest_os_id =
in_guest_os_id)) THEN INSERT INTO
`cloud`.`guest_os_hypervisor` ( uuid,
hypervisor_type, hypervisor_version,
guest_os_name, guest_os_id,
created,
Re: DISCUSS : Vmware to Cloudstack migration support
Hi Oliver, We are trying to migrate the vSphere environment to cloudstack (based on XenServer) due to some internal product dependency which can be addressed by the CloudStack environment. Thanks & Regards, Shreya On Tue, Jul 4, 2017 at 10:27 PM, Oliver Dzombic wrote: > Hi, > > just our of intrest: > > Why do you want to go away from vmware ? > > And why do you prefere xen and not kvm ( which is as you already > experienced much more tricky compared to kvm ) ? > > > -- > Mit freundlichen Gruessen / Best regards > > Oliver Dzombic > IP-Interactive > > mailto:i...@ip-interactive.de > > Anschrift: > > IP Interactive UG ( haftungsbeschraenkt ) > Zum Sonnenberg 1-3 > 63571 Gelnhausen > > HRB 93402 beim Amtsgericht Hanau > Geschäftsführung: Oliver Dzombic > > Steuer Nr.: 35 236 3622 1 > UST ID: DE274086107 > > > Am 04.07.2017 um 13:22 schrieb Shreya Nair: > > Hello, > > > > My team is working on a Vmware to Cloudstack migration task. The > CloudStack > > environment is set up on the Xenserver hypervisor. > > > > We are able to export a VM on vsphere to OVF template which also provides > > the OVF, VMDK disk image(s) and MF file for the particular VM. > > In order to create a CloudStack Template from these files, it can be done > > by 2 methods, namely, template creation from VHD(as the underlying > > hypervisor is XenServer) or template creation from ISO. > > > > VHD Template creation: > > - The VMDK file (Obtained after export OVF operation of the VM) is > > converted to VHD format with VBoxManage.exe tool that is available with > > VirtualBox. > > - The VHD file can be used to create a CloudStack template and > > instantiate a VM. > > > > > > ISO Template creation: > > - The OVF file (Obtained after export OVF operation of the VM) is > imported > > to Citrix XenCenter. > > - XenCenter runs Operating system Fixup on the imported OVF file and > > creates a modified ISO file. > > - The modified ISO file can be used for creating a template and > > instantiate a VM > > > > However, the newly created VM has booting issues as it requires "You > might > > have to change the root from /dev/hd[a-d] to /dev/xvd[a-d]" > > Is there an alternate way or support to migrate a vSphere VM to > CloudStack? > > Or a method to change the partitioning on the hard disk from sd[a-d] to > > xvd[a-d] > > > > > > > > Thanks & Regards, > > > > Shreya > > >
