Re: Connect to a MySQL Galera Cluster

[Shanker Balan]

Comments inline.

On 26-Jan-2014, at 10:10 am, Francois Gaudreault  
wrote:

> Yes, we tried with a NetScaler, but as soon as one MySQL dies, both 
> management servers fence themselves on DB exceptions :S


Does Galera maintain client connection state across the failover?


--
@shankerbalan

M: +91 98860 60539 | O: +91 (80) 67935867
shanker.ba...@shapeblue.com | www.shapeblue.com | Twitter:@shapeblue
ShapeBlue Services India LLP, 22nd floor, Unit 2201A, World Trade Centre, 
Bangalore - 560 055

Need Enterprise Grade Support for Apache CloudStack?
Our CloudStack Infrastructure 
Support offers the 
best 24/7 SLA for CloudStack Environments.

Apache CloudStack Bootcamp training courses

**NEW!** CloudStack 4.2.1 training
18th-19th February 2014, Brazil. 
Classroom
17th-23rd March 2014, Region A. Instructor led, 
On-line
24th-28th March 2014, Region B. Instructor led, 
On-line
16th-20th June 2014, Region A. Instructor led, 
On-line
23rd-27th June 2014, Region B. Instructor led, 
On-line

This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England & Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue Ltd. Shape 
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
operated under license from Shape Blue Ltd. ShapeBlue is a registered trademark.

Re: Connect to a MySQL Galera Cluster

[Francois Gaudreault]

Yes, we tried with a NetScaler, but as soon as one MySQL dies, both 
management servers fence themselves on DB exceptions :S


Francois

On 1/25/2014, 10:08 PM, Nux! wrote:

On 26.01.2014 02:33, Francois Gaudreault wrote:

We are trying to make CloudStack to work with a Galera two node
master/master cluster. We have a NetScaler doing DataStream LB in
front of the cluster, and we have two CloudStack management servers in
active/active.

Anyone had success with this kind of scenario? As soon as I shut a
MySQL node, the CloudStack JDBC panics, and the management server
fence themselves.  Why this is happening? Is there any way to handle
database failures in HA fashion? Any large cloud providers using
CloudStack handle this?


Hello,

I know there are people on the ml who are using galera and I'm 
planning on using it myself for Cloudstack.
We already have a 3 node deployment, but it is loadbalanced on virtual 
IPs and load balancer (we run VIP on each node as well as Haproxy), 
hopefully this will keep Cloudstack happy, I suggest you do a similar 
thing.


Lucian




--
Francois Gaudreault
Architecte de Solution Cloud | Cloud Solutions Architect
fgaudrea...@cloudops.com
514-629-6775
- - -
CloudOps
420 rue Guy
Montréal QC  H3J 1S6
www.cloudops.com
@CloudOps_

Re: Cloudstack 4.2 on XenServer vs KVM

[Shanker Balan]

Comments inline.

On 26-Jan-2014, at 8:35 am, Nux!  wrote:

> On 26.01.2014 00:39, John Mancuso wrote:
>> So, I am planning on setting up a brand new cloud infrastructure
>> using Cloudstack 4.2 on RHEL6. Cloudstack is hypervisor agnostic- I
>> got that... However there are some differences and features that are
>> available on XenServer that are not available on KVM. This is from a
>> Citrix salesperson:
>> "Here is some feedback on the following benefits of using Citrix
>> XenServer over KVM:
>>  1.  Recurring Volume Snapshots with delta - Citrix XenServer is the
>> only hypervisor where recurring snapshots will be deltas (in other
>> hypervisors every volume snapshot is full) - this provides significant
>> space savings on secondary storage
>>  2.  VM snapshots (taking a snapshot of a VM volumes including
>> memory state - not possible with KVM which supports only volume
>> snapshots)
>>  3.  Live Storage Migration is only possible on Citrix XenServer
>> (not supported on KVM)
>>  4.  Live CPU and Memory Scaling for running instances (not supported on 
>> KVM)"
>> On the Redhat side they have made it very clear that while Xen is
>> still available, KVM is the hypervisor technology they are pushing &
>> supporting going forward.
>> On the Apache/Citrix side, I get the feeling that from a QA
>> perspective CloudStack (and CloudPlatform) is based and tested on
>> XenServer and would be preferable in a stable & reliable  Production
>> environment.
>
> Hello,
>
> You are mostly correct, those points seem valid and right now Xenserver is 
> the better supported hypervisor, it is quite mature and with loads of nice 
> features. I'm seriously considering it myself.
>
> Having said that, many clouds deployed nowadays are on KVM; yes it is missing 
> some features but it has a huge user base, it's very stable and the 
> performance is great; for me the killer feature is that I got a "real" OS as 
> hypervisor, an OS that I have used extensively and am quite familiar with, 
> for which we have deployment and monitoring infra in place etc etc. 
> Additionally, if you want to use more exotic stuff, such as GlusterFS, Ceph 
> or whatever crazy thing (CLVM over multiple mpath devices?) can run in 
> RHEL/CentOS proper KVM is again the best choice. If you want VXLAN you are 
> again limited to KVM afaik.
>
> So it kind of depends on your needs, luckily there are good quality options 
> to satisfy most of them.

What I personally find most relevant for choosing a hypervisor is guest OS
support. Not all hypervisors are created equal when it comes to supporting
a wide mix of operating systems.

Given that XenServer and KVM are both open source, I would recommend running
both. It gives you OS flexibility and spreads risks.

If you can afford, add VMware also. Enterprises love VMware.

Regards.

--
@shankerbalan

M: +91 98860 60539 | O: +91 (80) 67935867
shanker.ba...@shapeblue.com | www.shapeblue.com | Twitter:@shapeblue
ShapeBlue Services India LLP, 22nd floor, Unit 2201A, World Trade Centre, 
Bangalore - 560 055

Need Enterprise Grade Support for Apache CloudStack?
Our CloudStack Infrastructure 
Support offers the 
best 24/7 SLA for CloudStack Environments.

Apache CloudStack Bootcamp training courses

**NEW!** CloudStack 4.2.1 training
18th-19th February 2014, Brazil. 
Classroom
17th-23rd March 2014, Region A. Instructor led, 
On-line
24th-28th March 2014, Region B. Instructor led, 
On-line
16th-20th June 2014, Region A. Instructor led, 
On-line
23rd-27th June 2014, Region B. Instructor led, 
On-line

This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England & Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue Ltd. Shape 
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
operated under license from Shape Blue Ltd. ShapeBlue is a registered trademark.

Re: Connect to a MySQL Galera Cluster

[Nux!]

On 26.01.2014 02:33, Francois Gaudreault wrote:

We are trying to make CloudStack to work with a Galera two node
master/master cluster. We have a NetScaler doing DataStream LB in
front of the cluster, and we have two CloudStack management servers in
active/active.

Anyone had success with this kind of scenario? As soon as I shut a
MySQL node, the CloudStack JDBC panics, and the management server
fence themselves.  Why this is happening? Is there any way to handle
database failures in HA fashion? Any large cloud providers using
CloudStack handle this?


Hello,

I know there are people on the ml who are using galera and I'm planning 
on using it myself for Cloudstack.
We already have a 3 node deployment, but it is loadbalanced on virtual 
IPs and load balancer (we run VIP on each node as well as Haproxy), 
hopefully this will keep Cloudstack happy, I suggest you do a similar 
thing.


Lucian

--
Sent from the Delta quadrant using Borg technology!

Nux!
www.nux.ro

Re: Cloudstack 4.2 on XenServer vs KVM

[Nux!]

On 26.01.2014 00:39, John Mancuso wrote:

So, I am planning on setting up a brand new cloud infrastructure
using Cloudstack 4.2 on RHEL6. Cloudstack is hypervisor agnostic- I
got that... However there are some differences and features that are
available on XenServer that are not available on KVM. This is from a
Citrix salesperson:

"Here is some feedback on the following benefits of using Citrix
XenServer over KVM:

  1.  Recurring Volume Snapshots with delta - Citrix XenServer is the
only hypervisor where recurring snapshots will be deltas (in other
hypervisors every volume snapshot is full) - this provides significant
space savings on secondary storage
  2.  VM snapshots (taking a snapshot of a VM volumes including
memory state - not possible with KVM which supports only volume
snapshots)
  3.  Live Storage Migration is only possible on Citrix XenServer
(not supported on KVM)
  4.  Live CPU and Memory Scaling for running instances (not supported 
on KVM)"


On the Redhat side they have made it very clear that while Xen is
still available, KVM is the hypervisor technology they are pushing &
supporting going forward.

On the Apache/Citrix side, I get the feeling that from a QA
perspective CloudStack (and CloudPlatform) is based and tested on
XenServer and would be preferable in a stable & reliable  Production
environment.


Hello,

You are mostly correct, those points seem valid and right now Xenserver 
is the better supported hypervisor, it is quite mature and with loads of 
nice features. I'm seriously considering it myself.


Having said that, many clouds deployed nowadays are on KVM; yes it is 
missing some features but it has a huge user base, it's very stable and 
the performance is great; for me the killer feature is that I got a 
"real" OS as hypervisor, an OS that I have used extensively and am quite 
familiar with, for which we have deployment and monitoring infra in 
place etc etc. Additionally, if you want to use more exotic stuff, such 
as GlusterFS, Ceph or whatever crazy thing (CLVM over multiple mpath 
devices?) can run in RHEL/CentOS proper KVM is again the best choice. If 
you want VXLAN you are again limited to KVM afaik.


So it kind of depends on your needs, luckily there are good quality 
options to satisfy most of them.


HTH
Lucian

--
Sent from the Delta quadrant using Borg technology!

Nux!
www.nux.ro

Connect to a MySQL Galera Cluster

[Francois Gaudreault]

We are trying to make CloudStack to work with a Galera two node 
master/master cluster. We have a NetScaler doing DataStream LB in front 
of the cluster, and we have two CloudStack management servers in 
active/active.


Anyone had success with this kind of scenario? As soon as I shut a MySQL 
node, the CloudStack JDBC panics, and the management server fence 
themselves.  Why this is happening? Is there any way to handle database 
failures in HA fashion? Any large cloud providers using CloudStack 
handle this?


Thanks.

--
Francois Gaudreault
Architecte de Solution Cloud | Cloud Solutions Architect
fgaudrea...@cloudops.com
514-629-6775
- - -
CloudOps
420 rue Guy
Montréal QC  H3J 1S6
www.cloudops.com
@CloudOps_

Cloudstack 4.2 on XenServer vs KVM

[John Mancuso]

So, I am planning on setting up a brand new cloud infrastructure using 
Cloudstack 4.2 on RHEL6. Cloudstack is hypervisor agnostic- I got that... 
However there are some differences and features that are available on XenServer 
that are not available on KVM. This is from a Citrix salesperson:

"Here is some feedback on the following benefits of using Citrix XenServer over 
KVM:

  1.  Recurring Volume Snapshots with delta - Citrix XenServer is the only 
hypervisor where recurring snapshots will be deltas (in other hypervisors every 
volume snapshot is full) - this provides significant space savings on secondary 
storage
  2.  VM snapshots (taking a snapshot of a VM volumes including memory state - 
not possible with KVM which supports only volume snapshots)
  3.  Live Storage Migration is only possible on Citrix XenServer (not 
supported on KVM)
  4.  Live CPU and Memory Scaling for running instances (not supported on KVM)"

On the Redhat side they have made it very clear that while Xen is still 
available, KVM is the hypervisor technology they are pushing & supporting going 
forward.

On the Apache/Citrix side, I get the feeling that from a QA perspective 
CloudStack (and CloudPlatform) is based and tested on XenServer and would be 
preferable in a stable & reliable  Production environment.



Is there any merit to my thinking?
__
John Mancuso | System Engineer | FREEWHEEL
mobile: +1 516.652.2475  skype: jmancuso_freewheel
www.freewheel.tv

SILICON VALLEY * NEW YORK * BEIJING  * LONDON

Re: packer for building cloudstack templates

[Brian Galura]

It's great to see progress in adding support to Packer I will test it as soon 
as it's available.

But what do people do today? Is there a way to convert an ovf to vhd for 
example? I would be surprised if everyone creates templates by hand.


Sent from Citrix WorxMail for iPhone




From: Peter Jönsson 
Date: 2014-01-25 09:43:55 +
To: users@cloudstack.apache.org 
,peter.joens...@gmail.com 
,users@cloudstack.apache.org 

Subject: Re: packer for building cloudstack templates

Hi!

As my library for talking to cloudstack (gopherstack) wasn’t ideal I have been 
waiting for a new variant. It was release yesterday: 
https://github.com/svanharmelen/gocs .

I will take a look at this library and perhaps, if it is good, port over my 
updates to packer to talk to this library. Then hopefully I can clean up my 
changes and send a pull request to upstream packer.

In general the approach we take for templates is to built them from scratch. 
That means PXE booting the instance, downloading kernel/initrd from a net boot 
server, then finally starting the OS-installation through kickstart. With 
packer this can be 100% automated via a special iPXE-ISO which will chain load 
off the user data attached to the VM instance.

- Build custom iPXE with simple embedded boot script:

#!pxe
dhcp
chain http://${dhcp-server}/latest/userdata

- Boot up VM with user data attached with enough information to continue the 
boot, e.g.

"#!ipxe\nkernel http://netboot/centos/6.3/x86_64/vmlinuz 
ks=http://netboot/ks.cfg\ninitrd 
http://netboot/centos/6.3/x86_64/initrd.img\nboot”

- After kickstart is completed we reboot the instance and continue setting it 
up using packer provisioning scripts.

Things become slightly easier when only performing incremental template 
updates. But then someone need to create the initial template of course.

// Peter


On Saturday 25 January 2014 at 09:38, Prasanna Santhanam wrote:

> On Sat, Jan 25, 2014 at 03:43:07AM +, Brian Galura wrote:
> > At my company we use packer to build ec2 images and really like it.
> > I would like to use it for cloudstack also.
> >
> > I found this: https://github.com/vogxn/packer-builtin
> >
> > Which appears to be a centos6 image builder for cloudstack but it
> > lacks instructions to convert the resultant image into something I
> > can import to cloudstack.
> >
> > Has anyone successfully done this?
> >
> > How do you build cloudstack templates?
>
> Hi Brian,
>
> That repo only contains a test builtin I was trying to build using
> packer. Peter Jonsson is working on a cloudstack builder for packer
> and announced about this last week.
>
> Peter's repo is here:
> https://github.com/mindjiver/packer
>
> You will need go to run the packer src and setup the cloudstack
> builder
>
> $ make updatedeps
> $ make
>
> --
> Prasanna.,
>
> 
> Powered by BigRock.com (http://BigRock.com)

Re: packer for building cloudstack templates

[Peter Jönsson]

Hi!

As my library for talking to cloudstack (gopherstack) wasn’t ideal I have been 
waiting for a new variant. It was release yesterday: 
https://github.com/svanharmelen/gocs .  

I will take a look at this library and perhaps, if it is good, port over my 
updates to packer to talk to this library. Then hopefully I can clean up my 
changes and send a pull request to upstream packer.

In general the approach we take for templates is to built them from scratch. 
That means PXE booting the instance, downloading kernel/initrd from a net boot 
server, then finally starting the OS-installation through kickstart. With 
packer this can be 100% automated via a special iPXE-ISO which will chain load 
off the user data attached to the VM instance.

- Build custom iPXE with simple embedded boot script:

#!pxe
dhcp
chain http://${dhcp-server}/latest/userdata

- Boot up VM with user data attached with enough information to continue the 
boot, e.g.  

"#!ipxe\nkernel http://netboot/centos/6.3/x86_64/vmlinuz 
ks=http://netboot/ks.cfg\ninitrd 
http://netboot/centos/6.3/x86_64/initrd.img\nboot”

- After kickstart is completed we reboot the instance and continue setting it 
up using packer provisioning scripts.

Things become slightly easier when only performing incremental template 
updates. But then someone need to create the initial template of course.  

// Peter  


On Saturday 25 January 2014 at 09:38, Prasanna Santhanam wrote:

> On Sat, Jan 25, 2014 at 03:43:07AM +, Brian Galura wrote:
> > At my company we use packer to build ec2 images and really like it.
> > I would like to use it for cloudstack also.
> >  
> > I found this: https://github.com/vogxn/packer-builtin
> >  
> > Which appears to be a centos6 image builder for cloudstack but it
> > lacks instructions to convert the resultant image into something I
> > can import to cloudstack.
> >  
> > Has anyone successfully done this?
> >  
> > How do you build cloudstack templates?
>  
> Hi Brian,
>  
> That repo only contains a test builtin I was trying to build using
> packer. Peter Jonsson is working on a cloudstack builder for packer
> and announced about this last week.
>  
> Peter's repo is here:  
> https://github.com/mindjiver/packer
>  
> You will need go to run the packer src and setup the cloudstack
> builder
>  
> $ make updatedeps
> $ make
>  
> --  
> Prasanna.,
>  
> 
> Powered by BigRock.com (http://BigRock.com)

Re: packer for building cloudstack templates

[Prasanna Santhanam]

On Sat, Jan 25, 2014 at 03:43:07AM +, Brian Galura wrote:
> At my company we use packer to build ec2 images and really like it.
> I would like to use it for cloudstack also.
> 
> I found this: https://github.com/vogxn/packer-builtin
> 
> Which appears to be a centos6 image builder for cloudstack but it
> lacks instructions to convert the resultant image into something I
> can import to cloudstack.
> 
> Has anyone successfully done this?
> 
> How do you build cloudstack templates?

Hi Brian,

That repo only contains a test builtin I was trying to build using
packer. Peter Jonsson is working on a cloudstack builder for packer
and announced about this last week.

Peter's repo is here: 
https://github.com/mindjiver/packer

You will need go to run the packer src and setup the cloudstack
builder

$ make updatedeps
$ make

-- 
Prasanna.,


Powered by BigRock.com