RE: Update Hypervisor patches from cloudstack prospective
ACS does not update underlying hypervisor, you do it manually, one node at the time, as Daan suggested. Don't worry about different patch levels. Andrija On Jun 9, 2014 7:35 AM, Venkata Suneel Babu Mallela sunee...@simplifydc.com wrote: Hi Daan, Suppose there are two XenServers in one cluster. I want to update individual Server. I've enabled maintenance mode for one XenServer and applied all the patches manually. Then, if I disabled the maintenance mode what happened, the two XenServers are having two different level of Patches. Is it allow the clustering? Actual question is, Does CloudStack has the feature to update the underlying hypervisors or do we need to perform updates and patch at the hypervisor level. Thank you Suneel Mallela -Original Message- From: Daan Hoogland [mailto:daan.hoogl...@gmail.com] Sent: Saturday, June 7, 2014 1:42 PM To: users@cloudstack.apache.org Cc: Prakash Rao Banuka Subject: Re: Update Hypervisor patches from cloudstack prospective put the host in maintenance mode. and wait till all vm are migrated away from it. On Sat, Jun 7, 2014 at 6:19 AM, Venkata Suneel Babu Mallela sunee...@simplifydc.com wrote: Hi all, Is there any provision to apply patches for a hypervisor from cloudstack prospective? Thnak you, Suneel Mallela Sent from my Sony Xperia™ smartphone -- Daan
RE: Update Hypervisor patches from cloudstack prospective
You can go through detail instruction at following location http://cloudstack.apache.org/docs/en-US/Apache_CloudStack/4.2.0/html/Installation_Guide/citrix-xenserver-installation.html#xenserver-version-upgrading hope it will help. Thanks Shweta -Original Message- From: Andrija Panic [mailto:andrija.pa...@gmail.com] Sent: Monday, June 09, 2014 11:32 AM To: users@cloudstack.apache.org Cc: Prakash Rao Banuka Subject: RE: Update Hypervisor patches from cloudstack prospective ACS does not update underlying hypervisor, you do it manually, one node at the time, as Daan suggested. Don't worry about different patch levels. Andrija On Jun 9, 2014 7:35 AM, Venkata Suneel Babu Mallela sunee...@simplifydc.com wrote: Hi Daan, Suppose there are two XenServers in one cluster. I want to update individual Server. I've enabled maintenance mode for one XenServer and applied all the patches manually. Then, if I disabled the maintenance mode what happened, the two XenServers are having two different level of Patches. Is it allow the clustering? Actual question is, Does CloudStack has the feature to update the underlying hypervisors or do we need to perform updates and patch at the hypervisor level. Thank you Suneel Mallela -Original Message- From: Daan Hoogland [mailto:daan.hoogl...@gmail.com] Sent: Saturday, June 7, 2014 1:42 PM To: users@cloudstack.apache.org Cc: Prakash Rao Banuka Subject: Re: Update Hypervisor patches from cloudstack prospective put the host in maintenance mode. and wait till all vm are migrated away from it. On Sat, Jun 7, 2014 at 6:19 AM, Venkata Suneel Babu Mallela sunee...@simplifydc.com wrote: Hi all, Is there any provision to apply patches for a hypervisor from cloudstack prospective? Thnak you, Suneel Mallela Sent from my Sony Xperia™ smartphone -- Daan
System VM not starting in my cloudstack configuration.
Hello Team, Nice to work with apache cloudstack. I have configured cloud stack on my 3 server. One server as a management server/primary storage also with ip 103.255.100.18 which uses subnet 103.255.100.17/29. Second server as host server with ip 103.255.100.180 which uses subnet 103.255.100.128/26 3rd server which is secondary storage ip 103.255.100.186 which uses subnet 103.255.100.128/26 I am facing issue in secondary storage in cloud zone and systemvm's not running showing stopped. Kindly suggest me where i am making mistake. Thanks.
deleting or cancelling broken ACS jobs
Hello guys, was wondering if anyone have come across an issue where acs would get stuck on several jobs and keeps trying to do them over and over again? I've come across an issue a few days ago. For some reason I have about 5 or 6 XenServer cluster jobs which have gone crazy. These jobs are of different nature, like template creation, vm start and enable host maintenance. They keep on repeating in the logs about 20-30 times a second, causing overfilling of logs. I get about 20GB of management server logs each day and it seems that these stuck jobs are causing the overflow. I am also not able to perform any activity on the XenServer cluster which has those stuck jobs. I am unable to start or stop jobs or pretty much do anything with it. I've tried restarting both the management server and the xenserver hosts, but that didn't help. After a short while following a restart the same thing starts to happen. Is there a way for ACS to cancel / remove these jobs? I've looked at the async_job and async_job_view db tables and I can see 28 entries there amongst which are these stuck jobs gone crazy. Is it safe for me to simply remove them from the database and restart the management server? Are there any other db tables that I should look at? Many thanks Andrei
Re: System VM not starting in my cloudstack configuration.
Comments inline. On 09-Jun-2014, at 2:15 pm, Naval saini naval.sa...@snet.in wrote: Hello Team, Nice to work with apache cloudstack. I have configured cloud stack on my 3 server. One server as a management server/primary storage also with ip 103.255.100.18 which uses subnet 103.255.100.17/29. Second server as host server with ip 103.255.100.180 which uses subnet 103.255.100.128/26 3rd server which is secondary storage ip 103.255.100.186 which uses subnet 103.255.100.128/26 I am facing issue in secondary storage in cloud zone and systemvm's not running showing stopped. Have you checked the management server logs for any errors while starting the system VMs? -- @shankerbalan M: +91 98860 60539 | O: +91 (80) 67935867 shanker.ba...@shapeblue.com | www.shapeblue.com | Twitter:@shapeblue ShapeBlue Services India LLP, 22nd floor, Unit 2201A, World Trade Centre, Bangalore - 560 055 Find out more about ShapeBlue and our range of CloudStack related services IaaS Cloud Design Buildhttp://shapeblue.com/iaas-cloud-design-and-build// CSForge – rapid IaaS deployment frameworkhttp://shapeblue.com/csforge/ CloudStack Consultinghttp://shapeblue.com/cloudstack-consultancy/ CloudStack Infrastructure Supporthttp://shapeblue.com/cloudstack-infrastructure-support/ CloudStack Bootcamp Training Courseshttp://shapeblue.com/cloudstack-training/ This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
install usage server
Hi all, I want to monitor every VMs in my apache cloudstack, how I can install cloudstack-usage in my management server? Because my cloud_usage database is empty, apparently it need cloudstack-usage that has been installed in my MS. I'm using basic networking in my apache cloudstack. I trid to follow the instruction in http://cloudstack-installation.readthedocs.org/en/latest/optional_installation.html#installing-the-usage-server-optional but it shows that the ./install is not valid, Can someone show me the correct way to install it? Thanks, looking forward for your answer. Dimas.
Re: KVM + VMware (and ceph)
On 09.06.2014 16:17, Gerolamo Valcamonica wrote: Hi Everybody, i have a production environment of cloudstack 4.3 based on KVM hosts and CEPH storage It's a good solution for me and i have good performance on both compute and storage side But now i have an explicit customer request for VMware environment so I'm investigating about it. Here my questions: - Can i have a mixed environment KVM + VMware vSphere Essentials Plus Kit under Cloudstack? - Can I have a mixed networking environment , so that i can, as example, have a frontend VMs on KVM and a backend VMs on VMware, on the same customere? (- Third, but off topic, question: can i have VMware hosts and CEPH storage?) Is there someone with similar enviroment that can give me suggestion about this? Hello, You can add Vmware hosts in a different/new cluster and let your user access it, sounds pretty simple and AFAIK it well within ACS's capabilities. Regarding Vmware and CEPH, it's not impossible, but I've never heard about this. HTH Lucian -- Sent from the Delta quadrant using Borg technology! Nux! www.nux.ro
Re: install usage server
On 09.06.2014 15:41, dimas yoga pratama wrote: Hi all, I want to monitor every VMs in my apache cloudstack, how I can install cloudstack-usage in my management server? Because my cloud_usage database is empty, apparently it need cloudstack-usage that has been installed in my MS. I'm using basic networking in my apache cloudstack. I trid to follow the instruction in http://cloudstack-installation.readthedocs.org/en/latest/optional_installation.html#installing-the-usage-server-optional but it shows that the ./install is not valid, Can someone show me the correct way to install it? Thanks, looking forward for your answer. Dimas. You should use the provided packages[1] and also be aware of the following gotcha, the usage server will not have access to all the libraries it requires for a DB connection, so you need to do: ln -s /usr/share/java/mysql-connector-java.jar /usr/share/cloudstack-usage/lib/mysql-connector-java.jar [1] - http://cloudstack.apt-get.eu/ -- Sent from the Delta quadrant using Borg technology! Nux! www.nux.ro
Re: install usage server
On Jun 9, 2014, at 4:50 PM, Pierre-Luc Dion pd...@cloudops.com wrote: install package: cloudstack-usage ex: yum install cloudstack-usage then you can do: service cloudstack-usage start Nice catch on the documentation we will update this… Yeah, my bad I remember adding a big NOT VALID, NEED CORRECTION, but never got to fixing it. Pierre-Luc On Mon, Jun 9, 2014 at 10:41 AM, dimas yoga pratama smid...@gmail.com wrote: Hi all, I want to monitor every VMs in my apache cloudstack, how I can install cloudstack-usage in my management server? Because my cloud_usage database is empty, apparently it need cloudstack-usage that has been installed in my MS. I'm using basic networking in my apache cloudstack. I trid to follow the instruction in http://cloudstack-installation.readthedocs.org/en/latest/optional_installation.html#installing-the-usage-server-optional but it shows that the ./install is not valid, Can someone show me the correct way to install it? Thanks, looking forward for your answer. Dimas.
Re: install usage server
Hi, thanks for quick response I encounter this following error when i try to start cloudstack-usage : Starting CloudStack Usage Monitor cloudstack-usage09/06/2014 23:04:13 31554 jsvc error: Cannot locate Java Home cat: /var/run/cloudstack-usage.pid: No such file or directoryAILED] [FAILED] On Mon, Jun 9, 2014 at 10:25 PM, Nux! n...@li.nux.ro wrote: On 09.06.2014 15:41, dimas yoga pratama wrote: Hi all, I want to monitor every VMs in my apache cloudstack, how I can install cloudstack-usage in my management server? Because my cloud_usage database is empty, apparently it need cloudstack-usage that has been installed in my MS. I'm using basic networking in my apache cloudstack. I trid to follow the instruction in http://cloudstack-installation.readthedocs.org/en/latest/optional_ installation.html#installing-the-usage-server-optional but it shows that the ./install is not valid, Can someone show me the correct way to install it? Thanks, looking forward for your answer. Dimas. You should use the provided packages[1] and also be aware of the following gotcha, the usage server will not have access to all the libraries it requires for a DB connection, so you need to do: ln -s /usr/share/java/mysql-connector-java.jar /usr/share/cloudstack-usage/lib/mysql-connector-java.jar [1] - http://cloudstack.apt-get.eu/ -- Sent from the Delta quadrant using Borg technology! Nux! www.nux.ro
Re: KVM + VMware (and ceph)
Hi, I think you could export an rbd device as an iscsi lun and let vmware to use it. In this configuration you obtain a replicated lun . Il giorno 09/giu/2014 17:18, Gerolamo Valcamonica gerol...@pyder.com ha scritto: Hi Everybody, i have a production environment of cloudstack 4.3 based on KVM hosts and CEPH storage It's a good solution for me and i have good performance on both compute and storage side But now i have an explicit customer request for VMware environment so I'm investigating about it. Here my questions: - Can i have a mixed environment KVM + VMware vSphere Essentials Plus Kit under Cloudstack? - Can I have a mixed networking environment , so that i can, as example, have a frontend VMs on KVM and a backend VMs on VMware, on the same customere? (- Third, but off topic, question: can i have VMware hosts and CEPH storage?) Is there someone with similar enviroment that can give me suggestion about this? -- Gerolamo Valcamonica
Re: install usage server
look like a missing path to find java. I've fixed that on centos-6.5 by installing java1.6: yum install java-1.6.0-openjdk Pierre-Luc Dion Architecte de Solution Cloud | Cloud Solutions Architect 855-OK-CLOUD (855-652-5683) x1101 - - - *CloudOps*420 rue Guy Montréal QC H3J 1S6 www.cloudops.com @CloudOps_ On Mon, Jun 9, 2014 at 12:10 PM, dimas yoga pratama smid...@gmail.com wrote: Hi, thanks for quick response I encounter this following error when i try to start cloudstack-usage : Starting CloudStack Usage Monitor cloudstack-usage09/06/2014 23:04:13 31554 jsvc error: Cannot locate Java Home cat: /var/run/cloudstack-usage.pid: No such file or directoryAILED] [FAILED] On Mon, Jun 9, 2014 at 10:25 PM, Nux! n...@li.nux.ro wrote: On 09.06.2014 15:41, dimas yoga pratama wrote: Hi all, I want to monitor every VMs in my apache cloudstack, how I can install cloudstack-usage in my management server? Because my cloud_usage database is empty, apparently it need cloudstack-usage that has been installed in my MS. I'm using basic networking in my apache cloudstack. I trid to follow the instruction in http://cloudstack-installation.readthedocs.org/en/latest/optional_ installation.html#installing-the-usage-server-optional but it shows that the ./install is not valid, Can someone show me the correct way to install it? Thanks, looking forward for your answer. Dimas. You should use the provided packages[1] and also be aware of the following gotcha, the usage server will not have access to all the libraries it requires for a DB connection, so you need to do: ln -s /usr/share/java/mysql-connector-java.jar /usr/share/cloudstack-usage/lib/mysql-connector-java.jar [1] - http://cloudstack.apt-get.eu/ -- Sent from the Delta quadrant using Borg technology! Nux! www.nux.ro
Re: install usage server
Thanks Luc, I installed java-1.6.0 and it works. :) On Mon, Jun 9, 2014 at 11:39 PM, Pierre-Luc Dion pd...@cloudops.com wrote: look like a missing path to find java. I've fixed that on centos-6.5 by installing java1.6: yum install java-1.6.0-openjdk Pierre-Luc Dion Architecte de Solution Cloud | Cloud Solutions Architect 855-OK-CLOUD (855-652-5683) x1101 - - - *CloudOps*420 rue Guy Montréal QC H3J 1S6 www.cloudops.com @CloudOps_ On Mon, Jun 9, 2014 at 12:10 PM, dimas yoga pratama smid...@gmail.com wrote: Hi, thanks for quick response I encounter this following error when i try to start cloudstack-usage : Starting CloudStack Usage Monitor cloudstack-usage09/06/2014 23:04:13 31554 jsvc error: Cannot locate Java Home cat: /var/run/cloudstack-usage.pid: No such file or directoryAILED] [FAILED] On Mon, Jun 9, 2014 at 10:25 PM, Nux! n...@li.nux.ro wrote: On 09.06.2014 15:41, dimas yoga pratama wrote: Hi all, I want to monitor every VMs in my apache cloudstack, how I can install cloudstack-usage in my management server? Because my cloud_usage database is empty, apparently it need cloudstack-usage that has been installed in my MS. I'm using basic networking in my apache cloudstack. I trid to follow the instruction in http://cloudstack-installation.readthedocs.org/en/latest/optional_ installation.html#installing-the-usage-server-optional but it shows that the ./install is not valid, Can someone show me the correct way to install it? Thanks, looking forward for your answer. Dimas. You should use the provided packages[1] and also be aware of the following gotcha, the usage server will not have access to all the libraries it requires for a DB connection, so you need to do: ln -s /usr/share/java/mysql-connector-java.jar /usr/share/cloudstack-usage/lib/mysql-connector-java.jar [1] - http://cloudstack.apt-get.eu/ -- Sent from the Delta quadrant using Borg technology! Nux! www.nux.ro
can I run CloudStack without IPtables?
Hi,all: I am trying different network setups in my CloudStack eval effort, and I am wondering if CS can be configured to not use iptables at all , giving that my intended goal is for a private cloud dedicated to my own company, in our own datacenter and all our networks are behind our own hardware based firewalls already? If I can stop iptables on all system VM’s, hypervisors and management servers, then it would be much easier to trouble shoot my setups and accelerate the eval process. Thanks, Yiping
Re: can I run CloudStack without IPtables?
Yiping, Yes you can have non-iptables setup. Most of the enterprise installations don't rely on cloudstack's iptables, routing or vpc features and prefer to use existing physical firewalls and vlan isolation. If you have VLANs, but dont want to use iptables that comes thru virtual router, look into CloudStack Advanced Zone Setup with Shared Network Functionality. In this case, you only leverage dhcp, userdata and dns(optional). You can create your own network offerings and bind the network to non-vpc shared network offering. DHCP at this point in time is a required. Userdata and DNS can be optional. You can choose to use your own in-house DNS dont route DNS queries through CloudStack virtual router (you would need to create custom network offering, which is few clicks in UI). You can also bypass userdata and serve your own userdata through external userdata services, you would need to write something on your end to support it. Regards ilya On 6/9/14, 12:02 PM, Yiping Zhang wrote: Hi,all: I am trying different network setups in my CloudStack eval effort, and I am wondering if CS can be configured to not use iptables at all , giving that my intended goal is for a private cloud dedicated to my own company, in our own datacenter and all our networks are behind our own hardware based firewalls already? If I can stop iptables on all system VM’s, hypervisors and management servers, then it would be much easier to trouble shoot my setups and accelerate the eval process. Thanks, Yiping
Re: KVM + VMware (and ceph)
Gerolamo, As previously noted, you can mix and match with some degree of segregation (i.e. templates must be different). I've not tried mixing KVM + VMware recently, but i see no reason why you cannot do that, if i recall correctly, i've done so a year ago or so, when i first installed cloudstack. As for Cephs, i have somewhat similar setup, I have beefy vSphere hypervisors with about 1.5tb of SSD drives on each hypervisor with 10GB NICs, that until recently have been idle. I'm setting up Ceph cluster on these and will front them with iSCSI to ESX hosts as VMFS. You can also look into presenting Ceph as NFS to vmware. Regards, ilya On 6/9/14, 8:17 AM, Gerolamo Valcamonica wrote: Hi Everybody, i have a production environment of cloudstack 4.3 based on KVM hosts and CEPH storage It's a good solution for me and i have good performance on both compute and storage side But now i have an explicit customer request for VMware environment so I'm investigating about it. Here my questions: - Can i have a mixed environment KVM + VMware vSphere Essentials Plus Kit under Cloudstack? - Can I have a mixed networking environment , so that i can, as example, have a frontend VMs on KVM and a backend VMs on VMware, on the same customere? (- Third, but off topic, question: can i have VMware hosts and CEPH storage?) Is there someone with similar enviroment that can give me suggestion about this?
Network model
Hi, I made a model to use in my college research - which is attached here - to deploy cloudstack in two machines, using two interfaces. Can anybody tell me if is it alright? If it isn't, can you tell me what is wrong so I can fixed it? * The dotted line means that the hypervisor creates the virtual router, VMs and SSVMS. * The machine which has management server also act as primary and secondary storage using NFS. * The hypervisor is a XenServer. * The router with IP 10.16.0.1 is a private router situated in my lab Thanks a lot. -- Ana Paula de Sousa Oliveira Graduando em Ciência da Computação Universidade Federal de Goiás
Problem SSVM with new Template
Hello guys, I have a problem with the SSVM after upgrade 4.2.1 to 4.3, if I test create a new vm from a new template the platform generate error and inform not possible create vm the errors inform, not possible copy template to primary storage and insufficient capacity but I restart the ssvm and the platform inform that agent is connecting (no up) and deploy a new vm from new template the vm create and running good, if the agent inform up in SSVM generate error know where the error may be?, the hypervisor vmware and the template for vm system is system vm-vmware-4.3, thanks Cordialmente / Best regards, Yesid Mora | Orchestration Engineer | O4IT PBX:+57 (1) 423-5460 Ext 251 | Cel: 3124509565 | Oficina 202 | www.o4it.comhttp://www.o4it.com | ym...@o4it.commailto:ym...@o4it.com [http://www.o4it.com]http://www.o4it.com[http://www.linkedin.com/company/1207504]http://www.linkedin.com/company/1207504[https://twitter.com/o4it]https://twitter.com/o4it[https://www.facebook.com/o4itofficial]https://www.facebook.com/o4itofficial[https://www.youtube.com/user/o4itofficial]https://www.youtube.com/user/o4itofficial CONFIDENTIALITY NOTICE: This e-mail message, including any attachments, is for the sole use of the intended recipient(s) and may contain confidential or proprietary information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, immediately contact the sender by reply e-mail and destroy all copies of the original message.
RE: Examples of configuring DB HA?
I was very close to getting this up and running in the lab (Centos 6.5 – 2 x sql servers and 1 mgmt server – all running in VMware Workstation, installed from 4.3 repo) but when setting the db.ha.enabled to true and restarting the mgmt. server, I now get 404 from tomcat and the management server log has lines in it saying things like: 2014-06-09 22:48:00,632 ERROR [c.c.u.d.Merovingian2] (main:null) Unable to get a new db connection java.sql.SQLException: Invalid load balancing strategy 'com.cloud.utils.db.StaticStrategy'. […] Caused by: java.lang.ClassNotFoundException: com.cloud.utils.db.StaticStrategy Anyone got any idea? Tried Googling and searching the mailing list but nothing that I can see as an answer. I’m just a lowly network engineer so wouldn’t know what these errors mean but I’m guessing I won’t be the first. Any ideas? *From:* Adrian Lewis [mailto:adr...@alsiconsulting.co.uk] *Sent:* 06 June 2014 10:51 *To:* users@cloudstack.apache.org *Subject:* Re: Examples of configuring DB HA? Hi all, Firstly thanks for the great responses already. Secondly, regarding HA vs failover, I had been assuming these as much the same. Based on what I had read about the new changes in 4.3, I had assumed that the new feature allows you to configure standard MySQL (clustering not required - Galera or otherwise) in a multimaster replication setup and that while management servers only speak with a single server at a time, failover to a backup server is automatic and does not need any work on the MySQL side to promote a slave to a master as with a basic master/slave setup. I'm personally not interested in load balancing just yet, simply having a hot standby DB that takes over automatically. This is what I take the term HA to mean. From the wiki, I'm also taking it that the use of the auto increment and offset values ensure that the two DBs can safely run as master-master in the event that each gets written to concurrently (split brain or just two mgmt servers failing over at slightly different times). It seems that this thread is already highlighting some of the confusion I and others have faced. Hopefully it will help someone else. Thanks again, Adrian On 6 Jun 2014 07:18, Shanker Balan shanker.ba...@shapeblue.com wrote: Hi Damodar, Comments inline. On 06-Jun-2014, at 10:53 am, Damoder Reddy damoder.re...@citrix.com wrote: Hi Adrian, For your question, . Is the CS side purely for failover or does it actually set up part of the replication for you? The answer is, the Cloud Stack does only failover configuration and the actual replication process on the mysql side has to be done by own. https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=34838207 For the second question, Can you easily enable an existing DB for HA or is this best done before there’s any data? The answer is, we can setup replication even with existing data and then start the management servers. The mysql documentation contains the clear steps how to setup replication with existing documentation. Probably that is the reason why we might not have included these steps in the doc. The OP is looking for HA, not failover. HA is possible in ACS 4.3.0 using MySQL Clustering. Once you have MySQL Clustering, its multi-master and not one master to many slaves. ACS should not fence itself like it currently does when the master is not available. The configuraiton we need to do on each management server is as below. You can follow the design doc steps if you think there is a minimal documentation in the 4.3 doc. The design doc also contains the links to mysql site for setting up the replication for fresh as well as existing setups. From the cloud stack side it is purely failover and falling back between the IPs configured for the master/salve databases. https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=34838207 -Original Message- From: Adrian Lewis [mailto:adr...@alsiconsulting.co.uk] Sent: Friday, June 6, 2014 6:46 AM To: users@cloudstack.apache.org Subject: Examples of configuring DB HA? Hi all, Does anyone have any example configs or blog posts explaining the DB HA features introduced in 4.3? Between the section in the design docs on the wiki and the official docs, I’m a little confused as to how it’s supposed to be set up – they appear to differ although there’s a lot more detail in the design docs. Some of it is clearly MySQL stuff that’s outside of Cloudstack but some of it is Cloudstack config as well. I’m just trying to get a feel for what is the best way to use what’s made it into 4.3 final (if different to the design docs). I’m not too strong on MySQL so I can’t easily work out what’s a requirement, what’s just recommended (and implications) and what the Cloudstack side actually does. Is the CS side purely for failover or does it actually set up part of the replication for you? Can you easily enable an existing DB for HA or is this best done before there’s
Re: Examples of configuring DB HA?
Well, tomcat is returning 404, because the app is not running. As a consequence of a class not found exception. Find the jar that contains the classes that are missing and add them into the classpath. On Mon, Jun 9, 2014 at 7:18 PM, Adrian Lewis adr...@alsiconsulting.co.uk wrote: I was very close to getting this up and running in the lab (Centos 6.5 – 2 x sql servers and 1 mgmt server – all running in VMware Workstation, installed from 4.3 repo) but when setting the db.ha.enabled to true and restarting the mgmt. server, I now get 404 from tomcat and the management server log has lines in it saying things like: 2014-06-09 22:48:00,632 ERROR [c.c.u.d.Merovingian2] (main:null) Unable to get a new db connection java.sql.SQLException: Invalid load balancing strategy 'com.cloud.utils.db.StaticStrategy'. […] Caused by: java.lang.ClassNotFoundException: com.cloud.utils.db.StaticStrategy Anyone got any idea? Tried Googling and searching the mailing list but nothing that I can see as an answer. I’m just a lowly network engineer so wouldn’t know what these errors mean but I’m guessing I won’t be the first. Any ideas? *From:* Adrian Lewis [mailto:adr...@alsiconsulting.co.uk] *Sent:* 06 June 2014 10:51 *To:* users@cloudstack.apache.org *Subject:* Re: Examples of configuring DB HA? Hi all, Firstly thanks for the great responses already. Secondly, regarding HA vs failover, I had been assuming these as much the same. Based on what I had read about the new changes in 4.3, I had assumed that the new feature allows you to configure standard MySQL (clustering not required - Galera or otherwise) in a multimaster replication setup and that while management servers only speak with a single server at a time, failover to a backup server is automatic and does not need any work on the MySQL side to promote a slave to a master as with a basic master/slave setup. I'm personally not interested in load balancing just yet, simply having a hot standby DB that takes over automatically. This is what I take the term HA to mean. From the wiki, I'm also taking it that the use of the auto increment and offset values ensure that the two DBs can safely run as master-master in the event that each gets written to concurrently (split brain or just two mgmt servers failing over at slightly different times). It seems that this thread is already highlighting some of the confusion I and others have faced. Hopefully it will help someone else. Thanks again, Adrian On 6 Jun 2014 07:18, Shanker Balan shanker.ba...@shapeblue.com wrote: Hi Damodar, Comments inline. On 06-Jun-2014, at 10:53 am, Damoder Reddy damoder.re...@citrix.com wrote: Hi Adrian, For your question, . Is the CS side purely for failover or does it actually set up part of the replication for you? The answer is, the Cloud Stack does only failover configuration and the actual replication process on the mysql side has to be done by own. https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=34838207 For the second question, Can you easily enable an existing DB for HA or is this best done before there’s any data? The answer is, we can setup replication even with existing data and then start the management servers. The mysql documentation contains the clear steps how to setup replication with existing documentation. Probably that is the reason why we might not have included these steps in the doc. The OP is looking for HA, not failover. HA is possible in ACS 4.3.0 using MySQL Clustering. Once you have MySQL Clustering, its multi-master and not one master to many slaves. ACS should not fence itself like it currently does when the master is not available. The configuraiton we need to do on each management server is as below. You can follow the design doc steps if you think there is a minimal documentation in the 4.3 doc. The design doc also contains the links to mysql site for setting up the replication for fresh as well as existing setups. From the cloud stack side it is purely failover and falling back between the IPs configured for the master/salve databases. https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=34838207 -Original Message- From: Adrian Lewis [mailto:adr...@alsiconsulting.co.uk] Sent: Friday, June 6, 2014 6:46 AM To: users@cloudstack.apache.org Subject: Examples of configuring DB HA? Hi all, Does anyone have any example configs or blog posts explaining the DB HA features introduced in 4.3? Between the section in the design docs on the wiki and the official docs, I’m a little confused as to how it’s supposed to be set up – they appear to differ although there’s a lot more detail in the design docs. Some of it is clearly MySQL stuff that’s outside of Cloudstack but some of it is Cloudstack config as well. I’m just trying to get a feel for what is the best way to use what’s made it into 4.3 final
Re: can I run CloudStack without IPtables?
Ilya: Thanks for quick clarification.I¹ll check out defining my own network offerings. Yiping On 6/9/14, 1:21 PM, ilya musayev ilya.mailing.li...@gmail.com wrote: Yiping, Yes you can have non-iptables setup. Most of the enterprise installations don't rely on cloudstack's iptables, routing or vpc features and prefer to use existing physical firewalls and vlan isolation. If you have VLANs, but dont want to use iptables that comes thru virtual router, look into CloudStack Advanced Zone Setup with Shared Network Functionality. In this case, you only leverage dhcp, userdata and dns(optional). You can create your own network offerings and bind the network to non-vpc shared network offering. DHCP at this point in time is a required. Userdata and DNS can be optional. You can choose to use your own in-house DNS dont route DNS queries through CloudStack virtual router (you would need to create custom network offering, which is few clicks in UI). You can also bypass userdata and serve your own userdata through external userdata services, you would need to write something on your end to support it. Regards ilya On 6/9/14, 12:02 PM, Yiping Zhang wrote: Hi,all: I am trying different network setups in my CloudStack eval effort, and I am wondering if CS can be configured to not use iptables at all , giving that my intended goal is for a private cloud dedicated to my own company, in our own datacenter and all our networks are behind our own hardware based firewalls already? If I can stop iptables on all system VM¹s, hypervisors and management servers, then it would be much easier to trouble shoot my setups and accelerate the eval process. Thanks, Yiping
Management Server Startup Issue
Anyone have any idea why the management service would refuse to start if the DB server is configured as a master for replication? log_bin=mysql-bin server_id=1 Adding the above the my.cnf file of my DB server, restarting mysql then restarting cloudstack-managment will cause cloudstack to get hung on startup here. 2014-06-09 18:25:33,769 INFO [c.c.u.c.ComponentContext] (main:null) Starting com.cloud.bridge.persist.dao.SHostDaoImpl_EnhancerByCloudStack_9da5499b 2014-06-09 18:25:33,769 INFO [c.c.u.c.ComponentContext] (main:null) Starting com.cloud.bridge.persist.dao.SObjectDaoImpl_EnhancerByCloudStack_847fb98c 2014-06-09 18:25:33,769 INFO [c.c.u.c.ComponentContext] (main:null) Starting com.cloud.bridge.persist.dao.CloudStackUserDaoImpl_EnhancerByCloudStack_7fce3ee6 2014-06-09 18:25:33,769 INFO [c.c.u.c.ComponentContext] (main:null) Starting com.cloud.bridge.service.core.ec2.EC2Engine_EnhancerByCloudStack_d70c9e3c 2014-06-09 18:25:33,769 INFO [c.c.u.c.ComponentContext] (main:null) Starting com.cloud.bridge.service.controller.s3.ServiceProvider_EnhancerByCloudStack_23d38b1 That is the last few lines of the management-server.log and it will hang there indefinitely. I noticed this on startup as well. 2014-06-09 18:25:16,841 INFO [c.c.u.d.T.Transaction] (main:null) Is Data Base High Availiability enabled? Ans : false 2014-06-09 18:25:17,164 DEBUG [c.c.u.d.ConnectionConcierge] (main:null) Registering a database connection for LockMaster1 2014-06-09 18:25:17,164 INFO [c.c.u.d.Merovingian2] (main:null) Cleaning up locks for 345049793560 2014-06-09 18:25:17,175 INFO [c.c.u.d.Merovingian2] (main:null) Released 0 locks for 345049793560 2014-06-09 18:25:17,206 INFO [o.a.c.s.l.CloudStackExtendedLifeCycle] (main:null) Running system integrity checker com.cloud.upgrade.DatabaseUpgradeChecker@63c8e4ae 2014-06-09 18:25:17,207 INFO [c.c.u.DatabaseUpgradeChecker] (main:null) Grabbing lock to check for database upgrade. 2014-06-09 18:25:17,254 DEBUG [c.c.u.d.VersionDaoImpl] (main:null) Checking to see if the database is at a version before it was the version table is created 2014-06-09 18:25:17,295 INFO [c.c.u.DatabaseUpgradeChecker] (main:null) DB version = 4.3.0 Code Version = 4.3.0 2014-06-09 18:25:17,296 INFO [c.c.u.DatabaseUpgradeChecker] (main:null) DB version and code version matches so no upgrade needed. The management server talking to the DB server at least enough to check the version; and mysql from the command line on the management server works fine as well. This line caught my attention. 2014-06-09 18:25:16,841 INFO [c.c.u.d.T.Transaction] (main:null) Is Data Base High Availiability enabled? Ans : false Is there something I need to set when using mysql replication specific to cloudstack? I do not see anything in the documentation on this other than setting up basic replication. if I comment out the above two lines in my.cnf and restart the management server it fires up just fine. I don’t get how enabling bin log would make a difference at all. Any help or explication for this strange issue would be appreciated. - Steve Searles
RE: Examples of configuring DB HA?
I'm going to sound stupid here but how do I find the jar that contains the classes and what is the classpath? Is this a bug of some sort? -Original Message- From: Rafael Weingartner [mailto:rafaelweingart...@gmail.com] Sent: 09 June 2014 23:28 To: users@cloudstack.apache.org Subject: Re: Examples of configuring DB HA? Well, tomcat is returning 404, because the app is not running. As a consequence of a class not found exception. Find the jar that contains the classes that are missing and add them into the classpath. On Mon, Jun 9, 2014 at 7:18 PM, Adrian Lewis adr...@alsiconsulting.co.uk wrote: I was very close to getting this up and running in the lab (Centos 6.5 – 2 x sql servers and 1 mgmt server – all running in VMware Workstation, installed from 4.3 repo) but when setting the db.ha.enabled to true and restarting the mgmt. server, I now get 404 from tomcat and the management server log has lines in it saying things like: 2014-06-09 22:48:00,632 ERROR [c.c.u.d.Merovingian2] (main:null) Unable to get a new db connection java.sql.SQLException: Invalid load balancing strategy 'com.cloud.utils.db.StaticStrategy'. […] Caused by: java.lang.ClassNotFoundException: com.cloud.utils.db.StaticStrategy Anyone got any idea? Tried Googling and searching the mailing list but nothing that I can see as an answer. I’m just a lowly network engineer so wouldn’t know what these errors mean but I’m guessing I won’t be the first. Any ideas? *From:* Adrian Lewis [mailto:adr...@alsiconsulting.co.uk] *Sent:* 06 June 2014 10:51 *To:* users@cloudstack.apache.org *Subject:* Re: Examples of configuring DB HA? Hi all, Firstly thanks for the great responses already. Secondly, regarding HA vs failover, I had been assuming these as much the same. Based on what I had read about the new changes in 4.3, I had assumed that the new feature allows you to configure standard MySQL (clustering not required - Galera or otherwise) in a multimaster replication setup and that while management servers only speak with a single server at a time, failover to a backup server is automatic and does not need any work on the MySQL side to promote a slave to a master as with a basic master/slave setup. I'm personally not interested in load balancing just yet, simply having a hot standby DB that takes over automatically. This is what I take the term HA to mean. From the wiki, I'm also taking it that the use of the auto increment and offset values ensure that the two DBs can safely run as master-master in the event that each gets written to concurrently (split brain or just two mgmt servers failing over at slightly different times). It seems that this thread is already highlighting some of the confusion I and others have faced. Hopefully it will help someone else. Thanks again, Adrian On 6 Jun 2014 07:18, Shanker Balan shanker.ba...@shapeblue.com wrote: Hi Damodar, Comments inline. On 06-Jun-2014, at 10:53 am, Damoder Reddy damoder.re...@citrix.com wrote: Hi Adrian, For your question, . Is the CS side purely for failover or does it actually set up part of the replication for you? The answer is, the Cloud Stack does only failover configuration and the actual replication process on the mysql side has to be done by own. https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=34838 207 For the second question, Can you easily enable an existing DB for HA or is this best done before there’s any data? The answer is, we can setup replication even with existing data and then start the management servers. The mysql documentation contains the clear steps how to setup replication with existing documentation. Probably that is the reason why we might not have included these steps in the doc. The OP is looking for HA, not failover. HA is possible in ACS 4.3.0 using MySQL Clustering. Once you have MySQL Clustering, its multi-master and not one master to many slaves. ACS should not fence itself like it currently does when the master is not available. The configuraiton we need to do on each management server is as below. You can follow the design doc steps if you think there is a minimal documentation in the 4.3 doc. The design doc also contains the links to mysql site for setting up the replication for fresh as well as existing setups. From the cloud stack side it is purely failover and falling back between the IPs configured for the master/salve databases. https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=34838 207 -Original Message- From: Adrian Lewis [mailto:adr...@alsiconsulting.co.uk] Sent: Friday, June 6, 2014 6:46 AM To: users@cloudstack.apache.org Subject: Examples of configuring DB HA? Hi all, Does anyone have any example configs or blog posts explaining the DB HA features introduced in 4.3? Between the section in the design docs on the wiki and the official
Re: Network model
Ana Paula, You cannot attach messages to mailing list. Please post it online on free file sharing sites (or google drive) and reference in this thread. CloudStack has been deployed in many universities, here is one blog of many on how it was deployed @ David Eccles School of Business, University of Utah by Kent Johnson http://uofucloudcapstone.wordpress.com Regards ilya On 6/9/14, 1:51 PM, Ana Paula de Sousa wrote: Hi, I made a model to use in my college research - which is attached here - to deploy cloudstack in two machines, using two interfaces. Can anybody tell me if is it alright? If it isn't, can you tell me what is wrong so I can fixed it? * The dotted line means that the hypervisor creates the virtual router, VMs and SSVMS. * The machine which has management server also act as primary and secondary storage using NFS. * The hypervisor is a XenServer. * The router with IP 10.16.0.1 is a private router situated in my lab Thanks a lot. -- Ana Paula de Sousa Oliveira Graduando em Ciência da Computação Universidade Federal de Goiás
RE: Examples of configuring DB HA?
I guess my question should perhaps be, does anyone know why the jar that contains the class isn’t already in the classpath and what's the best way to fix it? -Original Message- From: Adrian Lewis [mailto:adr...@alsiconsulting.co.uk] Sent: 09 June 2014 23:37 To: users@cloudstack.apache.org Subject: RE: Examples of configuring DB HA? I'm going to sound stupid here but how do I find the jar that contains the classes and what is the classpath? Is this a bug of some sort? -Original Message- From: Rafael Weingartner [mailto:rafaelweingart...@gmail.com] Sent: 09 June 2014 23:28 To: users@cloudstack.apache.org Subject: Re: Examples of configuring DB HA? Well, tomcat is returning 404, because the app is not running. As a consequence of a class not found exception. Find the jar that contains the classes that are missing and add them into the classpath. On Mon, Jun 9, 2014 at 7:18 PM, Adrian Lewis adr...@alsiconsulting.co.uk wrote: I was very close to getting this up and running in the lab (Centos 6.5 – 2 x sql servers and 1 mgmt server – all running in VMware Workstation, installed from 4.3 repo) but when setting the db.ha.enabled to true and restarting the mgmt. server, I now get 404 from tomcat and the management server log has lines in it saying things like: 2014-06-09 22:48:00,632 ERROR [c.c.u.d.Merovingian2] (main:null) Unable to get a new db connection java.sql.SQLException: Invalid load balancing strategy 'com.cloud.utils.db.StaticStrategy'. […] Caused by: java.lang.ClassNotFoundException: com.cloud.utils.db.StaticStrategy Anyone got any idea? Tried Googling and searching the mailing list but nothing that I can see as an answer. I’m just a lowly network engineer so wouldn’t know what these errors mean but I’m guessing I won’t be the first. Any ideas? *From:* Adrian Lewis [mailto:adr...@alsiconsulting.co.uk] *Sent:* 06 June 2014 10:51 *To:* users@cloudstack.apache.org *Subject:* Re: Examples of configuring DB HA? Hi all, Firstly thanks for the great responses already. Secondly, regarding HA vs failover, I had been assuming these as much the same. Based on what I had read about the new changes in 4.3, I had assumed that the new feature allows you to configure standard MySQL (clustering not required - Galera or otherwise) in a multimaster replication setup and that while management servers only speak with a single server at a time, failover to a backup server is automatic and does not need any work on the MySQL side to promote a slave to a master as with a basic master/slave setup. I'm personally not interested in load balancing just yet, simply having a hot standby DB that takes over automatically. This is what I take the term HA to mean. From the wiki, I'm also taking it that the use of the auto increment and offset values ensure that the two DBs can safely run as master-master in the event that each gets written to concurrently (split brain or just two mgmt servers failing over at slightly different times). It seems that this thread is already highlighting some of the confusion I and others have faced. Hopefully it will help someone else. Thanks again, Adrian On 6 Jun 2014 07:18, Shanker Balan shanker.ba...@shapeblue.com wrote: Hi Damodar, Comments inline. On 06-Jun-2014, at 10:53 am, Damoder Reddy damoder.re...@citrix.com wrote: Hi Adrian, For your question, . Is the CS side purely for failover or does it actually set up part of the replication for you? The answer is, the Cloud Stack does only failover configuration and the actual replication process on the mysql side has to be done by own. https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=34838 207 For the second question, Can you easily enable an existing DB for HA or is this best done before there’s any data? The answer is, we can setup replication even with existing data and then start the management servers. The mysql documentation contains the clear steps how to setup replication with existing documentation. Probably that is the reason why we might not have included these steps in the doc. The OP is looking for HA, not failover. HA is possible in ACS 4.3.0 using MySQL Clustering. Once you have MySQL Clustering, its multi-master and not one master to many slaves. ACS should not fence itself like it currently does when the master is not available. The configuraiton we need to do on each management server is as below. You can follow the design doc steps if you think there is a minimal documentation in the 4.3 doc. The design doc also contains the links to mysql site for setting up the replication for fresh as well as existing setups. From the cloud stack side it is purely failover and falling back between the IPs configured for the master/salve databases. https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=34838 207 -Original Message- From: Adrian Lewis
Re: Management Server Startup Issue
please give more logs. It is the 4.3.0 right? I bet there is a problem with a missing dependency. On Mon, Jun 9, 2014 at 7:32 PM, Steve Searles ssear...@zimcom.net wrote: Anyone have any idea why the management service would refuse to start if the DB server is configured as a master for replication? log_bin=mysql-bin server_id=1 Adding the above the my.cnf file of my DB server, restarting mysql then restarting cloudstack-managment will cause cloudstack to get hung on startup here. 2014-06-09 18:25:33,769 INFO [c.c.u.c.ComponentContext] (main:null) Starting com.cloud.bridge.persist.dao.SHostDaoImpl_EnhancerByCloudStack_9da5499b 2014-06-09 18:25:33,769 INFO [c.c.u.c.ComponentContext] (main:null) Starting com.cloud.bridge.persist.dao.SObjectDaoImpl_EnhancerByCloudStack_847fb98c 2014-06-09 18:25:33,769 INFO [c.c.u.c.ComponentContext] (main:null) Starting com.cloud.bridge.persist.dao.CloudStackUserDaoImpl_EnhancerByCloudStack_7fce3ee6 2014-06-09 18:25:33,769 INFO [c.c.u.c.ComponentContext] (main:null) Starting com.cloud.bridge.service.core.ec2.EC2Engine_EnhancerByCloudStack_d70c9e3c 2014-06-09 18:25:33,769 INFO [c.c.u.c.ComponentContext] (main:null) Starting com.cloud.bridge.service.controller.s3.ServiceProvider_EnhancerByCloudStack_23d38b1 That is the last few lines of the management-server.log and it will hang there indefinitely. I noticed this on startup as well. 2014-06-09 18:25:16,841 INFO [c.c.u.d.T.Transaction] (main:null) Is Data Base High Availiability enabled? Ans : false 2014-06-09 18:25:17,164 DEBUG [c.c.u.d.ConnectionConcierge] (main:null) Registering a database connection for LockMaster1 2014-06-09 18:25:17,164 INFO [c.c.u.d.Merovingian2] (main:null) Cleaning up locks for 345049793560 2014-06-09 18:25:17,175 INFO [c.c.u.d.Merovingian2] (main:null) Released 0 locks for 345049793560 2014-06-09 18:25:17,206 INFO [o.a.c.s.l.CloudStackExtendedLifeCycle] (main:null) Running system integrity checker com.cloud.upgrade.DatabaseUpgradeChecker@63c8e4ae 2014-06-09 18:25:17,207 INFO [c.c.u.DatabaseUpgradeChecker] (main:null) Grabbing lock to check for database upgrade. 2014-06-09 18:25:17,254 DEBUG [c.c.u.d.VersionDaoImpl] (main:null) Checking to see if the database is at a version before it was the version table is created 2014-06-09 18:25:17,295 INFO [c.c.u.DatabaseUpgradeChecker] (main:null) DB version = 4.3.0 Code Version = 4.3.0 2014-06-09 18:25:17,296 INFO [c.c.u.DatabaseUpgradeChecker] (main:null) DB version and code version matches so no upgrade needed. The management server talking to the DB server at least enough to check the version; and mysql from the command line on the management server works fine as well. This line caught my attention. 2014-06-09 18:25:16,841 INFO [c.c.u.d.T.Transaction] (main:null) Is Data Base High Availiability enabled? Ans : false Is there something I need to set when using mysql replication specific to cloudstack? I do not see anything in the documentation on this other than setting up basic replication. if I comment out the above two lines in my.cnf and restart the management server it fires up just fine. I don’t get how enabling bin log would make a difference at all. Any help or explication for this strange issue would be appreciated. - Steve Searles -- Rafael Weingärtner
Re: Examples of configuring DB HA?
the last question is the proper one.. ;) Probably because someone forgot it. I also hate when this kind of thing happens... How did you set up the CS version ? I mean fresh install 4.3 or upgrade from an older version? On Mon, Jun 9, 2014 at 7:49 PM, Adrian Lewis adr...@alsiconsulting.co.uk wrote: I guess my question should perhaps be, does anyone know why the jar that contains the class isn’t already in the classpath and what's the best way to fix it? -Original Message- From: Adrian Lewis [mailto:adr...@alsiconsulting.co.uk] Sent: 09 June 2014 23:37 To: users@cloudstack.apache.org Subject: RE: Examples of configuring DB HA? I'm going to sound stupid here but how do I find the jar that contains the classes and what is the classpath? Is this a bug of some sort? -Original Message- From: Rafael Weingartner [mailto:rafaelweingart...@gmail.com] Sent: 09 June 2014 23:28 To: users@cloudstack.apache.org Subject: Re: Examples of configuring DB HA? Well, tomcat is returning 404, because the app is not running. As a consequence of a class not found exception. Find the jar that contains the classes that are missing and add them into the classpath. On Mon, Jun 9, 2014 at 7:18 PM, Adrian Lewis adr...@alsiconsulting.co.uk wrote: I was very close to getting this up and running in the lab (Centos 6.5 – 2 x sql servers and 1 mgmt server – all running in VMware Workstation, installed from 4.3 repo) but when setting the db.ha.enabled to true and restarting the mgmt. server, I now get 404 from tomcat and the management server log has lines in it saying things like: 2014-06-09 22:48:00,632 ERROR [c.c.u.d.Merovingian2] (main:null) Unable to get a new db connection java.sql.SQLException: Invalid load balancing strategy 'com.cloud.utils.db.StaticStrategy'. […] Caused by: java.lang.ClassNotFoundException: com.cloud.utils.db.StaticStrategy Anyone got any idea? Tried Googling and searching the mailing list but nothing that I can see as an answer. I’m just a lowly network engineer so wouldn’t know what these errors mean but I’m guessing I won’t be the first. Any ideas? *From:* Adrian Lewis [mailto:adr...@alsiconsulting.co.uk] *Sent:* 06 June 2014 10:51 *To:* users@cloudstack.apache.org *Subject:* Re: Examples of configuring DB HA? Hi all, Firstly thanks for the great responses already. Secondly, regarding HA vs failover, I had been assuming these as much the same. Based on what I had read about the new changes in 4.3, I had assumed that the new feature allows you to configure standard MySQL (clustering not required - Galera or otherwise) in a multimaster replication setup and that while management servers only speak with a single server at a time, failover to a backup server is automatic and does not need any work on the MySQL side to promote a slave to a master as with a basic master/slave setup. I'm personally not interested in load balancing just yet, simply having a hot standby DB that takes over automatically. This is what I take the term HA to mean. From the wiki, I'm also taking it that the use of the auto increment and offset values ensure that the two DBs can safely run as master-master in the event that each gets written to concurrently (split brain or just two mgmt servers failing over at slightly different times). It seems that this thread is already highlighting some of the confusion I and others have faced. Hopefully it will help someone else. Thanks again, Adrian On 6 Jun 2014 07:18, Shanker Balan shanker.ba...@shapeblue.com wrote: Hi Damodar, Comments inline. On 06-Jun-2014, at 10:53 am, Damoder Reddy damoder.re...@citrix.com wrote: Hi Adrian, For your question, . Is the CS side purely for failover or does it actually set up part of the replication for you? The answer is, the Cloud Stack does only failover configuration and the actual replication process on the mysql side has to be done by own. https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=34838 207 For the second question, Can you easily enable an existing DB for HA or is this best done before there’s any data? The answer is, we can setup replication even with existing data and then start the management servers. The mysql documentation contains the clear steps how to setup replication with existing documentation. Probably that is the reason why we might not have included these steps in the doc. The OP is looking for HA, not failover. HA is possible in ACS 4.3.0 using MySQL Clustering. Once you have MySQL Clustering, its multi-master and not one master to many slaves. ACS should not fence itself like it currently does when the master is not available. The configuraiton we need to do on each management server is as below. You can follow the design doc steps if you think
RE: Examples of configuring DB HA?
Fresh 4.3 from the RPMs in the repo. Done yesterday. Had to yum install mysql on the management server as the client binaries weren't present but mysql-connector-java was installed as a dependency of the cloudstack rpm. Could something else be missing on the Centos side or does this look like a CS issue? -Original Message- From: Rafael Weingartner [mailto:rafaelweingart...@gmail.com] Sent: 10 June 2014 00:01 To: users@cloudstack.apache.org Subject: Re: Examples of configuring DB HA? the last question is the proper one.. ;) Probably because someone forgot it. I also hate when this kind of thing happens... How did you set up the CS version ? I mean fresh install 4.3 or upgrade from an older version? On Mon, Jun 9, 2014 at 7:49 PM, Adrian Lewis adr...@alsiconsulting.co.uk wrote: I guess my question should perhaps be, does anyone know why the jar that contains the class isn’t already in the classpath and what's the best way to fix it? -Original Message- From: Adrian Lewis [mailto:adr...@alsiconsulting.co.uk] Sent: 09 June 2014 23:37 To: users@cloudstack.apache.org Subject: RE: Examples of configuring DB HA? I'm going to sound stupid here but how do I find the jar that contains the classes and what is the classpath? Is this a bug of some sort? -Original Message- From: Rafael Weingartner [mailto:rafaelweingart...@gmail.com] Sent: 09 June 2014 23:28 To: users@cloudstack.apache.org Subject: Re: Examples of configuring DB HA? Well, tomcat is returning 404, because the app is not running. As a consequence of a class not found exception. Find the jar that contains the classes that are missing and add them into the classpath. On Mon, Jun 9, 2014 at 7:18 PM, Adrian Lewis adr...@alsiconsulting.co.uk wrote: I was very close to getting this up and running in the lab (Centos 6.5 – 2 x sql servers and 1 mgmt server – all running in VMware Workstation, installed from 4.3 repo) but when setting the db.ha.enabled to true and restarting the mgmt. server, I now get 404 from tomcat and the management server log has lines in it saying things like: 2014-06-09 22:48:00,632 ERROR [c.c.u.d.Merovingian2] (main:null) Unable to get a new db connection java.sql.SQLException: Invalid load balancing strategy 'com.cloud.utils.db.StaticStrategy'. […] Caused by: java.lang.ClassNotFoundException: com.cloud.utils.db.StaticStrategy Anyone got any idea? Tried Googling and searching the mailing list but nothing that I can see as an answer. I’m just a lowly network engineer so wouldn’t know what these errors mean but I’m guessing I won’t be the first. Any ideas? *From:* Adrian Lewis [mailto:adr...@alsiconsulting.co.uk] *Sent:* 06 June 2014 10:51 *To:* users@cloudstack.apache.org *Subject:* Re: Examples of configuring DB HA? Hi all, Firstly thanks for the great responses already. Secondly, regarding HA vs failover, I had been assuming these as much the same. Based on what I had read about the new changes in 4.3, I had assumed that the new feature allows you to configure standard MySQL (clustering not required - Galera or otherwise) in a multimaster replication setup and that while management servers only speak with a single server at a time, failover to a backup server is automatic and does not need any work on the MySQL side to promote a slave to a master as with a basic master/slave setup. I'm personally not interested in load balancing just yet, simply having a hot standby DB that takes over automatically. This is what I take the term HA to mean. From the wiki, I'm also taking it that the use of the auto increment and offset values ensure that the two DBs can safely run as master-master in the event that each gets written to concurrently (split brain or just two mgmt servers failing over at slightly different times). It seems that this thread is already highlighting some of the confusion I and others have faced. Hopefully it will help someone else. Thanks again, Adrian On 6 Jun 2014 07:18, Shanker Balan shanker.ba...@shapeblue.com wrote: Hi Damodar, Comments inline. On 06-Jun-2014, at 10:53 am, Damoder Reddy damoder.re...@citrix.com wrote: Hi Adrian, For your question, . Is the CS side purely for failover or does it actually set up part of the replication for you? The answer is, the Cloud Stack does only failover configuration and the actual replication process on the mysql side has to be done by own. https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=348 38 207 For the second question, Can you easily enable an existing DB for HA or is this best done before there’s any data? The answer is, we can setup replication even with existing data and then start the management servers. The mysql documentation contains the clear steps how to setup replication with existing
Manual Failover MGMT and SQL servers
Hi guys, How is the procedure to manually failover from one MGMT server to another and also to do the same with the Database? Thank you Email asegurado por Check Point
RE: Examples of configuring DB HA?
I don’t fully understand what I'm doing here but here's something that puzzles me: [root@cs-mgmt ~]# jar tf /usr/share/cloudstack-management/webapps/client/WEB-INF/lib/cloud-plugin-database-mysqlha-4.3.0.jar META-INF/ META-INF/MANIFEST.MF com/ com/cloud/ com/cloud/utils/ com/cloud/utils/db/ com/cloud/utils/db/StaticStrategy.class META-INF/NOTICE META-INF/DEPENDENCIES META-INF/LICENSE META-INF/maven/ META-INF/maven/org.apache.cloudstack/ META-INF/maven/org.apache.cloudstack/cloud-plugin-database-mysqlha/ META-INF/maven/org.apache.cloudstack/cloud-plugin-database-mysqlha/pom.xml META-INF/maven/org.apache.cloudstack/cloud-plugin-database-mysqlha/pom.properties [root@cs-mgmt ~]# Surely there's the class and that path is where a lot of other cloudstack-related jar files live so I'm guessing that is also in the classpath. Anyone? -Original Message- From: Adrian Lewis [mailto:adr...@alsiconsulting.co.uk] Sent: 10 June 2014 00:05 To: 'users@cloudstack.apache.org' Subject: RE: Examples of configuring DB HA? Fresh 4.3 from the RPMs in the repo. Done yesterday. Had to yum install mysql on the management server as the client binaries weren't present but mysql-connector-java was installed as a dependency of the cloudstack rpm. Could something else be missing on the Centos side or does this look like a CS issue? -Original Message- From: Rafael Weingartner [mailto:rafaelweingart...@gmail.com] Sent: 10 June 2014 00:01 To: users@cloudstack.apache.org Subject: Re: Examples of configuring DB HA? the last question is the proper one.. ;) Probably because someone forgot it. I also hate when this kind of thing happens... How did you set up the CS version ? I mean fresh install 4.3 or upgrade from an older version? On Mon, Jun 9, 2014 at 7:49 PM, Adrian Lewis adr...@alsiconsulting.co.uk wrote: I guess my question should perhaps be, does anyone know why the jar that contains the class isn’t already in the classpath and what's the best way to fix it? -Original Message- From: Adrian Lewis [mailto:adr...@alsiconsulting.co.uk] Sent: 09 June 2014 23:37 To: users@cloudstack.apache.org Subject: RE: Examples of configuring DB HA? I'm going to sound stupid here but how do I find the jar that contains the classes and what is the classpath? Is this a bug of some sort? -Original Message- From: Rafael Weingartner [mailto:rafaelweingart...@gmail.com] Sent: 09 June 2014 23:28 To: users@cloudstack.apache.org Subject: Re: Examples of configuring DB HA? Well, tomcat is returning 404, because the app is not running. As a consequence of a class not found exception. Find the jar that contains the classes that are missing and add them into the classpath. On Mon, Jun 9, 2014 at 7:18 PM, Adrian Lewis adr...@alsiconsulting.co.uk wrote: I was very close to getting this up and running in the lab (Centos 6.5 – 2 x sql servers and 1 mgmt server – all running in VMware Workstation, installed from 4.3 repo) but when setting the db.ha.enabled to true and restarting the mgmt. server, I now get 404 from tomcat and the management server log has lines in it saying things like: 2014-06-09 22:48:00,632 ERROR [c.c.u.d.Merovingian2] (main:null) Unable to get a new db connection java.sql.SQLException: Invalid load balancing strategy 'com.cloud.utils.db.StaticStrategy'. […] Caused by: java.lang.ClassNotFoundException: com.cloud.utils.db.StaticStrategy Anyone got any idea? Tried Googling and searching the mailing list but nothing that I can see as an answer. I’m just a lowly network engineer so wouldn’t know what these errors mean but I’m guessing I won’t be the first. Any ideas? *From:* Adrian Lewis [mailto:adr...@alsiconsulting.co.uk] *Sent:* 06 June 2014 10:51 *To:* users@cloudstack.apache.org *Subject:* Re: Examples of configuring DB HA? Hi all, Firstly thanks for the great responses already. Secondly, regarding HA vs failover, I had been assuming these as much the same. Based on what I had read about the new changes in 4.3, I had assumed that the new feature allows you to configure standard MySQL (clustering not required - Galera or otherwise) in a multimaster replication setup and that while management servers only speak with a single server at a time, failover to a backup server is automatic and does not need any work on the MySQL side to promote a slave to a master as with a basic master/slave setup. I'm personally not interested in load balancing just yet, simply having a hot standby DB that takes over automatically. This is what I take the term HA to mean. From the wiki, I'm also taking it that the use of the auto increment and offset values ensure that the two DBs can safely run as master-master in the event that each gets written to concurrently (split brain or just two mgmt servers failing over at slightly different times). It seems that this thread is already
RE: Management Server Startup Issue
Rafael, Thank you for responding so quickly. Yes 4.3.0. I am using a dedicated DB servers and dedicated management servers. I will provide whatever log files you would find useful. It would be odd if it was a dependancy since CS really has no visibility to the sql server other than a connect string? Or so I thought; and the system is running fine with the binlog off. With the bin log on I can run queries from the command line and everything seems normal from the sql end, but the management server will not run. Toggle binlog off CS works fine. The replication slave has not even been started yet. Let me know what other info I can send over that would be of help. There is nothing in the catalina logs of interest and my logging level is currently set to trace for the management-server.log. I will turn on the sql query log and compare them between startups of the management nodes perhaps that will yeild something. I have included a dropbox link with the management server log from a normal startup of CS and one with mysql binlog enabled. Any help would be greatly appriciated. https://dl.dropboxusercontent.com/u/51895629/management-server.logs.tar.gz Steve Searles -Original Message- From: Rafael Weingartner [mailto:rafaelweingart...@gmail.com] Sent: Monday, June 9, 2014 6:57 PM To: users@cloudstack.apache.org Subject: Re: Management Server Startup Issue please give more logs. It is the 4.3.0 right? I bet there is a problem with a missing dependency. On Mon, Jun 9, 2014 at 7:32 PM, Steve Searles ssear...@zimcom.net wrote: Anyone have any idea why the management service would refuse to start if the DB server is configured as a master for replication? log_bin=mysql-bin server_id=1 Adding the above the my.cnf file of my DB server, restarting mysql then restarting cloudstack-managment will cause cloudstack to get hung on startup here. 2014-06-09 18:25:33,769 INFO [c.c.u.c.ComponentContext] (main:null) Starting com.cloud.bridge.persist.dao.SHostDaoImpl_EnhancerByCloudStack_9da5499 b 2014-06-09 18:25:33,769 INFO [c.c.u.c.ComponentContext] (main:null) Starting com.cloud.bridge.persist.dao.SObjectDaoImpl_EnhancerByCloudStack_847fb 98c 2014-06-09 18:25:33,769 INFO [c.c.u.c.ComponentContext] (main:null) Starting com.cloud.bridge.persist.dao.CloudStackUserDaoImpl_EnhancerByCloudStac k_7fce3ee6 2014-06-09 18:25:33,769 INFO [c.c.u.c.ComponentContext] (main:null) Starting com.cloud.bridge.service.core.ec2.EC2Engine_EnhancerByCloudStack_d70c9 e3c 2014-06-09 18:25:33,769 INFO [c.c.u.c.ComponentContext] (main:null) Starting com.cloud.bridge.service.controller.s3.ServiceProvider_EnhancerByCloud Stack_23d38b1 That is the last few lines of the management-server.log and it will hang there indefinitely. I noticed this on startup as well. 2014-06-09 18:25:16,841 INFO [c.c.u.d.T.Transaction] (main:null) Is Data Base High Availiability enabled? Ans : false 2014-06-09 18:25:17,164 DEBUG [c.c.u.d.ConnectionConcierge] (main:null) Registering a database connection for LockMaster1 2014-06-09 18:25:17,164 INFO [c.c.u.d.Merovingian2] (main:null) Cleaning up locks for 345049793560 2014-06-09 18:25:17,175 INFO [c.c.u.d.Merovingian2] (main:null) Released 0 locks for 345049793560 2014-06-09 18:25:17,206 INFO [o.a.c.s.l.CloudStackExtendedLifeCycle] (main:null) Running system integrity checker com.cloud.upgrade.DatabaseUpgradeChecker@63c8e4ae 2014-06-09 18:25:17,207 INFO [c.c.u.DatabaseUpgradeChecker] (main:null) Grabbing lock to check for database upgrade. 2014-06-09 18:25:17,254 DEBUG [c.c.u.d.VersionDaoImpl] (main:null) Checking to see if the database is at a version before it was the version table is created 2014-06-09 18:25:17,295 INFO [c.c.u.DatabaseUpgradeChecker] (main:null) DB version = 4.3.0 Code Version = 4.3.0 2014-06-09 18:25:17,296 INFO [c.c.u.DatabaseUpgradeChecker] (main:null) DB version and code version matches so no upgrade needed. The management server talking to the DB server at least enough to check the version; and mysql from the command line on the management server works fine as well. This line caught my attention. 2014-06-09 18:25:16,841 INFO [c.c.u.d.T.Transaction] (main:null) Is Data Base High Availiability enabled? Ans : false Is there something I need to set when using mysql replication specific to cloudstack? I do not see anything in the documentation on this other than setting up basic replication. if I comment out the above two lines in my.cnf and restart the management server it fires up just fine. I don’t get how enabling bin log would make a difference at all. Any help or explication for this strange issue would be appreciated. - Steve Searles -- Rafael Weingärtner
RE: Management Server Startup Issue
It is also worth noting that these are the last two DB queries that happen
before the stop. So it may have something to do with cloudbridge?
140609 22:28:00 8 Connect cl...@db01.cvg.cs.zimcom.net on cloudbridge
8 Query /* mysql-connector-java-5.1.17-SNAPSHOT (
Revision: ${bzr.revision-id} ) */SHOW VARIABLES WHERE Variable_name ='language'
OR Variable_name = 'net_write_timeout' OR Variable_name = 'interactive_timeout'
OR Variable_name = 'wait_timeout' OR Variable_name = 'character_set_client' OR
Variable_name = 'character_set_connection' OR Variable_name = 'character_set'
OR Variable_name = 'character_set_server' OR Variable_name = 'tx_isolation' OR
Variable_name = 'transaction_isolation' OR Variable_name =
'character_set_results' OR Variable_name = 'timezone' OR Variable_name =
'time_zone' OR Variable_name = 'system_time_zone' OR Variable_name =
'lower_case_table_names' OR Variable_name = 'max_allowed_packet' OR
Variable_name = 'net_buffer_length' OR Variable_name = 'sql_mode' OR
Variable_name = 'query_cache_type' OR Variable_name = 'query_cache_size' OR
Variable_name = 'init_connect'
8 Query /* mysql-connector-java-5.1.17-SNAPSHOT (
Revision: ${bzr.revision-id} ) */SELECT @@session.auto_increment_increment
8 Query SHOW COLLATION
8 Query SET NAMES latin1
8 Query SET character_set_results = NULL
8 Query SET autocommit=1
8 Query SET sql_mode='STRICT_TRANS_TABLES'
8 Query SET autocommit=0
8 Query SET autocommit=0
8 Query SELECT offering_bundle.ID,
offering_bundle.AmazonEC2Offering, offering_bundle.CloudStackOffering FROM
offering_bundle
8 Query commit
8 Query rollback
8 Query SET autocommit=1
8 Query SET autocommit=0
8 Query SET autocommit=0
8 Query SELECT mhost.ID, mhost.MHostKey, mhost.Host,
mhost.Version, mhost.LastHeartbeatTime FROM mhost WHERE mhost.MHostKey =
_binary'00:50:56:92:04:18' ORDER BY RAND() LIMIT 1
8 Query commit
8 Query rollback
8 Query SET autocommit=1
8 Query SET autocommit=0
8 Query SET autocommit=0
8 Query UPDATE mhost SET
mhost.Host=_binary'http://localhost:7080/awsapi' WHERE mhost.ID = 1
8 Query commit
8 Query rollback
8 Query SET autocommit=1
8 Query SET autocommit=0
8 Query SET autocommit=0
8 Query SELECT shost.ID, shost.Host, shost.HostType,
shost.MHostID, shost.ExportRoot, shost.UserOnHost, shost.UserPassword FROM
shost WHERE shost.MHostID = 1 AND shost.ExportRoot =
_binary'/Users/john1/S3-Mount' ORDER BY RAND() LIMIT 1
8 Query commit
8 Query rollback
8 Query SET autocommit=1
9 Connect cl...@db01.cvg.cs.zimcom.net on cloud
9 Query /* mysql-connector-java-5.1.17-SNAPSHOT (
Revision: ${bzr.revision-id} ) */SHOW VARIABLES WHERE Variable_name ='language'
OR Variable_name = 'net_write_timeout' OR Variable_name = 'interactive_timeout'
OR Variable_name = 'wait_timeout' OR Variable_name = 'character_set_client' OR
Variable_name = 'character_set_connection' OR Variable_name = 'character_set'
OR Variable_name = 'character_set_server' OR Variable_name = 'tx_isolation' OR
Variable_name = 'transaction_isolation' OR Variable_name =
'character_set_results' OR Variable_name = 'timezone' OR Variable_name =
'time_zone' OR Variable_name = 'system_time_zone' OR Variable_name =
'lower_case_table_names' OR Variable_name = 'max_allowed_packet' OR
Variable_name = 'net_buffer_length' OR Variable_name = 'sql_mode' OR
Variable_name = 'query_cache_type' OR Variable_name = 'query_cache_size' OR
Variable_name = 'init_connect'
9 Query /* mysql-connector-java-5.1.17-SNAPSHOT (
Revision: ${bzr.revision-id} ) */SELECT @@session.auto_increment_increment
9 Query SHOW COLLATION
9 Query SET NAMES latin1
9 Query SET character_set_results = NULL
9 Query SET autocommit=1
9 Query SET sql_mode='STRICT_TRANS_TABLES'
9 Query SET autocommit=0
9 Query SELECT @@session.tx_isolation
9 Query SET SESSION TRANSACTION ISOLATION LEVEL READ
COMMITTED
9 Query SELECT 1
9 Query SET autocommit=0
9 Query SELECT configuration.name,
Ovs option not listed in a new network offering when it is enabled
Hi, I have enabled Ovs network service provider in CloudStack version 4.3 but it is not getting listed as an option to select in static NAT provider, port forwarding, virtual networking or load balancing services while creating a new network offering. Noticed supported services are displayed as BLANK for Ovs. Not sure if this has any link with options listed in offering services. I followed steps given in http://docs.cloudstack.apache.org/en/latest/networking/ovs-plugin.html. Has anyone enabled Ovs and worked on it? If this is confirmed to be a UI bug, any DB hack to proceed working with Ovs? Thanks, Praveen Kumar
RE: deleting or cancelling broken ACS jobs
Change these global parameters to very small value say 1 min job.cancel.threshold.minutesTime (in minutes) for async-jobs to be forcely cancelled if it has been in process for long job.expire.minutes Time (in minutes) for async-jobs to be kept in system and then restart your management server wait for some time and asyn job will expire and then change back these value to original value and restart MS again. Hope this will help Thanks Shweta -Original Message- From: Andrei Mikhailovsky [mailto:and...@arhont.com] Sent: Monday, June 09, 2014 6:53 PM To: users@cloudstack.apache.org Subject: deleting or cancelling broken ACS jobs Hello guys, was wondering if anyone have come across an issue where acs would get stuck on several jobs and keeps trying to do them over and over again? I've come across an issue a few days ago. For some reason I have about 5 or 6 XenServer cluster jobs which have gone crazy. These jobs are of different nature, like template creation, vm start and enable host maintenance. They keep on repeating in the logs about 20-30 times a second, causing overfilling of logs. I get about 20GB of management server logs each day and it seems that these stuck jobs are causing the overflow. I am also not able to perform any activity on the XenServer cluster which has those stuck jobs. I am unable to start or stop jobs or pretty much do anything with it. I've tried restarting both the management server and the xenserver hosts, but that didn't help. After a short while following a restart the same thing starts to happen. Is there a way for ACS to cancel / remove these jobs? I've looked at the async_job and async_job_view db tables and I can see 28 entries there amongst which are these stuck jobs gone crazy. Is it safe for me to simply remove them from the database and restart the management server? Are there any other db tables that I should look at? Many thanks Andrei
Re: can I run CloudStack without IPtables?
Comments inline. On 10-Jun-2014, at 3:58 am, Yiping Zhang yzh...@marketo.com wrote: Ilya: Thanks for quick clarification.I¹ll check out defining my own network offerings. I use a shared network with a pfSense based firewall at home for all my VMs. The VMs spun on the shared network have a dedicated VLAN and a default gateway set to the pfSense firewall. Security Groups policies have no affect for Vms on a shared network. http://shankerbalan.net/blog/create-a-shared-network-with-public-ips-in-cloudstack/ should be helpful. Hth. @shankerbalan Yiping On 6/9/14, 1:21 PM, ilya musayev ilya.mailing.li...@gmail.com wrote: Yiping, Yes you can have non-iptables setup. Most of the enterprise installations don't rely on cloudstack's iptables, routing or vpc features and prefer to use existing physical firewalls and vlan isolation. If you have VLANs, but dont want to use iptables that comes thru virtual router, look into CloudStack Advanced Zone Setup with Shared Network Functionality. In this case, you only leverage dhcp, userdata and dns(optional). You can create your own network offerings and bind the network to non-vpc shared network offering. DHCP at this point in time is a required. Userdata and DNS can be optional. You can choose to use your own in-house DNS dont route DNS queries through CloudStack virtual router (you would need to create custom network offering, which is few clicks in UI). You can also bypass userdata and serve your own userdata through external userdata services, you would need to write something on your end to support it. Regards ilya On 6/9/14, 12:02 PM, Yiping Zhang wrote: Hi,all: I am trying different network setups in my CloudStack eval effort, and I am wondering if CS can be configured to not use iptables at all , giving that my intended goal is for a private cloud dedicated to my own company, in our own datacenter and all our networks are behind our own hardware based firewalls already? If I can stop iptables on all system VM¹s, hypervisors and management servers, then it would be much easier to trouble shoot my setups and accelerate the eval process. Thanks, Yiping -- @shankerbalan M: +91 98860 60539 | O: +91 (80) 67935867 shanker.ba...@shapeblue.com | www.shapeblue.com | Twitter:@shapeblue ShapeBlue Services India LLP, 22nd floor, Unit 2201A, World Trade Centre, Bangalore - 560 055 Find out more about ShapeBlue and our range of CloudStack related services IaaS Cloud Design Buildhttp://shapeblue.com/iaas-cloud-design-and-build// CSForge – rapid IaaS deployment frameworkhttp://shapeblue.com/csforge/ CloudStack Consultinghttp://shapeblue.com/cloudstack-consultancy/ CloudStack Infrastructure Supporthttp://shapeblue.com/cloudstack-infrastructure-support/ CloudStack Bootcamp Training Courseshttp://shapeblue.com/cloudstack-training/ This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
RE: Examples of configuring DB HA?
I think the issue here is the mysql connector jar is loaded using tomcat's common class loader and the jar cloud-plugin-database-mysqlha-4.3.0.jar is loaded by the webapp class loader and the reason being Mysql connector is loaded using common class loader it does not have visibility into webapp class loader. Ideally the jar cloud-plugin-database-mysqlha-4.3.0.jar should also be loaded from the common class loader instead of webapp class loader. Can you try to load the jar cloud-plugin-database-mysqlha-4.3.0.jar in common.loader. Thanks Regards Damodar/ -Original Message- From: Adrian Lewis [mailto:adr...@alsiconsulting.co.uk] Sent: Tuesday, June 10, 2014 5:59 AM To: users@cloudstack.apache.org Subject: RE: Examples of configuring DB HA? I don’t fully understand what I'm doing here but here's something that puzzles me: [root@cs-mgmt ~]# jar tf /usr/share/cloudstack-management/webapps/client/WEB-INF/lib/cloud-plugin-database-mysqlha-4.3.0.jar META-INF/ META-INF/MANIFEST.MF com/ com/cloud/ com/cloud/utils/ com/cloud/utils/db/ com/cloud/utils/db/StaticStrategy.class META-INF/NOTICE META-INF/DEPENDENCIES META-INF/LICENSE META-INF/maven/ META-INF/maven/org.apache.cloudstack/ META-INF/maven/org.apache.cloudstack/cloud-plugin-database-mysqlha/ META-INF/maven/org.apache.cloudstack/cloud-plugin-database-mysqlha/pom.xml META-INF/maven/org.apache.cloudstack/cloud-plugin-database-mysqlha/pom.properties [root@cs-mgmt ~]# Surely there's the class and that path is where a lot of other cloudstack-related jar files live so I'm guessing that is also in the classpath. Anyone? -Original Message- From: Adrian Lewis [mailto:adr...@alsiconsulting.co.uk] Sent: 10 June 2014 00:05 To: 'users@cloudstack.apache.org' Subject: RE: Examples of configuring DB HA? Fresh 4.3 from the RPMs in the repo. Done yesterday. Had to yum install mysql on the management server as the client binaries weren't present but mysql-connector-java was installed as a dependency of the cloudstack rpm. Could something else be missing on the Centos side or does this look like a CS issue? -Original Message- From: Rafael Weingartner [mailto:rafaelweingart...@gmail.com] Sent: 10 June 2014 00:01 To: users@cloudstack.apache.org Subject: Re: Examples of configuring DB HA? the last question is the proper one.. ;) Probably because someone forgot it. I also hate when this kind of thing happens... How did you set up the CS version ? I mean fresh install 4.3 or upgrade from an older version? On Mon, Jun 9, 2014 at 7:49 PM, Adrian Lewis adr...@alsiconsulting.co.uk wrote: I guess my question should perhaps be, does anyone know why the jar that contains the class isn’t already in the classpath and what's the best way to fix it? -Original Message- From: Adrian Lewis [mailto:adr...@alsiconsulting.co.uk] Sent: 09 June 2014 23:37 To: users@cloudstack.apache.org Subject: RE: Examples of configuring DB HA? I'm going to sound stupid here but how do I find the jar that contains the classes and what is the classpath? Is this a bug of some sort? -Original Message- From: Rafael Weingartner [mailto:rafaelweingart...@gmail.com] Sent: 09 June 2014 23:28 To: users@cloudstack.apache.org Subject: Re: Examples of configuring DB HA? Well, tomcat is returning 404, because the app is not running. As a consequence of a class not found exception. Find the jar that contains the classes that are missing and add them into the classpath. On Mon, Jun 9, 2014 at 7:18 PM, Adrian Lewis adr...@alsiconsulting.co.uk wrote: I was very close to getting this up and running in the lab (Centos 6.5 – 2 x sql servers and 1 mgmt server – all running in VMware Workstation, installed from 4.3 repo) but when setting the db.ha.enabled to true and restarting the mgmt. server, I now get 404 from tomcat and the management server log has lines in it saying things like: 2014-06-09 22:48:00,632 ERROR [c.c.u.d.Merovingian2] (main:null) Unable to get a new db connection java.sql.SQLException: Invalid load balancing strategy 'com.cloud.utils.db.StaticStrategy'. […] Caused by: java.lang.ClassNotFoundException: com.cloud.utils.db.StaticStrategy Anyone got any idea? Tried Googling and searching the mailing list but nothing that I can see as an answer. I’m just a lowly network engineer so wouldn’t know what these errors mean but I’m guessing I won’t be the first. Any ideas? *From:* Adrian Lewis [mailto:adr...@alsiconsulting.co.uk] *Sent:* 06 June 2014 10:51 *To:* users@cloudstack.apache.org *Subject:* Re: Examples of configuring DB HA? Hi all, Firstly thanks for the great responses already. Secondly, regarding HA vs failover, I had been assuming these as much the same. Based on what I had read about the new changes in 4.3, I had assumed that the new feature allows you to configure standard MySQL (clustering not
