Hello Jafar, This is the way to test the HA. I did same before putting into the production.
When you unplugged the cable of physical hosts, what is the current state of host ? Is it showing “Disconnected”, “Alert” or “Down”, When I tested the HA it should have atleast one NFS as primary storage, it worked in my case with NFS as a primary storage or atleast one of the primary storage on NFS . So without any NFS storage, whenever I disconnected the host, it was either showing in “Disconnected” or “alert” and then HA will not work. Vivek Kumar Sr. Manager - Cloud & DevOps TechOps | Indiqus Technologies vivek.ku...@indiqus.com <mailto:vivek.ku...@indiqus.com> www.indiqus.com <https://www.indiqus.com/> > On 21-Feb-2023, at 5:29 PM, Jafar Aghabalayev > <jafar.aghabala...@pasha-technology.com> wrote: > > Hello Community, > My further steps are below: > > 1. I fixed the error related to Java and HA state display correct state > (Available for both hosts) > 2. I shutdown the host by unplugging power cable > 3. The HA state show fencing state > 4. No VMs migrated to the second available host (all VMs used offering with > HA enabled) > > Is there are any other options to test HA? > > > > > Regards, > Jafar Aghabalayev > > > -----Original Message----- > From: Jafar Aghabalayev <jafar.aghabala...@pasha-technology.com> > Sent: Monday, February 13, 2023 9:13 PM > To: users@cloudstack.apache.org; Wei ZHOU <ustcweiz...@gmail.com>; > boris.stoya...@shapeblue.com > Subject: RE: Cluster HA - KVM Hosts > > CAUTION: This email originated from outside the organization. Do not click > links or open attachments unless you recognize the sender and know the > content is safe. Please report all suspicious emails to > s...@pasha-technology.com. > > Hello, > I run the echo c > /proc/sysrq-trigger command and host went to restart (is > the HA provider initialize OOBM restart or not ?), however after host up > cloudstack agent not in running state > > Process: 4107 ExecStart=/usr/bin/java $JAVA_OPTS $JAVA_DEBUG -cp $CLASSPATH > $JAVA_CLASS (code=exited, status=0/SUCCESS) > > The HA state stucking in Suspect state for a while and then host went to > shutdown. Cloudstack show as Down state, resource state - Maintance and Power > state Off. However instances not rebooted on healty host within the same > cluster. Is any recommendation about that? > > Thank you for your time and efforts. > > > Regards, > > > > Jafar Aghabalayev | Senior IT Infrastructure Engineer > 157 Azadliq Avenue, AZ1106, Baku, Azerbaijan > mob: +994 55 900 19 34 > email: jafar.aghabala...@pasha-technology.com > > This communication contains information issued by "PASHA Technology" LLC. > This e-mail message and all attachments transmitted with it are intended > solely for the use of the addressee and may contain legally privileged and > confidential information. If the reader of this message is not the intended > recipient, or an employee or agent responsible for delivering this message to > the intended recipient, the reader is hereby notified that any dissemination, > distribution, copying, or other use of this message or its attachments is > strictly prohibited. If you have received this message in error, please > notify the sender immediately by replying to this message and please delete > it from your computer. Within the bounds of law "PASHA Technology" LLC may > monitor electronic transmissions through its internal and external networks > to ensure compliance with internal policies and for legitimate business > purposes. > > -----Original Message----- > From: Boris Stoyanov <boris.stoya...@shapeblue.com> > Sent: Saturday, February 11, 2023 2:37 PM > To: users@cloudstack.apache.org; Wei ZHOU <ustcweiz...@gmail.com> > Subject: Re: Cluster HA - KVM Hosts > > How did you power off the host? If you shut it down gracefully HA will not > kick in, hence considered an intended action. The goal of this feature is to > guard against unexpected events, like for example host has crashed. > > If you're looking to test it out you can try to provoke a kernel panic in the > kvm host, something like: echo c > /proc/sysrq-trigger > > Then soon HA investigator will determin the host as unhealthy, (pings > failing), soon after that there will be an activity checks on the VMs disks > running on the host. It will check if there's any changes and disk activity, > if that also fails it will determine the host for recovery. It will issue a > restart with the IPMI tool, if number of restarts (depending on > configuration) also fails it will fence the host and will start the VMs on > another host in the same cluster. > > I hope this is insightful for you. Let me know how it goes at your end. > > Bobby. > > From: Jafar Aghabalayev <jafar.aghabala...@pasha-technology.com> > Date: Saturday, 11 February 2023, 11:21 > To: Wei ZHOU <ustcweiz...@gmail.com>, users@cloudstack.apache.org > <users@cloudstack.apache.org> > Subject: Re: Cluster HA - KVM Hosts > Hello, > I created new offering, with HA enabled and used it > > Sent from Outlook for Android<https://aka.ms/AAb9ysg> > ________________________________ > From: Wei ZHOU <ustcweiz...@gmail.com> > Sent: Saturday, February 11, 2023 12:44:45 PM > To: users@cloudstack.apache.org <users@cloudstack.apache.org> > Cc: Jafar Aghabalayev <jafar.aghabala...@pasha-technology.com> > Subject: Re: Cluster HA - KVM Hosts > > > CAUTION: This email originated from outside the organization. Do not click > links or open attachments unless you recognize the sender and know the > content is safe. Please report all suspicious emails to > s...@pasha-technology.com. > > Hi, > > Is HA enabled on the VM? > > You can check the vm details. HA is not enabled for built-in service > offerings (Small/Medium). > > -Wei > > > > > > On Saturday, 11 February 2023, > pspa...@hotmail.com<mailto:pspa...@hotmail.com> > <pspa...@hotmail.com<mailto:pspa...@hotmail.com>> wrote: > Hi Jafar, > FYI. > VM HA does not work when server is stopped gracefully * Issue #4211 * > apache/cloudstack > | > | > | > | | | > > | > > | > | > | | > VM HA does not work when server is stopped gracefully * Issue #4211 * > apache/cloudstack > > When we stop a server (hypervisor) gracefully, vms on it will NOT be started > on other servers even HA is enabled. ISSUE TYPE Bug Report COMPONENT NAME VM > HA CLOUDSTACK VERSION 4.14/4.15 CONFIGURATI... > | | > > | > > | > > > > Thanks Pradeep > > Sent from Yahoo Mail on Android > > On Sat, 11 Feb 2023 at 12:02 am, Jafar > Aghabalayev<jafar.aghabala...@pasha-technology.com<mailto:jafar.aghabala...@pasha-technology.com>> > wrote: Hello Community, > > I have configured cluster with 2 KVM Hosts. > HA enabled for hosts, ha.tag attribute on global configuration is the same as > for ha.tag attribute for hosts. VMs are running with HA enabled offering. NFS > used as primary storage. > I tried to shutdown one of the hosts, however HA not performed. State and > power state indicated as down, but resource state show as up and VM located > at the failed host show in running state (in real it is unaccessible). I > tried to stop libvirtd service and the result same. > > Can anyone help me with this issue? > > -- This message is intended only for the use of the individual or entity to which it is addressed and may contain confidential and/or privileged information. If you are not the intended recipient, please delete the original message and any copy of it from your computer system. You are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited unless proper authorization has been obtained for such action. If you have received this communication in error, please notify the sender immediately. Although IndiQus attempts to sweep e-mail and attachments for viruses, it does not guarantee that both are virus-free and accepts no liability for any damage sustained as a result of viruses.
