Hello Community, My further steps are below: 1. I fixed the error related to Java and HA state display correct state (Available for both hosts) 2. I shutdown the host by unplugging power cable 3. The HA state show fencing state 4. No VMs migrated to the second available host (all VMs used offering with HA enabled)
Is there are any other options to test HA? Regards, Jafar Aghabalayev -----Original Message----- From: Jafar Aghabalayev <jafar.aghabala...@pasha-technology.com> Sent: Monday, February 13, 2023 9:13 PM To: users@cloudstack.apache.org; Wei ZHOU <ustcweiz...@gmail.com>; boris.stoya...@shapeblue.com Subject: RE: Cluster HA - KVM Hosts CAUTION: This email originated from outside the organization. Do not click links or open attachments unless you recognize the sender and know the content is safe. Please report all suspicious emails to s...@pasha-technology.com. Hello, I run the echo c > /proc/sysrq-trigger command and host went to restart (is the HA provider initialize OOBM restart or not ?), however after host up cloudstack agent not in running state Process: 4107 ExecStart=/usr/bin/java $JAVA_OPTS $JAVA_DEBUG -cp $CLASSPATH $JAVA_CLASS (code=exited, status=0/SUCCESS) The HA state stucking in Suspect state for a while and then host went to shutdown. Cloudstack show as Down state, resource state - Maintance and Power state Off. However instances not rebooted on healty host within the same cluster. Is any recommendation about that? Thank you for your time and efforts. Regards, Jafar Aghabalayev | Senior IT Infrastructure Engineer 157 Azadliq Avenue, AZ1106, Baku, Azerbaijan mob: +994 55 900 19 34 email: jafar.aghabala...@pasha-technology.com This communication contains information issued by "PASHA Technology" LLC. This e-mail message and all attachments transmitted with it are intended solely for the use of the addressee and may contain legally privileged and confidential information. If the reader of this message is not the intended recipient, or an employee or agent responsible for delivering this message to the intended recipient, the reader is hereby notified that any dissemination, distribution, copying, or other use of this message or its attachments is strictly prohibited. If you have received this message in error, please notify the sender immediately by replying to this message and please delete it from your computer. Within the bounds of law "PASHA Technology" LLC may monitor electronic transmissions through its internal and external networks to ensure compliance with internal policies and for legitimate business purposes. -----Original Message----- From: Boris Stoyanov <boris.stoya...@shapeblue.com> Sent: Saturday, February 11, 2023 2:37 PM To: users@cloudstack.apache.org; Wei ZHOU <ustcweiz...@gmail.com> Subject: Re: Cluster HA - KVM Hosts How did you power off the host? If you shut it down gracefully HA will not kick in, hence considered an intended action. The goal of this feature is to guard against unexpected events, like for example host has crashed. If you're looking to test it out you can try to provoke a kernel panic in the kvm host, something like: echo c > /proc/sysrq-trigger Then soon HA investigator will determin the host as unhealthy, (pings failing), soon after that there will be an activity checks on the VMs disks running on the host. It will check if there's any changes and disk activity, if that also fails it will determine the host for recovery. It will issue a restart with the IPMI tool, if number of restarts (depending on configuration) also fails it will fence the host and will start the VMs on another host in the same cluster. I hope this is insightful for you. Let me know how it goes at your end. Bobby. From: Jafar Aghabalayev <jafar.aghabala...@pasha-technology.com> Date: Saturday, 11 February 2023, 11:21 To: Wei ZHOU <ustcweiz...@gmail.com>, users@cloudstack.apache.org <users@cloudstack.apache.org> Subject: Re: Cluster HA - KVM Hosts Hello, I created new offering, with HA enabled and used it Sent from Outlook for Android<https://aka.ms/AAb9ysg> ________________________________ From: Wei ZHOU <ustcweiz...@gmail.com> Sent: Saturday, February 11, 2023 12:44:45 PM To: users@cloudstack.apache.org <users@cloudstack.apache.org> Cc: Jafar Aghabalayev <jafar.aghabala...@pasha-technology.com> Subject: Re: Cluster HA - KVM Hosts CAUTION: This email originated from outside the organization. Do not click links or open attachments unless you recognize the sender and know the content is safe. Please report all suspicious emails to s...@pasha-technology.com. Hi, Is HA enabled on the VM? You can check the vm details. HA is not enabled for built-in service offerings (Small/Medium). -Wei On Saturday, 11 February 2023, pspa...@hotmail.com<mailto:pspa...@hotmail.com> <pspa...@hotmail.com<mailto:pspa...@hotmail.com>> wrote: Hi Jafar, FYI. VM HA does not work when server is stopped gracefully * Issue #4211 * apache/cloudstack | | | | | | | | | | | VM HA does not work when server is stopped gracefully * Issue #4211 * apache/cloudstack When we stop a server (hypervisor) gracefully, vms on it will NOT be started on other servers even HA is enabled. ISSUE TYPE Bug Report COMPONENT NAME VM HA CLOUDSTACK VERSION 4.14/4.15 CONFIGURATI... | | | | Thanks Pradeep Sent from Yahoo Mail on Android On Sat, 11 Feb 2023 at 12:02 am, Jafar Aghabalayev<jafar.aghabala...@pasha-technology.com<mailto:jafar.aghabala...@pasha-technology.com>> wrote: Hello Community, I have configured cluster with 2 KVM Hosts. HA enabled for hosts, ha.tag attribute on global configuration is the same as for ha.tag attribute for hosts. VMs are running with HA enabled offering. NFS used as primary storage. I tried to shutdown one of the hosts, however HA not performed. State and power state indicated as down, but resource state show as up and VM located at the failed host show in running state (in real it is unaccessible). I tried to stop libvirtd service and the result same. Can anyone help me with this issue?