KVM OpenVSwitch LACP questions
Hello. We are currently building up a new CloudStack KVM cluster with OpenVSwitch as the network backing and we are faced with some conflicting information we would be grateful to have a second opinion on. In Red Hat documentation[1], a following quote is said: > Do not use LACP with OVS-based bonds, as this configuration is problematic > and unsupported. Instead, consider using bond_mode=balance-slb as a > replacement for this functionality. > [...] > For the technical details behind this requirement, see BZ#1267291. The linked bug report is made for RHEL 7.0 base and was closed in 2017. From what we see, the issue does no longer seem actual. We put this to the test ourselves in our lab, configured OVSBond interfaces with LACP and didn't see any issues at first glance. Our lab environment used OVS Bonds with lacp=active and bond_mode=balance-slb. Our experience shows that if we configure a bond without LACP, there is high risk for L2 loops and we do not wish to risk that. We do not see how suggesting balance-slb is a solution for lack of LACP. Is anyone else using LACP+balance-slb with OVS Bonds? Does anyone have actual scenarios where this has been an actual problem? Are we going to run into any predictable failure here by going this route? In an another Red Hat documentation page[2], following remarks are made about balance-slb OVS Bond mode: > Performance is affected by extra parsing per packet. Is there any known metric for how big the performance overhead is? How much of a resource are we sacrificing by using balance-slb? > There is a potential for vhost-user lock contention. "vhost-user lock contention" - it is not entirely clear what the risk here is. We found vague references in qemu documentation only, but that didn't tell us anything much. What would the real-world impact be here? [1] [ https://docs.redhat.com/en/documentation/red_hat_openstack_platform/8/html/director_installation_and_usage/appe-bonding_options#appe-Bonding_Options | https://docs.redhat.com/en/documentation/red_hat_openstack_platform/8/html/director_installation_and_usage/appe-bonding_options#appe-Bonding_Options ] [2] [ https://docs.redhat.com/en/documentation/red_hat_openstack_platform/10/html/advanced_overcloud_customization/appe-bonding_options | https://docs.redhat.com/en/documentation/red_hat_openstack_platform/10/html/advanced_overcloud_customization/appe-bonding_options ] Lugupidamisega / Best regards, Joann Mõndresku Süsteemiadministraator | Systems Administrator | jo...@wavecom.ee WaveCom AS | ISO 9001, 27001 & 27017 Certified DC and Cloud services Endla 16, Tallinn 10142 | www.wavecom.ee | www.facebook.com/wavecom.ee
Re: [D] KVM host in Alert State with Alert message Can not find network [cloudstack]
GitHub user amitmvyas added a comment to the discussion: KVM host in Alert State with Alert message Can not find network While configuring the zone I am following below steps. 1. Zone Type - Core 2. Core Zone Type - Advance (Security groups is - Off) 3. Zone Details - any name, IPv4 DNS: 8.8.8.8, Internal DNS, 192.168.1.53, Hypervisor: KVM 4. Network - a. Network Name - Physical Network 1 b. Isolation method - VLAN c. Traffic Types - Guest (guest_br0), Management (management_br0), Public (internet_br0), Storage (storage_br0) Rest of the steps are standard, once I click on launh zone, I am getting the message "Incorrect Network setup on agent, Reinitialize agent after network names are setup, details : Can not find network: guest_br0" GitHub link: https://github.com/apache/cloudstack/discussions/9712#discussioncomment-10709026 This is an automatically sent email for users@cloudstack.apache.org. To unsubscribe, please send an email to: users-unsubscr...@cloudstack.apache.org
Re: Secure Boot on Ubuntu 20.4 KVM Hypervisor for Win11
Hi, You can refer to the blog which provides an example of correct configuration (in section "Step 5: Verification") . -Wei On Thu, Sep 19, 2024 at 9:56 PM Ricardo Pertuz wrote: > Thanks Wei, > > The command shows me the whole xml dump, any particular section I should > check? Regarding secure I only see > > loader readonly='yes' secure='yes' > type='pflash'>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd > > > Atte, > > Ricardo Pertuz > > > On 19 Sep 2024 at 8:01 AM -0500, users@cloudstack.apache.org, wrote: > > > > --security-info >
Re: Secure Boot on Ubuntu 20.4 KVM Hypervisor for Win11
Thanks Wei, The command shows me the whole xml dump, any particular section I should check? Regarding secure I only see loader readonly='yes' secure='yes' type='pflash'>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd Atte, Ricardo Pertuz On 19 Sep 2024 at 8:01 AM -0500, users@cloudstack.apache.org, wrote: > > --security-info
Re: Secure Boot on Ubuntu 20.4 KVM Hypervisor for Win11
Hi, Can you check if the output of the command "virsh dumpxml --security-info vm-name" is correct ? -Wei On Thu, Sep 19, 2024 at 1:26 PM Ricardo Pertuz wrote: > Hey community, > > I have Ubuntu 20.04 as KVM Hypervisor on my 4.19 ACS platform but when > booting a virtual machine with a Windows 11 ISO I’m getting "Guest has not > initialized the display (yet)" > > I followed the guide: > > > https://blog.cloudabc.eu/cloudstack/2024/02/18/CloudStack-Create-Windows-11-on-Ubuntu/ > > but I’m guessing it’s related that is not compatible with Ubuntu 20.04 > > > Atte, > > Ricardo Pertuz > > >
Re: [D] KVM host in Alert State with Alert message Can not find network [cloudstack]
GitHub user alexandremattioli added a comment to the discussion: KVM host in Alert State with Alert message Can not find network @amitmvyas can you paste your netplan config here please? GitHub link: https://github.com/apache/cloudstack/discussions/9712#discussioncomment-10692875 This is an automatically sent email for users@cloudstack.apache.org. To unsubscribe, please send an email to: users-unsubscr...@cloudstack.apache.org
Re: [D] KVM host in Alert State with Alert message Can not find network [cloudstack]
GitHub user amitmvyas added a comment to the discussion: KVM host in Alert State with Alert message Can not find network Below is the netplan config details network: version: 2 renderer: networkd ethernets: enp33s0f0: dhcp4: false enp33s0f1: dhcp4: false enp193s0f0np0: dhcp4: false mtu: 9124 enp193s0f1np1: dhcp4: false enp65s0f0np0: dhcp4: false mtu: 9124 enp65s0f1np1: dhcp4: false mtu: 9124 bonds: server_bond0: interfaces: [enp193s0f0np0, enp65s0f0np0] mtu: 9124 parameters: mode: 802.3ad transmit-hash-policy: layer3+4 lacp-rate: fast mii-monitor-interval: 100 storage_bond0: interfaces: [enp193s0f1np1, enp65s0f1np1] mtu: 9124 parameters: mode: 802.3ad transmit-hash-policy: layer3+4 lacp-rate: fast mii-monitor-interval: 100 vlans: internet4090: id: 4090 link: server_bond0 storage18: id: 18 link: storage_bond0 bridges: management_br0: interfaces: [enp33s0f0] dhcp4: true cloud_br0: interfaces: [internet4090] addresses: [xxx.xxx.xxx.xxx/23] storage_br0: interfaces: [storage18] addresses: [xxx.xxx.xxx.xxx/24] GitHub link: https://github.com/apache/cloudstack/discussions/9712#discussioncomment-10693091 This is an automatically sent email for users@cloudstack.apache.org. To unsubscribe, please send an email to: users-unsubscr...@cloudstack.apache.org
Re: [D] KVM host in Alert State with Alert message Can not find network [cloudstack]
GitHub user amitmvyas added a comment to the discussion: KVM host in Alert State with Alert message Can not find network Please read cloud_br0 as internet_br0. GitHub link: https://github.com/apache/cloudstack/discussions/9712#discussioncomment-10693107 This is an automatically sent email for users@cloudstack.apache.org. To unsubscribe, please send an email to: users-unsubscr...@cloudstack.apache.org
Re: [D] KVM host in Alert State with Alert message Can not find network [cloudstack]
GitHub user amitmvyas added a comment to the discussion: KVM host in Alert State with Alert message Can not find network Hi, Yes, its storage_br0 and not internet_br0. I would like to know, do I have create new brdige for guest or I can use any existing one ? GitHub link: https://github.com/apache/cloudstack/discussions/9712#discussioncomment-10693085 This is an automatically sent email for users@cloudstack.apache.org. To unsubscribe, please send an email to: users-unsubscr...@cloudstack.apache.org
Re: [D] KVM host in Alert State with Alert message Can not find network [cloudstack]
GitHub user alexandremattioli added a comment to the discussion: KVM host in Alert State with Alert message Can not find network >Guest -> keeping it blank_ This can't be kept blank, otherwise ACS won't know in which bridge to place your guest network VLANs >Management -> management_br0 >Public -> internet_br0 Those should be fine >Storage -> internet_br0 Did you mean "storage_br0" ? GitHub link: https://github.com/apache/cloudstack/discussions/9712#discussioncomment-10692906 This is an automatically sent email for users@cloudstack.apache.org. To unsubscribe, please send an email to: users-unsubscr...@cloudstack.apache.org
Re: [D] KVM host in Alert State with Alert message Can not find network [cloudstack]
GitHub user boring-cyborg[bot] added a comment to the discussion: KVM host in Alert State with Alert message Can not find network Thanks for opening your first issue here! Be sure to follow the issue template! GitHub link: https://github.com/apache/cloudstack/discussions/9712#discussioncomment-10692862 This is an automatically sent email for users@cloudstack.apache.org. To unsubscribe, please send an email to: users-unsubscr...@cloudstack.apache.org
Secure Boot on Ubuntu 20.4 KVM Hypervisor for Win11
Hey community, I have Ubuntu 20.04 as KVM Hypervisor on my 4.19 ACS platform but when booting a virtual machine with a Windows 11 ISO I’m getting "Guest has not initialized the display (yet)" I followed the guide: https://blog.cloudabc.eu/cloudstack/2024/02/18/CloudStack-Create-Windows-11-on-Ubuntu/ but I’m guessing it’s related that is not compatible with Ubuntu 20.04 Atte, Ricardo Pertuz
Re: AW: VM is not migrated to another KVM host when the first goes down
Hi Ahmed, I agree with Swen. HA is a very big, complex topic. But first off: # What storage are you using? NFS? Linstor? # When u set up HA, is it Host HA or VM HA? My understanding is you cant have Host HA and VM HA at the same time. The most common configuration should be just VM HA. In your tests, make sure you simulate node failure by doing a force Power Off (or physically pull the cables to the server, thats what we did). Doing a reboot will not trigger HA. If using NFS, you might consider Out Of Band to be able to use shoot it in the head. Tho, im not so familiar with VM HA with NFS. Someone else might be better to advise this. But if using Linstor, you dont have to use OOB. But there are other configs to tune which u can find on their website. We use Linstor, and HA works well. Regards, Bryan On 13 Sep 2024 at 5:36 PM +0800, m...@swen.io, wrote: > I find HA is a really complex topic in CS. What state is your host in after > you did the shutdown? Are you able to set the host "Decraded" via UI? > > Regards, > Swen > > -Ursprüngliche Nachricht- > Von: Ahmed Awlaqi > Gesendet: Donnerstag, 12. September 2024 16:07 > An: users@cloudstack.apache.org > Betreff: VM is not migrated to another KVM host when the first goes down > > So I have a problem with Cloudstack 4.19.1.1 I have enabled HA in the compute > offering and configured out-of-band management in the KVM hosts. > The thing is when I shutdown a KVM host that has running machines it does not > migrate it to the running host > >
AW: VM is not migrated to another KVM host when the first goes down
I find HA is a really complex topic in CS. What state is your host in after you did the shutdown? Are you able to set the host "Decraded" via UI? Regards, Swen -Ursprüngliche Nachricht- Von: Ahmed Awlaqi Gesendet: Donnerstag, 12. September 2024 16:07 An: users@cloudstack.apache.org Betreff: VM is not migrated to another KVM host when the first goes down So I have a problem with Cloudstack 4.19.1.1 I have enabled HA in the compute offering and configured out-of-band management in the KVM hosts. The thing is when I shutdown a KVM host that has running machines it does not migrate it to the running host
VM is not migrated to another KVM host when the first goes down
So I have a problem with Cloudstack 4.19.1.1 I have enabled HA in the compute offering and configured out-of-band management in the KVM hosts. The thing is when I shutdown a KVM host that has running machines it does not migrate it to the running host
Re: KVM | Alma Linux 9.4
Hey Nux, thanks a bunch! You totally saved the day. Perhaps it would be beneficial to include these points in the documentation. Jon On Mon, Sep 2, 2024 at 3:10 AM Nux wrote: > Add the following to /etc/libvirt/libvirt.conf : > remote_mode="legacy" > > Then restart services. > > On 2024-09-01 16:40, Joan g wrote: > > Hi > > > > Yes done but masking them did not help. Still connection refused for > > sudo/root > > > > Jon > > > > On Sun, Sep 1, 2024 at 8:39 PM Fariborz Navidan > > wrote: > > > >> Hi. > >> > >> > >> Run the following command to mask the necessary services and let me > >> know > >> the outcome. > >> > >> > >> systemctl mask virtqemud.socket virtqemud-ro.socket > >> > > virtqemud-admin.socket virtqemud virtnetworkd virtstoraged > >> > >> Regards. > >> > >> On Sun, 1 Sept 2024, 16:42 Joan g, wrote: > >> > >> > Hi Fariborz, > >> > > >> > Thank you, I was able to manage bridge configurations. > >> > > >> > Now I am not able to add the host to pool. Agent logs print below: > >> > > >> > 2024-09-01 14:03:17,273 ERROR [cloud.agent.AgentShell] (main:null) > >> (logid:) > >> > Unable to start agent: > >> > com.cloud.utils.exception.CloudRuntimeException: Failed to connect > socket > >> > to '/var/run/libvirt/virtqemud-sock': Connection refused > >> > at > >> > > >> > > >> > com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.configure(LibvirtComputingResource.java:1153) > >> > at com.cloud.agent.Agent.(Agent.java:193) > >> > at > com.cloud.agent.AgentShell.launchNewAgent(AgentShell.java:452) > >> > at > >> > > com.cloud.agent.AgentShell.launchAgentFromClassInfo(AgentShell.java:431) > >> > at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:415) > >> > at com.cloud.agent.AgentShell.start(AgentShell.java:511) > >> > at com.cloud.agent.AgentShell.main(AgentShell.java:541) > >> > > >> > Did I miss some configs? > >> > > >> > I noticed that I can't run `virsh` as the root user or with `sudo`: > >> > > >> > # virsh list --all > >> > error: failed to connect to the hypervisor > >> > error: Failed to connect socket to '/var/run/libvirt/virtqemud-sock': > >> > Connection refused > >> > > >> > But as a user in wheel group its successful > >> > $ virsh list --all > >> > Id Name State > >> > > >> > > >> > > >> > *Jon* > >> > > >> > > >> > On Tue, Aug 27, 2024 at 11:16 PM Fariborz Navidan < > mdvlinqu...@gmail.com > >> > > >> > wrote: > >> > > >> > > Hello, > >> > > > >> > > I was able to configure Cloudstack 4.18 on AlmaLinux 9 last month.I > >> used > >> > > the following nmcli commands to create the bridge: > >> > > > >> > > nmcli con add ifname cloudbr0 type bridge con-name cloudbr0 > autoconnect > >> > yes > >> > > nmcli con add type bridge-slave ifname eth0 master cloudbr0 > >> > > nmcli con up cloudbr0 > >> > > > >> > > After creating the bridge, remove any assigned IP from the slave > >> > interface > >> > > (e.g eth0) and assign it to the bridge. > >> > > > >> > > Regards. > >> > > > >> > > On Tue, Aug 27, 2024 at 3:59 PM Joan g wrote: > >> > > > >> > > > Hello Community, > >> > > > > >> > > > Could someone provide guidance on setting up a bridge for the > latest > >> > > > AlmaLinux 9.4? When I use `nmcli` to create a bridge, the ethernet > >> > > > interfaces keep going down, and I'm unable to bring them online. > Any > >> > > > suggestions on working `nmcli` commands would be greatly > appreciated > >> > and > >> > > > helpful. > >> > > > > >> > > > Regards, > >> > > > Jon > >> > > > > >> > > > >> > > >> >
Re: KVM | Alma Linux 9.4
Add the following to /etc/libvirt/libvirt.conf : remote_mode="legacy" Then restart services. On 2024-09-01 16:40, Joan g wrote: Hi Yes done but masking them did not help. Still connection refused for sudo/root Jon On Sun, Sep 1, 2024 at 8:39 PM Fariborz Navidan wrote: Hi. Run the following command to mask the necessary services and let me know the outcome. systemctl mask virtqemud.socket virtqemud-ro.socket > > virtqemud-admin.socket virtqemud virtnetworkd virtstoraged Regards. On Sun, 1 Sept 2024, 16:42 Joan g, wrote: > Hi Fariborz, > > Thank you, I was able to manage bridge configurations. > > Now I am not able to add the host to pool. Agent logs print below: > > 2024-09-01 14:03:17,273 ERROR [cloud.agent.AgentShell] (main:null) (logid:) > Unable to start agent: > com.cloud.utils.exception.CloudRuntimeException: Failed to connect socket > to '/var/run/libvirt/virtqemud-sock': Connection refused > at > > com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.configure(LibvirtComputingResource.java:1153) > at com.cloud.agent.Agent.(Agent.java:193) > at com.cloud.agent.AgentShell.launchNewAgent(AgentShell.java:452) > at > com.cloud.agent.AgentShell.launchAgentFromClassInfo(AgentShell.java:431) > at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:415) > at com.cloud.agent.AgentShell.start(AgentShell.java:511) > at com.cloud.agent.AgentShell.main(AgentShell.java:541) > > Did I miss some configs? > > I noticed that I can't run `virsh` as the root user or with `sudo`: > > # virsh list --all > error: failed to connect to the hypervisor > error: Failed to connect socket to '/var/run/libvirt/virtqemud-sock': > Connection refused > > But as a user in wheel group its successful > $ virsh list --all > Id Name State > > > > *Jon* > > > On Tue, Aug 27, 2024 at 11:16 PM Fariborz Navidan > wrote: > > > Hello, > > > > I was able to configure Cloudstack 4.18 on AlmaLinux 9 last month.I used > > the following nmcli commands to create the bridge: > > > > nmcli con add ifname cloudbr0 type bridge con-name cloudbr0 autoconnect > yes > > nmcli con add type bridge-slave ifname eth0 master cloudbr0 > > nmcli con up cloudbr0 > > > > After creating the bridge, remove any assigned IP from the slave > interface > > (e.g eth0) and assign it to the bridge. > > > > Regards. > > > > On Tue, Aug 27, 2024 at 3:59 PM Joan g wrote: > > > > > Hello Community, > > > > > > Could someone provide guidance on setting up a bridge for the latest > > > AlmaLinux 9.4? When I use `nmcli` to create a bridge, the ethernet > > > interfaces keep going down, and I'm unable to bring them online. Any > > > suggestions on working `nmcli` commands would be greatly appreciated > and > > > helpful. > > > > > > Regards, > > > Jon > > > > > >
Re: KVM | Alma Linux 9.4
Do you see any alert in the UI -> Infrastructure -> Alerts that is relevant to that host stating the error? Regards. On Sun, 1 Sept 2024, 20:41 Joan g, wrote: > Its active and running. I can deploy VM's/use 'virsh' CLI etc as a non root > user and without sudo. > > Jon > > On Sun, Sep 1, 2024 at 9:57 PM Fariborz Navidan > wrote: > > > What is the status of libvirtd service? What does "systemctl status > > libvirtd" show? > > > > Regards. > > > > On Sun, 1 Sept 2024, 19:11 Joan g, wrote: > > > > > Hi > > > > > > Yes done but masking them did not help. Still connection refused for > > > sudo/root > > > > > > Jon > > > > > > On Sun, Sep 1, 2024 at 8:39 PM Fariborz Navidan > > > > wrote: > > > > > > > Hi. > > > > > > > > > > > > Run the following command to mask the necessary services and let me > > know > > > > the outcome. > > > > > > > > > > > > systemctl mask virtqemud.socket virtqemud-ro.socket > > > > > > virtqemud-admin.socket virtqemud virtnetworkd virtstoraged > > > > > > > > Regards. > > > > > > > > On Sun, 1 Sept 2024, 16:42 Joan g, wrote: > > > > > > > > > Hi Fariborz, > > > > > > > > > > Thank you, I was able to manage bridge configurations. > > > > > > > > > > Now I am not able to add the host to pool. Agent logs print below: > > > > > > > > > > 2024-09-01 14:03:17,273 ERROR [cloud.agent.AgentShell] (main:null) > > > > (logid:) > > > > > Unable to start agent: > > > > > com.cloud.utils.exception.CloudRuntimeException: Failed to connect > > > socket > > > > > to '/var/run/libvirt/virtqemud-sock': Connection refused > > > > > at > > > > > > > > > > > > > > > > > > > > com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.configure(LibvirtComputingResource.java:1153) > > > > > at com.cloud.agent.Agent.(Agent.java:193) > > > > > at > > > com.cloud.agent.AgentShell.launchNewAgent(AgentShell.java:452) > > > > > at > > > > > > > > > com.cloud.agent.AgentShell.launchAgentFromClassInfo(AgentShell.java:431) > > > > > at > > com.cloud.agent.AgentShell.launchAgent(AgentShell.java:415) > > > > > at com.cloud.agent.AgentShell.start(AgentShell.java:511) > > > > > at com.cloud.agent.AgentShell.main(AgentShell.java:541) > > > > > > > > > > Did I miss some configs? > > > > > > > > > > I noticed that I can't run `virsh` as the root user or with `sudo`: > > > > > > > > > > # virsh list --all > > > > > error: failed to connect to the hypervisor > > > > > error: Failed to connect socket to > '/var/run/libvirt/virtqemud-sock': > > > > > Connection refused > > > > > > > > > > But as a user in wheel group its successful > > > > > $ virsh list --all > > > > > Id Name State > > > > > > > > > > > > > > > > > > > > *Jon* > > > > > > > > > > > > > > > On Tue, Aug 27, 2024 at 11:16 PM Fariborz Navidan < > > > mdvlinqu...@gmail.com > > > > > > > > > > wrote: > > > > > > > > > > > Hello, > > > > > > > > > > > > I was able to configure Cloudstack 4.18 on AlmaLinux 9 last > month.I > > > > used > > > > > > the following nmcli commands to create the bridge: > > > > > > > > > > > > nmcli con add ifname cloudbr0 type bridge con-name cloudbr0 > > > autoconnect > > > > > yes > > > > > > nmcli con add type bridge-slave ifname eth0 master cloudbr0 > > > > > > nmcli con up cloudbr0 > > > > > > > > > > > > After creating the bridge, remove any assigned IP from the slave > > > > > interface > > > > > > (e.g eth0) and assign it to the bridge. > > > > > > > > > > > > Regards. > > > > > > > > > > > > On Tue, Aug 27, 2024 at 3:59 PM Joan g > wrote: > > > > > > > > > > > > > Hello Community, > > > > > > > > > > > > > > Could someone provide guidance on setting up a bridge for the > > > latest > > > > > > > AlmaLinux 9.4? When I use `nmcli` to create a bridge, the > > ethernet > > > > > > > interfaces keep going down, and I'm unable to bring them > online. > > > Any > > > > > > > suggestions on working `nmcli` commands would be greatly > > > appreciated > > > > > and > > > > > > > helpful. > > > > > > > > > > > > > > Regards, > > > > > > > Jon > > > > > > > > > > > > > > > > > > > > > > > > > > > >
Re: KVM | Alma Linux 9.4
Its active and running. I can deploy VM's/use 'virsh' CLI etc as a non root user and without sudo. Jon On Sun, Sep 1, 2024 at 9:57 PM Fariborz Navidan wrote: > What is the status of libvirtd service? What does "systemctl status > libvirtd" show? > > Regards. > > On Sun, 1 Sept 2024, 19:11 Joan g, wrote: > > > Hi > > > > Yes done but masking them did not help. Still connection refused for > > sudo/root > > > > Jon > > > > On Sun, Sep 1, 2024 at 8:39 PM Fariborz Navidan > > wrote: > > > > > Hi. > > > > > > > > > Run the following command to mask the necessary services and let me > know > > > the outcome. > > > > > > > > > systemctl mask virtqemud.socket virtqemud-ro.socket > > > > > virtqemud-admin.socket virtqemud virtnetworkd virtstoraged > > > > > > Regards. > > > > > > On Sun, 1 Sept 2024, 16:42 Joan g, wrote: > > > > > > > Hi Fariborz, > > > > > > > > Thank you, I was able to manage bridge configurations. > > > > > > > > Now I am not able to add the host to pool. Agent logs print below: > > > > > > > > 2024-09-01 14:03:17,273 ERROR [cloud.agent.AgentShell] (main:null) > > > (logid:) > > > > Unable to start agent: > > > > com.cloud.utils.exception.CloudRuntimeException: Failed to connect > > socket > > > > to '/var/run/libvirt/virtqemud-sock': Connection refused > > > > at > > > > > > > > > > > > > > com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.configure(LibvirtComputingResource.java:1153) > > > > at com.cloud.agent.Agent.(Agent.java:193) > > > > at > > com.cloud.agent.AgentShell.launchNewAgent(AgentShell.java:452) > > > > at > > > > > > com.cloud.agent.AgentShell.launchAgentFromClassInfo(AgentShell.java:431) > > > > at > com.cloud.agent.AgentShell.launchAgent(AgentShell.java:415) > > > > at com.cloud.agent.AgentShell.start(AgentShell.java:511) > > > > at com.cloud.agent.AgentShell.main(AgentShell.java:541) > > > > > > > > Did I miss some configs? > > > > > > > > I noticed that I can't run `virsh` as the root user or with `sudo`: > > > > > > > > # virsh list --all > > > > error: failed to connect to the hypervisor > > > > error: Failed to connect socket to '/var/run/libvirt/virtqemud-sock': > > > > Connection refused > > > > > > > > But as a user in wheel group its successful > > > > $ virsh list --all > > > > Id Name State > > > > > > > > > > > > > > > > *Jon* > > > > > > > > > > > > On Tue, Aug 27, 2024 at 11:16 PM Fariborz Navidan < > > mdvlinqu...@gmail.com > > > > > > > > wrote: > > > > > > > > > Hello, > > > > > > > > > > I was able to configure Cloudstack 4.18 on AlmaLinux 9 last month.I > > > used > > > > > the following nmcli commands to create the bridge: > > > > > > > > > > nmcli con add ifname cloudbr0 type bridge con-name cloudbr0 > > autoconnect > > > > yes > > > > > nmcli con add type bridge-slave ifname eth0 master cloudbr0 > > > > > nmcli con up cloudbr0 > > > > > > > > > > After creating the bridge, remove any assigned IP from the slave > > > > interface > > > > > (e.g eth0) and assign it to the bridge. > > > > > > > > > > Regards. > > > > > > > > > > On Tue, Aug 27, 2024 at 3:59 PM Joan g wrote: > > > > > > > > > > > Hello Community, > > > > > > > > > > > > Could someone provide guidance on setting up a bridge for the > > latest > > > > > > AlmaLinux 9.4? When I use `nmcli` to create a bridge, the > ethernet > > > > > > interfaces keep going down, and I'm unable to bring them online. > > Any > > > > > > suggestions on working `nmcli` commands would be greatly > > appreciated > > > > and > > > > > > helpful. > > > > > > > > > > > > Regards, > > > > > > Jon > > > > > > > > > > > > > > > > > > > > >
Re: KVM | Alma Linux 9.4
What is the status of libvirtd service? What does "systemctl status libvirtd" show? Regards. On Sun, 1 Sept 2024, 19:11 Joan g, wrote: > Hi > > Yes done but masking them did not help. Still connection refused for > sudo/root > > Jon > > On Sun, Sep 1, 2024 at 8:39 PM Fariborz Navidan > wrote: > > > Hi. > > > > > > Run the following command to mask the necessary services and let me know > > the outcome. > > > > > > systemctl mask virtqemud.socket virtqemud-ro.socket > > > > virtqemud-admin.socket virtqemud virtnetworkd virtstoraged > > > > Regards. > > > > On Sun, 1 Sept 2024, 16:42 Joan g, wrote: > > > > > Hi Fariborz, > > > > > > Thank you, I was able to manage bridge configurations. > > > > > > Now I am not able to add the host to pool. Agent logs print below: > > > > > > 2024-09-01 14:03:17,273 ERROR [cloud.agent.AgentShell] (main:null) > > (logid:) > > > Unable to start agent: > > > com.cloud.utils.exception.CloudRuntimeException: Failed to connect > socket > > > to '/var/run/libvirt/virtqemud-sock': Connection refused > > > at > > > > > > > > > com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.configure(LibvirtComputingResource.java:1153) > > > at com.cloud.agent.Agent.(Agent.java:193) > > > at > com.cloud.agent.AgentShell.launchNewAgent(AgentShell.java:452) > > > at > > > > com.cloud.agent.AgentShell.launchAgentFromClassInfo(AgentShell.java:431) > > > at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:415) > > > at com.cloud.agent.AgentShell.start(AgentShell.java:511) > > > at com.cloud.agent.AgentShell.main(AgentShell.java:541) > > > > > > Did I miss some configs? > > > > > > I noticed that I can't run `virsh` as the root user or with `sudo`: > > > > > > # virsh list --all > > > error: failed to connect to the hypervisor > > > error: Failed to connect socket to '/var/run/libvirt/virtqemud-sock': > > > Connection refused > > > > > > But as a user in wheel group its successful > > > $ virsh list --all > > > Id Name State > > > > > > > > > > > > *Jon* > > > > > > > > > On Tue, Aug 27, 2024 at 11:16 PM Fariborz Navidan < > mdvlinqu...@gmail.com > > > > > > wrote: > > > > > > > Hello, > > > > > > > > I was able to configure Cloudstack 4.18 on AlmaLinux 9 last month.I > > used > > > > the following nmcli commands to create the bridge: > > > > > > > > nmcli con add ifname cloudbr0 type bridge con-name cloudbr0 > autoconnect > > > yes > > > > nmcli con add type bridge-slave ifname eth0 master cloudbr0 > > > > nmcli con up cloudbr0 > > > > > > > > After creating the bridge, remove any assigned IP from the slave > > > interface > > > > (e.g eth0) and assign it to the bridge. > > > > > > > > Regards. > > > > > > > > On Tue, Aug 27, 2024 at 3:59 PM Joan g wrote: > > > > > > > > > Hello Community, > > > > > > > > > > Could someone provide guidance on setting up a bridge for the > latest > > > > > AlmaLinux 9.4? When I use `nmcli` to create a bridge, the ethernet > > > > > interfaces keep going down, and I'm unable to bring them online. > Any > > > > > suggestions on working `nmcli` commands would be greatly > appreciated > > > and > > > > > helpful. > > > > > > > > > > Regards, > > > > > Jon > > > > > > > > > > > > > > >
Re: KVM | Alma Linux 9.4
Hi Yes done but masking them did not help. Still connection refused for sudo/root Jon On Sun, Sep 1, 2024 at 8:39 PM Fariborz Navidan wrote: > Hi. > > > Run the following command to mask the necessary services and let me know > the outcome. > > > systemctl mask virtqemud.socket virtqemud-ro.socket > > > virtqemud-admin.socket virtqemud virtnetworkd virtstoraged > > Regards. > > On Sun, 1 Sept 2024, 16:42 Joan g, wrote: > > > Hi Fariborz, > > > > Thank you, I was able to manage bridge configurations. > > > > Now I am not able to add the host to pool. Agent logs print below: > > > > 2024-09-01 14:03:17,273 ERROR [cloud.agent.AgentShell] (main:null) > (logid:) > > Unable to start agent: > > com.cloud.utils.exception.CloudRuntimeException: Failed to connect socket > > to '/var/run/libvirt/virtqemud-sock': Connection refused > > at > > > > > com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.configure(LibvirtComputingResource.java:1153) > > at com.cloud.agent.Agent.(Agent.java:193) > > at com.cloud.agent.AgentShell.launchNewAgent(AgentShell.java:452) > > at > > com.cloud.agent.AgentShell.launchAgentFromClassInfo(AgentShell.java:431) > > at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:415) > > at com.cloud.agent.AgentShell.start(AgentShell.java:511) > > at com.cloud.agent.AgentShell.main(AgentShell.java:541) > > > > Did I miss some configs? > > > > I noticed that I can't run `virsh` as the root user or with `sudo`: > > > > # virsh list --all > > error: failed to connect to the hypervisor > > error: Failed to connect socket to '/var/run/libvirt/virtqemud-sock': > > Connection refused > > > > But as a user in wheel group its successful > > $ virsh list --all > > Id Name State > > > > > > > > *Jon* > > > > > > On Tue, Aug 27, 2024 at 11:16 PM Fariborz Navidan > > > wrote: > > > > > Hello, > > > > > > I was able to configure Cloudstack 4.18 on AlmaLinux 9 last month.I > used > > > the following nmcli commands to create the bridge: > > > > > > nmcli con add ifname cloudbr0 type bridge con-name cloudbr0 autoconnect > > yes > > > nmcli con add type bridge-slave ifname eth0 master cloudbr0 > > > nmcli con up cloudbr0 > > > > > > After creating the bridge, remove any assigned IP from the slave > > interface > > > (e.g eth0) and assign it to the bridge. > > > > > > Regards. > > > > > > On Tue, Aug 27, 2024 at 3:59 PM Joan g wrote: > > > > > > > Hello Community, > > > > > > > > Could someone provide guidance on setting up a bridge for the latest > > > > AlmaLinux 9.4? When I use `nmcli` to create a bridge, the ethernet > > > > interfaces keep going down, and I'm unable to bring them online. Any > > > > suggestions on working `nmcli` commands would be greatly appreciated > > and > > > > helpful. > > > > > > > > Regards, > > > > Jon > > > > > > > > > >
Re: KVM | Alma Linux 9.4
Hi. Run the following command to mask the necessary services and let me know the outcome. systemctl mask virtqemud.socket virtqemud-ro.socket > > virtqemud-admin.socket virtqemud virtnetworkd virtstoraged Regards. On Sun, 1 Sept 2024, 16:42 Joan g, wrote: > Hi Fariborz, > > Thank you, I was able to manage bridge configurations. > > Now I am not able to add the host to pool. Agent logs print below: > > 2024-09-01 14:03:17,273 ERROR [cloud.agent.AgentShell] (main:null) (logid:) > Unable to start agent: > com.cloud.utils.exception.CloudRuntimeException: Failed to connect socket > to '/var/run/libvirt/virtqemud-sock': Connection refused > at > > com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.configure(LibvirtComputingResource.java:1153) > at com.cloud.agent.Agent.(Agent.java:193) > at com.cloud.agent.AgentShell.launchNewAgent(AgentShell.java:452) > at > com.cloud.agent.AgentShell.launchAgentFromClassInfo(AgentShell.java:431) > at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:415) > at com.cloud.agent.AgentShell.start(AgentShell.java:511) > at com.cloud.agent.AgentShell.main(AgentShell.java:541) > > Did I miss some configs? > > I noticed that I can't run `virsh` as the root user or with `sudo`: > > # virsh list --all > error: failed to connect to the hypervisor > error: Failed to connect socket to '/var/run/libvirt/virtqemud-sock': > Connection refused > > But as a user in wheel group its successful > $ virsh list --all > Id Name State > > > > *Jon* > > > On Tue, Aug 27, 2024 at 11:16 PM Fariborz Navidan > wrote: > > > Hello, > > > > I was able to configure Cloudstack 4.18 on AlmaLinux 9 last month.I used > > the following nmcli commands to create the bridge: > > > > nmcli con add ifname cloudbr0 type bridge con-name cloudbr0 autoconnect > yes > > nmcli con add type bridge-slave ifname eth0 master cloudbr0 > > nmcli con up cloudbr0 > > > > After creating the bridge, remove any assigned IP from the slave > interface > > (e.g eth0) and assign it to the bridge. > > > > Regards. > > > > On Tue, Aug 27, 2024 at 3:59 PM Joan g wrote: > > > > > Hello Community, > > > > > > Could someone provide guidance on setting up a bridge for the latest > > > AlmaLinux 9.4? When I use `nmcli` to create a bridge, the ethernet > > > interfaces keep going down, and I'm unable to bring them online. Any > > > suggestions on working `nmcli` commands would be greatly appreciated > and > > > helpful. > > > > > > Regards, > > > Jon > > > > > >
Re: KVM | Alma Linux 9.4
Hi Fariborz, Thank you, I was able to manage bridge configurations. Now I am not able to add the host to pool. Agent logs print below: 2024-09-01 14:03:17,273 ERROR [cloud.agent.AgentShell] (main:null) (logid:) Unable to start agent: com.cloud.utils.exception.CloudRuntimeException: Failed to connect socket to '/var/run/libvirt/virtqemud-sock': Connection refused at com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.configure(LibvirtComputingResource.java:1153) at com.cloud.agent.Agent.(Agent.java:193) at com.cloud.agent.AgentShell.launchNewAgent(AgentShell.java:452) at com.cloud.agent.AgentShell.launchAgentFromClassInfo(AgentShell.java:431) at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:415) at com.cloud.agent.AgentShell.start(AgentShell.java:511) at com.cloud.agent.AgentShell.main(AgentShell.java:541) Did I miss some configs? I noticed that I can't run `virsh` as the root user or with `sudo`: # virsh list --all error: failed to connect to the hypervisor error: Failed to connect socket to '/var/run/libvirt/virtqemud-sock': Connection refused But as a user in wheel group its successful $ virsh list --all Id Name State *Jon* On Tue, Aug 27, 2024 at 11:16 PM Fariborz Navidan wrote: > Hello, > > I was able to configure Cloudstack 4.18 on AlmaLinux 9 last month.I used > the following nmcli commands to create the bridge: > > nmcli con add ifname cloudbr0 type bridge con-name cloudbr0 autoconnect yes > nmcli con add type bridge-slave ifname eth0 master cloudbr0 > nmcli con up cloudbr0 > > After creating the bridge, remove any assigned IP from the slave interface > (e.g eth0) and assign it to the bridge. > > Regards. > > On Tue, Aug 27, 2024 at 3:59 PM Joan g wrote: > > > Hello Community, > > > > Could someone provide guidance on setting up a bridge for the latest > > AlmaLinux 9.4? When I use `nmcli` to create a bridge, the ethernet > > interfaces keep going down, and I'm unable to bring them online. Any > > suggestions on working `nmcli` commands would be greatly appreciated and > > helpful. > > > > Regards, > > Jon > > >
Re: Need an assistance in create Rocky Linux KVM template
Hi guys, Any thoughts on this? On Wed, 28 Aug 2024 at 12:46, Muhammad Hanis Irfan Mohd Zaid < hanisirfan.w...@gmail.com> wrote: > Hi all, > > I've been scratching my head trying to get cloud-init working with > CloudStack to perform an instance root password reset. You can find the > steps I did to configure my Rocky Linux 9.4 template here: > https://pastebin.com/KPiyFGyw > > So initially when the instance first booted up, the randomly generated > password by CloudStack works with the root account. But, I've tried > shutting down the instance and using the "Reset Password" feature. After > booting it back up, the new randomly generated password doesn't work as > expected. > > Running the bash script (/usr/local/bin/cloud/reset_creds.sh) also doesn't > work. You can the logs here: > cloud-init.log = https://pastebin.com/TvABQ7wF > cloud-init-output.log = https://pastebin.com/dsQM5CCJ > > I can actually just download cloud images provided by Rocky for example > but would like to learn to create one myself. > > Thanks >
Need an assistance in create Rocky Linux KVM template
Hi all, I've been scratching my head trying to get cloud-init working with CloudStack to perform an instance root password reset. You can find the steps I did to configure my Rocky Linux 9.4 template here: https://pastebin.com/KPiyFGyw So initially when the instance first booted up, the randomly generated password by CloudStack works with the root account. But, I've tried shutting down the instance and using the "Reset Password" feature. After booting it back up, the new randomly generated password doesn't work as expected. Running the bash script (/usr/local/bin/cloud/reset_creds.sh) also doesn't work. You can the logs here: cloud-init.log = https://pastebin.com/TvABQ7wF cloud-init-output.log = https://pastebin.com/dsQM5CCJ I can actually just download cloud images provided by Rocky for example but would like to learn to create one myself. Thanks
Re: KVM | Alma Linux 9.4
Hello, I was able to configure Cloudstack 4.18 on AlmaLinux 9 last month.I used the following nmcli commands to create the bridge: nmcli con add ifname cloudbr0 type bridge con-name cloudbr0 autoconnect yes nmcli con add type bridge-slave ifname eth0 master cloudbr0 nmcli con up cloudbr0 After creating the bridge, remove any assigned IP from the slave interface (e.g eth0) and assign it to the bridge. Regards. On Tue, Aug 27, 2024 at 3:59 PM Joan g wrote: > Hello Community, > > Could someone provide guidance on setting up a bridge for the latest > AlmaLinux 9.4? When I use `nmcli` to create a bridge, the ethernet > interfaces keep going down, and I'm unable to bring them online. Any > suggestions on working `nmcli` commands would be greatly appreciated and > helpful. > > Regards, > Jon >
KVM | Alma Linux 9.4
Hello Community, Could someone provide guidance on setting up a bridge for the latest AlmaLinux 9.4? When I use `nmcli` to create a bridge, the ethernet interfaces keep going down, and I'm unable to bring them online. Any suggestions on working `nmcli` commands would be greatly appreciated and helpful. Regards, Jon
Re: [D] Question on FiberChannel Multipath for KVM + Pure Flash Array [cloudstack]
GitHub user DaanHoogland added a comment to the discussion: Question on FiberChannel Multipath for KVM + Pure Flash Array @midhunpjos , I have no experience with this type of storage but can see in the code that it is indeed lacking a capacity parameter. can you give the API calls that you used to add the storage? (if need be you can use the browser dev tools to see the calls being made) GitHub link: https://github.com/apache/cloudstack/discussions/9558#discussioncomment-10404071 This is an automatically sent email for users@cloudstack.apache.org. To unsubscribe, please send an email to: users-unsubscr...@cloudstack.apache.org
Re: [D] Filesystem for SharedMount Point / KVM Over Fibre Channel on Ubuntu 22.04 [cloudstack]
GitHub user midhunpjos added a comment to the discussion: Filesystem for SharedMount Point / KVM Over Fibre Channel on Ubuntu 22.04 Thanks @BryanMLima . OCFS2 appears to be straightforward. GitHub link: https://github.com/apache/cloudstack/discussions/9511#discussioncomment-10399064 This is an automatically sent email for users@cloudstack.apache.org. To unsubscribe, please send an email to: users-unsubscr...@cloudstack.apache.org
Re: [D] Filesystem for SharedMount Point / KVM Over Fibre Channel on Ubuntu 22.04 [cloudstack]
GitHub user BryanMLima added a comment to the discussion: Filesystem for SharedMount Point / KVM Over Fibre Channel on Ubuntu 22.04 Hey, @midhunpjos I usually use OCFS2 for iSCSI and FibreChannel, and it works as expected. There are some guides on the internet that can help you set it up, but it shouldn't be that difficult. GitHub link: https://github.com/apache/cloudstack/discussions/9511#discussioncomment-10384523 This is an automatically sent email for users@cloudstack.apache.org. To unsubscribe, please send an email to: users-unsubscr...@cloudstack.apache.org
Re: Join KVM host from CLI using only user and certificate
Joining a host with a certificate is successful when password arg is omitted, even though the task is reported as failed. Despite the success I think the command is unstable, if hosttags argument is specified it is not taken under account and no tags are assigned to the joined KVM host. It may be possible for other arguments to fail as well. Can someone verify this? here is an example command: cmk add host zoneid= podid= clustername=my-cluster hypervisor=KVM url=http:// username=root hosttags=test-tag allocationstate=enabled Regards, Jordan On Tue, Aug 6, 2024 at 9:13 AM jordan j wrote: > Using password= or password='' both prompt "failed to authenticate, please > check credentials" error with the task being canceled. > > Regards, > Jordan > > On Tue, Aug 6, 2024 at 7:14 AM Rohit Yadav > wrote: > >> Can you try to pass an empty password to cmk, when calling addHost API. >> >> For example, see this: >> https://github.com/rohityadavcloud/c8k.in/blob/main/install.sh#L289 >> >> >> Regards. >> >> >> >> >> ____ >> From: jordan j >> Sent: Tuesday, August 6, 2024 09:18 >> To: users@cloudstack.apache.org >> Subject: Re: Join KVM host from CLI using only user and certificate >> >> Forgot to add the error, may be helpful: >> >> Could not add host at [http://x.x.x.x] with zone[1], pod[1] and cluster >> [60] due to: [can't setup agent, due to >> com.cloud.utils.exception.CloudRuntimeException: Unable to persist the >> host >> details key: password for host id: 123123 >> >> Regards, >> Jordan >> >> On Tue, Aug 6, 2024 at 6:38 AM jordan j wrote: >> >> > Hello Rohit, >> > >> > Yes, the GUI clearly shows that but I was exploring doing it from the >> > command line with Cloudmonkey. >> > >> > Rodrigo, I did some tests today and it works. However the command >> reports >> > an error state even though the host is joined properly - no error in >> agent >> > logs, host is visible in CS and it is NOT in unsecure state. >> > >> > Regards, >> > Jordan >> > >> > On Tue, Aug 6, 2024 at 5:57 AM Rohit Yadav >> > wrote: >> > >> >> Jordan, >> >> >> >> In 4.18/4.19 the add host form clearly shows passwordless mechanism to >> >> add a KVM host. This is done via mgmt server’s ssh public key to be >> added >> >> to the root user on the kvm host. >> >> >> >> Regards. >> >> >> >> Regards. >> >> >> >> >> >> >> >> >> >> From: jordan j >> >> Sent: Monday, August 5, 2024 8:42:46 PM >> >> To: users@cloudstack.apache.org >> >> Subject: Re: Join KVM host from CLI using only user and certificate >> >> >> >> Thank you for the advice, I will test tomorrow! >> >> >> >> Best regards, >> >> Jordan >> >> >> >> On Mon, Aug 5, 2024 at 6:07 PM Alex Dietrich > >> .invalid> >> >> wrote: >> >> >> >> > Hi Rodrigo, >> >> > >> >> > It may be worth updating the CloudStack API documentation as it says >> the >> >> > password is indeed required for hypervisors other than VMWare. >> >> > >> >> > “the password for the host; required to be passed for hypervisors >> other >> >> > than VMWare” - >> >> > https://cloudstack.apache.org/api/apidocs-4.19/apis/addHost.html >> >> > >> >> > >> >> > * Alex >> >> > >> >> > [photo]<http://www.ussignal.com/> >> >> > >> >> > Alex Dietrich >> >> > Senior Network Engineer, US Signal >> >> > >> >> > 616-233-5094 | www.ussignal.com<<< >> http://www.ussignal.com<<> >> >> http://www.ussignal.com<> >> >> > https://www.ussignal.com> | adietr...@ussignal.com> >> > adietr...@ussignal.com> >> >> > >> >> > 201 Ionia Ave SW, Grand Rapids, MI 49503< >> >> > >> >> >> https://maps.google.com/?q=201%20Ionia%20Ave%20SW,%20Grand%20Rapids,%20MI%2049503 >> >> > > >> >> > >> >> > [linkedin]<https://www.linkedin.com/company/us-signal/> >> >> > >> >> > [facebook]<https://w
Re: vm nic speed on kvm host
Hello Swen, Does iperf3 show 2 Gbps and scp only 1 Gbps? Thanks From: m...@swen.io Date: Tuesday, 13 August 2024 at 4:08 PM To: users@cloudstack.apache.org Subject: AW: vm nic speed on kvm host Hi Jayanth, Iperf3 shows the full 2 Gbit bandwith when testing, still scp just can utilize 2 Gbit. How can we troubleshoot virtio? Regards, Swen -Ursprüngliche Nachricht- Von: Jayanth Babu A Gesendet: Montag, 12. August 2024 18:16 An: users@cloudstack.apache.org Betreff: Re: vm nic speed on kvm host Then 2 * 25 GbE shouldn’t matter if they’re running on the same host. Please try running iperf3 on instances. I see that the device driver is also “virtio” so the issue may lie somewhere else. Regards, Jayanth Reddy From: m...@swen.io Date: Monday, 12 August 2024 at 9:40 PM To: users@cloudstack.apache.org Subject: AW: vm nic speed on kvm host Yes, both instances have 256000 KB/s defined. Physical link between hosts is 2x25G NIC as LACP bond. But both instances are running on the same kvm host. You want to to use iperf3 on instances or kvm host? Regards, Swen -Ursprüngliche Nachricht- Von: Jayanth Babu A Gesendet: Montag, 12. August 2024 17:59 An: users@cloudstack.apache.org Betreff: Re: vm nic speed on kvm host Do both instances have 256000 KB/s defined on their XML? Just asking, what’s your physical link speed? Can you also try with iperf3 to gain some insights? Regards, Jayanth Reddy From: m...@swen.io Date: Monday, 12 August 2024 at 9:22 PM To: users@cloudstack.apache.org Subject: vm nic speed on kvm host Hi all, we are testing some settings on our ACS installation to get bandwidth up on vm level. But it looks like we are stuck at 1Gbit. Here is our test workflow: * Create 2 instances within the same network * Create a 20G file on one of the instances * Scp the file from 1 instance to the other * Overserve bandwidth via nload We are using global setting vm.network.throttling.rate with value of 1000 and virsh dumpxml looks like this: Which looks okay to us and we are able to get near max 1 Gbit bandwidth during scp. (128000 kbyte/s = 1 Gbit) When altering vm.network.throttling.rate to 2000 virsh dumpxml looks like this: Which should be okay, it is double the size. But scp still maxes out near 1Gbit. Any idea where to look for the bottleneck to get a 2 Gbit connection running between 2 instances in the same network? Regards, Swen Disclaimer *** This e-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended solely for the use of the addressee(s). If you are not the intended recipient, please notify the sender by e-mail and delete the original message. Further, you are not authorised to copy, disclose, or distribute this e-mail or its contents to any other person and any such actions are unlawful and strictly prohibited. This e-mail may contain viruses. NxtGen Datacenter & Cloud Technologies Private Ltd (“NxtGen”) has taken every reasonable precaution to minimize this risk but is not liable for any damage you may sustain as a result of any virus in this e-mail. You should carry out your own virus checks before opening the e-mail or attachment. NxtGen reserves the right to monitor and review the content of all messages sent to or from this e-mail address. Messages sent to or from this e-mail address may be stored on the NxtGen e-mail system. *** End of Disclaimer ***NXTGEN*** Disclaimer *** This e-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended solely for the use of the addressee(s). If you are not the intended recipient, please notify the sender by e-mail and delete the original message. Further, you are not authorised to copy, disclose, or distribute this e-mail or its contents to any other person and any such actions are unlawful and strictly prohibited. This e-mail may contain viruses. NxtGen Datacenter & Cloud Technologies Private Ltd (“NxtGen”) has taken every reasonable precaution to minimize this risk but is not liable for any damage you may sustain as a result of any virus in this e-mail. You should carry out your own virus checks before opening the e-mail or attachment. NxtGen reserves the right to monitor and review the content of all messages sent to or from this e-mail address. Messages sent to or from this e-mail address may be stored on the NxtGen e-mail system. *** End of Disclaimer ***NXTGEN*** Disclaimer *** This e-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended solely for the use of the addressee(s). If you are not the intended recipient, please notify the sender by e-mail and delete the original message. Further, you are not authorised to copy, disclose, or distribute this e-mail or its contents to any other person and any such
Re: vm nic speed on kvm host
What’s your physical NIC capacity on the KVM host and that of your network switch connecting your hosts? It may be possible that you need some other settings or correct bridge configuration or nicAdapter for your VMs. Regards. From: m...@swen.io Sent: Tuesday, August 13, 2024 4:07:02 PM To: users@cloudstack.apache.org Subject: AW: vm nic speed on kvm host Hi Jayanth, Iperf3 shows the full 2 Gbit bandwith when testing, still scp just can utilize 2 Gbit. How can we troubleshoot virtio? Regards, Swen -Ursprüngliche Nachricht- Von: Jayanth Babu A Gesendet: Montag, 12. August 2024 18:16 An: users@cloudstack.apache.org Betreff: Re: vm nic speed on kvm host Then 2 * 25 GbE shouldn’t matter if they’re running on the same host. Please try running iperf3 on instances. I see that the device driver is also “virtio” so the issue may lie somewhere else. Regards, Jayanth Reddy From: m...@swen.io Date: Monday, 12 August 2024 at 9:40 PM To: users@cloudstack.apache.org Subject: AW: vm nic speed on kvm host Yes, both instances have 256000 KB/s defined. Physical link between hosts is 2x25G NIC as LACP bond. But both instances are running on the same kvm host. You want to to use iperf3 on instances or kvm host? Regards, Swen -Ursprüngliche Nachricht- Von: Jayanth Babu A Gesendet: Montag, 12. August 2024 17:59 An: users@cloudstack.apache.org Betreff: Re: vm nic speed on kvm host Do both instances have 256000 KB/s defined on their XML? Just asking, what’s your physical link speed? Can you also try with iperf3 to gain some insights? Regards, Jayanth Reddy From: m...@swen.io Date: Monday, 12 August 2024 at 9:22 PM To: users@cloudstack.apache.org Subject: vm nic speed on kvm host Hi all, we are testing some settings on our ACS installation to get bandwidth up on vm level. But it looks like we are stuck at 1Gbit. Here is our test workflow: * Create 2 instances within the same network * Create a 20G file on one of the instances * Scp the file from 1 instance to the other * Overserve bandwidth via nload We are using global setting vm.network.throttling.rate with value of 1000 and virsh dumpxml looks like this: Which looks okay to us and we are able to get near max 1 Gbit bandwidth during scp. (128000 kbyte/s = 1 Gbit) When altering vm.network.throttling.rate to 2000 virsh dumpxml looks like this: Which should be okay, it is double the size. But scp still maxes out near 1Gbit. Any idea where to look for the bottleneck to get a 2 Gbit connection running between 2 instances in the same network? Regards, Swen Disclaimer *** This e-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended solely for the use of the addressee(s). If you are not the intended recipient, please notify the sender by e-mail and delete the original message. Further, you are not authorised to copy, disclose, or distribute this e-mail or its contents to any other person and any such actions are unlawful and strictly prohibited. This e-mail may contain viruses. NxtGen Datacenter & Cloud Technologies Private Ltd (“NxtGen”) has taken every reasonable precaution to minimize this risk but is not liable for any damage you may sustain as a result of any virus in this e-mail. You should carry out your own virus checks before opening the e-mail or attachment. NxtGen reserves the right to monitor and review the content of all messages sent to or from this e-mail address. Messages sent to or from this e-mail address may be stored on the NxtGen e-mail system. *** End of Disclaimer ***NXTGEN*** Disclaimer *** This e-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended solely for the use of the addressee(s). If you are not the intended recipient, please notify the sender by e-mail and delete the original message. Further, you are not authorised to copy, disclose, or distribute this e-mail or its contents to any other person and any such actions are unlawful and strictly prohibited. This e-mail may contain viruses. NxtGen Datacenter & Cloud Technologies Private Ltd (“NxtGen”) has taken every reasonable precaution to minimize this risk but is not liable for any damage you may sustain as a result of any virus in this e-mail. You should carry out your own virus checks before opening the e-mail or attachment. NxtGen reserves the right to monitor and review the content of all messages sent to or from this e-mail address. Messages sent to or from this e-mail address may be stored on the NxtGen e-mail system. *** End of Disclaimer ***NXTGEN***
AW: vm nic speed on kvm host
Hi Jayanth, Iperf3 shows the full 2 Gbit bandwith when testing, still scp just can utilize 2 Gbit. How can we troubleshoot virtio? Regards, Swen -Ursprüngliche Nachricht- Von: Jayanth Babu A Gesendet: Montag, 12. August 2024 18:16 An: users@cloudstack.apache.org Betreff: Re: vm nic speed on kvm host Then 2 * 25 GbE shouldn’t matter if they’re running on the same host. Please try running iperf3 on instances. I see that the device driver is also “virtio” so the issue may lie somewhere else. Regards, Jayanth Reddy From: m...@swen.io Date: Monday, 12 August 2024 at 9:40 PM To: users@cloudstack.apache.org Subject: AW: vm nic speed on kvm host Yes, both instances have 256000 KB/s defined. Physical link between hosts is 2x25G NIC as LACP bond. But both instances are running on the same kvm host. You want to to use iperf3 on instances or kvm host? Regards, Swen -Ursprüngliche Nachricht- Von: Jayanth Babu A Gesendet: Montag, 12. August 2024 17:59 An: users@cloudstack.apache.org Betreff: Re: vm nic speed on kvm host Do both instances have 256000 KB/s defined on their XML? Just asking, what’s your physical link speed? Can you also try with iperf3 to gain some insights? Regards, Jayanth Reddy From: m...@swen.io Date: Monday, 12 August 2024 at 9:22 PM To: users@cloudstack.apache.org Subject: vm nic speed on kvm host Hi all, we are testing some settings on our ACS installation to get bandwidth up on vm level. But it looks like we are stuck at 1Gbit. Here is our test workflow: * Create 2 instances within the same network * Create a 20G file on one of the instances * Scp the file from 1 instance to the other * Overserve bandwidth via nload We are using global setting vm.network.throttling.rate with value of 1000 and virsh dumpxml looks like this: Which looks okay to us and we are able to get near max 1 Gbit bandwidth during scp. (128000 kbyte/s = 1 Gbit) When altering vm.network.throttling.rate to 2000 virsh dumpxml looks like this: Which should be okay, it is double the size. But scp still maxes out near 1Gbit. Any idea where to look for the bottleneck to get a 2 Gbit connection running between 2 instances in the same network? Regards, Swen Disclaimer *** This e-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended solely for the use of the addressee(s). If you are not the intended recipient, please notify the sender by e-mail and delete the original message. Further, you are not authorised to copy, disclose, or distribute this e-mail or its contents to any other person and any such actions are unlawful and strictly prohibited. This e-mail may contain viruses. NxtGen Datacenter & Cloud Technologies Private Ltd (“NxtGen”) has taken every reasonable precaution to minimize this risk but is not liable for any damage you may sustain as a result of any virus in this e-mail. You should carry out your own virus checks before opening the e-mail or attachment. NxtGen reserves the right to monitor and review the content of all messages sent to or from this e-mail address. Messages sent to or from this e-mail address may be stored on the NxtGen e-mail system. *** End of Disclaimer ***NXTGEN*** Disclaimer *** This e-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended solely for the use of the addressee(s). If you are not the intended recipient, please notify the sender by e-mail and delete the original message. Further, you are not authorised to copy, disclose, or distribute this e-mail or its contents to any other person and any such actions are unlawful and strictly prohibited. This e-mail may contain viruses. NxtGen Datacenter & Cloud Technologies Private Ltd (“NxtGen”) has taken every reasonable precaution to minimize this risk but is not liable for any damage you may sustain as a result of any virus in this e-mail. You should carry out your own virus checks before opening the e-mail or attachment. NxtGen reserves the right to monitor and review the content of all messages sent to or from this e-mail address. Messages sent to or from this e-mail address may be stored on the NxtGen e-mail system. *** End of Disclaimer ***NXTGEN***
Re: vm nic speed on kvm host
Then 2 * 25 GbE shouldn’t matter if they’re running on the same host. Please try running iperf3 on instances. I see that the device driver is also “virtio” so the issue may lie somewhere else. Regards, Jayanth Reddy From: m...@swen.io Date: Monday, 12 August 2024 at 9:40 PM To: users@cloudstack.apache.org Subject: AW: vm nic speed on kvm host Yes, both instances have 256000 KB/s defined. Physical link between hosts is 2x25G NIC as LACP bond. But both instances are running on the same kvm host. You want to to use iperf3 on instances or kvm host? Regards, Swen -Ursprüngliche Nachricht- Von: Jayanth Babu A Gesendet: Montag, 12. August 2024 17:59 An: users@cloudstack.apache.org Betreff: Re: vm nic speed on kvm host Do both instances have 256000 KB/s defined on their XML? Just asking, what’s your physical link speed? Can you also try with iperf3 to gain some insights? Regards, Jayanth Reddy From: m...@swen.io Date: Monday, 12 August 2024 at 9:22 PM To: users@cloudstack.apache.org Subject: vm nic speed on kvm host Hi all, we are testing some settings on our ACS installation to get bandwidth up on vm level. But it looks like we are stuck at 1Gbit. Here is our test workflow: * Create 2 instances within the same network * Create a 20G file on one of the instances * Scp the file from 1 instance to the other * Overserve bandwidth via nload We are using global setting vm.network.throttling.rate with value of 1000 and virsh dumpxml looks like this: Which looks okay to us and we are able to get near max 1 Gbit bandwidth during scp. (128000 kbyte/s = 1 Gbit) When altering vm.network.throttling.rate to 2000 virsh dumpxml looks like this: Which should be okay, it is double the size. But scp still maxes out near 1Gbit. Any idea where to look for the bottleneck to get a 2 Gbit connection running between 2 instances in the same network? Regards, Swen Disclaimer *** This e-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended solely for the use of the addressee(s). If you are not the intended recipient, please notify the sender by e-mail and delete the original message. Further, you are not authorised to copy, disclose, or distribute this e-mail or its contents to any other person and any such actions are unlawful and strictly prohibited. This e-mail may contain viruses. NxtGen Datacenter & Cloud Technologies Private Ltd (“NxtGen”) has taken every reasonable precaution to minimize this risk but is not liable for any damage you may sustain as a result of any virus in this e-mail. You should carry out your own virus checks before opening the e-mail or attachment. NxtGen reserves the right to monitor and review the content of all messages sent to or from this e-mail address. Messages sent to or from this e-mail address may be stored on the NxtGen e-mail system. *** End of Disclaimer ***NXTGEN*** Disclaimer *** This e-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended solely for the use of the addressee(s). If you are not the intended recipient, please notify the sender by e-mail and delete the original message. Further, you are not authorised to copy, disclose, or distribute this e-mail or its contents to any other person and any such actions are unlawful and strictly prohibited. This e-mail may contain viruses. NxtGen Datacenter & Cloud Technologies Private Ltd (“NxtGen”) has taken every reasonable precaution to minimize this risk but is not liable for any damage you may sustain as a result of any virus in this e-mail. You should carry out your own virus checks before opening the e-mail or attachment. NxtGen reserves the right to monitor and review the content of all messages sent to or from this e-mail address. Messages sent to or from this e-mail address may be stored on the NxtGen e-mail system. *** End of Disclaimer ***NXTGEN***
AW: vm nic speed on kvm host
Yes, both instances have 256000 KB/s defined. Physical link between hosts is 2x25G NIC as LACP bond. But both instances are running on the same kvm host. You want to to use iperf3 on instances or kvm host? Regards, Swen -Ursprüngliche Nachricht- Von: Jayanth Babu A Gesendet: Montag, 12. August 2024 17:59 An: users@cloudstack.apache.org Betreff: Re: vm nic speed on kvm host Do both instances have 256000 KB/s defined on their XML? Just asking, what’s your physical link speed? Can you also try with iperf3 to gain some insights? Regards, Jayanth Reddy From: m...@swen.io Date: Monday, 12 August 2024 at 9:22 PM To: users@cloudstack.apache.org Subject: vm nic speed on kvm host Hi all, we are testing some settings on our ACS installation to get bandwidth up on vm level. But it looks like we are stuck at 1Gbit. Here is our test workflow: * Create 2 instances within the same network * Create a 20G file on one of the instances * Scp the file from 1 instance to the other * Overserve bandwidth via nload We are using global setting vm.network.throttling.rate with value of 1000 and virsh dumpxml looks like this: Which looks okay to us and we are able to get near max 1 Gbit bandwidth during scp. (128000 kbyte/s = 1 Gbit) When altering vm.network.throttling.rate to 2000 virsh dumpxml looks like this: Which should be okay, it is double the size. But scp still maxes out near 1Gbit. Any idea where to look for the bottleneck to get a 2 Gbit connection running between 2 instances in the same network? Regards, Swen Disclaimer *** This e-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended solely for the use of the addressee(s). If you are not the intended recipient, please notify the sender by e-mail and delete the original message. Further, you are not authorised to copy, disclose, or distribute this e-mail or its contents to any other person and any such actions are unlawful and strictly prohibited. This e-mail may contain viruses. NxtGen Datacenter & Cloud Technologies Private Ltd (“NxtGen”) has taken every reasonable precaution to minimize this risk but is not liable for any damage you may sustain as a result of any virus in this e-mail. You should carry out your own virus checks before opening the e-mail or attachment. NxtGen reserves the right to monitor and review the content of all messages sent to or from this e-mail address. Messages sent to or from this e-mail address may be stored on the NxtGen e-mail system. *** End of Disclaimer ***NXTGEN***
Re: vm nic speed on kvm host
Do both instances have 256000 KB/s defined on their XML? Just asking, what’s your physical link speed? Can you also try with iperf3 to gain some insights? Regards, Jayanth Reddy From: m...@swen.io Date: Monday, 12 August 2024 at 9:22 PM To: users@cloudstack.apache.org Subject: vm nic speed on kvm host Hi all, we are testing some settings on our ACS installation to get bandwidth up on vm level. But it looks like we are stuck at 1Gbit. Here is our test workflow: * Create 2 instances within the same network * Create a 20G file on one of the instances * Scp the file from 1 instance to the other * Overserve bandwidth via nload We are using global setting vm.network.throttling.rate with value of 1000 and virsh dumpxml looks like this: Which looks okay to us and we are able to get near max 1 Gbit bandwidth during scp. (128000 kbyte/s = 1 Gbit) When altering vm.network.throttling.rate to 2000 virsh dumpxml looks like this: Which should be okay, it is double the size. But scp still maxes out near 1Gbit. Any idea where to look for the bottleneck to get a 2 Gbit connection running between 2 instances in the same network? Regards, Swen Disclaimer *** This e-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended solely for the use of the addressee(s). If you are not the intended recipient, please notify the sender by e-mail and delete the original message. Further, you are not authorised to copy, disclose, or distribute this e-mail or its contents to any other person and any such actions are unlawful and strictly prohibited. This e-mail may contain viruses. NxtGen Datacenter & Cloud Technologies Private Ltd (“NxtGen”) has taken every reasonable precaution to minimize this risk but is not liable for any damage you may sustain as a result of any virus in this e-mail. You should carry out your own virus checks before opening the e-mail or attachment. NxtGen reserves the right to monitor and review the content of all messages sent to or from this e-mail address. Messages sent to or from this e-mail address may be stored on the NxtGen e-mail system. *** End of Disclaimer ***NXTGEN***
vm nic speed on kvm host
Hi all, we are testing some settings on our ACS installation to get bandwidth up on vm level. But it looks like we are stuck at 1Gbit. Here is our test workflow: * Create 2 instances within the same network * Create a 20G file on one of the instances * Scp the file from 1 instance to the other * Overserve bandwidth via nload We are using global setting vm.network.throttling.rate with value of 1000 and virsh dumpxml looks like this: Which looks okay to us and we are able to get near max 1 Gbit bandwidth during scp. (128000 kbyte/s = 1 Gbit) When altering vm.network.throttling.rate to 2000 virsh dumpxml looks like this: Which should be okay, it is double the size. But scp still maxes out near 1Gbit. Any idea where to look for the bottleneck to get a 2 Gbit connection running between 2 instances in the same network? Regards, Swen
Re: add additional KVM primary storage through CloudMonkey
Thank you Slavka, I will open a ticket for the UI later and make amends to documentation for CLI. Regards, Jordan On Mon, Aug 12, 2024 at 3:05 PM Slavka Peleva wrote: > Hi Jordan, > > I was able to add local storage via Cloudmonkey. There is no need to > provide the scope, it will be set depending on the URL scheme (it has to be > "file") > > (admin) 🐵 > create storagepool zoneid=07d64765-3123-4fc2-b947-25d2c36f5bb4 > > name=test provider=DefaultPrimary > > podid=0af34b96-e88d-440e-a6bd-c4e8aab4aa4a > > clusterid=49db6a16-2f6c-4583-9d07-37ccceb248ae url=file:// > > 10.2.32.244/var/lib/libvirt/images > > { > > "storagepool": { > > "clusterid": "49db6a16-2f6c-4583-9d07-37ccceb248ae", > > "clustername": "Cluster-A-1", > > "created": "2024-08-12T14:59:53+0300", > > "disksizeallocated": 0, > > "disksizetotal": 41001418752, > > "hasannotations": false, > > "hypervisor": "KVM", > > "id": "3714d38e-1842-4689-a162-0c14df06934d", > > "ipaddress": "10.2.32.244", > > "istagarule": false, > > "name": "test", > > "overprovisionfactor": "2.0", > > "path": "/var/lib/libvirt/images", > > "podid": "0af34b96-e88d-440e-a6bd-c4e8aab4aa4a", > > "podname": "Pod-A", > > "provider": "DefaultPrimary", > > "scope": "HOST", > > "state": "Up", > > "type": "Filesystem", > > "zoneid": "07d64765-3123-4fc2-b947-25d2c36f5bb4", > > "zonename": "Zone-A" > > } > > } > > > Via UI - probably you're right that there is a bug. When the data is > fetched it shows only the host from the first cluster in the list. > > Best regards, > Slavka > > On Mon, Aug 12, 2024 at 12:37 PM jordan j wrote: > > > Hello everyone, > > > > The docs claim that this can be done from UI and from manually modifying > > the agent on the KVM host but I wonder if it can be done from CLI? Here > is > > my experience so far (CS 4.19.1.0, one pod with mixed XCP and KVM > > clusters). > > > > - Manually modifying the agent: It works > > - From Primary storage UI: the KVM host cannot be selected even though a > > KVM cluster is selected above. Actually the host UI field can only select > > one of all the hosts in the zone and that host is not part of the > selected > > cluster. I wonder if that is a bug? > > - Cloudmonkey Create StoragePool command: > > > https://cloudstack.apache.org/api/apidocs-4.19/apis/createStoragePool.html > > . > > When selecting a scope argument there is no HOST value to select (that is > > the requirement for local disk) but only Zone and Cluster. Also the api > > command is poorly documented, for example I have no clue what the > "details" > > argument is used for. > > > > Has anyone had more success with UI and/or CLI? > > > > Best regards, > > Jordan > > >
Re: add additional KVM primary storage through CloudMonkey
Hi Jordan, I was able to add local storage via Cloudmonkey. There is no need to provide the scope, it will be set depending on the URL scheme (it has to be "file") (admin) 🐵 > create storagepool zoneid=07d64765-3123-4fc2-b947-25d2c36f5bb4 > name=test provider=DefaultPrimary > podid=0af34b96-e88d-440e-a6bd-c4e8aab4aa4a > clusterid=49db6a16-2f6c-4583-9d07-37ccceb248ae url=file:// > 10.2.32.244/var/lib/libvirt/images > { > "storagepool": { > "clusterid": "49db6a16-2f6c-4583-9d07-37ccceb248ae", > "clustername": "Cluster-A-1", > "created": "2024-08-12T14:59:53+0300", > "disksizeallocated": 0, > "disksizetotal": 41001418752, > "hasannotations": false, > "hypervisor": "KVM", > "id": "3714d38e-1842-4689-a162-0c14df06934d", > "ipaddress": "10.2.32.244", > "istagarule": false, > "name": "test", > "overprovisionfactor": "2.0", > "path": "/var/lib/libvirt/images", > "podid": "0af34b96-e88d-440e-a6bd-c4e8aab4aa4a", > "podname": "Pod-A", > "provider": "DefaultPrimary", > "scope": "HOST", > "state": "Up", > "type": "Filesystem", > "zoneid": "07d64765-3123-4fc2-b947-25d2c36f5bb4", > "zonename": "Zone-A" > } > } Via UI - probably you're right that there is a bug. When the data is fetched it shows only the host from the first cluster in the list. Best regards, Slavka On Mon, Aug 12, 2024 at 12:37 PM jordan j wrote: > Hello everyone, > > The docs claim that this can be done from UI and from manually modifying > the agent on the KVM host but I wonder if it can be done from CLI? Here is > my experience so far (CS 4.19.1.0, one pod with mixed XCP and KVM > clusters). > > - Manually modifying the agent: It works > - From Primary storage UI: the KVM host cannot be selected even though a > KVM cluster is selected above. Actually the host UI field can only select > one of all the hosts in the zone and that host is not part of the selected > cluster. I wonder if that is a bug? > - Cloudmonkey Create StoragePool command: > https://cloudstack.apache.org/api/apidocs-4.19/apis/createStoragePool.html > . > When selecting a scope argument there is no HOST value to select (that is > the requirement for local disk) but only Zone and Cluster. Also the api > command is poorly documented, for example I have no clue what the "details" > argument is used for. > > Has anyone had more success with UI and/or CLI? > > Best regards, > Jordan >
add additional KVM primary storage through CloudMonkey
Hello everyone, The docs claim that this can be done from UI and from manually modifying the agent on the KVM host but I wonder if it can be done from CLI? Here is my experience so far (CS 4.19.1.0, one pod with mixed XCP and KVM clusters). - Manually modifying the agent: It works - From Primary storage UI: the KVM host cannot be selected even though a KVM cluster is selected above. Actually the host UI field can only select one of all the hosts in the zone and that host is not part of the selected cluster. I wonder if that is a bug? - Cloudmonkey Create StoragePool command: https://cloudstack.apache.org/api/apidocs-4.19/apis/createStoragePool.html. When selecting a scope argument there is no HOST value to select (that is the requirement for local disk) but only Zone and Cluster. Also the api command is poorly documented, for example I have no clue what the "details" argument is used for. Has anyone had more success with UI and/or CLI? Best regards, Jordan
Re: Best steps to deploy a working KVM cluster with RHEL
Op 08/08/2024 om 10:18 schreef Muhammad Hanis Irfan Mohd Zaid: Gotcha! Thanks Rohit and Wido for the info. Is it okay for me to update the Best Practice section <https://github.com/apache/cloudstack-documentation/blob/main/source/conceptsandterminology/choosing_deployment_architecture.rst> in the docs to put a disclaimer for Primary storage mountpoints specifically for Ceph based on Wido explanation? I can create a pull request for the docs repo. This is the only thing I can contribute to the project for now. Sounds like a good idea! Such limitation doesn't exist for Ceph. Ceph technically isn't a mountpoint nor LUN either btw. Wido On Thu, 8 Aug 2024 at 16:11, Wido den Hollander <mailto:w...@widodh.nl>> wrote: Op 08/08/2024 om 09:53 schreef Rohit Yadav: > I think in CloudStack ceph storage pool you'll need to update its > capacity if/when you increase the storage capacity after adding it > initially. Wido and other Ceph gurus can advise other best practices. > > Libvirt will automatically detect the increased capacity of a Ceph cluster when you add capacity. There is no limit on how large a pool can be in Ceph and thus CloudStack. You can store multiple PB in a single Ceph pool. No need to split into smaller pools. Wido > Regards. > > > > *From:* Muhammad Hanis Irfan Mohd Zaid mailto:hanisirfan.w...@gmail.com>> > *Sent:* Thursday, August 8, 2024 11:43 > *To:* users@cloudstack.apache.org <mailto:users@cloudstack.apache.org> mailto:users@cloudstack.apache.org>> > *Cc:* Rohit Yadav mailto:rohit.ya...@shapeblue.com>> > *Subject:* Re: Best steps to deploy a working KVM cluster with RHEL > The gist that you shared plus your blog really helps me to set up CS on > our Rocky Linux servers. It's now running great along with Ceph RBD (the > other email) for primary and Ceph NFS for secondary. Thanks Rohit! > > Getting back to the pool size. Say I configured a Ceph RBD pool with no > quota, this means I can expand it indefinitely without the need to split > my Ceph storage into multiple pools of 6 TB based on the CS docs (best > practice section). > > I'll look at both Ceph and NFS limitations before actually designing the > production cluster. > > On Fri, 2 Aug 2024 at 20:46, Rohit Yadav mailto:rohit.ya...@shapeblue.com> > <mailto:rohit.ya...@shapeblue.com <mailto:rohit.ya...@shapeblue.com>>> wrote: > > Except the way you configure Linux bridges, using nmcli, on EL9 more > or less all steps apply as earlier EL distros. > > I've my old notes here - > https://gist.github.com/rohityadavcloud/fc401a0fe8e8ea16b4b3a4e3d149ce0c#file-el9-or-rhel9-acs <https://gist.github.com/rohityadavcloud/fc401a0fe8e8ea16b4b3a4e3d149ce0c#file-el9-or-rhel9-acs> <https://gist.github.com/rohityadavcloud/fc401a0fe8e8ea16b4b3a4e3d149ce0c#file-el9-or-rhel9-acs <https://gist.github.com/rohityadavcloud/fc401a0fe8e8ea16b4b3a4e3d149ce0c#file-el9-or-rhel9-acs>> > > CloudStack-Ceph users have easily used 100-1000s of TB of storage > (RBD) in production, so that's fine. For NFS you can refer to the > Ceph-NFS specific limitations (if any). > > > Regards. > > > > > > From: Muhammad Hanis Irfan Mohd Zaid mailto:hanisirfan.w...@gmail.com> > <mailto:hanisirfan.w...@gmail.com <mailto:hanisirfan.w...@gmail.com>>> > Sent: Friday, August 2, 2024 07:54 > To: users@cloudstack.apache.org <mailto:users@cloudstack.apache.org> <mailto:users@cloudstack.apache.org <mailto:users@cloudstack.apache.org>> > mailto:users@cloudstack.apache.org> <mailto:users@cloudstack.apache.org <mailto:users@cloudstack.apache.org>>> > Subject: Re: Best steps to deploy a working KVM cluster with RHEL > > Oh say we're using Rocky Linux 9 or AlmaLinux 9, is there any workable > steps that can be shared that works in production? > > We're going to be working mostly with 25G LACP bonded interfaces. And, > we're planning to use Ceph RBD for primary and Ceph NFS for secondary > storage. Does this mean provisioning more than 10 TB for both are > okay with > CloudStack? > > On Thu, 1 Aug
Re: Best steps to deploy a working KVM cluster with RHEL
Gotcha! Thanks Rohit and Wido for the info. Is it okay for me to update the Best Practice section <https://github.com/apache/cloudstack-documentation/blob/main/source/conceptsandterminology/choosing_deployment_architecture.rst> in the docs to put a disclaimer for Primary storage mountpoints specifically for Ceph based on Wido explanation? I can create a pull request for the docs repo. This is the only thing I can contribute to the project for now. On Thu, 8 Aug 2024 at 16:11, Wido den Hollander wrote: > > > Op 08/08/2024 om 09:53 schreef Rohit Yadav: > > I think in CloudStack ceph storage pool you'll need to update its > > capacity if/when you increase the storage capacity after adding it > > initially. Wido and other Ceph gurus can advise other best practices. > > > > > > Libvirt will automatically detect the increased capacity of a Ceph > cluster when you add capacity. > > There is no limit on how large a pool can be in Ceph and thus > CloudStack. You can store multiple PB in a single Ceph pool. No need to > split into smaller pools. > > Wido > > > Regards. > > > > > > > > *From:* Muhammad Hanis Irfan Mohd Zaid > > *Sent:* Thursday, August 8, 2024 11:43 > > *To:* users@cloudstack.apache.org > > *Cc:* Rohit Yadav > > *Subject:* Re: Best steps to deploy a working KVM cluster with RHEL > > The gist that you shared plus your blog really helps me to set up CS on > > our Rocky Linux servers. It's now running great along with Ceph RBD (the > > other email) for primary and Ceph NFS for secondary. Thanks Rohit! > > > > Getting back to the pool size. Say I configured a Ceph RBD pool with no > > quota, this means I can expand it indefinitely without the need to split > > my Ceph storage into multiple pools of 6 TB based on the CS docs (best > > practice section). > > > > I'll look at both Ceph and NFS limitations before actually designing the > > production cluster. > > > > On Fri, 2 Aug 2024 at 20:46, Rohit Yadav > <mailto:rohit.ya...@shapeblue.com>> wrote: > > > > Except the way you configure Linux bridges, using nmcli, on EL9 more > > or less all steps apply as earlier EL distros. > > > > I've my old notes here - > > > https://gist.github.com/rohityadavcloud/fc401a0fe8e8ea16b4b3a4e3d149ce0c#file-el9-or-rhel9-acs > < > https://gist.github.com/rohityadavcloud/fc401a0fe8e8ea16b4b3a4e3d149ce0c#file-el9-or-rhel9-acs > > > > > > CloudStack-Ceph users have easily used 100-1000s of TB of storage > > (RBD) in production, so that's fine. For NFS you can refer to the > > Ceph-NFS specific limitations (if any). > > > > > > Regards. > > > > > > > > > > > > From: Muhammad Hanis Irfan Mohd Zaid > <mailto:hanisirfan.w...@gmail.com>> > > Sent: Friday, August 2, 2024 07:54 > > To: users@cloudstack.apache.org <mailto:users@cloudstack.apache.org> > > mailto:users@cloudstack.apache.org>> > > Subject: Re: Best steps to deploy a working KVM cluster with RHEL > > > > Oh say we're using Rocky Linux 9 or AlmaLinux 9, is there any > workable > > steps that can be shared that works in production? > > > > We're going to be working mostly with 25G LACP bonded interfaces. > And, > > we're planning to use Ceph RBD for primary and Ceph NFS for secondary > > storage. Does this mean provisioning more than 10 TB for both are > > okay with > > CloudStack? > > > > On Thu, 1 Aug 2024 at 14:50, Rohit Yadav > <mailto:rohit.ya...@shapeblue.com>> wrote: > > > > > Hi Hanis, > > > > > > The docs may be a bit outdated and were originally written in > > scope for > > > XenServer - thanks for sharing that. It appears you're using KVM, > > so you > > > should look at the max-limitations and specific recommendations > > of your KVM > > > distro and NFS vendor. > > > > > > Majority of NFS datastore (both primary & secondary storage > > pools) there > > > days are in the 10s of TB in size/range, with even 100s of TBs > > also seen in > > > production usage. > > > > > > While using NFS, it's equally important to also consider > networking > > > aspects such as switching capacit
Re: Best steps to deploy a working KVM cluster with RHEL
Op 08/08/2024 om 09:53 schreef Rohit Yadav: I think in CloudStack ceph storage pool you'll need to update its capacity if/when you increase the storage capacity after adding it initially. Wido and other Ceph gurus can advise other best practices. Libvirt will automatically detect the increased capacity of a Ceph cluster when you add capacity. There is no limit on how large a pool can be in Ceph and thus CloudStack. You can store multiple PB in a single Ceph pool. No need to split into smaller pools. Wido Regards. *From:* Muhammad Hanis Irfan Mohd Zaid *Sent:* Thursday, August 8, 2024 11:43 *To:* users@cloudstack.apache.org *Cc:* Rohit Yadav *Subject:* Re: Best steps to deploy a working KVM cluster with RHEL The gist that you shared plus your blog really helps me to set up CS on our Rocky Linux servers. It's now running great along with Ceph RBD (the other email) for primary and Ceph NFS for secondary. Thanks Rohit! Getting back to the pool size. Say I configured a Ceph RBD pool with no quota, this means I can expand it indefinitely without the need to split my Ceph storage into multiple pools of 6 TB based on the CS docs (best practice section). I'll look at both Ceph and NFS limitations before actually designing the production cluster. On Fri, 2 Aug 2024 at 20:46, Rohit Yadav <mailto:rohit.ya...@shapeblue.com>> wrote: Except the way you configure Linux bridges, using nmcli, on EL9 more or less all steps apply as earlier EL distros. I've my old notes here - https://gist.github.com/rohityadavcloud/fc401a0fe8e8ea16b4b3a4e3d149ce0c#file-el9-or-rhel9-acs <https://gist.github.com/rohityadavcloud/fc401a0fe8e8ea16b4b3a4e3d149ce0c#file-el9-or-rhel9-acs> CloudStack-Ceph users have easily used 100-1000s of TB of storage (RBD) in production, so that's fine. For NFS you can refer to the Ceph-NFS specific limitations (if any). Regards. From: Muhammad Hanis Irfan Mohd Zaid mailto:hanisirfan.w...@gmail.com>> Sent: Friday, August 2, 2024 07:54 To: users@cloudstack.apache.org <mailto:users@cloudstack.apache.org> mailto:users@cloudstack.apache.org>> Subject: Re: Best steps to deploy a working KVM cluster with RHEL Oh say we're using Rocky Linux 9 or AlmaLinux 9, is there any workable steps that can be shared that works in production? We're going to be working mostly with 25G LACP bonded interfaces. And, we're planning to use Ceph RBD for primary and Ceph NFS for secondary storage. Does this mean provisioning more than 10 TB for both are okay with CloudStack? On Thu, 1 Aug 2024 at 14:50, Rohit Yadav mailto:rohit.ya...@shapeblue.com>> wrote: > Hi Hanis, > > The docs may be a bit outdated and were originally written in scope for > XenServer - thanks for sharing that. It appears you're using KVM, so you > should look at the max-limitations and specific recommendations of your KVM > distro and NFS vendor. > > Majority of NFS datastore (both primary & secondary storage pools) there > days are in the 10s of TB in size/range, with even 100s of TBs also seen in > production usage. > > While using NFS, it's equally important to also consider networking > aspects such as switching capacity in the (KVM) cluster, the switch & > host-nic capabilities such as 1G, 10G, teaming/bond, LACP etc. > > > Regards. > > > > > > From: Muhammad Hanis Irfan Mohd Zaid mailto:hanisirfan.w...@gmail.com>> > Sent: Thursday, August 1, 2024 07:01 > To: users@cloudstack.apache.org <mailto:users@cloudstack.apache.org> mailto:users@cloudstack.apache.org>> > Subject: Re: Best steps to deploy a working KVM cluster with RHEL > > Does anyone have thoughts on this? > > > https://docs.cloudstack.apache.org/en/4.19.1.0/conceptsandterminology/choosing_deployment_architecture.html#best-practices <https://docs.cloudstack.apache.org/en/4.19.1.0/conceptsandterminology/choosing_deployment_architecture.html#best-practices> > > Btw after reading that page, it looks like for primary storage the size > should be < 6 TB. What about secondary storage? Assumes both are using NFS. > > On Wed, 31 Jul 2024 at 16:52, Muhammad Hanis Irfan Mohd Zaid < > hanisirfan.w...@gmail.com <mailto:hanisirfan.w...@gmail.com>> wrote: > > > Hi CloudStack community! > > > > I'm currently testing out a POC with VLA
Re: Best steps to deploy a working KVM cluster with RHEL
I think in CloudStack ceph storage pool you'll need to update its capacity if/when you increase the storage capacity after adding it initially. Wido and other Ceph gurus can advise other best practices. Regards. From: Muhammad Hanis Irfan Mohd Zaid Sent: Thursday, August 8, 2024 11:43 To: users@cloudstack.apache.org Cc: Rohit Yadav Subject: Re: Best steps to deploy a working KVM cluster with RHEL The gist that you shared plus your blog really helps me to set up CS on our Rocky Linux servers. It's now running great along with Ceph RBD (the other email) for primary and Ceph NFS for secondary. Thanks Rohit! Getting back to the pool size. Say I configured a Ceph RBD pool with no quota, this means I can expand it indefinitely without the need to split my Ceph storage into multiple pools of 6 TB based on the CS docs (best practice section). I'll look at both Ceph and NFS limitations before actually designing the production cluster. On Fri, 2 Aug 2024 at 20:46, Rohit Yadav mailto:rohit.ya...@shapeblue.com>> wrote: Except the way you configure Linux bridges, using nmcli, on EL9 more or less all steps apply as earlier EL distros. I've my old notes here - https://gist.github.com/rohityadavcloud/fc401a0fe8e8ea16b4b3a4e3d149ce0c#file-el9-or-rhel9-acs CloudStack-Ceph users have easily used 100-1000s of TB of storage (RBD) in production, so that's fine. For NFS you can refer to the Ceph-NFS specific limitations (if any). Regards. From: Muhammad Hanis Irfan Mohd Zaid mailto:hanisirfan.w...@gmail.com>> Sent: Friday, August 2, 2024 07:54 To: users@cloudstack.apache.org<mailto:users@cloudstack.apache.org> mailto:users@cloudstack.apache.org>> Subject: Re: Best steps to deploy a working KVM cluster with RHEL Oh say we're using Rocky Linux 9 or AlmaLinux 9, is there any workable steps that can be shared that works in production? We're going to be working mostly with 25G LACP bonded interfaces. And, we're planning to use Ceph RBD for primary and Ceph NFS for secondary storage. Does this mean provisioning more than 10 TB for both are okay with CloudStack? On Thu, 1 Aug 2024 at 14:50, Rohit Yadav mailto:rohit.ya...@shapeblue.com>> wrote: > Hi Hanis, > > The docs may be a bit outdated and were originally written in scope for > XenServer - thanks for sharing that. It appears you're using KVM, so you > should look at the max-limitations and specific recommendations of your KVM > distro and NFS vendor. > > Majority of NFS datastore (both primary & secondary storage pools) there > days are in the 10s of TB in size/range, with even 100s of TBs also seen in > production usage. > > While using NFS, it's equally important to also consider networking > aspects such as switching capacity in the (KVM) cluster, the switch & > host-nic capabilities such as 1G, 10G, teaming/bond, LACP etc. > > > Regards. > > > > > > From: Muhammad Hanis Irfan Mohd Zaid > mailto:hanisirfan.w...@gmail.com>> > Sent: Thursday, August 1, 2024 07:01 > To: users@cloudstack.apache.org<mailto:users@cloudstack.apache.org> > mailto:users@cloudstack.apache.org>> > Subject: Re: Best steps to deploy a working KVM cluster with RHEL > > Does anyone have thoughts on this? > > > https://docs.cloudstack.apache.org/en/4.19.1.0/conceptsandterminology/choosing_deployment_architecture.html#best-practices > > Btw after reading that page, it looks like for primary storage the size > should be < 6 TB. What about secondary storage? Assumes both are using NFS. > > On Wed, 31 Jul 2024 at 16:52, Muhammad Hanis Irfan Mohd Zaid < > hanisirfan.w...@gmail.com<mailto:hanisirfan.w...@gmail.com>> wrote: > > > Hi CloudStack community! > > > > I'm currently testing out a POC with VLAN on our current vSphere cluster. > > As someone with a mostly VMware background, setting up each individual > KVM > > host and adding it to the CS management server is a bit of a hard task > for > > me. I've hit a few roadblocks and am hoping the community can assist me > in > > my journey. You can refer to the steps that I took to configure a KVM > node > > here: https://pastebin.com/MpSUq5mF > > > > One of the issues that I'm having is that after the setup that I ran on > > the pastebin, an error occurred which I'm sure should be resolved with > > libvirtd sockets masking, which proved it's not. I've to reboot the host > > while the UI is still adding the host so it can be successfully added. > > > > > > > > > > > > > > > > &g
Re: Best steps to deploy a working KVM cluster with RHEL
The gist that you shared plus your blog really helps me to set up CS on our Rocky Linux servers. It's now running great along with Ceph RBD (the other email) for primary and Ceph NFS for secondary. Thanks Rohit! Getting back to the pool size. Say I configured a Ceph RBD pool with no quota, this means I can expand it indefinitely without the need to split my Ceph storage into multiple pools of 6 TB based on the CS docs (best practice section). I'll look at both Ceph and NFS limitations before actually designing the production cluster. On Fri, 2 Aug 2024 at 20:46, Rohit Yadav wrote: > Except the way you configure Linux bridges, using nmcli, on EL9 more or > less all steps apply as earlier EL distros. > > I've my old notes here - > https://gist.github.com/rohityadavcloud/fc401a0fe8e8ea16b4b3a4e3d149ce0c#file-el9-or-rhel9-acs > > CloudStack-Ceph users have easily used 100-1000s of TB of storage (RBD) in > production, so that's fine. For NFS you can refer to the Ceph-NFS specific > limitations (if any). > > > Regards. > > > > > > From: Muhammad Hanis Irfan Mohd Zaid > Sent: Friday, August 2, 2024 07:54 > To: users@cloudstack.apache.org > Subject: Re: Best steps to deploy a working KVM cluster with RHEL > > Oh say we're using Rocky Linux 9 or AlmaLinux 9, is there any workable > steps that can be shared that works in production? > > We're going to be working mostly with 25G LACP bonded interfaces. And, > we're planning to use Ceph RBD for primary and Ceph NFS for secondary > storage. Does this mean provisioning more than 10 TB for both are okay with > CloudStack? > > On Thu, 1 Aug 2024 at 14:50, Rohit Yadav > wrote: > > > Hi Hanis, > > > > The docs may be a bit outdated and were originally written in scope for > > XenServer - thanks for sharing that. It appears you're using KVM, so you > > should look at the max-limitations and specific recommendations of your > KVM > > distro and NFS vendor. > > > > Majority of NFS datastore (both primary & secondary storage pools) there > > days are in the 10s of TB in size/range, with even 100s of TBs also seen > in > > production usage. > > > > While using NFS, it's equally important to also consider networking > > aspects such as switching capacity in the (KVM) cluster, the switch & > > host-nic capabilities such as 1G, 10G, teaming/bond, LACP etc. > > > > > > Regards. > > > > > > > > > > > > From: Muhammad Hanis Irfan Mohd Zaid > > Sent: Thursday, August 1, 2024 07:01 > > To: users@cloudstack.apache.org > > Subject: Re: Best steps to deploy a working KVM cluster with RHEL > > > > Does anyone have thoughts on this? > > > > > > > https://docs.cloudstack.apache.org/en/4.19.1.0/conceptsandterminology/choosing_deployment_architecture.html#best-practices > > > > Btw after reading that page, it looks like for primary storage the size > > should be < 6 TB. What about secondary storage? Assumes both are using > NFS. > > > > On Wed, 31 Jul 2024 at 16:52, Muhammad Hanis Irfan Mohd Zaid < > > hanisirfan.w...@gmail.com> wrote: > > > > > Hi CloudStack community! > > > > > > I'm currently testing out a POC with VLAN on our current vSphere > cluster. > > > As someone with a mostly VMware background, setting up each individual > > KVM > > > host and adding it to the CS management server is a bit of a hard task > > for > > > me. I've hit a few roadblocks and am hoping the community can assist me > > in > > > my journey. You can refer to the steps that I took to configure a KVM > > node > > > here: https://pastebin.com/MpSUq5mF > > > > > > One of the issues that I'm having is that after the setup that I ran on > > > the pastebin, an error occurred which I'm sure should be resolved with > > > libvirtd sockets masking, which proved it's not. I've to reboot the > host > > > while the UI is still adding the host so it can be successfully added. > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > *2024-07-30 03:56:37,871 INFO [kvm.resource.LibvirtConnection] > > > (main:null) (logid:) No existing libvirtd connection found. Opening a > new > > > one2024-07-30 03:56:38,109 ERROR [cloud.agent.AgentShell] (main:null) > > > (logid:) Unable to start > > > agent:com.cloud.utils.exception.CloudRuntimeExceptio
Re: Join KVM host from CLI using only user and certificate
Using password= or password='' both prompt "failed to authenticate, please check credentials" error with the task being canceled. Regards, Jordan On Tue, Aug 6, 2024 at 7:14 AM Rohit Yadav wrote: > Can you try to pass an empty password to cmk, when calling addHost API. > > For example, see this: > https://github.com/rohityadavcloud/c8k.in/blob/main/install.sh#L289 > > > Regards. > > > > > > From: jordan j > Sent: Tuesday, August 6, 2024 09:18 > To: users@cloudstack.apache.org > Subject: Re: Join KVM host from CLI using only user and certificate > > Forgot to add the error, may be helpful: > > Could not add host at [http://x.x.x.x] with zone[1], pod[1] and cluster > [60] due to: [can't setup agent, due to > com.cloud.utils.exception.CloudRuntimeException: Unable to persist the host > details key: password for host id: 123123 > > Regards, > Jordan > > On Tue, Aug 6, 2024 at 6:38 AM jordan j wrote: > > > Hello Rohit, > > > > Yes, the GUI clearly shows that but I was exploring doing it from the > > command line with Cloudmonkey. > > > > Rodrigo, I did some tests today and it works. However the command reports > > an error state even though the host is joined properly - no error in > agent > > logs, host is visible in CS and it is NOT in unsecure state. > > > > Regards, > > Jordan > > > > On Tue, Aug 6, 2024 at 5:57 AM Rohit Yadav > > wrote: > > > >> Jordan, > >> > >> In 4.18/4.19 the add host form clearly shows passwordless mechanism to > >> add a KVM host. This is done via mgmt server’s ssh public key to be > added > >> to the root user on the kvm host. > >> > >> Regards. > >> > >> Regards. > >> > >> > >> > >> > >> From: jordan j > >> Sent: Monday, August 5, 2024 8:42:46 PM > >> To: users@cloudstack.apache.org > >> Subject: Re: Join KVM host from CLI using only user and certificate > >> > >> Thank you for the advice, I will test tomorrow! > >> > >> Best regards, > >> Jordan > >> > >> On Mon, Aug 5, 2024 at 6:07 PM Alex Dietrich >> .invalid> > >> wrote: > >> > >> > Hi Rodrigo, > >> > > >> > It may be worth updating the CloudStack API documentation as it says > the > >> > password is indeed required for hypervisors other than VMWare. > >> > > >> > “the password for the host; required to be passed for hypervisors > other > >> > than VMWare” - > >> > https://cloudstack.apache.org/api/apidocs-4.19/apis/addHost.html > >> > > >> > > >> > * Alex > >> > > >> > [photo]<http://www.ussignal.com/> > >> > > >> > Alex Dietrich > >> > Senior Network Engineer, US Signal > >> > > >> > 616-233-5094 | www.ussignal.com<<< > http://www.ussignal.com<<> > >> http://www.ussignal.com<> > >> > https://www.ussignal.com> | adietr...@ussignal.com >> > adietr...@ussignal.com> > >> > > >> > 201 Ionia Ave SW, Grand Rapids, MI 49503< > >> > > >> > https://maps.google.com/?q=201%20Ionia%20Ave%20SW,%20Grand%20Rapids,%20MI%2049503 > >> > > > >> > > >> > [linkedin]<https://www.linkedin.com/company/us-signal/> > >> > > >> > [facebook]<https://www.facebook.com/ussignalcom/> > >> > > >> > [youtube]<https://www.youtube.com/channel/UCaFBGFfXmHziWGTFqjGzaWw> > >> > > >> > IMPORTANT: The contents of this email are confidential. Information is > >> > intended for the named recipient(s) only. If you have received this > >> email > >> > by mistake, please notify the sender immediately and do not disclose > the > >> > contents to anyone or make copies thereof. > >> > > >> > [__tpx__] > >> > From: Rodrigo D. Lopez > >> > Date: Monday, August 5, 2024 at 10:58 AM > >> > To: users@cloudstack.apache.org > >> > Subject: Re: Join KVM host from CLI using only user and certificate > >> > EXTERNAL > >> > > >> > Hello, Jordan > >> > > >> > In ACS, it is possible to add a host using a username and a > certificate > >> by > >> > executing the addHost API without specifying the
Re: Join KVM host from CLI using only user and certificate
Can you try to pass an empty password to cmk, when calling addHost API. For example, see this: https://github.com/rohityadavcloud/c8k.in/blob/main/install.sh#L289 Regards. From: jordan j Sent: Tuesday, August 6, 2024 09:18 To: users@cloudstack.apache.org Subject: Re: Join KVM host from CLI using only user and certificate Forgot to add the error, may be helpful: Could not add host at [http://x.x.x.x] with zone[1], pod[1] and cluster [60] due to: [can't setup agent, due to com.cloud.utils.exception.CloudRuntimeException: Unable to persist the host details key: password for host id: 123123 Regards, Jordan On Tue, Aug 6, 2024 at 6:38 AM jordan j wrote: > Hello Rohit, > > Yes, the GUI clearly shows that but I was exploring doing it from the > command line with Cloudmonkey. > > Rodrigo, I did some tests today and it works. However the command reports > an error state even though the host is joined properly - no error in agent > logs, host is visible in CS and it is NOT in unsecure state. > > Regards, > Jordan > > On Tue, Aug 6, 2024 at 5:57 AM Rohit Yadav > wrote: > >> Jordan, >> >> In 4.18/4.19 the add host form clearly shows passwordless mechanism to >> add a KVM host. This is done via mgmt server’s ssh public key to be added >> to the root user on the kvm host. >> >> Regards. >> >> Regards. >> >> >> >> ____ >> From: jordan j >> Sent: Monday, August 5, 2024 8:42:46 PM >> To: users@cloudstack.apache.org >> Subject: Re: Join KVM host from CLI using only user and certificate >> >> Thank you for the advice, I will test tomorrow! >> >> Best regards, >> Jordan >> >> On Mon, Aug 5, 2024 at 6:07 PM Alex Dietrich > .invalid> >> wrote: >> >> > Hi Rodrigo, >> > >> > It may be worth updating the CloudStack API documentation as it says the >> > password is indeed required for hypervisors other than VMWare. >> > >> > “the password for the host; required to be passed for hypervisors other >> > than VMWare” - >> > https://cloudstack.apache.org/api/apidocs-4.19/apis/addHost.html >> > >> > >> > * Alex >> > >> > [photo]<http://www.ussignal.com/> >> > >> > Alex Dietrich >> > Senior Network Engineer, US Signal >> > >> > 616-233-5094 | >> > www.ussignal.com<<<http://www.ussignal.com<<> >> http://www.ussignal.com<> >> > https://www.ussignal.com> | adietr...@ussignal.com> > adietr...@ussignal.com> >> > >> > 201 Ionia Ave SW, Grand Rapids, MI 49503< >> > >> https://maps.google.com/?q=201%20Ionia%20Ave%20SW,%20Grand%20Rapids,%20MI%2049503 >> > > >> > >> > [linkedin]<https://www.linkedin.com/company/us-signal/> >> > >> > [facebook]<https://www.facebook.com/ussignalcom/> >> > >> > [youtube]<https://www.youtube.com/channel/UCaFBGFfXmHziWGTFqjGzaWw> >> > >> > IMPORTANT: The contents of this email are confidential. Information is >> > intended for the named recipient(s) only. If you have received this >> email >> > by mistake, please notify the sender immediately and do not disclose the >> > contents to anyone or make copies thereof. >> > >> > [__tpx__] >> > From: Rodrigo D. Lopez >> > Date: Monday, August 5, 2024 at 10:58 AM >> > To: users@cloudstack.apache.org >> > Subject: Re: Join KVM host from CLI using only user and certificate >> > EXTERNAL >> > >> > Hello, Jordan >> > >> > In ACS, it is possible to add a host using a username and a certificate >> by >> > executing the addHost API without specifying the password attribute. >> This >> > way, CloudStack will attempt to connect to the host using the >> dynamically >> > created certificate available at: /var/lib/cloudstack/management/.ssh/. >> It >> > is necessary to configure the host in advance to accept connections >> using >> > this certificate. >> > >> > Best regards, >> > Rodrigo >> > >> > Em seg., 5 de ago. de 2024 às 11:50, jordan j >> > escreveu: >> > >> > > Hey Alex, >> > > >> > > Yes that is correct, I see the option in the GUI and when used all >> works >> > > but I fail to find the command line alternative. >> > > >> > > Regards, >> > > Jordan >> > &
Re: Join KVM host from CLI using only user and certificate
Forgot to add the error, may be helpful: Could not add host at [http://x.x.x.x] with zone[1], pod[1] and cluster [60] due to: [can't setup agent, due to com.cloud.utils.exception.CloudRuntimeException: Unable to persist the host details key: password for host id: 123123 Regards, Jordan On Tue, Aug 6, 2024 at 6:38 AM jordan j wrote: > Hello Rohit, > > Yes, the GUI clearly shows that but I was exploring doing it from the > command line with Cloudmonkey. > > Rodrigo, I did some tests today and it works. However the command reports > an error state even though the host is joined properly - no error in agent > logs, host is visible in CS and it is NOT in unsecure state. > > Regards, > Jordan > > On Tue, Aug 6, 2024 at 5:57 AM Rohit Yadav > wrote: > >> Jordan, >> >> In 4.18/4.19 the add host form clearly shows passwordless mechanism to >> add a KVM host. This is done via mgmt server’s ssh public key to be added >> to the root user on the kvm host. >> >> Regards. >> >> Regards. >> >> >> >> ____ >> From: jordan j >> Sent: Monday, August 5, 2024 8:42:46 PM >> To: users@cloudstack.apache.org >> Subject: Re: Join KVM host from CLI using only user and certificate >> >> Thank you for the advice, I will test tomorrow! >> >> Best regards, >> Jordan >> >> On Mon, Aug 5, 2024 at 6:07 PM Alex Dietrich > .invalid> >> wrote: >> >> > Hi Rodrigo, >> > >> > It may be worth updating the CloudStack API documentation as it says the >> > password is indeed required for hypervisors other than VMWare. >> > >> > “the password for the host; required to be passed for hypervisors other >> > than VMWare” - >> > https://cloudstack.apache.org/api/apidocs-4.19/apis/addHost.html >> > >> > >> > * Alex >> > >> > [photo]<http://www.ussignal.com/> >> > >> > Alex Dietrich >> > Senior Network Engineer, US Signal >> > >> > 616-233-5094 | www.ussignal.com<< >> http://www.ussignal.com<> >> > https://www.ussignal.com> | adietr...@ussignal.com> > adietr...@ussignal.com> >> > >> > 201 Ionia Ave SW, Grand Rapids, MI 49503< >> > >> https://maps.google.com/?q=201%20Ionia%20Ave%20SW,%20Grand%20Rapids,%20MI%2049503 >> > > >> > >> > [linkedin]<https://www.linkedin.com/company/us-signal/> >> > >> > [facebook]<https://www.facebook.com/ussignalcom/> >> > >> > [youtube]<https://www.youtube.com/channel/UCaFBGFfXmHziWGTFqjGzaWw> >> > >> > IMPORTANT: The contents of this email are confidential. Information is >> > intended for the named recipient(s) only. If you have received this >> email >> > by mistake, please notify the sender immediately and do not disclose the >> > contents to anyone or make copies thereof. >> > >> > [__tpx__] >> > From: Rodrigo D. Lopez >> > Date: Monday, August 5, 2024 at 10:58 AM >> > To: users@cloudstack.apache.org >> > Subject: Re: Join KVM host from CLI using only user and certificate >> > EXTERNAL >> > >> > Hello, Jordan >> > >> > In ACS, it is possible to add a host using a username and a certificate >> by >> > executing the addHost API without specifying the password attribute. >> This >> > way, CloudStack will attempt to connect to the host using the >> dynamically >> > created certificate available at: /var/lib/cloudstack/management/.ssh/. >> It >> > is necessary to configure the host in advance to accept connections >> using >> > this certificate. >> > >> > Best regards, >> > Rodrigo >> > >> > Em seg., 5 de ago. de 2024 às 11:50, jordan j >> > escreveu: >> > >> > > Hey Alex, >> > > >> > > Yes that is correct, I see the option in the GUI and when used all >> works >> > > but I fail to find the command line alternative. >> > > >> > > Regards, >> > > Jordan >> > > >> > > On Mon, Aug 5, 2024 at 5:37 PM Alex Dietrich > > > .invalid> >> > > wrote: >> > > >> > > > Rohit, >> > > > >> > > > I think Jordan is referring to the KVM Host add process. Per the API >> > > > documentation for addHost, it requires username and password and >> does >> > not >>
Re: Join KVM host from CLI using only user and certificate
Hello Rohit, Yes, the GUI clearly shows that but I was exploring doing it from the command line with Cloudmonkey. Rodrigo, I did some tests today and it works. However the command reports an error state even though the host is joined properly - no error in agent logs, host is visible in CS and it is NOT in unsecure state. Regards, Jordan On Tue, Aug 6, 2024 at 5:57 AM Rohit Yadav wrote: > Jordan, > > In 4.18/4.19 the add host form clearly shows passwordless mechanism to add > a KVM host. This is done via mgmt server’s ssh public key to be added to > the root user on the kvm host. > > Regards. > > Regards. > > > > > From: jordan j > Sent: Monday, August 5, 2024 8:42:46 PM > To: users@cloudstack.apache.org > Subject: Re: Join KVM host from CLI using only user and certificate > > Thank you for the advice, I will test tomorrow! > > Best regards, > Jordan > > On Mon, Aug 5, 2024 at 6:07 PM Alex Dietrich .invalid> > wrote: > > > Hi Rodrigo, > > > > It may be worth updating the CloudStack API documentation as it says the > > password is indeed required for hypervisors other than VMWare. > > > > “the password for the host; required to be passed for hypervisors other > > than VMWare” - > > https://cloudstack.apache.org/api/apidocs-4.19/apis/addHost.html > > > > > > * Alex > > > > [photo]<http://www.ussignal.com/> > > > > Alex Dietrich > > Senior Network Engineer, US Signal > > > > 616-233-5094 | www.ussignal.com<< > http://www.ussignal.com<> > > https://www.ussignal.com> | adietr...@ussignal.com > adietr...@ussignal.com> > > > > 201 Ionia Ave SW, Grand Rapids, MI 49503< > > > https://maps.google.com/?q=201%20Ionia%20Ave%20SW,%20Grand%20Rapids,%20MI%2049503 > > > > > > > [linkedin]<https://www.linkedin.com/company/us-signal/> > > > > [facebook]<https://www.facebook.com/ussignalcom/> > > > > [youtube]<https://www.youtube.com/channel/UCaFBGFfXmHziWGTFqjGzaWw> > > > > IMPORTANT: The contents of this email are confidential. Information is > > intended for the named recipient(s) only. If you have received this email > > by mistake, please notify the sender immediately and do not disclose the > > contents to anyone or make copies thereof. > > > > [__tpx__] > > From: Rodrigo D. Lopez > > Date: Monday, August 5, 2024 at 10:58 AM > > To: users@cloudstack.apache.org > > Subject: Re: Join KVM host from CLI using only user and certificate > > EXTERNAL > > > > Hello, Jordan > > > > In ACS, it is possible to add a host using a username and a certificate > by > > executing the addHost API without specifying the password attribute. This > > way, CloudStack will attempt to connect to the host using the dynamically > > created certificate available at: /var/lib/cloudstack/management/.ssh/. > It > > is necessary to configure the host in advance to accept connections using > > this certificate. > > > > Best regards, > > Rodrigo > > > > Em seg., 5 de ago. de 2024 às 11:50, jordan j > > escreveu: > > > > > Hey Alex, > > > > > > Yes that is correct, I see the option in the GUI and when used all > works > > > but I fail to find the command line alternative. > > > > > > Regards, > > > Jordan > > > > > > On Mon, Aug 5, 2024 at 5:37 PM Alex Dietrich > > .invalid> > > > wrote: > > > > > > > Rohit, > > > > > > > > I think Jordan is referring to the KVM Host add process. Per the API > > > > documentation for addHost, it requires username and password and does > > not > > > > appear to support using SSH keys. > > > > > > > > Am I correct in my understanding of your question Jordan? > > > > > > > > Thanks, > > > > Alex > > > > > > > > [photo]<http://www.ussignal.com/> > > > > > > > > Alex Dietrich > > > > Senior Network Engineer, US Signal > > > > > > > > 616-233-5094 | http://www.ussignal.com<< > > http://www.ussignal.com%3c> > > > > https://www.ussignal.com><https://www.ussignal.com%3e> | > > adietr...@ussignal.com > > > adietr...@ussignal.com> > > > > > > > > 201 Ionia Ave SW, Grand Rapids, MI 49503< > > > > > > > > > > https://urldefense.com/v3/__https://maps.google.com/?q=201*
Re: Join KVM host from CLI using only user and certificate
Jordan, In 4.18/4.19 the add host form clearly shows passwordless mechanism to add a KVM host. This is done via mgmt server’s ssh public key to be added to the root user on the kvm host. Regards. Regards. From: jordan j Sent: Monday, August 5, 2024 8:42:46 PM To: users@cloudstack.apache.org Subject: Re: Join KVM host from CLI using only user and certificate Thank you for the advice, I will test tomorrow! Best regards, Jordan On Mon, Aug 5, 2024 at 6:07 PM Alex Dietrich wrote: > Hi Rodrigo, > > It may be worth updating the CloudStack API documentation as it says the > password is indeed required for hypervisors other than VMWare. > > “the password for the host; required to be passed for hypervisors other > than VMWare” - > https://cloudstack.apache.org/api/apidocs-4.19/apis/addHost.html > > > * Alex > > [photo]<http://www.ussignal.com/> > > Alex Dietrich > Senior Network Engineer, US Signal > > 616-233-5094 | www.ussignal.com<<http://www.ussignal.com<> > https://www.ussignal.com> | adietr...@ussignal.com adietr...@ussignal.com> > > 201 Ionia Ave SW, Grand Rapids, MI 49503< > https://maps.google.com/?q=201%20Ionia%20Ave%20SW,%20Grand%20Rapids,%20MI%2049503 > > > > [linkedin]<https://www.linkedin.com/company/us-signal/> > > [facebook]<https://www.facebook.com/ussignalcom/> > > [youtube]<https://www.youtube.com/channel/UCaFBGFfXmHziWGTFqjGzaWw> > > IMPORTANT: The contents of this email are confidential. Information is > intended for the named recipient(s) only. If you have received this email > by mistake, please notify the sender immediately and do not disclose the > contents to anyone or make copies thereof. > > [__tpx__] > From: Rodrigo D. Lopez > Date: Monday, August 5, 2024 at 10:58 AM > To: users@cloudstack.apache.org > Subject: Re: Join KVM host from CLI using only user and certificate > EXTERNAL > > Hello, Jordan > > In ACS, it is possible to add a host using a username and a certificate by > executing the addHost API without specifying the password attribute. This > way, CloudStack will attempt to connect to the host using the dynamically > created certificate available at: /var/lib/cloudstack/management/.ssh/. It > is necessary to configure the host in advance to accept connections using > this certificate. > > Best regards, > Rodrigo > > Em seg., 5 de ago. de 2024 às 11:50, jordan j > escreveu: > > > Hey Alex, > > > > Yes that is correct, I see the option in the GUI and when used all works > > but I fail to find the command line alternative. > > > > Regards, > > Jordan > > > > On Mon, Aug 5, 2024 at 5:37 PM Alex Dietrich > .invalid> > > wrote: > > > > > Rohit, > > > > > > I think Jordan is referring to the KVM Host add process. Per the API > > > documentation for addHost, it requires username and password and does > not > > > appear to support using SSH keys. > > > > > > Am I correct in my understanding of your question Jordan? > > > > > > Thanks, > > > Alex > > > > > > [photo]<http://www.ussignal.com/> > > > > > > Alex Dietrich > > > Senior Network Engineer, US Signal > > > > > > 616-233-5094 | http://www.ussignal.com<< > http://www.ussignal.com%3c> > > > https://www.ussignal.com><https://www.ussignal.com%3e> | > adietr...@ussignal.com > > adietr...@ussignal.com> > > > > > > 201 Ionia Ave SW, Grand Rapids, MI 49503< > > > > > > https://urldefense.com/v3/__https://maps.google.com/?q=201*20Ionia*20Ave*20SW,*20Grand*20Rapids,*20MI*2049503__;JSUlJSUlJQ!!P9cq_d3Gyw!jOl0naQokNmcX3wCSYLQVNGsgtqdAQx5xlYUOMDsn1h2OAEyrTYxJTUaGfGAH1GuD4Cnb4oFX7S-_bjoOUzla3sD1rI$ > < > https://urldefense.com/v3/__https:/maps.google.com/?q=201*20Ionia*20Ave*20SW,*20Grand*20Rapids,*20MI*2049503__;JSUlJSUlJQ!!P9cq_d3Gyw!jOl0naQokNmcX3wCSYLQVNGsgtqdAQx5xlYUOMDsn1h2OAEyrTYxJTUaGfGAH1GuD4Cnb4oFX7S-_bjoOUzla3sD1rI$ > > > > > > > > > > > > [linkedin]< > https://urldefense.com/v3/__https://www.linkedin.com/company/us-signal/__;!!P9cq_d3Gyw!jOl0naQokNmcX3wCSYLQVNGsgtqdAQx5xlYUOMDsn1h2OAEyrTYxJTUaGfGAH1GuD4Cnb4oFX7S-_bjoOUzlhzOH-1Q$ > > > > > > > > [facebook]< > https://urldefense.com/v3/__https://www.facebook.com/ussignalcom/__;!!P9cq_d3Gyw!jOl0naQokNmcX3wCSYLQVNGsgtqdAQx5xlYUOMDsn1h2OAEyrTYxJTUaGfGAH1GuD4Cnb4oFX7S-_bjoOUzl5C1FKKM$ > > > > > > > > [youtube]< > https://urldefense.com/v3/__https://www.youtube.com/channel/UCaFBGFf
Re: Join KVM host from CLI using only user and certificate
Thank you for the advice, I will test tomorrow! Best regards, Jordan On Mon, Aug 5, 2024 at 6:07 PM Alex Dietrich wrote: > Hi Rodrigo, > > It may be worth updating the CloudStack API documentation as it says the > password is indeed required for hypervisors other than VMWare. > > “the password for the host; required to be passed for hypervisors other > than VMWare” - > https://cloudstack.apache.org/api/apidocs-4.19/apis/addHost.html > > > * Alex > > [photo]<http://www.ussignal.com/> > > Alex Dietrich > Senior Network Engineer, US Signal > > 616-233-5094 | www.ussignal.com< > https://www.ussignal.com> | adietr...@ussignal.com adietr...@ussignal.com> > > 201 Ionia Ave SW, Grand Rapids, MI 49503< > https://maps.google.com/?q=201%20Ionia%20Ave%20SW,%20Grand%20Rapids,%20MI%2049503 > > > > [linkedin]<https://www.linkedin.com/company/us-signal/> > > [facebook]<https://www.facebook.com/ussignalcom/> > > [youtube]<https://www.youtube.com/channel/UCaFBGFfXmHziWGTFqjGzaWw> > > IMPORTANT: The contents of this email are confidential. Information is > intended for the named recipient(s) only. If you have received this email > by mistake, please notify the sender immediately and do not disclose the > contents to anyone or make copies thereof. > > [__tpx__] > From: Rodrigo D. Lopez > Date: Monday, August 5, 2024 at 10:58 AM > To: users@cloudstack.apache.org > Subject: Re: Join KVM host from CLI using only user and certificate > EXTERNAL > > Hello, Jordan > > In ACS, it is possible to add a host using a username and a certificate by > executing the addHost API without specifying the password attribute. This > way, CloudStack will attempt to connect to the host using the dynamically > created certificate available at: /var/lib/cloudstack/management/.ssh/. It > is necessary to configure the host in advance to accept connections using > this certificate. > > Best regards, > Rodrigo > > Em seg., 5 de ago. de 2024 às 11:50, jordan j > escreveu: > > > Hey Alex, > > > > Yes that is correct, I see the option in the GUI and when used all works > > but I fail to find the command line alternative. > > > > Regards, > > Jordan > > > > On Mon, Aug 5, 2024 at 5:37 PM Alex Dietrich > .invalid> > > wrote: > > > > > Rohit, > > > > > > I think Jordan is referring to the KVM Host add process. Per the API > > > documentation for addHost, it requires username and password and does > not > > > appear to support using SSH keys. > > > > > > Am I correct in my understanding of your question Jordan? > > > > > > Thanks, > > > Alex > > > > > > [photo]<http://www.ussignal.com/> > > > > > > Alex Dietrich > > > Senior Network Engineer, US Signal > > > > > > 616-233-5094 | http://www.ussignal.com<< > http://www.ussignal.com%3c> > > > https://www.ussignal.com><https://www.ussignal.com%3e> | > adietr...@ussignal.com > > adietr...@ussignal.com> > > > > > > 201 Ionia Ave SW, Grand Rapids, MI 49503< > > > > > > https://urldefense.com/v3/__https://maps.google.com/?q=201*20Ionia*20Ave*20SW,*20Grand*20Rapids,*20MI*2049503__;JSUlJSUlJQ!!P9cq_d3Gyw!jOl0naQokNmcX3wCSYLQVNGsgtqdAQx5xlYUOMDsn1h2OAEyrTYxJTUaGfGAH1GuD4Cnb4oFX7S-_bjoOUzla3sD1rI$ > < > https://urldefense.com/v3/__https:/maps.google.com/?q=201*20Ionia*20Ave*20SW,*20Grand*20Rapids,*20MI*2049503__;JSUlJSUlJQ!!P9cq_d3Gyw!jOl0naQokNmcX3wCSYLQVNGsgtqdAQx5xlYUOMDsn1h2OAEyrTYxJTUaGfGAH1GuD4Cnb4oFX7S-_bjoOUzla3sD1rI$ > > > > > > > > > > > > [linkedin]< > https://urldefense.com/v3/__https://www.linkedin.com/company/us-signal/__;!!P9cq_d3Gyw!jOl0naQokNmcX3wCSYLQVNGsgtqdAQx5xlYUOMDsn1h2OAEyrTYxJTUaGfGAH1GuD4Cnb4oFX7S-_bjoOUzlhzOH-1Q$ > > > > > > > > [facebook]< > https://urldefense.com/v3/__https://www.facebook.com/ussignalcom/__;!!P9cq_d3Gyw!jOl0naQokNmcX3wCSYLQVNGsgtqdAQx5xlYUOMDsn1h2OAEyrTYxJTUaGfGAH1GuD4Cnb4oFX7S-_bjoOUzl5C1FKKM$ > > > > > > > > [youtube]< > https://urldefense.com/v3/__https://www.youtube.com/channel/UCaFBGFfXmHziWGTFqjGzaWw__;!!P9cq_d3Gyw!jOl0naQokNmcX3wCSYLQVNGsgtqdAQx5xlYUOMDsn1h2OAEyrTYxJTUaGfGAH1GuD4Cnb4oFX7S-_bjoOUzlrl2jX4U$ > > > > > > > > IMPORTANT: The contents of this email are confidential. Information is > > > intended for the named recipient(s) only. If you have received this > email > > > by mistake, please notify the sender immediately and do not disclose > the > > > contents t
Re: Join KVM host from CLI using only user and certificate
Hi Rodrigo, It may be worth updating the CloudStack API documentation as it says the password is indeed required for hypervisors other than VMWare. “the password for the host; required to be passed for hypervisors other than VMWare” - https://cloudstack.apache.org/api/apidocs-4.19/apis/addHost.html * Alex [photo]<http://www.ussignal.com/> Alex Dietrich Senior Network Engineer, US Signal 616-233-5094 | www.ussignal.com<https://www.ussignal.com> | adietr...@ussignal.com<mailto:adietr...@ussignal.com> 201 Ionia Ave SW, Grand Rapids, MI 49503<https://maps.google.com/?q=201%20Ionia%20Ave%20SW,%20Grand%20Rapids,%20MI%2049503> [linkedin]<https://www.linkedin.com/company/us-signal/> [facebook]<https://www.facebook.com/ussignalcom/> [youtube]<https://www.youtube.com/channel/UCaFBGFfXmHziWGTFqjGzaWw> IMPORTANT: The contents of this email are confidential. Information is intended for the named recipient(s) only. If you have received this email by mistake, please notify the sender immediately and do not disclose the contents to anyone or make copies thereof. [__tpx__] From: Rodrigo D. Lopez Date: Monday, August 5, 2024 at 10:58 AM To: users@cloudstack.apache.org Subject: Re: Join KVM host from CLI using only user and certificate EXTERNAL Hello, Jordan In ACS, it is possible to add a host using a username and a certificate by executing the addHost API without specifying the password attribute. This way, CloudStack will attempt to connect to the host using the dynamically created certificate available at: /var/lib/cloudstack/management/.ssh/. It is necessary to configure the host in advance to accept connections using this certificate. Best regards, Rodrigo Em seg., 5 de ago. de 2024 às 11:50, jordan j escreveu: > Hey Alex, > > Yes that is correct, I see the option in the GUI and when used all works > but I fail to find the command line alternative. > > Regards, > Jordan > > On Mon, Aug 5, 2024 at 5:37 PM Alex Dietrich .invalid> > wrote: > > > Rohit, > > > > I think Jordan is referring to the KVM Host add process. Per the API > > documentation for addHost, it requires username and password and does not > > appear to support using SSH keys. > > > > Am I correct in my understanding of your question Jordan? > > > > Thanks, > > Alex > > > > [photo]<http://www.ussignal.com/> > > > > Alex Dietrich > > Senior Network Engineer, US Signal > > > > 616-233-5094 | > > http://www.ussignal.com<<http://www.ussignal.com%3c> > > https://www.ussignal.com><https://www.ussignal.com%3e> | > > adietr...@ussignal.com > adietr...@ussignal.com> > > > > 201 Ionia Ave SW, Grand Rapids, MI 49503< > > > https://urldefense.com/v3/__https://maps.google.com/?q=201*20Ionia*20Ave*20SW,*20Grand*20Rapids,*20MI*2049503__;JSUlJSUlJQ!!P9cq_d3Gyw!jOl0naQokNmcX3wCSYLQVNGsgtqdAQx5xlYUOMDsn1h2OAEyrTYxJTUaGfGAH1GuD4Cnb4oFX7S-_bjoOUzla3sD1rI$<https://urldefense.com/v3/__https:/maps.google.com/?q=201*20Ionia*20Ave*20SW,*20Grand*20Rapids,*20MI*2049503__;JSUlJSUlJQ!!P9cq_d3Gyw!jOl0naQokNmcX3wCSYLQVNGsgtqdAQx5xlYUOMDsn1h2OAEyrTYxJTUaGfGAH1GuD4Cnb4oFX7S-_bjoOUzla3sD1rI$> > > > > > > > [linkedin]<https://urldefense.com/v3/__https://www.linkedin.com/company/us-signal/__;!!P9cq_d3Gyw!jOl0naQokNmcX3wCSYLQVNGsgtqdAQx5xlYUOMDsn1h2OAEyrTYxJTUaGfGAH1GuD4Cnb4oFX7S-_bjoOUzlhzOH-1Q$ > > > > > > > [facebook]<https://urldefense.com/v3/__https://www.facebook.com/ussignalcom/__;!!P9cq_d3Gyw!jOl0naQokNmcX3wCSYLQVNGsgtqdAQx5xlYUOMDsn1h2OAEyrTYxJTUaGfGAH1GuD4Cnb4oFX7S-_bjoOUzl5C1FKKM$ > > > > > > > [youtube]<https://urldefense.com/v3/__https://www.youtube.com/channel/UCaFBGFfXmHziWGTFqjGzaWw__;!!P9cq_d3Gyw!jOl0naQokNmcX3wCSYLQVNGsgtqdAQx5xlYUOMDsn1h2OAEyrTYxJTUaGfGAH1GuD4Cnb4oFX7S-_bjoOUzlrl2jX4U$ > > > > > > > IMPORTANT: The contents of this email are confidential. Information is > > intended for the named recipient(s) only. If you have received this email > > by mistake, please notify the sender immediately and do not disclose the > > contents to anyone or make copies thereof. > > > > [__tpx__] > > From: Rohit Yadav > > Date: Monday, August 5, 2024 at 10:34 AM > > To: users@cloudstack.apache.org > > Subject: Re: Join KVM host from CLI using only user and certificate > > EXTERNAL > > > > Hi Jordan, > > > > For the CLI (cmk), we support either username-password based > > authentication or API-secret key based authentication. > > > > Certificate-based (mtls) authentication feature is unavailable. > > > > > > Regards. > > > > > > > > > > > > From: jordan j > > Sent: Monday, August 5, 2024 19:42 > > To: users@cloudstack.apache.org > > Subject: Join KVM host from CLI using only user and certificate > > > > Hello everyone, > > > > I was exploring the host section of the CMK API reference but could not > > find a way to add a host (KVM one) to Cloudstack using user + certificate > > instead of user + password. Is such feature available? > > > > Best regards, > > Jordan > > >
Re: Join KVM host from CLI using only user and certificate
Hello, Jordan In ACS, it is possible to add a host using a username and a certificate by executing the addHost API without specifying the password attribute. This way, CloudStack will attempt to connect to the host using the dynamically created certificate available at: /var/lib/cloudstack/management/.ssh/. It is necessary to configure the host in advance to accept connections using this certificate. Best regards, Rodrigo Em seg., 5 de ago. de 2024 às 11:50, jordan j escreveu: > Hey Alex, > > Yes that is correct, I see the option in the GUI and when used all works > but I fail to find the command line alternative. > > Regards, > Jordan > > On Mon, Aug 5, 2024 at 5:37 PM Alex Dietrich .invalid> > wrote: > > > Rohit, > > > > I think Jordan is referring to the KVM Host add process. Per the API > > documentation for addHost, it requires username and password and does not > > appear to support using SSH keys. > > > > Am I correct in my understanding of your question Jordan? > > > > Thanks, > > Alex > > > > [photo]<http://www.ussignal.com/> > > > > Alex Dietrich > > Senior Network Engineer, US Signal > > > > 616-233-5094 | www.ussignal.com< > > https://www.ussignal.com> | adietr...@ussignal.com > adietr...@ussignal.com> > > > > 201 Ionia Ave SW, Grand Rapids, MI 49503< > > > https://maps.google.com/?q=201%20Ionia%20Ave%20SW,%20Grand%20Rapids,%20MI%2049503 > > > > > > > [linkedin]<https://www.linkedin.com/company/us-signal/> > > > > [facebook]<https://www.facebook.com/ussignalcom/> > > > > [youtube]<https://www.youtube.com/channel/UCaFBGFfXmHziWGTFqjGzaWw> > > > > IMPORTANT: The contents of this email are confidential. Information is > > intended for the named recipient(s) only. If you have received this email > > by mistake, please notify the sender immediately and do not disclose the > > contents to anyone or make copies thereof. > > > > [__tpx__] > > From: Rohit Yadav > > Date: Monday, August 5, 2024 at 10:34 AM > > To: users@cloudstack.apache.org > > Subject: Re: Join KVM host from CLI using only user and certificate > > EXTERNAL > > > > Hi Jordan, > > > > For the CLI (cmk), we support either username-password based > > authentication or API-secret key based authentication. > > > > Certificate-based (mtls) authentication feature is unavailable. > > > > > > Regards. > > > > > > > > > > > > From: jordan j > > Sent: Monday, August 5, 2024 19:42 > > To: users@cloudstack.apache.org > > Subject: Join KVM host from CLI using only user and certificate > > > > Hello everyone, > > > > I was exploring the host section of the CMK API reference but could not > > find a way to add a host (KVM one) to Cloudstack using user + certificate > > instead of user + password. Is such feature available? > > > > Best regards, > > Jordan > > >
Re: Join KVM host from CLI using only user and certificate
Hey Alex, Yes that is correct, I see the option in the GUI and when used all works but I fail to find the command line alternative. Regards, Jordan On Mon, Aug 5, 2024 at 5:37 PM Alex Dietrich wrote: > Rohit, > > I think Jordan is referring to the KVM Host add process. Per the API > documentation for addHost, it requires username and password and does not > appear to support using SSH keys. > > Am I correct in my understanding of your question Jordan? > > Thanks, > Alex > > [photo]<http://www.ussignal.com/> > > Alex Dietrich > Senior Network Engineer, US Signal > > 616-233-5094 | www.ussignal.com< > https://www.ussignal.com> | adietr...@ussignal.com adietr...@ussignal.com> > > 201 Ionia Ave SW, Grand Rapids, MI 49503< > https://maps.google.com/?q=201%20Ionia%20Ave%20SW,%20Grand%20Rapids,%20MI%2049503 > > > > [linkedin]<https://www.linkedin.com/company/us-signal/> > > [facebook]<https://www.facebook.com/ussignalcom/> > > [youtube]<https://www.youtube.com/channel/UCaFBGFfXmHziWGTFqjGzaWw> > > IMPORTANT: The contents of this email are confidential. Information is > intended for the named recipient(s) only. If you have received this email > by mistake, please notify the sender immediately and do not disclose the > contents to anyone or make copies thereof. > > [__tpx__] > From: Rohit Yadav > Date: Monday, August 5, 2024 at 10:34 AM > To: users@cloudstack.apache.org > Subject: Re: Join KVM host from CLI using only user and certificate > EXTERNAL > > Hi Jordan, > > For the CLI (cmk), we support either username-password based > authentication or API-secret key based authentication. > > Certificate-based (mtls) authentication feature is unavailable. > > > Regards. > > > > > > From: jordan j > Sent: Monday, August 5, 2024 19:42 > To: users@cloudstack.apache.org > Subject: Join KVM host from CLI using only user and certificate > > Hello everyone, > > I was exploring the host section of the CMK API reference but could not > find a way to add a host (KVM one) to Cloudstack using user + certificate > instead of user + password. Is such feature available? > > Best regards, > Jordan >
Re: Join KVM host from CLI using only user and certificate
Rohit, I think Jordan is referring to the KVM Host add process. Per the API documentation for addHost, it requires username and password and does not appear to support using SSH keys. Am I correct in my understanding of your question Jordan? Thanks, Alex [photo]<http://www.ussignal.com/> Alex Dietrich Senior Network Engineer, US Signal 616-233-5094 | www.ussignal.com<https://www.ussignal.com> | adietr...@ussignal.com<mailto:adietr...@ussignal.com> 201 Ionia Ave SW, Grand Rapids, MI 49503<https://maps.google.com/?q=201%20Ionia%20Ave%20SW,%20Grand%20Rapids,%20MI%2049503> [linkedin]<https://www.linkedin.com/company/us-signal/> [facebook]<https://www.facebook.com/ussignalcom/> [youtube]<https://www.youtube.com/channel/UCaFBGFfXmHziWGTFqjGzaWw> IMPORTANT: The contents of this email are confidential. Information is intended for the named recipient(s) only. If you have received this email by mistake, please notify the sender immediately and do not disclose the contents to anyone or make copies thereof. [__tpx__] From: Rohit Yadav Date: Monday, August 5, 2024 at 10:34 AM To: users@cloudstack.apache.org Subject: Re: Join KVM host from CLI using only user and certificate EXTERNAL Hi Jordan, For the CLI (cmk), we support either username-password based authentication or API-secret key based authentication. Certificate-based (mtls) authentication feature is unavailable. Regards. From: jordan j Sent: Monday, August 5, 2024 19:42 To: users@cloudstack.apache.org Subject: Join KVM host from CLI using only user and certificate Hello everyone, I was exploring the host section of the CMK API reference but could not find a way to add a host (KVM one) to Cloudstack using user + certificate instead of user + password. Is such feature available? Best regards, Jordan
Re: Join KVM host from CLI using only user and certificate
Hi Jordan, For the CLI (cmk), we support either username-password based authentication or API-secret key based authentication. Certificate-based (mtls) authentication feature is unavailable. Regards. From: jordan j Sent: Monday, August 5, 2024 19:42 To: users@cloudstack.apache.org Subject: Join KVM host from CLI using only user and certificate Hello everyone, I was exploring the host section of the CMK API reference but could not find a way to add a host (KVM one) to Cloudstack using user + certificate instead of user + password. Is such feature available? Best regards, Jordan
Join KVM host from CLI using only user and certificate
Hello everyone, I was exploring the host section of the CMK API reference but could not find a way to add a host (KVM one) to Cloudstack using user + certificate instead of user + password. Is such feature available? Best regards, Jordan
Re: Best steps to deploy a working KVM cluster with RHEL
Except the way you configure Linux bridges, using nmcli, on EL9 more or less all steps apply as earlier EL distros. I've my old notes here - https://gist.github.com/rohityadavcloud/fc401a0fe8e8ea16b4b3a4e3d149ce0c#file-el9-or-rhel9-acs CloudStack-Ceph users have easily used 100-1000s of TB of storage (RBD) in production, so that's fine. For NFS you can refer to the Ceph-NFS specific limitations (if any). Regards. From: Muhammad Hanis Irfan Mohd Zaid Sent: Friday, August 2, 2024 07:54 To: users@cloudstack.apache.org Subject: Re: Best steps to deploy a working KVM cluster with RHEL Oh say we're using Rocky Linux 9 or AlmaLinux 9, is there any workable steps that can be shared that works in production? We're going to be working mostly with 25G LACP bonded interfaces. And, we're planning to use Ceph RBD for primary and Ceph NFS for secondary storage. Does this mean provisioning more than 10 TB for both are okay with CloudStack? On Thu, 1 Aug 2024 at 14:50, Rohit Yadav wrote: > Hi Hanis, > > The docs may be a bit outdated and were originally written in scope for > XenServer - thanks for sharing that. It appears you're using KVM, so you > should look at the max-limitations and specific recommendations of your KVM > distro and NFS vendor. > > Majority of NFS datastore (both primary & secondary storage pools) there > days are in the 10s of TB in size/range, with even 100s of TBs also seen in > production usage. > > While using NFS, it's equally important to also consider networking > aspects such as switching capacity in the (KVM) cluster, the switch & > host-nic capabilities such as 1G, 10G, teaming/bond, LACP etc. > > > Regards. > > > > > > From: Muhammad Hanis Irfan Mohd Zaid > Sent: Thursday, August 1, 2024 07:01 > To: users@cloudstack.apache.org > Subject: Re: Best steps to deploy a working KVM cluster with RHEL > > Does anyone have thoughts on this? > > > https://docs.cloudstack.apache.org/en/4.19.1.0/conceptsandterminology/choosing_deployment_architecture.html#best-practices > > Btw after reading that page, it looks like for primary storage the size > should be < 6 TB. What about secondary storage? Assumes both are using NFS. > > On Wed, 31 Jul 2024 at 16:52, Muhammad Hanis Irfan Mohd Zaid < > hanisirfan.w...@gmail.com> wrote: > > > Hi CloudStack community! > > > > I'm currently testing out a POC with VLAN on our current vSphere cluster. > > As someone with a mostly VMware background, setting up each individual > KVM > > host and adding it to the CS management server is a bit of a hard task > for > > me. I've hit a few roadblocks and am hoping the community can assist me > in > > my journey. You can refer to the steps that I took to configure a KVM > node > > here: https://pastebin.com/MpSUq5mF > > > > One of the issues that I'm having is that after the setup that I ran on > > the pastebin, an error occurred which I'm sure should be resolved with > > libvirtd sockets masking, which proved it's not. I've to reboot the host > > while the UI is still adding the host so it can be successfully added. > > > > > > > > > > > > > > > > > > > > > > *2024-07-30 03:56:37,871 INFO [kvm.resource.LibvirtConnection] > > (main:null) (logid:) No existing libvirtd connection found. Opening a new > > one2024-07-30 03:56:38,109 ERROR [cloud.agent.AgentShell] (main:null) > > (logid:) Unable to start > > agent:com.cloud.utils.exception.CloudRuntimeException: Failed to connect > > socket to '/var/run/libvirt/virtqemud-sock': Connection refusedat > > > com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.configure(LibvirtComputingResource.java:1153) > > at com.cloud.agent.Agent.(Agent.java:193)at > > com.cloud.agent.AgentShell.launchNewAgent(AgentShell.java:452)at > > com.cloud.agent.AgentShell.launchAgentFromClassInfo(AgentShell.java:431) > > at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:415) > > at com.cloud.agent.AgentShell.start(AgentShell.java:511)at > > com.cloud.agent.AgentShell.main(AgentShell.java:541)* > > > > Another issue that I'm having is that VNC doesn't work the first time. > > I've to do these steps to get VNC working for newly added hosts: > > > >- Need to migrate a VM to a newly added host. > >- Try to use VNC (doesn't work). > >- Migrate it back out. > >- Reboot the new host. > >- Migrate the VM back into the new host. > >- Try to use VNC (now it works). > > > > > > I humbly request, is there anyone that can share any steps that I can > > follow to deploy a POC or even production capable cluster for KVM running > > on RHEL-based OS or even Ubuntu. Thanks :) > > > > > > >
Re: Best steps to deploy a working KVM cluster with RHEL
Oh say we're using Rocky Linux 9 or AlmaLinux 9, is there any workable steps that can be shared that works in production? We're going to be working mostly with 25G LACP bonded interfaces. And, we're planning to use Ceph RBD for primary and Ceph NFS for secondary storage. Does this mean provisioning more than 10 TB for both are okay with CloudStack? On Thu, 1 Aug 2024 at 14:50, Rohit Yadav wrote: > Hi Hanis, > > The docs may be a bit outdated and were originally written in scope for > XenServer - thanks for sharing that. It appears you're using KVM, so you > should look at the max-limitations and specific recommendations of your KVM > distro and NFS vendor. > > Majority of NFS datastore (both primary & secondary storage pools) there > days are in the 10s of TB in size/range, with even 100s of TBs also seen in > production usage. > > While using NFS, it's equally important to also consider networking > aspects such as switching capacity in the (KVM) cluster, the switch & > host-nic capabilities such as 1G, 10G, teaming/bond, LACP etc. > > > Regards. > > > > > > From: Muhammad Hanis Irfan Mohd Zaid > Sent: Thursday, August 1, 2024 07:01 > To: users@cloudstack.apache.org > Subject: Re: Best steps to deploy a working KVM cluster with RHEL > > Does anyone have thoughts on this? > > > https://docs.cloudstack.apache.org/en/4.19.1.0/conceptsandterminology/choosing_deployment_architecture.html#best-practices > > Btw after reading that page, it looks like for primary storage the size > should be < 6 TB. What about secondary storage? Assumes both are using NFS. > > On Wed, 31 Jul 2024 at 16:52, Muhammad Hanis Irfan Mohd Zaid < > hanisirfan.w...@gmail.com> wrote: > > > Hi CloudStack community! > > > > I'm currently testing out a POC with VLAN on our current vSphere cluster. > > As someone with a mostly VMware background, setting up each individual > KVM > > host and adding it to the CS management server is a bit of a hard task > for > > me. I've hit a few roadblocks and am hoping the community can assist me > in > > my journey. You can refer to the steps that I took to configure a KVM > node > > here: https://pastebin.com/MpSUq5mF > > > > One of the issues that I'm having is that after the setup that I ran on > > the pastebin, an error occurred which I'm sure should be resolved with > > libvirtd sockets masking, which proved it's not. I've to reboot the host > > while the UI is still adding the host so it can be successfully added. > > > > > > > > > > > > > > > > > > > > > > *2024-07-30 03:56:37,871 INFO [kvm.resource.LibvirtConnection] > > (main:null) (logid:) No existing libvirtd connection found. Opening a new > > one2024-07-30 03:56:38,109 ERROR [cloud.agent.AgentShell] (main:null) > > (logid:) Unable to start > > agent:com.cloud.utils.exception.CloudRuntimeException: Failed to connect > > socket to '/var/run/libvirt/virtqemud-sock': Connection refusedat > > > com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.configure(LibvirtComputingResource.java:1153) > > at com.cloud.agent.Agent.(Agent.java:193)at > > com.cloud.agent.AgentShell.launchNewAgent(AgentShell.java:452)at > > com.cloud.agent.AgentShell.launchAgentFromClassInfo(AgentShell.java:431) > > at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:415) > > at com.cloud.agent.AgentShell.start(AgentShell.java:511)at > > com.cloud.agent.AgentShell.main(AgentShell.java:541)* > > > > Another issue that I'm having is that VNC doesn't work the first time. > > I've to do these steps to get VNC working for newly added hosts: > > > >- Need to migrate a VM to a newly added host. > >- Try to use VNC (doesn't work). > >- Migrate it back out. > >- Reboot the new host. > >- Migrate the VM back into the new host. > >- Try to use VNC (now it works). > > > > > > I humbly request, is there anyone that can share any steps that I can > > follow to deploy a POC or even production capable cluster for KVM running > > on RHEL-based OS or even Ubuntu. Thanks :) > > > > > > >
Re: Best steps to deploy a working KVM cluster with RHEL
Hi Hanis, The docs may be a bit outdated and were originally written in scope for XenServer - thanks for sharing that. It appears you're using KVM, so you should look at the max-limitations and specific recommendations of your KVM distro and NFS vendor. Majority of NFS datastore (both primary & secondary storage pools) there days are in the 10s of TB in size/range, with even 100s of TBs also seen in production usage. While using NFS, it's equally important to also consider networking aspects such as switching capacity in the (KVM) cluster, the switch & host-nic capabilities such as 1G, 10G, teaming/bond, LACP etc. Regards. From: Muhammad Hanis Irfan Mohd Zaid Sent: Thursday, August 1, 2024 07:01 To: users@cloudstack.apache.org Subject: Re: Best steps to deploy a working KVM cluster with RHEL Does anyone have thoughts on this? https://docs.cloudstack.apache.org/en/4.19.1.0/conceptsandterminology/choosing_deployment_architecture.html#best-practices Btw after reading that page, it looks like for primary storage the size should be < 6 TB. What about secondary storage? Assumes both are using NFS. On Wed, 31 Jul 2024 at 16:52, Muhammad Hanis Irfan Mohd Zaid < hanisirfan.w...@gmail.com> wrote: > Hi CloudStack community! > > I'm currently testing out a POC with VLAN on our current vSphere cluster. > As someone with a mostly VMware background, setting up each individual KVM > host and adding it to the CS management server is a bit of a hard task for > me. I've hit a few roadblocks and am hoping the community can assist me in > my journey. You can refer to the steps that I took to configure a KVM node > here: https://pastebin.com/MpSUq5mF > > One of the issues that I'm having is that after the setup that I ran on > the pastebin, an error occurred which I'm sure should be resolved with > libvirtd sockets masking, which proved it's not. I've to reboot the host > while the UI is still adding the host so it can be successfully added. > > > > > > > > > > > *2024-07-30 03:56:37,871 INFO [kvm.resource.LibvirtConnection] > (main:null) (logid:) No existing libvirtd connection found. Opening a new > one2024-07-30 03:56:38,109 ERROR [cloud.agent.AgentShell] (main:null) > (logid:) Unable to start > agent:com.cloud.utils.exception.CloudRuntimeException: Failed to connect > socket to '/var/run/libvirt/virtqemud-sock': Connection refusedat > com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.configure(LibvirtComputingResource.java:1153) > at com.cloud.agent.Agent.(Agent.java:193)at > com.cloud.agent.AgentShell.launchNewAgent(AgentShell.java:452)at > com.cloud.agent.AgentShell.launchAgentFromClassInfo(AgentShell.java:431) > at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:415) > at com.cloud.agent.AgentShell.start(AgentShell.java:511)at > com.cloud.agent.AgentShell.main(AgentShell.java:541)* > > Another issue that I'm having is that VNC doesn't work the first time. > I've to do these steps to get VNC working for newly added hosts: > >- Need to migrate a VM to a newly added host. >- Try to use VNC (doesn't work). >- Migrate it back out. >- Reboot the new host. > - Migrate the VM back into the new host. >- Try to use VNC (now it works). > > > I humbly request, is there anyone that can share any steps that I can > follow to deploy a POC or even production capable cluster for KVM running > on RHEL-based OS or even Ubuntu. Thanks :) > > >
Re: Best steps to deploy a working KVM cluster with RHEL
Does anyone have thoughts on this? https://docs.cloudstack.apache.org/en/4.19.1.0/conceptsandterminology/choosing_deployment_architecture.html#best-practices Btw after reading that page, it looks like for primary storage the size should be < 6 TB. What about secondary storage? Assumes both are using NFS. On Wed, 31 Jul 2024 at 16:52, Muhammad Hanis Irfan Mohd Zaid < hanisirfan.w...@gmail.com> wrote: > Hi CloudStack community! > > I'm currently testing out a POC with VLAN on our current vSphere cluster. > As someone with a mostly VMware background, setting up each individual KVM > host and adding it to the CS management server is a bit of a hard task for > me. I've hit a few roadblocks and am hoping the community can assist me in > my journey. You can refer to the steps that I took to configure a KVM node > here: https://pastebin.com/MpSUq5mF > > One of the issues that I'm having is that after the setup that I ran on > the pastebin, an error occurred which I'm sure should be resolved with > libvirtd sockets masking, which proved it's not. I've to reboot the host > while the UI is still adding the host so it can be successfully added. > > > > > > > > > > > *2024-07-30 03:56:37,871 INFO [kvm.resource.LibvirtConnection] > (main:null) (logid:) No existing libvirtd connection found. Opening a new > one2024-07-30 03:56:38,109 ERROR [cloud.agent.AgentShell] (main:null) > (logid:) Unable to start > agent:com.cloud.utils.exception.CloudRuntimeException: Failed to connect > socket to '/var/run/libvirt/virtqemud-sock': Connection refusedat > com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.configure(LibvirtComputingResource.java:1153) > at com.cloud.agent.Agent.(Agent.java:193)at > com.cloud.agent.AgentShell.launchNewAgent(AgentShell.java:452)at > com.cloud.agent.AgentShell.launchAgentFromClassInfo(AgentShell.java:431) > at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:415) > at com.cloud.agent.AgentShell.start(AgentShell.java:511)at > com.cloud.agent.AgentShell.main(AgentShell.java:541)* > > Another issue that I'm having is that VNC doesn't work the first time. > I've to do these steps to get VNC working for newly added hosts: > >- Need to migrate a VM to a newly added host. >- Try to use VNC (doesn't work). >- Migrate it back out. >- Reboot the new host. >- Migrate the VM back into the new host. >- Try to use VNC (now it works). > > > I humbly request, is there anyone that can share any steps that I can > follow to deploy a POC or even production capable cluster for KVM running > on RHEL-based OS or even Ubuntu. Thanks :) > > >
Best steps to deploy a working KVM cluster with RHEL
Hi CloudStack community! I'm currently testing out a POC with VLAN on our current vSphere cluster. As someone with a mostly VMware background, setting up each individual KVM host and adding it to the CS management server is a bit of a hard task for me. I've hit a few roadblocks and am hoping the community can assist me in my journey. You can refer to the steps that I took to configure a KVM node here: https://pastebin.com/MpSUq5mF One of the issues that I'm having is that after the setup that I ran on the pastebin, an error occurred which I'm sure should be resolved with libvirtd sockets masking, which proved it's not. I've to reboot the host while the UI is still adding the host so it can be successfully added. *2024-07-30 03:56:37,871 INFO [kvm.resource.LibvirtConnection] (main:null) (logid:) No existing libvirtd connection found. Opening a new one2024-07-30 03:56:38,109 ERROR [cloud.agent.AgentShell] (main:null) (logid:) Unable to start agent:com.cloud.utils.exception.CloudRuntimeException: Failed to connect socket to '/var/run/libvirt/virtqemud-sock': Connection refused at com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.configure(LibvirtComputingResource.java:1153) at com.cloud.agent.Agent.(Agent.java:193)at com.cloud.agent.AgentShell.launchNewAgent(AgentShell.java:452)at com.cloud.agent.AgentShell.launchAgentFromClassInfo(AgentShell.java:431) at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:415) at com.cloud.agent.AgentShell.start(AgentShell.java:511)at com.cloud.agent.AgentShell.main(AgentShell.java:541)* Another issue that I'm having is that VNC doesn't work the first time. I've to do these steps to get VNC working for newly added hosts: - Need to migrate a VM to a newly added host. - Try to use VNC (doesn't work). - Migrate it back out. - Reboot the new host. - Migrate the VM back into the new host. - Try to use VNC (now it works). I humbly request, is there anyone that can share any steps that I can follow to deploy a POC or even production capable cluster for KVM running on RHEL-based OS or even Ubuntu. Thanks :)
Re: [D] packet loss from KVM to SSVM public and private ip address [cloudstack]
GitHub user dominar250 added a comment to the discussion: packet loss from KVM to SSVM public and private ip address @weizhouapache As discussed earlier I have separated private and public ip address with a separate network , Right now I'm not able to ping public ip ranges from kvm /management server . Do you have any idea where I need to check the settings. GitHub link: https://github.com/apache/cloudstack/discussions/9254#discussioncomment-10061752 This is an automatically sent email for users@cloudstack.apache.org. To unsubscribe, please send an email to: users-unsubscr...@cloudstack.apache.org
Re: Configuring KVM network bridges on AlmaLinux 9
Had the same issue with Oracle Linux 9. NetworkManager had the be re-enabled to make things work with Cloudstack. Was a bit hairy, but works fine: $ systemctl enable NetworkManager $ systemctl start NetworkManager # ls -l /etc/sysconfig/network-scripts/ -rw-r--r--. 1 root root 130 11. Mär 15:32 ifcfg-bond0 -rw-r--r--. 1 root root 182 11. Mär 15:32 ifcfg-bond0.200 -rw-r--r--. 1 root root 47 11. Mär 15:32 ifcfg-cloudbr0 -rw-r--r--. 1 root root 86 11. Mär 15:33 ifcfg-eno1 -rw-r--r--. 1 root root 86 11. Mär 15:33 ifcfg-eno2 # ifconfig | grep mtu bond0: flags=5187 mtu 1500 bond0.200: flags=4163 mtu 1500 bond0.600: flags=4163 mtu 1500 bond0.1304: flags=4163 mtu 1500 bond0.1372: flags=4163 mtu 1500 brbond0-600: flags=4163 mtu 1500 brbond0-1304: flags=4163 mtu 1500 brbond0-1372: flags=4163 mtu 1500 cloud0: flags=4163 mtu 1500 cloudbr0: flags=4163 mtu 1500 eno1: flags=6211 mtu 1500 eno2: flags=6211 mtu 1500 eno3: flags=4099 mtu 1500 eno4: flags=4099 mtu 1500 idrac: flags=4163 mtu 1500 lo: flags=73 mtu 65536 vnet2: flags=4163 mtu 1500 vnet3: flags=4163 mtu 1500 vnet4: flags=4163 mtu 1500 vnet5: flags=4163 mtu 1500 vnet6: flags=4163 mtu 1500 vnet7: flags=4163 mtu 1500 vnet8: flags=4163 mtu 1500 # cat /etc/os-release NAME="Oracle Linux Server" VERSION="9.4" ID="ol" ID_LIKE="fedora" VARIANT="Server" VARIANT_ID="server" VERSION_ID="9.4" PLATFORM_ID="platform:el9" PRETTY_NAME="Oracle Linux Server 9.4" ANSI_COLOR="0;31" CPE_NAME="cpe:/o:oracle:linux:9:4:server" HOME_URL="https://linux.oracle.com/"; BUG_REPORT_URL="https://github.com/oracle/oracle-linux"; ORACLE_BUGZILLA_PRODUCT="Oracle Linux 9" ORACLE_BUGZILLA_PRODUCT_VERSION=9.4 ORACLE_SUPPORT_PRODUCT="Oracle Linux" ORACLE_SUPPORT_PRODUCT_VERSION=9.4 Am Mon, Jul 15, 2024 at 10:52:43AM +0100 schrieb Nux: > Redhat are really taking the Mickey with this NetworkManager. > Here's the sausage to make it work, do test please. > > nmcli con add ifname cloudbr0 type bridge con-name cloudbr0 autoconnect yes > nmcli con add type bridge-slave ifname eth0 master cloudbr0 autoconnect yes > con-name br-eth0 > nmcli connection up cloudbr0 > > On 2024-07-15 10:27, Fariborz Navidan wrote: > > Hello Guys, > > > > As CentOS/AlmaLinux 9 has deprecated network-scripts, how do I configure > > cloudbr network bridges for KVM using NetworkManager on AlmaLinux 9? > > > > Please guide me ASAP? > > > > Thank you
Re: Configuring KVM network bridges on AlmaLinux 9
Redhat are really taking the Mickey with this NetworkManager. Here's the sausage to make it work, do test please. nmcli con add ifname cloudbr0 type bridge con-name cloudbr0 autoconnect yes nmcli con add type bridge-slave ifname eth0 master cloudbr0 autoconnect yes con-name br-eth0 nmcli connection up cloudbr0 On 2024-07-15 10:27, Fariborz Navidan wrote: Hello Guys, As CentOS/AlmaLinux 9 has deprecated network-scripts, how do I configure cloudbr network bridges for KVM using NetworkManager on AlmaLinux 9? Please guide me ASAP? Thank you
Configuring KVM network bridges on AlmaLinux 9
Hello Guys, As CentOS/AlmaLinux 9 has deprecated network-scripts, how do I configure cloudbr network bridges for KVM using NetworkManager on AlmaLinux 9? Please guide me ASAP? Thank you
Re: [D] Not able to Add Host . KVM in Ubuntu. Dev code running in Mac. [cloudstack]
GitHub user rohityadavcloud added a comment to the discussion: Not able to Add Host . KVM in Ubuntu. Dev code running in Mac. It's been long that we've used/maintained DevCloud, nowadays most of the developers DIY something (either docker or VM/appliance based) of their own, or use Simulator or mbx: https://github.com/shapeblue/mbx GitHub link: https://github.com/apache/cloudstack/discussions/9319#discussioncomment-9935321 This is an automatically sent email for users@cloudstack.apache.org. To unsubscribe, please send an email to: users-unsubscr...@cloudstack.apache.org
Re: [D] Not able to Add Host . KVM in Ubuntu. Dev code running in Mac. [cloudstack]
GitHub user gjosh91 added a comment to the discussion: Not able to Add Host . KVM in Ubuntu. Dev code running in Mac. @DaanHoogland Can you please suggest how to do this ? GitHub link: https://github.com/apache/cloudstack/discussions/9319#discussioncomment-9934389 This is an automatically sent email for users@cloudstack.apache.org. To unsubscribe, please send an email to: users-unsubscr...@cloudstack.apache.org
Re: [D] Not able to Add Host . KVM in Ubuntu. Dev code running in Mac. [cloudstack]
GitHub user gjosh91 edited a comment on the discussion: Not able to Add Host . KVM in Ubuntu. Dev code running in Mac. @rohityadavcloud thank you sir for your valuable suggestion. I will try the ubuntu way going forward or the VM way. Although this is not in the purview of my question but just to bring it to your knowledge the dev cloud image link referenced in the Latest document for release 4.19 is not functioning. I will still try if my approach is possible in Mac and select an answer for this question accordingly. Thank you for your valuable feedback. GitHub link: https://github.com/apache/cloudstack/discussions/9319#discussioncomment-993 This is an automatically sent email for users@cloudstack.apache.org. To unsubscribe, please send an email to: users-unsubscr...@cloudstack.apache.org
Re: [D] Not able to Add Host . KVM in Ubuntu. Dev code running in Mac. [cloudstack]
GitHub user gjosh91 added a comment to the discussion: Not able to Add Host . KVM in Ubuntu. Dev code running in Mac. @rohityadavcloud thank you sir for your valuable suggestion. I will try the ubuntu way going forward or the VM way. Although this is not in the purview of my question but just to bring it to your knowledge the dev cloud link referenced in the Latest document for release 4.19 is not functioning. Thank you for your valuable feedback. GitHub link: https://github.com/apache/cloudstack/discussions/9319#discussioncomment-993 This is an automatically sent email for users@cloudstack.apache.org. To unsubscribe, please send an email to: users-unsubscr...@cloudstack.apache.org
Re: [D] Not able to Add Host . KVM in Ubuntu. Dev code running in Mac. [cloudstack]
GitHub user rohityadavcloud added a comment to the discussion: Not able to Add Host . KVM in Ubuntu. Dev code running in Mac. That said, @gjosh91 here's a workaround - you can install/setup an Ubuntu VM on your OSX machine using UTM or Parallels and setup your development env in it instead. GitHub link: https://github.com/apache/cloudstack/discussions/9319#discussioncomment-9933278 This is an automatically sent email for users@cloudstack.apache.org. To unsubscribe, please send an email to: users-unsubscr...@cloudstack.apache.org
Re: [D] Not able to Add Host . KVM in Ubuntu. Dev code running in Mac. [cloudstack]
GitHub user rohityadavcloud added a comment to the discussion: Not able to Add Host . KVM in Ubuntu. Dev code running in Mac. @gjosh91 your setup will not work as Mac OS isn't a usually supported development platform for use with remote KVM - you'll need to figure out yourself how to do this and may be share with us - how you made it work! I suspect there's some mount and other commands that aren't working on the mgmt server that you're trying to run on OSX, while your hypervisor host is on Ubuntu/KVM. Even if you figure out/install those dependencies, the issues is further that GNU tools aren't compatible on OSX when installed using `brew`, the same way to setup/install on Linux (Ubuntu, Fedora). Most of us who use CloudStack development on OSX, actually use Simulator (see https://github.com/shapeblue/hackerbook and https://github.com/shapeblue/hackerbook/blob/main/2-dev.md#simulator-based-development) From my own experience, it's not worth spending time to figure out something that just works out of the box on Linux/Ubuntu for example. GitHub link: https://github.com/apache/cloudstack/discussions/9319#discussioncomment-9933268 This is an automatically sent email for users@cloudstack.apache.org. To unsubscribe, please send an email to: users-unsubscr...@cloudstack.apache.org
Re: [D] Not able to Add Host . KVM in Ubuntu. Dev code running in Mac. [cloudstack]
GitHub user DaanHoogland added a comment to the discussion: Not able to Add Host . KVM in Ubuntu. Dev code running in Mac. good, nothing wrong there. Long shot, but can your host reach the storage you have provisioned? GitHub link: https://github.com/apache/cloudstack/discussions/9319#discussioncomment-9933190 This is an automatically sent email for users@cloudstack.apache.org. To unsubscribe, please send an email to: users-unsubscr...@cloudstack.apache.org
Re: [D] Not able to Add Host . KVM in Ubuntu. Dev code running in Mac. [cloudstack]
GitHub user gjosh91 added a comment to the discussion: Not able to Add Host . KVM in Ubuntu. Dev code running in Mac. My agent is running. cloudstack-agent.service - CloudStack Agent Loaded: loaded (/lib/systemd/system/cloudstack-agent.service; enabled; vendor preset: enabled) Active: activating (auto-restart) since Tue 2024-07-02 12:55:39 IST; 4s ago Docs: http://www.cloudstack.org/ Process: 28709 ExecStart=/usr/bin/java $JAVA_OPTS $JAVA_DEBUG -cp $CLASSPATH $JAVA_CLASS (code=exited, status=0/SUCCESS) Main PID: 28709 (code=exited, status=0/SUCCESS) CPU: 991ms GitHub link: https://github.com/apache/cloudstack/discussions/9319#discussioncomment-9933062 This is an automatically sent email for users@cloudstack.apache.org. To unsubscribe, please send an email to: users-unsubscr...@cloudstack.apache.org
Re: [D] Not able to Add Host . KVM in Ubuntu. Dev code running in Mac. [cloudstack]
GitHub user DaanHoogland added a comment to the discussion: Not able to Add Host . KVM in Ubuntu. Dev code running in Mac. On the mac you can reach 8250 , so that side seems to be functional for this part. On the host an agent should be running (check `systemctl status cloudstack-agent`). GitHub link: https://github.com/apache/cloudstack/discussions/9319#discussioncomment-9932988 This is an automatically sent email for users@cloudstack.apache.org. To unsubscribe, please send an email to: users-unsubscr...@cloudstack.apache.org
Re: [D] Not able to Add Host . KVM in Ubuntu. Dev code running in Mac. [cloudstack]
GitHub user gjosh91 added a comment to the discussion: Not able to Add Host . KVM in Ubuntu. Dev code running in Mac. Can you please elaborate. I want to run the Management on Mac . I have not initiated any management instance seperately and am running the backend code which as per my understanding should act as management server. My KVM and agent is running on host Ubuntu . GitHub link: https://github.com/apache/cloudstack/discussions/9319#discussioncomment-9932972 This is an automatically sent email for users@cloudstack.apache.org. To unsubscribe, please send an email to: users-unsubscr...@cloudstack.apache.org
Re: [D] Not able to Add Host . KVM in Ubuntu. Dev code running in Mac. [cloudstack]
GitHub user DaanHoogland added a comment to the discussion: Not able to Add Host . KVM in Ubuntu. Dev code running in Mac. ok, if that is on your mac it is a misconfiguration of the management server if it is on the host the agent isn't running. GitHub link: https://github.com/apache/cloudstack/discussions/9319#discussioncomment-9932829 This is an automatically sent email for users@cloudstack.apache.org. To unsubscribe, please send an email to: users-unsubscr...@cloudstack.apache.org
Re: [D] Not able to Add Host . KVM in Ubuntu. Dev code running in Mac. [cloudstack]
GitHub user gjosh91 edited a comment on the discussion: Not able to Add Host . KVM in Ubuntu. Dev code running in Mac. @DaanHoogland I have already shared that in my previous comment. It is working fine when I ping the Mangement server from Host on port 8250. Reply I am getting while trying to ping 8250 on my Mac 192.168.1.159 (where my backend code is running ) from Ubuntu where my KVM is running 192.168.1.95 : telnet 192.168.1.159 8250 Trying 192.168.1.159... Connected to 192.168.1.159. Escape character is '^]'. Also I would like to add that I have checked for any services running on port 8250 and no such service is running on that port. GitHub link: https://github.com/apache/cloudstack/discussions/9319#discussioncomment-9931317 This is an automatically sent email for users@cloudstack.apache.org. To unsubscribe, please send an email to: users-unsubscr...@cloudstack.apache.org
Re: [D] Not able to Add Host . KVM in Ubuntu. Dev code running in Mac. [cloudstack]
GitHub user gjosh91 edited a comment on the discussion: Not able to Add Host . KVM in Ubuntu. Dev code running in Mac. @DaanHoogland I have already shared that in my previous comment. It is working fine when I ping the Mangement server from Host on port 8250. Reply I am getting while trying to ping 8250 on my Mac 192.168.1.159 (where my backend code is running ) from Ubuntu where my KVM is running 192.168.1.95 : telnet 192.168.1.159 8250 Trying 192.168.1.159... Connected to 192.168.1.159. Escape character is '^]'. GitHub link: https://github.com/apache/cloudstack/discussions/9319#discussioncomment-9931317 This is an automatically sent email for users@cloudstack.apache.org. To unsubscribe, please send an email to: users-unsubscr...@cloudstack.apache.org
Re: [D] Not able to Add Host . KVM in Ubuntu. Dev code running in Mac. [cloudstack]
GitHub user gjosh91 edited a comment on the discussion: Not able to Add Host . KVM in Ubuntu. Dev code running in Mac. @DaanHoogland I have already shared that in my previous comment. It is working fine when I ping the Mangement server from Host on port 8250. GitHub link: https://github.com/apache/cloudstack/discussions/9319#discussioncomment-9931317 This is an automatically sent email for users@cloudstack.apache.org. To unsubscribe, please send an email to: users-unsubscr...@cloudstack.apache.org
Re: [D] Not able to Add Host . KVM in Ubuntu. Dev code running in Mac. [cloudstack]
GitHub user gjosh91 edited a discussion: Not able to Add Host . KVM in Ubuntu. Dev code running in Mac. Hi Community, Need help stuck at adding Hosts through frontend . I am in a bind and confused at this point . Please guide . This is my setup : I have setup my cloud Development environment in Mac M2. I have started the backend services (using IntelliJ) , deployed the Db and started the front end (Using VSCode) . I would like to bring to your knowledge that I have not separately setup my cloudstack management server as it was my understanding that running the backend service will itself act as a management server. I have setup my cloudstack agent in the Ubuntu 22 machine . I have assigned the directories for NFS as mentioned in the official docs . I have also setup the KVM and checked if it is running. I have changed the configuration file for network managed by Netplan in my case . This is the network configuration file for your reference : /etc/netplan/01-network-manager-all.yaml network: version: 2 renderer: NetworkManager ethernets: enp1s0: dhcp4: no vlans: enp1s0.200: id: 200 link: enp1s0 wifis: wlp2s0: dhcp4: false dhcp6: false access-points: "WIFISSID": # Replace with your WiFi SSID password: "WIFIPASSWORD" # Replace with your WiFi password bridges: cloudbr0: interfaces: - wlp2s0 addresses: - 192.168.1.95/24 routes: - to: default via: 192.168.1.1 nameservers: addresses: - 8.8.8.8 - 8.8.4.4 search: - lab.example.org parameters: forward-delay: 0 stp: false max-age: 1 cloudbr1: interfaces: - enp1s0.200 dhcp4: no parameters: forward-delay: 0 stp: false max-age: 1 Now both the machines are able to ping each other. They are connected over a private Wifi network . I am able to ssh from Mac into Ubuntu . My problem is occurring when I am adding Host . While adding Host I am inputting the . But it is giving Error 503 that no service resource found at http://ipaddress . Please guide if I am missing something or doing something wrong. P.S. I am new to everything cloud and if you are thinking that I should already be knowing that and not mentioning it in your answer please do mention it . GitHub link: https://github.com/apache/cloudstack/discussions/9319 This is an automatically sent email for users@cloudstack.apache.org. To unsubscribe, please send an email to: users-unsubscr...@cloudstack.apache.org
Re: Issue in Setup KVM host with agent 4.18.1
Hello, That's essentially an Ampere Altra server. You will need to share a lot more details. This may also come in handy: https://rohityadav.cloud/blog/cloudstack-arm64-kvm/ On 2024-06-26 08:07, Sanjay Kumar wrote: Hi All, Does the ARM RL300 server Support Cloudstack? We are facing while installing the Cloudstack agent 4.18.1.0. Any help would be really appreciated. Thank you! Thank you Sanjay Kumar
Re: Issue in Setup KVM host with agent 4.18.1
Hi Sanjay, Generally speaking, we do support ARM-based KVM hosts with CloudStack, but not platforms may work out of the box and is largely due to libvirt/kvm/qemu support on them. ARM systems aren't homogenous in the sense how libvirt/qemu manages to produce the domain XML on them and how qemu reacts to the command/args provided to it. Ampere Altra is expected to work. It also depends what host OS you're running. That said, you haven't really shared what the problem is and what issues you maybe facing. Any logs, output would be useful along with details of your host OS (such as Ubuntu, EL8/EL9 etc). Regards. From: Sanjay Kumar Sent: Wednesday, June 26, 2024 12:37 To: users@cloudstack.apache.org ; d...@cloudstack.apache.org Subject: Issue in Setup KVM host with agent 4.18.1 Hi All, Does the ARM RL300 server Support Cloudstack? We are facing while installing the Cloudstack agent 4.18.1.0. Any help would be really appreciated. Thank you! Thank you Sanjay Kumar
Issue in Setup KVM host with agent 4.18.1
Hi All, Does the ARM RL300 server Support Cloudstack? We are facing while installing the Cloudstack agent 4.18.1.0. Any help would be really appreciated. Thank you! Thank you Sanjay Kumar
Re: VM serialnumber in KVM
Wei is it possible to do the same with XCP as hypervisor? *Francisco Arencibia Quesada.* *DevOps Engineer* On Wed, 12 Jun 2024 at 18:22, Francisco Arencibia Quesada < arencibia.franci...@gmail.com> wrote: > Thanks so much Wei, this worked like a charm > > On Wed, Jun 12, 2024 at 5:22 PM Wei ZHOU wrote: > >> I tried the following >> >> - stop the vm >> - enable extra config in global setting >> "enable.additional.vm.configuration" >> - change account setting "allow.additional.vm.configuration.list.kvm" >> to "sysinfo,system,entry", of course you can change global or domain >> settings. >> - update extra config of vm >> cmk update virtualmachine id=2446f9d9-83ad-4b4c-bf3e-df041a390fcf >> extraconfig=" > name='serial'>MISERIAL " >> - start the vm >> >> vm has the following setting, which looks ok >> >> >> >> >> MISERIAL >> >> >> >> >> Apache Software Foundation >> CloudStack KVM Hypervisor >> 2446f9d9-83ad-4b4c-bf3e-df041a390fcf >> >> >> >> >> >> -Wei >> >> On Wed, Jun 12, 2024 at 4:47 PM Francisco Arencibia Quesada >> wrote: >> > >> > I tried with this but it stuck libvirt >> > https://github.com/atomspring/KVM-BIOS-SerialNo >> > :( >> > >> > On Wed, Jun 12, 2024 at 9:59 AM Francisco Arencibia Quesada < >> > arencibia.franci...@gmail.com> wrote: >> > >> > > yes that would be great. >> > > >> > > On Wed, Jun 12, 2024 at 9:58 AM Wido den Hollander >> wrote: >> > > >> > >> (Back to the list) >> > >> >> > >> Op 12/06/2024 om 09:56 schreef Francisco Arencibia Quesada: >> > >> > I need to set the serial number, manually, or automatically but it >> > >> needs >> > >> > to be sticky, licensing purposes. >> > >> >> > >> If CloudStack would always set the same serial for the same VM, would >> > >> that be OK? >> > >> >> > >> Wido >> > >> >> > >> > >> > >> > :) >> > >> > >> > >> > On Wed, Jun 12, 2024 at 9:50 AM Wido den Hollander > > >> > <mailto:w...@widodh.nl>> wrote: >> > >> > >> > >> > >> > >> > >> > >> > Op 11/06/2024 om 16:29 schreef Francisco Arencibia Quesada: >> > >> > > Good morning guys, >> > >> > > >> > >> > > When I run on Windows wmic bios get serialnumber, I receive >> a >> > >> > blank serial >> > >> > > number, I have tried >> > >> > > running virsh edit VM, and setting : >> > >> > > >> > >> > > >> > >> > > >> > >> > > Apache Software >> > >> Foundation >> > >> > > CloudStack KVM Hypervisor >> > >> > > MISERIAL >> > >> > > > > >> name='uuid'>166f6f56-a8a3-4ab9-82f3-467bf90b0126 >> > >> > > >> > >> > > >> > >> > > >> > >> > > but still the same. >> > >> > > Any guidance? For us it is important to have the serial >> number >> > >> > field for >> > >> > > licensing purposes. >> > >> > > >> > >> > >> > >> > Do you want to be able to set the serialnumber manually or >> could the >> > >> > UUID be sufficient here? >> > >> > >> > >> > Wido >> > >> > >> > >> > > Thanks in advance. >> > >> > > Regards >> > >> > > >> > >> > >> > >> > >> > >> > >> > >> > -- >> > >> > *Francisco Arencibia Quesada.* >> > >> > *DevOps Engineer* >> > >> >> > > >> > > >> > > -- >> > > *Francisco Arencibia Quesada.* >> > > *DevOps Engineer* >> > > >> > >> > >> > -- >> > *Francisco Arencibia Quesada.* >> > *DevOps Engineer* >> > > > -- > *Francisco Arencibia Quesada.* > *DevOps Engineer* >
Re: [D] packet loss from KVM to SSVM public and private ip address [cloudstack]
GitHub user weizhouapache added a comment to the discussion: packet loss from KVM to SSVM public and private ip address > @weizhouapache So cloudstack could'nt work with single ip range ? > There may be some issues with vm console and ssvm (download template/volume, etc). Everything else should work. It is not recommended to use single ip range. If you are just playing with cloudstack, it is ok. If you want to run a product env, you need a better design. GitHub link: https://github.com/apache/cloudstack/discussions/9254#discussioncomment-9772468 This is an automatically sent email for users@cloudstack.apache.org. To unsubscribe, please send an email to: users-unsubscr...@cloudstack.apache.org
Re: [D] packet loss from KVM to SSVM public and private ip address [cloudstack]
GitHub user dominar250 added a comment to the discussion: packet loss from KVM to SSVM public and private ip address @weizhouapache Thanks for the suggestion. Is it a good idea to run management, KVM, and NFS on a single machine? Does this setup cause routing-related issues? My plan is to use CloudStack only for Kubernetes cluster development GitHub link: https://github.com/apache/cloudstack/discussions/9254#discussioncomment-9772469 This is an automatically sent email for users@cloudstack.apache.org. To unsubscribe, please send an email to: users-unsubscr...@cloudstack.apache.org
Re: [D] packet loss from KVM to SSVM public and private ip address [cloudstack]
GitHub user DaanHoogland added a comment to the discussion: packet loss from KVM to SSVM public and private ip address sounds good @dominar250 , but still a separate ip range for the host and for the SVMs (and VMs in general) is best. GitHub link: https://github.com/apache/cloudstack/discussions/9254#discussioncomment-9772470 This is an automatically sent email for users@cloudstack.apache.org. To unsubscribe, please send an email to: users-unsubscr...@cloudstack.apache.org
Re: [D] packet loss from KVM to SSVM public and private ip address [cloudstack]
GitHub user dominar250 added a comment to the discussion: packet loss from KVM to SSVM public and private ip address @weizhouapache So cloudstack could'nt work with single ip range ? GitHub link: https://github.com/apache/cloudstack/discussions/9254#discussioncomment-9772467 This is an automatically sent email for users@cloudstack.apache.org. To unsubscribe, please send an email to: users-unsubscr...@cloudstack.apache.org
Re: [D] packet loss from KVM to SSVM public and private ip address [cloudstack]
GitHub user weizhouapache added a comment to the discussion: packet loss from KVM to SSVM public and private ip address > @DaanHoogland Thanks for addressing this issue. From SSVM/consoleproxy i can > able to ping my kvm machine and management server which is stable . But I > can't get constant ping from kvm or management server to the public/private > ip address for ssvm and console vm. ping is toggling , initial level or after > couple of pings @dominar250 it might be cause public/private IP of system vms are in the same range can you share output of "ip a" in the system vms ? GitHub link: https://github.com/apache/cloudstack/discussions/9254#discussioncomment-9772463 This is an automatically sent email for users@cloudstack.apache.org. To unsubscribe, please send an email to: users-unsubscr...@cloudstack.apache.org
Re: [D] packet loss from KVM to SSVM public and private ip address [cloudstack]
GitHub user dominar250 added a comment to the discussion: packet loss from KVM to SSVM public and private ip address @DaanHoogland root@s-55-VM:~# ip a 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever 2: eth0: mtu 1500 qdisc pfifo_fast state UP group default qlen 1000 link/ether 0e:00:a9:fe:88:07 brd ff:ff:ff:ff:ff:ff altname enp0s3 altname ens3 inet 169.254.136.7/16 brd 169.254.255.255 scope global eth0 valid_lft forever preferred_lft forever 3: eth1: mtu 1500 qdisc pfifo_fast state UP group default qlen 1000 link/ether 1e:00:f7:00:00:02 brd ff:ff:ff:ff:ff:ff altname enp0s4 altname ens4 inet 10.158.65.24/25 brd 10.158.65.127 scope global eth1 valid_lft forever preferred_lft forever 4: eth2: mtu 1500 qdisc pfifo_fast state UP group default qlen 1000 link/ether 1e:00:64:00:00:15 brd ff:ff:ff:ff:ff:ff altname enp0s5 altname ens5 inet 10.158.65.13/25 brd 10.158.65.127 scope global eth2 valid_lft forever preferred_lft forever GitHub link: https://github.com/apache/cloudstack/discussions/9254#discussioncomment-9772464 This is an automatically sent email for users@cloudstack.apache.org. To unsubscribe, please send an email to: users-unsubscr...@cloudstack.apache.org
Re: [D] packet loss from KVM to SSVM public and private ip address [cloudstack]
GitHub user weizhouapache added a comment to the discussion: packet loss from KVM to SSVM public and private ip address @dominar250 I think it is because your systemvm have two nics/ips in the same range typically the public and private should use different ip range and vlan/vni. GitHub link: https://github.com/apache/cloudstack/discussions/9254#discussioncomment-9772466 This is an automatically sent email for users@cloudstack.apache.org. To unsubscribe, please send an email to: users-unsubscr...@cloudstack.apache.org
Re: [D] packet loss from KVM to SSVM public and private ip address [cloudstack]
GitHub user dominar250 added a comment to the discussion: packet loss from KVM to SSVM public and private ip address [system_vm-ip.txt](https://github.com/user-attachments/files/15823200/system_vm-ip.txt) GitHub link: https://github.com/apache/cloudstack/discussions/9254#discussioncomment-9772465 This is an automatically sent email for users@cloudstack.apache.org. To unsubscribe, please send an email to: users-unsubscr...@cloudstack.apache.org
Re: [D] packet loss from KVM to SSVM public and private ip address [cloudstack]
GitHub user dominar250 added a comment to the discussion: packet loss from KVM to SSVM public and private ip address @DaanHoogland Thanks for addressing this issue. From SSVM/consoleproxy i can able to ping my kvm machine and management server which is stable . But I can't get constant ping from kvm or management server to the public/private ip address for ssvm and console vm. ping is toggling , initial level or after couple of pings GitHub link: https://github.com/apache/cloudstack/discussions/9254#discussioncomment-9772462 This is an automatically sent email for users@cloudstack.apache.org. To unsubscribe, please send an email to: users-unsubscr...@cloudstack.apache.org
Re: [D] packet loss from KVM to SSVM public and private ip address [cloudstack]
GitHub user DaanHoogland added a comment to the discussion: packet loss from KVM to SSVM public and private ip address @dominar250 I cleanup the description a bit, please let me know if i messed it up. I do not understand your full scenario yet. you are pinging the console proxy but that does not reflect in your description. Can you expand a bit on the scenario and the problem? Is this initial packet drop concequently reproducible and is it true for the SSVM as well? GitHub link: https://github.com/apache/cloudstack/discussions/9254#discussioncomment-9772461 This is an automatically sent email for users@cloudstack.apache.org. To unsubscribe, please send an email to: users-unsubscr...@cloudstack.apache.org
Re: [D] packet loss from KVM to SSVM public and private ip address [cloudstack]
GitHub user boring-cyborg[bot] added a comment to the discussion: packet loss from KVM to SSVM public and private ip address Thanks for opening your first issue here! Be sure to follow the issue template! GitHub link: https://github.com/apache/cloudstack/discussions/9254#discussioncomment-9772460 This is an automatically sent email for users@cloudstack.apache.org. To unsubscribe, please send an email to: users-unsubscr...@cloudstack.apache.org
Re: VM serialnumber in KVM
I also created a PR to add the serial: https://github.com/apache/cloudstack/pull/9236 Wido Op 12/06/2024 om 18:22 schreef Francisco Arencibia Quesada: Thanks so much Wei, this worked like a charm On Wed, Jun 12, 2024 at 5:22 PM Wei ZHOU wrote: I tried the following - stop the vm - enable extra config in global setting "enable.additional.vm.configuration" - change account setting "allow.additional.vm.configuration.list.kvm" to "sysinfo,system,entry", of course you can change global or domain settings. - update extra config of vm cmk update virtualmachine id=2446f9d9-83ad-4b4c-bf3e-df041a390fcf extraconfig=" MISERIAL " - start the vm vm has the following setting, which looks ok MISERIAL Apache Software Foundation CloudStack KVM Hypervisor 2446f9d9-83ad-4b4c-bf3e-df041a390fcf -Wei On Wed, Jun 12, 2024 at 4:47 PM Francisco Arencibia Quesada wrote: I tried with this but it stuck libvirt https://github.com/atomspring/KVM-BIOS-SerialNo :( On Wed, Jun 12, 2024 at 9:59 AM Francisco Arencibia Quesada < arencibia.franci...@gmail.com> wrote: yes that would be great. On Wed, Jun 12, 2024 at 9:58 AM Wido den Hollander wrote: (Back to the list) Op 12/06/2024 om 09:56 schreef Francisco Arencibia Quesada: I need to set the serial number, manually, or automatically but it needs to be sticky, licensing purposes. If CloudStack would always set the same serial for the same VM, would that be OK? Wido :) On Wed, Jun 12, 2024 at 9:50 AM Wido den Hollander mailto:w...@widodh.nl>> wrote: Op 11/06/2024 om 16:29 schreef Francisco Arencibia Quesada: > Good morning guys, > > When I run on Windows wmic bios get serialnumber, I receive a blank serial > number, I have tried > running virsh edit VM, and setting : > > > > Apache Software Foundation > CloudStack KVM Hypervisor > MISERIAL > name='uuid'>166f6f56-a8a3-4ab9-82f3-467bf90b0126 > > > > but still the same. > Any guidance? For us it is important to have the serial number field for > licensing purposes. > Do you want to be able to set the serialnumber manually or could the UUID be sufficient here? Wido > Thanks in advance. > Regards > -- *Francisco Arencibia Quesada.* *DevOps Engineer* -- *Francisco Arencibia Quesada.* *DevOps Engineer* -- *Francisco Arencibia Quesada.* *DevOps Engineer*
Re: VM serialnumber in KVM
Thanks so much Wei, this worked like a charm On Wed, Jun 12, 2024 at 5:22 PM Wei ZHOU wrote: > I tried the following > > - stop the vm > - enable extra config in global setting > "enable.additional.vm.configuration" > - change account setting "allow.additional.vm.configuration.list.kvm" > to "sysinfo,system,entry", of course you can change global or domain > settings. > - update extra config of vm > cmk update virtualmachine id=2446f9d9-83ad-4b4c-bf3e-df041a390fcf > extraconfig="name='serial'>MISERIAL " > - start the vm > > vm has the following setting, which looks ok > > > > > MISERIAL > > > > > Apache Software Foundation > CloudStack KVM Hypervisor > 2446f9d9-83ad-4b4c-bf3e-df041a390fcf > > > > > > -Wei > > On Wed, Jun 12, 2024 at 4:47 PM Francisco Arencibia Quesada > wrote: > > > > I tried with this but it stuck libvirt > > https://github.com/atomspring/KVM-BIOS-SerialNo > > :( > > > > On Wed, Jun 12, 2024 at 9:59 AM Francisco Arencibia Quesada < > > arencibia.franci...@gmail.com> wrote: > > > > > yes that would be great. > > > > > > On Wed, Jun 12, 2024 at 9:58 AM Wido den Hollander > wrote: > > > > > >> (Back to the list) > > >> > > >> Op 12/06/2024 om 09:56 schreef Francisco Arencibia Quesada: > > >> > I need to set the serial number, manually, or automatically but it > > >> needs > > >> > to be sticky, licensing purposes. > > >> > > >> If CloudStack would always set the same serial for the same VM, would > > >> that be OK? > > >> > > >> Wido > > >> > > >> > > > >> > :) > > >> > > > >> > On Wed, Jun 12, 2024 at 9:50 AM Wido den Hollander > >> > <mailto:w...@widodh.nl>> wrote: > > >> > > > >> > > > >> > > > >> > Op 11/06/2024 om 16:29 schreef Francisco Arencibia Quesada: > > >> > > Good morning guys, > > >> > > > > >> > > When I run on Windows wmic bios get serialnumber, I receive a > > >> > blank serial > > >> > > number, I have tried > > >> > > running virsh edit VM, and setting : > > >> > > > > >> > > > > >> > > > > >> > > Apache Software > > >> Foundation > > >> > > CloudStack KVM Hypervisor > > >> > > MISERIAL > > >> > > > >> name='uuid'>166f6f56-a8a3-4ab9-82f3-467bf90b0126 > > >> > > > > >> > > > > >> > > > > >> > > but still the same. > > >> > > Any guidance? For us it is important to have the serial > number > > >> > field for > > >> > > licensing purposes. > > >> > > > > >> > > > >> > Do you want to be able to set the serialnumber manually or > could the > > >> > UUID be sufficient here? > > >> > > > >> > Wido > > >> > > > >> > > Thanks in advance. > > >> > > Regards > > >> > > > > >> > > > >> > > > >> > > > >> > -- > > >> > *Francisco Arencibia Quesada.* > > >> > *DevOps Engineer* > > >> > > > > > > > > > -- > > > *Francisco Arencibia Quesada.* > > > *DevOps Engineer* > > > > > > > > > -- > > *Francisco Arencibia Quesada.* > > *DevOps Engineer* > -- *Francisco Arencibia Quesada.* *DevOps Engineer*
Re: VM serialnumber in KVM
I tried the following - stop the vm - enable extra config in global setting "enable.additional.vm.configuration" - change account setting "allow.additional.vm.configuration.list.kvm" to "sysinfo,system,entry", of course you can change global or domain settings. - update extra config of vm cmk update virtualmachine id=2446f9d9-83ad-4b4c-bf3e-df041a390fcf extraconfig=" MISERIAL " - start the vm vm has the following setting, which looks ok MISERIAL Apache Software Foundation CloudStack KVM Hypervisor 2446f9d9-83ad-4b4c-bf3e-df041a390fcf -Wei On Wed, Jun 12, 2024 at 4:47 PM Francisco Arencibia Quesada wrote: > > I tried with this but it stuck libvirt > https://github.com/atomspring/KVM-BIOS-SerialNo > :( > > On Wed, Jun 12, 2024 at 9:59 AM Francisco Arencibia Quesada < > arencibia.franci...@gmail.com> wrote: > > > yes that would be great. > > > > On Wed, Jun 12, 2024 at 9:58 AM Wido den Hollander wrote: > > > >> (Back to the list) > >> > >> Op 12/06/2024 om 09:56 schreef Francisco Arencibia Quesada: > >> > I need to set the serial number, manually, or automatically but it > >> needs > >> > to be sticky, licensing purposes. > >> > >> If CloudStack would always set the same serial for the same VM, would > >> that be OK? > >> > >> Wido > >> > >> > > >> > :) > >> > > >> > On Wed, Jun 12, 2024 at 9:50 AM Wido den Hollander >> > <mailto:w...@widodh.nl>> wrote: > >> > > >> > > >> > > >> > Op 11/06/2024 om 16:29 schreef Francisco Arencibia Quesada: > >> > > Good morning guys, > >> > > > >> > > When I run on Windows wmic bios get serialnumber, I receive a > >> > blank serial > >> > > number, I have tried > >> > > running virsh edit VM, and setting : > >> > > > >> > > > >> > > > >> > > Apache Software > >> Foundation > >> > > CloudStack KVM Hypervisor > >> > > MISERIAL > >> > > >> name='uuid'>166f6f56-a8a3-4ab9-82f3-467bf90b0126 > >> > > > >> > > > >> > > > >> > > but still the same. > >> > > Any guidance? For us it is important to have the serial number > >> > field for > >> > > licensing purposes. > >> > > > >> > > >> > Do you want to be able to set the serialnumber manually or could the > >> > UUID be sufficient here? > >> > > >> > Wido > >> > > >> > > Thanks in advance. > >> > > Regards > >> > > > >> > > >> > > >> > > >> > -- > >> > *Francisco Arencibia Quesada.* > >> > *DevOps Engineer* > >> > > > > > > -- > > *Francisco Arencibia Quesada.* > > *DevOps Engineer* > > > > > -- > *Francisco Arencibia Quesada.* > *DevOps Engineer*