Re: Windows VM performance in ACS

[Jayanth Babu A]

Hi,
Just wanted to follow-up to see if you were able to resolve this.

Regards,
Jayanth Reddy

From: Jayanth Babu A 
Date: Friday, 24 May 2024 at 7:23 AM
To: users@cloudstack.apache.org 
Subject: Re: Windows VM performance in ACS
Hello Alexandru,
Alright. Please past the output of # virsh dumpxml 

Thanks,
Jayanth


From: Alexandru Stan 
Sent: Friday, May 24, 2024 2:01:35 am
To: users@cloudstack.apache.org 
Subject: RE: Windows VM performance in ACS

Did that and I'm not really sure that the situation is improved. Right after 
booting I started installing the latest CU for May and it was done in 1 hour 
and 30 minutes. I know that these things sometimes take a while to install but 
this seems way too much...


-Original Message-
From: Jayanth Babu A 
Sent: 23 May, 2024 21:55
To: users@cloudstack.apache.org
Subject: Re: Windows VM performance in ACS

Hello Alexandru,
Thanks for sharing. The reason could be that the VM is using IDE instead of 
virtio. Please stop the VM and add the key "rootDiskController" with value 
"virtio" and see the difference. You'll have to ensure that virtio drivers are 
installed on the VM so that it would be able to detect the disks.

Thanks,
Jayanth


From: Alexandru Stan 
Sent: Friday, May 24, 2024 12:21:03 am
To: users@cloudstack.apache.org 
Subject: RE: Windows VM performance in ACS

Hi Jayanth,

I don't have that key. In the settings section of the vm there are 2 keys, 
Message.ReservedCapacityFreed.Flag and rootdisksize.
I don't have a template yet, actually this vm was installed from a Windows ISO 
(that is registered as Windows PV in ACS) and I was hoping to transform it into 
a template with cloudbase-init, but since the performance is so bad I didn't 
get past the updates phase...

Alex


-Original Message-
From: Jayanth Babu A 
Sent: Thursday, May 23, 2024 4:54 PM
To: users@cloudstack.apache.org
Subject: Re: Windows VM performance in ACS

Hello Alexandru,
I’m not able to see the image. Would you please check the value for the key 
“rootDiskController” in both template and the Windows VM if the template OS 
type is “Windows PV” already? You’ll find it in the settings section.

Regards,
Jayanth Reddy

From: Alexandru Stan 
Date: Thursday, 23 May 2024 at 5:53 PM
To: users@cloudstack.apache.org 
Subject: RE: Windows VM performance in ACS Yes, I installed the guest tools 
right at first boot.

[cid:image001.png@01DAAD25.1CAA02B0]

From: Gary Dixon 
Sent: Thursday, May 23, 2024 2:32 PM
To: users@cloudstack.apache.org
Subject: RE: Windows VM performance in ACS

Have you checked in the VM's device manager that all devices are using virtio 
drivers (disk, disk controller, nic adapter etc) 
[cid:image535355.png@39364AC9.99EC2427]
Gary Dixon
Quadris Cloud Manager
[cid:image073403.png@5F5163CD.BCC16405]
+44 (0) 161 537 4980
 +44 (0) 7989 717661
[cid:image544450.png@462E4508.F6776E5F]
gary.di...@quadris.co.uk<mailto:gary.di...@quadris.co.uk>
[cid:image958545.png@2524980D.56B1E4D4]
https://checkpoint.url-protection.com/v1/url?o=www.quadris.com=OWQ3Y2VjYjI5MzFmMDhlYQ===ODIxMzViOWYyNWQ3YzFhMTNhYmJiY2FjNWFjM2NlMTQxYzA0OTkxZmIxNzlkMTI0ZDQ4NWQ3ZjZhY2E2ZTVmNg===Y3AxZTpueHRnZW5pbmZpbml0ZWRhdGFjZW50ZXI6YzpvOmEzMTc5ZmM5MjI1ZTc3NTIxOGEyMTUwOTlhZWE2NGNhOnYxOnA6VA==<https://checkpoint.url-protection.com/v1/url?o=http%3A//www.quadris.com=NjRjMmNhNWQxNWIyNTc5YQ===Yzc1OTFlZWZiYjA5ZThkYzZkYzVkNzAzZGVkOWE5NGViZTliZGRhODBiYmM2ZGZhNDg1OTNmN2VjNThhYmJhNA===Y3AxZTpueHRnZW5pbmZpbml0ZWRhdGFjZW50ZXI6YzpvOjdlOWE2YmVlMWZlMDUxZjU5YTM1MWZkYzc2YTVlOThmOnYxOmg6VA==><https://checkpoint.url-protection.com/v1/url?o=www.quadris.com=OWQ3Y2VjYjI5MzFmMDhlYQ===ODIxMzViOWYyNWQ3YzFhMTNhYmJiY2FjNWFjM2NlMTQxYzA0OTkxZmIxNzlkMTI0ZDQ4NWQ3ZjZhY2E2ZTVmNg===Y3AxZTpueHRnZW5pbmZpbml0ZWRhdGFjZW50ZXI6YzpvOmEzMTc5ZmM5MjI1ZTc3NTIxOGEyMTUwOTlhZWE2NGNhOnYxOnA6VA==%3chttps://checkpoint.url-protection.com/v1/url?o=http%3A//www.quadris.com=NjRjMmNhNWQxNWIyNTc5YQ===Yzc1OTFlZWZiYjA5ZThkYzZkYzVkNzAzZGVkOWE5NGViZTliZGRhODBiYmM2ZGZhNDg1OTNmN2VjNThhYmJhNA===Y3AxZTpueHRnZW5pbmZpbml0ZWRhdGFjZW50ZXI6YzpvOjdlOWE2YmVlMWZlMDUxZjU5YTM1MWZkYzc2YTVlOThmOnYxOmg6VA==%3e>
[cid:image378974.png@A6154DF9.C6D27CA5]
Innovation House, 12‑13 Bredbury Business Park Bredbury Park Way, Bredbury, 
Stockport, SK6 2SN -Original Message-
From: Alexandru Stan 
mailto:alexandru.s...@lifeincloud.com.INVALID>>
Sent: Thursday, May 23, 2024 11:17 AM
To: users@cloudstack.apache.org<mailto:users@cloudstack.apache.org>
Subject: RE: Windows VM performance in ACS

Hi Gary,

That’s what I used when registering the ISO. Doesn’t seem to help at all 
unfortunately.


From: Gary Dixon 
mailto:gary.di...@quadris.co.uk.INVALID>>
Sent: Thursday, May 23, 2024 1:14 PM
To: users@cloudstack.apache.org<mailto:users@cloudstack.apache.org>
Subject: RE: Windows VM performance in ACS

HI Alexandru

We use "Windows PV" OS type on

Re: Cloudstack Managment service Self Fencing

[Jayanth Babu A]

Hello Joan,
I don’t seem to understand fencing in this case, please elaborate. Does 
CloudStack WebUI or API show the Node_2 management server as offline?

Regards,
Jayanth Reddy

From: Joan g 
Date: Monday, 27 May 2024 at 11:49 PM
To: users@cloudstack.apache.org 
Subject: Cloudstack Managment service Self Fencing
Hello team,

I have 2 node cloudstack management server deployment, the issue that is
happening frequently is that Node_2 is always shutting down itself as a
part of self fencing.
Can someone guide on the possible reason for this, I can observe there is
no network disconnection between the managemet servers.

Thanks,
Jon
Disclaimer *** This e-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION 
intended solely for the use of the addressee(s). If you are not the intended 
recipient, please notify the sender by e-mail and delete the original message. 
Further, you are not authorised to copy, disclose, or distribute this e-mail or 
its contents to any other person and any such actions are unlawful and strictly 
prohibited. This e-mail may contain viruses. NxtGen Datacenter & Cloud 
Technologies Private Ltd (“NxtGen”) has taken every reasonable precaution to 
minimize this risk but is not liable for any damage you may sustain as a result 
of any virus in this e-mail. You should carry out your own virus checks before 
opening the e-mail or attachment. NxtGen reserves the right to monitor and 
review the content of all messages sent to or from this e-mail address. 
Messages sent to or from this e-mail address may be stored on the NxtGen e-mail 
system. *** End of Disclaimer ***NXTGEN***

Re: Set number of total projects for each account

[Jayanth Babu A]

Thanks, Wei.
Would it be good to introduce something like “max.account.projects” into the 
Global Limits [1] as well?

[1] 
https://docs.cloudstack.apache.org/en/latest/adminguide/usage.html#globally-configured-limits

Regards,
Jayanth Reddy

From: Wei ZHOU 
Date: Monday, 27 May 2024 at 4:26 PM
To: users@cloudstack.apache.org 
Subject: Re: Set number of total projects for each account
This seems to be missing on UI

it works via cloudmonkey

(localcloud)  > update resourcelimit
domainid=37ff2485-cc1e-11ee-a4eb-1e00db000197 account=ACSUser
resourcetype=5 max=3
{
  "resourcelimit": {
"account": "ACSUser",
"domain": "ROOT",
"domainid": "37ff2485-cc1e-11ee-a4eb-1e00db000197",
"max": 3,
"resourcetype": "5",
"resourcetypename": "project"
  }
}


-Wei

On Mon, May 27, 2024 at 10:23 AM Mevludin Blazevic
 wrote:
>
> Hi all,
>
> does anyone know how to set a fix number of projects for each account?
> In the ressources overview I can only see that there is an unlimited
> number of projects available for an account, but how can I set a value
> for this?
>
> - Mevludin
>
Disclaimer *** This e-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION 
intended solely for the use of the addressee(s). If you are not the intended 
recipient, please notify the sender by e-mail and delete the original message. 
Further, you are not authorised to copy, disclose, or distribute this e-mail or 
its contents to any other person and any such actions are unlawful and strictly 
prohibited. This e-mail may contain viruses. NxtGen Datacenter & Cloud 
Technologies Private Ltd (“NxtGen”) has taken every reasonable precaution to 
minimize this risk but is not liable for any damage you may sustain as a result 
of any virus in this e-mail. You should carry out your own virus checks before 
opening the e-mail or attachment. NxtGen reserves the right to monitor and 
review the content of all messages sent to or from this e-mail address. 
Messages sent to or from this e-mail address may be stored on the NxtGen e-mail 
system. *** End of Disclaimer ***NXTGEN***

Re: Backup VM on Cloudstack

[Jayanth Babu A]

Hello Wei,
ACS v4.16; IIRC Veeam should be either v11 or v12.

Thanks,
Jayanth

Sent on the move


From: Wei ZHOU 
Sent: Monday, May 27, 2024 3:16:36 pm
To: users@cloudstack.apache.org 
Subject: Re: Backup VM on Cloudstack

great to know it.
Can you share the acs/vmware/veeam version?
Thanks

On Monday, May 27, 2024, Jayanth Babu A 
wrote:

> Hello,
> Veeam agent-based backups have worked for us so far.
>
> Regards,
> Jayanth Reddy
>
> From: Khang Nguyen Phuc 
> Date: Friday, 24 May 2024 at 1:03 PM
> To: users@cloudstack.apache.org 
> Subject: Backup VM on Cloudstack
> Hello everyone,
>
> I'm looking for some advice on solutions for backing up VMs running on KVM
> in Cloudstack. I found two plugins in the documentation, but they are both
> paid. I also saw the dummy backup, but introductions to Cloudstack mention
> that it is only for testing the API's functionality. Can I consider dummy
> backup as a "native" backup solution for Cloudstack? I see two offerings,
> 'Gold' and 'Silver,' but there is no information on how many backups it
> makes or for how long...
>
> Can you suggest a backup solution for me or provide clearer documentation
> about the dummy backup?
>
> Thank you very much.
> Disclaimer *** This e-mail contains PRIVILEGED AND CONFIDENTIAL
> INFORMATION intended solely for the use of the addressee(s). If you are not
> the intended recipient, please notify the sender by e-mail and delete the
> original message. Further, you are not authorised to copy, disclose, or
> distribute this e-mail or its contents to any other person and any such
> actions are unlawful and strictly prohibited. This e-mail may contain
> viruses. NxtGen Datacenter & Cloud Technologies Private Ltd (“NxtGen”) has
> taken every reasonable precaution to minimize this risk but is not liable
> for any damage you may sustain as a result of any virus in this e-mail. You
> should carry out your own virus checks before opening the e-mail or
> attachment. NxtGen reserves the right to monitor and review the content of
> all messages sent to or from this e-mail address. Messages sent to or from
> this e-mail address may be stored on the NxtGen e-mail system. *** End of
> Disclaimer ***NXTGEN***
>

Disclaimer *** This e-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION 
intended solely for the use of the addressee(s). If you are not the intended 
recipient, please notify the sender by e-mail and delete the original message. 
Further, you are not authorised to copy, disclose, or distribute this e-mail or 
its contents to any other person and any such actions are unlawful and strictly 
prohibited. This e-mail may contain viruses. NxtGen Datacenter & Cloud 
Technologies Private Ltd (“NxtGen”) has taken every reasonable precaution to 
minimize this risk but is not liable for any damage you may sustain as a result 
of any virus in this e-mail. You should carry out your own virus checks before 
opening the e-mail or attachment. NxtGen reserves the right to monitor and 
review the content of all messages sent to or from this e-mail address. 
Messages sent to or from this e-mail address may be stored on the NxtGen e-mail 
system. *** End of Disclaimer ***NXTGEN***

Re: HA for management server

[Jayanth Babu A]

Hello,
Yes, DB clustering with Galera or some other sort should be looked into. I'm 
not sure if [1] has worked for someone so far.

[1] 
https://docs.cloudstack.apache.org/en/latest/adminguide/reliability.html#configuring-database-high-availability

Thanks,
Jayanth

From: Alexandru Stan 
Sent: Monday, May 27, 2024 2:48 PM
To: users@cloudstack.apache.org 
Subject: RE: HA for management server

Hi,

Actually no, I'm just documenting the process so far, so nothing was done for 
the DB. For this I assume the info in the official documentation would be ok? 
Or something more advanced would be needed, like a galera cluster?



-Original Message-
From: Jayanth Babu A 
Sent: Monday, May 27, 2024 12:12 PM
To: users@cloudstack.apache.org
Subject: Re: HA for management server

Hello Alexandru,
Please see [1] and [2]. I assume your DB HA is taken care of.

[1] 
https://checkpoint.url-protection.com/v1/url?o=https%3A//docs.cloudstack.apache.org/en/latest/adminguide/reliability.html=ZmEwYjAwNmYwMjIxNTU5ZQ===NmQyMzY5Nzc5YTU2ZDkyYjc4N2ExNDU4Y2Q0OWFkMjQ4OGRhMGZiZjdiNDA5N2NmNmRhM2EwYjUzZGEwMmI2Mg===Y3AxZTpueHRnZW5pbmZpbml0ZWRhdGFjZW50ZXI6YzpvOmY0ZWFkYmU5NDkzMjMyMjdjY2EyM2IxN2YzOGZiMWE4OnYxOnA6VA==
[2] 
https://checkpoint.url-protection.com/v1/url?o=https%3A//github.com/apache/cloudstack/issues/8221=YzVlNDk3YjI5NTEwMTM5Mg===OTBmN2Q4ZjA3YzRlOTAxZDk1YzcwMmExMTAzYTY4N2VmYjg5MGZkZGQyMDE2NTM3MTU4MGUxNDRjNzMzN2E0ZQ===Y3AxZTpueHRnZW5pbmZpbml0ZWRhdGFjZW50ZXI6YzpvOmY0ZWFkYmU5NDkzMjMyMjdjY2EyM2IxN2YzOGZiMWE4OnYxOnA6VA==

Regards,
Jayanth Reddy
Engineering Manager

From: Alexandru Stan 
Date: Monday, 27 May 2024 at 2:38 PM
To: users@cloudstack.apache.org 
Subject: HA for management server
Hello,

Is there any documentation on deployment of multiple management servers in high 
availability? Or does anyone have good info on this? The official documentation 
does not contain anything relevant unfortunately.

Thank you!
Disclaimer *** This e-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION 
intended solely for the use of the addressee(s). If you are not the intended 
recipient, please notify the sender by e-mail and delete the original message. 
Further, you are not authorised to copy, disclose, or distribute this e-mail or 
its contents to any other person and any such actions are unlawful and strictly 
prohibited. This e-mail may contain viruses. NxtGen Datacenter & Cloud 
Technologies Private Ltd (“NxtGen”) has taken every reasonable precaution to 
minimize this risk but is not liable for any damage you may sustain as a result 
of any virus in this e-mail. You should carry out your own virus checks before 
opening the e-mail or attachment. NxtGen reserves the right to monitor and 
review the content of all messages sent to or from this e-mail address. 
Messages sent to or from this e-mail address may be stored on the NxtGen e-mail 
system. *** End of Disclaimer ***NXTGEN***
Disclaimer *** This e-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION 
intended solely for the use of the addressee(s). If you are not the intended 
recipient, please notify the sender by e-mail and delete the original message. 
Further, you are not authorised to copy, disclose, or distribute this e-mail or 
its contents to any other person and any such actions are unlawful and strictly 
prohibited. This e-mail may contain viruses. NxtGen Datacenter & Cloud 
Technologies Private Ltd (“NxtGen”) has taken every reasonable precaution to 
minimize this risk but is not liable for any damage you may sustain as a result 
of any virus in this e-mail. You should carry out your own virus checks before 
opening the e-mail or attachment. NxtGen reserves the right to monitor and 
review the content of all messages sent to or from this e-mail address. 
Messages sent to or from this e-mail address may be stored on the NxtGen e-mail 
system. *** End of Disclaimer ***NXTGEN***

Re: Backup VM on Cloudstack

[Jayanth Babu A]

Hello,
Veeam agent-based backups have worked for us so far.

Regards,
Jayanth Reddy

From: Khang Nguyen Phuc 
Date: Friday, 24 May 2024 at 1:03 PM
To: users@cloudstack.apache.org 
Subject: Backup VM on Cloudstack
Hello everyone,

I'm looking for some advice on solutions for backing up VMs running on KVM
in Cloudstack. I found two plugins in the documentation, but they are both
paid. I also saw the dummy backup, but introductions to Cloudstack mention
that it is only for testing the API's functionality. Can I consider dummy
backup as a "native" backup solution for Cloudstack? I see two offerings,
'Gold' and 'Silver,' but there is no information on how many backups it
makes or for how long...

Can you suggest a backup solution for me or provide clearer documentation
about the dummy backup?

Thank you very much.
Disclaimer *** This e-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION 
intended solely for the use of the addressee(s). If you are not the intended 
recipient, please notify the sender by e-mail and delete the original message. 
Further, you are not authorised to copy, disclose, or distribute this e-mail or 
its contents to any other person and any such actions are unlawful and strictly 
prohibited. This e-mail may contain viruses. NxtGen Datacenter & Cloud 
Technologies Private Ltd (“NxtGen”) has taken every reasonable precaution to 
minimize this risk but is not liable for any damage you may sustain as a result 
of any virus in this e-mail. You should carry out your own virus checks before 
opening the e-mail or attachment. NxtGen reserves the right to monitor and 
review the content of all messages sent to or from this e-mail address. 
Messages sent to or from this e-mail address may be stored on the NxtGen e-mail 
system. *** End of Disclaimer ***NXTGEN***

Re: HA for management server

[Jayanth Babu A]

Hello Alexandru,
Please see [1] and [2]. I assume your DB HA is taken care of.

[1] https://docs.cloudstack.apache.org/en/latest/adminguide/reliability.html
[2] https://github.com/apache/cloudstack/issues/8221

Regards,
Jayanth Reddy
Engineering Manager

From: Alexandru Stan 
Date: Monday, 27 May 2024 at 2:38 PM
To: users@cloudstack.apache.org 
Subject: HA for management server
Hello,

Is there any documentation on deployment of multiple management servers in high 
availability? Or does anyone have good info on this? The official documentation 
does not contain anything relevant unfortunately.

Thank you!
Disclaimer *** This e-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION 
intended solely for the use of the addressee(s). If you are not the intended 
recipient, please notify the sender by e-mail and delete the original message. 
Further, you are not authorised to copy, disclose, or distribute this e-mail or 
its contents to any other person and any such actions are unlawful and strictly 
prohibited. This e-mail may contain viruses. NxtGen Datacenter & Cloud 
Technologies Private Ltd (“NxtGen”) has taken every reasonable precaution to 
minimize this risk but is not liable for any damage you may sustain as a result 
of any virus in this e-mail. You should carry out your own virus checks before 
opening the e-mail or attachment. NxtGen reserves the right to monitor and 
review the content of all messages sent to or from this e-mail address. 
Messages sent to or from this e-mail address may be stored on the NxtGen e-mail 
system. *** End of Disclaimer ***NXTGEN***

Re: Set number of total projects for each account

[Jayanth Babu A]

Hello Mevludin,
I don’t think that project limits at an account-level is implemented. You may 
have to consider at domain-level only.

Regards,
Jayanth Reddy

From: Mevludin Blazevic 
Date: Monday, 27 May 2024 at 1:53 PM
To: users@cloudstack.apache.org 
Subject: Set number of total projects for each account
Hi all,

does anyone know how to set a fix number of projects for each account?
In the ressources overview I can only see that there is an unlimited
number of projects available for an account, but how can I set a value
for this?

- Mevludin
Disclaimer *** This e-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION 
intended solely for the use of the addressee(s). If you are not the intended 
recipient, please notify the sender by e-mail and delete the original message. 
Further, you are not authorised to copy, disclose, or distribute this e-mail or 
its contents to any other person and any such actions are unlawful and strictly 
prohibited. This e-mail may contain viruses. NxtGen Datacenter & Cloud 
Technologies Private Ltd (“NxtGen”) has taken every reasonable precaution to 
minimize this risk but is not liable for any damage you may sustain as a result 
of any virus in this e-mail. You should carry out your own virus checks before 
opening the e-mail or attachment. NxtGen reserves the right to monitor and 
review the content of all messages sent to or from this e-mail address. 
Messages sent to or from this e-mail address may be stored on the NxtGen e-mail 
system. *** End of Disclaimer ***NXTGEN***

Re: Windows VM performance in ACS

[Jayanth Babu A]

Hello Alexandru,
Alright. Please past the output of # virsh dumpxml 

Thanks,
Jayanth


From: Alexandru Stan 
Sent: Friday, May 24, 2024 2:01:35 am
To: users@cloudstack.apache.org 
Subject: RE: Windows VM performance in ACS

Did that and I'm not really sure that the situation is improved. Right after 
booting I started installing the latest CU for May and it was done in 1 hour 
and 30 minutes. I know that these things sometimes take a while to install but 
this seems way too much...


-Original Message-
From: Jayanth Babu A 
Sent: 23 May, 2024 21:55
To: users@cloudstack.apache.org
Subject: Re: Windows VM performance in ACS

Hello Alexandru,
Thanks for sharing. The reason could be that the VM is using IDE instead of 
virtio. Please stop the VM and add the key "rootDiskController" with value 
"virtio" and see the difference. You'll have to ensure that virtio drivers are 
installed on the VM so that it would be able to detect the disks.

Thanks,
Jayanth


From: Alexandru Stan 
Sent: Friday, May 24, 2024 12:21:03 am
To: users@cloudstack.apache.org 
Subject: RE: Windows VM performance in ACS

Hi Jayanth,

I don't have that key. In the settings section of the vm there are 2 keys, 
Message.ReservedCapacityFreed.Flag and rootdisksize.
I don't have a template yet, actually this vm was installed from a Windows ISO 
(that is registered as Windows PV in ACS) and I was hoping to transform it into 
a template with cloudbase-init, but since the performance is so bad I didn't 
get past the updates phase...

Alex


-Original Message-
From: Jayanth Babu A 
Sent: Thursday, May 23, 2024 4:54 PM
To: users@cloudstack.apache.org
Subject: Re: Windows VM performance in ACS

Hello Alexandru,
I’m not able to see the image. Would you please check the value for the key 
“rootDiskController” in both template and the Windows VM if the template OS 
type is “Windows PV” already? You’ll find it in the settings section.

Regards,
Jayanth Reddy

From: Alexandru Stan 
Date: Thursday, 23 May 2024 at 5:53 PM
To: users@cloudstack.apache.org 
Subject: RE: Windows VM performance in ACS Yes, I installed the guest tools 
right at first boot.

[cid:image001.png@01DAAD25.1CAA02B0]

From: Gary Dixon 
Sent: Thursday, May 23, 2024 2:32 PM
To: users@cloudstack.apache.org
Subject: RE: Windows VM performance in ACS

Have you checked in the VM's device manager that all devices are using virtio 
drivers (disk, disk controller, nic adapter etc) 
[cid:image535355.png@39364AC9.99EC2427]
Gary Dixon
Quadris Cloud Manager
[cid:image073403.png@5F5163CD.BCC16405]
+44 (0) 161 537 4980
 +44 (0) 7989 717661
[cid:image544450.png@462E4508.F6776E5F]
gary.di...@quadris.co.uk<mailto:gary.di...@quadris.co.uk>
[cid:image958545.png@2524980D.56B1E4D4]
https://checkpoint.url-protection.com/v1/url?o=www.quadris.com=OWQ3Y2VjYjI5MzFmMDhlYQ===ODIxMzViOWYyNWQ3YzFhMTNhYmJiY2FjNWFjM2NlMTQxYzA0OTkxZmIxNzlkMTI0ZDQ4NWQ3ZjZhY2E2ZTVmNg===Y3AxZTpueHRnZW5pbmZpbml0ZWRhdGFjZW50ZXI6YzpvOmEzMTc5ZmM5MjI1ZTc3NTIxOGEyMTUwOTlhZWE2NGNhOnYxOnA6VA==<https://checkpoint.url-protection.com/v1/url?o=http%3A//www.quadris.com=NjRjMmNhNWQxNWIyNTc5YQ===Yzc1OTFlZWZiYjA5ZThkYzZkYzVkNzAzZGVkOWE5NGViZTliZGRhODBiYmM2ZGZhNDg1OTNmN2VjNThhYmJhNA===Y3AxZTpueHRnZW5pbmZpbml0ZWRhdGFjZW50ZXI6YzpvOjdlOWE2YmVlMWZlMDUxZjU5YTM1MWZkYzc2YTVlOThmOnYxOmg6VA==>
[cid:image378974.png@A6154DF9.C6D27CA5]
Innovation House, 12‑13 Bredbury Business Park Bredbury Park Way, Bredbury, 
Stockport, SK6 2SN -Original Message-
From: Alexandru Stan 
mailto:alexandru.s...@lifeincloud.com.INVALID>>
Sent: Thursday, May 23, 2024 11:17 AM
To: users@cloudstack.apache.org<mailto:users@cloudstack.apache.org>
Subject: RE: Windows VM performance in ACS

Hi Gary,

That’s what I used when registering the ISO. Doesn’t seem to help at all 
unfortunately.


From: Gary Dixon 
mailto:gary.di...@quadris.co.uk.INVALID>>
Sent: Thursday, May 23, 2024 1:14 PM
To: users@cloudstack.apache.org<mailto:users@cloudstack.apache.org>
Subject: RE: Windows VM performance in ACS

HI Alexandru

We use "Windows PV" OS type on our Windows VM's - this provides the Hyper-V 
enlightenments.

BR

Gary

[cid:image795113.png@DAEF2351.E3855BD4]
Gary Dixon
Quadris Cloud Manager
[cid:image752066.png@3A68EBBE.280BF225]
+44 (0) 161 537 4980
+44 (0) 7989 717661
[cid:image143416.png@CD1E068B.3BF4E714]
gary.di...@quadris.co.uk<mailto:gary.di...@quadris.co.uk<mailto:gary.di...@quadris.co.uk%3cmailto:gary.di...@quadris.co.uk>>
[cid:image596607.png@BDE27FFF.72E872DF]
https://checkpoint.url-protection.com/v1/url?o=http%3A//www.quadris.com/=N2M5MzIzZDYzMzk1YzU1ZA===NTIwNzczY2E1ZjI5MGJkNzY4YmYyYzhlMmJmMmRhZjI2ZTU2N2E5MmQxMThmZDM1NTE5YWQwNjU2NTBkODZiYQ===Y3AxZTpueHRnZW5pbmZpbml0ZWRhdGFjZW50ZXI6YzpvOmEzMTc5ZmM5MjI1ZTc3NTIxOGEyMTUwOTlhZWE2NGNhOnYxOnA6VA==<https://checkp

Re: Windows VM performance in ACS

[Jayanth Babu A]

Hello Alexandru,
Thanks for sharing. The reason could be that the VM is using IDE instead of 
virtio. Please stop the VM and add the key "rootDiskController" with value 
"virtio" and see the difference. You'll have to ensure that virtio drivers are 
installed on the VM so that it would be able to detect the disks.

Thanks,
Jayanth


From: Alexandru Stan 
Sent: Friday, May 24, 2024 12:21:03 am
To: users@cloudstack.apache.org 
Subject: RE: Windows VM performance in ACS

Hi Jayanth,

I don't have that key. In the settings section of the vm there are 2 keys, 
Message.ReservedCapacityFreed.Flag and rootdisksize.
I don't have a template yet, actually this vm was installed from a Windows ISO 
(that is registered as Windows PV in ACS) and I was hoping to transform it into 
a template with cloudbase-init, but since the performance is so bad I didn't 
get past the updates phase...

Alex


-Original Message-
From: Jayanth Babu A 
Sent: Thursday, May 23, 2024 4:54 PM
To: users@cloudstack.apache.org
Subject: Re: Windows VM performance in ACS

Hello Alexandru,
I’m not able to see the image. Would you please check the value for the key 
“rootDiskController” in both template and the Windows VM if the template OS 
type is “Windows PV” already? You’ll find it in the settings section.

Regards,
Jayanth Reddy

From: Alexandru Stan 
Date: Thursday, 23 May 2024 at 5:53 PM
To: users@cloudstack.apache.org 
Subject: RE: Windows VM performance in ACS Yes, I installed the guest tools 
right at first boot.

[cid:image001.png@01DAAD25.1CAA02B0]

From: Gary Dixon 
Sent: Thursday, May 23, 2024 2:32 PM
To: users@cloudstack.apache.org
Subject: RE: Windows VM performance in ACS

Have you checked in the VM's device manager that all devices are using virtio 
drivers (disk, disk controller, nic adapter etc) 
[cid:image535355.png@39364AC9.99EC2427]
Gary Dixon
Quadris Cloud Manager
[cid:image073403.png@5F5163CD.BCC16405]
+44 (0) 161 537 4980
 +44 (0) 7989 717661
[cid:image544450.png@462E4508.F6776E5F]
gary.di...@quadris.co.uk<mailto:gary.di...@quadris.co.uk>
[cid:image958545.png@2524980D.56B1E4D4]
https://checkpoint.url-protection.com/v1/url?o=www.quadris.com=OWQ3Y2VjYjI5MzFmMDhlYQ===ODIxMzViOWYyNWQ3YzFhMTNhYmJiY2FjNWFjM2NlMTQxYzA0OTkxZmIxNzlkMTI0ZDQ4NWQ3ZjZhY2E2ZTVmNg===Y3AxZTpueHRnZW5pbmZpbml0ZWRhdGFjZW50ZXI6YzpvOmEzMTc5ZmM5MjI1ZTc3NTIxOGEyMTUwOTlhZWE2NGNhOnYxOnA6VA==<https://checkpoint.url-protection.com/v1/url?o=http%3A//www.quadris.com=NjRjMmNhNWQxNWIyNTc5YQ===Yzc1OTFlZWZiYjA5ZThkYzZkYzVkNzAzZGVkOWE5NGViZTliZGRhODBiYmM2ZGZhNDg1OTNmN2VjNThhYmJhNA===Y3AxZTpueHRnZW5pbmZpbml0ZWRhdGFjZW50ZXI6YzpvOjdlOWE2YmVlMWZlMDUxZjU5YTM1MWZkYzc2YTVlOThmOnYxOmg6VA==>
[cid:image378974.png@A6154DF9.C6D27CA5]
Innovation House, 12‑13 Bredbury Business Park Bredbury Park Way, Bredbury, 
Stockport, SK6 2SN -Original Message-
From: Alexandru Stan 
mailto:alexandru.s...@lifeincloud.com.INVALID>>
Sent: Thursday, May 23, 2024 11:17 AM
To: users@cloudstack.apache.org<mailto:users@cloudstack.apache.org>
Subject: RE: Windows VM performance in ACS

Hi Gary,

That’s what I used when registering the ISO. Doesn’t seem to help at all 
unfortunately.


From: Gary Dixon 
mailto:gary.di...@quadris.co.uk.INVALID>>
Sent: Thursday, May 23, 2024 1:14 PM
To: users@cloudstack.apache.org<mailto:users@cloudstack.apache.org>
Subject: RE: Windows VM performance in ACS

HI Alexandru

We use "Windows PV" OS type on our Windows VM's - this provides the Hyper-V 
enlightenments.

BR

Gary

[cid:image795113.png@DAEF2351.E3855BD4]
Gary Dixon
Quadris Cloud Manager
[cid:image752066.png@3A68EBBE.280BF225]
+44 (0) 161 537 4980
+44 (0) 7989 717661
[cid:image143416.png@CD1E068B.3BF4E714]
gary.di...@quadris.co.uk<mailto:gary.di...@quadris.co.uk<mailto:gary.di...@quadris.co.uk%3cmailto:gary.di...@quadris.co.uk>>
[cid:image596607.png@BDE27FFF.72E872DF]
https://checkpoint.url-protection.com/v1/url?o=http%3A//www.quadris.com/=N2M5MzIzZDYzMzk1YzU1ZA===NTIwNzczY2E1ZjI5MGJkNzY4YmYyYzhlMmJmMmRhZjI2ZTU2N2E5MmQxMThmZDM1NTE5YWQwNjU2NTBkODZiYQ===Y3AxZTpueHRnZW5pbmZpbml0ZWRhdGFjZW50ZXI6YzpvOmEzMTc5ZmM5MjI1ZTc3NTIxOGEyMTUwOTlhZWE2NGNhOnYxOnA6VA==<https://checkpoint.url-protection.com/v1/url?o=http%3A//www.quadris.com/=MjI3YTZlZjZhNTJhYzNlZg===NzE1OTIyZGVhOWE3MmRiYjI4YTE0YWQ4MDI3NWZhMjg3NmQ2MGU3MzBhNzZiOGI1NmQyMDllZmU2MWEwMjJiNg===Y3AxZTpueHRnZW5pbmZpbml0ZWRhdGFjZW50ZXI6YzpvOmEzMTc5ZmM5MjI1ZTc3NTIxOGEyMTUwOTlhZWE2NGNhOnYxOnA6VA==<https://checkpoint.url-protection.com/v1/url?o=http%3A//www.quadris.com/%253chttp%3A/www.quadris.com/=ZjQ2Y2VhYzY0YzMzM2NmZA===MTY1YzQ3YTMwMDBmNmNhMjQzZGZhNDk0MGU0ZTdkM2FmMmFhMmEyNzkwY2Y1MWM3YjU0OGFlODY2MjgzZTAwNw===Y3AxZTpueHRnZW5pbmZpbml0ZWRhdGFjZW50ZXI6YzpvOjdlOWE2YmVlMWZlMDUxZjU5YTM1MWZkYzc2YTVlOThmOnYxOmg6VA==>>
[cid:image382983.png@B32DDBFC.505CE7AD]
Innovation House, 12‑13 Bredbury Business Park Bredbury Park Way, Bredbur

Re: Windows VM performance in ACS

[Jayanth Babu A]

Hello Alexandru,
I’m not able to see the image. Would you please check the value for the key 
“rootDiskController” in both template and the Windows VM if the template OS 
type is “Windows PV” already? You’ll find it in the settings section.

Regards,
Jayanth Reddy

From: Alexandru Stan 
Date: Thursday, 23 May 2024 at 5:53 PM
To: users@cloudstack.apache.org 
Subject: RE: Windows VM performance in ACS
Yes, I installed the guest tools right at first boot.

[cid:image001.png@01DAAD25.1CAA02B0]

From: Gary Dixon 
Sent: Thursday, May 23, 2024 2:32 PM
To: users@cloudstack.apache.org
Subject: RE: Windows VM performance in ACS

Have you checked in the VM's device manager that all devices are using virtio 
drivers (disk, disk controller, nic adapter etc)
[cid:image535355.png@39364AC9.99EC2427]
Gary Dixon
Quadris Cloud Manager
[cid:image073403.png@5F5163CD.BCC16405]
+44 (0) 161 537 4980
 +44 (0) 7989 717661
[cid:image544450.png@462E4508.F6776E5F]
gary.di...@quadris.co.uk
[cid:image958545.png@2524980D.56B1E4D4]
www.quadris.com
[cid:image378974.png@A6154DF9.C6D27CA5]
Innovation House, 12‑13 Bredbury Business Park
Bredbury Park Way, Bredbury, Stockport, SK6 2SN
-Original Message-
From: Alexandru Stan 
mailto:alexandru.s...@lifeincloud.com.INVALID>>
Sent: Thursday, May 23, 2024 11:17 AM
To: users@cloudstack.apache.org
Subject: RE: Windows VM performance in ACS

Hi Gary,

That’s what I used when registering the ISO. Doesn’t seem to help at all 
unfortunately.


From: Gary Dixon 
mailto:gary.di...@quadris.co.uk.INVALID>>
Sent: Thursday, May 23, 2024 1:14 PM
To: users@cloudstack.apache.org
Subject: RE: Windows VM performance in ACS

HI Alexandru

We use "Windows PV" OS type on our Windows VM's - this provides the Hyper-V 
enlightenments.

BR

Gary

[cid:image795113.png@DAEF2351.E3855BD4]
Gary Dixon
Quadris Cloud Manager
[cid:image752066.png@3A68EBBE.280BF225]
+44 (0) 161 537 4980
+44 (0) 7989 717661
[cid:image143416.png@CD1E068B.3BF4E714]
gary.di...@quadris.co.uk>
[cid:image596607.png@BDE27FFF.72E872DF]
http://www.quadris.com/>
[cid:image382983.png@B32DDBFC.505CE7AD]
Innovation House, 12‑13 Bredbury Business Park Bredbury Park Way, Bredbury, 
Stockport, SK6 2SN -Original Message-
From: Alexandru Stan 
mailto:alexandru.s...@lifeincloud.com.INVALID>>
Sent: Thursday, May 23, 2024 10:40 AM
To: 
users@cloudstack.apache.org>
Subject: Windows VM performance in ACS

Hi everyone,

Is there anything that must be done to improve the performance of Windows VMs 
in ACS? I tried to deploy a W10 instance, with the virtio drivers, and the 
performance is very, very poor (for example it took almost 3 hours to install a 
CU, the actual setup took about 50 minutes and so on). The hypervisor kvm on a 
HP server, with ssd's for storage. In other apps there are those hyper-v 
enlightments that can be enabled for Windows guests and it really makes a 
difference, but I have no idea if this is a thing in ACS too. If someone has 
some info on this, please share.

Thank you!
Disclaimer *** This e-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION 
intended solely for the use of the addressee(s). If you are not the intended 
recipient, please notify the sender by e-mail and delete the original message. 
Further, you are not authorised to copy, disclose, or distribute this e-mail or 
its contents to any other person and any such actions are unlawful and strictly 
prohibited. This e-mail may contain viruses. NxtGen Datacenter & Cloud 
Technologies Private Ltd (“NxtGen”) has taken every reasonable precaution to 
minimize this risk but is not liable for any damage you may sustain as a result 
of any virus in this e-mail. You should carry out your own virus checks before 
opening the e-mail or attachment. NxtGen reserves the right to monitor and 
review the content of all messages sent to or from this e-mail address. 
Messages sent to or from this e-mail address may be stored on the NxtGen e-mail 
system. *** 

Re: Let's Encrypt

[Jayanth Babu A]

Hi Ian,
Yes. In this case, the ACS management server doesn’t need any additional 
configuration but you’ll have to take care of CPVM and SSVM (optionally) like 
Ruben suggested. Also see [1] where you should have a CA signed one instead.

[1] https://github.com/apache/cloudstack/discussions/9013

Regards,
Jayanth Reddy

From: Ian Tobin 
Date: Tuesday, 21 May 2024 at 5:40 AM
To: users@cloudstack.apache.org 
Subject: RE: Let's Encrypt
Hi Ruben,

Thanks for the info, do you mean running ACME on the reverse proxy? Anything 
needing to be configured on the ACS management server?

Thanks

Ian




-Original Message-
From: Ruben Bosch 
Sent: 20 May 2024 23:38
To: users@cloudstack.apache.org
Subject: Re: Let's Encrypt

Ian, this is easily achievable by means of an ACME client (Certbot) and running 
ACS management behind a reverse proxy. You can write a hook to upload a 
certificate to the CPVM as well. (
https://checkpoint.url-protection.com/v1/url?o=https%3A//cloudstack.apache.org/api/apidocs-4.16/apis/uploadCustomCertificate.html=NTI4NzIzY2NiZTM4YzE1Yw===N2JiM2Q5ZTFmY2NiZDUwYTkxM2U0ODY5MmM2MjhlNjNkMWY4ZjlhNTQ0MWFjMDQwNTAwYWU1YzI4NDEwNjllMQ===Y3AxZTpueHRnZW5pbmZpbml0ZWRhdGFjZW50ZXI6YzpvOmU1YWQ3MDZjNDAzYjhiMGQzNTM0MmZhMjcyZGIyODFhOnYxOnA6VA==)
Just be mindful that the CPVM requires a wildcard certificate.

On Mon, May 20, 2024 at 2:50 PM Ian Tobin 
wrote:

> Hi,
>
> Are there any plans to implement Let's Encrypt with CS? More so
> securing the Management console and Proxy.
>
> Thanks
>
> Ian
>
>
>
Disclaimer *** This e-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION 
intended solely for the use of the addressee(s). If you are not the intended 
recipient, please notify the sender by e-mail and delete the original message. 
Further, you are not authorised to copy, disclose, or distribute this e-mail or 
its contents to any other person and any such actions are unlawful and strictly 
prohibited. This e-mail may contain viruses. NxtGen Datacenter & Cloud 
Technologies Private Ltd (“NxtGen”) has taken every reasonable precaution to 
minimize this risk but is not liable for any damage you may sustain as a result 
of any virus in this e-mail. You should carry out your own virus checks before 
opening the e-mail or attachment. NxtGen reserves the right to monitor and 
review the content of all messages sent to or from this e-mail address. 
Messages sent to or from this e-mail address may be stored on the NxtGen e-mail 
system. *** End of Disclaimer ***NXTGEN***

Re: Primary storage recovery

[Jayanth Babu A]

Hello Niclas,
May I know what is the version of CloudStack, is it 4.19?

Let us say we keep the "browse" functionality aside for now, are you able to 
start and manage the VMs, images and ISOs from CloudStack?

You also said that you managed to restore a backup, how much loss are we 
talking about here?

Thanks,
Jayanth


From: Niclas Lindblom 
Sent: Saturday, April 6, 2024 2:11:14 pm
To: users@cloudstack.apache.org 
Subject: Primary storage recovery

Hello,

I have had a disk failure on my NFS server which hosts primary and secondary 
storage. I have managed to restore a backup and the file structure is back on 
the primary storage on the NFS server. However, it seems Cloudstack has lost 
the reference to it, Primary storage is showing as “up”, but when I click 
browse, it’s empty. I have validated the NFS connection and can mount the 
primary storage to a test folder, so it appears there is some relation between 
cloudstack and the primary storage volumes that’s disappeared.

I am in a bit of panic mode here, so it’s possible I missed something but are 
there any steps I could take from here ?

Thanks

Niclas
Disclaimer *** This e-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION 
intended solely for the use of the addressee(s). If you are not the intended 
recipient, please notify the sender by e-mail and delete the original message. 
Further, you are not authorised to copy, disclose, or distribute this e-mail or 
its contents to any other person and any such actions are unlawful and strictly 
prohibited. This e-mail may contain viruses. NxtGen Datacenter & Cloud 
Technologies Private Ltd (“NxtGen”) has taken every reasonable precaution to 
minimize this risk but is not liable for any damage you may sustain as a result 
of any virus in this e-mail. You should carry out your own virus checks before 
opening the e-mail or attachment. NxtGen reserves the right to monitor and 
review the content of all messages sent to or from this e-mail address. 
Messages sent to or from this e-mail address may be stored on the NxtGen e-mail 
system. *** End of Disclaimer ***NXTGEN***

Re: any qcow2 pfsense image public available?

[Jayanth Babu A]

Not sure if I know anyone who does it anymore. I still see that creating a 
template from ISO is a safe bet [1] though you mentioned that you'd want to 
skip them.

[1] https://www.shapeblue.com/vnf-appliance-integration-deep-dive/

Thanks,
Jayanth



From: Ricardo Pertuz 
Sent: Saturday, March 30, 2024 10:01:00 pm
To: users@cloudstack.apache.org 
Subject: any qcow2 pfsense image public available?

Hi community

Is there any qcow2 pfsense image for VNF public available to do a POC? We want 
to skip the ISO steps

Regards!



Ricardo Pertuz



Disclaimer *** This e-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION 
intended solely for the use of the addressee(s). If you are not the intended 
recipient, please notify the sender by e-mail and delete the original message. 
Further, you are not authorised to copy, disclose, or distribute this e-mail or 
its contents to any other person and any such actions are unlawful and strictly 
prohibited. This e-mail may contain viruses. NxtGen Datacenter & Cloud 
Technologies Private Ltd ("NxtGen") has taken every reasonable precaution to 
minimize this risk but is not liable for any damage you may sustain as a result 
of any virus in this e-mail. You should carry out your own virus checks before 
opening the e-mail or attachment. NxtGen reserves the right to monitor and 
review the content of all messages sent to or from this e-mail address. 
Messages sent to or from this e-mail address may be stored on the NxtGen e-mail 
system. *** End of Disclaimer ***NXTGEN***

Re: Understanding Secondary Storage Traffic

[Jayanth Babu A]

Alright. CephFS and RBD stay in different Ceph pools. To clarify, this is how 
CloudStack does it

  1.  Upload of Guest Images and ISOs:  The secondary storage VM mounts the NFS 
share (from CephFS) and writes the images to CephFS pool.
  2.  Instance Launch for the first time: The RBD image gets created from the 
QCOW2 (or compatible) stored in NFS (CephFS). This is performed by the 
hypervisor which mounts the NFS share and creates a RBD image.
  3.  Disk Snapshots: Hypervisor mounts the NFS share (also does the format 
conversion from RAW to QCOW2) and stores it on NFS share (CephFS).

Now coming to your question, there is no inter-pool copy in Ceph for any 
transactions, so consider some additional copying over secondary storage and 
hypervisor plus protocol translations between RBD and NFS. A secondary storage 
instance is bound on the “management” network of hypervisors so can make use of 
your 4 * 100 Gbps in presence of a trunk for management and other networks.

In case you’re planning for external NFS server by any chance, please plan your 
network interface of the NFS server in such a way that the secondary storage 
and hypervisors are able to serve all the 3 points mentioned above at the scale 
of the infrastructure.

Regards,
Jayanth Reddy

From: R A 
Date: Friday, 29 March 2024 at 4:06 PM
To: users@cloudstack.apache.org 
Subject: RE: Understanding Secondary Storage Traffic
Yes, CephFS over NFS (ganesha)


From: R A mailto:jarhe...@hotmail.de>>
Date: Friday, 29 March 2024 at 2:10 PM
To: users@cloudstack.apache.org 
mailto:users@cloudstack.apache.org>>
Subject: Understanding Secondary Storage Traffic

Hello Community,

i am planning a cloudstack hyperconverged cluster with Ceph as primary and 
secondary storage.

I already know that snapshots, volume backups and images are transferred via 
secondary storage interface, but I have problems in understanding the correct 
flow.

Maybe someone can explain it to me , because i need to understand which loads 
are transferred via secondary to size the interface correctly.

In my setup I ve 2x nics with each 2x 100Gbits ports for eph cluster network 
and public network. So in sum Ceph has 400Gbits on each host. So now the 
documentation says that cloudstack will transfer snapshots/images/backups via 
secondary storage. But I don't get it because the data is hosted by ceph and 
ceph has a capability of 400Gbit. So when I for example use 30Gbits for 
secondary storage will this limitate snapshots/images/backups to 30Gbits? Or 
does it mean that cloudstack use the secondary storage network for management 
things, but the data are still transferred by ceph?

BR
Reza

Disclaimer *** This e-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION 
intended solely for the use of the addressee(s). If you are not the intended 
recipient, please notify the sender by e-mail and delete the original message. 
Further, you are not authorised to copy, disclose, or distribute this e-mail or 
its contents to any other person and any such actions are unlawful and strictly 
prohibited. This e-mail may contain viruses. NxtGen Datacenter & Cloud 
Technologies Private Ltd (“NxtGen”) has taken every reasonable precaution to 
minimize this risk but is not liable for any damage you may sustain as a result 
of any virus in this e-mail. You should carry out your own virus checks before 
opening the e-mail or attachment. NxtGen reserves the right to monitor and 
review the content of all messages sent to or from this e-mail address. 
Messages sent to or from this e-mail address may be stored on the NxtGen e-mail 
system. *** End of Disclaimer ***NXTGEN***

Re: Understanding Secondary Storage Traffic

[Jayanth Babu A]

Hello,
Are you planning to use CephFS over NFS for your secondary storage?

Regards,
Jayanth Reddy

From: R A 
Date: Friday, 29 March 2024 at 2:10 PM
To: users@cloudstack.apache.org 
Subject: Understanding Secondary Storage Traffic

Hello Community,

i am planning a cloudstack hyperconverged cluster with Ceph as primary and 
secondary storage.

I already know that snapshots, volume backups and images are transferred via 
secondary storage interface, but I have problems in understanding the correct 
flow.

Maybe someone can explain it to me , because i need to understand which loads 
are transferred via secondary to size the interface correctly.

In my setup I ve 2x nics with each 2x 100Gbits ports for eph cluster network 
and public network. So in sum Ceph has 400Gbits on each host. So now the 
documentation says that cloudstack will transfer snapshots/images/backups via 
secondary storage. But I don't get it because the data is hosted by ceph and 
ceph has a capability of 400Gbit. So when I for example use 30Gbits for 
secondary storage will this limitate snapshots/images/backups to 30Gbits? Or 
does it mean that cloudstack use the secondary storage network for management 
things, but the data are still transferred by ceph?

BR
Reza
Disclaimer *** This e-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION 
intended solely for the use of the addressee(s). If you are not the intended 
recipient, please notify the sender by e-mail and delete the original message. 
Further, you are not authorised to copy, disclose, or distribute this e-mail or 
its contents to any other person and any such actions are unlawful and strictly 
prohibited. This e-mail may contain viruses. NxtGen Datacenter & Cloud 
Technologies Private Ltd (“NxtGen”) has taken every reasonable precaution to 
minimize this risk but is not liable for any damage you may sustain as a result 
of any virus in this e-mail. You should carry out your own virus checks before 
opening the e-mail or attachment. NxtGen reserves the right to monitor and 
review the content of all messages sent to or from this e-mail address. 
Messages sent to or from this e-mail address may be stored on the NxtGen e-mail 
system. *** End of Disclaimer ***NXTGEN***

Re: CKS with K8s Offering N/w

[Jayanth Babu A]

+1

Bharat, see if you can start using the isolated network to get the full 
experience of CKS. In shared network you should only rely on connecting to node 
ports or have an external load balancer (outside of CloudStack) balance the 
traffic to the node ports where any service like traefik runs.

Thanks,
Jayanth


From: Wei ZHOU 
Sent: Friday, March 1, 2024 11:20:09 pm
To: users@cloudstack.apache.org 
Subject: Re: CKS with K8s Offering N/w

Hi,

Just my 2 cents.

If you use NodePort, you need to know which worker node the pod is runing
on. It is a problem if there are multiple nodes. To solve this problem,
LoadBalancer can be used. cloudstack creates a load balancing rule to the
NodePort of all worker nodes. So the service can be accessible no matter
where the pod is. However, this only works with Isolated networks, as
shared networks do not support Load Balancer.

traefik may work for you, I did not look into it yet. Another way is as I
have suggested, use kubectl port-forward to access the services with
ClusterIP.

-Wei


On Friday, March 1, 2024, Bharat Bhushan Saini
 wrote:

> Hi Jayanth,
>
>
>
> Just as an query I want to know that when the cluster run on shared
> network the traefik-ingress-controller is required to access the
> application externally else nodeport defind is enough for that.
>
>
>
> Thanks and Regards,
>
> Bharat Saini
>
>
>
> [image: signature_3414558938]
>
>
>
> *From: *Jayanth Babu A 
> *Date: *Friday, 1 March 2024 at 9:09 PM
> *To: *users@cloudstack.apache.org 
> *Subject: *Re: CKS with K8s Offering N/w
>
> EXTERNAL EMAIL: Please verify the sender email address before taking any
> action, replying, clicking any link or opening any attachment.
>
>
> Hi Bharat,
>
> I don't seem to understand your question. Would you please explain in more
> detail?
>
> Thanks,
> Jayanth
>
> 
> From: Bharat Bhushan Saini 
> Sent: Friday, March 1, 2024 3:15:18 pm
> To: users@cloudstack.apache.org 
> Subject: Re: CKS with K8s Offering N/w
>
> Hi Wei,
>
> In shared n/w the traefik ingress is needed or only nodeport is enough for
> that!
>
> Thanks and Regards,
> Bharat Saini
>
> [signature_1176335358]
>
> From: Wei ZHOU 
> Date: Friday, 1 March 2024 at 1:59 PM
> To: users@cloudstack.apache.org 
> Subject: Re: CKS with K8s Offering N/w
> EXTERNAL EMAIL: Please verify the sender email address before taking any
> action, replying, clicking any link or opening any attachment.
>
>
> Hi Bharat,
>
> If you deploy a CKS cluster on an isolated network, please ensure the
> public Ips (which include the endpoint IP of the CKS cluster, and Load
> balancer IPs) are reachable from the management server.
> The management server configures the k8s nodes (controller/worker) via the
> port -222x of endpoint IP.
>
> If you deploy a CKS cluster on a shared network, Load balancer is not
> supported.
> If you create a K8s service with nodeport, you can access it by  IP>:.
> If clusterIP is used, to access the service, you need to run "kubectl
> port-forward" on the controller node.
>
>
> -Wei
>
>

Disclaimer *** This e-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION 
intended solely for the use of the addressee(s). If you are not the intended 
recipient, please notify the sender by e-mail and delete the original message. 
Further, you are not authorised to copy, disclose, or distribute this e-mail or 
its contents to any other person and any such actions are unlawful and strictly 
prohibited. This e-mail may contain viruses. NxtGen Datacenter & Cloud 
Technologies Private Ltd ("NxtGen") has taken every reasonable precaution to 
minimize this risk but is not liable for any damage you may sustain as a result 
of any virus in this e-mail. You should carry out your own virus checks before 
opening the e-mail or attachment. NxtGen reserves the right to monitor and 
review the content of all messages sent to or from this e-mail address. 
Messages sent to or from this e-mail address may be stored on the NxtGen e-mail 
system. *** End of Disclaimer ***NXTGEN***

Re: CKS with K8s Offering N/w

[Jayanth Babu A]

Hi Bharat,

I don't seem to understand your question. Would you please explain in more 
detail?

Thanks,
Jayanth


From: Bharat Bhushan Saini 
Sent: Friday, March 1, 2024 3:15:18 pm
To: users@cloudstack.apache.org 
Subject: Re: CKS with K8s Offering N/w

Hi Wei,

In shared n/w the traefik ingress is needed or only nodeport is enough for that!

Thanks and Regards,
Bharat Saini

[signature_1176335358]

From: Wei ZHOU 
Date: Friday, 1 March 2024 at 1:59 PM
To: users@cloudstack.apache.org 
Subject: Re: CKS with K8s Offering N/w
EXTERNAL EMAIL: Please verify the sender email address before taking any 
action, replying, clicking any link or opening any attachment.


Hi Bharat,

If you deploy a CKS cluster on an isolated network, please ensure the
public Ips (which include the endpoint IP of the CKS cluster, and Load
balancer IPs) are reachable from the management server.
The management server configures the k8s nodes (controller/worker) via the
port -222x of endpoint IP.

If you deploy a CKS cluster on a shared network, Load balancer is not
supported.
If you create a K8s service with nodeport, you can access it by :.
If clusterIP is used, to access the service, you need to run "kubectl
port-forward" on the controller node.


-Wei



On Fri, Mar 1, 2024 at 7:08 AM Bharat Bhushan Saini
 wrote:

> Hi Wei,
>
>
>
> I deployed cloudstack 4.18.1 on ubuntu 22.04 LTS on a standalone server
> with kvm,nfs consist.
>
>
>
> I already tested some vm’s on the cloudstack on a shared network with
> untagged vlan because what IP range I have that was bridged with the
> private n/w and natting is enabled on that. On shared n/w I am able to
> access internet but in isolated or L2 config it can’t.
>
>
>
> As per your suggestion, I tried with create default k8s n/w and also
> create a network which have the same config of default k8s n/w but I untag
> the vlan in that n/w. Both was not working.
>
> On shared n/w I a able to spawn the cluster and also able to login with
> key and also deploy an application but the containers was running on the
> Cluster IP.
>
>
>
> Thanks and Regards,
>
> Bharat Saini
>
>
>
> [image: signature_2926674288]
>
>
>

--- Disclaimer: --
This message and its contents are intended solely for the designated addressee 
and are proprietary to Kloudspot. The information in this email is meant 
exclusively for Kloudspot business use. Any use by individuals other than the 
addressee constitutes misuse and an infringement of Kloudspot's proprietary 
rights. If you are not the intended recipient, please return this email to the 
sender. Kloudspot cannot guarantee the security or error-free transmission of 
e-mail communications. Information could be intercepted, corrupted, lost, 
destroyed, arrive late or incomplete, or contain viruses. Therefore, Kloudspot 
shall not be liable for any issues arising from the transmission of this email.

Disclaimer *** This e-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION 
intended solely for the use of the addressee(s). If you are not the intended 
recipient, please notify the sender by e-mail and delete the original message. 
Further, you are not authorised to copy, disclose, or distribute this e-mail or 
its contents to any other person and any such actions are unlawful and strictly 
prohibited. This e-mail may contain viruses. NxtGen Datacenter & Cloud 
Technologies Private Ltd (“NxtGen”) has taken every reasonable precaution to 
minimize this risk but is not liable for any damage you may sustain as a result 
of any virus in this e-mail. You should carry out your own virus checks before 
opening the e-mail or attachment. NxtGen reserves the right to monitor and 
review the content of all messages sent to or from this e-mail address. 
Messages sent to or from this e-mail address may be stored on the NxtGen e-mail 
system. *** End of Disclaimer ***NXTGEN***

Re: Network Issue with Cluster

[Jayanth Babu A]

I think this has something to do with your network and not CloudStack. Let us 
know what you find after the analysis.


Thanks,
Jayanth

From: Bharat Bhushan Saini 
Sent: Friday, March 1, 2024 6:02:09 PM
To: users@cloudstack.apache.org 
Subject: Re: Network Issue with Cluster


Hi Jayanth,



My point is not among the vm’s. Concern in the shared network, as what the IP 
allocated in that range is having latency.

Day before yesterday, the network is working fine.



Thanks and Regards,

Bharat Saini



[signature_1001564804]



From: Jayanth Babu A 
Date: Friday, 1 March 2024 at 5:33 PM
To: users@cloudstack.apache.org 
Subject: Re: Network Issue with Cluster

EXTERNAL EMAIL: Please verify the sender email address before taking any 
action, replying, clicking any link or opening any attachment.


Hello Bharat,

Are you saying that you're observing the latency among the VMs in the same 
network?


Thanks,
Jayanth


From: Bharat Bhushan Saini 
Sent: Friday, March 1, 2024 5:20:22 pm
To: users@cloudstack.apache.org 
Subject: Network Issue with Cluster

Hi All,

Yesterday cloudstack deployment is running fine. Today I encountered an issue 
in the cloudstack 4.18.1.

The connectivity of the VM’s in the cloudstack dashboard having latches eg 
control and worker node. I also restarted the network but the issue is persist. 
Sharing the ping status of control node below,


PING 10.x.x.185 (10.x.x.185): 56 data bytes

Request timeout for icmp_seq 0

Request timeout for icmp_seq 1

Request timeout for icmp_seq 2

Request timeout for icmp_seq 3

Request timeout for icmp_seq 4

Request timeout for icmp_seq 5

Request timeout for icmp_seq 6

Request timeout for icmp_seq 7

Request timeout for icmp_seq 8

Request timeout for icmp_seq 9

64 bytes from 10.x.x.185: icmp_seq=10 ttl=63 time=4.954 ms

64 bytes from 10.x.x.185: icmp_seq=11 ttl=63 time=6.642 ms

Request timeout for icmp_seq 12

Request timeout for icmp_seq 13

Request timeout for icmp_seq 14

Request timeout for icmp_seq 15

Request timeout for icmp_seq 16

Request timeout for icmp_seq 17

^C

--- 10.x.x.185 ping statistics ---

19 packets transmitted, 2 packets received, 89.5% packet loss

round-trip min/avg/max/stddev = 4.954/5.798/6.642/0.844 ms

Ping status of MS as MS and KVM running on same machine as below,

PING 10.x.x.101 (10.1.10.101): 56 data bytes

64 bytes from 10.x.x.101: icmp_seq=0 ttl=63 time=9.528 ms

64 bytes from 10.x.x.101: icmp_seq=1 ttl=63 time=6.201 ms

64 bytes from 10.x.x.101: icmp_seq=2 ttl=63 time=8.534 ms

64 bytes from 10.x.x.101: icmp_seq=3 ttl=63 time=12.364 ms

64 bytes from 10.x.x.101: icmp_seq=4 ttl=63 time=12.948 ms

64 bytes from 10.x.x.101: icmp_seq=5 ttl=63 time=13.043 ms

^C

--- 10.x.x.101 ping statistics ---

6 packets transmitted, 6 packets received, 0.0% packet loss

round-trip min/avg/max/stddev = 6.201/10.436/13.043/2.556 ms


Thanks and Regards,
Bharat Saini

[signature_1700367617]

--- Disclaimer: --
This message and its contents are intended solely for the designated addressee 
and are proprietary to Kloudspot. The information in this email is meant 
exclusively for Kloudspot business use. Any use by individuals other than the 
addressee constitutes misuse and an infringement of Kloudspot's proprietary 
rights. If you are not the intended recipient, please return this email to the 
sender. Kloudspot cannot guarantee the security or error-free transmission of 
e-mail communications. Information could be intercepted, corrupted, lost, 
destroyed, arrive late or incomplete, or contain viruses. Therefore, Kloudspot 
shall not be liable for any issues arising from the transmission of this email.

Disclaimer *** This e-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION 
intended solely for the use of the addressee(s). If you are not the intended 
recipient, please notify the sender by e-mail and delete the original message. 
Further, you are not authorised to copy, disclose, or distribute this e-mail or 
its contents to any other person and any such actions are unlawful and strictly 
prohibited. This e-mail may contain viruses. NxtGen Datacenter & Cloud 
Technologies Private Ltd (“NxtGen”) has taken every reasonable precaution to 
minimize this risk but is not liable for any damage you may sustain as a result 
of any virus in this e-mail. You should carry out your own virus checks before 
opening the e-mail or attachment. NxtGen reserves the right to monitor and 
review the content of all messages sent to or from this e-mail address. 
Messages sent to or from this e-mail address may be stored on the NxtGen e-mail 
system. *** End of Disclaimer ***NXTGEN***

--- Disclaimer: --
This message and its contents are intended solely for the designated addressee 
and are proprietary to Kloudspot. The information in this email is meant 
exclusively for Kloud

Re: Network Issue with Cluster

[Jayanth Babu A]

Hello Bharat,

Are you saying that you're observing the latency among the VMs in the same 
network?


Thanks,
Jayanth


From: Bharat Bhushan Saini 
Sent: Friday, March 1, 2024 5:20:22 pm
To: users@cloudstack.apache.org 
Subject: Network Issue with Cluster

Hi All,

Yesterday cloudstack deployment is running fine. Today I encountered an issue 
in the cloudstack 4.18.1.

The connectivity of the VM’s in the cloudstack dashboard having latches eg 
control and worker node. I also restarted the network but the issue is persist. 
Sharing the ping status of control node below,


PING 10.x.x.185 (10.x.x.185): 56 data bytes

Request timeout for icmp_seq 0

Request timeout for icmp_seq 1

Request timeout for icmp_seq 2

Request timeout for icmp_seq 3

Request timeout for icmp_seq 4

Request timeout for icmp_seq 5

Request timeout for icmp_seq 6

Request timeout for icmp_seq 7

Request timeout for icmp_seq 8

Request timeout for icmp_seq 9

64 bytes from 10.x.x.185: icmp_seq=10 ttl=63 time=4.954 ms

64 bytes from 10.x.x.185: icmp_seq=11 ttl=63 time=6.642 ms

Request timeout for icmp_seq 12

Request timeout for icmp_seq 13

Request timeout for icmp_seq 14

Request timeout for icmp_seq 15

Request timeout for icmp_seq 16

Request timeout for icmp_seq 17

^C

--- 10.x.x.185 ping statistics ---

19 packets transmitted, 2 packets received, 89.5% packet loss

round-trip min/avg/max/stddev = 4.954/5.798/6.642/0.844 ms

Ping status of MS as MS and KVM running on same machine as below,

PING 10.x.x.101 (10.1.10.101): 56 data bytes

64 bytes from 10.x.x.101: icmp_seq=0 ttl=63 time=9.528 ms

64 bytes from 10.x.x.101: icmp_seq=1 ttl=63 time=6.201 ms

64 bytes from 10.x.x.101: icmp_seq=2 ttl=63 time=8.534 ms

64 bytes from 10.x.x.101: icmp_seq=3 ttl=63 time=12.364 ms

64 bytes from 10.x.x.101: icmp_seq=4 ttl=63 time=12.948 ms

64 bytes from 10.x.x.101: icmp_seq=5 ttl=63 time=13.043 ms

^C

--- 10.x.x.101 ping statistics ---

6 packets transmitted, 6 packets received, 0.0% packet loss

round-trip min/avg/max/stddev = 6.201/10.436/13.043/2.556 ms


Thanks and Regards,
Bharat Saini

[signature_1700367617]

--- Disclaimer: --
This message and its contents are intended solely for the designated addressee 
and are proprietary to Kloudspot. The information in this email is meant 
exclusively for Kloudspot business use. Any use by individuals other than the 
addressee constitutes misuse and an infringement of Kloudspot's proprietary 
rights. If you are not the intended recipient, please return this email to the 
sender. Kloudspot cannot guarantee the security or error-free transmission of 
e-mail communications. Information could be intercepted, corrupted, lost, 
destroyed, arrive late or incomplete, or contain viruses. Therefore, Kloudspot 
shall not be liable for any issues arising from the transmission of this email.

Disclaimer *** This e-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION 
intended solely for the use of the addressee(s). If you are not the intended 
recipient, please notify the sender by e-mail and delete the original message. 
Further, you are not authorised to copy, disclose, or distribute this e-mail or 
its contents to any other person and any such actions are unlawful and strictly 
prohibited. This e-mail may contain viruses. NxtGen Datacenter & Cloud 
Technologies Private Ltd (“NxtGen”) has taken every reasonable precaution to 
minimize this risk but is not liable for any damage you may sustain as a result 
of any virus in this e-mail. You should carry out your own virus checks before 
opening the e-mail or attachment. NxtGen reserves the right to monitor and 
review the content of all messages sent to or from this e-mail address. 
Messages sent to or from this e-mail address may be stored on the NxtGen e-mail 
system. *** End of Disclaimer ***NXTGEN***

Re: CKS Storage Provisioner Info

[Jayanth Babu A]

Hello Bharat,
Please confirm if you’re using self-signed or a signed certificate from trusted 
CA on your management server API endpoint. The error indicates that the CKS 
cannot complete the TLS handshake due to the common name or SAN mismatch.
It is usually advised to put Trusted CA signed-certificates and have the proper 
domain names or SAN that match the certificate. Please change the endpoint 
domain name accordingly in the global configuration setting “endpoint.url” and 
ensure the CKS nodes or network is able to resolve and connect to it.

Thanks,
Jayanth

From: Bharat Bhushan Saini 
Date: Wednesday, 28 February 2024 at 10:19
To: users@cloudstack.apache.org 
Subject: Re: CKS Storage Provisioner Info
Hi Jayanth,

I shows below

Error syncing load balancer: failed to ensure load balancer: error retrieving 
load balancer rules: Get 
https://checkpoint.url-protection.com/v1/url?o=https%3A//10.x.x.2%3A8443/client/api%3FapiKey%3Dk83H56KFdhFqpv7cXPU11nkwxPt8f2rXnm1WWVIRdeErqZr72Pzp7ySmricPWs7FQQuMmClznDhMz7uqnRD2wA%26amp%3Bcommand%3DlistLoadBalancerRules%26amp%3Bkeyword%3Da85de8a8ca0f543cca49e06fc3f30791%26amp%3Blistall%3Dtrue%26amp%3Bresponse%3Djson%26amp%3Bsignature%3DHVQNyOboMkqp4rwQYY6wLJ1NBzY%253D%3A=ZDM3OWY0MmUwMWVmMGVlMA===YTJhNGFiMWNiNzY1YWE1YWYzOTdhMzk0ZjlkNDkwYTgyMDNjOGQ5ZDU0ODM4MDcxMjAyNjQzOGM4MGI3NTFhZg===Y3AxZTpueHRnZW5pbmZpbml0ZWRhdGFjZW50ZXI6YzpvOjNiNDk1M2JiNmRjNDE0OGZlYmU4NTY0YmUzYjA4ODU4OnYxOnQ6VA==
 x509: cannot validate certificate for 10.x.x.2 because it doesn't contain any 
IP SANs

Can I put API URL as management URL?

Thanks and Regards,
Bharat Saini

[signature_1763564491]

From: Jayanth Babu A 
Date: Wednesday, 28 February 2024 at 10:15 AM
To: users@cloudstack.apache.org 
Subject: Re: CKS Storage Provisioner Info
EXTERNAL EMAIL: Please verify the sender email address before taking any 
action, replying, clicking any link or opening any attachment.


Hello Bharat,
What does “# kubectl describe svc/traefik” say?

Thanks,
Jayanth

From: Bharat Bhushan Saini 
Date: Wednesday, 28 February 2024 at 10:11
To: users@cloudstack.apache.org 
Subject: Re: CKS Storage Provisioner Info
Hi All,

I had some queries regarding CKS service

Why external IP is not shown in SVC. Do we have any resolvent for this and 
traefik service is in pending state as I have 1 control and 1 worker node.

kubectl get svc

NAME TYPE   CLUSTER-IP   EXTERNAL-IP   PORT(S)  
AGE

kubernetes   ClusterIP  10.96.0.1443/TCP  
39h

nginx-nodeport   NodePort   10.110.79.87 80:30918/TCP 
15h

nginx-serviceNodePort   10.110.244.170   80:32180/TCP 
17h

traefik  LoadBalancer   10.107.145.95 
80:32289/TCP,443:32426/TCP   17h

Inside the cluster the CLUSTER IP was continuous change by the 
SVC, I just login again and I saw that the CLUSTER IP is different from 
yesterday.

Thanks and Regards,
Bharat Saini

[signature_3834506047]

From: Jayanth Babu A 
Date: Tuesday, 27 February 2024 at 11:26 AM
To: users@cloudstack.apache.org 
Subject: Re: CKS Storage Provisioner Info
EXTERNAL EMAIL: Please verify the sender email address before taking any 
action, replying, clicking any link or opening any attachment.


Hello Bharat,
You’ve some well-known options as below:
https://github.com/kubernetes-sigs/nfs-subdir-external-provisioner<https://checkpoint.url-protection.com/v1/url?o=https%3A//github.com/kubernetes-sigs/nfs-subdir-external-provisioner=MjVhNGRiMTM5ZmE4NDM5NQ===ZDFhZDE3YWFiZDhiOGYyOThhZjI2MDdhNDJjNjE4MmU0NDQ3ZDNlZDQ3MTMxYjYxYjEwOTM2OWE4NTc1OTVlNQ===Y3AxZTpueHRnZW5pbmZpbml0ZWRhdGFjZW50ZXI6YzpvOjg2NDk3YWEwMzU5NmQ5NWE3NmFlNGUxMmNkMmEzZmE5OnYxOmg6VA==><https://checkpoint.url-protection.com/v1/url?o=https%3A//github.com/kubernetes-sigs/nfs-subdir-external-provisioner%253chttps%3A/checkpoint.url-protection.com/v1/url%3Fo%3Dhttps%253A//github.com/kubernetes-sigs/nfs-subdir-external-provisioner%26amp%3Bg%3DMjVhNGRiMTM5ZmE4NDM5NQ%3D%3D%26amp%3Bh%3DZDFhZDE3YWFiZDhiOGYyOThhZjI2MDdhNDJjNjE4MmU0NDQ3ZDNlZDQ3MTMxYjYxYjEwOTM2OWE4NTc1OTVlNQ%3D%3D%26amp%3Bp%3DY3AxZTpueHRnZW5pbmZpbml0ZWRhdGFjZW50ZXI6YzpvOjg2NDk3YWEwMzU5NmQ5NWE3NmFlNGUxMmNkMmEzZmE5OnYxOmg6VA%3D%3D%253e=Y2I2ODNlM2RiZmMzOTdiNg===OGM4YmE0YTZiMzRiNjA3MzJlYjRhZThhMjVlMzNlNmMxYTBiZjlmMjdhODg2Y2I2OGFiOTViYjUzMGExMWUyMg===Y3AxZTpueHRnZW5pbmZpbml0ZWRhdGFjZW50ZXI6YzpvOjNiNDk1M2JiNmRjNDE0OGZlYmU4NTY0YmUzYjA4ODU4OnYxOmg6VA==>
https://github.com/rook/rook<https://checkpoint.url-protection.com/v1/url?o=https%3A//github.com/rook/rook=ZWQ0NWJlZDEyYjM0ODE3Nw===MjQzMTQ4ZDczMjQ3OTRkMzI4MjdlNmQ4ZTc4NzQ4OTY1ZjM4ZDlmZDEyODc0OTE3OTNkZGRhZGRlMjZhOTdhMQ===Y3AxZTpueHRnZW5pbmZpbml0ZWRhdGFjZW50ZXI6YzpvOjg2NDk3YWEwMzU5NmQ5NWE3NmFlNGUxMmNkMmEzZmE5OnYxOmg6VA==><https://checkpoint.url-protection.com/v1/url?o=https%3A//github.com/rook/rook%253chttps%3A/checkpoint.url-protection.com/v1/url%3Fo%3Dhttps%253A//githu

Re: CKS Storage Provisioner Info

[Jayanth Babu A]

Hello Bharat,
What does “# kubectl describe svc/traefik” say?

Thanks,
Jayanth

From: Bharat Bhushan Saini 
Date: Wednesday, 28 February 2024 at 10:11
To: users@cloudstack.apache.org 
Subject: Re: CKS Storage Provisioner Info
Hi All,

I had some queries regarding CKS service

Why external IP is not shown in SVC. Do we have any resolvent for this and 
traefik service is in pending state as I have 1 control and 1 worker node.

kubectl get svc

NAME TYPE   CLUSTER-IP   EXTERNAL-IP   PORT(S)  
AGE

kubernetes   ClusterIP  10.96.0.1443/TCP  
39h

nginx-nodeport   NodePort   10.110.79.87 80:30918/TCP 
15h

nginx-serviceNodePort   10.110.244.170   80:32180/TCP 
17h

traefik  LoadBalancer   10.107.145.95 
80:32289/TCP,443:32426/TCP   17h

Inside the cluster the CLUSTER IP was continuous change by the 
SVC, I just login again and I saw that the CLUSTER IP is different from 
yesterday.

Thanks and Regards,
Bharat Saini

[signature_3834506047]

From: Jayanth Babu A 
Date: Tuesday, 27 February 2024 at 11:26 AM
To: users@cloudstack.apache.org 
Subject: Re: CKS Storage Provisioner Info
EXTERNAL EMAIL: Please verify the sender email address before taking any 
action, replying, clicking any link or opening any attachment.


Hello Bharat,
You’ve some well-known options as below:
https://github.com/kubernetes-sigs/nfs-subdir-external-provisioner<https://checkpoint.url-protection.com/v1/url?o=https%3A//github.com/kubernetes-sigs/nfs-subdir-external-provisioner=MjVhNGRiMTM5ZmE4NDM5NQ===ZDFhZDE3YWFiZDhiOGYyOThhZjI2MDdhNDJjNjE4MmU0NDQ3ZDNlZDQ3MTMxYjYxYjEwOTM2OWE4NTc1OTVlNQ===Y3AxZTpueHRnZW5pbmZpbml0ZWRhdGFjZW50ZXI6YzpvOjg2NDk3YWEwMzU5NmQ5NWE3NmFlNGUxMmNkMmEzZmE5OnYxOmg6VA==>
https://github.com/rook/rook<https://checkpoint.url-protection.com/v1/url?o=https%3A//github.com/rook/rook=ZWQ0NWJlZDEyYjM0ODE3Nw===MjQzMTQ4ZDczMjQ3OTRkMzI4MjdlNmQ4ZTc4NzQ4OTY1ZjM4ZDlmZDEyODc0OTE3OTNkZGRhZGRlMjZhOTdhMQ===Y3AxZTpueHRnZW5pbmZpbml0ZWRhdGFjZW50ZXI6YzpvOjg2NDk3YWEwMzU5NmQ5NWE3NmFlNGUxMmNkMmEzZmE5OnYxOmg6VA==>
 - CephFS & NFS can fit

Thanks,
Jayanth Reddy

From: Bharat Bhushan Saini 
Date: Tuesday, 27 February 2024 at 11:01
To: users@cloudstack.apache.org 
Subject: Re: CKS Storage Provisioner Info
Hi All,

Thanks for helping out for the storage provisioner.

In CKS service I am able to bound PVC as ReadWriteOnce with Leaseweb CloudStack 
CSI Driver.
Is there any opportunity in the cloudstack with other driver that I can bound 
storage as ReadWriteMany.

I tried with Leaseweb and got below warning
Warning  ProvisioningFailed6s (x5 over 21s)  
csi.cloudstack.apache.org_cloudstack-csi-controller-7f89c8cd47-ztllw_c6112933-3587-4445-8702-74b255b1e56f
  failed to provision volume with StorageClass "cloudstack-custom": rpc error: 
code = InvalidArgument desc = Volume capabilities not supported. Only 
SINGLE_NODE_WRITER supported.

Thanks and Regards,
Bharat Saini

[signature_636195584]

From: Kiran Chavala 
Date: Monday, 26 February 2024 at 5:54 PM
To: users@cloudstack.apache.org 
Subject: Re: CKS Storage Provisioner Info
EXTERNAL EMAIL: Please verify the sender email address before taking any 
action, replying, clicking any link or opening any attachment.


Hi Bharath

Note the CKS provisioner works on KVM based cloudstack environment

Regards
Kiran

From: Kiran Chavala 
Date: Monday, 26 February 2024 at 5:45 PM
To: users@cloudstack.apache.org 
Subject: Re: CKS Storage Provisioner Info
Hi Bharat Bhusan

Please follow these steps


1. Deploy a Kubernetes cluster on cluster


NAME STATUS   ROLES   AGE VERSION
ty-control-18de52c04f7   Readycontrol-plane   5m11s   v1.28.4
ty-node-18de52c4185  Ready  4m55s   v1.28.4

kubectl get secrets -A
NAMESPACE  NAME  TYPE   
 DATA   AGE
kube-systemcloudstack-secret Opaque 
 1  10m



2. Check the deployment, it should  be in pending

~ kubectl get deployments -A
NAMESPACE  NAMEREADY   UP-TO-DATE   
AVAILABLE   AGE
kube-systemcloudstack-csi-controller   0/1 10   
46s


3. Edit the deployment and remove the nodeSelector part

~kubectl edit deployment/cloudstack-csi-controller -n kube-system


  nodeSelector:
kubernetes.io/os: linux
node-role.kubernetes.io/master: ""

4. Check the deployment again  and it should be running state

~kubectl get deployments -A
NAMESPACE  NAMEREADY   UP-TO-DATE   
AVAILABLE   AGE
kube-systemcloudstack-csi-controller   1/1 11   
2m39s

5. Replace the disk offering in the storage class yaml

Provide the custom disk offering UUID (service offe

Re: CKS Storage Provisioner Info

[Jayanth Babu A]

Hello Bharat,
You’ve some well-known options as below:
https://github.com/kubernetes-sigs/nfs-subdir-external-provisioner
https://github.com/rook/rook - CephFS & NFS can fit

Thanks,
Jayanth Reddy

From: Bharat Bhushan Saini 
Date: Tuesday, 27 February 2024 at 11:01
To: users@cloudstack.apache.org 
Subject: Re: CKS Storage Provisioner Info
Hi All,

Thanks for helping out for the storage provisioner.

In CKS service I am able to bound PVC as ReadWriteOnce with Leaseweb CloudStack 
CSI Driver.
Is there any opportunity in the cloudstack with other driver that I can bound 
storage as ReadWriteMany.

I tried with Leaseweb and got below warning
Warning  ProvisioningFailed6s (x5 over 21s)  
csi.cloudstack.apache.org_cloudstack-csi-controller-7f89c8cd47-ztllw_c6112933-3587-4445-8702-74b255b1e56f
  failed to provision volume with StorageClass "cloudstack-custom": rpc error: 
code = InvalidArgument desc = Volume capabilities not supported. Only 
SINGLE_NODE_WRITER supported.

Thanks and Regards,
Bharat Saini

[signature_636195584]

From: Kiran Chavala 
Date: Monday, 26 February 2024 at 5:54 PM
To: users@cloudstack.apache.org 
Subject: Re: CKS Storage Provisioner Info
EXTERNAL EMAIL: Please verify the sender email address before taking any 
action, replying, clicking any link or opening any attachment.


Hi Bharath

Note the CKS provisioner works on KVM based cloudstack environment

Regards
Kiran

From: Kiran Chavala 
Date: Monday, 26 February 2024 at 5:45 PM
To: users@cloudstack.apache.org 
Subject: Re: CKS Storage Provisioner Info
Hi Bharat Bhusan

Please follow these steps


1. Deploy a Kubernetes cluster on cluster


NAME STATUS   ROLES   AGE VERSION
ty-control-18de52c04f7   Readycontrol-plane   5m11s   v1.28.4
ty-node-18de52c4185  Ready  4m55s   v1.28.4

kubectl get secrets -A
NAMESPACE  NAME  TYPE   
 DATA   AGE
kube-systemcloudstack-secret Opaque 
 1  10m



2. Check the deployment, it should  be in pending

~ kubectl get deployments -A
NAMESPACE  NAMEREADY   UP-TO-DATE   
AVAILABLE   AGE
kube-systemcloudstack-csi-controller   0/1 10   
46s


3. Edit the deployment and remove the nodeSelector part

~kubectl edit deployment/cloudstack-csi-controller -n kube-system


  nodeSelector:
kubernetes.io/os: linux
node-role.kubernetes.io/master: ""

4. Check the deployment again  and it should be running state

~kubectl get deployments -A
NAMESPACE  NAMEREADY   UP-TO-DATE   
AVAILABLE   AGE
kube-systemcloudstack-csi-controller   1/1 11   
2m39s

5. Replace the disk offering in the storage class yaml

Provide the custom disk offering UUID (service offerings > disk offering > 
custom disk offering

4c518474-5d7b-4285-a07c-c57e214abb3b


vi 0-storageclass.yaml

apiVersion: storage.k8s.io/v1
kind: StorageClass
metadata:
  name: cloudstack-custom
provisioner: csi.cloudstack.apache.org
reclaimPolicy: Delete
volumeBindingMode: WaitForFirstConsumer
allowVolumeExpansion: false
parameters:
  csi.cloudstack.apache.org/disk-offering-id: 
4c518474-5d7b-4285-a07c-c57e214abb3b


kubectl apply -f 0-storageclass.yaml

k8s git:(master) ✗ kubectl get sc
NAMEPROVISIONER RECLAIMPOLICY   
VOLUMEBINDINGMODE  ALLOWVOLUMEEXPANSION   AGE
cloudstack-custom   csi.cloudstack.apache.org   Delete  
WaitForFirstConsumer   false  72s



6. Apply the pvc yaml

apiVersion: v1
kind: PersistentVolumeClaim
metadata:
  name: example-pvc-block
spec:
  storageClassName: cloudstack-custom
  volumeMode: Block
  accessModes:
- ReadWriteOnce
  resources:
requests:
  storage: 1Gi


kubectl apply -f pvc-block.yaml

k8s git:(master) ✗ kubectl get pvc
NAMESTATUSVOLUME   CAPACITY   ACCESS MODES   STORAGECLASS   
 AGE
example-pvc-block   Pending  
cloudstack-custom   31s
7.  Apply the pod block yaml

apiVersion: v1
kind: Pod
metadata:
  name: example-pod-block
spec:
  containers:
- name: example
  image: ubuntu
  volumeDevices:
- devicePath: "/dev/example-block"
  name: example-volume
  stdin: true
  stdinOnce: true
  tty: true
  volumes:
- name: example-volume
  persistentVolumeClaim:
claimName: example-pvc-block


kubectl apply -f pod-block.yaml


➜  k8s git:(master) ✗ k get pods -A
NAMESPACE  NAME READY   
STATUSRESTARTS  AGE
defaultexample-pod-block1/1 
Running   0 107s

Events:
  TypeReason  Age   From Message
  --     ---

Re: DDOS Attacks from my virtual Router

[Jayanth Babu A]

Hi,
I'm not sure if this is due to dnsmasq update and there are currently no 
security advisories that describe this. IIUC, the origin of these kind of 
events is more from the VMs provided to the customers or external folks and not 
from the components of cloud itself.

Thanks,
Jayanth Reddy


Sent from Outlook for Android


From: Granwille Strauss 
Sent: Tuesday, February 13, 2024 12:48:46 am
To: users@cloudstack.apache.org 
Cc: Jayanth Reddy ; Wei ZHOU 
Subject: Re: DDOS Attacks from my virtual Router


Update:

So since I ran updates for dnsmasq in all system vms, the issue seems to be 
solved. Our DC hasn't complained again. So it seems the vm templates need an 
update?

On 2/9/24 10:29, Jayanth Reddy wrote:

Please capture on 53/UDP as most of the DNS stack uses UDP by default.

I looked the screenshot, No NAME means that the IP hasn't undergone STATIC NAT 
to a VM, which is okay wherein perhaps there could be port forwards or Load 
Balancer instead. The VR should assign the IP on its interface if it is 
acquired in the network. If I may ask, how are you concluding that IPs are 
unassigned elsewhere, have you performed basic reachability tests? Your case 
could be one of the below

1. That IP could be SNAT for that network.
2. Or there was an assignment to one of the VMs previously as STATIC NAT and 
later released. Please check your events.

Get Outlook for 
Android


From: Granwille Strauss 
Sent: Friday, February 9, 2024 1:40:05 pm
To: users@cloudstack.apache.org 

Cc: Jayanth Reddy 
; Wei ZHOU 

Subject: Re: DDOS Attacks from my virtual Router


I run version 4.18.1.0  currently, oddly there was an update for dnsmasq so I 
applied them to all systemvms. I clean restarted the guest networks and so far 
everything seems to be running fine. If I pick up issues, I will destroy the 
routers so that cloudstack can recreate them again.

In the meantime, I am running the tcpdump as recommended in the vritual router 
and will keep an eye on it, as mentioned there seems to be no movement on port 
53 so far and I also asked the DC to provide an update on this after the 
changes I have applied.

In any case, attached is a screenshot of the IP address that are allocated but 
zero VM associated, I checked all of them and these IPs show up no where. I 
have no loadbalancers, proxies nothing. Just simple setup, with two virtual 
routers, one SSVM and one Consolevm. The rest are VM instances. I am going to 
check the git url you provided and query the DB to see what these are.

On 2/9/24 09:53, Jayanth Reddy wrote:

Hi,
Allocated means that it is assigned somewhere. You'll need to check the Public 
IP Address tab. Use the shared GH issue for exceptional case.

The VR does bind only on the internal network. No, manually updating packages 
on VRs and System VMs might produce strange results. Please provision them 
again.

Thanks

Get Outlook for 
Android


From: Granwille Strauss 

Sent: Friday, February 9, 2024 1:10:32 pm
To: 
users@cloudstack.apache.org
 

Cc: Wei ZHOU 
;
 
jayanthreddy5...@gmail.com
 

Subject: Re: DDOS Attacks from my virtual Router


Hi

Yes, I have Advanced network set up. I am going to check for