Re: Change source-nat IP - Isolated Network

[Kiran Chavala]

Hi Cristian

Changing source-NAT ip for an isolated network is present in 4.19 release of 
cloudstack

https://www.shapeblue.com/customising-source-nat-address-for-networks/

Regards
Kiran


From: cristian.c@istream.today 
Date: Wednesday, 12 June 2024 at 5:53 PM
To: users@cloudstack.apache.org 
Subject: Change source-nat IP - Isolated Network
Hello,



Is there a way to change a source-NAT IP for an Isolated network? I ask
because I have multiple ranges, and the current one used for source-NAT must
be removed.

Cloudstack 4.18.1

Regards,
Cristian

 

Re: Recommended method of generating SystemVM images for new arch?

[Kiran Chavala]

Hi Rishi

You can follow this mailing list discussion to generate systemvm template for 
different arch

https://lists.apache.org/list?users@cloudstack.apache.org:2023-1:Cloudstack%20on%20arm64%20and%20packer%20build%20systemvmtemplate%20success


Regards
Kiran

From: Rishi Misra 
Date: Wednesday, 24 April 2024 at 11:13 PM
To: users@cloudstack.apache.org 
Subject: Recommended method of generating SystemVM images for new arch?
Hi there,

Is there a recommended way of generating SystemVM images for new
architecture?

I tried using build.sh
but
I'm not sure if there is an easy way of doing it since packer may require
tweaking on archs for it to generate VMs.

Thanks.

 

Re: How to kcs cluster name with supplied name?

[Kiran Chavala]

Hi Jaejong


You can login to the control node from the Cloudstack management server

http://docs.cloudstack.apache.org/en/4.19.0.0/plugins/cloudstack-kubernetes-service.html#kubernetes-clusters


Example

ssh -i /var/cloudstack/management/.ssh/id_rsa -p 2223 
cloud@<mailto:cloud@10.0.54.133>

cloud@gh-node-18eea9a312c:~$ sudo su -

root@gh-node-18eea9a312c:~# find / -name kubeadm
/opt/bin/kubeadm

root@gh-node-18eea9a312c:~# kubeadm


The kubeadm tool is present at /opt/bin

Regards
Kiran

From: jaejong 
Date: Wednesday, 17 April 2024 at 7:40 AM
To: users@cloudstack.apache.org 
Subject: Re: How to kcs cluster name with supplied name?
Thank you Kiran Chavala.

Now I changed cluster name.
For users, I get Hint at  kubernetes manual.
using kubeadm kubeconfig user command

But I can't find kubeadm command from acs control panel or kcs control vm.

Where can I use the kubeadm?


 


-Original Message-
From: "Kiran Chavala"
To: "users@cloudstack.apache.org";
Cc:
Sent: 2024-04-15 (월) 16:06:20 (GMT+09:00)
Subject: Re: How to kcs cluster name with supplied name?

Hi Jaejong

The kuberneres/cks cluster created in Cloudstack are created via Kubeadm tool 
which always creates with the default name as kubernetes

You can rename the cluster  as per your requirement by following this article


https://medium.com/@manumv1/how-to-rename-a-kubernetes-cluster-c10db35d92aa


From kubectl perspective your kubernetes cluster can be named totally 
differently than in kubeadm-config ConfigMap. They are configured 
independently. Actually in .kube/config file you can refer to your cluster by 
any name you want, but you need to make the change both in clusters as well as 
in contexts sections.


Also you can reach out to the kubeadm community to cross check if they can 
support specifying a name during k8s cluster creation

https://github.com/kubernetes/kubeadm/issues/416



Regards
Kiran

From: jaejong 
Date: Monday, 15 April 2024 at 5:53 AM
To: users@cloudstack.apache.org 
Subject: How to kcs cluster name with supplied name?
I create kcs community iso 1.28.4 on acs 4.19.0.1.

I create two clusters. The cluster name is not populated to Config.
In cluster kubeconfig, cluster name is kubernetes  and user is kubernetes-admin.
So I can not merge two into one.

I remember it is possible in previous version.

kubeconfig is created with the name I supplied when  create kubernetes cluster 
such as:
apiVersion: v1
clusters:
- cluster:
   certificate-authority-data: ...
   server: https://x.x.x.x:6443
 name: supplied-name
contexts:
- context:
   cluster: supplied-name
   user: supplied-name-admin
 name: supplied-name-admin@kubernetes
kind: Config
preferences: {}
users:
- name: supplied-name-admin
 user:
So I can distingush two clusters.

Is there any way I can change cluster name in  kubeconfig?

Re: How to kcs cluster name with supplied name?

[Kiran Chavala]

Hi Jaejong

The kuberneres/cks cluster created in Cloudstack are created via Kubeadm tool 
which always creates with the default name as kubernetes

You can rename the cluster  as per your requirement by following this article


https://medium.com/@manumv1/how-to-rename-a-kubernetes-cluster-c10db35d92aa


From kubectl perspective your kubernetes cluster can be named totally 
differently than in kubeadm-config ConfigMap. They are configured 
independently. Actually in .kube/config file you can refer to your cluster by 
any name you want, but you need to make the change both in clusters as well as 
in contexts sections.


Also you can reach out to the kubeadm community to cross check if they can 
support specifying a name during k8s cluster creation

https://github.com/kubernetes/kubeadm/issues/416



Regards
Kiran

From: jaejong 
Date: Monday, 15 April 2024 at 5:53 AM
To: users@cloudstack.apache.org 
Subject: How to kcs cluster name with supplied name?
I create kcs community iso 1.28.4 on acs 4.19.0.1.

I create two clusters. The cluster name is not populated to Config.
In cluster kubeconfig, cluster name is kubernetes  and user is kubernetes-admin.
So I can not merge two into one.

I remember it is possible in previous version.

kubeconfig is created with the name I supplied when  create kubernetes cluster 
such as:
apiVersion: v1
clusters:
- cluster:
certificate-authority-data: ...
server: https://x.x.x.x:6443
  name: supplied-name
contexts:
- context:
cluster: supplied-name
user: supplied-name-admin
  name: supplied-name-admin@kubernetes
kind: Config
preferences: {}
users:
- name: supplied-name-admin
  user:
So I can distingush two clusters.

Is there any way I can change cluster name in  kubeconfig?

 

[ANNOUNCE] Apache CloudStack Terraform Provider v0.5.0 Release

[Kiran Chavala]

Hi All

# Apache CloudStack Terraform Provider v0.5.0 Release

We are pleased to announce the release of Apache CloudStack Terraform
provider v0.5.0.

Terraform is an open-source infrastructure as code software tool that
provides a consistent CLI workflow to manage resources in many
public/private clouds.

Terraform v0.5.0 comes packed with several new features, enhancements,
and bug fixes to make it even more robust and reliable.

Some of the key highlights of this release include:


-  Added support for Kubernetes Cluster creation
-  Added support for Kubernetes iso registration
-  Added support for new data sources in Cloudstack
-  Added UEFI Support to the Cloudstack instance resource
-  Added vApp properties support to the Cloudstack Instance resource
-  Added parameters (host_id , cluster_id support to the
Cloudstack instance resource
-  Added source_nat_ip_address support to the Cloudstack network
-  Added  new resource attach_volume
-  Improved service offering creation by adding more parameters
-  Added documentation for new resources
-  Various Bug fixes
-  Validated and fixed all existing resource creations to work as expected


Apache CloudStack Terraform provider v0.5.0.  is available for
download now from the Apache CloudStack website.

## Downloads and Documentation

The official source code for Apache CloudStack Terraform provider can
be downloaded from:

https://cloudstack.apache.org/downloads


The installation and usage documentation for Apache CloudStack
Terraform provider is available at:

https://github.com/apache/cloudstack-terraform-provider/wiki
https://github.com/apache/cloudstack-terraform-provider/wiki#installing-from-github-release


Users can also get the provider from the Terraform registry published at:

https://registry.terraform.io/providers/cloudstack/cloudstack/0.5.0


The documentation for the usage of resources to create and interact
with CloudStack is available at

https://registry.terraform.io/providers/cloudstack/cloudstack/0.5.0/docs


Regards
Kiran Chavala

Re: New PMC member: Slavka Peleva

[Kiran Chavala]

Congratulations Slavka!

Regards
Kiran

From: Nicolas Vazquez 
Date: Wednesday, 10 April 2024 at 6:01 PM
To: users@cloudstack.apache.org , 
d...@cloudstack.apache.org 
Cc: users@cloudstack.apache.org 
Subject: Re: New PMC member: Slavka Peleva
Congratulations Slavka!

Regards,
Nicolas Vazquez


From: Rene Peinthor 
Date: Wednesday, 10 April 2024 at 09:13
To: d...@cloudstack.apache.org 
Cc: users@cloudstack.apache.org 
Subject: Re: New PMC member: Slavka Peleva
:clap: Slavka!

Cheers,
Rene

On Wed, Apr 10, 2024 at 2:04 PM Suresh Kumar Anaparti <
sureshanapa...@apache.org> wrote:

> Congratulations Slavka!
>
> Regards,
> Suresh
>
> On Wed, Apr 10, 2024 at 4:41 PM Ivet Petrova 
> wrote:
>
> > Hello all,
> >
> > The Project Management Committee (PMC) for Apache CloudStack
> > has invited Slavka Peleva to become a PMC member and we are pleased
> > to announce that they have accepted.
> >
> > Slavka has contributed in the past and has shown effort to make the
> > project run smoothly
> >
> > Please join me in congratulating Slavka!
> >
> >
> > Best regards,
> >
> >
> >
> >
> >
>



 

[RESULT] [VOTE] Release Apache CloudStack Terraform Provider v0.5.0

[Kiran Chavala]

Hi All

After more than 72 hours, the vote for CloudStack Terraform Provider v0.5.0 
*passes* with

5 PMC + 2 non-PMC votes.

+1 (PMC / binding)
5 persons (Rohit, Daan, Boris, Hari, Nux)

+1 (non binding)
2 persons (Jithin, Suresh)

0
none

-1
none

Thanks to everyone participating.

I will now prepare the release announcement to go out after 24-48 hours to give 
the mirrors time to catch up.

Regards,
Kiran Chavala

 

Re: [VOTE] Release Apache CloudStack Terraform Provider v0.5.0

[Kiran Chavala]

Hi All,

Reminder – terraform 0.5.0  is up for testing and voting.

Regards.
Kiran

From: Rohit Yadav 
Date: Wednesday, 3 April 2024 at 9:43 AM
To: d...@cloudstack.apache.org , 
users@cloudstack.apache.org 
Subject: Re: [VOTE] Release Apache CloudStack Terraform Provider v0.5.0
+1 (binding)

Tested vm deployment using 0.5.0-pre.

Regards.



 



From: Kiran Chavala 
Sent: Tuesday, April 2, 2024 2:55:40 PM
To: d...@cloudstack.apache.org ; 
users@cloudstack.apache.org 
Subject: [VOTE] Release Apache CloudStack Terraform Provider v0.5.0

Hi ALL

I've created a CloudStack Terraform Provider v0.5.0 release, with the following 
artifacts up for a vote:

Git Branch and Commit SH:

https://github.com/cloudstack/terraform-provider-cloudstack

Commit: 7c682bf17bebf40837a30ebcca811fc7b8785a15

Source release (checksums and signatures are available at the same location):
https://dist.apache.org/repos/dist/dev/cloudstack/terraform-provider-0.5.0/

PGP release keys (signed using E03379CB066175FAC2BC9E027B3F1C5E93F97FAB):
https://dist.apache.org/repos/dist/release/cloudstack/KEYS

Vote will be open for 72 hours.

For sanity in tallying the vote, can PMC members please be sure to indicate 
"(binding)" with their vote?

[ ] +1  approve
[ ] +0  no opinion
[ ] -1  disapprove (and reason why)

For users convenience, they can use this 0.5.0-pre build 
https://registry.terraform.io/providers/cloudstack/cloudstack/0.5.0-pre for 
testing purposes.
The binaries are here: 
https://github.com/apache/cloudstack-terraform-provider/releases/tag/v0.5.0-pre


Regards
Kiran Chavala

[VOTE] Release Apache CloudStack Terraform Provider v0.5.0

[Kiran Chavala]

Hi ALL

I've created a CloudStack Terraform Provider v0.5.0 release, with the following 
artifacts up for a vote:

Git Branch and Commit SH:

https://github.com/cloudstack/terraform-provider-cloudstack

Commit: 7c682bf17bebf40837a30ebcca811fc7b8785a15

Source release (checksums and signatures are available at the same location):
https://dist.apache.org/repos/dist/dev/cloudstack/terraform-provider-0.5.0/

PGP release keys (signed using E03379CB066175FAC2BC9E027B3F1C5E93F97FAB):
https://dist.apache.org/repos/dist/release/cloudstack/KEYS

Vote will be open for 72 hours.

For sanity in tallying the vote, can PMC members please be sure to indicate 
"(binding)" with their vote?

[ ] +1  approve
[ ] +0  no opinion
[ ] -1  disapprove (and reason why)

For users convenience, they can use this 0.5.0-pre build 
https://registry.terraform.io/providers/cloudstack/cloudstack/0.5.0-pre for 
testing purposes.
The binaries are here: 
https://github.com/apache/cloudstack-terraform-provider/releases/tag/v0.5.0-pre


Regards
Kiran Chavala

 

Re: [PROPOSE] RM for Cloudstack Terraform Provider

[Kiran Chavala]

Hi All

Update- I am planning to cut 0.5 RC 1 and start the voting process on  April 1st

Please continue testing the 0.5 pre 
(https://registry.terraform.io/providers/cloudstack/cloudstack/0.5.0-pre)  and 
help report any issues/regressions at 
https://github.com/apache/cloudstack-terraform-provider/issues

Regards
Kiran

From: Rohit Yadav 
Date: Monday, 18 March 2024 at 9:44 PM
To: d...@cloudstack.apache.org , 
users@cloudstack.apache.org 
Subject: Re: [PROPOSE] RM for Cloudstack Terraform Provider
All,

Update - Terraform Registry support is looking into it, meanwhile they've done 
sometime to effect trigger to have the pre/alpha build available publicly now - 
https://registry.terraform.io/providers/cloudstack/cloudstack/0.5.0-pre

Please continue testing and help report any issues/regressions at 
https://github.com/apache/cloudstack-terraform-provider/issues


Regards.




 



From: Rohit Yadav 
Sent: Friday, March 15, 2024 18:34
To: d...@cloudstack.apache.org ; 
users@cloudstack.apache.org 
Subject: Re: [PROPOSE] RM for Cloudstack Terraform Provider

All,

Kiran is release manager for the next Terraform provider release (v0.5.0) but 
isn't a committer to have commit privileges to the upstream repo (something PMC 
can help into?).

To assist him, I've created a pre-RC (alpha) build for testing purposes and we 
encourage users to test and report regressions/bugs. The binaries are here: 
https://github.com/apache/cloudstack-terraform-provider/releases/tag/v0.5.0-pre

For some reason, Terraform registry isn't picking up the Github release from 
the 'cloudstack' org which is used because of Terraform registry's strict repo 
naming convention -
https://registry.terraform.io/providers/cloudstack/cloudstack/latest (which 
should pick release information from 
https://github.com/cloudstack/terraform-provider-cloudstack/releases/tag/v0.5.0-pre).
 I've logged a ticket with Hashicorp to look into the resync/sync issue.

In the meantime, users can use the following alpha/pre-rc builds for testing 
from:
https://registry.terraform.io/providers/shapeblue/cloudstack/latest
or, binaries from:
https://github.com/apache/cloudstack-terraform-provider/releases/tag/v0.5.0-pre

Users are welcome to report any regressions or issues here: 
https://github.com/apache/cloudstack-terraform-provider/issues


Thanks and regards,

Rohit & Kiran





From: Kiran Chavala 
Sent: Monday, March 4, 2024 17:29
To: users@cloudstack.apache.org ; 
d...@cloudstack.apache.org 
Subject: [PROPOSE] RM for Cloudstack Terraform Provider

Hi All,

Greetings

I'd like to propose and put myself forward as the release manager for v0.5.0 
release of  
cloudstack-terraform-provider(https://github.com/apache/cloudstack-terraform-provider)
  if no objections are there.


Since the last release of the cloudstack-terraform-provider (v0.4.0) was in 
2022. I am proposing to have the v0.5.0 as a quicker release.


I am also proposing the keep the scope of v0.5 release minimal and it should 
only contain minor improvements and bug fixes


Regarding timeline for the v0.5.0 release, I am targeting it by March 25th 2024.

We can have a alpha release of v0.5.0 by March 18th 2024 which allows the 
community users to test and report any issues.


After the v0.5 release we can spend some more time on adding new features and 
improvements to the cloudstack-terraform-provider and do a proper release of 
v0.6.0 in the coming months


Please ping me (@kiranchavala) on GitHub, in case you want to include any 
Issue/PR in the v0.5.0 release.

Please let me know if you have any thoughts/comments.



[1] 
https://github.com/apache/cloudstack-terraform-provider/compare/v0.4.0...main

[2] https://github.com/apache/cloudstack-terraform-provider/milestone/2

[3] https://github.com/apache/cloudstack-terraform-provider/issues





Regards
Kiran

Re: Kubernetes node in different zones

[Kiran Chavala]

Hi Francisco

Currently its not possible to deploy nodes across zone.

The Kubernetes cluster is tied to a single zone


Regards
Kiran

From: Francisco Arencibia Quesada 
Date: Monday, 25 March 2024 at 3:56 PM
To: users@cloudstack.apache.org 
Subject: Kubernetes node in different zones
Good morning guys,

I'm testing K8s on Cloudstack, and I can't deploy the nodes across
different zones. Is there a way to do this? I'm using Cloudstack 4.18.1

Kind regards
Thank you in advance



--
*Francisco Arencibia Quesada.*
*DevOps Engineer*

 

Re: packer cloudstack

[Kiran Chavala]

Hi Francisco

Please find the sample template I had created for cloudstack


https://developer.hashicorp.com/packer/integrations/hashicorp/cloudstack/latest/components/builder/cloudstack#basic-example


https://github.com/kiranchavala/cloudstack-marketplace-templates

https://github.com/kiranchavala/cloudstack-marketplace-templates/blob/main/docker-22-04.pkr.hcl



Other useful links
https://github.com/MissionCriticalCloud/bubble-templates-packer
https://github.com/PCextreme/packer-templates

Regards
Kiran

From: Francisco Arencibia Quesada 
Date: Thursday, 7 March 2024 at 4:03 PM
To: users@cloudstack.apache.org 
Subject: packer cloudstack
Good morning guys,

I'm  using packer, and I'm having some issues, I can't find many examples
online, at least for cloudstack. Do you guys have any template working to
point me in the right direction? My file complains about the boot_command
option:

source "cloudstack" "example" {
api_url = "http://X.X.X.X:8080/client/api;
api_key = "XXX"
secret_key = "XXX"
disk_offering = "Standard Custom"
disk_size = "20"
hypervisor = "XenServer"
network = "test-packer"
service_offering = "4-8"
source_iso = "Ubuntu 22.04.1 live server amd64"
zone = "EU-MAD1"
ssh_username = "user"
ssh_password = "packer"
template_name = "Ubuntu22.04.1-XCP-Packer"
template_display_text = "ubuntu-22.04.1-XCP-Packer"
template_featured = true
template_password_enabled = true
template_scalable = true
template_os = "Other PV (64-bit)"
http_directory = "http"
http_port_min = 8000
http_port_max = 8099
boot_command = [
"",
"linux /install/vmlinuz noapic ",
"preseed/url=http://{{ .HTTPIP }}:{{ .HTTPPort }}/preseed.cfg ",
"debian-installer=en_US auto locale=en_US kbd-chooser/method=us ",
"hostname={{ user `Name` }} ",
"fb=false debconf/frontend=noninteractive ",
"keyboard-configuration/modelcode=SKIP keyboard-configuration/layout=USA ",
"keyboard-configuration/variant=USA console-setup/ask_detect=false ",
"initrd=/install/initrd.gz -- "
]

}

build {
sources = ["source.cloudstack.example"]

}



pressed.cfg

### set locales
d-i debian-installer/locale string en_US.UTF-8
d-i keyboard-configuration/xkb-keymap select us

### Network configuration
d-i netcfg/choose_interface select auto
d-i netcfg/get_hostname string ubuntu
d-i netcfg/get_domain string localdomain

### Ubuntu mirrors
d-i mirror/country string manual
d-i mirror/http/hostname string archive.ubuntu.com
d-i mirror/http/directory string /ubuntu
d-i mirror/http/proxy string

### credentials
d-i passwd/user-fullname string Ubuntu User
d-i passwd/username string ubuntu
d-i passwd/user-password password ubuntu
d-i passwd/user-password-again password ubuntu
d-i user-setup/allow-password-weak boolean true
d-i user-setup/encrypt-home boolean false

### Timezone configuration
d-i clock-setup/utc boolean true
d-i time/zone string UTC

### Disk partitioning
d-i partman-auto/method string regular
d-i partman-auto/choose_recipe select atomic

d-i partman-partitioning/confirm_write_new_label boolean true
d-i partman/choose_partition select finish
d-i partman/confirm boolean true
d-i partman/confirm_nooverwrite boolean true

### base system
d-i base-installer/kernel/override-image string linux-server

### Automatic updates
d-i pkgsel/update-policy select none

### Software selection
tasksel tasksel/first multiselect standard
d-i pkgsel/include string openssh-server

### GRUB install
d-i grub-installer/only_debian boolean true
d-i grub-installer/with_other_os boolean true

### Finish installation
d-i finish-install/reboot_in_progress note




Thank you all in advance
Regards

--
*Francisco Arencibia Quesada.*
*DevOps Engineer*

 

[PROPOSE] RM for Cloudstack Terraform Provider

[Kiran Chavala]

Hi All,

Greetings

I'd like to propose and put myself forward as the release manager for v0.5.0 
release of  
cloudstack-terraform-provider(https://github.com/apache/cloudstack-terraform-provider)
  if no objections are there.


Since the last release of the cloudstack-terraform-provider (v0.4.0) was in 
2022. I am proposing to have the v0.5.0 as a quicker release.


I am also proposing the keep the scope of v0.5 release minimal and it should 
only contain minor improvements and bug fixes


Regarding timeline for the v0.5.0 release, I am targeting it by March 25th 2024.

We can have a alpha release of v0.5.0 by March 18th 2024 which allows the 
community users to test and report any issues.


After the v0.5 release we can spend some more time on adding new features and 
improvements to the cloudstack-terraform-provider and do a proper release of 
v0.6.0 in the coming months


Please ping me (@kiranchavala) on GitHub, in case you want to include any 
Issue/PR in the v0.5.0 release.

Please let me know if you have any thoughts/comments.



[1] 
https://github.com/apache/cloudstack-terraform-provider/compare/v0.4.0...main

[2] https://github.com/apache/cloudstack-terraform-provider/milestone/2

[3] https://github.com/apache/cloudstack-terraform-provider/issues





Regards
Kiran

 

Re: volume was locked forever as "migration in progress"

[Kiran Chavala]

Hi

Currently there is no way to force cancel a struck async job.

you have to restart the management service

service cloudstack-management restart

Regards
Kiran

From: h.chi...@bestnetllc.co.jp 
Date: Monday, 4 March 2024 at 1:43 AM
To: users@cloudstack.apache.org 
Subject: volume was locked forever as "migration in progress"
Hello community



Do you know how to force cancel a stuck job?



When the source KVM host went down during storage migration, the volume was
locked forever as "migration in progress".



thank you.

 

Re: CKS with K8s Offering N/w

[Kiran Chavala]

Hi Bharat

For shared networks is no Loadblancing service is not  available if you look at 
the  the offering


The is the reason I believe  containers are running on  Cluster IP

[cid:image001.png@01DA6BD7.CF067AE0]


For isolated networks or the default Kubernetes network Offering there is 
Loabalancing service available



[A screenshot of a computer  Description automatically generated]

Regards
Kiran


From: Bharat Bhushan Saini 
Date: Friday, 1 March 2024 at 11:38 AM
To: users@cloudstack.apache.org 
Subject: Re: CKS with K8s Offering N/w
Hi Wei,

I deployed cloudstack 4.18.1 on ubuntu 22.04 LTS on a standalone server with 
kvm,nfs consist.

I already tested some vm’s on the cloudstack on a shared network with untagged 
vlan because what IP range I have that was bridged with the private n/w and 
natting is enabled on that. On shared n/w I am able to access internet but in 
isolated or L2 config it can’t.

As per your suggestion, I tried with create default k8s n/w and also create a 
network which have the same config of default k8s n/w but I untag the vlan in 
that n/w. Both was not working.
On shared n/w I a able to spawn the cluster and also able to login with key and 
also deploy an application but the containers was running on the Cluster IP.

Thanks and Regards,
Bharat Saini

[signature_2926674288]

From: Wei ZHOU 
Date: Thursday, 29 February 2024 at 10:20 PM
To: users@cloudstack.apache.org 
Subject: Re: CKS with K8s Offering N/w
EXTERNAL EMAIL: Please verify the sender email address before taking any 
action, replying, clicking any link or opening any attachment.


Hi Bharat,

In my opinion, most of the CKS issues you have are caused by your network
configuration.

Please share more details of your environments, as much as possible.

-Wei

On Thu, Feb 29, 2024 at 5:45 PM Bharat Bhushan Saini
 wrote:

> Hi All,
>
>
>
> Now the cluster goes in error state. Please refer logs as below
>
>
>
> 2024-02-29 13:25:05,774 ERROR [c.c.k.c.a.KubernetesClusterActionWorker]
> (API-Job-Executor-54:ctx-7e86c22d job-777 ctx-5c1e1685) (logid:458f275d)
> Failed to setup Kubernetes cluster : *kspot* in usable state as unable to
> access control node VMs of the cluster
>
> 2024-02-29 13:25:11,900 INFO  [c.c.k.c.a.KubernetesClusterActionWorker]
> (API-Job-Executor-54:ctx-7e86c22d job-777 ctx-5c1e1685) (logid:458f275d)
> Detached Kubernetes binaries from VM : *kspot*-control-18df4d40038 in the
> Kubernetes cluster : *kspot*
>
> 2024-02-29 13:25:12,804 INFO  [c.c.k.c.a.KubernetesClusterActionWorker]
> (API-Job-Executor-54:ctx-7e86c22d job-777 ctx-5c1e1685) (logid:458f275d)
> Detached Kubernetes binaries from VM : *kspot*-node-18df4d4562b in the
> Kubernetes cluster : *kspot*
>
> 2024-02-29 13:25:12,806 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> (API-Job-Executor-54:ctx-7e86c22d job-777) (logid:458f275d) Complete async
> job-777, jobStatus: FAILED, resultCode: 530, result:
> org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":"530","errortext":"Failed
> to setup Kubernetes cluster : *kspot* in usable state as unable to access
> control node VMs of the cluster"}
>
> 2024-02-29 13:34:31,962 DEBUG [c.c.a.t.Request]
> (RouterStatusMonitor-1:ctx-6890fa84) (logid:7daaca79) Seq
> 10-2919458458442974958
>
>
>
>
>
> Thanks and Regards,
>
> Bharat Saini
>
>
>
> [image: signature_3007469423]
>
>
>
> *From: *Bharat Bhushan Saini 
> *Date: *Thursday, 29 February 2024 at 5:09 PM
> *To: *users@cloudstack.apache.org 
> *Subject: *Re: CKS with K8s Offering N/w
>
> EXTERNAL EMAIL: Please verify the sender email address before taking any
> action, replying, clicking any link or opening any attachment.
>
>
>
> Hi Wei,
>
>
>
> I truncate the mysql database table of kubernetes_cluster.
>
>
>
> Now the cluster is stucked in the starting state.
>
>
>
> Thanks and Regards,
>
> Bharat Saini
>
>
>
> [image: signature_17144652]
>
>
>
> *From: *Wei ZHOU 
> *Date: *Thursday, 29 February 2024 at 4:52 PM
> *To: *users@cloudstack.apache.org 
> *Subject: *Re: CKS with K8s Offering N/w
>
> EXTERNAL EMAIL: Please verify the sender email address before taking any
> action, replying, clicking any link or opening any attachment.
>
>
> The endpoint is automatically set by cloudstack, if the CKS cluster is
> created successfully.
>
> If the endpoint is empty, it means the CKS cluster is not setup well, you'd
> better remove it if it is not in use.
>
> -Wei
>
> On Thu, Feb 29, 2024 at 12:17 PM Bharat Bhushan Saini
>  wrote:
>
> > Hi Wei,
> >
> >
> >
> > Last record is empty but new one also having the same endpoint with alert
> > condition. Can I delete first the new cluster then empty the table,
> should
> > it work?
> >
> > If it is then how we will manage multiple cluster!
> >
> >
> >
> > Thanks and Regards,
> >
> > Bharat Saini
> >
> >
> >
> > [image: signature_3652424534]
> >
> >
> >
> > *From: *Wei ZHOU 
> > *Date: *Thursday, 29 February 2024 at 4:34 PM
> > *To: *users@cloudstack.apache.org 
> > *Subject: *Re: CKS with K8s 

Re: Import from external host

[Kiran Chavala]

Hi Jimmy


Could you please try the steps mentioned here

https://github.com/apache/cloudstack/issues/8704#issuecomment-1963762570

Also please check if the libvirtd process is listenting on the port

netstat -tunap|grep 16509

Regards
Kiran

From: Jimmy Huybrechts 
Date: Thursday, 29 February 2024 at 2:44 AM
To: users@cloudstack.apache.org 
Subject: Re: Import from external host
Took some search indeed but this is what I get in the log:

2024-02-28 22:07:26,036 ERROR [c.c.a.ApiServer] 
(qtp1753127384-12419:ctx-46cafb61 ctx-360e905b) (logid:72359c47) unhandled 
exception executing api command: [Ljava.lang.String;@7e8da5b
com.cloud.utils.exception.CloudRuntimeException: Error while listing remote Vms
at 
org.apache.cloudstack.vm.UnmanagedVMsManagerImpl.getRemoteVms(UnmanagedVMsManagerImpl.java:2489)
at 
org.apache.cloudstack.vm.UnmanagedVMsManagerImpl.listVmsForImport(UnmanagedVMsManagerImpl.java:2464)
at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at 
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at 
org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344)
at 
org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198)
at 
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163)
at 
org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97)
at 
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)
at 
org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:215)
at com.sun.proxy.$Proxy459.listVmsForImport(Unknown Source)
at 
org.apache.cloudstack.api.command.admin.vm.ListVmsForImportCmd.execute(ListVmsForImportCmd.java:121)
at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:172)
at com.cloud.api.ApiServer.queueCommand(ApiServer.java:782)
at com.cloud.api.ApiServer.handleRequest(ApiServer.java:603)
at com.cloud.api.ApiServlet.processRequestInContext(ApiServlet.java:347)
at com.cloud.api.ApiServlet$1.run(ApiServlet.java:154)
at 
org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:55)
at 
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:102)
at 
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:52)
at com.cloud.api.ApiServlet.processRequest(ApiServlet.java:151)
at com.cloud.api.ApiServlet.doGet(ApiServlet.java:105)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:645)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:750)
at 
org.eclipse.jetty.servlet.ServletHolder$NotAsync.service(ServletHolder.java:1450)
at 
org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:799)
at 
org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:554)
at 
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)
at 
org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:600)
at 
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
at 
org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235)
at 
org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1624)
at 
org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
at 
org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1440)
at 
org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)
at 
org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:505)
at 
org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1594)
at 
org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)
at 
org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1355)
at 
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
at 
org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:772)
at 
org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146)
at 
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
at org.eclipse.jetty.server.Server.handle(Server.java:516)

Re: new committer: Vishesh Jindal (vishesh)

[Kiran Chavala]

Congratulations Vishesh

Regards
Kiran

From: Daan Hoogland 
Date: Monday, 26 February 2024 at 7:35 PM
To: users , dev 
Subject: new committer: Vishesh Jindal (vishesh)
users and devs,

The Project Management Committee (PMC) for Apache CloudStack
has invited Vishesh Jindal to become a committer and we are pleased
to announce that they have accepted.

Being a committer enables easier contribution to the
project since there is no need to go via the patch
submission process. This should enable better productivity.

Please join me in congratulating Vishesh.

--
on behalf of the PMC, Daan

 

Re: Cloudstack DB using 3 Node Galrea Cluster.

[Kiran Chavala]

Hi Joan

You can refer this article

https://severalnines.com/blog/how-deploy-high-availability-cloudstackcloudplatform-mariadb-galera-cluster/


I had these in my notes when I tried setting it up percona-xtradb, hope its 
useful to you.


Install 2 ubuntu nodes for percona-xtradb cluster

On ubuntu node 1

$ sudo apt update

$ sudo apt install gnupg2

$ wget https://repo.percona.com/apt/percona-release_latest.$(lsb_release 
-sc)_all.deb

$ sudo dpkg -i percona-release_latest.$(lsb_release -sc)_all.deb

$ sudo apt update

$ sudo apt install percona-server-server-5.7



cat >>/etc/mysql/my.cnf>/etc/mysql/my.cnfuse mysql
mysql>GRANT ALL ON *.* to root@'%' IDENTIFIED BY 'password';
mysql>GRANT ALL PRIVILEGES ON *.* TO 'root'@'%' IDENTIFIED BY 'password' WITH 
GRANT OPTION;
mysql>FLUSH PRIVILEGES;
mysql> SELECT host FROM mysql.user WHERE User = 'root';
mysql>SET GLOBAL pxc_strict_mode=PERMISSIVE



Regards
Kiran

From: Joan g 
Date: Saturday, 24 February 2024 at 12:29 AM
To: users@cloudstack.apache.org 
Subject: Cloudstack DB using 3 Node Galrea Cluster.
Hi Community,

I need some suggestions  on using 3 node Mariadb *Galera Cluster or percona
xtradb* for Cloudstack Databases.

In My setup the Databases are behind a LB and write happens only to a
single node

With new Cloudstack 4.18.1 install  initial database migration is always
failing because of schema update/sync issues with other DB nodes.

Logs in Mysql err::
2024-02-23T12:55:15.521278Z 17 [ERROR] [MY-010584] [Repl] Replica SQL:
Error 'Duplicate column name 'display'' on query. Default
 database: 'cloud'. Query: 'ALTER TABLE cloud.guest_os ADD COLUMN display
tinyint(1) DEFAULT '1' COMMENT 'should this guest_os b
e shown to the end user'', Error_code: MY-001060

Due to this Cloudstack initialisation is always failing.

Can someone point me with a suggested method for DB HA

Jon

 

Re: Cloudstack with Managed Databases?

[Kiran Chavala]

+1 for using Cloud-init to  install and configure your DBMS.

Or you can use packer plugin for cloudstack to create golden image template 
with DBMS

https://developer.hashicorp.com/packer/integrations/hashicorp/cloudstack/latest/components/builder/cloudstack
https://copyprogramming.com/howto/how-to-setup-mysql-with-cloud-init


Regards
Kiran

From: Jayanth Reddy 
Date: Monday, 26 February 2024 at 8:15 AM
To: users@cloudstack.apache.org 
Subject: Re: Cloudstack with Managed Databases?
Hello,
One of the ways I think of is to make use of the cloud-init's functionalities 
to install and configure your DBMS. However you may have less view of the DBMS 
later which might not exactly fit into "managed".

I've seen people have their own CMP and handling all the integration there.

Thanks,
Jayanth

 



From: Hunter Yap <123qwqqw...@gmail.com>
Sent: Monday, February 26, 2024 8:04:39 am
To: users@cloudstack.apache.org 
Subject: Cloudstack with Managed Databases?

Hi Guys,

We are exploring offering Managed Databases as a service on our Cloudstack
Public Cloud.

Has anyone done this before? What method did you use and what was the
experience like?

Regards,
Hunter

Re: CKS Storage Provisioner Info

[Kiran Chavala]

Hi Bharath

Note the CKS provisioner works on KVM based cloudstack environment

Regards
Kiran

From: Kiran Chavala 
Date: Monday, 26 February 2024 at 5:45 PM
To: users@cloudstack.apache.org 
Subject: Re: CKS Storage Provisioner Info
Hi Bharat Bhusan

Please follow these steps


1. Deploy a Kubernetes cluster on cluster


NAME STATUS   ROLES   AGE VERSION
ty-control-18de52c04f7   Readycontrol-plane   5m11s   v1.28.4
ty-node-18de52c4185  Ready  4m55s   v1.28.4

kubectl get secrets -A
NAMESPACE  NAME  TYPE   
 DATA   AGE
kube-systemcloudstack-secret Opaque 
 1  10m



2. Check the deployment, it should  be in pending

~ kubectl get deployments -A
NAMESPACE  NAMEREADY   UP-TO-DATE   
AVAILABLE   AGE
kube-systemcloudstack-csi-controller   0/1 10   
46s


3. Edit the deployment and remove the nodeSelector part

~kubectl edit deployment/cloudstack-csi-controller -n kube-system


  nodeSelector:
kubernetes.io/os: linux
node-role.kubernetes.io/master: ""

4. Check the deployment again  and it should be running state

~kubectl get deployments -A
NAMESPACE  NAMEREADY   UP-TO-DATE   
AVAILABLE   AGE
kube-systemcloudstack-csi-controller   1/1 11   
2m39s

5. Replace the disk offering in the storage class yaml

Provide the custom disk offering UUID (service offerings > disk offering > 
custom disk offering

4c518474-5d7b-4285-a07c-c57e214abb3b


vi 0-storageclass.yaml

apiVersion: storage.k8s.io/v1
kind: StorageClass
metadata:
  name: cloudstack-custom
provisioner: csi.cloudstack.apache.org
reclaimPolicy: Delete
volumeBindingMode: WaitForFirstConsumer
allowVolumeExpansion: false
parameters:
  csi.cloudstack.apache.org/disk-offering-id: 
4c518474-5d7b-4285-a07c-c57e214abb3b


kubectl apply -f 0-storageclass.yaml

k8s git:(master) ✗ kubectl get sc
NAMEPROVISIONER RECLAIMPOLICY   
VOLUMEBINDINGMODE  ALLOWVOLUMEEXPANSION   AGE
cloudstack-custom   csi.cloudstack.apache.org   Delete  
WaitForFirstConsumer   false  72s



6. Apply the pvc yaml

apiVersion: v1
kind: PersistentVolumeClaim
metadata:
  name: example-pvc-block
spec:
  storageClassName: cloudstack-custom
  volumeMode: Block
  accessModes:
- ReadWriteOnce
  resources:
requests:
  storage: 1Gi


kubectl apply -f pvc-block.yaml

k8s git:(master) ✗ kubectl get pvc
NAMESTATUSVOLUME   CAPACITY   ACCESS MODES   STORAGECLASS   
 AGE
example-pvc-block   Pending  
cloudstack-custom   31s
7.  Apply the pod block yaml

apiVersion: v1
kind: Pod
metadata:
  name: example-pod-block
spec:
  containers:
- name: example
  image: ubuntu
  volumeDevices:
- devicePath: "/dev/example-block"
  name: example-volume
  stdin: true
  stdinOnce: true
  tty: true
  volumes:
- name: example-volume
  persistentVolumeClaim:
claimName: example-pvc-block


kubectl apply -f pod-block.yaml


➜  k8s git:(master) ✗ k get pods -A
NAMESPACE  NAME READY   
STATUSRESTARTS  AGE
defaultexample-pod-block1/1 
Running   0 107s

Events:
  TypeReason  Age   From Message
  --     ---
  Normal  Scheduled   9sdefault-schedulerSuccessfully 
assigned default/example-pod-block to ty-node-18de52c4185
  Normal  SuccessfulAttachVolume  6sattachdetach-controller  
AttachVolume.Attach succeeded for volume 
"pvc-02999f04-dd0a-407c-8805-125c7c56d51b"
  Normal  SuccessfulMountVolume   4skubelet  
MapVolume.MapPodDevice succeeded for volume 
"pvc-02999f04-dd0a-407c-8805-125c7c56d51b" globalMapPath 
"/var/lib/kubelet/plugins/kubernetes.io/csi/volumeDevices/pvc-02999f04-dd0a-407c-8805-125c7c56d51b/dev"
  Normal  SuccessfulMountVolume   4skubelet  
MapVolume.MapPodDevice succeeded for volume 
"pvc-02999f04-dd0a-407c-8805-125c7c56d51b" volumeMapPath 
"/var/lib/kubelet/pods/076bd828-7130-4f72-a0ee-29f93043bbb1/volumeDevices/kubernetes.io~csi"
  Normal  Pulling 3skubelet  Pulling image 
"ubuntu"

Regards
Kiran





From: Jayanth Reddy 
Date: Monday, 26 February 2024 at 4:35 PM
To: users@cloudstack.apache.org 
Subject: Re: CKS Storage Provisioner Info
Hello Bharat,
If that is the case, please update your "api-url" variable for the cloud-config.

FWIW, please also visit "endpoint.url" in 

Re: CKS Storage Provisioner Info

[Kiran Chavala]

Hi Bharat Bhusan

Please follow these steps


1. Deploy a Kubernetes cluster on cluster


NAME STATUS   ROLES   AGE VERSION
ty-control-18de52c04f7   Readycontrol-plane   5m11s   v1.28.4
ty-node-18de52c4185  Ready  4m55s   v1.28.4

kubectl get secrets -A
NAMESPACE  NAME  TYPE   
 DATA   AGE
kube-systemcloudstack-secret Opaque 
 1  10m



2. Check the deployment, it should  be in pending

~ kubectl get deployments -A
NAMESPACE  NAMEREADY   UP-TO-DATE   
AVAILABLE   AGE
kube-systemcloudstack-csi-controller   0/1 10   
46s


3. Edit the deployment and remove the nodeSelector part

~kubectl edit deployment/cloudstack-csi-controller -n kube-system


  nodeSelector:
kubernetes.io/os: linux
node-role.kubernetes.io/master: ""

4. Check the deployment again  and it should be running state

~kubectl get deployments -A
NAMESPACE  NAMEREADY   UP-TO-DATE   
AVAILABLE   AGE
kube-systemcloudstack-csi-controller   1/1 11   
2m39s


5. Replace the disk offering in the storage class yaml

Provide the custom disk offering UUID (service offerings > disk offering > 
custom disk offering

4c518474-5d7b-4285-a07c-c57e214abb3b


vi 0-storageclass.yaml

apiVersion: storage.k8s.io/v1
kind: StorageClass
metadata:
  name: cloudstack-custom
provisioner: csi.cloudstack.apache.org
reclaimPolicy: Delete
volumeBindingMode: WaitForFirstConsumer
allowVolumeExpansion: false
parameters:
  csi.cloudstack.apache.org/disk-offering-id: 
4c518474-5d7b-4285-a07c-c57e214abb3b


kubectl apply -f 0-storageclass.yaml

k8s git:(master) ✗ kubectl get sc
NAMEPROVISIONER RECLAIMPOLICY   
VOLUMEBINDINGMODE  ALLOWVOLUMEEXPANSION   AGE
cloudstack-custom   csi.cloudstack.apache.org   Delete  
WaitForFirstConsumer   false  72s



6. Apply the pvc yaml

apiVersion: v1
kind: PersistentVolumeClaim
metadata:
  name: example-pvc-block
spec:
  storageClassName: cloudstack-custom
  volumeMode: Block
  accessModes:
- ReadWriteOnce
  resources:
requests:
  storage: 1Gi


kubectl apply -f pvc-block.yaml

k8s git:(master) ✗ kubectl get pvc
NAMESTATUSVOLUME   CAPACITY   ACCESS MODES   STORAGECLASS   
 AGE
example-pvc-block   Pending  
cloudstack-custom   31s

7.  Apply the pod block yaml

apiVersion: v1
kind: Pod
metadata:
  name: example-pod-block
spec:
  containers:
- name: example
  image: ubuntu
  volumeDevices:
- devicePath: "/dev/example-block"
  name: example-volume
  stdin: true
  stdinOnce: true
  tty: true
  volumes:
- name: example-volume
  persistentVolumeClaim:
claimName: example-pvc-block


kubectl apply -f pod-block.yaml


➜  k8s git:(master) ✗ k get pods -A
NAMESPACE  NAME READY   
STATUSRESTARTS  AGE
defaultexample-pod-block1/1 
Running   0 107s

Events:
  TypeReason  Age   From Message
  --     ---
  Normal  Scheduled   9sdefault-schedulerSuccessfully 
assigned default/example-pod-block to ty-node-18de52c4185
  Normal  SuccessfulAttachVolume  6sattachdetach-controller  
AttachVolume.Attach succeeded for volume 
"pvc-02999f04-dd0a-407c-8805-125c7c56d51b"
  Normal  SuccessfulMountVolume   4skubelet  
MapVolume.MapPodDevice succeeded for volume 
"pvc-02999f04-dd0a-407c-8805-125c7c56d51b" globalMapPath 
"/var/lib/kubelet/plugins/kubernetes.io/csi/volumeDevices/pvc-02999f04-dd0a-407c-8805-125c7c56d51b/dev"
  Normal  SuccessfulMountVolume   4skubelet  
MapVolume.MapPodDevice succeeded for volume 
"pvc-02999f04-dd0a-407c-8805-125c7c56d51b" volumeMapPath 
"/var/lib/kubelet/pods/076bd828-7130-4f72-a0ee-29f93043bbb1/volumeDevices/kubernetes.io~csi"
  Normal  Pulling 3skubelet  Pulling image 
"ubuntu"

Regards
Kiran


From: Jayanth Reddy 
Date: Monday, 26 February 2024 at 4:35 PM
To: users@cloudstack.apache.org 
Subject: Re: CKS Storage Provisioner Info
Hello Bharat,
If that is the case, please update your "api-url" variable for the cloud-config.

FWIW, please also visit "endpoint.url" in global configuration to include the 
HTTPS endpoint.

Thanks,
Jayanth

Sent from Outlook for Android

 



From: Bharat Bhushan Saini 
Sent: Monday, February 26, 2024 4:29:22 pm
To: users@cloudstack.apache.org 
Subject: Re: CKS Storage Provisioner Info

Hi Jayanth,

For to secure 

Re: CKS Storage Provisioner Info

[Kiran Chavala]

Hi Bharat

You can try the following CSI driver

https://github.com/Leaseweb/cloudstack-csi-driver
https://github.com/apalia/cloudstack-csi-driver

Regards
Kiran

From: Bharat Bhushan Saini 
Date: Thursday, 22 February 2024 at 5:14 PM
To: users@cloudstack.apache.org 
Subject: CKS Storage Provisioner Info
Hi All,

As working with the CKS service I had a query regarding with the K8s storage 
provisioner.
Which provisioner I can use for the shared and unshared PVC in the CKS service.
Please support in this, it will be great help for me.

Thanks and Regards,
Bharat Saini

[signature_1218208545]

--- Disclaimer: --
This message and its contents are intended solely for the designated addressee 
and are proprietary to Kloudspot. The information in this email is meant 
exclusively for Kloudspot business use. Any use by individuals other than the 
addressee constitutes misuse and an infringement of Kloudspot's proprietary 
rights. If you are not the intended recipient, please return this email to the 
sender. Kloudspot cannot guarantee the security or error-free transmission of 
e-mail communications. Information could be intercepted, corrupted, lost, 
destroyed, arrive late or incomplete, or contain viruses. Therefore, Kloudspot 
shall not be liable for any issues arising from the transmission of this email.

 

Re: Update Password For Existing XEN Host

[Kiran Chavala]

Hi Joan


Could you please try with the following  api call

https://cloudstack.apache.org/api/apidocs-4.19/apis/updateHostPassword.html

Regards
Kiran



From: Joan g 
Date: Wednesday, 14 February 2024 at 7:22 PM
To: users@cloudstack.apache.org 
Subject: Update Password For Existing XEN Host
Hello Community,

My cloudstack Setup is  Using Xen server. Due to security reasons i was
forced to change my xen root password.

Can someone let me know how I can update the password for my host in
cloudstack DB ?

Following blow link does not help
http://docs.cloudstack.apache.org/projects/archived-cloudstack-administration/en/latest/hosts.html#changing-host-password

Regards,
Joan

 

Re: Cilium CNI for CSK

[Kiran Chavala]

Hi Ricardo

We have a existing Github issue created  to support new CNI  for CKS

https://github.com/apache/cloudstack/issues/6637


Regards
Kiran

From: Ricardo Pertuz 
Date: Tuesday, 6 February 2024 at 5:11 PM
To: users@cloudstack.apache.org 
Subject: Cilium CNI for CSK
Hi,

Weavenet is closing so maybe we should consider migrating to another CNI, 
should I create a entry in gitlab with the request?

source: 
https://www.crn.com/news/cloud/2024/aws-backed-kubernetes-company-weaveworks-closes-ceo-blames-failed-m-a

BR


 

Re: Kubernetes Clusters Failing to Start 4.19.0

[Kiran Chavala]

Hi Wally

Could you please check the following items

1. Check if you have set the global setting  “Endpoint url (endpoint.url)” to 
management server ip addrees.

2. Login to the control node and check if the nodes are in ready state and also 
the pods are in running state

cloud@k1-control-18d9cc9f10d:~$ sudo su -
root@k1-control-18d9cc9f10d:~#
Exectue the Kubectl command

root@k1-control-18d9cc9f10d:~# cd /opt/cloud/bin

Make sure the  nodes are in running state

root@k1-control-18d9cc9f10d:/opt/cloud/bin# kubectl get nodes
NAME STATUS   ROLES   AGE VERSION
k1-control-18d9cc9f10d   Readycontrol-plane   8m37s   v1.28.4
k1-node-18d9cca4fad  Ready  8m22s   v1.28.4

Make sure all pods are in running state

root@k1-control-18d9cc9f10d:/opt/cloud/bin# kubectl get pods --all-namespaces
NAMESPACE  NAME READY   
STATUSRESTARTS   AGE
kube-systemcloud-controller-manager-574bcb86c-tz9cj 1/1 
Running   0  8m36s
kube-systemcoredns-5dd5756b68-245tn 1/1 
Running   0  9m12s
kube-systemcoredns-5dd5756b68-jplbr 1/1 
Running   0  9m12s
kube-systemetcd-k1-control-18d9cc9f10d  1/1 
Running   0  9m19s
kube-systemkube-apiserver-k1-control-18d9cc9f10d1/1 
Running   0  9m15s
kube-systemkube-controller-manager-k1-control-18d9cc9f10d   1/1 
Running   0  9m15s
kube-systemkube-proxy-4qq2h 1/1 
Running   0  9m5s
kube-systemkube-proxy-jfq7k 1/1 
Running   0  9m12s
kube-systemkube-scheduler-k1-control-18d9cc9f10d1/1 
Running   0  9m19s
kube-systemweave-net-77lcj  2/2 
Running   1 (9m9s ago)   9m12s
kube-systemweave-net-k8cnk  2/2 
Running   0  9m5s
kubernetes-dashboard   dashboard-metrics-scraper-5657497c4c-gmt6m   1/1 
Running   0  9m12s
kubernetes-dashboard   kubernetes-dashboard-5b749d9495-vth8j1/1 
Running   0  9m12s


3. Please provide the following logs to investigate which step its failing

cat /var/log/daemon.log

cat /var/log/messages

Regards
Kiran


From: Wally B 
Date: Thursday, 15 February 2024 at 4:35 AM
To: users@cloudstack.apache.org 
Subject: Kubernetes Clusters Failing to Start 4.19.0
Hello Everyone!

We are currently attempting to deploy k8s clusters and are running into
issues with the deployment.


Current CS Environment:

CloudStack Verison: 4.19.0 (Same issue before we upgraded from 4.18.1).
Hypervisor Type: Ubuntu 20.04.03 KVM
Attempted K8s Bins: 1.23.3, 1.27.3



 ISSUE =

For some reason when we attempt the cluster provisioning all of the VMs
start up, SSH Keys are installed, but then at least 1, sometimes 2 of the
VMs (control and/or worker) we get:

[FAILED] Failed to start deploy-kube-system.service.
[FAILED] Failed to start Execute cloud user/final scripts.

The Cloudstack UI just says:
Create Kubernetes cluster test-cluster in progress
for about an hour (I assume this is the 3600 second timeout) and then
fails.

In the users event log it stays on:
INFO KUBERNETES.CLUSTER.CREATE
Scheduled
Creating Kubernetes cluster. Cluster Id: XXX



I can ssh into the VMs with their assigned private keys. I attempted to run
the deploy-kube-system script but it just says already provisioned! I'm not
sure how I would Execute cloud user/final scripts. If I attempt to stop the
cluster and start it again nothing seems to change.



Any help would be appreciated, I can provide any details as they are needed!

Thanks!
Wally

 

Re: new website is life

[Kiran Chavala]

Congratulations to all involved!,  Breath of fresh air to the website, Looks 
Neat and clean

Regards
Kiran

From: Daan Hoogland 
Date: Wednesday, 7 February 2024 at 1:53 PM
To: dev , users 
Subject: new website is life
People,
we brought the new website. Please all have a look at
https://cloudstack.apache.org

thanks for any feedback

--
Daan

 

Re: xcp templates to kvm

[Kiran Chavala]

Hi Francisco

The xcp zone templates will in vhd format. In order for them to work with KVM 
zone they have to be in qcow2 format

You can try to use the qemu-img tool to convert them to qcow2 format

Regards
Kiran

From: Francisco Arencibia Quesada 
Date: Wednesday, 31 January 2024 at 5:28 PM
To: users@cloudstack.apache.org 
Subject: xcp templates to kvm
Good morning guys,

I have a doubt regarding a matter. If I copy all templates, such as Ubuntu
and Windows, from an XCP zone to a KVM zone, is it possible to make them
work? Or do I need to create new templates for the KVM zone?
Thank you in advance
Regards
--
*Francisco Arencibia Quesada.*
*DevOps Engineer*

 

Re: Urgent Help Needed with Stuck VM Instance Creation

[Kiran Chavala]

Hi Palash

You can take a look at the management server logs and the agent logs on the kvm 
host and see why the vm is struck in starting state

Also you can make use of the expunge option when deploying a vm via terraform

When you run terraform destroy , it directly expunges the vm instead of 
destroying it



https://registry.terraform.io/providers/cloudstack/cloudstack/latest/docs/resources/instance#expunge

Regards
Kiran
From: Wei ZHOU 
Date: Friday, 26 January 2024 at 4:10 PM
To: users@cloudstack.apache.org 
Subject: Re: Urgent Help Needed with Stuck VM Instance Creation
If you use KVM, you can restart the cloudstack-agent of the host where the
VM is running.


-Wei


 

On Fri, 26 Jan 2024 at 10:40, Palash Biswas  wrote:

>
> Hi Community,
>
> I'm encountering an issue while creating a VM instance through Terraform.
> The process seems to be stuck, and in the Cloudstack UI, it has been
> showing a "starting" status for the past hour. I'm unable to stop or
> destroy it manually. Can anyone provide guidance on how to terminate this
> instance?
>
> Regards,
> Palash
>
>

Re: new PMC member Harikrishna Patnala

[Kiran Chavala]

Congrats Hari!

Regards
Kiran

From: Abhishek Kumar 
Date: Monday, 15 January 2024 at 5:14 PM
To: dev , users 
Subject: Re: new PMC member Harikrishna Patnala
Congrats Hari!

From: Daan Hoogland 
Sent: 15 January 2024 14:55
To: dev ; users 
Subject: new PMC member Harikrishna Patnala

users and dev,

The PMC have invited Harikrishna to join their ranks and he has
gracefully accepted. Please join me in congratulating Hari.

--
Daan



 

Re: New committer: Alexandre Mattioli

[Kiran Chavala]

Congratulations Alex!

Regards
Kiran

From: Jithin Raju 
Date: Thursday, 11 January 2024 at 10:16 AM
To: users@cloudstack.apache.org , Dev 

Subject: Re: New committer: Alexandre Mattioli
Congratulations Alex.

-Jithin

From: Nux 
Date: Thursday, 11 January 2024 at 3:58 AM
To: Dev , Users 
Subject: New committer: Alexandre Mattioli
All,

The Project Management Committee (PMC) for Apache CloudStack
has invited Alexandre Mattioli to become a committer and we are pleased
to announce that they have accepted.

Alex has been instrumental in many features present today in Cloudstack,
with a focus on networking and VMWare:
- IPv6 static routing
- Edge Zones
- Autoscaling with VR
- VNF appliances
- VMWare NSX support
- Tungsten Fabric / OpenSDN
- Backup & recovery framework
- VLAN trunking and security policies in ESX
and so on.


Please join me in congratulating Alex!



 

Re: new committer Vladimir Petrov

[Kiran Chavala]

Congratulations Vladi

Regards
Kiran

From: Ruben Bosch 
Date: Tuesday, 12 December 2023 at 11:03 AM
To: d...@cloudstack.apache.org 
Cc: users 
Subject: Re: new committer Vladimir Petrov
Congrats!

Met vriendelijke groet / Kind regards,

Ruben Bosch
CLDIN


 

> On 12 Dec 2023, at 10:52, Daan Hoogland  wrote:
>
> community,
>
> The PMC has decided Vladi to become a committer and he has gracefully
> accepted. Please join me in welcoming Vladi to the project as
> committer.
> Congratulations Vladi
>
> --
> Daan

Re: new PMC member: Abhishek Kumar

[Kiran Chavala]

Congratulations Abhishek well deserved

Regards
Kiran

From: Nux 
Date: Thursday, 23 November 2023 at 2:40 PM
To: users@cloudstack.apache.org 
Subject: Re: new PMC member: Abhishek Kumar
Congrats and well deserved!

On 23 November 2023 09:40:58 CET, Daan Hoogland  wrote:
>The Project Management Committee (PMC) for Apache CloudStack
>has invited Abhishek Kumar to become a PMC member and we are pleased
>to announce that they have accepted.
>
>Abhishek has contributed in the past and has shown effort to make the
>project run smoothly. He is also the Release Manager for the upcoming
>4.19 release.
>
>please join me in congratulating Abhishek
>
>--
>Daan
>

 

Re: Creating a CloudStack AutoScale VM Group with Terraform

[Kiran Chavala]

Hi Palash

Could you please log a improvement issue here  for creating autoscale vm groups 
via terraform

https://github.com/apache/cloudstack-terraform-provider/issues

Regards
Kiran

From: Marco Sinhoreli 
Date: Monday, 20 November 2023 at 10:48 AM
To: users@cloudstack.apache.org 
Subject: Re: Creating a CloudStack AutoScale VM Group with Terraform
Hi Palash

The Autoscale VM group API call is not exposed to the CloudStack Terraform 
Provider. You can find the complete supported CloudStack resources here: 
https://registry.terraform.io/providers/cloudstack/cloudstack/latest/docs


From: Palash Biswas 
Date: Tuesday, 14 November 2023 at 16:40
To: users@cloudstack.apache.org 
Subject: Creating a CloudStack AutoScale VM Group with Terraform
Hello,

I'm looking to create a CloudStack AutoScale VM Group using Terraform, but
I couldn't find clear documentation on how to achieve this, especially
regarding the creation of AutoScale policies and AutoScale VM groups.

My goal is to deploy and manage the entire AutoScale VM Group using
Terraform. I'm currently using Terraform version 1.6.2.

I would greatly appreciate any advice or guidance on how to accomplish this
task.

Thank you for your assistance.

Regards,
Palash Biswas

 

Re: Create Kubernetes Cluster Problem

[Kiran Chavala]

Hi Raihan

Yes the value of endpoint.url should be http://192.168.10.120:8080/client/api

Regards
Kiran


From: Raihan Jana Prasetya 
Date: Thursday, 12 October 2023 at 1:45 PM
To: users@cloudstack.apache.org 
Subject: Re: Create Kubernetes Cluster Problem
in the global settings i need to set the value of the endpoint.url. i
accessed my apache cloudstack from 192.168.10.120:8080/client, does it mean
the value of the endpoint.url should be 192.168.10.120:8080/client/api ?
thank you

On Thu, Oct 12, 2023 at 10:49 AM Raihan Jana Prasetya <
raihanjanaprase...@gmail.com> wrote:

> Hi Kiran,
>
> Thank you for the respond. yes i have used the same command to generate
> the ISO. Last night i turned off the server, and this morning i checked,
> all of the pods are now running, but NOT READY yet. I think restart made
> them running now.
> The issue i'm facing now is, i'm trying to start the k8s cluster again
> from the UI, but it's been 40 minutes on the "SCHEDULED" state on the
> "Events" tab and the state of the cluster and on the Kubernetes tab the
> state of the cluster is "Error". I've run this command too:
>
> skripsi@cloudstack:~$ kubectl --kubeconfig kube.conf create
> serviceaccount dashboard-admin-sa
> serviceaccount/dashboard-admin-sa created
> skripsi@cloudstack:~$ kubectl --kubeconfig kube.conf create
> clusterrolebinding dashboard-admin-sa --clusterrole=cluster-admin
> --serviceaccount=default:dashboard-admin-sa
> clusterrolebinding.rbac.authorization.k8s.io/dashboard-admin-sa created
> *creating token*
>
> skripsi@cloudstack:~$ kubectl --kubeconfig kube.conf get nodes
> --all-namespaces
> NAME   STATUS   ROLES   AGE   VERSION
> k8s-k8s-1272-control-18b19d3c77f   Readycontrol-plane   37h   v1.27.2
> k8s-k8s-1272-node-18b19d40e2b  Ready  37h   v1.27.2
>
> skripsi@cloudstack:~$ kubectl --kubeconfig kube.conf get pods
> --all-namespaces
> NAMESPACE  NAME
>READY   STATUSRESTARTSAGE
> kube-systemcoredns-5d78c9869d-ckm89
>1/1 Running   1 ( ago)   37h
> kube-systemcoredns-5d78c9869d-spn7x
>1/1 Running   1 ( ago)   37h
> kube-systemetcd-k8s-k8s-1272-control-18b19d3c77f
> 0/1 Running   3 ( ago)   37h
> kube-systemkube-apiserver-k8s-k8s-1272-control-18b19d3c77f
> 0/1 Running   3 ( ago)   37h
> kube-system
> kube-controller-manager-k8s-k8s-1272-control-18b19d3c77f   0/1 Running
>  3 ( ago)   37h
> kube-systemkube-proxy-s9jv8
>1/1 Running   3 ( ago)   37h
> kube-systemkube-proxy-zvml6
>1/1 Running   3 ( ago)   37h
> kube-systemkube-scheduler-k8s-k8s-1272-control-18b19d3c77f
> 0/1 Running   3 ( ago)   37h
> kube-systemweave-net-hcsql
> 2/2 Running   3 ( ago)   37h
> kube-systemweave-net-xnq5k
> 2/2 Running   3 ( ago)   37h
> kubernetes-dashboard   dashboard-metrics-scraper-5cb4f4bb9c-ljrh4
>1/1 Running   1 ( ago)   37h
> kubernetes-dashboard   kubernetes-dashboard-6967859bff-b9lm5
> 1/1 Running   1 ( ago)   37h
>
> Regards,
> Raihan
>
> On Wed, Oct 11, 2023 at 6:06 PM Kiran Chavala 
> wrote:
>
>> Hi Raihan
>>
>> I was able to launch a working k8s cluster successfully after generating
>> the iso for 1.2.7.2
>>
>> Please use the following command to generate the ISO
>>
>> ./create-kubernetes-binaries-iso.sh ./ 1.27.2 1.3.0 1.27.0
>> https://raw.githubusercontent.com/weaveworks/weave/master/prog/weave-kube/weave-daemonset-k8s-1.11.yaml
>> https://raw.githubusercontent.com/kubernetes/dashboard/v2.7.0/aio/deploy/recommended.yaml
>> setup-1.27.2<
>> https://raw.githubusercontent.com/kubernetes/dashboard/v2.7.0/aio/deploy/recommended.yaml%20setup-1.27.2
>> >
>>
>> Regards
>> Kiran
>>
>> From: Kiran Chavala 
>> Date: Wednesday, 11 October 2023 at 3:32 PM
>> To: users@cloudstack.apache.org 
>> Subject: Re: Create Kubernetes Cluster Problem
>> Hi Raihan
>>
>>
>> Could you use the community generated  Kubernetes iso
>>
>> https://download.cloudstack.org/cks/setup-1.27.3.iso
>>
>>
>> Meanwhile I will cross check with 1.27.2 version locally and let you know
>> if I can reproduce the issue
>>
>> Regards
>> Kiran
>>
>> From: Raihan Jana Prasetya 
>> Date: Wednesday, 11 October 2023 at 8:30 AM
>> To: users@cloudstack.apache.org 
>> Subject: Create Kubernetes Cluster Problem
>> Hello,
>>
>> I have a problem when creating Kub

Re: Create Kubernetes Cluster Problem

[Kiran Chavala]

Hi Raihan

I was able to launch a working k8s cluster successfully after generating the 
iso for 1.2.7.2

Please use the following command to generate the ISO

./create-kubernetes-binaries-iso.sh ./ 1.27.2 1.3.0 1.27.0 
https://raw.githubusercontent.com/weaveworks/weave/master/prog/weave-kube/weave-daemonset-k8s-1.11.yaml
 
https://raw.githubusercontent.com/kubernetes/dashboard/v2.7.0/aio/deploy/recommended.yaml
 
setup-1.27.2<https://raw.githubusercontent.com/kubernetes/dashboard/v2.7.0/aio/deploy/recommended.yaml%20setup-1.27.2>

Regards
Kiran

From: Kiran Chavala 
Date: Wednesday, 11 October 2023 at 3:32 PM
To: users@cloudstack.apache.org 
Subject: Re: Create Kubernetes Cluster Problem
Hi Raihan


Could you use the community generated  Kubernetes iso

https://download.cloudstack.org/cks/setup-1.27.3.iso


Meanwhile I will cross check with 1.27.2 version locally and let you know if I 
can reproduce the issue

Regards
Kiran

From: Raihan Jana Prasetya 
Date: Wednesday, 11 October 2023 at 8:30 AM
To: users@cloudstack.apache.org 
Subject: Create Kubernetes Cluster Problem
Hello,

I have a problem when creating Kubernetes cluster on apache cloudstack
version 1.18.1 with this Kubernetes version
1.27.2,  kubernetes version, see
https://github.com/kubernetes/kubernetes/releases

1.3.0, CNI version, see https://github.com/containernetworking/plugins/releases

1.27.0, cri-tools version, see
https://github.com/kubernetes-sigs/cri-tools/releases

1.11, weave addon *for* kubernetes, see
https://github.com/weaveworks/weave/tree/master/prog/weave-kube

2.7.0, kubernetes dashboard version, see
https://github.com/kubernetes/dashboard/release


the cluster always fails to start, but the control and regular nodes is
running. This is the issue I found when I check the pods

skripsi@cloudstack:~$ kubectl --kubeconfig kube.conf get pods
--all-namespaces

NAMESPACE
NAME   READY
STATUS  RESTARTS  AGE

kube-system
coredns-5d78c9869d-ckm89   0/1
Pending 0 12h

kube-system
coredns-5d78c9869d-spn7x   0/1
Pending 0 12h

kube-system
etcd-k8s-k8s-1272-control-18b19d3c77f  1/1
Running 1 (32m ago)   12h

kube-system
kube-apiserver-k8s-k8s-1272-control-18b19d3c77f1/1
Running 1 (32m ago)   12h

kube-system
kube-controller-manager-k8s-k8s-1272-control-18b19d3c77f   1/1
Running 1 (32m ago)   12h

kube-system
kube-proxy-s9jv8   1/1
Running 1 (32m ago)   12h

kube-system
kube-proxy-zvml6   1/1
Running 1 (32m ago)   12h

kube-system
kube-scheduler-k8s-k8s-1272-control-18b19d3c77f1/1
Running 1 (32m ago)   12h

kube-system
weave-net-hcsql0/2
Init:ImagePullBackOff   0 12h

kube-system
weave-net-xnq5k0/2
Init:ImagePullBackOff   0 12h

kubernetes-dashboard
dashboard-metrics-scraper-5cb4f4bb9c-ljrh4 0/1
Pending 0 12h

kubernetes-dashboard
kubernetes-dashboard-6967859bff-b9lm5  0/1
Pending 0 12h

When i want to check the pods, it says that i need to be logged in to the
server

skripsi@cloudstack:~$ kubectl describe pod weave-net-hcsql

E1011 02:30:01.456779   23642 memcache.go:265] couldn't get current server
API group list: the server has asked for the client to provide credentials

E1011 02:30:01.457860   23642 memcache.go:265] couldn't get current server
API group list: the server has asked for the client to provide credentials

E1011 02:30:01.458810   23642 memcache.go:265] couldn't get current server
API group list: the server has asked for the client to provide credentials

E1011 02:30:01.460754   23642 memcache.go:265] couldn't get current server
API group list: the server has asked for the client to provide credentials

E1011 02:30:01.462716   23642 memcache.go:265] couldn't get current server
API group list: the server has asked for the client to provide credentials

error: You must be logged in to the server (the server has asked for the
client to provide credentials)

Can you please guide me what should i do. thank you :)



 

Re: Create Kubernetes Cluster Problem

[Kiran Chavala]

Hi Raihan


Could you use the community generated  Kubernetes iso

https://download.cloudstack.org/cks/setup-1.27.3.iso


Meanwhile I will cross check with 1.27.2 version locally and let you know if I 
can reproduce the issue

Regards
Kiran

From: Raihan Jana Prasetya 
Date: Wednesday, 11 October 2023 at 8:30 AM
To: users@cloudstack.apache.org 
Subject: Create Kubernetes Cluster Problem
Hello,

I have a problem when creating Kubernetes cluster on apache cloudstack
version 1.18.1 with this Kubernetes version
1.27.2,  kubernetes version, see
https://github.com/kubernetes/kubernetes/releases

1.3.0, CNI version, see https://github.com/containernetworking/plugins/releases

1.27.0, cri-tools version, see
https://github.com/kubernetes-sigs/cri-tools/releases

1.11, weave addon *for* kubernetes, see
https://github.com/weaveworks/weave/tree/master/prog/weave-kube

2.7.0, kubernetes dashboard version, see
https://github.com/kubernetes/dashboard/release


the cluster always fails to start, but the control and regular nodes is
running. This is the issue I found when I check the pods

skripsi@cloudstack:~$ kubectl --kubeconfig kube.conf get pods
--all-namespaces

NAMESPACE
NAME   READY
STATUS  RESTARTS  AGE

kube-system
coredns-5d78c9869d-ckm89   0/1
Pending 0 12h

kube-system
coredns-5d78c9869d-spn7x   0/1
Pending 0 12h

kube-system
etcd-k8s-k8s-1272-control-18b19d3c77f  1/1
Running 1 (32m ago)   12h

kube-system
kube-apiserver-k8s-k8s-1272-control-18b19d3c77f1/1
Running 1 (32m ago)   12h

kube-system
kube-controller-manager-k8s-k8s-1272-control-18b19d3c77f   1/1
Running 1 (32m ago)   12h

kube-system
kube-proxy-s9jv8   1/1
Running 1 (32m ago)   12h

kube-system
kube-proxy-zvml6   1/1
Running 1 (32m ago)   12h

kube-system
kube-scheduler-k8s-k8s-1272-control-18b19d3c77f1/1
Running 1 (32m ago)   12h

kube-system
weave-net-hcsql0/2
Init:ImagePullBackOff   0 12h

kube-system
weave-net-xnq5k0/2
Init:ImagePullBackOff   0 12h

kubernetes-dashboard
dashboard-metrics-scraper-5cb4f4bb9c-ljrh4 0/1
Pending 0 12h

kubernetes-dashboard
kubernetes-dashboard-6967859bff-b9lm5  0/1
Pending 0 12h

When i want to check the pods, it says that i need to be logged in to the
server

skripsi@cloudstack:~$ kubectl describe pod weave-net-hcsql

E1011 02:30:01.456779   23642 memcache.go:265] couldn't get current server
API group list: the server has asked for the client to provide credentials

E1011 02:30:01.457860   23642 memcache.go:265] couldn't get current server
API group list: the server has asked for the client to provide credentials

E1011 02:30:01.458810   23642 memcache.go:265] couldn't get current server
API group list: the server has asked for the client to provide credentials

E1011 02:30:01.460754   23642 memcache.go:265] couldn't get current server
API group list: the server has asked for the client to provide credentials

E1011 02:30:01.462716   23642 memcache.go:265] couldn't get current server
API group list: the server has asked for the client to provide credentials

error: You must be logged in to the server (the server has asked for the
client to provide credentials)

Can you please guide me what should i do. thank you :)

 

Re: [ANNOUNCEMENT] Apache CloudStack LTS Maintenance Release 4.18.1.0

[Kiran Chavala]

Congratulations everyone on the new release

Regards
Kiran



From: Rohit Yadav 
Date: Friday, 15 September 2023 at 10:12 PM
To: users@cloudstack.apache.org , 
d...@cloudstack.apache.org 
Cc: Wei ZHOU 
Subject: Re: [ANNOUNCEMENT] Apache CloudStack LTS Maintenance Release 4.18.1.0
Congratulations everyone on the new release, and thanks Wei and everyone 
involved in the release and voting process.


Regards.


From: Nicolas Vazquez 
Sent: Friday, September 15, 2023 20:36
To: users@cloudstack.apache.org 
Cc: Wei ZHOU 
Subject: Re: [ANNOUNCEMENT] Apache CloudStack LTS Maintenance Release 4.18.1.0

Great, thanks Wei!

Regards,
Nicolas Vazquez


On 15/9/23, 11:18, "Sina Kashipazha"  
wrote:

Congrats! Well done Wei!



--






 

- Original Message ---
On Friday, September 15th, 2023 at 3:56 PM, Nux 
mailto:n...@li.nux.ro>> wrote:


>

>

> That's amazing! Thanks, Wei!
>

>

>

> On 2023-09-15 14:44, Wei ZHOU wrote:
>

> > The Apache CloudStack project is pleased to announce the release of
> > CloudStack 4.18.1.0.
> >

> > The CloudStack 4.18.1.0 release is a maintenance release as part of
> > its 4.18.x LTS branch and contains around 200 fixes and
> > improvements since the CloudStack 4.18.0.0 release. Some of the
> > highlights include:
> >

> > - Support Managed User Data in AutoScale VM groups
> > - Support CKS (CloudStack Kubernetes Cluster) in VPC tiers
> > - Support for VMware 8.0.0.x
> > - Several Hypervisor (VMware, KVM, XenServer) fixes and improvements
> > - Several UI fixes and improvements
> > - Several Network (L2, VXLAN, etc) fixes and improvements
> > - Several System VM (CPVM, SSVM) fixes and improvements
> > - Improve Solidfire storage plugin integration on VMware
> > - Support volume migration in ScaleIO/PowerFlex within and across
> > ScaleIO/PowerFlex storage clusters
> > - Volume encryption support for StorPool
> > - Fix CloudStack upgrade with some MySQL versions
> > - Fix guest OSes and guest OS mappings in CloudStack database
> >

> > CloudStack LTS branches are supported for 18 months and will receive
> > updates for the first 12 months and only security updates in the last
> > 6 months.
> >

> > Apache CloudStack is an integrated Infrastructure-as-a-Service (IaaS)
> > software platform that allows users to build feature-rich public and
> > private cloud environments. CloudStack includes an intuitive user
> > interface and rich API for managing the compute, networking, software,
> > and storage resources. The project became an Apache top-level project
> > in March, 2013.
> >

> > More information about Apache CloudStack can be found at:
> > https://cloudstack.apache.org/
> >

> > # Documentation
> >

> > What's new in CloudStack 4.18.1.0:
> > https://docs.cloudstack.apache.org/en/4.18.1.0/releasenotes/about.html
> >

> > The 4.18.1.0 release notes include a full list of issues fixed, as
> > well as upgrade instructions from previous versions of Apache
> > CloudStack, and can be found at:
> > https://docs.cloudstack.apache.org/en/4.18.1.0/releasenotes/
> >

> > The official installation, administration, and API documentation for
> > each of the releases are available on our documentation page:
> > https://docs.cloudstack.apache.org/
> >

> > # Downloads
> >

> > The official source code for the 4.18.1.0 release can be downloaded
> > from our downloads page:
> > https://cloudstack.apache.org/downloads.html
> >

> > In addition to the official source code release, individual
> > contributors have also made convenience binaries available on the
> > Apache CloudStack download page, and can be found at:
> >

> > https://download.cloudstack.org/el/7/
> > https://download.cloudstack.org/el/8/
> > https://download.cloudstack.org/ubuntu/dists/
> > https://www.shapeblue.com/packages/

Re: Network ID is already under use by another Kubernetes cluster

[Kiran Chavala]

Hi Cristian

Currently  only one Kubernetes cluster can be launched in a Network.

You can create a improvement/enhancement request for this feature

https://github.com/apache/cloudstack/issues

Regards
Kiran

From: cristian.c@istream.today 
Date: Tuesday, 5 September 2023 at 4:23 PM
To: users@cloudstack.apache.org 
Subject: Network ID is already under use by another Kubernetes cluster
Hello,



  I just tried to create a Kubernetes cluster and I get this error : Network
ID: fffdc800-1c6e-4fb7-a8b6-34b10218245e is already under use by another
Kubernetes cluster.   I'm not allowed to have multiple cluster in the same
network?


  I'm asking this because I saw that there is no option to create multiple
node pools inside a cluster ( similar to digital ocean ).

Thank you,

Cristian

 

Re: [DISCUSS] Simplifying constructs and UX

[Kiran Chavala]

Hi Rohit

Good  Ideas !, Please find my feedback inline


1.  Does it make sense to simply the Default View as a Project which cannot be 
deleted and primary space for the Account. Essentially, the default view is the 
logged in account/user's project with no other collaborators

Kiran> I prefer to keep the Default view as there should be some differentiation

Projects is a feature (like grouping) through which a user can organize his 
resources in Cloudstack.

Other public cloud providers uses the concept of resource groups to organize a 
account resources

May be it could be useful is future as more integrations are added to Cloudstack

2.  Migrate all isolated network constructs as VPC with a single tier.

Kiran> +1 for this

All other public cloud providers  by default deploy a vpc network along with 
the vm deployment

Do you mean by default Cloudstack, should create a vpc  network , instead of 
isolated network ?

Currently isolated network is created by default during vm creation


3.  Simplify templates/isos that are listed in deploy VM form: as a user, the 
template/iso section of the deploy VM form is complicated, would it make sense 
to simplify the template/iso shown as groups of guest OS family (like several 
other portals) and templates uploaded/registered by the account separately.

Kiran> +1 for this

Also I believe the community and shared filter can be merged into one as it 
simplifies

4.  Remove data disk from VM deploy form, or hide it by default (show a button 
- add volume):
Currently, the deploy VM form only supports one data disk, however API can 
multiple disks. One can always still use APIs, but deploy VM and later attach 
more disks; or deploy vm but not start it, attach as many data disks as we want 
and then start it.

Kiran> I believe the data disk should be present in the vm deploy form, as the 
user should have the option to select large disk for his use case

Also when deploying a vm from ISO, a data disk offering is a mandatory feild


5.  Show user-data and affinity (placement) groups as a first-class step, not 
hidden under advanced menu.

Kiran> +1, as user-data(cloud-init) is widely used in automation as it helps in 
bringing up the vm with the required configuration

+1 also for shifting the affinity groups from advanced menu

6.  Offering groups or bundles: introduce way to group/bundle compute/data 
offerings; for example, I want to see CPU optimised offerings, memory 
optimiised offerings, specialised offerings (say GPU) etc.

Kiran> +1, for this

Regards
Kiran

From: Rohit Yadav 
Date: Friday, 11 August 2023 at 9:44 PM
To: d...@cloudstack.apache.org 
Cc: users@cloudstack.apache.org 
Subject: [DISCUSS] Simplifying constructs and UX
All,

Request for comments on following ideas, largely in the UI:

  1.  Does it make sense to simply the Default View as a Project which cannot 
be deleted and primary space for the Account. Essentially, the default view is 
the logged in account/user's project with no other collaborators

  2.  Migrate all isolated network constructs as VPC with a single tier.

  3.  Simplify templates/isos that are listed in deploy VM form: as a user, the 
template/iso section of the deploy VM form is complicated, would it make sense 
to simplify the template/iso shown as groups of guest OS family (like several 
other portals) and templates uploaded/registered by the account separately.

  4.  Remove data disk from VM deploy form, or hide it by default (show a 
button - add volume):
Currently, the deploy VM form only supports one data disk, however API can 
multiple disks. One can always still use APIs, but deploy VM and later attach 
more disks; or deploy vm but not start it, attach as many data disks as we want 
and then start it.

  5.  Show user-data and affinity (placement) groups as a first-class step, not 
hidden under advanced menu.

  6.  Offering groups or bundles: introduce way to group/bundle compute/data 
offerings; for example, I want to see CPU optimised offerings, memory 
optimiised offerings, specialised offerings (say GPU) etc.


Regards.



 

Re: Guest OS Rhel 9 and centos 9 going to kernel panic mode.

[Kiran Chavala]

Hi Sanjay

This look like limitation from the el9 side

https://www.phoronix.com/news/RHEL-9-x86-64-v2-Plans
https://developers.redhat.com/blog/2021/01/05/building-red-hat-enterprise-linux-9-for-the-x86-64-v2-microarchitecture-level#recommendations_for_rhel_9

https://forums.rockylinux.org/t/rocky-linux-9-virtualbox-kernel-panic/6692/5


As a workaround, Please perform the following changes

1. Edit the file present on the kvm hosts  
“/etc/cloudstack/agent/agent.properties “

guest.cpu.mode=host-passthrough

2. Restart the agent service

service cloudstack-agent restart

---
Now to try to launch a  new centos 9 stream vm from the ISO

Regards
Kiran


From: Sanjay Kumar 
Date: Wednesday, 2 August 2023 at 12:58 PM
To: users@cloudstack.apache.org , 
d...@cloudstack.apache.org 
Subject: Guest OS Rhel 9 and centos 9 going to kernel panic mode.
Hello,

We are facing strange issue with guest Os rhel 9 and centos 9 going to
kernel panic mode while deploying the vm.

ACS_Version: 4.18
KVM_Host: Rocky_Linux 8.8

Any help would be much appreciated

Thanks,
Sanjay Kumar

 

Re: Introductions

[Kiran Chavala]

Welcome Ayush!

Regards
Kiran


From: Ruben Bosch 
Date: Friday, 26 May 2023 at 12:06 PM
To: users@cloudstack.apache.org 
Subject: Re: Introductions
Hi Ayush,

Welcome and good luck!

Met vriendelijke groet / Kind regards,

Ruben Bosch
CLDIN


 

> On 26 May 2023, at 06:51, Ayush Pandey  wrote:
>
> Hi Everyone,
>
> I am Ayush Pandey, joining the community for a project as part of Google
> Summer of code 2023. I will be working with my mentor Nicolas Vazquez on
> "Extend Import-Export Instances to the KVM Hypervisor"
> https://github.com/apache/cloudstack/issues/7127
>
> I am really looking forward to collaborating with and learning from this
> amazing community.
>
> Thank you,
> Regards,
> Ayush Pandey

Re: Error on UEFI Secure boot on 4.18

[Kiran Chavala]

Hi Pratik

As discussed , could you please try it on centos 8 instead of ubuntu and raise 
a github issue for UEFI on ubuntu

https://github.com/apache/cloudstack/issues

http://docs.cloudstack.apache.org/en/latest/installguide/hypervisor/kvm.html?highlight=uefi#uefi-legacy-secureboot

Please refer the Limitations

https://cwiki.apache.org/confluence/display/CLOUDSTACK/Enable+UEFI+booting+for+Instance

Regards
Kiran

From: Pratik Chandrakar 
Date: Tuesday, 2 May 2023 at 10:29 AM
To: users@cloudstack.apache.org 
Subject: Re: Error on UEFI Secure boot on 4.18
Hi Kiran,
I tried but still got the same error message "Guest has not initialized the
display (yet)." for UEFI - Secure Boot only. However, I can manually create
and boot vm in Secure mode on the same machine. Please advise

On Fri, Apr 14, 2023 at 10:42 AM Kiran Chavala 
wrote:

> Hi Pratik
>
>
> 1. Try the following steps
>
>
> Edit the file /etc/libvirt/qemu.conf and add the following line
>
> nvram =
> ["/usr/share/OVMF/OVMF_CODE.secboot.fd:/usr/share/OVMF/OVMF_VARS.fd"]
>
> 2. Restart the cloud stack agent and libvirtd or force reconnect the host
>
> service libvirtd restart
> service cloudstack-agent restart
>
> 3. Check the db entry value for host.uefi.enable
>
> mysql> select * from host_details;
>
> ++-++--+
> | id | host_id | name   |
> value|
>
> ++-++--+
> |  1 |   1 | Host.OS.Kernel.Version |
> 5.15.0-35-generic|
> |  2 |   1 | com.cloud.network.Networks.RouterPrivateIpStrategy |
> HostLocal|
> |  3 |   1 | Host.OS.Version|
> 22.04|
> |  4 |   1 | host.volume.encryption |
> true |
> |  5 |   1 | secured|
> true |
> |  6 |   1 | Host.OS|
> Ubuntu   |
> |  8 |   1 | password   |
> Nl8+U+aEYhs7XQmf6Jz9Q6b5JmGqbO4fvV3xfDT+KgNYfd19g8us |
> | 14 |   1 | username   |
> root |
> | 28 |   1 | host.uefi.enable   |
> true |
>
> ++-++--+
> 9 rows in set (0.00 sec)
>
> 3. Register a uefi template
>
> https://repo.almalinux.org/almalinux/8/cloud/x86_64/images/
>
>
> 4. Try to deploy a vm
>
> -
> If you are still facing the issue, then please try with Centos 8 host/
> instead of Ubuntu 22.04.2 as i think it could be a limitation
>
>
> http://docs.cloudstack.apache.org/en/latest/installguide/hypervisor/kvm.html?highlight=uefi#uefi-legacy-secureboot
>
> Please refer the Limitations
>
>
> https://cwiki.apache.org/confluence/display/CLOUDSTACK/Enable+UEFI+booting+for+Instance
>
>
>
> Also, Could you raise a Github issue for this
>
>
> https://github.com/apache/cloudstack/issues
>
> Regards
> Kiran
>
> 
> From: Pratik Chandrakar 
> Sent: 13 April 2023 18:02
> To: users@cloudstack.apache.org 
> Subject: Error on UEFI Secure boot on 4.18
>
> Hello All,
>  I am getting "Guest has not initialized the display (yet)." message on VM
> creation on CKS 4.18 on UEFI - Secure boot however there is no issue on
> UEFI - Legacy mode. Environment details are
>  Cloudstack : 4.18
>  Host : Ubuntu 22.04.2
>  Content of uefi.properties
>guest.nvram.template.secure=/usr/share/OVMF/OVMF_VARS.fd
>guest.nvram.template.legacy=/usr/share/OVMF/OVMF_VARS.fd
>guest.loader.secure=/usr/share/OVMF/OVMF_CODE.secboot.fd
>guest.loader.legacy=/usr/share/OVMF/OVMF_CODE.fd
>guest.nvram.path=/var/lib/libvirt/qemu/nvram/
>
> Please guide.
>
> --
> *Regards,*
> *Pratik Chandrakar*
>
>
>
>

--
*Regards,*
*Pratik Chandrakar*

 

Re: Error on UEFI Secure boot on 4.18

[Kiran Chavala]

Hi Pratik


1. Try the following steps


Edit the file /etc/libvirt/qemu.conf and add the following line

nvram = ["/usr/share/OVMF/OVMF_CODE.secboot.fd:/usr/share/OVMF/OVMF_VARS.fd"]

2. Restart the cloud stack agent and libvirtd or force reconnect the host

service libvirtd restart
service cloudstack-agent restart

3. Check the db entry value for host.uefi.enable

mysql> select * from host_details;
++-++--+
| id | host_id | name   | value 
   |
++-++--+
|  1 |   1 | Host.OS.Kernel.Version | 
5.15.0-35-generic|
|  2 |   1 | com.cloud.network.Networks.RouterPrivateIpStrategy | HostLocal 
   |
|  3 |   1 | Host.OS.Version| 22.04 
   |
|  4 |   1 | host.volume.encryption | true  
   |
|  5 |   1 | secured| true  
   |
|  6 |   1 | Host.OS| Ubuntu
   |
|  8 |   1 | password   | 
Nl8+U+aEYhs7XQmf6Jz9Q6b5JmGqbO4fvV3xfDT+KgNYfd19g8us |
| 14 |   1 | username   | root  
   |
| 28 |   1 | host.uefi.enable   | true  
   |
++-++--+
9 rows in set (0.00 sec)

3. Register a uefi template

https://repo.almalinux.org/almalinux/8/cloud/x86_64/images/


4. Try to deploy a vm

-
If you are still facing the issue, then please try with Centos 8 host/ instead 
of Ubuntu 22.04.2 as i think it could be a limitation

http://docs.cloudstack.apache.org/en/latest/installguide/hypervisor/kvm.html?highlight=uefi#uefi-legacy-secureboot

Please refer the Limitations

https://cwiki.apache.org/confluence/display/CLOUDSTACK/Enable+UEFI+booting+for+Instance



Also, Could you raise a Github issue for this


https://github.com/apache/cloudstack/issues

Regards
Kiran


From: Pratik Chandrakar 
Sent: 13 April 2023 18:02
To: users@cloudstack.apache.org 
Subject: Error on UEFI Secure boot on 4.18

Hello All,
 I am getting "Guest has not initialized the display (yet)." message on VM
creation on CKS 4.18 on UEFI - Secure boot however there is no issue on
UEFI - Legacy mode. Environment details are
 Cloudstack : 4.18
 Host : Ubuntu 22.04.2
 Content of uefi.properties
   guest.nvram.template.secure=/usr/share/OVMF/OVMF_VARS.fd
   guest.nvram.template.legacy=/usr/share/OVMF/OVMF_VARS.fd
   guest.loader.secure=/usr/share/OVMF/OVMF_CODE.secboot.fd
   guest.loader.legacy=/usr/share/OVMF/OVMF_CODE.fd
   guest.nvram.path=/var/lib/libvirt/qemu/nvram/

Please guide.

--
*Regards,*
*Pratik Chandrakar*

 

Re: [ANNOUNCE] New VP of Apache CloudStack - Rohit Yadav

[Kiran Chavala]

Congratulations Rohit 

Regards
Kiran

From: Simon Weller 
Sent: 30 March 2023 09:05
To: d...@cloudstack.apache.org ; 
users@cloudstack.apache.org 
Cc: priv...@cloudstack.apache.org 
Subject: [ANNOUNCE] New VP of Apache CloudStack - Rohit Yadav

All,

I'm very pleased to announce that the ASF board has accepted the nomination
of Rohit Yadav to be the new VP of the Apache CloudStack project.

It has been my pleasure to serve as the VP over the past year, and I'd like
to thank the community for all of the support.

Rohit, congratulations and I wish you the best as you take on this new role.

-Simon

 

Re: We are facing strange issue with acs 4.18 with Rocky Linux9

[Kiran Chavala]

Hi sanjay

Could you please give access to the logs

Regards
Kiran

From: Sanjay Kumar 
Sent: 27 March 2023 23:40
To: users@cloudstack.apache.org 
Cc: d...@cloudstack.apache.org 
Subject: Re: We are facing strange issue with acs 4.18 with Rocky Linux9

  logs.zip



On Mon, Mar 27, 2023, 11:07 PM Wei ZHOU  wrote:

> Can you share the full log while added the host ?
>
> -Wei
>
>
>
> On Monday, 27 March 2023, Sanjay Kumar  wrote:
>
> > Hi All,
> >
> > We have setup the lab acs 4.18 with Rocky linux 9 and it was running but
> > after a day we faced the issue. is there any OS dependencies with 4.18?
> >
> >
> >
> > Could not add host at [http://10.40.40.71] with zone [1], pod [1] and
> > cluster [1] due to: [ can't setup agent, due to
> > com.cloud.utils.exception.CloudRuntimeException: Failed to setup keystore
> > on the KVM host: 10.40.40.71 - Failed to setup keystore on the KVM host:
> > 10.40.40.71].
> >
> >
> > 2023-03-27 10:09:11,382 DEBUG [c.c.c.ClusterManagerImpl]
> > (Cluster-Heartbeat-1:ctx-3383eeb3) (logid:c03fe0a7) Detected management
> > node left, id:2, nodeIP:10.40.40.23
> > 2023-03-27 10:09:11,382 INFO  [c.c.c.ClusterManagerImpl]
> > (Cluster-Heartbeat-1:ctx-3383eeb3) (logid:c03fe0a7) Trying to connect to
> > 10.40.40.23
> > 2023-03-27 10:09:11,383 INFO  [c.c.c.ClusterManagerImpl]
> > (Cluster-Heartbeat-1:ctx-3383eeb3) (logid:c03fe0a7) Management node 2 is
> > detected inactive by timestamp but is pingable
> > 2023-03-27 10:09:12,882 DEBUG [c.c.c.ClusterManagerImpl]
> > (Cluster-Heartbeat-1:ctx-ee783d0b) (logid:87ac62d2) Detected management
> > node left, id:2, nodeIP:10.40.40.23
> > 2023-03-27 10:09:12,882 INFO  [c.c.c.ClusterManagerImpl]
> > (Cluster-Heartbeat-1:ctx-ee783d0b) (logid:87ac62d2) Trying to connect to
> > 10.40.40.23
> > 2023-03-27 10:09:12,882 INFO  [c.c.c.ClusterManagerImpl]
> > (Cluster-Heartbeat-1:ctx-ee783d0b) (logid:87ac62d2) Management node 2 is
> > detected inactive by timestamp but is pingable
> > 2023-03-27 10:09:14,382 DEBUG [c.c.c.ClusterManagerImpl]
> > (Cluster-Heartbeat-1:ctx-1f50e525) (logid:a4ef06ad) Detected management
> > node left, id:2, nodeIP:10.40.40.23
> > 2023-03-27 10:09:14,383 INFO  [c.c.c.ClusterManagerImpl]
> > (Cluster-Heartbeat-1:ctx-1f50e525) (logid:a4ef06ad) Trying to connect to
> > 10.40.40.23
> > 2023-03-27 10:09:14,383 INFO  [c.c.c.ClusterManagerImpl]
> > (Cluster-Heartbeat-1:ctx-1f50e525) (logid:a4ef06ad) Management node 2 is
> > detected inactive by timestamp but is pingable
> > 2023-03-27 10:09:15,122 DEBUG [o.a.c.h.HAManagerImpl]
> > (BackgroundTaskPollManager-6:ctx-b26dd505) (logid:66b6c0db) HA health
> > check
> > task is running...
> > [root@ASCLDACS01 ~]# tail
> > /var/log/cloudstack/management/management-server.log
> > 2023-03-27 10:09:14,382 DEBUG [c.c.c.ClusterManagerImpl]
> > (Cluster-Heartbeat-1:ctx-1f50e525) (logid:a4ef06ad) Detected management
> > node left, id:2, nodeIP:10.40.40.23
> > 2023-03-27 10:09:14,383 INFO  [c.c.c.ClusterManagerImpl]
> > (Cluster-Heartbeat-1:ctx-1f50e525) (logid:a4ef06ad) Trying to connect to
> > 10.40.40.23
> > 2023-03-27 10:09:14,383 INFO  [c.c.c.ClusterManagerImpl]
> > (Cluster-Heartbeat-1:ctx-1f50e525) (logid:a4ef06ad) Management node 2 is
> > detected inactive by timestamp but is pingable
> > 2023-03-27 10:09:15,122 DEBUG [o.a.c.h.HAManagerImpl]
> > (BackgroundTaskPollManager-6:ctx-b26dd505) (logid:66b6c0db) HA health
> > check
> > task is running...
> > 2023-03-27 10:09:15,881 DEBUG [c.c.c.ClusterManagerImpl]
> > (Cluster-Heartbeat-1:ctx-b3ca8d68) (logid:50c9cf85) Detected management
> > node left, id:2, nodeIP:10.40.40.23
> > 2023-03-27 10:09:15,881 INFO  [c.c.c.ClusterManagerImpl]
> > (Cluster-Heartbeat-1:ctx-b3ca8d68) (logid:50c9cf85) Trying to connect to
> > 10.40.40.23
> > 2023-03-27 10:09:15,882 INFO  [c.c.c.ClusterManagerImpl]
> > (Cluster-Heartbeat-1:ctx-b3ca8d68) (logid:50c9cf85) Management node 2 is
> > detected inactive by timestamp but is pingable
> > 2023-03-27 10:09:17,382 DEBUG [c.c.c.ClusterManagerImpl]
> > (Cluster-Heartbeat-1:ctx-2dbaab99) (logid:7f3a46b4) Detected management
> > node left, id:2, nodeIP:10.40.40.23
> > 2023-03-27 10:09:17,382 INFO  [c.c.c.ClusterManagerImpl]
> > (Cluster-Heartbeat-1:ctx-2dbaab99) (logid:7f3a46b4) Trying to connect to
> > 10.40.40.23
> > 2023-03-27 10:09:17,383 INFO  [c.c.c.ClusterManagerImpl]
> > (Cluster-Heartbeat-1:ctx-2dbaab99) (logid:7f3a46b4) Management node 2 is
> > detected inactive by timestamp but is pingable
> >
> >
> > Any help you can give would be greatly appreciated
> >
> >
> >
> > With Regards,
> >
> > Sanjay
> >
>

 

Re: Daan Hoogland - New ASF Member

[Kiran Chavala]

Congratulations Daan

Regards
Kiran

From: Paul Angus 
Sent: 24 March 2023 14:58
To: users@cloudstack.apache.org ; 
d...@cloudstack.apache.org 
Subject: Daan Hoogland - New ASF Member



It is my pleasure to announce that Daan Hoogland as been elected to become a
member of the ASF.

The ASF would like to recognize both his practical involvement and the way
in which he has interacted with others in and around the ASF.



Congratulations  Daan.









Kind regards



Paul Angus




 

Re: Enabling UEFI secure Boot on ACS 4.17.2 KVM+Ubuntu

[Kiran Chavala]

Hi



Could you please add the following configuration in  /etc/libvirt/qemu.conf

nvram = ["/usr/share/OVMF/OVMF_CODE.secboot.fd:/usr/share/OVMF/OVMF_VARS.fd"]


restart the cloudstack agent and libvirtd services


I have not tried on Ubuntu, The uefi feature works fine with KVM+Centos/ 8


In the database could you please check the following query

select * from host_details where name="host.uefi.enable";

You can also refer to the following issues

https://github.com/apache/cloudstack/pull/3638

https://github.com/apache/cloudstack/issues/4238


Regards
Kiran



From: Joan g 
Sent: 21 March 2023 18:41
To: users@cloudstack.apache.org 
Subject: Enabling UEFI secure Boot on ACS 4.17.2 KVM+Ubuntu

Hello,

I am trying to deploy a Windows machine with Secure boot. But its getting
failed with message " Cannot deploy to specified host as host does n't
support uefi vm deployment, returning."

OVMF is already installed in KVM node and uefi.properties are updated with
below details:

===
guest.nvram.template.secure=/usr/share/OVMF/OVMF_VARS.fd
guest.nvram.template.legacy=/usr/share/OVMF/OVMF_VARS.fd
guest.loader.secure=/usr/share/OVMF/OVMF_CODE.secboot.fd
guest.loader.legacy=/usr/share/OVMF/OVMF_CODE.fd
guest.nvram.path=/var/lib/libvirt/qemu/nvram/
===


After restarting the cloudstack-agent in host, still the Database table not
getting updated

-
mysql> select * from host_details where name like '%uefi%';
Empty set (0.00 sec)
-

Can someone advice what I am missing here?

Regards
Jg

 

Re: CloudStack VM search using IP

[Kiran Chavala]

Hi Mosharaf

Or query the database

mysql> select instance_id from nics where ip4_address="<>" and state 
="Allocated";


Also, you can try to use this api call, it's usefull

https://cloudstack.apache.org/api/apidocs-4.17/apis/listNics.html

Regards
Kiran

From: Mosharaf Hossain 
Sent: 18 March 2023 16:15
To: users@cloudstack.apache.org 
Subject: CloudStack VM search using IP

Hi
At the moment, I am unable to locate a VM using its IP address but I can
locate it using its name. Does anyone have any suggestions on how to search
for a VM using its IP?




Regards
Mosharaf Hossain
Manager, Product Development
IT Division

Bangladesh Export Import Company Ltd.

Level-8, SAM Tower, Plot #4, Road #22, Gulshan-1, Dhaka-1212,Bangladesh

Tel: +880 9609 000 999, +880 2 5881 5559, Ext: 14191, Fax: +880 2 9895757

Cell: +8801787680828, Email: mosharaf.hoss...@bol-online.com, Web:
www.bol-online.com


 

Re: Hello Community!!

[Kiran Chavala]

Welcome Jithin

Regards
Kiran

From: Vishesh Jindal 
Sent: 14 March 2023 15:52
To: users@cloudstack.apache.org ; 
d...@cloudstack.apache.org 
Subject: Re: Hello Community!!

Welcome Jithin!

Regards
Vishesh

From: Nicolas Vazquez 
Sent: Tuesday, March 14, 2023 3:44 PM
To: users@cloudstack.apache.org ; 
d...@cloudstack.apache.org 
Subject: Re: Hello Community!!

Welcome Jithin!

Regards,
Nicolas Vazquez


From: Jithin Raju 
Date: Tuesday, 14 March 2023 at 04:57
To: users@cloudstack.apache.org , 
d...@cloudstack.apache.org 
Subject: Hello Community!!
Hi All,

I have joined ShapeBlue and looking forward to getting actively involved in the 
community. Previously I worked on the commercial fork of the ACS, mostly 
involved in technical support.

-Jithin









 

Re: Rocky 9 management setup

[Kiran Chavala]

Hi Vivek

You can comment the line number 45 and line 375 to 391 in the script 
/usr/bin/cloudstack-setup-databases

And try running the cloudstack-setup-databases again

Regards
Kiran




 

From: Jeremy Hansen
Sent: Thursday, March 09, 2023 07:53
To: Vivek Kumar via users
Subject: Rocky 9 management setup

The database setup script seems broken in 4.17.2.0 for Rocky 9.  I realize 
Rocky isn’t officially supported yet but I’d like to try…

Is there an alternative way to setup the db on a fresh install?

Currently seeing

Traceback (most recent call last):
  File "/usr/bin/cloudstack-setup-databases", line 45, in 
from cloud_utils import check_selinux, CheckFailed, resolves_to_ipv6
ImportError: cannot import name 'check_selinux' from 'cloud_utils' 
(/usr/local/lib/python3.9/site-packages/cloud_utils/__init__.py)

Do the latest builds support Rocky 9?

Thanks
-jeremy

Re: Console Proxy VM TLS version and cipher suites

[Kiran Chavala]

Hi Gary

AFAIK, I think cloudstack has disabled  anything below TLS v1.2 from 4.11.0 
release



https://github.com/apache/cloudstack/pull/2480

https://issues.apache.org/jira/browse/CLOUDSTACK-10319

[https://opengraph.githubassets.com/2b9813d128412ed49741e9c7523f4d3fb466d19b3c3b290539fb876ba1bcf0a9/apache/cloudstack/pull/2480]
CLOUDSTACK-10319: Prefer TLSv1.2, deprecate TLSv1.0,1.1 by rohityadavcloud · 
Pull Request #2480 · 
apache/cloudstack
This deprecates and remove TLS 1.0 and 1.1 from preferred list of protocols and 
keeps only TLSv1.2. @blueorangutan package
github.com



Regards
Kiran

From: Gary Dixon 
Sent: 07 March 2023 17:35
To: users@cloudstack.apache.org 
Subject: Console Proxy VM TLS version and cipher suites






Hi all



Is there a way of limiting the console proxy to allow nothing below TLS v1.2, 
1.3 and only allow strong cipher suites – we are failing a PEN test currently 
and need to strengthen the CPVM security ?



TIA



Gary

Gary Dixon​
Senior Technical Consultant
T:  +44 161 537 4990
E:  vms@quadris‑support.com
W: www.quadris.co.uk
[cid:image056775.png@576B6FF7.488A06BD]
The information contained in this e-mail from Quadris may be confidential and 
privileged for the private use of the named recipient.  The contents of this 
e-mail may not necessarily represent the official views of Quadris.  If you 
have received this information in error you must not copy, distribute or take 
any action or reliance on its contents.  Please destroy any hard copies and 
delete this message.

 

Re: Using terraform to spin custom instances?

[Kiran Chavala]

Hi Jordan

Currently it's not possible to select the host id using the terraform provider

https://registry.terraform.io/providers/cloudstack/cloudstack/latest/docs/resources/instance

There is no argument for hostid in terraform code for Cloudstack

Regards
Kiran


From: jordan j 
Sent: 20 February 2023 12:57
To: users@cloudstack.apache.org 
Subject: Re: Using terraform to spin custom instances?

Hello everyone,
One more question regarding the Terraform provider.
When deploying a new instance, is it possible to select the resident host?


Regards,
Jordan




 

On Mon, Jan 23, 2023 at 12:45 PM jordan j  wrote:

> Works like a charm! :)
>
> On Mon, Jan 23, 2023 at 10:44 AM Stephan Bienek 
> wrote:
>
>> Hi Jordan,
>>
>> it actually works but not too great documented.
>> Use the following example:
>>
>> resource "cloudstack_instance" "web" {
>>   name = "server-1"
>>   service_offering = "custom"
>>   network_id   = "c4a3303c-376d-4d56-b336-1bd91cb130b6"
>>   template = "d4c2f9c6-1d18-11ec-9173-50eb7122da94"
>>   zone = "d4a81f75-5d92-415e-ab59-e85cc2ce56d9"
>>   details = {"cpuNumber" = "2", "memory" = "500"}
>> }
>>
>> Best regards,
>> Stephan
>>
>> > jordan j  hat am 23.01.2023 08:42 CET geschrieben:
>> >
>> >
>> > Dear everyone,
>> >
>> > I started playing with the Terraform provider. I noticed that there is
>> no
>> > way to choose custom resource values as my Compute Offering is custom.
>> Is
>> > there a way or that feature is not developed? Any advice is appreciated!
>> >
>> > Regard,
>> > Jordan
>>
>

Re: How to safely change the subnet in CS 4.11.2

[Kiran Chavala]

Hi Pratik

In 4.17.2 ui you can update the network cidr from the ui.

If in 4.11 its not possible you can try from the api

https://cloudstack.apache.org/api/apidocs-4.17/apis/updateNetwork.html

https://cloudstack.apache.org/api/apidocs-4.11/apis/updateNetwork.html

[cid:8f373e55-ce64-4cb7-a333-40adeb0f5963]

Regards
Kiran

From: Pratik Chandrakar 
Sent: 17 February 2023 10:54
To: users@cloudstack.apache.org 
Subject: How to safely change the subnet in CS 4.11.2

Hi all,
 How can I safely increase/change the subnet in CS 4.11.2 as UI has no
option?

--
*Regards,*
*Pratik Chandrakar*

 

Re: Kubernetes load balancer service

[Kiran Chavala]

Hi Stu

Could you please try the Kubernetes service on Advance zone, instead of Basic 
zone.

AFAIK Kubernetes provider requires a advanced zone ( i.e Network with 
Loadbalancing rules)

http://docs.cloudstack.apache.org/en/latest/plugins/cloudstack-kubernetes-provider.html

Regards
Kiran

From: Stuart Whitman 
Sent: 16 February 2023 23:46
To: users@cloudstack.apache.org 
Subject: Kubernetes load balancer service

Hello,

I have enabled the Kubernetes service in a basic networking zone. When I try to 
create a k8s load balancer service, the external-ip never changes from pending.

What do I need to do to enable this feature?

Thanks,
-Stu
_
The information contained in this e-mail and any attachments from Group W may 
contain confidential and/or proprietary information and is intended only for 
the named recipient to whom it was originally addressed. If you are not the 
intended recipient, be aware that any disclosure, distribution, or copying of 
this e-mail or its attachments is strictly prohibited. If you have received 
this e-mail in error, please notify the sender immediately of that fact by 
return e-mail and permanently delete the e-mail and any attachments to it.

 

Re: SSVM Randomly Stopped Connecting

[Kiran Chavala]

HI

Are you able to ssh to the ssvm, If yes can you please execute health check 
script

/usr/local/cloud/systemvm/ssvm-check.sh

Also are you able to connect to the management server on port 8250

from the ssvm

telnet  8250

Also could you please share the /var/log/cloud.out log it will be helpful

Regards
Kiran




 

From: Granwille Strauss
Sent: Wednesday, February 15, 2023 14:15
To: users@cloudstack.apache.org
Cc: Harikrishna Patnala
Subject: Re: SSVM Randomly Stopped Connecting


Hi Harikrishna

I have done so, status remains showing "connecting". And on the dashboard I can 
see my secondary storage usage, which means its supposed to be connected. 
However, if I reboot the cloudstack-management, it will show 0 again. See 
attached.

May I add it most likely was not "random" as I mentioned previously. I did 
update my opensense gateway, which resulted in a reboot. However, connections 
and routing has been perfect again. And then I did also run yum update on the 
kvm host where this SSVM is tied to. And the only error I experienced was that 
mysql-connect-python required python 2.7, which I installed to resolve the 
dependency issue, but python3.6 is still active on the host as well.

On 2/15/23 10:30, Harikrishna Patnala wrote:

Hi,

Have you tried destroying the SSVM, it will be recreated automatically. Please 
try that, it may solve the issue.

Thanks,
Harikrishna

From: Granwille Strauss 

Date: Wednesday, 15 February 2023 at 1:46 PM
To: users@cloudstack.apache.org 

Subject: SSVM Randomly Stopped Connecting

Hi Guys

As the error suggests, this morning my SSVM just randomly stopped connecting 
and agent status remains in "Connecting" mode. ConsolveVM seems perfectly fine. 
I did the regular checks in SSVM and it all seems fine, see attached 
screenshot. I tried force rebooting the SSVM but still nothing. The host kvm 
server is 100% connected as one typically gets the "host unreachable" error 
when something like this, but not this time.

I SSH into the SSVM and ran the 'reboot' command and tailed the management log, 
this is what it throws: https://jpst.it/36K93

I do not see any errors there either. Any suggestions that can help with this, 
please?
--

Regards / Groete
[https://www.adsigner.com/v1/s/631091998d4670001fe43ec2/621c9b76c140bb001ed0f818/logo/621b3fa39fb210001f975298/cd2904ba-304d-4a49-bf33-cbe9ac76d929_248x-.png]
Granwille Strauss  //  Senior Systems Admin

e: 
granwi...@namhost.com
m: +264 81 323 1260
w: 
www.namhost.com

[https://www.adsigner.com/v1/s/631091998d4670001fe43ec2/621c9b76c140bb001ed0f818/social_icon_01/621b3fa39fb210001f975298/9151954b-b298-41aa-89c8-1d68af075373_48x48.png][https://www.adsigner.com/v1/s/631091998d4670001fe43ec2/621c9b76c140bb001ed0f818/social_icon_02/621b3fa39fb210001f975298/85a9dc7c-7bd1-4958-85a9-e6a25baeb028_48x48.png][https://www.adsigner.com/v1/s/631091998d4670001fe43ec2/621c9b76c140bb001ed0f818/social_icon_03/621b3fa39fb210001f975298/c1c5386c-914c-43cf-9d37-5b4aa8e317ab_48x48.png][https://www.adsigner.com/v1/s/631091998d4670001fe43ec2/621c9b76c140bb001ed0f818/social_icon_04/621b3fa39fb210001f975298/3aaa7968-130e-48ec-821d-559a332cce47_48x48.png][https://www.adsigner.com/v1/s/631091998d4670001fe43ec2/621c9b76c140bb001ed0f818/social_icon_05/621b3fa39fb210001f975298/3a8c09e6-588f-43a8-acfd-be4423fd3fb6_48x48.png]

[https://www.adsigner.com/v1/i/631091998d4670001fe43ec2/621c9b76c140bb001ed0f818/banner/940x300]
Namhost Internet Services (Pty) Ltd,

24 Black Eagle Rd, Hermanus, 7210, RSA

The content of this message is confidential. If you have received it by 
mistake, please inform us by email reply and then delete the message. It is 
forbidden to copy, forward, or in any way reveal the contents of this message 
to anyone without our explicit consent. The integrity and security of this 
email cannot be guaranteed over the Internet. Therefore, the sender will not be 
held liable for any damage caused by the message. For our full privacy policy 
and disclaimers, please go to 

Re: [ANNOUNCE] Ivet Petrova has joined the PMC

[Kiran Chavala]

Congratulations Ivet!

From: David Jumani 
Sent: 15 February 2023 11:36
To: users@cloudstack.apache.org ; 
d...@cloudstack.apache.org 
Cc: priv...@cloudstack.apache.org 
Subject: Re: [ANNOUNCE] Ivet Petrova has joined the PMC

Congratulations Ivet!


From: Vishesh Jindal 
Sent: Wednesday, February 15, 2023 10:24 AM
To: users@cloudstack.apache.org 
Cc: d...@cloudstack.apache.org ; 
priv...@cloudstack.apache.org 
Subject: Re: [ANNOUNCE] Ivet Petrova has joined the PMC

Congratulations Ivet!

From: Rohit Yadav 
Sent: Wednesday, February 15, 2023 7:14 AM
To: users@cloudstack.apache.org 
Cc: d...@cloudstack.apache.org ; 
priv...@cloudstack.apache.org 
Subject: Re: [ANNOUNCE] Ivet Petrova has joined the PMC

Congratulations Ivet, well deserved!

Regards.

From: Martijn Struijk 
Sent: Wednesday, February 15, 2023 3:06:18 AM
To: users@cloudstack.apache.org 
Cc: d...@cloudstack.apache.org ; 
priv...@cloudstack.apache.org 
Subject: Re: [ANNOUNCE] Ivet Petrova has joined the PMC

Congratulations Ivet!

On Tue, Feb 14, 2023 at 7:24 PM Nicolas Vazquez <
nicolas.vazq...@shapeblue.com> wrote:

> Congratulations Ivet!
>
> Regards,
> Nicolas Vazquez
> 
> From: Simon Weller 
> Sent: Tuesday, February 14, 2023 1:01 PM
> To: priv...@cloudstack.apache.org ;
> d...@cloudstack.apache.org ;
> users@cloudstack.apache.org 
> Subject: [ANNOUNCE] Ivet Petrova has joined the PMC
>
> Hi everyone,
>
> It gives me great pleasure to announce that Ivet has been invited to join
> the
> CloudStack PMC and she has accepted.
>
> Please join me in congratulating Ivet!
>
> -Simon (on behalf of the CloudStack PMC)
>
>
>
>










 

Re: Updating storage addresses

[Kiran Chavala]

Hi Vivek

The ideal way is to add new primary storage, and secondary storage and migrate 
the existing volumes and snapshots
to the new storages


Note: Updating the database is not recommended and may lead to inconsistency

You please try updating the following tables in the database

mysql> select * from storage_pool;

mysql> update storage_pool set host_address="", path ="" where id="";

Secondary storage

mysql> select * from image_store;

mysql> update image_store set url="" where id="";


Make sure there is no data on primary storage and secondary storage (volumes, 
templates, iso Snapshot,)

Destroy the secondary storage vm once the change is done

Unmanage and Manage the cluster

Regards
Kiran





 

From: Jeremy Hansen
Sent: Tuesday, February 14, 2023 14:30
To: Vivek Kumar via users
Subject: Updating storage addresses

I have to update the primary and secondary storage address just to a new IP for 
NFS.  I can’t seem to find a way to do this through the interface.  Do I have 
to do an update to the db?  Any notes on how to do that?

Thanks
-jeremy

Re: Removing a zone

[Kiran Chavala]

The logs are pointing that there are still active volume in the zone

>From the UI are you able to destroy the data volumes or root volumes attached 
>to any running instances

[cid:e8ca360c-a016-429d-b458-1a845632872e]


DB hack

update volumes set removed=now(), state=Destroy where id="";



Regards
Kiran




 

From: Granwille Strauss
Sent: Monday, February 13, 2023 16:05
To: users@cloudstack.apache.org
Cc: Kiran Chavala
Subject: Re: Removing a zone


Thank you,

After removing ISO via DB method you provided, error still exists so you were 
right, it was not the ISO causing this. Here's the log entry when I attempt to 
delete zone:

2023-02-13 12:31:48,258 ERROR [c.c.a.ApiServer] (qtp262366552-454:ctx-f498ef20 
ctx-6c40cbcd) (logid:dd5b8f8e) unhandled exception executing api command: 
[Ljava.lang.String;@38b34249
com.cloud.utils.exception.CloudRuntimeException: The zone cannot be deleted 
because there are storage volumes in this zone.
at 
com.cloud.configuration.ConfigurationManagerImpl.checkIfZoneIsDeletable(ConfigurationManagerImpl.java:2234)
at 
com.cloud.configuration.ConfigurationManagerImpl.deleteZone(ConfigurationManagerImpl.java:2380)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native 
Method)
at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at 
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at 
org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344)
at 
org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198)
at 
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163)
at 
org.apache.cloudstack.network.contrail.management.EventUtils$EventInterceptor.invoke(EventUtils.java:107)
at 
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175)
at 
com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.java:52)
at 
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175)
at 
org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97)
at 
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)
at 
org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:215)
at com.sun.proxy.$Proxy122.deleteZone(Unknown Source)
at 
org.apache.cloudstack.api.command.admin.zone.DeleteZoneCmd.execute(DeleteZoneCmd.java:72)
at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:163)
at com.cloud.api.ApiServer.queueCommand(ApiServer.java:776)
at com.cloud.api.ApiServer.handleRequest(ApiServer.java:600)
at com.cloud.api.ApiServlet.processRequestInContext(ApiServlet.java:327)
at com.cloud.api.ApiServlet$1.run(ApiServlet.java:145)
at 
org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:55)
at 
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:102)
at 
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:52)
at com.cloud.api.ApiServlet.processRequest(ApiServlet.java:142)
at com.cloud.api.ApiServlet.doGet(ApiServlet.java:96)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:645)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:750)
at 
org.eclipse.jetty.servlet.ServletHolder$NotAsync.service(ServletHolder.java:1450)
at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:799)
at 
org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:550)
at 
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)
at 
org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:600)
at 
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
at 
org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235)
at 
org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1624)
at 
org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
at 
org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1434)
at 
org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)
at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:501)
at 
org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1594)
at 
org.eclipse.jetty.server.handler.ScopedHandler.nextScope(Scoped

Re: Removing a zone

[Kiran Chavala]

Hi Groete

Could you please share the management server logs exception when you are trying 
to delete the zone.

I don't think its related to ISO



If you want to clean up the stale ISO's in the system

Then you need to update the database


  1.  Identify the template id in the vm_template table

select * from vm_template where name="" and format="ISO";

  2.  Update the state field to "Inactive"

update vm_template set state="Inactive" where template_id="";

  3.  Update the removed field to now();

update template_zone_ref set remvoed=now() where template_id="";

  4.  Update the template_Store_ref;

update template_store_ref set destroyed=1, state="Destroyed" where 
template_id="";



Regards
Kiran




 

From: Granwille Strauss
Sent: Monday, February 13, 2023 12:30
To: users@cloudstack.apache.org
Subject: Removing a zone


Hi Guys

I am busy cleaning up zones, and managed to delete all pods and cluster and so 
tied to the zone and all that but when deleting the zone itself it shows there 
is storage devices tied to zone. I have checked it all and there's none. 
However, I believe its because image ISO that were initially installed, see 
attached screenshot, which is why the zone can't be deleted. I tried adding the 
secondary storage again, where it was stored, but no luck. Any ideas how I can 
go about cleaning out these old ISOs to delete my old zone?

--
Regards / Groete

[https://www.adsigner.com/v1/s/631091998d4670001fe43ec2/621c9b76c140bb001ed0f818/logo/621b3fa39fb210001f975298/cd2904ba-304d-4a49-bf33-cbe9ac76d929_248x-.png]
 Granwille Strauss  //  Senior Systems Admin

e: granwi...@namhost.com
m: +264 81 323 1260
w: www.namhost.com

[https://www.adsigner.com/v1/s/631091998d4670001fe43ec2/621c9b76c140bb001ed0f818/social_icon_01/621b3fa39fb210001f975298/9151954b-b298-41aa-89c8-1d68af075373_48x48.png]
 
[https://www.adsigner.com/v1/s/631091998d4670001fe43ec2/621c9b76c140bb001ed0f818/social_icon_02/621b3fa39fb210001f975298/85a9dc7c-7bd1-4958-85a9-e6a25baeb028_48x48.png]
   
[https://www.adsigner.com/v1/s/631091998d4670001fe43ec2/621c9b76c140bb001ed0f818/social_icon_03/621b3fa39fb210001f975298/c1c5386c-914c-43cf-9d37-5b4aa8e317ab_48x48.png]
   
[https://www.adsigner.com/v1/s/631091998d4670001fe43ec2/621c9b76c140bb001ed0f818/social_icon_04/621b3fa39fb210001f975298/3aaa7968-130e-48ec-821d-559a332cce47_48x48.png]
   
[https://www.adsigner.com/v1/s/631091998d4670001fe43ec2/621c9b76c140bb001ed0f818/social_icon_05/621b3fa39fb210001f975298/3a8c09e6-588f-43a8-acfd-be4423fd3fb6_48x48.png]
 

[https://www.adsigner.com/v1/i/631091998d4670001fe43ec2/621c9b76c140bb001ed0f818/banner/940x300]

Namhost Internet Services (Pty) Ltd,

24 Black Eagle Rd, Hermanus, 7210, RSA


The content of this message is confidential. If you have received it by 
mistake, please inform us by email reply and then delete the message. It is 
forbidden to copy, forward, or in any way reveal the contents of this message 
to anyone without our explicit consent. The integrity and security of this 
email cannot be guaranteed over the Internet. Therefore, the sender will not be 
held liable for any damage caused by the message. For our full privacy policy 
and disclaimers, please go to https://www.namhost.com/privacy-policy

[Powered by 
AdSigner]

Re: Failed to create Kubernetes Cluster on ACS 4.17.2

[Kiran Chavala]

Hi Pratik

I was able to deploy k8s cluster on 4.17.2 without any issue

Please try to deploy the k8s cluster with a ssh key pair, so that you can ssh 
to the master node, as it would help us in checking the logs on the master node 
on why the "deploy-kube-system.service" failed to start


cloud@test2-control-18611f3ee0c:/var/log$ ls
alternatives.log  auth.log  cloud-init.log cloud.log   cron.log
debughaproxy.log  kern.log  messages  pods runit  sysstat
apache2   btmp  cloud-init-output.log  containers  daemon.log  
faillog  journal  lastlog   ntpstats  private  samba  wtmp

Regards
Kiran

From: Wei ZHOU 
Sent: 02 February 2023 17:00
To: users@cloudstack.apache.org 
Subject: Re: Failed to create Kubernetes Cluster on ACS 4.17.2

Hi Pratik,

Did you create the k8s cluster on new or existing isolated networks ?


-Wei

On Thu, 2 Feb 2023 at 11:14, Pratik Chandrakar 
wrote:

> Hi Kiran,
> Desired information is as follows,
>   1.  Cloudstack version you are using
> *ACS 4.17.2*
>
>   2.   Kubernetes version iso you had used (
> http://packages.shapeblue.com/cks/)
> *setup-1.23.3.iso* and *setup-1.21.3.iso*
>
>   3.  Which network you used to deploy the kubernetes ( isolated or shared
> ) ?
> *   isolated*
>
>   4.   Are you able to ssh to the master node and worker node from the
> management server
> *No*. But VMs are pinging from the router.
>
> On Thu, Feb 2, 2023 at 3:03 PM Kiran Chavala 
> wrote:
>
> > Hi Pratik
> >
> > Could you please let me know the details of the environment
> >
> >
> >   1.  Cloudstack version you are using
> >
> >   2.   Kubernetes version iso you had used
> > http://packages.shapeblue.com/cks/
> >
> > <http://packages.shapeblue.com/cks/3.>
> >   3.  Which network you used to deploy the kubernetes ( isolated or
> shared
> > ) ?
> >
> >   4.   Are you able to ssh to the master node and worker node from the
> > management server
> >
> > ssh -i /var/cloudstack/management/.ssh/id_rsa -p  root@
> > ssh -i /var/cloudstack/management/.ssh/id_rsa -p 2223 root@
> >
> > If you are able to ssh then could you check if the containers are started
> > on the host or check the kubelet service
> >
> > systemctl status kubelet
> >
> >
> >
> > Regards
> > Kiran
> >
> > <http://packages.shapeblue.com/cks/3.>
> >
> >
> > <http://packages.shapeblue.com/cks/3.>
> >
> >
> > <http://packages.shapeblue.com/cks/>
> >
> >
> > 
> > From: Pratik Chandrakar 
> > Sent: 02 February 2023 14:23
> > To: users@cloudstack.apache.org 
> > Subject: Re: Failed to create Kubernetes Cluster on ACS 4.17.2
> >
> > Hi Kiran,
> > Compute Offering - 4P-8G Ram
> > Network Offering - DefaultNetworkOfferingforKubernetesService in Advanced
> > Zone
> >
> > No exception/error was generated on the management server. but on VM
> > "*Failed
> > to start deploy-kube-system.service*" & "*Failed to Start Execute cloud
> > user/final scripts*". And the UI shows *Create Kubernetes cluster
> > KubeCluster1.23.3 in progress* even after the error on VM.
> >
> >
> >
> > On Thu, Feb 2, 2023 at 1:46 PM Kiran Chavala <
> kiran.chav...@shapeblue.com>
> > wrote:
> >
> > > Hi Pratik
> > >
> > > Could you please send the management server log ( exception)
> > >
> > > What is compute offering you have used for deploying the k8s cluster,
> can
> > > you make sure you use at least 2 gb ram and 2 cores offering
> > >
> > > Regards
> > > Kiran
> > > 
> > > From: Pratik Chandrakar 
> > > Sent: 02 February 2023 13:28
> > > To: users@cloudstack.apache.org 
> > > Subject: Failed to create Kubernetes Cluster on ACS 4.17.2
> > >
> > > Hello,
> > > I am trying to create a Kubernetes cluster for learning purposes. I
> > > followed the steps available on
> > >
> >
> https://docs.cloudstack.apache.org/en/latest/plugins/cloudstack-kubernetes-service.html
> > > but on deployment, I get "Failed to start deploy-kube-system.service"
> > error
> > > on one of the VM. I tried this with multiple images (1.21.3, 1.23.3,
> > > 1.24.0) but the same error occurs.
> > > Please guide me on how to solve this problem.
> > >
> > > [image.png]
> > >
> > > --
> > > Thanks
> > > Pratik Chandrakar
> > >
> > >
> > >
> > >
> >
> > --
> > *Regards,*
> > *Pratik Chandrakar*
> >
> >
> >
> >
>
> --
> *Regards,*
> *Pratik Chandrakar*
>

 

Re: Failed to create Kubernetes Cluster on ACS 4.17.2

[Kiran Chavala]

Thanks Pratik

Could you please let me know the hypervisor you have used

I will do a quick test and let you know,

Regards
Kiran

From: Pratik Chandrakar 
Sent: 02 February 2023 15:43
To: users@cloudstack.apache.org 
Subject: Re: Failed to create Kubernetes Cluster on ACS 4.17.2

Hi Kiran,
Desired information is as follows,
  1.  Cloudstack version you are using
*ACS 4.17.2*

  2.   Kubernetes version iso you had used (
http://packages.shapeblue.com/cks/)
*setup-1.23.3.iso* and *setup-1.21.3.iso*

  3.  Which network you used to deploy the kubernetes ( isolated or shared
) ?
*   isolated*

  4.   Are you able to ssh to the master node and worker node from the
management server
*No*. But VMs are pinging from the router.

On Thu, Feb 2, 2023 at 3:03 PM Kiran Chavala 
wrote:

> Hi Pratik
>
> Could you please let me know the details of the environment
>
>
>   1.  Cloudstack version you are using
>
>   2.   Kubernetes version iso you had used
> http://packages.shapeblue.com/cks/
>
> <http://packages.shapeblue.com/cks/3.>
>   3.  Which network you used to deploy the kubernetes ( isolated or shared
> ) ?
>
>   4.   Are you able to ssh to the master node and worker node from the
> management server
>
> ssh -i /var/cloudstack/management/.ssh/id_rsa -p  root@
> ssh -i /var/cloudstack/management/.ssh/id_rsa -p 2223 root@
>
> If you are able to ssh then could you check if the containers are started
> on the host or check the kubelet service
>
> systemctl status kubelet
>
>
>
> Regards
> Kiran
>
> <http://packages.shapeblue.com/cks/3.>
>
>
> <http://packages.shapeblue.com/cks/3.>
>
>
> <http://packages.shapeblue.com/cks/>
>
>
> 
> From: Pratik Chandrakar 
> Sent: 02 February 2023 14:23
> To: users@cloudstack.apache.org 
> Subject: Re: Failed to create Kubernetes Cluster on ACS 4.17.2
>
> Hi Kiran,
> Compute Offering - 4P-8G Ram
> Network Offering - DefaultNetworkOfferingforKubernetesService in Advanced
> Zone
>
> No exception/error was generated on the management server. but on VM
> "*Failed
> to start deploy-kube-system.service*" & "*Failed to Start Execute cloud
> user/final scripts*". And the UI shows *Create Kubernetes cluster
> KubeCluster1.23.3 in progress* even after the error on VM.
>
>
>
> On Thu, Feb 2, 2023 at 1:46 PM Kiran Chavala 
> wrote:
>
> > Hi Pratik
> >
> > Could you please send the management server log ( exception)
> >
> > What is compute offering you have used for deploying the k8s cluster, can
> > you make sure you use at least 2 gb ram and 2 cores offering
> >
> > Regards
> > Kiran
> > 
> > From: Pratik Chandrakar 
> > Sent: 02 February 2023 13:28
> > To: users@cloudstack.apache.org 
> > Subject: Failed to create Kubernetes Cluster on ACS 4.17.2
> >
> > Hello,
> > I am trying to create a Kubernetes cluster for learning purposes. I
> > followed the steps available on
> >
> https://docs.cloudstack.apache.org/en/latest/plugins/cloudstack-kubernetes-service.html
> > but on deployment, I get "Failed to start deploy-kube-system.service"
> error
> > on one of the VM. I tried this with multiple images (1.21.3, 1.23.3,
> > 1.24.0) but the same error occurs.
> > Please guide me on how to solve this problem.
> >
> > [image.png]
> >
> > --
> > Thanks
> > Pratik Chandrakar
> >
> >
> >
> >
>
> --
> *Regards,*
> *Pratik Chandrakar*
>
>
>
>

--
*Regards,*
*Pratik Chandrakar*

 

Re: understand Cloudstack Database performance

[Kiran Chavala]

Hi Jordan

Rookie query regarding mysql performance

Will increase or decreasing the value of "max_connections" in mysql.cnf help in 
the cloudstack database performance?

[mysqld]

innodb_rollback_on_timeout=1
innodb_lock_wait_timeout=600
max_connections=350
log-bin=mysql-bin
binlog-format = 'ROW'
server-id=source-01
innodb_rollback_on_timeout=1
innodb_lock_wait_timeout=600
max_connections=350
log-bin=mysql-bin
binlog-format = 'ROW'

Regards
Kiran


From: jordan j 
Sent: 02 February 2023 13:24
To: users@cloudstack.apache.org 
Subject: Re: understand Cloudstack Database performance

During some analysis I noticed that Cloudstack does not send more than 2000
queries to the database.
Is there a way to increase that value?

With the current setup creating a /16 network takes about 70 seconds.
I found a variable on the CS global settings called
details.batch.query.size which is 2000 and increased it to 5000.

However after CS reboot the amount of queries going to the database still
did not pass more than 2000.

Does anyone know where the value of the database query limit is?

Regards,
Jordan


 

On Tue, Jan 31, 2023 at 2:58 AM jordan j  wrote:

> Hello everyone!
>
> ACS 4.17.2 with a separate database. ACS currently has no vm instances.
>
> While creating some /16 user networks we noticed some timeouts on the API.
> After some tests - the smaller the new network the less the issues.
>
> Checking the database - there were 600 slow queries on average.
> The db server is separate - 8gb of ram and 6gb given for
> innodb_buffer_pool_size.
> Buffing the vm RAM to 64 gb did not help.
>
> What did help was increasing join_buffer_size to 64MB.
>
> Optimization tips in the docs do not give much info: page
> https://docs.cloudstack.apache.org/en/latest/adminguide/tuning.html
>
> Is there an optimization guide that has to be done for CS to perform
> normally?
> Are there any rules that need to be followed while scaling the
> infrastructure?
>
> Regards,
> Jordan
>

Re: Failed to create Kubernetes Cluster on ACS 4.17.2

[Kiran Chavala]

Hi Pratik

Could you please let me know the details of the environment


  1.  Cloudstack version you are using

  2.   Kubernetes version iso you had used
http://packages.shapeblue.com/cks/

<http://packages.shapeblue.com/cks/3.>
  3.  Which network you used to deploy the kubernetes ( isolated or shared ) ?

  4.   Are you able to ssh to the master node and worker node from the 
management server

ssh -i /var/cloudstack/management/.ssh/id_rsa -p  root@
ssh -i /var/cloudstack/management/.ssh/id_rsa -p 2223 root@

If you are able to ssh then could you check if the containers are started on 
the host or check the kubelet service

systemctl status kubelet



Regards
Kiran

<http://packages.shapeblue.com/cks/3.>


<http://packages.shapeblue.com/cks/3.>


<http://packages.shapeblue.com/cks/>



From: Pratik Chandrakar 
Sent: 02 February 2023 14:23
To: users@cloudstack.apache.org 
Subject: Re: Failed to create Kubernetes Cluster on ACS 4.17.2

Hi Kiran,
Compute Offering - 4P-8G Ram
Network Offering - DefaultNetworkOfferingforKubernetesService in Advanced
Zone

No exception/error was generated on the management server. but on VM "*Failed
to start deploy-kube-system.service*" & "*Failed to Start Execute cloud
user/final scripts*". And the UI shows *Create Kubernetes cluster
KubeCluster1.23.3 in progress* even after the error on VM.



On Thu, Feb 2, 2023 at 1:46 PM Kiran Chavala 
wrote:

> Hi Pratik
>
> Could you please send the management server log ( exception)
>
> What is compute offering you have used for deploying the k8s cluster, can
> you make sure you use at least 2 gb ram and 2 cores offering
>
> Regards
> Kiran
> 
> From: Pratik Chandrakar 
> Sent: 02 February 2023 13:28
> To: users@cloudstack.apache.org 
> Subject: Failed to create Kubernetes Cluster on ACS 4.17.2
>
> Hello,
> I am trying to create a Kubernetes cluster for learning purposes. I
> followed the steps available on
> https://docs.cloudstack.apache.org/en/latest/plugins/cloudstack-kubernetes-service.html
> but on deployment, I get "Failed to start deploy-kube-system.service" error
> on one of the VM. I tried this with multiple images (1.21.3, 1.23.3,
> 1.24.0) but the same error occurs.
> Please guide me on how to solve this problem.
>
> [image.png]
>
> --
> Thanks
> Pratik Chandrakar
>
>
>
>

--
*Regards,*
*Pratik Chandrakar*

 

Re: Failed to create Kubernetes Cluster on ACS 4.17.2

[Kiran Chavala]

Hi Pratik

Could you please send the management server log ( exception)

What is compute offering you have used for deploying the k8s cluster, can you 
make sure you use at least 2 gb ram and 2 cores offering

Regards
Kiran

From: Pratik Chandrakar 
Sent: 02 February 2023 13:28
To: users@cloudstack.apache.org 
Subject: Failed to create Kubernetes Cluster on ACS 4.17.2

Hello,
I am trying to create a Kubernetes cluster for learning purposes. I followed 
the steps available on 
https://docs.cloudstack.apache.org/en/latest/plugins/cloudstack-kubernetes-service.html
 but on deployment, I get "Failed to start deploy-kube-system.service" error on 
one of the VM. I tried this with multiple images (1.21.3, 1.23.3, 1.24.0) but 
the same error occurs.
Please guide me on how to solve this problem.

[image.png]

--
Thanks
Pratik Chandrakar

 

Re: Instance used IP address given to virtual router

[Kiran Chavala]

Hi Stuart

Could you please try out the following options

  1.
Try to restart the network with the clean-up option - this should make the 
virtual router get a new ip address.

  2.   Create a new guest network and assign the new network to the virtual 
machine and delete the old associated to

  3.   The last option is to update the database tables  (nics, 
user_ip_address), with the correct ip address and stop/start the vm

select * from nics where instance_id=<>;
select * from user_ip_address where state="Allocated"
select * from user_ip_address where state="Free"

Please find the screenshots attached


Regards
Kiran


From: Stuart Whitman 
Sent: 02 February 2023 01:07
To: users@cloudstack.apache.org 
Subject: Instance used IP address given to virtual router

Hello,

I needed to update the gateway used by a basic networking zone. I disabled the 
zone and deleted all instances, system vms, and the virtual router, but I got a 
message about an IP address in use whenever I tried to update the gateway. I 
discovered that the IP in question was the one the virtual router had. There 
appeared to be no way to resolve this using the web interface or API, so I set 
the state of the IP address to Free in the MySQL database. After doing so, I 
was able to fix the gateway.

The IP address was given to the virtual router when I enabled the zone, but it 
was also given to an instance I created. Is there a way to repair the damage I 
did by manually fiddling with the MySQL database?

Thanks,
-Stu
_
The information contained in this e-mail and any attachments from Group W may 
contain confidential and/or proprietary information and is intended only for 
the named recipient to whom it was originally addressed. If you are not the 
intended recipient, be aware that any disclosure, distribution, or copying of 
this e-mail or its attachments is strictly prohibited. If you have received 
this e-mail in error, please notify the sender immediately of that fact by 
return e-mail and permanently delete the e-mail and any attachments to it.

 

Introduction

[Kiran Chavala]

Hi all,


This is Kiran, Just wanted to say hi to everyone in the community.

I've recently Shape blue as QA test engineer.

Previously I used to work with Citrix/Persistent for about 10 years in 
providing technical support to Cloudstack ( Citrix CloudPlatform and Rovius 
CloudPlatform) products

Looking forward to working with the community

Regards,
Kiran

kiran.chav...@shapeblue.com