GitHub user ahmadamirahmadi1401 added a comment to the discussion: Upgrading K8s Cluster Failed
@weizhouapache These have been repeated over and over again. 2025-06-03 07:42:57,510 ERROR [c.c.u.s.SshHelper] (API-Job-Executor-116:ctx-c60f694f job-32763 ctx-b2ed3f15) (logid:ae643eb7) SSH execution of command sudo ./upgrade-kubernetes.sh14647125368844262123.sh 1.32.4 true false false has an error status code in return. Result output: Installing binaries from /mnt/k8sdisk/ unpacking quay.io/apalia/cloudstack-csi-driver:0.0.2 (sha256:6f38051b27964da06af1cbcf1c759b4eb5266bdd02033f07c3d2e04630e2893f)...done unpacking ghcr.io/leaseweb/cloudstack-csi-driver:0.8.1 (sha256:7a6cf3ba95be182ee8c991dced373f56faacbfac9a719056586d98af3aa932c5)...done unpacking docker.io/apache/cloudstack-kubernetes-autoscaler:latest (sha256:1c8a22c342daa5884f622f078be70ff913599aada0c4f859fe42ed28413afe98)...done unpacking docker.io/apache/cloudstack-kubernetes-provider:v1.1.0 (sha256:10c058968e7d2f8e55da5976336a42d88b057e75880f000d3120aa2d75649e97)...done unpacking registry.k8s.io/coredns/coredns:v1.11.3 (sha256:9caabbf6238b189a65d0d6e6ac138de60d6a1c419e5a341fbbb7c78382559c6e)...done unpacking k8s.gcr.io/sig-storage/csi-attacher:v3.0.2 (sha256:6f80b12657a7e0a5c683b24e806c4bbbe33a43e39b041fe9b7514d665d478ea4)...done unpacking registry.k8s.io/sig-storage/csi-attacher:v4.6.1 (sha256:b4d611100ece2f9bc980d1cb19c2285b8868da261e3b1ee8f45448ab5512ab94)...done unpacking k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.0.1 (sha256:e07f914c32f0505e4c470a62a40ee43f84cbf8dc46ff861f31b14457ccbad108)...done unpacking registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.10.1 (sha256:f25af73ee708ff9c82595ae99493cdef9295bd96953366cddf36305f82555dac)...done unpacking k8s.gcr.io/sig-storage/csi-provisioner:v2.0.4 (sha256:bec571992d40203edcd056ac0b0d97003887ee5e4be144c41932d18639673b03)...done unpacking registry.k8s.io/sig-storage/csi-provisioner:v5.0.1 (sha256:405a14e1aa702f7ea133cea459e8395fe40a6125c088c55569e696d48e1bd385)...done unpacking registry.k8s.io/sig-storage/csi-resizer:v1.11.1 (sha256:a541e6cc2d8b011bb21b1d4ffec6b090e85270cce6276ee302d86153eec0af43)...done unpacking docker.io/kubernetesui/dashboard:v2.7.0 (sha256:2e500d29e9d5f4a086b908eb8dfe7ecac57d2ab09d65b24f588b1d449841ef93)...done unpacking registry.k8s.io/etcd:3.5.16-0 (sha256:c6a9d11cc5c04b114ccdef39a9265eeef818e3d02f5359be035ae784097fdec5)...done unpacking registry.k8s.io/kube-apiserver:v1.32.4 (sha256:631c6cc78b2862be4fed7df3384a643ef7297eebadae22e8ef9cbe2e19b6386f)...done unpacking registry.k8s.io/kube-controller-manager:v1.32.4 (sha256:25e29187ea66f0ff9b9a00114849c3a30b649005c900a8b2a69e3f3fa56448fb)...done unpacking registry.k8s.io/kube-proxy:v1.32.4 (sha256:152638222ecf265eb8e5352e3c50e8fc520994e8ffcff1ee1490c975f7fc2b36)...done unpacking registry.k8s.io/kube-scheduler:v1.32.4 (sha256:09c55f8dac59a4b8e5e354140f5a4bdd6fa9bd95c42d6bcba6782ed37c31b5a2)...done unpacking registry.k8s.io/sig-storage/livenessprobe:v2.12.0 (sha256:5baeb4a6d7d517434292758928bb33efc6397368cbb48c8a4cf29496abf4e987)...done unpacking docker.io/kubernetesui/metrics-scraper:v1.0.8 (sha256:76049887f07a0476dc93efc2d3569b9529bf982b22d29f356092ce206e98765c)...done unpacking registry.k8s.io/pause:3.10 (sha256:ee6521f290b2168b6e0935a181d4cff9be1ac3f505666ef0e3c98fae8199917a)...done unpacking registry.mainco.com/weaveworks/weave-kube:latest (sha256:35827a9c549c095f0e9d1cf8b35d8f27ae2c76e31bc6f7f3c0bc95911d5accea)...done unpacking registry.mainco.com/weaveworks/weave-npc:latest (sha256:062832fd25b5e9e16650e618f26bba1409a7b3bf2c3903e1b369d788abc63aef)...done registry.k8s.io/pause:3.10 [upgrade] Reading configuration from the "kubeadm-config" ConfigMap in namespace "kube-system"... [upgrade] Use 'kubeadm init phase upload-config --config your-config.yaml' to re-upload it. [upgrade/preflight] Running preflight checks [upgrade] Running cluster health checks [upgrade] Reading configuration from the "kubeadm-config" ConfigMap in namespace "kube-system"... [upgrade] Use 'kubeadm init phase upload-config --config your-config.yaml' to re-upload it. [upgrade/preflight] Running preflight checks [upgrade] Running cluster health checks ======== 2025-06-03 07:42:57,511 ERROR [c.c.k.c.a.KubernetesClusterActionWorker] (API-Job-Executor-116:ctx-c60f694f job-32763 ctx-b2ed3f15) (logid:ae643eb7) Failed to upgrade Kubernetes cluster : 82c623a8ac92d1ffee84962c976e6800-01jwtbe6dpqkmw633gwkaagpba, unable to upgrade Kubernetes node on VM : k8s-82c623a8ac92d1ffee84962c976e6800-01j-control-19734b7e1d6, retries left: 3 ======= 2025-06-03 07:43:55,561 ERROR [c.c.u.s.SshHelper] (API-Job-Executor-116:ctx-c60f694f job-32763 ctx-b2ed3f15) (logid:ae643eb7) SSH execution of command sudo ./upgrade-kubernetes.sh14647125368844262123.sh 1.32.4 true false false has an error status code in return. Result output: Installing binaries from /mnt/k8sdisk/ unpacking quay.io/apalia/cloudstack-csi-driver:0.0.2 (sha256:6f38051b27964da06af1cbcf1c759b4eb5266bdd02033f07c3d2e04630e2893f)...done unpacking ghcr.io/leaseweb/cloudstack-csi-driver:0.8.1 (sha256:7a6cf3ba95be182ee8c991dced373f56faacbfac9a719056586d98af3aa932c5)...done unpacking docker.io/apache/cloudstack-kubernetes-autoscaler:latest (sha256:1c8a22c342daa5884f622f078be70ff913599aada0c4f859fe42ed28413afe98)...done unpacking docker.io/apache/cloudstack-kubernetes-provider:v1.1.0 (sha256:10c058968e7d2f8e55da5976336a42d88b057e75880f000d3120aa2d75649e97)...done ===== 2025-06-03 07:43:56,433 ERROR [c.c.u.s.SshHelper] (API-Job-Executor-116:ctx-c60f694f job-32763 ctx-b2ed3f15) (logid:ae643eb7) SSH execution of command sudo ./upgrade-kubernetes.sh14647125368844262123.sh 1.32.4 true false false has an error status code in return. Result output: Installing binaries from /mnt/k8sdisk/ mount: /mnt/k8sdisk: /dev/sr0 already mounted on /mnt/k8sdisk. cp: cannot create regular file '/opt/bin/kubeadm': Text file busy GitHub link: https://github.com/apache/cloudstack/discussions/11006#discussioncomment-13434092 ---- This is an automatically sent email for users@cloudstack.apache.org. To unsubscribe, please send an email to: users-unsubscr...@cloudstack.apache.org