Hi Ammad, Is the understanding right that the steps as mentioned by you in the previous mail has in-fact worked on one zone? If that's the case, could you please ensure that all the hosts in all the other zones have the new systemVM iso copied into them by checking the timestamps as well and comparing the checksums against the iso on the management server, so that when the system VM's are recreated, they pick up the new iso.
Thanks, Pearl ________________________________ From: Ammad Syed <syedamma...@gmail.com> Sent: Sunday, September 13, 2020 12:49 PM To: users@cloudstack.apache.org <users@cloudstack.apache.org> Subject: Re: Cloudstack 4.11.3 to 4.13.1 SystemVMs Error Hi Andrija, Here is the permission of mount point in SSVM. root@s-25437-VM:~# df -h Filesystem Size Used Avail Use% Mounted on udev 233M 0 233M 0% /dev tmpfs 98M 19M 80M 19% /run /dev/xvda5 1.1G 773M 282M 74% / tmpfs 244M 0 244M 0% /dev/shm tmpfs 5.0M 0 5.0M 0% /run/lock tmpfs 244M 0 244M 0% /sys/fs/cgroup /dev/xvda1 92M 35M 57M 39% /boot /dev/xvda6 435M 21M 410M 5% /var /dev/xvda7 75M 1.6M 72M 3% /tmp 172.16.10.35:/nfs/KHI02 12T 7.0T 5.1T 59% /mnt/SecStorage/8ea71ccb-e493-3c7e-8bb0-97871f5c2092 tmpfs 49M 0 49M 0% /run/user/0 root@s-25437-VM:~# root@s-25437-VM:~# root@s-25437-VM:~# cd /mnt/SecStorage/8ea71ccb-e493-3c7e-8bb0-97871f5c2092 root@s-25437-VM:/mnt/SecStorage/8ea71ccb-e493-3c7e-8bb0-97871f5c2092# root@s-25437-VM:/mnt/SecStorage/8ea71ccb-e493-3c7e-8bb0-97871f5c2092# ls -lah total 12K drwxrwxrwx 5 root root 70 Dec 21 2018 . drwxrwxrwx 3 root root 4.0K Sep 10 23:12 .. drwxrwxrwx 52 root root 4.0K Aug 13 19:37 snapshots drwxrwxrwx 3 root root 26 Jun 7 2013 template drwxrwxrwx 98 root root 4.0K Sep 1 12:52 volumes -Ammad Ali On Fri, Sep 11, 2020 at 6:09 PM Andrija Panic <andrija.pa...@gmail.com> wrote: > Can you share permissions of your secondary storage (mount it then ls -lah > the mount point) > pearl.dsi...@shapeblue.com www.shapeblue.com 3 London Bridge Street, 3rd floor, News Building, London SE1 9SGUK @shapeblue > On Fri, 11 Sep 2020 at 01:39, Ammad Syed <syedamma...@gmail.com> wrote: > > > Hi Andrija, > > > > I have performed an upgrade on my production system from 4.11.3 to > 4.13.1. > > Even I cleared the tags but the issue is still there. > > > > I have four zones and only in one zone and on specific host, the > > systemVM's agent goes up but on all other zones, key injection to > systemVM > > is still failing on all zones and PODs. I have checked, the updated ISO > is > > there on all hosts. The md5sum of systemvm.iso is same on xen hosts and > acs > > host. > > > > Look like a weird problem. How can I troubleshoot this further ? Any > advise > > would be appreciated. > > > > -Ammad > > > > > -- > > Andrija Panić > -- Regards, Syed Ammad Ali