are you using local storage ? shared storage? It seems there is no enough space on the storage:
1. 2013-09-24 04:10:16,295 INFO [cloud.vm.VirtualMachineManagerImpl] (consoleproxy-1:null) Unable to contact resource. 2. com.cloud.exception.StorageUnavailableException: Resource [StoragePool:214] is unreachable: Unable to create Vol[2174|vm=1982|ROOT]:com.cloud.utils.exception.CloudRuntimeException: org.libvirt.LibvirtException: internal error Child process (/bin/umount /mnt/99a4fb82-780d-35c2-afb0-7f16388eeb94) unexpected exit status 32: error writing /etc/mtab.tmp: No space left on device 3. /mnt/99a4fb82-780d-35c2-afb0-7f16388eeb94 was not found in /proc/mounts 2013/9/23 Indra Pramana <in...@sg.or.id> > Hi Chiradeep, > > I have uploaded the logs in pastebin here: > > http://pastebin.com/jy49jF4A > > Looking forward to your reply, thank you. > > Cheers. > > > > On Tue, Sep 24, 2013 at 3:59 AM, Chiradeep Vittal < > chiradeep.vit...@citrix.com> wrote: > > > Logs? > > > > On 9/23/13 12:46 PM, "Indra Pramana" <in...@sg.or.id> wrote: > > > > >Dear all, > > > > > >The script failed to restart the system VMs. See below. > > > > > >All my system VMs (except one virtual router) are in "Starting" state > but > > >it never got started. Any idea how to resolve this issue? > > > > > >=== > > >nohup: ignoring input > > >/usr/bin/cloudstack-sysvmadm: line 21: /etc/rc.d/init.d/functions: No > such > > >file or directory > > > > > >Stopping and starting 1 secondary storage vm(s)... > > >Done stopping and starting secondary storage vm(s) > > > > > >Stopping and starting 1 console proxy vm(s)... > > >ERROR: Failed to start console proxy vm with id 1903 > > > > > >Done stopping and starting console proxy vm(s) . > > > > > >Stopping and starting 2 running routing vm(s)... > > >ERROR: Failed to restart domainRouter with id 1931 > > > > > >ERROR: Failed to restart domainRouter with id 1930 > > > > > >Done restarting router(s). > > >=== > > > > > >Looking forward to your reply, thank you. > > > > > >Cheers. > > > > > > > > > > > >On Tue, Sep 24, 2013 at 2:54 AM, Indra Pramana <in...@sg.or.id> wrote: > > > > > >> Is it normal for the cloudstack-sysvmadm script to take very long to > > >>run? > > >> It has been more than 30 minutes and it's still restarting the second > > >> system VM. > > >> > > >> === > > >> root@cs-mgmt-01:~/cloudstack3# tail -f sysvm.log > > >> nohup: ignoring input > > >> /usr/bin/cloudstack-sysvmadm: line 21: /etc/rc.d/init.d/functions: No > > >>such > > >> file > > >> > > >> Stopping and starting 1 secondary storage vm(s)... > > >> Done stopping and starting secondary storage vm(s) > > >> > > >> Stopping and starting 1 console proxy vm(s)... > > >> === > > >> > > >> If it's normal, any reason why? I presume restarting a VM shouldn't > take > > >> that long in normal circumstances? > > >> > > >> Any insight is appreciated. :) > > >> > > >> Thank you. > > >> > > > > > -- Rafael Weingartner