Dean where on XS did you find the .iso -----Original Message----- From: Dean Kamali <dean.kam...@gmail.com> Reply-to: users@cloudstack.apache.org To: users@cloudstack.apache.org <users@cloudstack.apache.org> Subject: Re: SSVM Problem - ERROR: Java process not running. Try restarting the SSVM. Date: Fri, 1 Aug 2014 15:03:34 -0400
Hey everyone, I managed to fix it, I went over the troubleshooting guide once more, and I found that #9 talked about similar error I was seeing, I had to delete existing systemvm***.iso on each of my hosts and then then remove the host from cloudstack and add it again, this will copy systemvm***.iso to from management server back to the host. I have also deleted public keys used to access SSVMs, these keys were also copied from management station to each of my hosts. Thanks everyone for your assistance, really appreciate it. On Fri, Aug 1, 2014 at 2:39 PM, Pierre-Luc Dion <pd...@cloudops.com> wrote: > Did you try to destroy the SSVM ? > it will get automatically recreated, > > also, can you connect on the management server on port 8250 from the SSVM ? > telnet <cloudstack mgt-server ip> 8250 > > > *Pierre-Luc DION* > Architecte de Solution Cloud | Cloud Solutions Architect > t 855.652.5683 > > *CloudOps* Votre partenaire infonuagique* | *Cloud Solutions Experts > 420 rue Guy *|* Montreal *|* Quebec *|* H3J 1S6 > w cloudops.com *|* tw @CloudOps_ > > > > On Fri, Aug 1, 2014 at 1:45 PM, Dean Kamali <dean.kam...@gmail.com> wrote: > > > # *cat /etc/cloudstack-release * > > Cloudstack Release 4.4.0 Wed Jul 30 15:11:52 UTC 2014 > > > > *# mount | column -t ( I don't see secondary storage mounted) * > > > > sysfs on /sys > > type sysfs (rw,nosuid,nodev,noexec,relatime) > > proc on /proc > > type proc (rw,nosuid,nodev,noexec,relatime) > > udev on /dev > > type devtmpfs > > (rw,relatime,size=10240k,nr_inodes=59458,mode=755) > > devpts on /dev/pts > > type devpts > > (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000) > > tmpfs on /run > > type tmpfs > > (rw,nosuid,noexec,relatime,size=50772k,mode=755) > > /dev/disk/by-uuid/835a9847-1d96-418e-90a9-e3653f522510 on / > > type ext4 > > (rw,relatime,errors=remount-ro,user_xattr,barrier=1,data=ordered) > > tmpfs on /run/lock > > type tmpfs (rw,nosuid,nodev,noexec,relatime,size=5120k) > > tmpfs on /run/shm > > type tmpfs > (rw,nosuid,nodev,noexec,relatime,size=217660k) > > /dev/xvda1 on /boot > > type ext4 > (rw,relatime,user_xattr,barrier=1,data=ordered) > > /dev/xvda6 on /home > > type ext4 > (rw,relatime,user_xattr,barrier=1,data=ordered) > > /dev/xvda8 on /opt > > type ext4 > (rw,relatime,user_xattr,barrier=1,data=ordered) > > /dev/xvda10 on /tmp > > type ext4 > (rw,relatime,user_xattr,barrier=1,data=ordered) > > /dev/xvda7 on /usr > > type ext4 > (rw,relatime,user_xattr,barrier=1,data=ordered) > > /dev/xvda9 on /var > > type ext4 > (rw,relatime,user_xattr,barrier=1,data=ordered) > > none on /proc/xen > > type xenfs (rw,relatime) > > rpc_pipefs on > > /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime) > > > > > > *# tail /var/log/cloud.log * > > > > 2014-08-01 17:42:22,406 ERROR [cloud.agent.AgentShell] (main:null) Unable > > to start agent: Resource class not found: > > com.cloud.storage.resource.PremiumSecondaryStorageResource due to: > > java.lang.ClassNotFoundException: > > com.cloud.storage.resource.PremiumSecondaryStorageResource > > > > > > weird eh? > > > > > > > > On Fri, Aug 1, 2014 at 12:50 PM, Pierre-Luc Dion <pd...@cloudops.com> > > wrote: > > > > > and "df" , the SSVM should have the secondary NFS share mounted, if it > > > doesn't try to mount it manually in /mnt as test. > > > > > > > > > > > > *Pierre-Luc DION* > > > Architecte de Solution Cloud | Cloud Solutions Architect > > > t 855.652.5683 > > > > > > *CloudOps* Votre partenaire infonuagique* | *Cloud Solutions Experts > > > 420 rue Guy *|* Montreal *|* Quebec *|* H3J 1S6 > > > w cloudops.com *|* tw @CloudOps_ > > > > > > > > > > > > On Fri, Aug 1, 2014 at 12:48 PM, Erik Weber <terbol...@gmail.com> > wrote: > > > > > > > Could you log on to the SSVM and paste the contents of > > > > /etc/cloudstack-release? > > > > > > > > > > > > Erik > > > > > > > > > > > > On Fri, Aug 1, 2014 at 6:04 PM, Dean Kamali <dean.kam...@gmail.com> > > > wrote: > > > > > > > > > Same error after redeployment > > > > > > > > > > # rpm -qa |grep cloudstack > > > > > cloudstack-awsapi-4.4.0-NONOSS_3.el6.x86_64 > > > > > cloudstack-management-4.4.0-NONOSS_3.el6.x86_64 > > > > > cloudstack-common-4.4.0-NONOSS_3.el6.x86_64 > > > > > cloudstack-usage-4.4.0-NONOSS_3.el6.x86_64 > > > > > > > > > > # cat Cloudstack.repo > > > > > [apache-cloudstack] > > > > > name=Apache CloudStack > > > > > baseurl=http://cloudstack.apt-get.eu/rhel/4.4/ > > > > > enabled=1 > > > > > gpgcheck=0 > > > > > > > > > > Are these the ones you are using? > > > > > > > > > > Dean > > > > > > > > > > > > > > > On Fri, Aug 1, 2014 at 11:58 AM, Erik Weber <terbol...@gmail.com> > > > wrote: > > > > > > > > > > > That's weird. > > > > > > > > > > > > Could you try to destroy the ssvm and see if it happens after > > > redeploy? > > > > > > > > > > > > Also, could you get the output of: > > > > > > rpm -qa | grep cloudstack > > > > > > > > > > > > on your mgmt server? > > > > > > > > > > > > Erik > > > > > > > > > > > > > > > > > > On Fri, Aug 1, 2014 at 5:09 PM, Dean Kamali < > dean.kam...@gmail.com > > > > > > > > wrote: > > > > > > > > > > > > > I have used the ones in http://cloudstack.apt-get.eu/rhel/4.4/ > > are > > > > > these > > > > > > > the right ones? > > > > > > > > > > > > > > I'm only using xenserver with NFS link, no VMware or netapp in > > > this > > > > > > setup. > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On Fri, Aug 1, 2014 at 10:59 AM, Erik Weber < > terbol...@gmail.com > > > > > > > > wrote: > > > > > > > > > > > > > > > It means you have a cloudstack-agent built with non-oss. > > > > > > > > > > > > > > > > > > > > > > > > Is this installed with rpms from apt-get.eu or somewhere > else? > > > > > > > > > > > > > > > > Erik > > > > > > > > > > > > > > > > > > > > > > > > On Fri, Aug 1, 2014 at 4:51 PM, Dean Kamali < > > > dean.kam...@gmail.com > > > > > > > > > > > > wrote: > > > > > > > > > > > > > > > > > Hey Erik, thanks for the link, however I'm getting the > > > following > > > > > when > > > > > > > > > checking /var/log/cloud.log on SSVM > > > > > > > > > > > > > > > > > > ERROR [cloud.agent.AgentShell] (main:null) Unable to start > > > agent: > > > > > > > > Resource > > > > > > > > > class not found: > > > > > > > > com.cloud.storage.resource.PremiumSecondaryStorageResource > > > > > > > > > due to: java.lang.ClassNotFoundException: > > > > > > > > > com.cloud.storage.resource.PremiumSecondaryStorageResource > > > > > > > > > > > > > > > > > > Dean > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On Fri, Aug 1, 2014 at 9:55 AM, Erik Weber < > > > terbol...@gmail.com> > > > > > > > wrote: > > > > > > > > > > > > > > > > > > > Have you done the usual ssvm troubleshooting? > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > https://cwiki.apache.org/confluence/display/CLOUDSTACK/SSVM,+templates,+Secondary+storage+troubleshooting > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > Erik > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On Fri, Aug 1, 2014 at 3:48 PM, Dean Kamali < > > > > > dean.kam...@gmail.com > > > > > > > > > > > > > > > > wrote: > > > > > > > > > > > > > > > > > > > > > Hey everyone, > > > > > > > > > > > > > > > > > > > > > > I have installed SSVM template > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > http://cloudstack.apt-get.eu/systemvm/4.4/systemvm64template-4.4.0-6-xen.vhd.bz2 > > > > > > > > > > > on another fresh install ( downloaded fresh packages > and > > > > using > > > > > > > clean > > > > > > > > > > > database). > > > > > > > > > > > > > > > > > > > > > > SSVM boot fine, after connecting to secondary storage > VM. > > > > > > > > > > > > > > > > > > > > > > root@s-2-VM:~# /usr/bin/java -version > > > > > > > > > > > java version "1.7.0_65" > > > > > > > > > > > OpenJDK Runtime Environment (IcedTea 2.5.1) > > > > > (7u65-2.5.1-2~deb7u1) > > > > > > > > > > > OpenJDK 64-Bit Server VM (build 24.65-b04, mixed mode) > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > root@s-2-VM:~# cat /etc/cloudstack-release > > > > > > > > > > > Cloudstack Release 4.4.0 Wed Jul 30 15:11:52 UTC 2014 > > > > > > > > > > > > > > > > > > > > > > Yet, the vm doesn't mount secondary storage , I'm > going > > to > > > > try > > > > > > > 4.3.0 > > > > > > > > > > > template, this is getting frustrating. > > > > > > > > > > > > > > > > > > > > > > Any other ideas? > > > > > > > > > > > > > > > > > > > > > > Thank you > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On Thu, Jul 31, 2014 at 2:26 PM, Daan Hoogland < > > > > > > > > > daan.hoogl...@gmail.com> > > > > > > > > > > > wrote: > > > > > > > > > > > > > > > > > > > > > > > Matthew, that is a bug in that distribution of the > > > systemvm > > > > > > > > templates > > > > > > > > > > > > Where did you get them? > > > > > > > > > > > > the ones at cloudstack.apt-get.eu with the name > > 4.4.0-6 > > > > are > > > > > > the > > > > > > > > ones > > > > > > > > > > > > you should use. > > > > > > > > > > > > > > > > > > > > > > > > @rayees: can you update the ones at > download.cloud.com > > , > > > > > > please? > > > > > > > > > > > > > > > > > > > > > > > > regards, > > > > > > > > > > > > Daan > > > > > > > > > > > > > > > > > > > > > > > > On Thu, Jul 31, 2014 at 8:08 PM, Matthew Midgett > > > > > > > > > > > > <cst...@trickhosting.biz> wrote: > > > > > > > > > > > > > Pierre-Luc DION > > > > > > > > > > > > > > > > > > > > > > > > > > root@s-48-VM:~# cat /etc/cloudstack-release > > > > > > > > > > > > > Cloudstack Release 3 Wed Jul 23 14:18:46 UTC 2014 > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > -----Original Message----- > > > > > > > > > > > > > From: Pierre-Luc Dion <pd...@cloudops.com> > > > > > > > > > > > > > Reply-to: users@cloudstack.apache.org > > > > > > > > > > > > > To: users@cloudstack.apache.org < > > > > > users@cloudstack.apache.org > > > > > > > > > > > > > > > > > > > > Subject: Re: SSVM Problem - ERROR: Java process not > > > > > running. > > > > > > > Try > > > > > > > > > > > > > restarting the SSVM. > > > > > > > > > > > > > Date: Thu, 31 Jul 2014 13:17:53 -0400 > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > Dean, > > > > > > > > > > > > > Could you post the content of > /etc/cloudstack-version > > > > > from a > > > > > > > > > running > > > > > > > > > > > > > systemvm ? > > > > > > > > > > > > > > > > > > > > > > > > > > Thanks, > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > *Pierre-Luc DION* > > > > > > > > > > > > > Architecte de Solution Cloud | Cloud Solutions > > > Architect > > > > > > > > > > > > > t 855.652.5683 > > > > > > > > > > > > > > > > > > > > > > > > > > *CloudOps* Votre partenaire infonuagique* | *Cloud > > > > > Solutions > > > > > > > > > Experts > > > > > > > > > > > > > 420 rue Guy *|* Montreal *|* Quebec *|* H3J 1S6 > > > > > > > > > > > > > w cloudops.com *|* tw @CloudOps_ > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On Thu, Jul 31, 2014 at 1:09 PM, Dean Kamali < > > > > > > > > > dean.kam...@gmail.com> > > > > > > > > > > > > wrote: > > > > > > > > > > > > > > > > > > > > > > > > > >> Matthew, > > > > > > > > > > > > >> > > > > > > > > > > > > >> Thanks for your feedback, I would like to double > > check > > > > the > > > > > > > > version > > > > > > > > > > of > > > > > > > > > > > > SSVM > > > > > > > > > > > > >> template name you are currently using, could you > > > please > > > > > > share > > > > > > > > > info? > > > > > > > > > > > > >> > > > > > > > > > > > > >> Another question, I'm gussing that > > > > 0b1ff1bc054860378f08347 > > > > > > is > > > > > > > > the > > > > > > > > > > UUID > > > > > > > > > > > > of > > > > > > > > > > > > >> your secondary storage, is that correct? > > > > > > > > > > > > >> > > > > > > > > > > > > >> Thanks > > > > > > > > > > > > >> > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > -- > > > > > > > > > > > > Daan > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > >
