RE: Problem with VMware CloudStack SSVM Agent
Yes it is Java 6 running on SSVM, is there a newer version of systemvm template I should load? It might be a second order effect, but the SSVM runs out of disk space (100%) and when I reboot it whatever is consuming disk space (maybe Java?) is cleared to 50%. -Soheil root@s-22-VM:~# java -version Java HotSpot(TM) Client VM warning: Insufficient space for shared memory file: /tmp/hsperfdata_root/29147 Try using the -Djava.io.tmpdir= option to select an alternate temp location. java version 1.6.0_26 Java(TM) SE Runtime Environment (build 1.6.0_26-b03) Java HotSpot(TM) Client VM (build 20.1-b02, mixed mode) root@s-22-VM:~# df Filesystem 1K-blocks Used Available Use% Mounted on /dev/sda1 2015820 2015820 0 100% / tmpfs 256216 0256216 0% /lib/init/rw udev25167664251612 1% /dev tmpfs 256216 0256216 0% /dev/shm From: Erik Weber [terbol...@gmail.com] Sent: Monday, April 07, 2014 11:44 PM To: dev Subject: Re: Problem with VMware CloudStack SSVM Agent Could you check wich java version it has installed? From the error message I'd interpret it as it's trying to run java7 code on java6 jre. -- Erik Weber On Tue, Apr 8, 2014 at 1:39 AM, Soheil Eizadi seiz...@infoblox.com wrote: I am trying to bring up CloudStack 4.4 on vSphere 5.1, I cannot get the Agent to run on SSVM, here is the error: =templateProcessor mtu=1500 eth2ip=10.48.15.100 eth2mask=255.255.255.0 gateway=10.48.15.1 public.network.device=eth2 eth0mask=0.0.0.0 eth0ip=0.0.0.0 eth1ip=10.48.15.49 eth1mask=255.255.255.0 mgmtcidr=10.48.15.0/24 localgw=10.48.15.1 private.network.device=eth1 eth3ip=10.48.15.33 eth3mask=255.255.255.0 storageip=10.48.15.33 storagenetmask=255.255.255.0 storagegateway=10.48.15.1 internaldns1=10.48.2.11 internaldns2= dns1=10.48.2.11 dns2= Exception in thread main java.lang.UnsupportedClassVersionError: com/cloud/agent/AgentShell : Unsupported major.minor version 51.0 at java.lang.ClassLoader.defineClass1(Native Method) at java.lang.ClassLoader.defineClassCond(ClassLoader.java:631) at java.lang.ClassLoader.defineClass(ClassLoader.java:615) at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:141) at java.net.URLClassLoader.defineClass(URLClassLoader.java:283) at java.net.URLClassLoader.access$000(URLClassLoader.java:58) at java.net.URLClassLoader$1.run(URLClassLoader.java:197) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:190) at java.lang.ClassLoader.loadClass(ClassLoader.java:306) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) at java.lang.ClassLoader.loadClass(ClassLoader.java:247) Could not find the main class: com.cloud.agent.AgentShell. Program will exit. Here is the SSVM diags: root@s-22-VM:/var/log/cloud# /usr/local/cloud/systemvm/ssvm-check.sh First DNS server is 10.48.2.11 PING 10.48.2.11 (10.48.2.11): 56 data bytes 64 bytes from 10.48.2.11: icmp_seq=0 ttl=63 time=1.423 ms 64 bytes from 10.48.2.11: icmp_seq=1 ttl=63 time=0.338 ms --- 10.48.2.11 ping statistics --- 2 packets transmitted, 2 packets received, 0% packet loss round-trip min/avg/max/stddev = 0.338/0.881/1.423/0.543 ms Good: Can ping DNS server Good: DNS resolves download.cloud.com ERROR: NFS is not currently mounted Try manually mounting from inside the VM NFS server is eth2 ping: unknown host WARNING: cannot ping nfs server routing table follows Kernel IP routing table Destination Gateway Genmask Flags Metric RefUse Iface 10.48.15.0 0.0.0.0 255.255.255.0 U 0 00 eth1 10.48.15.0 0.0.0.0 255.255.255.0 U 0 00 eth2 10.48.15.0 0.0.0.0 255.255.255.0 U 0 00 eth3 0.0.0.0 10.48.15.1 0.0.0.0 UG0 00 eth2 Management server is 10.48.15.10. Checking connectivity. Good: Can connect to management server port 8250 ERROR: Java process not running. Try restarting the SSVM.
RE: Problem with VMware CloudStack SSVM Agent
I made sure that I was using the latest systemVM Template. Still have Java problem. I seem to remember trying to run the latest Mgmt Server and it required Java 7 so I updated the Mgmt Server to Java 7. % ./client/target/generated-webapp/WEB-INF/classes/scripts/storage/secondary/cloud-install-sys-tmplt -m /mnt/sec -u http://jenkins.buildacloud.org/job/build-systemvm64-master/lastSuccessfulBuild/artifact/tools/appliance/dist/systemvm64template-master-vmware.ova -h vmware -F From: Soheil Eizadi [seiz...@infoblox.com] Sent: Tuesday, April 08, 2014 6:39 AM To: dev@cloudstack.apache.org Subject: RE: Problem with VMware CloudStack SSVM Agent Yes it is Java 6 running on SSVM, is there a newer version of systemvm template I should load? It might be a second order effect, but the SSVM runs out of disk space (100%) and when I reboot it whatever is consuming disk space (maybe Java?) is cleared to 50%. -Soheil root@s-22-VM:~# java -version Java HotSpot(TM) Client VM warning: Insufficient space for shared memory file: /tmp/hsperfdata_root/29147 Try using the -Djava.io.tmpdir= option to select an alternate temp location. java version 1.6.0_26 Java(TM) SE Runtime Environment (build 1.6.0_26-b03) Java HotSpot(TM) Client VM (build 20.1-b02, mixed mode) root@s-22-VM:~# df Filesystem 1K-blocks Used Available Use% Mounted on /dev/sda1 2015820 2015820 0 100% / tmpfs 256216 0256216 0% /lib/init/rw udev25167664251612 1% /dev tmpfs 256216 0256216 0% /dev/shm From: Erik Weber [terbol...@gmail.com] Sent: Monday, April 07, 2014 11:44 PM To: dev Subject: Re: Problem with VMware CloudStack SSVM Agent Could you check wich java version it has installed? From the error message I'd interpret it as it's trying to run java7 code on java6 jre. -- Erik Weber On Tue, Apr 8, 2014 at 1:39 AM, Soheil Eizadi seiz...@infoblox.com wrote: I am trying to bring up CloudStack 4.4 on vSphere 5.1, I cannot get the Agent to run on SSVM, here is the error: =templateProcessor mtu=1500 eth2ip=10.48.15.100 eth2mask=255.255.255.0 gateway=10.48.15.1 public.network.device=eth2 eth0mask=0.0.0.0 eth0ip=0.0.0.0 eth1ip=10.48.15.49 eth1mask=255.255.255.0 mgmtcidr=10.48.15.0/24 localgw=10.48.15.1 private.network.device=eth1 eth3ip=10.48.15.33 eth3mask=255.255.255.0 storageip=10.48.15.33 storagenetmask=255.255.255.0 storagegateway=10.48.15.1 internaldns1=10.48.2.11 internaldns2= dns1=10.48.2.11 dns2= Exception in thread main java.lang.UnsupportedClassVersionError: com/cloud/agent/AgentShell : Unsupported major.minor version 51.0 at java.lang.ClassLoader.defineClass1(Native Method) at java.lang.ClassLoader.defineClassCond(ClassLoader.java:631) at java.lang.ClassLoader.defineClass(ClassLoader.java:615) at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:141) at java.net.URLClassLoader.defineClass(URLClassLoader.java:283) at java.net.URLClassLoader.access$000(URLClassLoader.java:58) at java.net.URLClassLoader$1.run(URLClassLoader.java:197) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:190) at java.lang.ClassLoader.loadClass(ClassLoader.java:306) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) at java.lang.ClassLoader.loadClass(ClassLoader.java:247) Could not find the main class: com.cloud.agent.AgentShell. Program will exit. Here is the SSVM diags: root@s-22-VM:/var/log/cloud# /usr/local/cloud/systemvm/ssvm-check.sh First DNS server is 10.48.2.11 PING 10.48.2.11 (10.48.2.11): 56 data bytes 64 bytes from 10.48.2.11: icmp_seq=0 ttl=63 time=1.423 ms 64 bytes from 10.48.2.11: icmp_seq=1 ttl=63 time=0.338 ms --- 10.48.2.11 ping statistics --- 2 packets transmitted, 2 packets received, 0% packet loss round-trip min/avg/max/stddev = 0.338/0.881/1.423/0.543 ms Good: Can ping DNS server Good: DNS resolves download.cloud.com ERROR: NFS is not currently mounted Try manually mounting from inside the VM NFS server is eth2 ping: unknown host WARNING: cannot ping nfs server routing table follows Kernel IP routing table Destination Gateway Genmask Flags Metric RefUse Iface 10.48.15.0 0.0.0.0 255.255.255.0 U 0 00 eth1 10.48.15.0 0.0.0.0 255.255.255.0 U 0 00 eth2 10.48.15.0 0.0.0.0 255.255.255.0 U 0 00 eth3 0.0.0.0 10.48.15.1 0.0.0.0 UG0 00 eth2 Management server is 10.48.15.10. Checking
Problem with VMware CloudStack SSVM Agent
I am trying to bring up CloudStack 4.4 on vSphere 5.1, I cannot get the Agent to run on SSVM, here is the error: =templateProcessor mtu=1500 eth2ip=10.48.15.100 eth2mask=255.255.255.0 gateway=10.48.15.1 public.network.device=eth2 eth0mask=0.0.0.0 eth0ip=0.0.0.0 eth1ip=10.48.15.49 eth1mask=255.255.255.0 mgmtcidr=10.48.15.0/24 localgw=10.48.15.1 private.network.device=eth1 eth3ip=10.48.15.33 eth3mask=255.255.255.0 storageip=10.48.15.33 storagenetmask=255.255.255.0 storagegateway=10.48.15.1 internaldns1=10.48.2.11 internaldns2= dns1=10.48.2.11 dns2= Exception in thread main java.lang.UnsupportedClassVersionError: com/cloud/agent/AgentShell : Unsupported major.minor version 51.0 at java.lang.ClassLoader.defineClass1(Native Method) at java.lang.ClassLoader.defineClassCond(ClassLoader.java:631) at java.lang.ClassLoader.defineClass(ClassLoader.java:615) at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:141) at java.net.URLClassLoader.defineClass(URLClassLoader.java:283) at java.net.URLClassLoader.access$000(URLClassLoader.java:58) at java.net.URLClassLoader$1.run(URLClassLoader.java:197) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:190) at java.lang.ClassLoader.loadClass(ClassLoader.java:306) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) at java.lang.ClassLoader.loadClass(ClassLoader.java:247) Could not find the main class: com.cloud.agent.AgentShell. Program will exit. Here is the SSVM diags: root@s-22-VM:/var/log/cloud# /usr/local/cloud/systemvm/ssvm-check.sh First DNS server is 10.48.2.11 PING 10.48.2.11 (10.48.2.11): 56 data bytes 64 bytes from 10.48.2.11: icmp_seq=0 ttl=63 time=1.423 ms 64 bytes from 10.48.2.11: icmp_seq=1 ttl=63 time=0.338 ms --- 10.48.2.11 ping statistics --- 2 packets transmitted, 2 packets received, 0% packet loss round-trip min/avg/max/stddev = 0.338/0.881/1.423/0.543 ms Good: Can ping DNS server Good: DNS resolves download.cloud.com ERROR: NFS is not currently mounted Try manually mounting from inside the VM NFS server is eth2 ping: unknown host WARNING: cannot ping nfs server routing table follows Kernel IP routing table Destination Gateway Genmask Flags Metric RefUse Iface 10.48.15.0 0.0.0.0 255.255.255.0 U 0 00 eth1 10.48.15.0 0.0.0.0 255.255.255.0 U 0 00 eth2 10.48.15.0 0.0.0.0 255.255.255.0 U 0 00 eth3 0.0.0.0 10.48.15.1 0.0.0.0 UG0 00 eth2 Management server is 10.48.15.10. Checking connectivity. Good: Can connect to management server port 8250 ERROR: Java process not running. Try restarting the SSVM.
RE: Enabling VMware Support
I downloaded 5.1 SDK and trying to build the image using the -Dnoredist option, but get error with what I assume is other modules that get pulled in with that flag. Is there is a way to just build in the VMware piece? -Soheil [INFO] Apache CloudStack Plugin - NetApp File System . FAILURE [0.063s] From: Michael Phillips [mphilli7...@hotmail.com] Sent: Thursday, April 03, 2014 2:20 PM To: dev@cloudstack.apache.org Subject: RE: Enabling VMware Support You need to use the vsphere 5.1 SDK to build the nonoss From: seiz...@infoblox.com To: dev@cloudstack.apache.org Subject: Enabling VMware Support Date: Thu, 3 Apr 2014 21:15:15 + I was trying to bring up VMware Hypervisor, for the first time, mostly worked with XenServer in the past. I have mostly 5.1 and 5.5 systems. I looked at the Wiki: https://cwiki.apache.org/confluence/display/CLOUDSTACK/Hypervisor+VMWare Is this wiki still current? It is referencing the 4.1 SDK files to download from VMware site and supported versions is 4.1 and 5.0. -Soheil
RE: Enabling VMware Support
Yes, I noted the other JAR files in the wiki, I will update the Wiki once I figure out how to get this to work. I did the following: Place this vim25.jar in deps folder and rename it as vim25_51.jar, then run: deps/install-non-oss.sh to install it into m2 repo. The NetApp build problem has nothing to do with VMware but got created with the -Dnoredist option. -Soheil From: Alex Hitchins [a...@alexhitchins.com] Sent: Friday, April 04, 2014 9:30 AM To: dev@cloudstack.apache.org Subject: RE: Enabling VMware Support I had issues with the VM ware dependencies last week. I will upload the ones I have that work for me and send you the URL as soon as I can. There are several vim_ files referenced in the development wiki however they are old ones. The ones I got to work are the ones from the VMWare SDK 5.1. -Original Message- From: Soheil Eizadi [mailto:seiz...@infoblox.com] Sent: 04 April 2014 17:21 To: dev@cloudstack.apache.org Subject: RE: Enabling VMware Support I downloaded 5.1 SDK and trying to build the image using the -Dnoredist option, but get error with what I assume is other modules that get pulled in with that flag. Is there is a way to just build in the VMware piece? -Soheil [INFO] Apache CloudStack Plugin - NetApp File System . FAILURE [0.063s] From: Michael Phillips [mphilli7...@hotmail.com] Sent: Thursday, April 03, 2014 2:20 PM To: dev@cloudstack.apache.org Subject: RE: Enabling VMware Support You need to use the vsphere 5.1 SDK to build the nonoss From: seiz...@infoblox.com To: dev@cloudstack.apache.org Subject: Enabling VMware Support Date: Thu, 3 Apr 2014 21:15:15 + I was trying to bring up VMware Hypervisor, for the first time, mostly worked with XenServer in the past. I have mostly 5.1 and 5.5 systems. I looked at the Wiki: https://cwiki.apache.org/confluence/display/CLOUDSTACK/Hypervisor+VMWa re Is this wiki still current? It is referencing the 4.1 SDK files to download from VMware site and supported versions is 4.1 and 5.0. -Soheil
RE: Enabling VMware Support
Yes, I had to include the additional JAR files from there to get noredist to build with VMware support. I used the link in the Wiki: http://zooi.widodh.nl/cloudstack/build-dep/cloud-manageontap.jar I got my CloudStack running and ran into this issue: https://issues.apache.org/jira/browse/CLOUDSTACK-4943 Which is the vSwitch labels getting mangled by the Wizard. After fixing this I am able to create a Zone with VMware Cluster in it. -Soheil From: Alex Hitchins [a...@alexhitchins.com] Sent: Friday, April 04, 2014 12:35 PM To: dev@cloudstack.apache.org Subject: RE: Enabling VMware Support Soheil, Right - try the files at this link : http://resources.shapeblue.com/acs/deps/ These are form my deps folder and this seems to be building just fine. -Original Message- From: Soheil Eizadi [mailto:seiz...@infoblox.com] Sent: 04 April 2014 17:58 To: dev@cloudstack.apache.org Subject: RE: Enabling VMware Support Yes, I noted the other JAR files in the wiki, I will update the Wiki once I figure out how to get this to work. I did the following: Place this vim25.jar in deps folder and rename it as vim25_51.jar, then run: deps/install-non-oss.sh to install it into m2 repo. The NetApp build problem has nothing to do with VMware but got created with the -Dnoredist option. -Soheil From: Alex Hitchins [a...@alexhitchins.com] Sent: Friday, April 04, 2014 9:30 AM To: dev@cloudstack.apache.org Subject: RE: Enabling VMware Support I had issues with the VM ware dependencies last week. I will upload the ones I have that work for me and send you the URL as soon as I can. There are several vim_ files referenced in the development wiki however they are old ones. The ones I got to work are the ones from the VMWare SDK 5.1. -Original Message- From: Soheil Eizadi [mailto:seiz...@infoblox.com] Sent: 04 April 2014 17:21 To: dev@cloudstack.apache.org Subject: RE: Enabling VMware Support I downloaded 5.1 SDK and trying to build the image using the -Dnoredist option, but get error with what I assume is other modules that get pulled in with that flag. Is there is a way to just build in the VMware piece? -Soheil [INFO] Apache CloudStack Plugin - NetApp File System . FAILURE [0.063s] From: Michael Phillips [mphilli7...@hotmail.com] Sent: Thursday, April 03, 2014 2:20 PM To: dev@cloudstack.apache.org Subject: RE: Enabling VMware Support You need to use the vsphere 5.1 SDK to build the nonoss From: seiz...@infoblox.com To: dev@cloudstack.apache.org Subject: Enabling VMware Support Date: Thu, 3 Apr 2014 21:15:15 + I was trying to bring up VMware Hypervisor, for the first time, mostly worked with XenServer in the past. I have mostly 5.1 and 5.5 systems. I looked at the Wiki: https://cwiki.apache.org/confluence/display/CLOUDSTACK/Hypervisor+VMWa re Is this wiki still current? It is referencing the 4.1 SDK files to download from VMware site and supported versions is 4.1 and 5.0. -Soheil
Enabling VMware Support
I was trying to bring up VMware Hypervisor, for the first time, mostly worked with XenServer in the past. I have mostly 5.1 and 5.5 systems. I looked at the Wiki: https://cwiki.apache.org/confluence/display/CLOUDSTACK/Hypervisor+VMWare Is this wiki still current? It is referencing the 4.1 SDK files to download from VMware site and supported versions is 4.1 and 5.0. -Soheil
RE: CloudStack New Spring Logic
Hi Hugo, Thanks for catching it, it was just my typo that was causing the problem. :( -Soheil From: Trippie [trip...@gmail.com] on behalf of Hugo Trippaers [h...@trippaers.nl] Sent: Tuesday, March 25, 2014 12:53 AM To: dev@cloudstack.apache.org Subject: Re: CloudStack New Spring Logic Hey Soheil, The files look good to me at first glance. Are you sure the property files are in the final jar? Just asking because you use the resource directory and our default is resources. Cheers, Hugo On 24 mrt. 2014, at 20:46, Soheil Eizadi seiz...@infoblox.com wrote: I am refactoring some code that use to work with the older 4.x before the new Spring changes. I read the Spring wiki and have made the necessary changes, e.g. Administrators-MacBook-Pro-88:infoblox seizadi$ find resource/ resource/ resource//log4j.properties resource//META-INF resource//META-INF/cloudstack resource//META-INF/cloudstack/infoblox resource//META-INF/cloudstack/infoblox/module.properties resource//META-INF/cloudstack/infoblox/spring-infoblox-context.xml Administrators-MacBook-Pro-88:infoblox seizadi$ cat resource//META-INF/cloudstack/infoblox/module.properties # . name=infoblox parent=network Administrators-MacBook-Pro-88:infoblox seizadi$ cat resource//META-INF/cloudstack/infoblox/spring-infoblox-context.xml !-- -- beans xmlns=http://www.springframework.org/schema/beans; xmlns:xsi=http://www.w3.org/2001/XMLSchema-instance; xmlns:context=http://www.springframework.org/schema/context; xmlns:aop=http://www.springframework.org/schema/aop; xsi:schemaLocation=http://www.springframework.org/schema/beans http://www.springframework.org/schema/beans/spring-beans-3.0.xsd http://www.springframework.org/schema/aop http://www.springframework.org/schema/aop/spring-aop-3.0.xsd http://www.springframework.org/schema/context http://www.springframework.org/schema/context/spring-context-3.0.xsd; bean id=InfobloxDaoImpl class=org.apache.cloudstack.network.dao.InfobloxDaoImpl / bean id=Infoblox class=org.apache.cloudstack.network.element.InfobloxElement property name=name value=Infoblox / /bean /beans My jar file builds and gets put into the target directory: ./cloud-client-ui-4.4.0-SNAPSHOT/WEB-INF/lib/cloud-plugin-network-infoblox-4.4.0-SNAPSHOT.jar ./client/target/cloud-client-ui-4.4.0-SNAPSHOT/WEB-INF/lib/cloud-plugin-network-infoblox-4.4.0-SNAPSHOT.jar I don't see my plugin in the Network Hierarchy: INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) Module Hierarchy: network INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) Module Hierarchy: baremetal-network INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) Module Hierarchy: contrail INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) Module Hierarchy: elb INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) Module Hierarchy: midonet INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) Module Hierarchy: netscaler INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) Module Hierarchy: nvp INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) Module Hierarchy: opendaylight INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) Module Hierarchy: ovs INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) Module Hierarchy: paloalto INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) Module Hierarchy: server-network INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) Module Hierarchy: ssp INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) Module Hierarchy: vns INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) Module Hierarchy: vxlan What am I missing to get my module into the DefintionSet? -Soheil
CloudStack New Spring Logic
I am refactoring some code that use to work with the older 4.x before the new Spring changes. I read the Spring wiki and have made the necessary changes, e.g. Administrators-MacBook-Pro-88:infoblox seizadi$ find resource/ resource/ resource//log4j.properties resource//META-INF resource//META-INF/cloudstack resource//META-INF/cloudstack/infoblox resource//META-INF/cloudstack/infoblox/module.properties resource//META-INF/cloudstack/infoblox/spring-infoblox-context.xml Administrators-MacBook-Pro-88:infoblox seizadi$ cat resource//META-INF/cloudstack/infoblox/module.properties # . name=infoblox parent=network Administrators-MacBook-Pro-88:infoblox seizadi$ cat resource//META-INF/cloudstack/infoblox/spring-infoblox-context.xml !-- -- beans xmlns=http://www.springframework.org/schema/beans; xmlns:xsi=http://www.w3.org/2001/XMLSchema-instance; xmlns:context=http://www.springframework.org/schema/context; xmlns:aop=http://www.springframework.org/schema/aop; xsi:schemaLocation=http://www.springframework.org/schema/beans http://www.springframework.org/schema/beans/spring-beans-3.0.xsd http://www.springframework.org/schema/aop http://www.springframework.org/schema/aop/spring-aop-3.0.xsd http://www.springframework.org/schema/context http://www.springframework.org/schema/context/spring-context-3.0.xsd; bean id=InfobloxDaoImpl class=org.apache.cloudstack.network.dao.InfobloxDaoImpl / bean id=Infoblox class=org.apache.cloudstack.network.element.InfobloxElement property name=name value=Infoblox / /bean /beans My jar file builds and gets put into the target directory: ./cloud-client-ui-4.4.0-SNAPSHOT/WEB-INF/lib/cloud-plugin-network-infoblox-4.4.0-SNAPSHOT.jar ./client/target/cloud-client-ui-4.4.0-SNAPSHOT/WEB-INF/lib/cloud-plugin-network-infoblox-4.4.0-SNAPSHOT.jar I don't see my plugin in the Network Hierarchy: INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) Module Hierarchy: network INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) Module Hierarchy: baremetal-network INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) Module Hierarchy: contrail INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) Module Hierarchy: elb INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) Module Hierarchy: midonet INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) Module Hierarchy: netscaler INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) Module Hierarchy: nvp INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) Module Hierarchy: opendaylight INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) Module Hierarchy: ovs INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) Module Hierarchy: paloalto INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) Module Hierarchy: server-network INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) Module Hierarchy: ssp INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) Module Hierarchy: vns INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) Module Hierarchy: vxlan What am I missing to get my module into the DefintionSet? -Soheil
RE: Java Coding Convention Errors
Here is a code fragment for serialization: result = (T)gson.fromJson(resultString, TypeToken.get(newObject.getClass()).getType()); It is just generic/single handler for all generic type corresponding to the same raw type. -Soheil From: Hugo Trippaers [trip...@gmail.com] Sent: Monday, March 17, 2014 11:30 PM To: dev@cloudstack.apache.org Subject: Re: Java Coding Convention Errors Soheil, How are these classes serialized? There are different ways to solve this like annotations with the serialized name or a gson policy. Cheers, Hugo Sent from my iPhone On 18 mrt. 2014, at 03:33, Soheil Eizadi seiz...@infoblox.com wrote: Looks like in the new trunk we have turned on checks to enforce coding conventions in Eclipse? I have errors with some classes that I need to turn off: Name 'is_default' must match pattern '^_?[a-zA-Z0-9]*$'. For example a declaration: private boolean is_default; These classes are part of the interface for REST communication so the strings must match the corresponding JSON objects. What is the best practice to turn this off in the project for a particular Class? -Soheil
RE: Java Coding Convention Errors
Here is a proposed solution to evaluate, use the maven-checkstyle-plugin exclude feature to make exception for modules that have code convention to conform to external structures. Here is sample for my use case: artifactIdmaven-checkstyle-plugin/artifactId configuration excludes **/infoblox/InfobloxNetworkView.java /excludes /configuration -Soheil From: Soheil Eizadi [seiz...@infoblox.com] Sent: Tuesday, March 18, 2014 6:26 AM To: dev@cloudstack.apache.org Subject: RE: Java Coding Convention Errors Here is a code fragment for serialization: result = (T)gson.fromJson(resultString, TypeToken.get(newObject.getClass()).getType()); It is just generic/single handler for all generic type corresponding to the same raw type. -Soheil From: Hugo Trippaers [trip...@gmail.com] Sent: Monday, March 17, 2014 11:30 PM To: dev@cloudstack.apache.org Subject: Re: Java Coding Convention Errors Soheil, How are these classes serialized? There are different ways to solve this like annotations with the serialized name or a gson policy. Cheers, Hugo Sent from my iPhone On 18 mrt. 2014, at 03:33, Soheil Eizadi seiz...@infoblox.com wrote: Looks like in the new trunk we have turned on checks to enforce coding conventions in Eclipse? I have errors with some classes that I need to turn off: Name 'is_default' must match pattern '^_?[a-zA-Z0-9]*$'. For example a declaration: private boolean is_default; These classes are part of the interface for REST communication so the strings must match the corresponding JSON objects. What is the best practice to turn this off in the project for a particular Class? -Soheil
RE: Java Coding Convention Errors
Hi Hugo, Thanks for the direction, I followed that pattern, -Soheil From: Hugo Trippaers [trip...@gmail.com] Sent: Tuesday, March 18, 2014 12:43 PM To: dev@cloudstack.apache.org Subject: Re: Java Coding Convention Errors Hey Soheil, Isn't is possible to stick to the CloudStack standards and use the SerializedName annotation? http://google-gson.googlecode.com/svn/tags/1.2.3/docs/javadocs/com/google/gson/annotations/SerializedName.html Another option is to set a policy on gson that will automagically translate the java name into the underscore standard upon serialization. So isBoolean would become is_boolean. Look at the NiciraNvpApi, the gson policy is activated in the constructor. Cheers, Hugo Sent from my iPhone On 18 mrt. 2014, at 20:34, Soheil Eizadi seiz...@infoblox.com wrote: Here is a proposed solution to evaluate, use the maven-checkstyle-plugin exclude feature to make exception for modules that have code convention to conform to external structures. Here is sample for my use case: artifactIdmaven-checkstyle-plugin/artifactId configuration excludes **/infoblox/InfobloxNetworkView.java /excludes /configuration -Soheil From: Soheil Eizadi [seiz...@infoblox.com] Sent: Tuesday, March 18, 2014 6:26 AM To: dev@cloudstack.apache.org Subject: RE: Java Coding Convention Errors Here is a code fragment for serialization: result = (T)gson.fromJson(resultString, TypeToken.get(newObject.getClass()).getType()); It is just generic/single handler for all generic type corresponding to the same raw type. -Soheil From: Hugo Trippaers [trip...@gmail.com] Sent: Monday, March 17, 2014 11:30 PM To: dev@cloudstack.apache.org Subject: Re: Java Coding Convention Errors Soheil, How are these classes serialized? There are different ways to solve this like annotations with the serialized name or a gson policy. Cheers, Hugo Sent from my iPhone On 18 mrt. 2014, at 03:33, Soheil Eizadi seiz...@infoblox.com wrote: Looks like in the new trunk we have turned on checks to enforce coding conventions in Eclipse? I have errors with some classes that I need to turn off: Name 'is_default' must match pattern '^_?[a-zA-Z0-9]*$'. For example a declaration: private boolean is_default; These classes are part of the interface for REST communication so the strings must match the corresponding JSON objects. What is the best practice to turn this off in the project for a particular Class? -Soheil
Java Coding Convention Errors
Looks like in the new trunk we have turned on checks to enforce coding conventions in Eclipse? I have errors with some classes that I need to turn off: Name 'is_default' must match pattern '^_?[a-zA-Z0-9]*$'. For example a declaration: private boolean is_default; These classes are part of the interface for REST communication so the strings must match the corresponding JSON objects. What is the best practice to turn this off in the project for a particular Class? -Soheil
DevCloud2
I just had someone from our Product Marketing that had been to the local meetup demonstrating DevCloud2. They have a situation where they configured some basic configuration and then the next time they ran DevCloud2 it complained about lack of memory and would not come up for them, it was not obvious to them what to do next. I fixed the problem by setting the Maven options and configuring it for more memory in .bashrc: MAVEN_OPTS=-Xmx2g -XX:MaxPermSize=512m export MAVEN_OPTS We might want to revisit the base configuration for DevCloud2. -Soheil
XenServer Memory Increase Problem
I am running on CloudStack Master 4.3. I had a use case where my XenServer ran out of memory and I could not create any more instances on CloudStack. I shutdown the XenServer and increased the memory on XenServer and brought up the Management Server again, but the Management Server still sees the old values. How is this suppose to work? As a workaround I assume I could find the database entry for the old RAM value and update with the new Memory Total. Here is some more detailed logs: The stats for the XenServer from CloudStack: Total CPU 2 x 2.67 GHz CPU Utilized0.08% CPU Allocated for VMs 0% Memory Total7.03 GB Memory Allocated2.50 GB Memory Used 3.60 MB Network Read558.23 MB Network Write 23.20 MB The log of memory problem: WARN [o.a.c.alerts] (Job-Executor-5:ctx-3b5b1c95) alertType:: 8 // dataCenterId:: 1 // podId:: null // clusterId:: null // message:: Failed to deploy Vm with Id: 27, on Host wi th Id: null INFO [o.a.c.a.c.u.v.DeployVMCmd] (Job-Executor-5:ctx-3b5b1c95) com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[User|test-2]Scope=in terface com.cloud.dc.DataCenter; id=1 INFO [o.a.c.a.c.u.v.DeployVMCmd] (Job-Executor-5:ctx-3b5b1c95) Unable to create a deployment for VM[User|test-2] com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[User|test-2]Scope=interface com.cloud.dc.DataCenter; id=1 at org.apache.cloudstack.engine.cloud.entity.api.VMEntityManagerImpl.reserveVirtualMachine(VMEntityManagerImpl.java:210) at org.apache.cloudstack.engine.cloud.entity.api.VirtualMachineEntityImpl.reserve(VirtualMachineEntityImpl.java:198) at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3372) at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:2954) at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:2940) at com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125) at org.apache.cloudstack.api.command.user.vm.DeployVMCmd.execute(DeployVMCmd.java:421) at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:161) at com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:97) at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$1.run(AsyncJobManagerImpl.java:526) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) at java.lang.Thread.run(Thread.java:679) INFO [o.a.c.f.j.i.AsyncJobMonitor] (Job-Executor-5:null) Remove job-62 from job monitoring
RE: XenServer Memory Increase Problem
Thanks Nitin, I created Jira Bug: https://issues.apache.org/jira/browse/CLOUDSTACK-4883 -Soheil From: Nitin Mehta [nitin.me...@citrix.com] Sent: Wednesday, October 16, 2013 12:15 PM To: dev@cloudstack.apache.org Subject: Re: XenServer Memory Increase Problem Soheil - I guess this is a bug that addition of new memory isn't detected. File it if not already done. I would suggest you to change the DB as of now. Right tables are host and op_host_capacity (capacity_type=0). You might have to keep in mind the over provisioning factors you have kept. See if changing it works. On 16/10/13 11:56 AM, Soheil Eizadi seiz...@infoblox.com wrote: I am running on CloudStack Master 4.3. I had a use case where my XenServer ran out of memory and I could not create any more instances on CloudStack. I shutdown the XenServer and increased the memory on XenServer and brought up the Management Server again, but the Management Server still sees the old values. How is this suppose to work? As a workaround I assume I could find the database entry for the old RAM value and update with the new Memory Total. Here is some more detailed logs: The stats for the XenServer from CloudStack: Total CPU 2 x 2.67 GHz CPU Utilized0.08% CPU Allocated for VMs 0% Memory Total7.03 GB Memory Allocated2.50 GB Memory Used 3.60 MB Network Read558.23 MB Network Write 23.20 MB The log of memory problem: WARN [o.a.c.alerts] (Job-Executor-5:ctx-3b5b1c95) alertType:: 8 // dataCenterId:: 1 // podId:: null // clusterId:: null // message:: Failed to deploy Vm with Id: 27, on Host wi th Id: null INFO [o.a.c.a.c.u.v.DeployVMCmd] (Job-Executor-5:ctx-3b5b1c95) com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[User|test-2]Scope=in terface com.cloud.dc.DataCenter; id=1 INFO [o.a.c.a.c.u.v.DeployVMCmd] (Job-Executor-5:ctx-3b5b1c95) Unable to create a deployment for VM[User|test-2] com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[User|test-2]Scope=interface com.cloud.dc.DataCenter; id=1 at org.apache.cloudstack.engine.cloud.entity.api.VMEntityManagerImpl.reserveV irtualMachine(VMEntityManagerImpl.java:210) at org.apache.cloudstack.engine.cloud.entity.api.VirtualMachineEntityImpl.res erve(VirtualMachineEntityImpl.java:198) at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java: 3372) at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java: 2954) at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java: 2940) at com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorD ispatcher.intercept(ComponentInstantiationPostProcessor.java:125) at org.apache.cloudstack.api.command.user.vm.DeployVMCmd.execute(DeployVMCmd. java:421) at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:161) at com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:97) at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$1.run(AsyncJ obManagerImpl.java:526) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java: 1110) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java :603) at java.lang.Thread.run(Thread.java:679) INFO [o.a.c.f.j.i.AsyncJobMonitor] (Job-Executor-5:null) Remove job-62 from job monitoring
RE: XenServer Memory Increase Problem
Here is more detail for others that have this bug, until it is fixed: Find the total memory listed for XenServer it is under column ram for the XenServer you have: mysql select * from host; Then find the XenServer above and in another table op_host_capacity update column total_capacity mysql select * from op_host_capacity; mysql update op_host_capacity set total_capacity=7546932288 where id=1; mysql commit; From: Soheil Eizadi [seiz...@infoblox.com] Sent: Wednesday, October 16, 2013 12:25 PM To: dev@cloudstack.apache.org Subject: RE: XenServer Memory Increase Problem Thanks Nitin, I created Jira Bug: https://issues.apache.org/jira/browse/CLOUDSTACK-4883 -Soheil From: Nitin Mehta [nitin.me...@citrix.com] Sent: Wednesday, October 16, 2013 12:15 PM To: dev@cloudstack.apache.org Subject: Re: XenServer Memory Increase Problem Soheil - I guess this is a bug that addition of new memory isn't detected. File it if not already done. I would suggest you to change the DB as of now. Right tables are host and op_host_capacity (capacity_type=0). You might have to keep in mind the over provisioning factors you have kept. See if changing it works. On 16/10/13 11:56 AM, Soheil Eizadi seiz...@infoblox.com wrote: I am running on CloudStack Master 4.3. I had a use case where my XenServer ran out of memory and I could not create any more instances on CloudStack. I shutdown the XenServer and increased the memory on XenServer and brought up the Management Server again, but the Management Server still sees the old values. How is this suppose to work? As a workaround I assume I could find the database entry for the old RAM value and update with the new Memory Total. Here is some more detailed logs: The stats for the XenServer from CloudStack: Total CPU 2 x 2.67 GHz CPU Utilized0.08% CPU Allocated for VMs 0% Memory Total7.03 GB Memory Allocated2.50 GB Memory Used 3.60 MB Network Read558.23 MB Network Write 23.20 MB The log of memory problem: WARN [o.a.c.alerts] (Job-Executor-5:ctx-3b5b1c95) alertType:: 8 // dataCenterId:: 1 // podId:: null // clusterId:: null // message:: Failed to deploy Vm with Id: 27, on Host wi th Id: null INFO [o.a.c.a.c.u.v.DeployVMCmd] (Job-Executor-5:ctx-3b5b1c95) com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[User|test-2]Scope=in terface com.cloud.dc.DataCenter; id=1 INFO [o.a.c.a.c.u.v.DeployVMCmd] (Job-Executor-5:ctx-3b5b1c95) Unable to create a deployment for VM[User|test-2] com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[User|test-2]Scope=interface com.cloud.dc.DataCenter; id=1 at org.apache.cloudstack.engine.cloud.entity.api.VMEntityManagerImpl.reserveV irtualMachine(VMEntityManagerImpl.java:210) at org.apache.cloudstack.engine.cloud.entity.api.VirtualMachineEntityImpl.res erve(VirtualMachineEntityImpl.java:198) at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java: 3372) at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java: 2954) at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java: 2940) at com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorD ispatcher.intercept(ComponentInstantiationPostProcessor.java:125) at org.apache.cloudstack.api.command.user.vm.DeployVMCmd.execute(DeployVMCmd. java:421) at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:161) at com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:97) at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$1.run(AsyncJ obManagerImpl.java:526) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java: 1110) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java :603) at java.lang.Thread.run(Thread.java:679) INFO [o.a.c.f.j.i.AsyncJobMonitor] (Job-Executor-5:null) Remove job-62 from job monitoring
RE: Global setting host is not set to MS IP anymore on master
Since I synced my code with 4.3 Master, the Host and Management Network is getting properly for me. The storage network is empty. -Soheil From: Mike Tutkowski [mike.tutkow...@solidfire.com] Sent: Friday, October 11, 2013 11:23 AM To: dev@cloudstack.apache.org Cc: Prasanna Santhanam Subject: Re: Global setting host is not set to MS IP anymore on master Yeah, I tend to set up my CS environment manually. The first thing I do when I log in via the GUI is change the host, secstorage, and cidr Global Settings and then re-start the management server. It would be great if this were not required, of course. On Fri, Oct 11, 2013 at 11:14 AM, Min Chen min.c...@citrix.com wrote: I am also using marvin to deploy my local environment. Do you need to restart MS after adding this globalConfig section in our .cfg file? If so, developer may be able to workaround this. But this issue still needs to be addressed for people not using marvin framework to setup environment, then they have to always remember a manual update host step before starting any ssvm. Thanks -min On 10/10/13 9:31 PM, Prasanna Santhanam t...@apache.org wrote: So, why does setting the 'host' to your IP not work? I do that for the test environment on master as part of deployment via marvin. It's only a small change in the marvin-config. On https://github.com/vogxn/cloud-autodeploy.git commit 8fe580e82fe4ab6dd8e124bf226c5941e72a4204 Author: Prasanna Santhanam t...@apache.org Date: Fri Oct 4 13:53:55 2013 +0530 host value in global config defaults to localhost Signed-off-by: Prasanna Santhanam t...@apache.org diff --git a/kvm.cfg b/kvm.cfg index 43b45de..0e23db0 100644 --- a/kvm.cfg +++ b/kvm.cfg @@ -152,6 +152,10 @@ ], globalConfig: [ { +name: host, +value: cloudstack-centos63 +}, +{ name: network.gc.wait, value: 60 }, On Thu, Oct 10, 2013 at 11:25:15PM +, Prachi Damle wrote: I see it on Windows too. -Original Message- From: Alena Prokharchyk [mailto:alena.prokharc...@citrix.com] Sent: Thursday, October 10, 2013 4:20 PM To: dev@cloudstack.apache.org; Min Chen Subject: Re: Global setting host is not set to MS IP anymore on master Importance: High I'm facing the same problem on master (OS X v10.8.4 if the platform matters) On 10/10/13 3:22 PM, Min Chen min.c...@citrix.com wrote: Hmm? I think that it may be related to new ConfigDepot framework to support dynamic config value without restarting MS. -min On 10/10/13 3:00 PM, Nitin Mehta nitin.me...@citrix.com wrote: If my memory serves me right this was fixed in 4.2. Maybe the fixer forgot to port it to master ? On 10/10/13 2:46 PM, Min Chen min.c...@citrix.com wrote: Hi there, Not sure if others experience the same issue. In 4.2, when MS starts, it will discover the IP address of MS and automatically set global setting host to that IP address. Now it seems broken on master, MS started but host is still set to localhost, which caused my system vm cannot ping back MS and thus no agent status cannot be found for system vm, thus this message on my console INFO [o.a.c.s.e.DefaultEndPointSelector] (StatsCollector-3:null) No running ssvm is found, so command will be sent to LocalHostEndPoint. Anybody has any idea on this? Thanks -min -- Prasanna., Powered by BigRock.com -- *Mike Tutkowski* *Senior CloudStack Developer, SolidFire Inc.* e: mike.tutkow...@solidfire.com o: 303.746.7302 Advancing the way the world uses the cloudhttp://solidfire.com/solution/overview/?video=play *™*
RE: System VM template caching
This seems similar to a problem I had on 4.3 Master with System VM creation. If it is the same problem you can check from API command ListTemplateCommand(), from CloudMonkey and see if it returns a bogus cached value. Then you know it is the same problem. -Soheil http://mail-archives.apache.org/mod_mbox/cloudstack-dev/201309.mbox/%3c6717ec2e5a665a40a5af626d7d4fa90625e2e...@x2008mb1.infoblox.com%3E From: Kelcey Jamison Damage [kel...@backbonetechnology.com] Sent: Tuesday, October 08, 2013 12:19 PM To: Cloud Dev Subject: [ACS 4.2][Upgrade Issue] System VM template caching Hi, Several of us in the community have found that with the 4.2 upgrade, when we download and install the latest system VM template, CloudStack refuses to use this template for new system VM creation. CloudStack appears to be usin a cached or master-clone variant of the old template. This is causing may KVM+ 4.2 users to have broken clouds, A bug report has been filed: https://issues.apache.org/jira/browse/CLOUDSTACK-4826 My question is: Does anyone know where this cached template is stored? when CloudStack goes to make a new system VM, where does it look first for the template? We have observed through testing that this is no secondary storage. Thanks in advance. Kelcey Damage | Infrastructure Systems Architect Strategy | Automation | Cloud Computing | Technology Development Backbone Technology, Inc 604-331-1152 ext. 114
RE: Problem creating VirtualRouter on XenServer 6.2 due to problem with copy_vhd_from_secondarystorage.sh
I traced this to a problem with ListTemplateCommand() that is returning what I assumed is a cached value 10.48.15.22:/home/nfs/secondary/template/tmpl/1/1/34b74283-916e-4562-82fd-082b387b51c5.vhd, the new secondary storage has a new template now: template/tmpl/1/1/170c3425-6078-479e-8843-3f8fdc02aaf3.vhd. I am not sure at what stage this happened, and rather than debug this further, I just reinstalled it from scratch and fixed the issue. -Soheil From: Soheil Eizadi [seiz...@infoblox.com] Sent: Tuesday, September 24, 2013 6:10 PM To: dev@cloudstack.apache.org Subject: RE: Problem creating VirtualRouter on XenServer 6.2 due to problem with copy_vhd_from_secondarystorage.sh The error with copy_vhd_from_secondarystorage.sh is due to a problem with secondary storage, vhd_util returning a negative number to a query as the file does not exist. I am not sure why 34b74283-916e-4562-82fd-082b387b51c5.vhd versus 170c3425-6078-479e-8843-3f8fdc02aaf3.vhd is referenced, that is the next step to chase down. -Soheil [root@cloudstackxenserver1 bin]# ./vhd-util query -v -n 10.48.15.22:/home/nfs/secondary/template/tmpl/1/1/34b74283-916e-4562-82fd-082b387b51c5.vhd error opening 10.48.15.22:/home/nfs/secondary/template/tmpl/1/1/34b74283-916e-4562-82fd-082b387b51c5.vhd: -2 root@nfs-server-10-48-15-21:/opt/storage/secondary# find . ./template ./template/tmpl ./template/tmpl/1 ./template/tmpl/1/1 ./template/tmpl/1/1/170c3425-6078-479e-8843-3f8fdc02aaf3.vhd ./template/tmpl/1/1/template.properties ./template/tmpl/1/5 ./template/tmpl/1/5/0911ae22-350f-38f5-ad3e-423e7e5d6539.vhd ./template/tmpl/1/5/template.properties ./template/tmpl/2 ./volumes ./snapshots From: Soheil Eizadi [seiz...@infoblox.com] Sent: Tuesday, September 24, 2013 5:11 PM To: dev@cloudstack.apache.org Subject: Problem creating VirtualRouter on XenServer 6.2 due to problem with copy_vhd_from_secondarystorage.sh Environment: - 4.3 master (synced with master 08/28/2013 08:43 AM) - XenServer 6.2 I have a problem creating a Virtual Router on XenServer 6.2, here are the symptoms, vmops.log and SMlog don't tell you much, but when I run the copy command native I get an error like the copy_vhd_from_secondarystorage.sh shell is not compatible with XenServer 6.2. I cleared the XenServer host tag to make sure the latest scripts were downloaded from my build. If someone thinks this problem is fixed on the top of the trunk, I can do another pull, otherwise I guess I need chase this some more in my enviroment? -Soheil [root@cloudstackxenserver1 log]# /opt/xensource/bin/copy_vhd_from_secondarystorage.sh 10.48.15.22:/home/nfs/secondary/template/tmpl/1/1/34b74283-916e-4562-82fd-082b387b51c5.vhd 1cca28ee-886a-6d52-5461-662b33f1d8d8 cloud-0230b187-29c2-4060-826c-7f697cceea35 Syntax error: Unknown switch: -22MiB For usage run: 'xe help' 9#can not create vdi in sr 1cca28ee-886a-6d52-5461-662b33f1d8d8 vmops.log: INFO [o.a.c.n.e.InfobloxElement] (Job-Executor-5:ctx-e6414bc5) InfobloxDeviceElement Host Record created for VM r-9-VM WARN [c.c.h.x.r.XenServerStorageProcessor] (DirectAgent-382:null) destoryVDIbyNameLabel failed due to there are 0 VDIs with name cloud-0230b187-29c2-4060-826c-7f697cceea35 WARN [c.c.h.x.r.XenServerStorageProcessor] (DirectAgent-382:null) can not create vdi in sr 1cca28ee-886a-6d52-5461-662b33f1d8d8 . SMlog: Sep 24 16:39:41 cloudstackxenserver1 SM: [28919] VMOPS enter copy_vhd_from_secondarystorage Sep 24 16:39:41 cloudstackxenserver1 SM: [28919] ['bash', '/opt/xensource/bin/copy_vhd_from_secondarystorage.sh', '10.48.15.22:/home/nfs/secondary/template/tmpl/1/1/34b74283-916e-4562-82fd-082b387b51c5.vhd', '1cca28ee-886a-6d52-5461-662b33f1d8d8', 'cloud-0230b187-29c2-4060-826c-7f697cceea35'] Sep 24 16:39:41 cloudstackxenserver1 SM: [28919] pread SUCCESS Sep 24 16:39:41 cloudstackxenserver1 SM: [28919] VMOPS exit copy_vhd_from_secondarystorage Sep 24 16:39:42 cloudstackxenserver1 SM: [28955] VMOPS enter kill_copy_process Sep 24 16:39:42 cloudstackxenserver1 SM: [28955] ['bash', '/opt/xensource/bin/kill_copy_process.sh', '34b74283-916e-4562-82fd-082b387b51c5.vhd'] Sep 24 16:39:42 cloudstackxenserver1 SM: [28955] pread SUCCESS Sep 24 16:39:42 cloudstackxenserver1 SM: [28955] VMOPS exit kill_copy_process
Advanced Networking Shared Network Deletion Fail due to VRouter
Here is problem I just encoutered on 4.3 Master: 1. Created a Shared Advanced network 2. Created an instance 3. Removed the instance 4. After the GUI showed the Instance was removed I tried to delete the network The network deletion fails, due to VRouter Instance being present: WARN [c.c.n.NetworkManagerImpl] (Job-Executor-2:ctx-820db89a) Unable to complete destroy of the network due to element: VirtualRouter Really the problem is that VRouter is already deleted on XenServer but looks like it is still in the MS database! I cleaned up the database and removed the VRouter instance information from the vm_instance table, and was able to successfully remove the network. Is this a known issue? -Soheil [root@xenserver1-cloudstack ~]# xe vm-list uuid ( RO) : 58a9612b-7a73-8a14-4b29-58f043acec7c name-label ( RW): s-1-VM power-state ( RO): running uuid ( RO) : 9e5503d1-16a5-40ab-a0dc-788bad583c0d name-label ( RW): Control domain on host: xenserver1-cloudstack power-state ( RO): running uuid ( RO) : 91950b00-584b-a6b8-e3f9-27a75f071e6d name-label ( RW): v-2-VM power-state ( RO): running The exception is from the call to destroy VM that calls advanceExpunge() and fails when it finally called the Hypervisor: s_logger.debug(Cleaning up NICS); ListCommand nicExpungeCommands = hvGuru.finalizeExpungeNics(vm, profile.getNics()); Here is what the database looks like for the instances: mysql select * from vm_instance; +++--+---+---++-+-++++-+--+--+-+--++---+--+-+-+-++++---+-+--+-+--+--+--+---+---+---+--+---+--++--+-+--++ | id | name | uuid | instance_name | state | vm_template_id | guest_os_id | private_mac_address | private_ip_address | pod_id | data_center_id | host_id | last_host_id | proxy_id | proxy_assign_time | vnc_password | ha_enabled | limit_cpu_use | update_count | update_time | created | removed | type | vm_type| account_id | domain_id | service_offering_id | reservation_id | hypervisor_type | disk_offering_id | cpu | ram | owner | speed | host_name | display_name | desired_state | dynamically_scalable | display_vm | power_state | power_state_update_time | power_state_update_count | power_host | +++--+---+---++-+-++++-+--+--+-+--++---+--+-+-+-++++---+-+--+-+--+--+--+---+---+---+--+---+--++--+-+--++ | 1 | s-1-VM | 4cd7eee7-b420-4fce-8aec-90fae16ff3a0 | s-1-VM| Running | 1 | 183 | 06:f2:48:00:00:0c | 10.48.15.41| 1 | 1 | 1 |1 | NULL | NULL | 3e0934c4827e7b71 | 0 | 0 |3 | 2013-09-27 05:27:32 | 2013-09-27 05:24:44 | NULL| SecondaryStorageVm | SecondaryStorageVm | 1 | 1 | 9 | 002fd3d7-a347-4b21-8ee5-0c4418b8cce6 | XenServer | NULL | NULL | NULL | NULL | NULL | NULL | NULL | NULL | 0 | 1 | PowerUnknown | NULL| 0 | NULL | | 2 | v-2-VM | d89219d1-e741-4242-ac20-215dd3d325e3 | v-2-VM| Running | 1 | 183 | 06:55:34:00:00:05 | 10.48.15.34| 1 | 1 | 1 |1 | NULL | NULL | 735aa2bf84c2b6e | 0 | 0 |3 | 2013-09-27 05:27:32 | 2013-09-27 05:24:44 | NULL| ConsoleProxy | ConsoleProxy | 1 | 1 | 11 | 7fce9eb6-37e3-4005-992d-2b5f6697455d | XenServer | NULL | NULL | NULL
RE: Problem creating VirtualRouter on XenServer 6.2 due to problem with copy_vhd_from_secondarystorage.sh
I followed the steps here: https://cwiki.apache.org/confluence/display/CLOUDSTACK/How+to+build+CloudStack Under Install the SystemVM Template, I put the steps there as there was not enough detail for developers. I think it is OK but you can review. As I said I am not sure of the steps that led to this problem as I merged from 4.2 to 4.3 and upgraded my systemVM image on secondary store, may be somewhere in that transition things broke. -Soheil From: Nitin Mehta [nitin.me...@citrix.com] Sent: Friday, September 27, 2013 12:00 PM To: dev@cloudstack.apache.org Subject: Re: Problem creating VirtualRouter on XenServer 6.2 due to problem with copy_vhd_from_secondarystorage.sh ListTemplateCommand() just reads the content present on secondary storage through template.properties. How did you put the new template ? Was template.properties and DB updated accordingly ? On 27/09/13 11:30 AM, Soheil Eizadi seiz...@infoblox.com wrote: I traced this to a problem with ListTemplateCommand() that is returning what I assumed is a cached value 10.48.15.22:/home/nfs/secondary/template/tmpl/1/1/34b74283-916e-4562-82fd- 082b387b51c5.vhd, the new secondary storage has a new template now: template/tmpl/1/1/170c3425-6078-479e-8843-3f8fdc02aaf3.vhd. I am not sure at what stage this happened, and rather than debug this further, I just reinstalled it from scratch and fixed the issue. -Soheil From: Soheil Eizadi [seiz...@infoblox.com] Sent: Tuesday, September 24, 2013 6:10 PM To: dev@cloudstack.apache.org Subject: RE: Problem creating VirtualRouter on XenServer 6.2 due to problem with copy_vhd_from_secondarystorage.sh The error with copy_vhd_from_secondarystorage.sh is due to a problem with secondary storage, vhd_util returning a negative number to a query as the file does not exist. I am not sure why 34b74283-916e-4562-82fd-082b387b51c5.vhd versus 170c3425-6078-479e-8843-3f8fdc02aaf3.vhd is referenced, that is the next step to chase down. -Soheil [root@cloudstackxenserver1 bin]# ./vhd-util query -v -n 10.48.15.22:/home/nfs/secondary/template/tmpl/1/1/34b74283-916e-4562-82fd- 082b387b51c5.vhd error opening 10.48.15.22:/home/nfs/secondary/template/tmpl/1/1/34b74283-916e-4562-82fd- 082b387b51c5.vhd: -2 root@nfs-server-10-48-15-21:/opt/storage/secondary# find . ./template ./template/tmpl ./template/tmpl/1 ./template/tmpl/1/1 ./template/tmpl/1/1/170c3425-6078-479e-8843-3f8fdc02aaf3.vhd ./template/tmpl/1/1/template.properties ./template/tmpl/1/5 ./template/tmpl/1/5/0911ae22-350f-38f5-ad3e-423e7e5d6539.vhd ./template/tmpl/1/5/template.properties ./template/tmpl/2 ./volumes ./snapshots From: Soheil Eizadi [seiz...@infoblox.com] Sent: Tuesday, September 24, 2013 5:11 PM To: dev@cloudstack.apache.org Subject: Problem creating VirtualRouter on XenServer 6.2 due to problem with copy_vhd_from_secondarystorage.sh Environment: - 4.3 master (synced with master 08/28/2013 08:43 AM) - XenServer 6.2 I have a problem creating a Virtual Router on XenServer 6.2, here are the symptoms, vmops.log and SMlog don't tell you much, but when I run the copy command native I get an error like the copy_vhd_from_secondarystorage.sh shell is not compatible with XenServer 6.2. I cleared the XenServer host tag to make sure the latest scripts were downloaded from my build. If someone thinks this problem is fixed on the top of the trunk, I can do another pull, otherwise I guess I need chase this some more in my enviroment? -Soheil [root@cloudstackxenserver1 log]# /opt/xensource/bin/copy_vhd_from_secondarystorage.sh 10.48.15.22:/home/nfs/secondary/template/tmpl/1/1/34b74283-916e-4562-82fd- 082b387b51c5.vhd 1cca28ee-886a-6d52-5461-662b33f1d8d8 cloud-0230b187-29c2-4060-826c-7f697cceea35 Syntax error: Unknown switch: -22MiB For usage run: 'xe help' 9#can not create vdi in sr 1cca28ee-886a-6d52-5461-662b33f1d8d8 vmops.log: INFO [o.a.c.n.e.InfobloxElement] (Job-Executor-5:ctx-e6414bc5) InfobloxDeviceElement Host Record created for VM r-9-VM WARN [c.c.h.x.r.XenServerStorageProcessor] (DirectAgent-382:null) destoryVDIbyNameLabel failed due to there are 0 VDIs with name cloud-0230b187-29c2-4060-826c-7f697cceea35 WARN [c.c.h.x.r.XenServerStorageProcessor] (DirectAgent-382:null) can not create vdi in sr 1cca28ee-886a-6d52-5461-662b33f1d8d8 . SMlog: Sep 24 16:39:41 cloudstackxenserver1 SM: [28919] VMOPS enter copy_vhd_from_secondarystorage Sep 24 16:39:41 cloudstackxenserver1 SM: [28919] ['bash', '/opt/xensource/bin/copy_vhd_from_secondarystorage.sh', '10.48.15.22:/home/nfs/secondary/template/tmpl/1/1/34b74283-916e-4562-82fd -082b387b51c5.vhd', '1cca28ee-886a-6d52-5461-662b33f1d8d8', 'cloud-0230b187-29c2-4060-826c-7f697cceea35'] Sep 24 16:39:41 cloudstackxenserver1 SM: [28919] pread SUCCESS Sep 24 16:39:41 cloudstackxenserver1 SM: [28919] VMOPS exit copy_vhd_from_secondarystorage Sep 24 16:39:42
Problem creating VirtualRouter on XenServer 6.2 due to problem with copy_vhd_from_secondarystorage.sh
Environment: - 4.3 master (synced with master 08/28/2013 08:43 AM) - XenServer 6.2 I have a problem creating a Virtual Router on XenServer 6.2, here are the symptoms, vmops.log and SMlog don't tell you much, but when I run the copy command native I get an error like the copy_vhd_from_secondarystorage.sh shell is not compatible with XenServer 6.2. I cleared the XenServer host tag to make sure the latest scripts were downloaded from my build. If someone thinks this problem is fixed on the top of the trunk, I can do another pull, otherwise I guess I need chase this some more in my enviroment? -Soheil [root@cloudstackxenserver1 log]# /opt/xensource/bin/copy_vhd_from_secondarystorage.sh 10.48.15.22:/home/nfs/secondary/template/tmpl/1/1/34b74283-916e-4562-82fd-082b387b51c5.vhd 1cca28ee-886a-6d52-5461-662b33f1d8d8 cloud-0230b187-29c2-4060-826c-7f697cceea35 Syntax error: Unknown switch: -22MiB For usage run: 'xe help' 9#can not create vdi in sr 1cca28ee-886a-6d52-5461-662b33f1d8d8 vmops.log: INFO [o.a.c.n.e.InfobloxElement] (Job-Executor-5:ctx-e6414bc5) InfobloxDeviceElement Host Record created for VM r-9-VM WARN [c.c.h.x.r.XenServerStorageProcessor] (DirectAgent-382:null) destoryVDIbyNameLabel failed due to there are 0 VDIs with name cloud-0230b187-29c2-4060-826c-7f697cceea35 WARN [c.c.h.x.r.XenServerStorageProcessor] (DirectAgent-382:null) can not create vdi in sr 1cca28ee-886a-6d52-5461-662b33f1d8d8 . SMlog: Sep 24 16:39:41 cloudstackxenserver1 SM: [28919] VMOPS enter copy_vhd_from_secondarystorage Sep 24 16:39:41 cloudstackxenserver1 SM: [28919] ['bash', '/opt/xensource/bin/copy_vhd_from_secondarystorage.sh', '10.48.15.22:/home/nfs/secondary/template/tmpl/1/1/34b74283-916e-4562-82fd-082b387b51c5.vhd', '1cca28ee-886a-6d52-5461-662b33f1d8d8', 'cloud-0230b187-29c2-4060-826c-7f697cceea35'] Sep 24 16:39:41 cloudstackxenserver1 SM: [28919] pread SUCCESS Sep 24 16:39:41 cloudstackxenserver1 SM: [28919] VMOPS exit copy_vhd_from_secondarystorage Sep 24 16:39:42 cloudstackxenserver1 SM: [28955] VMOPS enter kill_copy_process Sep 24 16:39:42 cloudstackxenserver1 SM: [28955] ['bash', '/opt/xensource/bin/kill_copy_process.sh', '34b74283-916e-4562-82fd-082b387b51c5.vhd'] Sep 24 16:39:42 cloudstackxenserver1 SM: [28955] pread SUCCESS Sep 24 16:39:42 cloudstackxenserver1 SM: [28955] VMOPS exit kill_copy_process
RE: Problem creating VirtualRouter on XenServer 6.2 due to problem with copy_vhd_from_secondarystorage.sh
The error with copy_vhd_from_secondarystorage.sh is due to a problem with secondary storage, vhd_util returning a negative number to a query as the file does not exist. I am not sure why 34b74283-916e-4562-82fd-082b387b51c5.vhd versus 170c3425-6078-479e-8843-3f8fdc02aaf3.vhd is referenced, that is the next step to chase down. -Soheil [root@cloudstackxenserver1 bin]# ./vhd-util query -v -n 10.48.15.22:/home/nfs/secondary/template/tmpl/1/1/34b74283-916e-4562-82fd-082b387b51c5.vhd error opening 10.48.15.22:/home/nfs/secondary/template/tmpl/1/1/34b74283-916e-4562-82fd-082b387b51c5.vhd: -2 root@nfs-server-10-48-15-21:/opt/storage/secondary# find . ./template ./template/tmpl ./template/tmpl/1 ./template/tmpl/1/1 ./template/tmpl/1/1/170c3425-6078-479e-8843-3f8fdc02aaf3.vhd ./template/tmpl/1/1/template.properties ./template/tmpl/1/5 ./template/tmpl/1/5/0911ae22-350f-38f5-ad3e-423e7e5d6539.vhd ./template/tmpl/1/5/template.properties ./template/tmpl/2 ./volumes ./snapshots From: Soheil Eizadi [seiz...@infoblox.com] Sent: Tuesday, September 24, 2013 5:11 PM To: dev@cloudstack.apache.org Subject: Problem creating VirtualRouter on XenServer 6.2 due to problem with copy_vhd_from_secondarystorage.sh Environment: - 4.3 master (synced with master 08/28/2013 08:43 AM) - XenServer 6.2 I have a problem creating a Virtual Router on XenServer 6.2, here are the symptoms, vmops.log and SMlog don't tell you much, but when I run the copy command native I get an error like the copy_vhd_from_secondarystorage.sh shell is not compatible with XenServer 6.2. I cleared the XenServer host tag to make sure the latest scripts were downloaded from my build. If someone thinks this problem is fixed on the top of the trunk, I can do another pull, otherwise I guess I need chase this some more in my enviroment? -Soheil [root@cloudstackxenserver1 log]# /opt/xensource/bin/copy_vhd_from_secondarystorage.sh 10.48.15.22:/home/nfs/secondary/template/tmpl/1/1/34b74283-916e-4562-82fd-082b387b51c5.vhd 1cca28ee-886a-6d52-5461-662b33f1d8d8 cloud-0230b187-29c2-4060-826c-7f697cceea35 Syntax error: Unknown switch: -22MiB For usage run: 'xe help' 9#can not create vdi in sr 1cca28ee-886a-6d52-5461-662b33f1d8d8 vmops.log: INFO [o.a.c.n.e.InfobloxElement] (Job-Executor-5:ctx-e6414bc5) InfobloxDeviceElement Host Record created for VM r-9-VM WARN [c.c.h.x.r.XenServerStorageProcessor] (DirectAgent-382:null) destoryVDIbyNameLabel failed due to there are 0 VDIs with name cloud-0230b187-29c2-4060-826c-7f697cceea35 WARN [c.c.h.x.r.XenServerStorageProcessor] (DirectAgent-382:null) can not create vdi in sr 1cca28ee-886a-6d52-5461-662b33f1d8d8 . SMlog: Sep 24 16:39:41 cloudstackxenserver1 SM: [28919] VMOPS enter copy_vhd_from_secondarystorage Sep 24 16:39:41 cloudstackxenserver1 SM: [28919] ['bash', '/opt/xensource/bin/copy_vhd_from_secondarystorage.sh', '10.48.15.22:/home/nfs/secondary/template/tmpl/1/1/34b74283-916e-4562-82fd-082b387b51c5.vhd', '1cca28ee-886a-6d52-5461-662b33f1d8d8', 'cloud-0230b187-29c2-4060-826c-7f697cceea35'] Sep 24 16:39:41 cloudstackxenserver1 SM: [28919] pread SUCCESS Sep 24 16:39:41 cloudstackxenserver1 SM: [28919] VMOPS exit copy_vhd_from_secondarystorage Sep 24 16:39:42 cloudstackxenserver1 SM: [28955] VMOPS enter kill_copy_process Sep 24 16:39:42 cloudstackxenserver1 SM: [28955] ['bash', '/opt/xensource/bin/kill_copy_process.sh', '34b74283-916e-4562-82fd-082b387b51c5.vhd'] Sep 24 16:39:42 cloudstackxenserver1 SM: [28955] pread SUCCESS Sep 24 16:39:42 cloudstackxenserver1 SM: [28955] VMOPS exit kill_copy_process
OpenDayLight Project
Is there anyone on the development community involved in the OpenDayLight Project? (http://www.opendaylight.org/) -Soheil
RE: DhcpServiceProvider
Thanks for highlighting why remove entry is not implemented. The interface works for internal implementation where you have the MS database and a separate table in the DHCP server that you are managing. If the DHCP Provider is external and authoritative on the IP Address Management or trying to provide discovery view this assumption is not valid, and you need to explicitly inform it when you want to add an entry and remove one. It looks like most External DHCP providers are going to use the standard Plugin prepare/release interface, like I have for our solution. -Soheil From: Sheng Yang [sh...@yasker.org] Sent: Friday, September 13, 2013 4:23 PM To: dev@cloudstack.apache.org Subject: Re: DhcpServiceProvider In the original implementation, the new dhcp entry would automatically override the old one, so the old entry hasn't been removed explicitly. But still, it would be better to get it done explicitly of course. --Sheng On Fri, Sep 13, 2013 at 1:20 PM, Chiradeep Vittal chiradeep.vit...@citrix.com wrote: Soheil, agree that it needs to moved to NetworkElement and also needs complementary remove() It seems half-thought-out. On 9/13/13 11:31 AM, Soheil Eizadi seiz...@infoblox.com wrote: Posting my questions again... -Soheil From: Soheil Eizadi [seiz...@infoblox.com] Sent: Friday, September 06, 2013 3:13 PM To: dev@cloudstack.apache.org Subject: DhcpServiceProvider I had not looked at the DhcpServiceProvider NetworkElement before, but after recent problem, I got a chance to look at it in more detail. I am new to CloudStack and don't have a lot of the history and had some questions. Is there a link to documentation for the DhcpServiceProvider work? I assume the main use case for DhcpServiceProvider is to support DHCP Daemon like DNSMasq, are there other use cases? The interface is simple enough: public interface DhcpServiceProvider extends NetworkElement { boolean addDhcpEntry(...) ...; boolean configDhcpSupportForSubnet(...) ...; boolean removeDhcpSupportForSubnet(...) ...; } Is there a reason why the companion entry to addDhcpEntry() e.g. removeDhcpEntry() is missing? What is the motivation in adding this code to the NetworkManager versus contain it inside the NetworkElement providing the DHCP? (The logic I see in NetworkManager does not seem to be adding any value. Also it is adding a specific network function DHCP to the NetworkManager, where we are moving functions e.g. IP Address Allocation out.)
Advanced Networking Public Network Service Providers
In the Advanced Networking use cases you have two physical networks (Public and Guest Networks). What is the reason for the GUI not providing Network Service Provider configuration for the Public Network? Thanks, -Soheil
VirtualRouter MAC address NULL
I have not come across this when testing Basic Networking on 4.2, but on 4.3/master with Advanced Networking I have a call to create the Virtual Router with Mac Address is NULL on call to prepare(). Is this normal? -Soheil 2013-09-13 11:14:22,684 INFO [o.a.c.n.e.InfobloxElement] (Job-Executor-9:ctx-288d1882) InfobloxDeviceElement called to prepare Host Name r-9-VM with DNS Domain acme.com Gateway 192.168.11.1 Netmask 192.168.11.0/24 with MAC null with IPv4 192.168.11.1
RE: Advanced Networking Public Network Service Providers
The main use case is providing DNS for the Public Network, but could also provide DHCP and IP Address Management once we work out the Interface for making External IPAM authoritative for CloudStack. Yes agree, much of the discussion on the thread you attached applies here also, is it more complicated than enabling the UI to prompt for a service offering to be bound to the public network and GUI to configure providers? -Soheil From: Chiradeep Vittal [chiradeep.vit...@citrix.com] Sent: Friday, September 13, 2013 1:26 PM To: dev@cloudstack.apache.org Subject: Re: Advanced Networking Public Network Service Providers What services would you provide on the public network? I see a similar discussion here: http://goo.gl/eESveL On 9/13/13 11:35 AM, Soheil Eizadi seiz...@infoblox.com wrote: In the Advanced Networking use cases you have two physical networks (Public and Guest Networks). What is the reason for the GUI not providing Network Service Provider configuration for the Public Network? Thanks, -Soheil
RE: There is no upgrade path from 4.1.1 to 4.2.0
Ordering and dependency needs to be handled with multiple sql files not an issue with single file. -Soheil From: Alex Huang [alex.hu...@citrix.com] Sent: Wednesday, September 11, 2013 8:29 AM To: dev@cloudstack.apache.org Subject: RE: There is no upgrade path from 4.1.1 to 4.2.0 Why do we even maintain such a thing? DB migration version should not be related to the release version. So DB just goes forward in one continuous stream, version 42, 43, 44, 45, 46, etc. So why do we have specific from release to release upgrades? Additionally, there shouldn't be a big olde 41to42.sql. There should be something 0042-add-important-feature-x.sql, 0043-i-added-something-else- splendid.sql. The multiple sql files upgrade is supported. It was actually the original intent with db upgrade but, back when we were a small team, it was easier to just edit one single file. Now, we can definitely change to that type of convention. It does mean a lot more sql files but if we add a directory structure, then it shouldn't be a problem. --Alex
RE: There is no upgrade path from 4.1.1 to 4.2.0
Forgot to comment, I like the idea of having smaller sql files rather than one large file. -Soheil From: Soheil Eizadi [seiz...@infoblox.com] Sent: Wednesday, September 11, 2013 9:02 AM To: dev@cloudstack.apache.org Subject: RE: There is no upgrade path from 4.1.1 to 4.2.0 Ordering and dependency needs to be handled with multiple sql files not an issue with single file. -Soheil From: Alex Huang [alex.hu...@citrix.com] Sent: Wednesday, September 11, 2013 8:29 AM To: dev@cloudstack.apache.org Subject: RE: There is no upgrade path from 4.1.1 to 4.2.0 Why do we even maintain such a thing? DB migration version should not be related to the release version. So DB just goes forward in one continuous stream, version 42, 43, 44, 45, 46, etc. So why do we have specific from release to release upgrades? Additionally, there shouldn't be a big olde 41to42.sql. There should be something 0042-add-important-feature-x.sql, 0043-i-added-something-else- splendid.sql. The multiple sql files upgrade is supported. It was actually the original intent with db upgrade but, back when we were a small team, it was easier to just edit one single file. Now, we can definitely change to that type of convention. It does mean a lot more sql files but if we add a directory structure, then it shouldn't be a problem. --Alex
Review Request 14023: NetworkManager Exception Fix Due to call to getDhcpServiceProvider()
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/14023/ --- Review request for cloudstack. Repository: cloudstack-git Description --- I ran the master branch with my NetworkElement integrated which provides DHCP service. In my use case I was able to create a VM but when I deleted it there was an exception in the NetworkManager when it called: isDhcpAccrossMultipleSubnetsSupported() getDhcpServiceProvider() My DHCP Provider is a NetworkElement but does not implement the DhcpServiceProvider interface. public DhcpServiceProvider getDhcpServiceProvider(Network network) { String DhcpProvider = _ntwkSrvcDao.getProviderForServiceInNetwork(network.getId(), Service.Dhcp); if (DhcpProvider == null) { s_logger.debug(Network + network + doesn't support service + Service.Dhcp.getName()); return null; } return (DhcpServiceProvider)_networkModel.getElementImplementingProvider(DhcpProvider); } There is a check in the NetworkManager in the Prepare stage but a similar check is missing in Release stage. Diffs - server/src/com/cloud/network/NetworkManagerImpl.java ae27554 Diff: https://reviews.apache.org/r/14023/diff/ Testing --- I verified in my environment where due to VM expunge failing to NetworkManager exception the system would retry on a timer. After the fix the VM was removed from the system after the first retry. Thanks, Soheil Eizadi
DhcpServiceProvider
I had not looked at the DhcpServiceProvider NetworkElement before, but after recent problem, I got a chance to look at it in more detail. I am new to CloudStack and don't have a lot of the history and had some questions. Is there a link to documentation for the DhcpServiceProvider work? I assume the main use case for DhcpServiceProvider is to support DHCP Daemon like DNSMasq, are there other use cases? The interface is simple enough: public interface DhcpServiceProvider extends NetworkElement { boolean addDhcpEntry(...) ...; boolean configDhcpSupportForSubnet(...) ...; boolean removeDhcpSupportForSubnet(...) ...; } Is there a reason why the companion entry to addDhcpEntry() e.g. removeDhcpEntry() is missing? What is the motivation in adding this code to the NetworkManager versus contain it inside the NetworkElement providing the DHCP? (The logic I see in NetworkManager does not seem to be adding any value. Also it is adding a specific network function DHCP to the NetworkManager, where we are moving functions e.g. IP Address Allocation out.)
RE: NetworkManager Fix Master branch
I will do that. -Soheil From: Chiradeep Vittal [chiradeep.vit...@citrix.com] Sent: Friday, September 06, 2013 3:07 PM To: dev@cloudstack.apache.org Subject: Re: NetworkManager Fix Master branch Thanks Soheil, can I trouble you to post a review request On 9/6/13 2:54 PM, Soheil Eizadi seiz...@infoblox.com wrote: I ran the master branch with my NetworkElement integrated which provides DHCP service. In my use case I was able to create a VM but when I deleted it there was an exception in the NetworkManager when it called: isDhcpAccrossMultipleSubnetsSupported() getDhcpServiceProvider() My DHCP Provider is a NetworkElement but does not implement the DhcpServiceProvider interface. public DhcpServiceProvider getDhcpServiceProvider(Network network) { String DhcpProvider = _ntwkSrvcDao.getProviderForServiceInNetwork(network.getId(), Service.Dhcp); if (DhcpProvider == null) { s_logger.debug(Network + network + doesn't support service + Service.Dhcp.getName()); return null; } return (DhcpServiceProvider)_networkModel.getElementImplementingProvider(DhcpProv ider); } There is a check in the NetworkManager in the Prepare stage but a similar check is missing in Release stage. Below is a patch to the problem for you to review. I tested it in my environment: diff --git a/server/src/com/cloud/network/NetworkManagerImpl.java b/server/src/com/cloud/network/NetworkManagerImpl.java index ae27554..073cb95 100755 --- a/server/src/com/cloud/network/NetworkManagerImpl.java +++ b/server/src/com/cloud/network/NetworkManagerImpl.java @@ -1568,7 +1568,9 @@ public class NetworkManagerImpl extends ManagerBase implements NetworkManager, L } // remove the dhcpservice ip if this is the last nic in subnet. -if (vm.getType() == Type.User isDhcpAccrossMultipleSubnetsSupported(network) isLastNicInSubnet(nic) +DhcpServiceProvider dhcpServiceProvider = getDhcpServiceProvider(network); +if (dhcpServiceProvider != null + vm.getType() == Type.User isDhcpAccrossMultipleSubnetsSupported(dhcpServiceProvider) isLastNicInSubnet(nic) network.getTrafficType() == TrafficType.Guest network.getGuestType() == GuestType.Shared) { removeDhcpServiceInSubnet(nic); } @@ -1582,8 +1584,7 @@ public class NetworkManagerImpl extends ManagerBase implements NetworkManager, L } } -public boolean isDhcpAccrossMultipleSubnetsSupported(Network network) { -DhcpServiceProvider dhcpServiceProvider = getDhcpServiceProvider(network); +public boolean isDhcpAccrossMultipleSubnetsSupported(DhcpServiceProvider dhcpServiceProvider) { Map Network.Capability, String capabilities = dhcpServiceProvider.getCapabilities().get(Network.Service.Dhcp); String supportsMultipleSubnets = capabilities.get(Network.Capability.DhcpAccrossMultipleSubnets); if (supportsMultipleSubnets != null Boolean.valueOf(supportsMultipleSubnets)) { @@ -2448,7 +2449,12 @@ public class NetworkManagerImpl extends ManagerBase implements NetworkManager, L return null; } -return (DhcpServiceProvider)_networkModel.getElementImplementingProvider(DhcpProv ider); +NetworkElement element = _networkModel.getElementImplementingProvider(DhcpProvider); +if ( element instanceof DhcpServiceProvider ) { + return (DhcpServiceProvider)_networkModel.getElementImplementingProvider(DhcpProv ider); +} else { + return null; +} } -Soheil
NetworkManager Fix Master branch
I ran the master branch with my NetworkElement integrated which provides DHCP service. In my use case I was able to create a VM but when I deleted it there was an exception in the NetworkManager when it called: isDhcpAccrossMultipleSubnetsSupported() getDhcpServiceProvider() My DHCP Provider is a NetworkElement but does not implement the DhcpServiceProvider interface. public DhcpServiceProvider getDhcpServiceProvider(Network network) { String DhcpProvider = _ntwkSrvcDao.getProviderForServiceInNetwork(network.getId(), Service.Dhcp); if (DhcpProvider == null) { s_logger.debug(Network + network + doesn't support service + Service.Dhcp.getName()); return null; } return (DhcpServiceProvider)_networkModel.getElementImplementingProvider(DhcpProvider); } There is a check in the NetworkManager in the Prepare stage but a similar check is missing in Release stage. Below is a patch to the problem for you to review. I tested it in my environment: diff --git a/server/src/com/cloud/network/NetworkManagerImpl.java b/server/src/com/cloud/network/NetworkManagerImpl.java index ae27554..073cb95 100755 --- a/server/src/com/cloud/network/NetworkManagerImpl.java +++ b/server/src/com/cloud/network/NetworkManagerImpl.java @@ -1568,7 +1568,9 @@ public class NetworkManagerImpl extends ManagerBase implements NetworkManager, L } // remove the dhcpservice ip if this is the last nic in subnet. -if (vm.getType() == Type.User isDhcpAccrossMultipleSubnetsSupported(network) isLastNicInSubnet(nic) +DhcpServiceProvider dhcpServiceProvider = getDhcpServiceProvider(network); +if (dhcpServiceProvider != null + vm.getType() == Type.User isDhcpAccrossMultipleSubnetsSupported(dhcpServiceProvider) isLastNicInSubnet(nic) network.getTrafficType() == TrafficType.Guest network.getGuestType() == GuestType.Shared) { removeDhcpServiceInSubnet(nic); } @@ -1582,8 +1584,7 @@ public class NetworkManagerImpl extends ManagerBase implements NetworkManager, L } } -public boolean isDhcpAccrossMultipleSubnetsSupported(Network network) { -DhcpServiceProvider dhcpServiceProvider = getDhcpServiceProvider(network); +public boolean isDhcpAccrossMultipleSubnetsSupported(DhcpServiceProvider dhcpServiceProvider) { Map Network.Capability, String capabilities = dhcpServiceProvider.getCapabilities().get(Network.Service.Dhcp); String supportsMultipleSubnets = capabilities.get(Network.Capability.DhcpAccrossMultipleSubnets); if (supportsMultipleSubnets != null Boolean.valueOf(supportsMultipleSubnets)) { @@ -2448,7 +2449,12 @@ public class NetworkManagerImpl extends ManagerBase implements NetworkManager, L return null; } -return (DhcpServiceProvider)_networkModel.getElementImplementingProvider(DhcpProvider); +NetworkElement element = _networkModel.getElementImplementingProvider(DhcpProvider); +if ( element instanceof DhcpServiceProvider ) { + return (DhcpServiceProvider)_networkModel.getElementImplementingProvider(DhcpProvider); +} else { + return null; +} } -Soheil
RE: Template Problem
To: dev@cloudstack.apache.org Subject: Re: Template Problem Do you have contents of template_view and vm_templates? Thanks -min On 8/30/13 9:25 AM, Soheil Eizadi seiz...@infoblox.com wrote: It was in the original email, here it is by itself: mysql select * from template_store_ref; ++--+-+-+- ++--+++---+--- -+---++--- -+ +---+---+-+--- ---+-+-+ | id | store_id | template_id | created | last_updated | job_id | download_pct | size | store_role | physical_size | download_state | error_str | local_path | install_path | url | state | destroyed | is_copy | update_count | ref_cnt | updated | ++--+-+-+- ++--+++---+--- -+---++--- -+ +---+---+-+--- ---+-+-+ | 5 |1 | 1 | 2013-08-28 23:10:50 | 2013-08-29 21:01:19 | NULL | 100 | 2101252608 | Image |2101252608 | DOWNLOADED | NULL | NULL | template/tmpl/1/1/170c3425-6078-479e-8843-3f8fdc02aaf3.vhd | http://download.cloud.com/templates/4.2/systemvmtemplate-2013-06-12-master -xen.vhd.bz2 | Ready | 0 | 0 |0 | 0 | NULL| | 6 |1 | 5 | 2013-08-29 18:16:53 | 2013-08-29 21:01:19 | NULL | 100 | 52428800 | Image | 50430464 | DOWNLOADED | NULL | NULL | template/tmpl/1/5/0911ae22-350f-38f5-ad3e-423e7e5d6539.vhd | http://people.apache.org/~bhaisaab/vms/ttylinux_pv.vhd | Ready | 0 | 0 |0 | 0 | NULL| ++--+-+-+- ++--+++---+--- -+---++--- -+ +---+---+-+--- ---+-+-+ 2 rows in set (0.00 sec) From: Chiradeep Vittal [chiradeep.vit...@citrix.com] Sent: Friday, August 30, 2013 9:22 AM To: dev@cloudstack.apache.org Subject: Re: Template Problem Just the contents of template_store_ref On 8/30/13 9:17 AM, Soheil Eizadi seiz...@infoblox.com wrote: Chiradeep, What do you want me to lookup, before I clean up my system? -Soheil From: Wei ZHOU [ustcweiz...@gmail.com] Sent: Thursday, August 29, 2013 3:16 PM To: dev@cloudstack.apache.org Subject: Re: Template Problem Chiradeep, Thanks. I cannot give more information as the environment has been cleaned. Maybe Soheil can. I think it is the same issue. 2013/8/29 Chiradeep Vittal chiradeep.vit...@citrix.com It should be template_store_ref On 8/29/13 2:34 PM, Wei ZHOU ustcweiz...@gmail.com wrote: It is the same issue to what I described in comment of CLOUDSTACK-4459: Wei Zhouhttps://issues.apache.org/jira/secure/ViewProfile.jspa?name=weizho u a dded a comment - 29/Aug/13 22:24 Edison, after I redeploy the environment (clean db, restore devcloud to original, reploydb), the system is up. Th systemvms (ssvm and cpvm) are running and the state are up, but I can not see tinylinux in template list. the template_host_ref table is empty. Wei Zhouhttps://issues.apache.org/jira/secure/ViewProfile.jspa?name=weizho u a dded a comment - 29/Aug/13 23:10 It works well on 4.2-forward branch. 2013/8/29 Soheil Eizadi seiz...@infoblox.com I migrated my development environment to the top of trunk which points to 4.3 now. I created a new CloudStack runtime environment running XenServer 6.2, for my Secondary Store I replicated another NFS Server that has images for preRC CloudStack version 4.2 SystemVM and TinyLinux on it. I have the CS running and it creates the SSVM and it is healthy, but I don't see any Templates in the UI, from the database I would expect to see the tiny Linux and SystemVM Template in the Templates view. I have restarted the management server and the problem is persistent. What is the next steps to debug this further? -Soheil Here is some logs below: From SSVM: /usr/local/cloud/systemvm/ssvm-check.sh First DNS server is 10.48.15.25 PING 10.48.15.25 (10.48.15.25
RE: Template Problem
Great, I'm glad you were able to fix it. Next time I sync up with master I will retry it and report on this thread. Thanks, -Soheil From: Min Chen [min.c...@citrix.com] Sent: Thursday, September 05, 2013 2:58 PM To: dev@cloudstack.apache.org Subject: Re: Template Problem Thanks Soheil. From your description, I just realized that you are working on master branch. You may have mentioned in your earlier email, but I have missed that. In master branch, we reused state column of db table vm_template to indicate whether a template is active or not active, but we missed one place to update this column value for existing template, thus your problem. I have made a commit 072013911703c906ba6af0374d25afb494e74737 to address this issue, verified on my local and worked fine for fresh install env. Can you try again with latest code? -min On 9/5/13 11:43 AM, Soheil Eizadi seiz...@infoblox.com wrote: Hi Min, Your timing is good, today I worked on this setup some more and figured out what is going on with it. I made some changes to it and so it is not exactly what I documented before but the problem is still there. I removed the Secondary Storage from my system and installed a new secondary storage with just the SystemVM template on it, to see if that would fix the problem, but I still had the problem :( If there is a Wiki page on this area that would be helpful, I am slowly coming up to speed looking at the code and becoming more familiar it. The GUI calls list templates with the templatefilter set to all. There is a bunch of logic searching the template based on lots of knobs but mostly it boils down to displaying what is in template_view which before I changed the secondary storage and now with the new secondary storage, only has the ISO in it and that is why it not showing any templates in the GUI. (mysql dump below.) Since I deleted the secondary storage, TemplateServiceImpl detected and reinstalled the tinyLinux image in it, and it is in the Ready state in template_store_ref (mysql dump below.) There was a change to template_view where it only displays items if vm_template.state='Active', the state of the tinyLinux is 'Allocated'. (mysql dump below.) I updated it manually to Active: mysql update vm_template set state='Active' where id=5; This fixed the template_view display to show the tinyLinux in template_view and fixed the GUI. Now the question is why is it not set to Active? May be it was never set to Active as the clause to display based on vm_template.state='Active'; came into the system from schema-420to430.sql. Hope this helps, -Soheil mysql select * from vm_template; +-+-+---+- -++--+-+-+--+- -- ---++-+-+- ---+--+--- +-+---+-+--+-- ---+-+-+-+ +--+--+---+---+--+ -+--+ | id | unique_name | name | uuid | public | featured | type| hvm | bits | url | format | created | removed | account_id | checksum | display_text | enable_password | enable_sshkey | guest_os_id | bootable | prepopulate | cross_zones | extractable | hypervisor_type | source_template_id | template_tag | sort_key | size | state | update_count | updated | dynamically_scalable | +-+-+---+- -++--+-+-+--+- -- ---++-+-+- ---+--+--- +-+---+-+--+-- ---+-+-+-+ +--+--+---+---+--+ -+--+ | 1 | routing-1 | SystemVM Template (XenServer) | db876372-11c1-11e3-b37b-005056aec95c | 0 |0 | SYSTEM | 0 | 32 | http://download.cloud.com/templates/4.2/systemvmtemplate-2013-06-12-master -xen.vhd.bz2 | VHD| 2013-08-30 15:16:46 | NULL| 1 | fb1b6e032a160d86f2c28feb5add6d83 | SystemVM Template (XenServer) | 0 | 0 | 183 |1 | 0 | 1 | 0 | XenServer | NULL | NULL |0 | 276162048
RE: SystemVM downloading
Not just Hyper-V but looks like none of the sytemvm images e.g. Xen/VMware are posted on the site. -Soheil From: Donal Lafferty [donal.laffe...@citrix.com] Sent: Wednesday, September 04, 2013 12:35 PM To: dev@cloudstack.apache.org Subject: SystemVM downloading I thought I'd be able to download systemvmtemplate-2013-09-03-master-hyperv.vhd from http://jenkins.cloudstack.org/view/master/job/build-systemvm-master/ However, I don't see a link to do so. Is systemvmtemplate-2013-09-03-master-hyperv.vhd or other recent copy online anywhere? DL
RE: NetworkElements: configure the provider to enable the provider?
Hi Prasanna, The limitation you have highlighted enable network service providers without actually adding the device is not enforced by the NetworkManager but by the design of the NetworkElement. If you have not registered a device with the Netscaler NetworkElement it is rejecting the Enable. The NetworkManager calls the NetworkElement isReady() and that determines if it is ready to accept the call to Enable. I assume that NetScaler NetworkElement code can not handle subsequent calls to Prepare() etc. unless a device is configured. I assume those other NetworkElements you have highlighted, have chosen to return True on that call, and handle the subsequent calls e.g. Prepare(), when there is not a device, my NetworkElement behaves this way so that it can be enabled early when there is no device. There is a design pattern to enable some Network Elements that offer service to the Physical and Guest network in the call to createPhysicalNetwork() in NetworkServiceImpl: ... // add VirtualRouter as the default network service provider addDefaultVirtualRouterToPhysicalNetwork(pNetwork.getId()); // add security group provider to the physical network addDefaultSecurityGroupProviderToPhysicalNetwork(pNetwork.getId()); // add VPCVirtualRouter as the defualt network service provider addDefaultVpcVirtualRouterToPhysicalNetwork(pNetwork.getId()); // add baremetal as the defualt network service provider addDefaultBaremetalProvidersToPhysicalNetwork(pNetwork.getId()); //Add Internal Load Balancer element as a default network service provider addDefaultInternalLbProviderToPhysicalNetwork(pNetwork.getId()); // add Infoblox as the default network service provider addDefaultInfobloxProvidersToPhysicalNetwork(pNetwork.getId()); -Soheil From: Prasanna Santhanam [t...@apache.org] Sent: Saturday, August 31, 2013 1:36 AM To: CloudStack Dev Subject: NetworkElements: configure the provider to enable the provider? I'm looking to enable network service providers without actually adding the device but it appears as if the addition of the device is coupled with the enabling of the provider. While this is not the case with default providers like VR, VpcVR, security groups and the InternalLbVm? What is the reason for the restriction placed on External NetworkElements? In marvin integration tests [1] we want to be able to enable the provider whilst deployment and later add VPX Netscalers per test but this is not possible since the Netscaler provider cannot be enabled during the deployment of CloudStack. The problem exists with the implementation of other providers as well like JuniperSRX, F5BigIp. Nicira and Midonet however are always ready to be enabled. I tried the following via API: $add networkserviceprovider name=Netscaler physicalnetworkid=0d1a18d5-837e-4973-8b06-ff1f3a8bdbfd The netscaler element is registered successfully but disabled: mysql select id, state, provider_name, physical_network_id from physical_network_service_providers; ++--+---+-+ | id | state| provider_name | physical_network_id | ++--+---+-+ | 1 | Enabled | VirtualRouter | 200 | | 2 | Disabled | SecurityGroupProvider | 200 | | 3 | Enabled | VpcVirtualRouter | 200 | | 4 | Enabled | InternalLbVm | 200 | | 5 | Disabled | Netscaler | 200 | | 6 | Disabled | JuniperSRX| 200 | ++--+---+-+ 6 rows in set (0.00 sec) So I enable it using: $update networkserviceprovider id=1a266697-838a-4322-b894-235bdc158da1 state=Enabled Async job d830d7aa-2a1e-44a4-a736-4885a668e8a6 failed Error 530, Provider is not ready, cannot Enable the provider, please configure the provider first accountid = e31a616a-1212-11e3-8a03-ef159ac306d1 cmd = org.apache.cloudstack.api.command.admin.network.UpdateNetworkServiceProviderCmd created = 2013-08-31T13:58:12+0530 jobid = d830d7aa-2a1e-44a4-a736-4885a668e8a6 jobprocstatus = 0 jobresult: errorcode = 530 errortext = Provider is not ready, cannot Enable the provider, please configure the provider first jobresultcode = 530 jobresulttype = object jobstatus = 2 userid = e31a7560-1212-11e3-8a03-ef159ac306d1 These steps feel counter-intuitive and the error message is a little confusing too. It says I need to configure the provider to enable the provider? [1] https://reviews.apache.org/r/13889/ -- Prasanna., Powered by BigRock.com
RE: documentation/wiki is a mess
Eliminate duplication, recently I updated the wiki about how to install the SystemVM template for development. I found that there are two places where setting up development environment is documented, one was a wiki that I could modify. -Soheil https://cwiki.apache.org/confluence/display/CLOUDSTACK/How+to+build+CloudStack http://cloudstack.apache.org/develop/environment.html From: Chiradeep Vittal [chiradeep.vit...@citrix.com] Sent: Tuesday, September 03, 2013 11:33 AM To: dev@cloudstack.apache.org Subject: Re: documentation/wiki is a mess The wiki is also for users as content gets added between releases as well. But the developer content can certainly be reorganized. On 9/3/13 11:10 AM, Darren Shepherd darren.s.sheph...@gmail.com wrote: The state of documentation and especially the wiki is a mess. I'd like to help clean this up, but I can't seem to reconcile the difference between the XML documentation and the wiki. Personally I feel the wiki should be for development. The XML should be installation and admin guides only. Additionally, another general complaint I have is that features are basically only documented in the 4.x Design Documents sections. This is not very useful and makes it impossible to find anything. Additionally those documents are really more a statement of work. There should be a section for the design of cloudstack, organized into functional areas. So one can actually navigate the design. The state of documentation of an open source projects says a lot about the community that develops it... Darren
RE: Template Problem
It was in the original email, here it is by itself: mysql select * from template_store_ref; ++--+-+-+-++--+++---++---++++---+---+-+--+-+-+ | id | store_id | template_id | created | last_updated| job_id | download_pct | size | store_role | physical_size | download_state | error_str | local_path | install_path | url | state | destroyed | is_copy | update_count | ref_cnt | updated | ++--+-+-+-++--+++---++---++++---+---+-+--+-+-+ | 5 |1 | 1 | 2013-08-28 23:10:50 | 2013-08-29 21:01:19 | NULL | 100 | 2101252608 | Image |2101252608 | DOWNLOADED | NULL | NULL | template/tmpl/1/1/170c3425-6078-479e-8843-3f8fdc02aaf3.vhd | http://download.cloud.com/templates/4.2/systemvmtemplate-2013-06-12-master-xen.vhd.bz2 | Ready | 0 | 0 |0 | 0 | NULL| | 6 |1 | 5 | 2013-08-29 18:16:53 | 2013-08-29 21:01:19 | NULL | 100 | 52428800 | Image | 50430464 | DOWNLOADED | NULL | NULL | template/tmpl/1/5/0911ae22-350f-38f5-ad3e-423e7e5d6539.vhd | http://people.apache.org/~bhaisaab/vms/ttylinux_pv.vhd | Ready | 0 | 0 |0 | 0 | NULL| ++--+-+-+-++--+++---++---++++---+---+-+--+-+-+ 2 rows in set (0.00 sec) From: Chiradeep Vittal [chiradeep.vit...@citrix.com] Sent: Friday, August 30, 2013 9:22 AM To: dev@cloudstack.apache.org Subject: Re: Template Problem Just the contents of template_store_ref On 8/30/13 9:17 AM, Soheil Eizadi seiz...@infoblox.com wrote: Chiradeep, What do you want me to lookup, before I clean up my system? -Soheil From: Wei ZHOU [ustcweiz...@gmail.com] Sent: Thursday, August 29, 2013 3:16 PM To: dev@cloudstack.apache.org Subject: Re: Template Problem Chiradeep, Thanks. I cannot give more information as the environment has been cleaned. Maybe Soheil can. I think it is the same issue. 2013/8/29 Chiradeep Vittal chiradeep.vit...@citrix.com It should be template_store_ref On 8/29/13 2:34 PM, Wei ZHOU ustcweiz...@gmail.com wrote: It is the same issue to what I described in comment of CLOUDSTACK-4459: Wei Zhouhttps://issues.apache.org/jira/secure/ViewProfile.jspa?name=weizhou a dded a comment - 29/Aug/13 22:24 Edison, after I redeploy the environment (clean db, restore devcloud to original, reploydb), the system is up. Th systemvms (ssvm and cpvm) are running and the state are up, but I can not see tinylinux in template list. the template_host_ref table is empty. Wei Zhouhttps://issues.apache.org/jira/secure/ViewProfile.jspa?name=weizhou a dded a comment - 29/Aug/13 23:10 It works well on 4.2-forward branch. 2013/8/29 Soheil Eizadi seiz...@infoblox.com I migrated my development environment to the top of trunk which points to 4.3 now. I created a new CloudStack runtime environment running XenServer 6.2, for my Secondary Store I replicated another NFS Server that has images for preRC CloudStack version 4.2 SystemVM and TinyLinux on it. I have the CS running and it creates the SSVM and it is healthy, but I don't see any Templates in the UI, from the database I would expect to see the tiny Linux and SystemVM Template in the Templates view. I have restarted the management server and the problem is persistent. What is the next steps to debug this further? -Soheil Here is some logs below: From SSVM: /usr/local/cloud/systemvm/ssvm-check.sh First DNS server is 10.48.15.25 PING 10.48.15.25 (10.48.15.25): 56 data bytes 64 bytes from 10.48.15.25: icmp_seq=0 ttl=64 time=1.038 ms 64 bytes from
RE: Template Problem
Chiradeep, What do you want me to lookup, before I clean up my system? -Soheil From: Wei ZHOU [ustcweiz...@gmail.com] Sent: Thursday, August 29, 2013 3:16 PM To: dev@cloudstack.apache.org Subject: Re: Template Problem Chiradeep, Thanks. I cannot give more information as the environment has been cleaned. Maybe Soheil can. I think it is the same issue. 2013/8/29 Chiradeep Vittal chiradeep.vit...@citrix.com It should be template_store_ref On 8/29/13 2:34 PM, Wei ZHOU ustcweiz...@gmail.com wrote: It is the same issue to what I described in comment of CLOUDSTACK-4459: Wei Zhouhttps://issues.apache.org/jira/secure/ViewProfile.jspa?name=weizhou a dded a comment - 29/Aug/13 22:24 Edison, after I redeploy the environment (clean db, restore devcloud to original, reploydb), the system is up. Th systemvms (ssvm and cpvm) are running and the state are up, but I can not see tinylinux in template list. the template_host_ref table is empty. Wei Zhouhttps://issues.apache.org/jira/secure/ViewProfile.jspa?name=weizhou a dded a comment - 29/Aug/13 23:10 It works well on 4.2-forward branch. 2013/8/29 Soheil Eizadi seiz...@infoblox.com I migrated my development environment to the top of trunk which points to 4.3 now. I created a new CloudStack runtime environment running XenServer 6.2, for my Secondary Store I replicated another NFS Server that has images for preRC CloudStack version 4.2 SystemVM and TinyLinux on it. I have the CS running and it creates the SSVM and it is healthy, but I don't see any Templates in the UI, from the database I would expect to see the tiny Linux and SystemVM Template in the Templates view. I have restarted the management server and the problem is persistent. What is the next steps to debug this further? -Soheil Here is some logs below: From SSVM: /usr/local/cloud/systemvm/ssvm-check.sh First DNS server is 10.48.15.25 PING 10.48.15.25 (10.48.15.25): 56 data bytes 64 bytes from 10.48.15.25: icmp_seq=0 ttl=64 time=1.038 ms 64 bytes from 10.48.15.25: icmp_seq=1 ttl=64 time=0.359 ms --- 10.48.15.25 ping statistics --- 2 packets transmitted, 2 packets received, 0% packet loss round-trip min/avg/max/stddev = 0.359/0.699/1.038/0.340 ms Good: Can ping DNS server Good: DNS resolves download.cloud.com NFS is currently mounted Mount point is /mnt/SecStorage/3667905e-f9c2-388e-a8c6-112cb96a98a9 Good: Can write to mount point Management server is 10.48.15.10. Checking connectivity. Good: Can connect to management server port 8250 Good: Java process is running Tests Complete. Look for ERROR or WARNING above. From MS log: WARN [c.c.c.ClusterManagerImpl] (Cluster-Notification-1:null) Notifying management server join event took 21 ms INFO [c.c.n.s.SecurityGroupListener] (AgentConnectTaskPool-2:ctx-b401ef43) Received a host startup notification INFO [o.a.c.s.i.TemplateServiceImpl] (AgentConnectTaskPool-2:ctx-b401ef43) Template Sync found routing-1 already in the image store INFO [o.a.c.s.i.TemplateServiceImpl] (AgentConnectTaskPool-2:ctx-b401ef43) Template Sync did not find routing-3 on image store 1, may request download based on available hypervisor types INFO [o.a.c.s.i.TemplateServiceImpl] (AgentConnectTaskPool-2:ctx-b401ef43) Template Sync did not find centos55-x86_64 on image store 1, may request download based on available hypervisor types INFO [o.a.c.s.i.TemplateServiceImpl] (AgentConnectTaskPool-2:ctx-b401ef43) Template Sync found tiny Linux already in the image store INFO [o.a.c.s.i.TemplateServiceImpl] (AgentConnectTaskPool-2:ctx-b401ef43) Template Sync did not find centos53-x64 on image store 1, may request download based on available hypervisor types INFO [o.a.c.s.i.TemplateServiceImpl] (AgentConnectTaskPool-2:ctx-b401ef43) Template Sync did not find routing-8 on image store 1, may request download based on available hypervisor types INFO [o.a.c.s.i.TemplateServiceImpl] (AgentConnectTaskPool-2:ctx-b401ef43) Template Sync did not find routing-9 on image store 1, may request download based on available hypervisor types INFO [o.a.c.s.i.TemplateServiceImpl] (AgentConnectTaskPool-2:ctx-b401ef43) Template Sync did not find routing-10 on image store 1, may request download based on available hypervisor types INFO [o.a.c.s.i.TemplateServiceImpl] (AgentConnectTaskPool-2:ctx-b401ef43) Skip downloading template routing-10 since current data center does not have hypervisor LXC INFO [o.a.c.s.i.TemplateServiceImpl] (AgentConnectTaskPool-2:ctx-b401ef43) Skip
RE: Add network offering UI problem
OK, logged a bug for it: https://issues.apache.org/jira/browse/CLOUDSTACK-4558 I can recreate it on Safari as well, but could not reproduce it on Win7 with IE. -Soheil From: Marty Sweet [msweet@gmail.com] Sent: Wednesday, August 28, 2013 4:02 PM To: dev@cloudstack.apache.org Subject: Re: Add network offering UI problem Yes, it would be worth logging a bug. It would also be good if you could test on some more browsers, if they all are affected then it should be an easy fix :) Marty On Wednesday, August 28, 2013, Soheil Eizadi wrote: I mis-typed removed I have not, below From: Soheil Eizadi [seiz...@infoblox.com javascript:;] Sent: Wednesday, August 28, 2013 3:16 PM To: dev@cloudstack.apache.org javascript:; Subject: Add network offering UI problem I have an operlapping window problem on a Modal Dialog box that is shown. The problem happens on FireFox and Chrome. The window overlaps only if you create two offerings back to back. I create one, enable service and go back and create another one and I have the problem. I have seen this UI problem when I was working on 4.2 and now that I have merged to the latest trunk on 4.3, I still see this problem. Should I log a JIRA Bug request, the snapshot showing problem below: Screen%20Shot%202013 08 28%20at%209.46.29%20AM.png | opencloudstackhttps://sites.google.com/site/opencloudstack/_/rsrc/1377725503233/home/Screen%20Shot%202013-08-28%20at%209.46.29%20AM.png -Soheil
Template Problem
I migrated my development environment to the top of trunk which points to 4.3 now. I created a new CloudStack runtime environment running XenServer 6.2, for my Secondary Store I replicated another NFS Server that has images for preRC CloudStack version 4.2 SystemVM and TinyLinux on it. I have the CS running and it creates the SSVM and it is healthy, but I don't see any Templates in the UI, from the database I would expect to see the tiny Linux and SystemVM Template in the Templates view. I have restarted the management server and the problem is persistent. What is the next steps to debug this further? -Soheil Here is some logs below: From SSVM: /usr/local/cloud/systemvm/ssvm-check.sh First DNS server is 10.48.15.25 PING 10.48.15.25 (10.48.15.25): 56 data bytes 64 bytes from 10.48.15.25: icmp_seq=0 ttl=64 time=1.038 ms 64 bytes from 10.48.15.25: icmp_seq=1 ttl=64 time=0.359 ms --- 10.48.15.25 ping statistics --- 2 packets transmitted, 2 packets received, 0% packet loss round-trip min/avg/max/stddev = 0.359/0.699/1.038/0.340 ms Good: Can ping DNS server Good: DNS resolves download.cloud.com NFS is currently mounted Mount point is /mnt/SecStorage/3667905e-f9c2-388e-a8c6-112cb96a98a9 Good: Can write to mount point Management server is 10.48.15.10. Checking connectivity. Good: Can connect to management server port 8250 Good: Java process is running Tests Complete. Look for ERROR or WARNING above. From MS log: WARN [c.c.c.ClusterManagerImpl] (Cluster-Notification-1:null) Notifying management server join event took 21 ms INFO [c.c.n.s.SecurityGroupListener] (AgentConnectTaskPool-2:ctx-b401ef43) Received a host startup notification INFO [o.a.c.s.i.TemplateServiceImpl] (AgentConnectTaskPool-2:ctx-b401ef43) Template Sync found routing-1 already in the image store INFO [o.a.c.s.i.TemplateServiceImpl] (AgentConnectTaskPool-2:ctx-b401ef43) Template Sync did not find routing-3 on image store 1, may request download based on available hypervisor types INFO [o.a.c.s.i.TemplateServiceImpl] (AgentConnectTaskPool-2:ctx-b401ef43) Template Sync did not find centos55-x86_64 on image store 1, may request download based on available hypervisor types INFO [o.a.c.s.i.TemplateServiceImpl] (AgentConnectTaskPool-2:ctx-b401ef43) Template Sync found tiny Linux already in the image store INFO [o.a.c.s.i.TemplateServiceImpl] (AgentConnectTaskPool-2:ctx-b401ef43) Template Sync did not find centos53-x64 on image store 1, may request download based on available hypervisor types INFO [o.a.c.s.i.TemplateServiceImpl] (AgentConnectTaskPool-2:ctx-b401ef43) Template Sync did not find routing-8 on image store 1, may request download based on available hypervisor types INFO [o.a.c.s.i.TemplateServiceImpl] (AgentConnectTaskPool-2:ctx-b401ef43) Template Sync did not find routing-9 on image store 1, may request download based on available hypervisor types INFO [o.a.c.s.i.TemplateServiceImpl] (AgentConnectTaskPool-2:ctx-b401ef43) Template Sync did not find routing-10 on image store 1, may request download based on available hypervisor types INFO [o.a.c.s.i.TemplateServiceImpl] (AgentConnectTaskPool-2:ctx-b401ef43) Skip downloading template routing-10 since current data center does not have hypervisor LXC INFO [o.a.c.s.i.TemplateServiceImpl] (AgentConnectTaskPool-2:ctx-b401ef43) Skip downloading template routing-9 since current data center does not have hypervisor Hyperv INFO [o.a.c.s.i.TemplateServiceImpl] (AgentConnectTaskPool-2:ctx-b401ef43) Skip downloading template routing-8 since current data center does not have hypervisor VMware INFO [o.a.c.s.i.TemplateServiceImpl] (AgentConnectTaskPool-2:ctx-b401ef43) Skip downloading template routing-3 since current data center does not have hypervisor KVM INFO [o.a.c.s.i.TemplateServiceImpl] (AgentConnectTaskPool-2:ctx-b401ef43) Skip downloading template centos53-x64 since current data center does not have hypervisor VMware INFO [o.a.c.s.i.TemplateServiceImpl] (AgentConnectTaskPool-2:ctx-b401ef43) Skip downloading template centos55-x86_64 since current data center does not have hypervisor KVM INFO [c.c.c.AgentHookBase] (AgentConnectTaskPool-1:ctx-81d176bd) Successfully sent out command to start HTTP handling in console proxy agent INFO [c.c.a.m.AgentManagerImpl] (ClusteredAgentManager Timer:null) Could not to find a Discoverer to load the resource: 2 for hypervisor type: null INFO [c.c.a.m.DirectAgentAttache] (AgentTaskPool-2:ctx-0f928c9f) StartupAnswer received 2 Interval = 60 INFO [c.c.n.s.SecurityGroupListener] (AgentTaskPool-2:ctx-0f928c9f) Received a host startup notification INFO [c.c.h.x.r.CitrixResourceBase] (AgentTaskPool-1:ctx-36b7c165) Private
Add network offering UI problem
I have an operlapping window problem on a Modal Dialog box that is shown. The problem happens on FireFox and Chrome. The window overlaps only if you create two offerings back to back. I create one, enable service and go back and create another one and I have the problem. I have not I have seen this UI problem when I was working on 4.2 and now that I have merged to the latest trunk on 4.3, I still see this problem. Should I log a JIRA Bug request, the snapshot showing problem below: https://sites.google.com/site/opencloudstack/_/rsrc/1377725503233/home/Screen%20Shot%202013-08-28%20at%209.46.29%20AM.png -Soheil
RE: Unable to create link local network exception
Yes missing . :) The Blog post you wrote was a good. We need something like that and the Citrix post in the Wiki and may be for each vendor plugin we can update their special logging requirements. Right now the focus in on the Hypervisors but as we get more Storage and Networking solutions integrated, we need instructions on how to isolate issues related to those as well. -Soheil From: Donal Lafferty [donal.laffe...@citrix.com] Sent: Wednesday, August 14, 2013 3:47 AM To: dev@cloudstack.apache.org Subject: RE: Unable to create link local network exception Strictly speaking, it's SMlog (no '.') -Original Message- From: Soheil Eizadi [mailto:seiz...@infoblox.com] Sent: 14 August 2013 02:21 To: dev@cloudstack.apache.org Subject: RE: Unable to create link local network exception Hi Mike, Check the SM.log on the XenServer and see if you get more information why the request failed. -Soheil From: Mike Tutkowski [mike.tutkow...@solidfire.com] Sent: Tuesday, August 13, 2013 2:54 PM To: dev@cloudstack.apache.org Subject: Unable to create link local network exception Hi, I get the following exception when trying to add a 6.1 XenServer host into a cluster in 4.2. The host starts out in the Alert state, but quickly changes over to the Up state. Any thoughts on this? Thanks! WARN [xen.resource.CitrixResourceBase] (DirectAgent-37:) Unable to create local link network The server failed to handle your request, due to an internal error. The given message may give details useful for debugging the problem. at com.xensource.xenapi.Types.checkResponse(Types.java:1694) at com.xensource.xenapi.Connection.dispatch(Connection.java:368) at com.cloud.hypervisor.xen.resource.XenServerConnectionPool$XenServerCo nnection.dispatch(XenServerConnectionPool.java:909) at com.xensource.xenapi.VIF.plug(VIF.java:846) at com.cloud.hypervisor.xen.resource.CitrixResourceBase.setupLinkLocalNetw ork(CitrixResourceBase.java:4848) at com.cloud.hypervisor.xen.resource.CitrixResourceBase.execute(CitrixResou rceBase.java:3368) at com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(Citr ixResourceBase.java:487) at com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest( XenServer56Resource.java:73) at com.cloud.hypervisor.xen.resource.XenServer610Resource.executeRequest (XenServer610Resource.java:104) at com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache .java:186) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) at java.util.concurrent.FutureTask.run(FutureTask.java:138) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.ac cess$301(ScheduledThreadPoolExecutor.java:98) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.ru n(ScheduledThreadPoolExecutor.java:206) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecut or.java:895) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.ja va:918) at java.lang.Thread.run(Thread.java:680) WARN [agent.manager.DirectAgentAttache] (DirectAgent-37:) Seq 4-1553137671: Exception Caught while executing command com.cloud.utils.exception.CloudRuntimeException: Unable to create local link network due to The server failed to handle your request, due to an internal error. The given message may give details useful for debugging the problem. at com.cloud.hypervisor.xen.resource.CitrixResourceBase.setupLinkLocalNetw ork(CitrixResourceBase.java:4862) at com.cloud.hypervisor.xen.resource.CitrixResourceBase.execute(CitrixResou rceBase.java:3368) at com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(Citr ixResourceBase.java:487) at com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest( XenServer56Resource.java:73) at com.cloud.hypervisor.xen.resource.XenServer610Resource.executeRequest (XenServer610Resource.java:104) at com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache .java:186) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) at java.util.concurrent.FutureTask.run(FutureTask.java:138) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.ac cess$301(ScheduledThreadPoolExecutor.java:98) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.ru n(ScheduledThreadPoolExecutor.java:206) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecut or.java:895) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.ja va:918) at java.lang.Thread.run(Thread.java:680) Caused by: The server failed to handle your request, due to an internal error. The given message may give details useful
RE: Unable to create link local network exception
Hi Mike, Check the SM.log on the XenServer and see if you get more information why the request failed. -Soheil From: Mike Tutkowski [mike.tutkow...@solidfire.com] Sent: Tuesday, August 13, 2013 2:54 PM To: dev@cloudstack.apache.org Subject: Unable to create link local network exception Hi, I get the following exception when trying to add a 6.1 XenServer host into a cluster in 4.2. The host starts out in the Alert state, but quickly changes over to the Up state. Any thoughts on this? Thanks! WARN [xen.resource.CitrixResourceBase] (DirectAgent-37:) Unable to create local link network The server failed to handle your request, due to an internal error. The given message may give details useful for debugging the problem. at com.xensource.xenapi.Types.checkResponse(Types.java:1694) at com.xensource.xenapi.Connection.dispatch(Connection.java:368) at com.cloud.hypervisor.xen.resource.XenServerConnectionPool$XenServerConnection.dispatch(XenServerConnectionPool.java:909) at com.xensource.xenapi.VIF.plug(VIF.java:846) at com.cloud.hypervisor.xen.resource.CitrixResourceBase.setupLinkLocalNetwork(CitrixResourceBase.java:4848) at com.cloud.hypervisor.xen.resource.CitrixResourceBase.execute(CitrixResourceBase.java:3368) at com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:487) at com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:73) at com.cloud.hypervisor.xen.resource.XenServer610Resource.executeRequest(XenServer610Resource.java:104) at com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.java:186) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) at java.util.concurrent.FutureTask.run(FutureTask.java:138) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:98) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:206) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918) at java.lang.Thread.run(Thread.java:680) WARN [agent.manager.DirectAgentAttache] (DirectAgent-37:) Seq 4-1553137671: Exception Caught while executing command com.cloud.utils.exception.CloudRuntimeException: Unable to create local link network due to The server failed to handle your request, due to an internal error. The given message may give details useful for debugging the problem. at com.cloud.hypervisor.xen.resource.CitrixResourceBase.setupLinkLocalNetwork(CitrixResourceBase.java:4862) at com.cloud.hypervisor.xen.resource.CitrixResourceBase.execute(CitrixResourceBase.java:3368) at com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:487) at com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:73) at com.cloud.hypervisor.xen.resource.XenServer610Resource.executeRequest(XenServer610Resource.java:104) at com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.java:186) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) at java.util.concurrent.FutureTask.run(FutureTask.java:138) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:98) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:206) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918) at java.lang.Thread.run(Thread.java:680) Caused by: The server failed to handle your request, due to an internal error. The given message may give details useful for debugging the problem. at com.xensource.xenapi.Types.checkResponse(Types.java:1694) at com.xensource.xenapi.Connection.dispatch(Connection.java:368) at com.cloud.hypervisor.xen.resource.XenServerConnectionPool$XenServerConnection.dispatch(XenServerConnectionPool.java:909) at com.xensource.xenapi.VIF.plug(VIF.java:846) at com.cloud.hypervisor.xen.resource.CitrixResourceBase.setupLinkLocalNetwork(CitrixResourceBase.java:4848) ... 13 more -- *Mike Tutkowski* *Senior CloudStack Developer, SolidFire Inc.* e: mike.tutkow...@solidfire.com o: 303.746.7302 Advancing the way the world uses the cloudhttp://solidfire.com/solution/overview/?video=play *™*
RE: Quick Question about System VM problem
I seem to remember that the command line options were different and there are calls had explicit hard coded path to /usr/bin/vhd-util that were failing if I placed the new vhd-util in that location. When we bring a new XenServer online and download to /opt/xensource, I don't think we remove the old vhd-util, so I thought this was by design meant to work this way. -Soheil From: Sanjay Tripathi [sanjay.tripa...@citrix.com] Sent: Thursday, August 08, 2013 11:36 PM To: dev@cloudstack.apache.org Subject: RE: Quick Question about System VM problem I don't think you need two versions of vhd-util. If you are adding new XenServer host, just you need to copy the existing vhd-util from /usr/sbin to its correct locations and it works fine. Can you share what are the issues you are getting if you use the existing vhd-util in XenServer host. --Sanjay -Original Message- From: Soheil Eizadi [mailto:seiz...@infoblox.com] Sent: Friday, August 09, 2013 11:37 AM To: dev@cloudstack.apache.org Subject: RE: Quick Question about System VM problem My experience was that you had to keep two versions of it on the XenServer, the original one (/usr/sbin/vhd-util) and download a new one that ends up in /opt/xensource/bin/vhd-util -Soheil From: Prasanna Santhanam [t...@apache.org] Sent: Thursday, August 08, 2013 9:22 PM To: dev@cloudstack.apache.org Subject: Re: Quick Question about System VM problem On Thu, Aug 08, 2013 at 10:25:28PM +, Donal Lafferty wrote: There's a tag that is applied to you XenServer. AFAIK, the tag tells the management server not to download systemvm.iso Also, be careful not to overwrite the vhd-utils on a XenServer version 6.x and beyond. The vhd-util mentioned on the build from master page does not work with new versions of XenServer. It should be updated soon. What is the issue with the vhd-util on download.cloud.com? Can you please file a bug? I've been using the vhd-util on download.cloud.com and haven't faced any issues with my Xen 6.0.2 hosts. -- Prasanna., Powered by BigRock.com
RE: IP Address Allocation
I think this is a consensus of where we are: We would follow the path of NetworkElement meaning the infrastructure to create a service offering, the provider concept and the use of agent/host infrastructure to support external providers. (The external NetworkGuru also uses many of the same infrastructure.) This would allow developing a plugin, if needed that could provide in addition to NetworkElement and NetworkGuru features the new External IP Address Allocation capability. The points Alex made was to complete the work in the NetworkManager and refactor out the IP Address Allocation out into a unique class that can be called by NetworkGurus directly rather than using the NetworkManager. This new Class would have logic to call to the external IP Address Providers or use internal database to provide allocation. I hope I captured the essence of where we are with this? -Soheil From: Murali Reddy [murali.re...@citrix.com] Sent: Wednesday, August 07, 2013 7:43 AM To: dev@cloudstack.apache.org Subject: Re: IP Address Allocation On 07/08/13 1:40 AM, Alex Huang alex.hu...@citrix.com wrote: I'll say it's a bad design. He he I designed it. :( We had to make some compromises due to time constraints. I always intended to move the ip allocation into NetworkGurus and actually attempted to several times but, at the end for various reasons, we just couldn't complete that task. I generally believe that ip address allocation can actually be done even without CloudStack's database, for example, if it came from a master dhcp server or some IT central database. So an interface like IpAddressReserver to abstract that functionality would be great. I have to say the number of implementations for NetworkGuru grew faster than I expected. In one sense, it's a good sign that everyone was able to use it but then it exposes the work that was incomplete to begin with. IIRC, there's basically two problems I left on NetworkGuru to be better designed. One is this ip address allocation. The other problem is how to identify which set of NetworkGurus should manage the network. I believe that selection process should be much more transparent to the administrator who setup the CS deployment but because at the time only VLAN isolation was supported, I did not put that into CS. As more and more SDN technologies come online, it's best we design that process. Can we follow the path of NetworkElement which was once a single base class implementing all service abstractions to set of derived interfaces for each service (DhcpServiceProvider, LoadBalancingServiceProvider etc). With this approach a network element can just implement the service it want to provide. Current guru implementation are tightly coupled with each other. For e.g Midonet, Nicira guru implement the network design for their isolation and for the rest of the functionality they fall back on Guest network guru. Perhaps we can split the abstraction of network guru into multiple derived interface specific to each function like isolation, network design, ip address management. So if Infoblox guru just want to provide IPAM, then it can just focus on it with out the knowledge of other functions of network guru. I think Hugo made some changes there but I haven't had a chance to study how that all works now in 4.x yet. There are some artifacts in the code to show I was thinking about this. For example, Network and Nic carries the Isolation URI instead of just VLAN tag because it was intended to be cast by the NetworkGuru and then transported to the hypervisor. We expected anyone who plugs into CloudStack have two places to plug into: orchestration and actual provisioning. So the NetworkGuru forms the URI for isolation and then it has code at the hypervisor side to resolve the URI to something that the hypervisor can understand. --Alex -Original Message- From: Soheil Eizadi [mailto:seiz...@infoblox.com] Sent: Tuesday, August 6, 2013 11:54 AM To: dev@cloudstack.apache.org Subject: RE: IP Address Allocation Agree that the IP Address allocation is different than the DHCP and DNS service offered by the NetworkElements. The third party NetworkGurus just reference the standard NetworkManager IP Address Allocation routines, either directly (e.g. _networkMgr.assignPublicIpAddress()) or by calling out to the GuestNetworkGuru. I would say in the current design the Network Manager manages the IP Addresses not the Network Gurus. I don't think this is a bad design, in that the NetworkGurus are sharing the same ip address allocation and get new features (e.g. IP reservation or VM migration) without implementing new code to support them. -Soheil From: Alex Huang [alex.hu...@citrix.com] Sent: Tuesday, August 06, 2013 11:27 AM To: Chiradeep Vittal; dev@cloudstack.apache.org Subject: RE: IP Address Allocation We can either break NetworkManager down
RE: Question about creating a template
Hi Mike, The problem is with handling the command org.apache.cloudstack.storage.command.CopyCommand, look at the log before this error and see if there is any problem with the registered agent that is suppose to handle this command. -Soheil From: Mike Tutkowski [mike.tutkow...@solidfire.com] Sent: Tuesday, August 06, 2013 11:28 AM To: dev@cloudstack.apache.org Subject: Question about creating a template Hi, I have a small Linux ISO (http://www.damnsmalllinux.org/download.html) I've uploaded to my secondary storage NFS location. I can create VM instances just fine with it. I stopped one of my VMs that was created with this ISO and tried to create a template from its root disk. I received the following exception and was wondering what people's comments might be. Thanks! ERROR [cloud.async.AsyncJobManagerImpl] (Job-Executor-8:job-41 = [ 583f08f2-e32a-4d16-815a-2ac2953d2ae9 ]) Unexpected exception while executing org.apache.cloudstack.api.command.user.template.CreateTemplateCmd com.cloud.utils.exception.CloudRuntimeException: Failed to create templateUnsupported command issued:org.apache.cloudstack.storage.command.CopyCommand. Are you sure you got the right type of server? at com.cloud.template.TemplateManagerImpl.createPrivateTemplate(TemplateManagerImpl.java:1368) at com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125) at org.apache.cloudstack.api.command.user.template.CreateTemplateCmd.execute(CreateTemplateCmd.java:263) at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:158) at com.cloud.async.AsyncJobManagerImpl$1.run(AsyncJobManagerImpl.java:531) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) at java.util.concurrent.FutureTask.run(FutureTask.java:138) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918) at java.lang.Thread.run(Thread.java:680) -- *Mike Tutkowski* *Senior CloudStack Developer, SolidFire Inc.* e: mike.tutkow...@solidfire.com o: 303.746.7302 Advancing the way the world uses the cloudhttp://solidfire.com/solution/overview/?video=play *™*
RE: IP Address Allocation
Agree that the IP Address allocation is different than the DHCP and DNS service offered by the NetworkElements. The third party NetworkGurus just reference the standard NetworkManager IP Address Allocation routines, either directly (e.g. _networkMgr.assignPublicIpAddress()) or by calling out to the GuestNetworkGuru. I would say in the current design the Network Manager manages the IP Addresses not the Network Gurus. I don't think this is a bad design, in that the NetworkGurus are sharing the same ip address allocation and get new features (e.g. IP reservation or VM migration) without implementing new code to support them. -Soheil From: Alex Huang [alex.hu...@citrix.com] Sent: Tuesday, August 06, 2013 11:27 AM To: Chiradeep Vittal; dev@cloudstack.apache.org Subject: RE: IP Address Allocation We can either break NetworkManager down further and say NetworkGuru sets the actual parameters of the network and a new IpAddressReserver sets the ip address or we can let NetworkGurus identify the IpAddressReserver to use themselves. I generally think NetworkManager shouldn't care where the ip address came from because it really shouldn't know anything about the actual network we're laying out for the end user. That's always been left to the NetworkGurus. If you think about it from that perspective, then it's natural that ip address is allocated by the NetworkGuru. But I can see different NetworkGurus may want to share the same ip address allocation tables/schemes so an interface for them to share that code does make sense. Note there's a difference between allocating ip address and the act of actually issuing the ip address and associating the ip address to a fqdn. That act is performed by the network elements. Here we're specifically saying who is responsible for figuring out the ip address that can be allocated to a particular vm and works within a network. --Alex -Original Message- From: Chiradeep Vittal Sent: Tuesday, August 6, 2013 11:14 AM To: dev@cloudstack.apache.org Cc: Alex Huang Subject: Re: IP Address Allocation The way the gurus are consulted for network design and reservation makes it difficult to put this inside a guru. However it does seem odd to put this inside an element. Perhaps we need a 3rd type (IpAddressReserver?) On 8/6/13 10:42 AM, Soheil Eizadi seiz...@infoblox.com wrote: The NetworkGuru does a lot more than IP address allocation, e.g. handle the Layer2/3 networking unique to the particular vendor. There are a lot of NetworkElements providing their own NetworkGuru plugins (Nicira, MidoNet, ...) extending the standard CloudStack Gurus. The feature of providing IP Address Allocation, DHCP and DNS is common for all these networks, so rather than provide our own Guru the proposed design would allow the above functions to coexist with existing Gurus. -Soheil From: Murali Reddy [murali.re...@citrix.com] Sent: Tuesday, August 06, 2013 3:24 AM To: dev@cloudstack.apache.org Subject: Re: IP Address Allocation On 06/08/13 8:59 AM, Soheil Eizadi seiz...@infoblox.com wrote: One way to achieve this behavior is to have a call out in prepareNic() to the NetworkElements before the call to the NetworkGuru allowing the NetworkElement to update the Nic Profile. In this use case the Network Element would suggest an IP Address. In the use case below the IP Address would be updated by the NetworkElement. There is logic in getIp(), the current IP Allocation that handles the case where the Nic Profile already has an IP Address. This needs to be updated to handle this new use case. The current use case assume that the VM had already been prepared once and has an IP Address allocated that could be reused. Does anyone see a problem with this approach? Purpose of Guru (to design the network) and Element (implement the network) are different. Right way would be for your plug-in to implement both network Guru and element and let the guru do the IP address allocation. -Soheil From: Soheil Eizadi [seiz...@infoblox.com] Sent: Monday, August 05, 2013 2:35 PM To: dev@cloudstack.apache.org Subject: IP Address Allocation I am trying to figure out what would be the proper way for a Plugin to interact with the CloudStack VM deployment and provide an authoritative IP Address from its database versus the local CloudStack database. It looks like the NetworkElements are not presented an opportunity to provide an IP Address and you must develop a NetworkGuru to provide this function. There is some customization of the IP Address designed into the Secondary NICs (see allocateGuestIP()). -Soheil
RE: IP Address Allocation
It is more a function of the networks that are managed, so any VM including SystemVMs would be managed. It would apply to both Public and Guest Networks. -Soheil From: Musayev, Ilya [imusa...@webmd.net] Sent: Tuesday, August 06, 2013 11:49 AM To: dev@cloudstack.apache.org Subject: RE: IP Address Allocation Can this be done on system VMs as well? I see that its targeted for the guests, if there is a way to abstract and apply ip address on any component - it would certainly make ACS much more flexible than it is now. -Original Message- From: Soheil Eizadi [mailto:seiz...@infoblox.com] Sent: Tuesday, August 06, 2013 2:29 PM To: dev@cloudstack.apache.org Subject: RE: IP Address Allocation We can define a third type of element for IP Address Allocation, let me look at the code and see is there is standard base class that it can extend or we have to come up with a new base class like we have for NetworkElements. -Soheil From: Chiradeep Vittal [chiradeep.vit...@citrix.com] Sent: Tuesday, August 06, 2013 11:14 AM To: dev@cloudstack.apache.org Cc: Alex Huang Subject: Re: IP Address Allocation The way the gurus are consulted for network design and reservation makes it difficult to put this inside a guru. However it does seem odd to put this inside an element. Perhaps we need a 3rd type (IpAddressReserver?) On 8/6/13 10:42 AM, Soheil Eizadi seiz...@infoblox.com wrote: The NetworkGuru does a lot more than IP address allocation, e.g. handle the Layer2/3 networking unique to the particular vendor. There are a lot of NetworkElements providing their own NetworkGuru plugins (Nicira, MidoNet, ...) extending the standard CloudStack Gurus. The feature of providing IP Address Allocation, DHCP and DNS is common for all these networks, so rather than provide our own Guru the proposed design would allow the above functions to coexist with existing Gurus. -Soheil From: Murali Reddy [murali.re...@citrix.com] Sent: Tuesday, August 06, 2013 3:24 AM To: dev@cloudstack.apache.org Subject: Re: IP Address Allocation On 06/08/13 8:59 AM, Soheil Eizadi seiz...@infoblox.com wrote: One way to achieve this behavior is to have a call out in prepareNic() to the NetworkElements before the call to the NetworkGuru allowing the NetworkElement to update the Nic Profile. In this use case the Network Element would suggest an IP Address. In the use case below the IP Address would be updated by the NetworkElement. There is logic in getIp(), the current IP Allocation that handles the case where the Nic Profile already has an IP Address. This needs to be updated to handle this new use case. The current use case assume that the VM had already been prepared once and has an IP Address allocated that could be reused. Does anyone see a problem with this approach? Purpose of Guru (to design the network) and Element (implement the network) are different. Right way would be for your plug-in to implement both network Guru and element and let the guru do the IP address allocation. -Soheil From: Soheil Eizadi [seiz...@infoblox.com] Sent: Monday, August 05, 2013 2:35 PM To: dev@cloudstack.apache.org Subject: IP Address Allocation I am trying to figure out what would be the proper way for a Plugin to interact with the CloudStack VM deployment and provide an authoritative IP Address from its database versus the local CloudStack database. It looks like the NetworkElements are not presented an opportunity to provide an IP Address and you must develop a NetworkGuru to provide this function. There is some customization of the IP Address designed into the Secondary NICs (see allocateGuestIP()). -Soheil
RE: IP Address Allocation
The NetworkGuru does a lot more than IP address allocation, e.g. handle the Layer2/3 networking unique to the particular vendor. There are a lot of NetworkElements providing their own NetworkGuru plugins (Nicira, MidoNet, ...) extending the standard CloudStack Gurus. The feature of providing IP Address Allocation, DHCP and DNS is common for all these networks, so rather than provide our own Guru the proposed design would allow the above functions to coexist with existing Gurus. -Soheil From: Murali Reddy [murali.re...@citrix.com] Sent: Tuesday, August 06, 2013 3:24 AM To: dev@cloudstack.apache.org Subject: Re: IP Address Allocation On 06/08/13 8:59 AM, Soheil Eizadi seiz...@infoblox.com wrote: One way to achieve this behavior is to have a call out in prepareNic() to the NetworkElements before the call to the NetworkGuru allowing the NetworkElement to update the Nic Profile. In this use case the Network Element would suggest an IP Address. In the use case below the IP Address would be updated by the NetworkElement. There is logic in getIp(), the current IP Allocation that handles the case where the Nic Profile already has an IP Address. This needs to be updated to handle this new use case. The current use case assume that the VM had already been prepared once and has an IP Address allocated that could be reused. Does anyone see a problem with this approach? Purpose of Guru (to design the network) and Element (implement the network) are different. Right way would be for your plug-in to implement both network Guru and element and let the guru do the IP address allocation. -Soheil From: Soheil Eizadi [seiz...@infoblox.com] Sent: Monday, August 05, 2013 2:35 PM To: dev@cloudstack.apache.org Subject: IP Address Allocation I am trying to figure out what would be the proper way for a Plugin to interact with the CloudStack VM deployment and provide an authoritative IP Address from its database versus the local CloudStack database. It looks like the NetworkElements are not presented an opportunity to provide an IP Address and you must develop a NetworkGuru to provide this function. There is some customization of the IP Address designed into the Secondary NICs (see allocateGuestIP()). -Soheil
RE: IP Address Allocation
We can define a third type of element for IP Address Allocation, let me look at the code and see is there is standard base class that it can extend or we have to come up with a new base class like we have for NetworkElements. -Soheil From: Chiradeep Vittal [chiradeep.vit...@citrix.com] Sent: Tuesday, August 06, 2013 11:14 AM To: dev@cloudstack.apache.org Cc: Alex Huang Subject: Re: IP Address Allocation The way the gurus are consulted for network design and reservation makes it difficult to put this inside a guru. However it does seem odd to put this inside an element. Perhaps we need a 3rd type (IpAddressReserver?) On 8/6/13 10:42 AM, Soheil Eizadi seiz...@infoblox.com wrote: The NetworkGuru does a lot more than IP address allocation, e.g. handle the Layer2/3 networking unique to the particular vendor. There are a lot of NetworkElements providing their own NetworkGuru plugins (Nicira, MidoNet, ...) extending the standard CloudStack Gurus. The feature of providing IP Address Allocation, DHCP and DNS is common for all these networks, so rather than provide our own Guru the proposed design would allow the above functions to coexist with existing Gurus. -Soheil From: Murali Reddy [murali.re...@citrix.com] Sent: Tuesday, August 06, 2013 3:24 AM To: dev@cloudstack.apache.org Subject: Re: IP Address Allocation On 06/08/13 8:59 AM, Soheil Eizadi seiz...@infoblox.com wrote: One way to achieve this behavior is to have a call out in prepareNic() to the NetworkElements before the call to the NetworkGuru allowing the NetworkElement to update the Nic Profile. In this use case the Network Element would suggest an IP Address. In the use case below the IP Address would be updated by the NetworkElement. There is logic in getIp(), the current IP Allocation that handles the case where the Nic Profile already has an IP Address. This needs to be updated to handle this new use case. The current use case assume that the VM had already been prepared once and has an IP Address allocated that could be reused. Does anyone see a problem with this approach? Purpose of Guru (to design the network) and Element (implement the network) are different. Right way would be for your plug-in to implement both network Guru and element and let the guru do the IP address allocation. -Soheil From: Soheil Eizadi [seiz...@infoblox.com] Sent: Monday, August 05, 2013 2:35 PM To: dev@cloudstack.apache.org Subject: IP Address Allocation I am trying to figure out what would be the proper way for a Plugin to interact with the CloudStack VM deployment and provide an authoritative IP Address from its database versus the local CloudStack database. It looks like the NetworkElements are not presented an opportunity to provide an IP Address and you must develop a NetworkGuru to provide this function. There is some customization of the IP Address designed into the Secondary NICs (see allocateGuestIP()). -Soheil
IP Address Allocation
I am trying to figure out what would be the proper way for a Plugin to interact with the CloudStack VM deployment and provide an authoritative IP Address from its database versus the local CloudStack database. It looks like the NetworkElements are not presented an opportunity to provide an IP Address and you must develop a NetworkGuru to provide this function. There is some customization of the IP Address designed into the Secondary NICs (see allocateGuestIP()). -Soheil
RE: IP Address Allocation
One way to achieve this behavior is to have a call out in prepareNic() to the NetworkElements before the call to the NetworkGuru allowing the NetworkElement to update the Nic Profile. In this use case the Network Element would suggest an IP Address. In the use case below the IP Address would be updated by the NetworkElement. There is logic in getIp(), the current IP Allocation that handles the case where the Nic Profile already has an IP Address. This needs to be updated to handle this new use case. The current use case assume that the VM had already been prepared once and has an IP Address allocated that could be reused. Does anyone see a problem with this approach? -Soheil From: Soheil Eizadi [seiz...@infoblox.com] Sent: Monday, August 05, 2013 2:35 PM To: dev@cloudstack.apache.org Subject: IP Address Allocation I am trying to figure out what would be the proper way for a Plugin to interact with the CloudStack VM deployment and provide an authoritative IP Address from its database versus the local CloudStack database. It looks like the NetworkElements are not presented an opportunity to provide an IP Address and you must develop a NetworkGuru to provide this function. There is some customization of the IP Address designed into the Secondary NICs (see allocateGuestIP()). -Soheil
RE: Physical Network / Guest Network / Service Offering Interactions for Basic Networking
Thanks for the replies, I posted the message as I was going to fix it and submit a patch but wanted to know if there were any issues I should be aware of in this area. Actually the problem is not with ConfigurationServerImpl, but with the call to CreateGuestNetwork(). I am actually a little confused because today I got some cycles to debug this and found that when I created a bogus zone with a XenServer that did not exist, the wizard ran all the way and created the defaultGuestNetwork and the Network that got created had a proper service map! So now I am puzzled why it did not work for the first network I created. I guess I need to initialize my whole system and see why the first time it did not work properly and report back. (May be pilot error and it was not set to proper service offering when the wizard was run.) I stepped through the NetworkServiceImpl and NetworkManagerImpl logic for CreateGuestNetwork() and they were all working fine with a NetworkServiceOffering other than the default defaultSharedSGNetworkOffering, in my case I create a defaultInfobloxSharedOffering. Here is the what the service map looks like for the network 225 that was created, I have my plugin providing DNS service: mysql select * from ntwk_service_map; +++---+---+-+ | id | network_id | service | provider | created | +++---+---+-+ . | 21 |225 | SecurityGroup | SecurityGroupProvider | 2013-07-30 01:15:08 | | 22 |225 | Dns | Infoblox | 2013-07-30 01:15:08 | | 23 |225 | Dhcp | VirtualRouter | 2013-07-30 01:15:08 | | 24 |225 | UserData | VirtualRouter | 2013-07-30 01:15:08 | +++---+---+-+ 24 rows in set (0.00 sec) From: Chiradeep Vittal [chiradeep.vit...@citrix.com] Sent: Friday, July 26, 2013 3:09 AM To: dev@cloudstack.apache.org Subject: Re: Physical Network / Guest Network / Service Offering Interactions for Basic Networking Did you modify the code in com/cloud/server/ConfigurationServerImpl to do this? AFAIK, basic zone always creates a default guest network based on the defaultSharedSGNetworkOffering offering. You may create additional offerings, but I suspect the code won't let you create additional guest networks based on those offerings. Check the DB, (foreign key network_offering_id in table networks) On 7/26/13 3:08 PM, Daan Hoogland daan.hoogl...@gmail.com wrote: Soheil, I noticed your post not being replied to so I wondered what it was about, I can make a guess but it doesn't contain a question, only an observation. Do you mean to have some question about the behavior you are seeing? regards, Daan Hoogland On Fri, Jul 19, 2013 at 7:57 PM, Soheil Eizadi seiz...@infoblox.com wrote: I am trying to figure out if the behavior I am seeing for Basic Networking: For my use case I have a Network Service Offering that has replaced Virtual Router service, e.g. DHCP/DNS with my plugin service. Then I created a zone with Basic Networking configuration with that Network Service Offering. What I see is that the defaultGuestNetwork that is created attached to the Physical Network does not have my Service listed in its Network Service Map. -Soheil More detail below: mysql select * from physical_network; +-+--+--+ +--+---+---++-+-- ---+-+ | id | uuid | name | data_center_id | vnet | speed | domain_id | broadcast_domain_range | state | created | removed | +-+--+--+ +--+---+---++-+-- ---+-+ | 200 | 3a3b7a2e-e771-4847-bd1b-4d9a4ad27baf | cloud-public | 1 | NULL | NULL | NULL | POD| Enabled | 2013-07-02 17:33:56 | NULL| +-+--+--+ +--+---+---++-+-- ---+-+ 1 row in set (0.00 sec) mysql select * from physical_network_service_providers
Re: Review Request 12883: DNS value in Zone is not getting set in the Network created for the Zone
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/12883/#review24205 --- In researching this more look like there is a code in NetworkManager that will set the Network DNS Domain, given proper DNS Capabilities (Capability.AllowDnsSuffixModification) is set in the DNS Offering. I need to investigate what happens when the DNS value for Zone is modified, so perhaps the code in the prepare/release is not needed. // If networkDomain is not specified, take it from the global configuration if (_networkModel.areServicesSupportedByNetworkOffering(networkOfferingId, Service.Dns)) { MapNetwork.Capability, String dnsCapabilities = _networkModel.getNetworkOfferingServiceCapabilities (_configMgr.getNetworkOffering(networkOfferingId), Service.Dns); String isUpdateDnsSupported = dnsCapabilities.get(Capability.AllowDnsSuffixModification); if (isUpdateDnsSupported == null || !Boolean.valueOf(isUpdateDnsSupported)) { if (networkDomain != null) { // TBD: NetworkOfferingId and zoneId. Send uuids instead. throw new InvalidParameterValueException(Domain name change is not supported by network offering id= + networkOfferingId + in zone id= + zoneId); } - Soheil Eizadi On July 26, 2013, 10:22 p.m., Soheil Eizadi wrote: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/12883/ --- (Updated July 26, 2013, 10:22 p.m.) Review request for cloudstack. Bugs: https://issues.apache.org/jira/browse/CLOUDSTACK-3754 Repository: cloudstack-git Description --- DNS value in Zone is not getting set in the Network created for the Zone. Due to this the prepare and release calls to the Network Plugins are missing this information for the VMs. see Jira bug https://issues.apache.org/jira/browse/CLOUDSTACK-3754 for additional details. diff --git a/server/src/com/cloud/network/NetworkManagerImpl.java b/server/src/com/cloud/network/NetworkManagerImpl.java index 8e90cb7..53715c2 100755 --- a/server/src/com/cloud/network/NetworkManagerImpl.java +++ b/server/src/com/cloud/network/NetworkManagerImpl.java @@ -2041,6 +2041,12 @@ public class NetworkManagerImpl extends ManagerBase implements NetworkManager, L dest, ReservationContext context, long nicId, NetworkVO network) throws InsufficientVirtualNetworkCapcityException, InsufficientAddressCapacityException, ConcurrentOperationException, InsufficientCapacityException, ResourceUnavailableException { + + if (dest.getDataCenter().getNetworkType() == NetworkType.Basic) { + if ((network.getNetworkDomain() == null) (dest.getDataCenter().getDomain() != null)) { + network.setNetworkDomain(dest.getDataCenter().getDomain()); + } + } Integer networkRate = _networkModel.getNetworkRate(network.getId(), vmProfile.getId()); NetworkGuru guru = AdapterBase.getAdapterByName(_networkGurus, network.getGuruName()); @@ -2116,6 +2122,13 @@ public class NetworkManagerImpl extends ManagerBase implements NetworkManager, L s_logger.error(NetworkGuru +guru+ prepareForMigration failed.); // XXX: Transaction error } } + + if (dest.getDataCenter().getNetworkType() == NetworkType.Basic) { + if ((network.getNetworkDomain() == null) (dest.getDataCenter().getDomain() != null)) { + network.setNetworkDomain(dest.getDataCenter().getDomain()); + } + } + for (NetworkElement element : _networkElements) { if(element instanceof NetworkMigrationResponder){ if(!((NetworkMigrationResponder) element).prepareMigration(profile, network, vm, dest, context)){ @@ -2238,7 +2251,14 @@ public class NetworkManagerImpl extends ManagerBase implements NetworkManager, L //commit the transaction before proceeding releasing nic profile on the network elements txn.commit(); -// Perform release on network elements +DataCenterVO zone = _dcDao.findById(network.getDataCenterId()); +if ( zone.getNetworkType() == NetworkType.Basic) { + if ((network.getNetworkDomain() == null) (zone.getDomain() != null)) { + network.setNetworkDomain(zone.getDomain
Re: Review Request 12883: DNS value in Zone is not getting set in the Network created for the Zone
On July 24, 2013, 9:22 p.m., Soheil Eizadi wrote: After thinking about this some more I think a better way to fix this problem is to have the UI leave this NULL and have the Network Manager fill in the value by looking up the value in the Network, if it is NULL then lookup the value in the Zone. This behavior will avoid having additional code to handle the case where the Zone DNS field is updated. I will look at this some more and submitted another patch for this problem. Fixed the problem by changing the Server side and implementing a change in the Network Manager, so that the individual plugins are not burdened with this logic. - Soheil --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/12883/#review23786 --- On July 23, 2013, 10:03 p.m., Soheil Eizadi wrote: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/12883/ --- (Updated July 23, 2013, 10:03 p.m.) Review request for cloudstack. Bugs: https://issues.apache.org/jira/browse/CLOUDSTACK-3754 Repository: cloudstack-git Description --- DNS value in Zone is not getting set in the Network created for the Zone. Due to this the prepare and release calls to the Network Plugins are missing this information for the VMs. see Jira bug https://issues.apache.org/jira/browse/CLOUDSTACK-3754 for additional details. Administrators-MacBook-Pro-7:cloudstack seizadi$ git diff diff --git a/ui/scripts/zoneWizard.js b/ui/scripts/zoneWizard.js index cb92c4e..9885b1d 100755 --- a/ui/scripts/zoneWizard.js +++ b/ui/scripts/zoneWizard.js @@ -3084,7 +3084,9 @@ zoneid: args.data.returnedZone.id, name: 'defaultGuestNetwork', displaytext: 'defaultGuestNetwork', - networkofferingid: args.data.zone.networkOfferingId + networkofferingid: args.data.zone.networkOfferingId, + networkDomain: args.data.returnedZone.domain }; //Advanced zone with SG Diffs - Diff: https://reviews.apache.org/r/12883/diff/ Testing --- Created Basic Network with Wizard and validated with FireFox debugger that value was properly set and validated with CloudMonkey that the defaultGuestNetwork created had the DNS Domain value set. I noted that there are other Ajax calls in UI that createNetwork() and don't set this field, also there is a use case where the zone value can be modified and this value would need to be updated in the attached Networks. So I would not close the Jira bug until those additional cases are fixed in the UI. Thanks, Soheil Eizadi
Re: Review Request 12883: DNS value in Zone is not getting set in the Network created for the Zone
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/12883/ --- (Updated July 26, 2013, 10:22 p.m.) Review request for cloudstack. Changes --- Changed Network Manager for this fix (server/src/com/cloud/network/NetworkManagerImpl.java). Bugs: https://issues.apache.org/jira/browse/CLOUDSTACK-3754 Repository: cloudstack-git Description (updated) --- DNS value in Zone is not getting set in the Network created for the Zone. Due to this the prepare and release calls to the Network Plugins are missing this information for the VMs. see Jira bug https://issues.apache.org/jira/browse/CLOUDSTACK-3754 for additional details. diff --git a/server/src/com/cloud/network/NetworkManagerImpl.java b/server/src/com/cloud/network/NetworkManagerImpl.java index 8e90cb7..53715c2 100755 --- a/server/src/com/cloud/network/NetworkManagerImpl.java +++ b/server/src/com/cloud/network/NetworkManagerImpl.java @@ -2041,6 +2041,12 @@ public class NetworkManagerImpl extends ManagerBase implements NetworkManager, L dest, ReservationContext context, long nicId, NetworkVO network) throws InsufficientVirtualNetworkCapcityException, InsufficientAddressCapacityException, ConcurrentOperationException, InsufficientCapacityException, ResourceUnavailableException { + + if (dest.getDataCenter().getNetworkType() == NetworkType.Basic) { + if ((network.getNetworkDomain() == null) (dest.getDataCenter().getDomain() != null)) { + network.setNetworkDomain(dest.getDataCenter().getDomain()); + } + } Integer networkRate = _networkModel.getNetworkRate(network.getId(), vmProfile.getId()); NetworkGuru guru = AdapterBase.getAdapterByName(_networkGurus, network.getGuruName()); @@ -2116,6 +2122,13 @@ public class NetworkManagerImpl extends ManagerBase implements NetworkManager, L s_logger.error(NetworkGuru +guru+ prepareForMigration failed.); // XXX: Transaction error } } + + if (dest.getDataCenter().getNetworkType() == NetworkType.Basic) { + if ((network.getNetworkDomain() == null) (dest.getDataCenter().getDomain() != null)) { + network.setNetworkDomain(dest.getDataCenter().getDomain()); + } + } + for (NetworkElement element : _networkElements) { if(element instanceof NetworkMigrationResponder){ if(!((NetworkMigrationResponder) element).prepareMigration(profile, network, vm, dest, context)){ @@ -2238,7 +2251,14 @@ public class NetworkManagerImpl extends ManagerBase implements NetworkManager, L //commit the transaction before proceeding releasing nic profile on the network elements txn.commit(); -// Perform release on network elements +DataCenterVO zone = _dcDao.findById(network.getDataCenterId()); +if ( zone.getNetworkType() == NetworkType.Basic) { + if ((network.getNetworkDomain() == null) (zone.getDomain() != null)) { + network.setNetworkDomain(zone.getDomain()); + } + } + + // Perform release on network elements for (NetworkElement element : _networkElements) { if (s_logger.isDebugEnabled()) { s_logger.debug(Asking + element.getName() + to release + nic); Diffs - Diff: https://reviews.apache.org/r/12883/diff/ Testing (updated) --- Validated that the defaultGuestNetwork created had the DNS Domain value set to NULL. I mades sure that calls to prepare/release to Network Element Plugins had the DNS Domain set to the Zone value. Thanks, Soheil Eizadi
RE: DNS Network Domain
Thanks, it will have to be part of a bigger change to also change the UI to update the Network when the Zone DNS Domain is updated. -Soheil From: Chiradeep Vittal [chiradeep.vit...@citrix.com] Sent: Tuesday, July 23, 2013 9:56 PM To: dev@cloudstack.apache.org Subject: Re: DNS Network Domain Not sure. I don't think it will break anything to remove this check. On 7/24/13 3:04 AM, Soheil Eizadi seiz...@infoblox.com wrote: Created Jira bug against this, was going to submit a UI patch: https://issues.apache.org/jira/browse/CLOUDSTACK-3754 -Soheil From: Soheil Eizadi [seiz...@infoblox.com] Sent: Tuesday, July 02, 2013 6:36 PM To: dev@cloudstack.apache.org Subject: DNS Network Domain I found that the DNS Network Domain set for Basic Networking is not getting passed down to Network Plugins. I am trying to figure out how DNS Network Domain is suppose to work for my plugin integration. I was getting a NULL value for Basic Networking for the DNS Domain even though I had set a value for it in the Wizard. After I set the value in the database, it seems to be working but wanted to understand why it was not set,I found code in the system that enforces this behavior, when I try to set it from the API. -Soheil More detail logs . The Domain is set in the Zone Setting to acme.com: list zones count = 1 zone: name = testzone .. domain = acme.com .. It does not get passed down to the attached network. API call list networks missing networkdomain field as it is NULL. list networks count = 1 network: id = 1065fff0-a6e2-410a-94d5-50bc72f879db name = defaultGuestNetwork acltype = Domain broadcastdomaintype = Native . I also tried to set it using API to set the value but get exception: ERROR [cloud.async.AsyncJobManagerImpl] (Job-Executor-20:job-20) Unexpected exception while executing org.apache.cloudstack.api.command.user.network.UpdateNetworkCmd com.cloud.exception.InvalidParameterValueException: NetworkOffering and domain suffix upgrade can be perfomed for Isolated networks only at com.cloud.network.NetworkServiceImpl.updateGuestNetwork(NetworkServiceImpl .java:1982) at com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorD ispatcher.intercept(ComponentInstantiationPostProcessor.java:125) Exception from here: // network offering and domain suffix can be updated for Isolated networks only in 3.0 if ((networkOfferingId != null || domainSuffix != null) network.getGuestType() != GuestType.Isolated) { throw new InvalidParameterValueException(NetworkOffering and domain suffix upgrade can be perfomed for Isolated networks only); } I've patched the database and it works for me, trying to understand why we have code to prevent it? list networks count = 1 network: id = 1065fff0-a6e2-410a-94d5-50bc72f879db name = defaultGuestNetwork ... networkdomain = acme.com INFO [network.element.InfobloxElement] (consoleproxy-1:) InfobloxDeviceElement called to prepare Host Name soheil-test with DNS Domain acme.com Gateway null Netmask null with MAC 06:97:84:00:00:16 with IPv4 172.16.197.161
Re: Review Request 12883: DNS value in Zone is not getting set in the Network created for the Zone
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/12883/#review23785 --- After thinking about this some more I think a better way to fix this problem is to have the UI leave this NULL and have the Network Manager fill in the value by looking up the value in the Network, if it is NULL then lookup the value in the Zone. This behavior will avoid having additional code to handle the case where the Zone DNS field is updated. I will look at this some more and submitted another patch for this problem. - Soheil Eizadi On July 23, 2013, 10:03 p.m., Soheil Eizadi wrote: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/12883/ --- (Updated July 23, 2013, 10:03 p.m.) Review request for cloudstack. Bugs: https://issues.apache.org/jira/browse/CLOUDSTACK-3754 Repository: cloudstack-git Description --- DNS value in Zone is not getting set in the Network created for the Zone. Due to this the prepare and release calls to the Network Plugins are missing this information for the VMs. see Jira bug https://issues.apache.org/jira/browse/CLOUDSTACK-3754 for additional details. Administrators-MacBook-Pro-7:cloudstack seizadi$ git diff diff --git a/ui/scripts/zoneWizard.js b/ui/scripts/zoneWizard.js index cb92c4e..9885b1d 100755 --- a/ui/scripts/zoneWizard.js +++ b/ui/scripts/zoneWizard.js @@ -3084,7 +3084,9 @@ zoneid: args.data.returnedZone.id, name: 'defaultGuestNetwork', displaytext: 'defaultGuestNetwork', - networkofferingid: args.data.zone.networkOfferingId + networkofferingid: args.data.zone.networkOfferingId, + networkDomain: args.data.returnedZone.domain }; //Advanced zone with SG Diffs - Diff: https://reviews.apache.org/r/12883/diff/ Testing --- Created Basic Network with Wizard and validated with FireFox debugger that value was properly set and validated with CloudMonkey that the defaultGuestNetwork created had the DNS Domain value set. I noted that there are other Ajax calls in UI that createNetwork() and don't set this field, also there is a use case where the zone value can be modified and this value would need to be updated in the attached Networks. So I would not close the Jira bug until those additional cases are fixed in the UI. Thanks, Soheil Eizadi
Re: Review Request 12883: DNS value in Zone is not getting set in the Network created for the Zone
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/12883/#review23786 --- After thinking about this some more I think a better way to fix this problem is to have the UI leave this NULL and have the Network Manager fill in the value by looking up the value in the Network, if it is NULL then lookup the value in the Zone. This behavior will avoid having additional code to handle the case where the Zone DNS field is updated. I will look at this some more and submitted another patch for this problem. - Soheil Eizadi On July 23, 2013, 10:03 p.m., Soheil Eizadi wrote: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/12883/ --- (Updated July 23, 2013, 10:03 p.m.) Review request for cloudstack. Bugs: https://issues.apache.org/jira/browse/CLOUDSTACK-3754 Repository: cloudstack-git Description --- DNS value in Zone is not getting set in the Network created for the Zone. Due to this the prepare and release calls to the Network Plugins are missing this information for the VMs. see Jira bug https://issues.apache.org/jira/browse/CLOUDSTACK-3754 for additional details. Administrators-MacBook-Pro-7:cloudstack seizadi$ git diff diff --git a/ui/scripts/zoneWizard.js b/ui/scripts/zoneWizard.js index cb92c4e..9885b1d 100755 --- a/ui/scripts/zoneWizard.js +++ b/ui/scripts/zoneWizard.js @@ -3084,7 +3084,9 @@ zoneid: args.data.returnedZone.id, name: 'defaultGuestNetwork', displaytext: 'defaultGuestNetwork', - networkofferingid: args.data.zone.networkOfferingId + networkofferingid: args.data.zone.networkOfferingId, + networkDomain: args.data.returnedZone.domain }; //Advanced zone with SG Diffs - Diff: https://reviews.apache.org/r/12883/diff/ Testing --- Created Basic Network with Wizard and validated with FireFox debugger that value was properly set and validated with CloudMonkey that the defaultGuestNetwork created had the DNS Domain value set. I noted that there are other Ajax calls in UI that createNetwork() and don't set this field, also there is a use case where the zone value can be modified and this value would need to be updated in the attached Networks. So I would not close the Jira bug until those additional cases are fixed in the UI. Thanks, Soheil Eizadi
RE: DNS Network Domain
Created Jira bug against this, was going to submit a UI patch: https://issues.apache.org/jira/browse/CLOUDSTACK-3754 -Soheil From: Soheil Eizadi [seiz...@infoblox.com] Sent: Tuesday, July 02, 2013 6:36 PM To: dev@cloudstack.apache.org Subject: DNS Network Domain I found that the DNS Network Domain set for Basic Networking is not getting passed down to Network Plugins. I am trying to figure out how DNS Network Domain is suppose to work for my plugin integration. I was getting a NULL value for Basic Networking for the DNS Domain even though I had set a value for it in the Wizard. After I set the value in the database, it seems to be working but wanted to understand why it was not set,I found code in the system that enforces this behavior, when I try to set it from the API. -Soheil More detail logs . The Domain is set in the Zone Setting to acme.com: list zones count = 1 zone: name = testzone .. domain = acme.com .. It does not get passed down to the attached network. API call list networks missing networkdomain field as it is NULL. list networks count = 1 network: id = 1065fff0-a6e2-410a-94d5-50bc72f879db name = defaultGuestNetwork acltype = Domain broadcastdomaintype = Native . I also tried to set it using API to set the value but get exception: ERROR [cloud.async.AsyncJobManagerImpl] (Job-Executor-20:job-20) Unexpected exception while executing org.apache.cloudstack.api.command.user.network.UpdateNetworkCmd com.cloud.exception.InvalidParameterValueException: NetworkOffering and domain suffix upgrade can be perfomed for Isolated networks only at com.cloud.network.NetworkServiceImpl.updateGuestNetwork(NetworkServiceImpl.java:1982) at com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125) Exception from here: // network offering and domain suffix can be updated for Isolated networks only in 3.0 if ((networkOfferingId != null || domainSuffix != null) network.getGuestType() != GuestType.Isolated) { throw new InvalidParameterValueException(NetworkOffering and domain suffix upgrade can be perfomed for Isolated networks only); } I've patched the database and it works for me, trying to understand why we have code to prevent it? list networks count = 1 network: id = 1065fff0-a6e2-410a-94d5-50bc72f879db name = defaultGuestNetwork ... networkdomain = acme.com INFO [network.element.InfobloxElement] (consoleproxy-1:) InfobloxDeviceElement called to prepare Host Name soheil-test with DNS Domain acme.com Gateway null Netmask null with MAC 06:97:84:00:00:16 with IPv4 172.16.197.161
Review Request 12883: DNS value in Zone is not getting set in the Network created for the Zone
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/12883/ --- Review request for cloudstack. Bugs: https://issues.apache.org/jira/browse/CLOUDSTACK-3754 Repository: cloudstack-git Description --- DNS value in Zone is not getting set in the Network created for the Zone. Due to this the prepare and release calls to the Network Plugins are missing this information for the VMs. see Jira bug https://issues.apache.org/jira/browse/CLOUDSTACK-3754 for additional details. Administrators-MacBook-Pro-7:cloudstack seizadi$ git diff diff --git a/ui/scripts/zoneWizard.js b/ui/scripts/zoneWizard.js index cb92c4e..9885b1d 100755 --- a/ui/scripts/zoneWizard.js +++ b/ui/scripts/zoneWizard.js @@ -3084,7 +3084,9 @@ zoneid: args.data.returnedZone.id, name: 'defaultGuestNetwork', displaytext: 'defaultGuestNetwork', - networkofferingid: args.data.zone.networkOfferingId + networkofferingid: args.data.zone.networkOfferingId, + networkDomain: args.data.returnedZone.domain }; //Advanced zone with SG Diffs - Diff: https://reviews.apache.org/r/12883/diff/ Testing --- Created Basic Network with Wizard and validated with FireFox debugger that value was properly set and validated with CloudMonkey that the defaultGuestNetwork created had the DNS Domain value set. I noted that there are other Ajax calls in UI that createNetwork() and don't set this field, also there is a use case where the zone value can be modified and this value would need to be updated in the attached Networks. So I would not close the Jira bug until those additional cases are fixed in the UI. Thanks, Soheil Eizadi
Physical Network / Guest Network / Service Offering Interactions for Basic Networking
I am trying to figure out if the behavior I am seeing for Basic Networking: For my use case I have a Network Service Offering that has replaced Virtual Router service, e.g. DHCP/DNS with my plugin service. Then I created a zone with Basic Networking configuration with that Network Service Offering. What I see is that the defaultGuestNetwork that is created attached to the Physical Network does not have my Service listed in its Network Service Map. -Soheil More detail below: mysql select * from physical_network; +-+--+--++--+---+---++-+-+-+ | id | uuid | name | data_center_id | vnet | speed | domain_id | broadcast_domain_range | state | created | removed | +-+--+--++--+---+---++-+-+-+ | 200 | 3a3b7a2e-e771-4847-bd1b-4d9a4ad27baf | cloud-public | 1 | NULL | NULL | NULL | POD| Enabled | 2013-07-02 17:33:56 | NULL| +-+--+--++--+---+---++-+-+-+ 1 row in set (0.00 sec) mysql select * from physical_network_service_providers; ++--+-+---+--+-+--+---+--+--+---+-+---+-+--++-+-+-+ | id | uuid | physical_network_id | provider_name | state| destination_physical_network_id | vpn_service_provided | dhcp_service_provided | dns_service_provided | gateway_service_provided | firewall_service_provided | source_nat_service_provided | load_balance_service_provided | static_nat_service_provided | port_forwarding_service_provided | user_data_service_provided | security_group_service_provided | networkacl_service_provided | removed | ++--+-+---+--+-+--+---+--+--+---+-+---+-+--++-+-+-+ | 1 | 0a60e2e7-8b57-493f-b3f0-2dccf0b79705 | 200 | VirtualRouter | Enabled | 0 | 1 | 1 |1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 0 | 0 | NULL| | 2 | eeaa91c4-e97f-4a5e-9f82-b82db6959e3a | 200 | SecurityGroupProvider | Enabled | 0 | 0 | 0 |0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 | 0 | NULL| | 3 | adb626c9-7274-4afa-b4da-dfaa479836fa | 200 | VpcVirtualRouter | Disabled | 0 | 1 | 1 |1 | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 0 | 1 | NULL| | 4 | da2fa58c-2e0f-4189-a0cf-c32c19028dae | 200 | BaremetalDhcpProvider | Disabled | 0 | 0 | 1 |0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | NULL| | 5 |
RE: Trouble uploading ISO file
I logged jira bug to track this problem: https://issues.apache.org/jira/browse/CLOUDSTACK-3671 -Soheil From: Soheil Eizadi [seiz...@infoblox.com] Sent: Wednesday, July 17, 2013 11:57 AM To: dev@cloudstack.apache.org Subject: RE: Trouble uploading ISO file The 192.168.56.1 is due to the fact that you have multiple interfaces and have not setup your host/network information properly in the CSM database. You need the following three arguments to make sure they are consistent: host management.network.cidr secstorage.allowed.internal.sites Restart your CSM and also delete the System VMs so they have the proper host information. About your DNS, I would check your MAC firewall, may be turn it off and see if the DNS queries can go out. -Soheil From: Mike Tutkowski [mike.tutkow...@solidfire.com] Sent: Wednesday, July 17, 2013 11:22 AM To: dev@cloudstack.apache.org Subject: Re: Trouble uploading ISO file Here are the OS boot parameters. I'm not sure why the host is referenced as 192.168.56.1 as that's the address my host OS gets when I run DevCloud2 (which I'm not doing here). That VirtualBox network is up and running, however, as I just happen to be running a VM through it. -- quiet console=hvc0%template=domP%type=secstorage%host=192.168.56.1%port=8250%name=s-1-VM%zone=1%pod=1%guid=s-1-VM%resource=org.apache.cloudstack.storage.resource.NfsSecondaryStorageResource%instance=SecStorage%sslcopy=true%role=templateProcessor%mtu=1500%eth2ip=172.16.140.50%eth2mask=255.255.255.0%gateway=172.16.140.2%eth0ip=169.254.2.91%eth0mask=255.255.0.0%eth1ip=172.16.140.37%eth1mask=255.255.255.0%mgmtcidr= 192.168.56.0/24%localgw=172.16.140.2%private.network.device=eth1%eth3ip=172.16.140.36%eth3mask=255.255.255.0%storageip=172.16.140.36%storagenetmask=255.255.255.0%storagegateway=172.16.140.2%internaldns1=172.16.140.2%dns1=8.8.8.8 On Wed, Jul 17, 2013 at 12:12 PM, Mike Tutkowski mike.tutkow...@solidfire.com wrote: I notice from the Ubuntu host that I can ping machines on the same private network, but not access the Internet. It looks like this test failed to resolve download.cloud.com. Perhaps I have something misconfigured in Fusion? On Wed, Jul 17, 2013 at 12:10 PM, Mike Tutkowski mike.tutkow...@solidfire.com wrote: Interesting...same results. Thoughts? root@s-1-VM:~# /usr/local/cloud/systemvm/ssvm-check.sh First DNS server is 172.16.140.2 PING 172.16.140.2 (172.16.140.2): 56 data bytes 64 bytes from 172.16.140.2: icmp_seq=0 ttl=64 time=2.796 ms 64 bytes from 172.16.140.2: icmp_seq=1 ttl=64 time=0.959 ms --- 172.16.140.2 ping statistics --- 2 packets transmitted, 2 packets received, 0% packet loss round-trip min/avg/max/stddev = 0.959/1.877/2.796/0.919 ms Good: Can ping DNS server ERROR: DNS not resolving download.cloud.com resolv.conf follows nameserver 172.16.140.2 nameserver 8.8.8.8 On Wed, Jul 17, 2013 at 11:59 AM, Mike Tutkowski mike.tutkow...@solidfire.com wrote: I am now re-trying with the following configuration: Basic zone using a VMware Fusion private network Host OS at 172.16.140.1 DNS at 172.16.140.2 Ubuntu (for NFS secondary storage) at 172.16.140.5 XenServer at 172.16.140.6 System VM range at 172.16.140.30 to 172.16.140.40 User VM range at 172.16.140.50 to 172.16.140.60 On Wed, Jul 17, 2013 at 11:45 AM, Mike Tutkowski mike.tutkow...@solidfire.com wrote: Doh! I believe I made a mistake there. Let me fix that and retry. Thanks! On Wed, Jul 17, 2013 at 11:43 AM, Soheil Eizadi seiz...@infoblox.comwrote: You did not document but I assume since you are using Fusion and your host is 172.16.140.1, your gateway is going to be 172.16.140.2. The Gateway is where you want to send your DNS requests to not your host 172.16.140.1. -Soheil From: Mike Tutkowski [mike.tutkow...@solidfire.com] Sent: Wednesday, July 17, 2013 10:34 AM To: dev@cloudstack.apache.org Subject: Re: Trouble uploading ISO file Thanks :) Somehow that other thread got opened with a similar subject line. This is the results I received from the script: First DNS server is 172.16.140.1 PING 172.16.140.1 (172.16.140.1): 56 data bytes 64 bytes from 172.16.140.1: icmp_seq=0 ttl=64 time=1.977 ms 64 bytes from 172.16.140.1: icmp_seq=1 ttl=64 time=1.508 ms --- 172.16.140.1 ping statistics --- 2 packets transmitted, 2 packets received, 0% packet loss round-trip min/avg/max/stddev = 1.508/1.742/1.977/0.235 ms Good: Can ping DNS server ERROR: DNS not resolving download.cloud.com resolv.conf follows nameserver 172.16.140.1 nameserver 8.8.8.8 On Wed, Jul 17, 2013 at 11:29 AM, Soheil Eizadi seiz...@infoblox.com wrote: Hi Mike, You have another thread open
RE: Trouble uploading ISO file
Hi Mike, You have another thread open where you got information to use: ssh -i /root/.ssh/id_rsa.cloud -p 3922 root@link-local-ip After you get access to the SSVM, then you run the following script to check the status: root@s-1-VM:~# /usr/local/cloud/systemvm/ssvm-check.sh It will print out some common diagnostics, the typical failure case for your use case could be: - You have multiple interfaces and have not setup your host/network information properly - DNS is not setup properly -Soheil From: Mike Tutkowski [mike.tutkow...@solidfire.com] Sent: Wednesday, July 17, 2013 10:07 AM To: dev@cloudstack.apache.org Subject: Re: Trouble uploading ISO file As an FYI, I used this template for the system VMs: http://jenkins.cloudstack.org/job/build-systemvm-master/lastSuccessfulBuild/artifact/tools/appliance/dist/systemvmtemplate-2013-07-16-master-xen.vhd.bz2 I'm running the CS MS on Mac OS X 10.8.3. Within OS X, I'm running VMware Fusion. It's running one XenServer host and one Ubuntu host (where the NFS share resides). The networking is private within Fusion, where the host OS (OS X) has 172.16.140.1 as its IP address, the XenServer host is at 172.16.140.6 and the Ubuntu host is at 172.16.140.5. I've given the system VMs 172.16.140.30 - 172.16.140.40. I've given the user VMs 172.16.140.50 - 172.16.140.60. Initially when setting up the zone, I did see a message about the link local addresses, but I looked at SSVM and CPVM and they seem to have link local addresses at 169.254.2.134 and 169.254.3.247, respectively (not sure how those addresses were picked). On Wed, Jul 17, 2013 at 10:56 AM, Mike Tutkowski mike.tutkow...@solidfire.com wrote: Also, when I click on View Console in the GUI, it says the server refused the connection (same result for both SSVM and CPVM). On Wed, Jul 17, 2013 at 10:54 AM, Mike Tutkowski mike.tutkow...@solidfire.com wrote: Hi Simon, I am just running a Basic Zone. The public IP address of the SSVM is 172.16.140.50. When I try to SSH in, it times out: mtutkowski-LT:~ mtutkowski$ ssh root@172.16.140.50 ssh: connect to host 172.16.140.50 port 22: Operation timed out When I see a dash by Agent State in the GUI, do you know what that indicates? Thanks! On Wed, Jul 17, 2013 at 10:46 AM, Simon Weller swel...@ena.com wrote: Mike, Are you running in an advanced network zone? If you ssh into the SSVM, which interface does your default route take? Can you telnet to the httpd server on port 80 from the SSVM? - Original Message - From: Mike Tutkowski mike.tutkow...@solidfire.com To: dev@cloudstack.apache.org Sent: Wednesday, July 17, 2013 11:38:36 AM Subject: Re: Trouble uploading ISO file This is where I'm trying to copy the ISO from (from the same computer that's running the CS MS): http://172.16.140.1/~mtutkowski/ubuntu-12.04.1-desktop-amd64.iso On Wed, Jul 17, 2013 at 10:37 AM, Mike Tutkowski mike.tutkow...@solidfire.com wrote: Hi, I'm seeing the following error in the console when I try to upload an ISO file: WARN [storage.download.DownloadListener] (Timer-11:) Entering download error state: timeout waiting for response from storage host, TEMPLATE: 210 at host 0 Any thoughts on this? I seem to be able to access the ISO that I want to copy just fine via my browser. Also, the CS MS has been able to successfully create a snapshots and volumes folder on my NFS share. Thanks! -- *Mike Tutkowski* *Senior CloudStack Developer, SolidFire Inc.* e: mike.tutkow...@solidfire.com o: 303.746.7302 Advancing the way the world uses the cloud http://solidfire.com/solution/overview/?video=play *™* -- *Mike Tutkowski* *Senior CloudStack Developer, SolidFire Inc.* e: mike.tutkow...@solidfire.com o: 303.746.7302 Advancing the way the world uses the cloudhttp://solidfire.com/solution/overview/?video=play *™* -- *Mike Tutkowski* *Senior CloudStack Developer, SolidFire Inc.* e: mike.tutkow...@solidfire.com o: 303.746.7302 Advancing the way the world uses the cloudhttp://solidfire.com/solution/overview/?video=play *™* -- *Mike Tutkowski* *Senior CloudStack Developer, SolidFire Inc.* e: mike.tutkow...@solidfire.com o: 303.746.7302 Advancing the way the world uses the cloudhttp://solidfire.com/solution/overview/?video=play *™* -- *Mike Tutkowski* *Senior CloudStack Developer, SolidFire Inc.* e: mike.tutkow...@solidfire.com o: 303.746.7302 Advancing the way the world uses the cloudhttp://solidfire.com/solution/overview/?video=play *™*
RE: Trouble uploading ISO file
You did not document but I assume since you are using Fusion and your host is 172.16.140.1, your gateway is going to be 172.16.140.2. The Gateway is where you want to send your DNS requests to not your host 172.16.140.1. -Soheil From: Mike Tutkowski [mike.tutkow...@solidfire.com] Sent: Wednesday, July 17, 2013 10:34 AM To: dev@cloudstack.apache.org Subject: Re: Trouble uploading ISO file Thanks :) Somehow that other thread got opened with a similar subject line. This is the results I received from the script: First DNS server is 172.16.140.1 PING 172.16.140.1 (172.16.140.1): 56 data bytes 64 bytes from 172.16.140.1: icmp_seq=0 ttl=64 time=1.977 ms 64 bytes from 172.16.140.1: icmp_seq=1 ttl=64 time=1.508 ms --- 172.16.140.1 ping statistics --- 2 packets transmitted, 2 packets received, 0% packet loss round-trip min/avg/max/stddev = 1.508/1.742/1.977/0.235 ms Good: Can ping DNS server ERROR: DNS not resolving download.cloud.com resolv.conf follows nameserver 172.16.140.1 nameserver 8.8.8.8 On Wed, Jul 17, 2013 at 11:29 AM, Soheil Eizadi seiz...@infoblox.comwrote: Hi Mike, You have another thread open where you got information to use: ssh -i /root/.ssh/id_rsa.cloud -p 3922 root@link-local-ip After you get access to the SSVM, then you run the following script to check the status: root@s-1-VM:~# /usr/local/cloud/systemvm/ssvm-check.sh It will print out some common diagnostics, the typical failure case for your use case could be: - You have multiple interfaces and have not setup your host/network information properly - DNS is not setup properly -Soheil From: Mike Tutkowski [mike.tutkow...@solidfire.com] Sent: Wednesday, July 17, 2013 10:07 AM To: dev@cloudstack.apache.org Subject: Re: Trouble uploading ISO file As an FYI, I used this template for the system VMs: http://jenkins.cloudstack.org/job/build-systemvm-master/lastSuccessfulBuild/artifact/tools/appliance/dist/systemvmtemplate-2013-07-16-master-xen.vhd.bz2 I'm running the CS MS on Mac OS X 10.8.3. Within OS X, I'm running VMware Fusion. It's running one XenServer host and one Ubuntu host (where the NFS share resides). The networking is private within Fusion, where the host OS (OS X) has 172.16.140.1 as its IP address, the XenServer host is at 172.16.140.6 and the Ubuntu host is at 172.16.140.5. I've given the system VMs 172.16.140.30 - 172.16.140.40. I've given the user VMs 172.16.140.50 - 172.16.140.60. Initially when setting up the zone, I did see a message about the link local addresses, but I looked at SSVM and CPVM and they seem to have link local addresses at 169.254.2.134 and 169.254.3.247, respectively (not sure how those addresses were picked). On Wed, Jul 17, 2013 at 10:56 AM, Mike Tutkowski mike.tutkow...@solidfire.com wrote: Also, when I click on View Console in the GUI, it says the server refused the connection (same result for both SSVM and CPVM). On Wed, Jul 17, 2013 at 10:54 AM, Mike Tutkowski mike.tutkow...@solidfire.com wrote: Hi Simon, I am just running a Basic Zone. The public IP address of the SSVM is 172.16.140.50. When I try to SSH in, it times out: mtutkowski-LT:~ mtutkowski$ ssh root@172.16.140.50 ssh: connect to host 172.16.140.50 port 22: Operation timed out When I see a dash by Agent State in the GUI, do you know what that indicates? Thanks! On Wed, Jul 17, 2013 at 10:46 AM, Simon Weller swel...@ena.com wrote: Mike, Are you running in an advanced network zone? If you ssh into the SSVM, which interface does your default route take? Can you telnet to the httpd server on port 80 from the SSVM? - Original Message - From: Mike Tutkowski mike.tutkow...@solidfire.com To: dev@cloudstack.apache.org Sent: Wednesday, July 17, 2013 11:38:36 AM Subject: Re: Trouble uploading ISO file This is where I'm trying to copy the ISO from (from the same computer that's running the CS MS): http://172.16.140.1/~mtutkowski/ubuntu-12.04.1-desktop-amd64.iso On Wed, Jul 17, 2013 at 10:37 AM, Mike Tutkowski mike.tutkow...@solidfire.com wrote: Hi, I'm seeing the following error in the console when I try to upload an ISO file: WARN [storage.download.DownloadListener] (Timer-11:) Entering download error state: timeout waiting for response from storage host, TEMPLATE: 210 at host 0 Any thoughts on this? I seem to be able to access the ISO that I want to copy just fine via my browser. Also, the CS MS has been able to successfully create a snapshots and volumes folder on my NFS share. Thanks! -- *Mike Tutkowski* *Senior CloudStack Developer, SolidFire Inc.* e: mike.tutkow...@solidfire.com o: 303.746.7302 Advancing the way the world
RE: Trouble uploading ISO file
The 192.168.56.1 is due to the fact that you have multiple interfaces and have not setup your host/network information properly in the CSM database. You need the following three arguments to make sure they are consistent: host management.network.cidr secstorage.allowed.internal.sites Restart your CSM and also delete the System VMs so they have the proper host information. About your DNS, I would check your MAC firewall, may be turn it off and see if the DNS queries can go out. -Soheil From: Mike Tutkowski [mike.tutkow...@solidfire.com] Sent: Wednesday, July 17, 2013 11:22 AM To: dev@cloudstack.apache.org Subject: Re: Trouble uploading ISO file Here are the OS boot parameters. I'm not sure why the host is referenced as 192.168.56.1 as that's the address my host OS gets when I run DevCloud2 (which I'm not doing here). That VirtualBox network is up and running, however, as I just happen to be running a VM through it. -- quiet console=hvc0%template=domP%type=secstorage%host=192.168.56.1%port=8250%name=s-1-VM%zone=1%pod=1%guid=s-1-VM%resource=org.apache.cloudstack.storage.resource.NfsSecondaryStorageResource%instance=SecStorage%sslcopy=true%role=templateProcessor%mtu=1500%eth2ip=172.16.140.50%eth2mask=255.255.255.0%gateway=172.16.140.2%eth0ip=169.254.2.91%eth0mask=255.255.0.0%eth1ip=172.16.140.37%eth1mask=255.255.255.0%mgmtcidr= 192.168.56.0/24%localgw=172.16.140.2%private.network.device=eth1%eth3ip=172.16.140.36%eth3mask=255.255.255.0%storageip=172.16.140.36%storagenetmask=255.255.255.0%storagegateway=172.16.140.2%internaldns1=172.16.140.2%dns1=8.8.8.8 On Wed, Jul 17, 2013 at 12:12 PM, Mike Tutkowski mike.tutkow...@solidfire.com wrote: I notice from the Ubuntu host that I can ping machines on the same private network, but not access the Internet. It looks like this test failed to resolve download.cloud.com. Perhaps I have something misconfigured in Fusion? On Wed, Jul 17, 2013 at 12:10 PM, Mike Tutkowski mike.tutkow...@solidfire.com wrote: Interesting...same results. Thoughts? root@s-1-VM:~# /usr/local/cloud/systemvm/ssvm-check.sh First DNS server is 172.16.140.2 PING 172.16.140.2 (172.16.140.2): 56 data bytes 64 bytes from 172.16.140.2: icmp_seq=0 ttl=64 time=2.796 ms 64 bytes from 172.16.140.2: icmp_seq=1 ttl=64 time=0.959 ms --- 172.16.140.2 ping statistics --- 2 packets transmitted, 2 packets received, 0% packet loss round-trip min/avg/max/stddev = 0.959/1.877/2.796/0.919 ms Good: Can ping DNS server ERROR: DNS not resolving download.cloud.com resolv.conf follows nameserver 172.16.140.2 nameserver 8.8.8.8 On Wed, Jul 17, 2013 at 11:59 AM, Mike Tutkowski mike.tutkow...@solidfire.com wrote: I am now re-trying with the following configuration: Basic zone using a VMware Fusion private network Host OS at 172.16.140.1 DNS at 172.16.140.2 Ubuntu (for NFS secondary storage) at 172.16.140.5 XenServer at 172.16.140.6 System VM range at 172.16.140.30 to 172.16.140.40 User VM range at 172.16.140.50 to 172.16.140.60 On Wed, Jul 17, 2013 at 11:45 AM, Mike Tutkowski mike.tutkow...@solidfire.com wrote: Doh! I believe I made a mistake there. Let me fix that and retry. Thanks! On Wed, Jul 17, 2013 at 11:43 AM, Soheil Eizadi seiz...@infoblox.comwrote: You did not document but I assume since you are using Fusion and your host is 172.16.140.1, your gateway is going to be 172.16.140.2. The Gateway is where you want to send your DNS requests to not your host 172.16.140.1. -Soheil From: Mike Tutkowski [mike.tutkow...@solidfire.com] Sent: Wednesday, July 17, 2013 10:34 AM To: dev@cloudstack.apache.org Subject: Re: Trouble uploading ISO file Thanks :) Somehow that other thread got opened with a similar subject line. This is the results I received from the script: First DNS server is 172.16.140.1 PING 172.16.140.1 (172.16.140.1): 56 data bytes 64 bytes from 172.16.140.1: icmp_seq=0 ttl=64 time=1.977 ms 64 bytes from 172.16.140.1: icmp_seq=1 ttl=64 time=1.508 ms --- 172.16.140.1 ping statistics --- 2 packets transmitted, 2 packets received, 0% packet loss round-trip min/avg/max/stddev = 1.508/1.742/1.977/0.235 ms Good: Can ping DNS server ERROR: DNS not resolving download.cloud.com resolv.conf follows nameserver 172.16.140.1 nameserver 8.8.8.8 On Wed, Jul 17, 2013 at 11:29 AM, Soheil Eizadi seiz...@infoblox.com wrote: Hi Mike, You have another thread open where you got information to use: ssh -i /root/.ssh/id_rsa.cloud -p 3922 root@link-local-ip After you get access to the SSVM, then you run the following script to check the status: root@s-1-VM:~# /usr/local/cloud/systemvm/ssvm-check.sh It will print out some common diagnostics
Exception when inserting Event
I have code to delete the Plugin device from the system, when I try to execute this code I get an exception before my Command gets invoked in system code that tries to create an event. I debugged this to the event table underlying SQL definition. I wanted to know what the best practice was for CloudStack: * Update the Event Table definition to accommodate a longer Type Field * Limit my choice of naming to fit the existing 32 byte Event Field Ideally I wanted to change the event definition, but the change will impact database upgrade as we go from one release to another. -Soheil mysql describe event; +-+-+--+-+---++ | Field | Type| Null | Key | Default | Extra | +-+-+--+-+---++ | id | bigint(20) unsigned | NO | PRI | NULL | auto_increment | . | type| varchar(32) | NO | MUL | NULL || . +-+-+--+-+---++ --- @Entity @Table(name=event) public class EventVO implements Event { @Column(name=type) private String type; -- ERROR [cloud.api.ApiServer] (183551903@qtp-729770861-5:) unhandled exception executing api command: deleteInfobloxDevice com.cloud.utils.exception.CloudRuntimeException: DB Exception on: com.mysql.jdbc.JDBC4PreparedStatement@59c7f05d: INSERT INTO event (event.type, event.state, event.description, event.created, event.user_id, event.account_id, event.domain_id, event.level, event.start_id, event.parameters, event.uuid, event.archived) VALUES (_binary'PHYSICAL.INFOBLOXCONTROLLER.DELETE', 'Scheduled', _binary'Deleting Infoblox Controller', '2013-07-16 04:11:58', 2, 2, 1, _binary'INFO', 0, null, _binary'eefc03f0-f60b-4450-a43a-319e66c15e94', 0) at com.cloud.utils.db.GenericDaoBase.persist(GenericDaoBase.java:1342) .. at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582) Caused by: com.mysql.jdbc.MysqlDataTruncation: Data truncation: Data too long for column 'type' at row 1 at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:4072)
RE: Plugin/ Agent/ Host States
Here is the answer to this question, the Host State has the following states, most likely in this order: Alert Connecting Up Disconnected After the Plugin Resource gets called with Configure() and Start(), the Plugin Agent Manager creates the Host resource associated with the Plugin. The Agent Manger calls the Plugin Resource with a couple of commands to ensure it is proper state: ReadyCommand() and MaintainCommand() a response to these commands brings up and keeps the Plugin in the Up state. There is an additional Command GetHostStatsCommand() that is sent by Agent Manager, I don't see any of the Network Plugins respond to this command. I assume since it Hypervisor focused. If you don't respond to it properly you get following warnings. It is good practice to fill in the parts of the message that applies to a generic plugin to get rid of the warnings from log files: WARN [agent.manager.AgentManagerImpl] (StatsCollector-2:) Unsupported Command: Unsupported command issued:com.cloud.agent.api.GetHostStatsCommand. Are you sure you got the right type of server? WARN [cloud.server.StatsCollector] (StatsCollector-2:) Received invalid host stats for host: 2 The Agent Manager log error messages don't have the Host name, just the Host id, so you need to look them up in the database. Probably good practice for the logs to also print the name, so in the warning above host Id=2 is Infoblox Controller. id name uuid status 1 xenserver1-cloudstack 59f27a99-8133-4890-a845-d45668068742 Up 2 Infoblox Controller - 172.16.197.135 c430126c-97b8-434e-bd8d-db1d96832921 Up The GetHostStatsCommand() might be a good placeholder to get Network Plugin stats. -Soheil From: Soheil Eizadi [seiz...@infoblox.com] Sent: Friday, July 05, 2013 6:55 PM To: dev@cloudstack.apache.org Subject: Plugin/ Agent/ Host States I am trying to understand how the Host object state transitions to Up state? I see it starts in Alert state. There is not a setter for status and the comment for it in HostVO.java said: /** * Note: There is no setter for status because it has to be set in the dao code. */ @Column(name=status, nullable=false) private Status status = null; Thanks, -Soheil
CloudStack Local Storage Stats
I have been doing some negative testing with Plugin, it caused VMs not to start properly I had some that were in Stopped or Stopping state that I had clean out of the system manually. After I was done I found that the XenServer Hypervisor Local Storage Stats was off between CloudStack and the XenServer. I am trying to figure if this normal, given my negative testing, Cloudstack usage is 34342961152/34347155456 (used/capacity) versus XenServer 4194304/34347155456. -Soheil [root@xenserver1-cloudstack ~]# xe sr-param-list uuid=52ea201e-694e-37ef-d9fa-61b10af29165 uuid ( RO): 52ea201e-694e-37ef-d9fa-61b10af29165 name-label ( RW): 52ea201e-694e-37ef-d9fa-61b10af29165 name-description ( RW): Cloud Stack Local LVM Storage Pool for 846b5000-897d-4eee-8497-3b7992bdc40e host ( RO): xenserver1-cloudstack allowed-operations (SRO): forget; VDI.create; VDI.snapshot; plug; update; destroy; VDI.destroy; scan; VDI.clone; VDI.resize; unplug current-operations (SRO): VDIs (SRO): PBDs (SRO): 5fa4e878-f708-33e4-bfd2-5cb51d680669 virtual-allocation ( RO): 0 physical-utilisation ( RO): 4194304 physical-size ( RO): 34347155456 type ( RO): lvm content-type ( RO): user shared ( RW): false introduced-by ( RO): not in database other-config (MRW): i18n-original-value-name_label: Local storage; i18n-key: local-storage sm-config (MRO): allocation: thick; use_vhd: true; devserial: blobs ( RO): local-cache-enabled ( RO): false tags (SRW): mysql select * from storage_pool; ++-+--+---+--++++-+++---+--+-+-+-++---+-++ | id | name| uuid | pool_type | port | data_center_id | pod_id | cluster_id | used_bytes | capacity_bytes | host_address | user_info | path | created | removed | update_time | status | storage_provider_name | scope | hypervisor | ++-+--+---+--++++-+++---+--+-+-+-++---+-++ | 5 | testprimarynfs | 75719dd8-db6b-398f-924a-c6d088e442d2 | NetworkFilesystem | 2049 | 1 | 1 | 1 | 11577196544 |20332937216 | 172.16.197.134 | NULL | /opt/storage/primary | 2013-07-03 00:00:44 | NULL| NULL| Up | DefaultPrimary| CLUSTER | NULL | | 7 | xenserver1-cloudstack Local Storage | 52ea201e-694e-37ef-d9fa-61b10af29165 | LVM |0 | 1 | 1 | 1 | 34342961152 |34347155456 | 172.16.197.133 | NULL | lvm | 2013-07-08 00:38:14 | NULL| NULL| Up | DefaultPrimary| HOST| NULL | ++-+--+---+--++++-+++---+--+-+-+-++---+-++ 2 rows in set (0.00 sec)
RE: Spring Framework Question
Hi Mike, You typically have a public interface for your DAO: public interface InfobloxDao extends GenericDaoInfobloxDeviceVO, Long{ } Then an implementation: public class InfobloxDaoImpl extends GenericDaoBaseInfobloxDeviceVO, Long implements InfobloxDao { ... } This is a good link for the details of Database Access: https://cwiki.apache.org/confluence/display/CLOUDSTACK/Data+Access+Layer The DataBase DAO is one of the Beans you register with Spring componentContext.xml.in: bean id=InfobloxDaoImpl class=org.apache.cloudstack.network.dao.InfobloxDaoImpl / Then at run time the call like the one you have below wires your application typically plugin to the plugin data base implementation: @Inject InfobloxDao _infobloxDao; From: Mike Tutkowski [mike.tutkow...@solidfire.com] Sent: Sunday, April 21, 2013 11:53 AM To: cloudstack-...@incubator.apache.org Subject: Spring Framework Question Hi, I'm new to the Spring Framework. I understand the basic concepts, but am not familiar with the details regarding how to hook up dependencies. For example, I see this in various classes: @Inject DiskOfferingDao diskOfferingDao; What did we have to do in Spring (ex. files to configure) so that the proper runtime instance of DiskOfferingDao was instantiated and assigned to diskOfferingDao? Thanks! -- *Mike Tutkowski* *Senior CloudStack Developer, SolidFire Inc.* e: mike.tutkow...@solidfire.com o: 303.746.7302 Advancing the way the world uses the cloudhttp://solidfire.com/solution/overview/?video=play *™*
Plugin/ Agent/ Host States
I am trying to understand how the Host object state transitions to Up state? I see it starts in Alert state. There is not a setter for status and the comment for it in HostVO.java said: /** * Note: There is no setter for status because it has to be set in the dao code. */ @Column(name=status, nullable=false) private Status status = null; Thanks, -Soheil
RE: Secondary Storage/TinyLinux
I debugged this to another symptom of secondary storage VM network connectivity problem. (The Ready state of the template was No). Thanks, -Soheil From: Devdeep Singh [devdeep.si...@citrix.com] Sent: Monday, July 01, 2013 4:59 PM To: dev@cloudstack.apache.org Subject: RE: Secondary Storage/TinyLinux When you see it under Templates, what is the property of 'Ready' attribute of the template? Regards, Devdeep -Original Message- From: Soheil Eizadi [mailto:seiz...@infoblox.com] Sent: Monday, July 01, 2013 4:06 PM To: dev@cloudstack.apache.org Subject: Secondary Storage/TinyLinux A few days ago I built the latest 4.2 and it came up and secondary storage loaded TinyLinux Image that I was able to deploy it adding instances. Today I rebuilt my system, initialized the database and this time using the same NFS secondary storage. I don't have Tiny Linux Image, when I go to add an instance from templates. However I see it in the Templates for the zone. Has any one seen this behavior? -Soheil
Secondary Storage/TinyLinux
A few days ago I built the latest 4.2 and it came up and secondary storage loaded TinyLinux Image that I was able to deploy it adding instances. Today I rebuilt my system, initialized the database and this time using the same NFS secondary storage. I don't have Tiny Linux Image, when I go to add an instance from templates. However I see it in the Templates for the zone. Has any one seen this behavior? -Soheil
RE: Master build problem
Hi Prasanna, I am glad the problem is fixed on master. I will pull it next time I merge with master. Thanks, -Soheil From: Prasanna Santhanam [t...@apache.org] Sent: Wednesday, June 26, 2013 9:47 PM To: dev@cloudstack.apache.org Subject: Re: Master build problem Hiroaki fixed this with 39ef9240e87234afc2d4ddb37beaa63fe3240e4a. Do you have that commit SHA in your branch? On Wed, Jun 26, 2013 at 06:45:20PM +, Soheil Eizadi wrote: I don't see a fix checked in for that, my merged branch is ahead of master. It looks like it is due to the SSP Plugin checkin yesterday. If I had to guess the component is not included in the client/pom.xml. I commented out the plugin in my branch (removed it from componentContext.xml.in) and I can run the image now. -Soheil Administrators-MacBook-Pro-7:client seizadi$ pwd /Users/seizadi/cloudstack/infoblox_branch/cloudstack/client Administrators-MacBook-Pro-7:client seizadi$ fgrep cloud-plugin-network pom.xml artifactIdcloud-plugin-network-nvp/artifactId artifactIdcloud-plugin-network-ovs/artifactId artifactIdcloud-plugin-network-elb/artifactId artifactIdcloud-plugin-network-vns/artifactId artifactIdcloud-plugin-network-midonet/artifactId artifactIdcloud-plugin-network-internallb/artifactId artifactIdcloud-plugin-network-infoblox/artifactId artifactIdcloud-plugin-network-f5/artifactId artifactIdcloud-plugin-network-netscaler/artifactId artifactIdcloud-plugin-network-srx/artifactId artifactIdcloud-plugin-network-cisco-vnmc/artifactId From: Min Chen [min.c...@citrix.com] Sent: Wednesday, June 26, 2013 11:07 AM To: dev@cloudstack.apache.org Subject: Re: Master build problem I got latest master and able to start MS. I think that Prasanna has fixed that with a later checkin. Thanks -min On 6/26/13 11:02 AM, Soheil Eizadi seiz...@infoblox.com wrote: I merged the latest master into my branch and could not run it. I switched to master branch and built it but can not run it either, has anyone else seen this problem with sspCredentialDaoImpl? ERROR [web.context.ContextLoader] (main:) Context initialization failed org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'actionEventUtils': Injection of autowired dependencies failed; nested exception is org.springframework.beans.factory.BeanCreationException: Could not autowire field: com.cloud.event.dao.EventDao com.cloud.event.ActionEventUtils.eventDao; nested exception is org.springframework.beans.factory.CannotLoadBeanClassException: Cannot find class [com.cloud.network.dao.SspCredentialDaoImpl] for bean with name 'sspCredentialDaoImpl' defined in class path resource [componentContext.xml]; nested exception is java.lang.ClassNotFoundException: com.cloud.network.dao.SspCredentialDaoImpl -- Prasanna., Powered by BigRock.com
RE: System VMs grabbing wrong IP
I set the following three arguments to make sure they are consistent: host management.network.cidr secstorage.allowed.internal.sites Is there a reason why this does not get set as part of the standard wizard/basic setup? -Soheil From: Trippie [trip...@gmail.com] on behalf of Hugo Trippaers [h...@trippaers.nl] Sent: Thursday, June 27, 2013 3:49 PM To: dev@cloudstack.apache.org Subject: Re: System VMs grabbing wrong IP Sean, Change the global setting host to the ip address where the management server should respond to. You need to restart the management server after you make this change and recreate any system vms (ssvm and console proxy) Cheers, Hugo On Jun 27, 2013, at 2:35 PM, Sean Truman stru...@gmail.com wrote: All, My dev setup is running management/guest on cloudbr0 I have eth1 setup with a 10.0.0.x network so I can access the cloud via VPN but for some reason my secondary storage thinks my management node is the 10.0.0.x, where does it get the IP from and how can I change it? Sean
RE: Failed to mount primary NFS storage
I had built a new XenServer (licensed expired), I had copied vhd-util from download site to /opt/xensource/bin and removed the one in /usr/sbin, but looks like it referenced by hardcoded path, so it needs to be found via, /usr/sbin. [17802] 2013-06-27 09:15:08.707337 ['/usr/sbin/vhd-util', 'scan', '-f', '-c', '-m', '/var/run/sr-mount/476d133b-5c8c-a674-6544-89e261cd18cb/*.vhd'] I fixed this problem and the resolved the problem with mounting the primary storage. -Soheil From: Soheil Eizadi [seiz...@infoblox.com] Sent: Thursday, June 27, 2013 3:53 PM To: dev@cloudstack.apache.org Subject: Failed to mount primary NFS storage This is a new problem I have not seen before, I failed to mount primary NFS storage but it looks like it is mounted on XenServer and operational. After this problem it is in a loop where you can not fix the problem from wizard, as every time you try to mount it you get an exception since it is already in the SR list. I manually removed the primary storage on XenServer and tried again and it fails again with the same error: Caused by: SR_BACKEND_FAILURE_40The SR scan failed [opterr=error VHD-scanning path /var/run/sr-mount/14499ec3-000f-bb8a-a33d-eba5a98f69e6 (2)] Is this a known problem? -Soheil INFO [network.security.SecurityGroupListener] (2004014557@qtp-1799775865-8:) Received a host startup notification INFO [network.security.SecurityGroupListener] (2004014557@qtp-1799775865-8:) Scheduled network rules cleanup, interval=2118 INFO [network.security.SecurityGroupListener] (2004014557@qtp-1799775865-8:) Received a host startup notification INFO [cloud.resource.ResourceManagerImpl] (2004014557@qtp-1799775865-8:) server resources successfully discovered by XCP Agent WARN [xen.resource.CitrixResourceBase] (DirectAgent-1:) Catch Exception com.cloud.utils.exception.CloudRuntimeException, create StoragePool failed due to com.cloud.utils.exception.CloudRuntimeException: Unable to create NFS SR Pool[1|172.16.197.134:2049|/opt/storage/primary] on host:846b5000-897d-4eee-8497-3b7992bdc40e pool: 172.16.197.134/opt/storage/primary com.cloud.utils.exception.CloudRuntimeException: Unable to create NFS SR Pool[1|172.16.197.134:2049|/opt/storage/primary] at com.cloud.hypervisor.xen.resource.CitrixResourceBase.getNfsSR(CitrixResourceBase.java:6532) at com.cloud.hypervisor.xen.resource.CitrixResourceBase.execute(CitrixResourceBase.java:5541) at com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:560) at com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:73) at com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.java:186) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) at java.util.concurrent.FutureTask.run(FutureTask.java:138) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:98) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:206) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918) at java.lang.Thread.run(Thread.java:680) Caused by: SR_BACKEND_FAILURE_40The SR scan failed [opterr=error VHD-scanning path /var/run/sr-mount/66f0805b-da95-872c-2a6e-d5c46c219c2a (2)] at com.xensource.xenapi.Types.checkResponse(Types.java:1936) at com.xensource.xenapi.Connection.dispatch(Connection.java:368) at com.cloud.hypervisor.xen.resource.XenServerConnectionPool$XenServerConnection.dispatch(XenServerConnectionPool.java:909) at com.xensource.xenapi.SR.scan(SR.java:1241) at com.cloud.hypervisor.xen.resource.CitrixResourceBase.getNfsSR(CitrixResourceBase.java:6529) ... 12 more WARN [datastore.lifecycle.CloudStackPrimaryDataStoreLifeCycleImpl] (2004014557@qtp-1799775865-8:) Can not create storage pool through host 1 due to Catch Exception com.cloud.utils.exception.CloudRuntimeException, create StoragePool failed due to com.cloud.utils.exception.CloudRuntimeException: Unable to create NFS SR Pool[1|172.16.197.134:2049|/opt/storage/primary] on host:846b5000-897d-4eee-8497-3b7992bdc40e pool: 172.16.197.134/opt/storage/primary ERROR [cloud.api.ApiServer] (2004014557@qtp-1799775865-8:) unhandled exception executing api command: createStoragePool com.cloud.utils.exception.CloudRuntimeException: Failed to add data store at com.cloud.storage.StorageManagerImpl.createPool(StorageManagerImpl.java:752) at com.cloud.storage.StorageManagerImpl.createPool(StorageManagerImpl.java:183) at org.apache.cloudstack.api.command.admin.storage.CreateStoragePoolCmd.execute(CreateStoragePoolCmd.java:144) at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:155
RE: System VMs grabbing wrong IP
I can, I am new to this, I see there is Bugzilla and Jira links there how do I got about filling a request? The behavior on my system that has multiple interfaces is that is does not set it to any of the interfaces on the system but the default one that is in the database initialization (192.168.56.x). I have thought about just setting this up on dev system to get around this problem :) -Soheil From: Trippie [trip...@gmail.com] on behalf of Hugo Trippaers [h...@trippaers.nl] Sent: Thursday, June 27, 2013 4:34 PM To: dev@cloudstack.apache.org Subject: Re: System VMs grabbing wrong IP Hey Soheil, They get set to one of the interfaces on the system when you start the management server for the first time. So if you have multiple interfaces on the system it will only configure the services for one of the ip addresses. This looks like we have an opportunity to improve documentation and maybe we should throw an error when that management server is started on a machine with multiple network interfaces. Or indeed show a ui during the initial configuration to select which interface to use. Would you like to file a bug report for this at issues.apache.org? Cheers, Hugo On Jun 27, 2013, at 4:04 PM, Soheil Eizadi seiz...@infoblox.com wrote: I set the following three arguments to make sure they are consistent: host management.network.cidr secstorage.allowed.internal.sites Is there a reason why this does not get set as part of the standard wizard/basic setup? -Soheil From: Trippie [trip...@gmail.com] on behalf of Hugo Trippaers [h...@trippaers.nl] Sent: Thursday, June 27, 2013 3:49 PM To: dev@cloudstack.apache.org Subject: Re: System VMs grabbing wrong IP Sean, Change the global setting host to the ip address where the management server should respond to. You need to restart the management server after you make this change and recreate any system vms (ssvm and console proxy) Cheers, Hugo On Jun 27, 2013, at 2:35 PM, Sean Truman stru...@gmail.com wrote: All, My dev setup is running management/guest on cloudbr0 I have eth1 setup with a 10.0.0.x network so I can access the cloud via VPN but for some reason my secondary storage thinks my management node is the 10.0.0.x, where does it get the IP from and how can I change it? Sean
Master build problem
I merged the latest master into my branch and could not run it. I switched to master branch and built it but can not run it either, has anyone else seen this problem with sspCredentialDaoImpl? ERROR [web.context.ContextLoader] (main:) Context initialization failed org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'actionEventUtils': Injection of autowired dependencies failed; nested exception is org.springframework.beans.factory.BeanCreationException: Could not autowire field: com.cloud.event.dao.EventDao com.cloud.event.ActionEventUtils.eventDao; nested exception is org.springframework.beans.factory.CannotLoadBeanClassException: Cannot find class [com.cloud.network.dao.SspCredentialDaoImpl] for bean with name 'sspCredentialDaoImpl' defined in class path resource [componentContext.xml]; nested exception is java.lang.ClassNotFoundException: com.cloud.network.dao.SspCredentialDaoImpl
RE: Master build problem
I don't see a fix checked in for that, my merged branch is ahead of master. It looks like it is due to the SSP Plugin checkin yesterday. If I had to guess the component is not included in the client/pom.xml. I commented out the plugin in my branch (removed it from componentContext.xml.in) and I can run the image now. -Soheil Administrators-MacBook-Pro-7:client seizadi$ pwd /Users/seizadi/cloudstack/infoblox_branch/cloudstack/client Administrators-MacBook-Pro-7:client seizadi$ fgrep cloud-plugin-network pom.xml artifactIdcloud-plugin-network-nvp/artifactId artifactIdcloud-plugin-network-ovs/artifactId artifactIdcloud-plugin-network-elb/artifactId artifactIdcloud-plugin-network-vns/artifactId artifactIdcloud-plugin-network-midonet/artifactId artifactIdcloud-plugin-network-internallb/artifactId artifactIdcloud-plugin-network-infoblox/artifactId artifactIdcloud-plugin-network-f5/artifactId artifactIdcloud-plugin-network-netscaler/artifactId artifactIdcloud-plugin-network-srx/artifactId artifactIdcloud-plugin-network-cisco-vnmc/artifactId From: Min Chen [min.c...@citrix.com] Sent: Wednesday, June 26, 2013 11:07 AM To: dev@cloudstack.apache.org Subject: Re: Master build problem I got latest master and able to start MS. I think that Prasanna has fixed that with a later checkin. Thanks -min On 6/26/13 11:02 AM, Soheil Eizadi seiz...@infoblox.com wrote: I merged the latest master into my branch and could not run it. I switched to master branch and built it but can not run it either, has anyone else seen this problem with sspCredentialDaoImpl? ERROR [web.context.ContextLoader] (main:) Context initialization failed org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'actionEventUtils': Injection of autowired dependencies failed; nested exception is org.springframework.beans.factory.BeanCreationException: Could not autowire field: com.cloud.event.dao.EventDao com.cloud.event.ActionEventUtils.eventDao; nested exception is org.springframework.beans.factory.CannotLoadBeanClassException: Cannot find class [com.cloud.network.dao.SspCredentialDaoImpl] for bean with name 'sspCredentialDaoImpl' defined in class path resource [componentContext.xml]; nested exception is java.lang.ClassNotFoundException: com.cloud.network.dao.SspCredentialDaoImpl
Master Branch problem cannot login
I synced today, initialized the database and built image and found that I could not login to the CS UI. Not sure exactly what is going on but looks like the default field for Account Table was not created, when I tried to manually create it I got an error. The problem corrected itself when I ran the deployDB mvn build a second time after I had created the field manually. I can now log into the CS UI, but I thought I would document it here. -Soheil Below is more detail log. Administrators-MacBook-Pro-7:cloudstack seizadi$ git branch * infoblox master Administrators-MacBook-Pro-7:cloudstack seizadi$ git merge master Already up-to-date. From AccountVO.java: @Entity @Table(name=account) public class AccountVO implements Account { @Id @GeneratedValue(strategy=GenerationType.IDENTITY) @Column(name=id) private long id; . @Column(name = default) boolean isDefault; From create-schema.sql I don't see any field default defined: CREATE TABLE `cloud`.`account` ( `id` bigint unsigned NOT NULL auto_increment, `account_name` varchar(100) COMMENT 'an account name set by the creator of the account, defaults to username for single accounts', `uuid` varchar(40), `type` int(1) unsigned NOT NULL, `domain_id` bigint unsigned, `state` varchar(10) NOT NULL default 'enabled', `removed` datetime COMMENT 'date removed', `cleanup_needed` tinyint(1) NOT NULL default '0', `network_domain` varchar(255), `default_zone_id` bigint unsigned, PRIMARY KEY (`id`), INDEX i_account__removed(`removed`), CONSTRAINT `fk_account__default_zone_id` FOREIGN KEY `fk_account__default_zone_id`(`default_zone_id`) REFERENCES `data_center`(`id`) ON DELETE CASCADE, INDEX `i_account__cleanup_needed`(`cleanup_needed`), INDEX `i_account__account_name__domain_id__removed`(`account_name`, `domain_id`, `removed`), CONSTRAINT `fk_account__domain_id` FOREIGN KEY(`domain_id`) REFERENCES `domain` (`id`), INDEX `i_account__domain_id`(`domain_id`), CONSTRAINT `uc_account__uuid` UNIQUE (`uuid`) ) ENGINE=InnoDB DEFAULT CHARSET=utf8; mysql select * from account; ++--+--+--+---+-+-+++-+ | id | account_name | uuid | type | domain_id | state | removed | cleanup_needed | network_domain | default_zone_id | ++--+--+--+---+-+-+++-+ | 1 | system | 401c6676-d1f2-11e2-a780-ee6f6199dc83 |1 | 1 | enabled | NULL| 0 | NULL |NULL | | 2 | admin| 401c74fe-d1f2-11e2-a780-ee6f6199dc83 |1 | 1 | enabled | NULL| 0 | NULL |NULL | ++--+--+--+---+-+-+++-+ 2 rows in set (0.00 sec) ERROR [cloud.api.ApiServlet] (2071009240@qtp-761108485-3:) unknown exception writing api response com.cloud.utils.exception.CloudRuntimeException: DB Exception on: com.mysql.jdbc.PreparedStatement@52c0152d: SELECT account.id, account.account_name, account.type, account.domain_id, account.state, account.removed, account.cleanup_needed, account.network_domain, account.uuid, account.default_zone_id, account.default FROM account WHERE account.id = 2 at com.cloud.utils.db.GenericDaoBase.findById(GenericDaoBase.java:979) at com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125) at com.cloud.utils.db.GenericDaoBase.findByIdIncludingRemoved(GenericDaoBase.java:939) at com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125) at com.cloud.user.AccountManagerImpl.getAccount(AccountManagerImpl.java:1632) at com.cloud.api.ApiServer.loginUser(ApiServer.java:808) at com.cloud.api.ApiServlet.processRequest(ApiServlet.java:210) at com.cloud.api.ApiServlet.doPost(ApiServlet.java:71) at javax.servlet.http.HttpServlet.service(HttpServlet.java:727) at javax.servlet.http.HttpServlet.service(HttpServlet.java:820) at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511) at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:401) at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216) at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182) at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766) at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450) at org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230) at org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114) at
RE: UI Development
There is not a use case, but from the UI Plugin design description, looks like it is aimed at extending the CS UI after it is in production. I was thinking that there might be a requirement for having some Server side code running in CS to support this UI Plugin. The current CS Plugins are built in and if you wanted to add supporting UI I think you would develop that native rather than using a UI Plugin architecture. -Soheil From: Alex Huang [alex.hu...@citrix.com] Sent: Wednesday, June 12, 2013 9:16 AM To: dev@cloudstack.apache.org Subject: RE: UI Development Soheil, Yes there is. Look under the plugins folder for all the current plugins. CloudStack plugins allow not only code to be inserted to add functionality but APIs can be added to facilitate new functionalities. I do ask everyone who are developing plugins to consider and discuss end user facing API changes on the list before making them. Admin API changes can be added fairly quickly. --Alex -Original Message- From: Brian Federle [mailto:brian.fede...@citrix.com] Sent: Tuesday, June 11, 2013 12:44 PM To: 'dev@cloudstack.apache.org' Subject: RE: UI Development I'm pretty sure there is a modular system in place for the backend, though I only do front-end development so I'm not familiar with it. Maybe a server- side dev can answer that? -Brian -Original Message- From: Soheil Eizadi [mailto:seiz...@infoblox.com] Sent: Tuesday, June 11, 2013 11:52 AM To: dev@cloudstack.apache.org Subject: RE: UI Development Hi Brian, Thanks for the detail. I have looked at the UI-Plugin page, is there a matching server side plugin component to go along with the UI-Plugin to extend the CloudStack functionality? -Soheil From: Brian Federle [brian.fede...@citrix.com] Sent: Tuesday, June 11, 2013 11:44 AM To: 'dev@cloudstack.apache.org' Subject: RE: UI Development Hi Soheil, For the most part pretty much any IDE/text editor will work for UI development, as the code base is pure JS+HTML+CSS. I usually use Firebug for debugging purposes. For IDEs, I would recommend IntelliJ IDEA, which has the best support for JS, including an integrated JS debugger. Not too familiar with Eclipse for web dev, though. Unfortunately UI documentation is a bit sparse right now; I'm in the process of adding more documentation when I can find time. For now, I would recommend going through the UI plugin development tutorial and see if it will address your needs for the feature: https://cwiki.apache.org/CLOUDSTACK/ui-plugin-tutorial.html. It goes through setting up a new list view with a set of actions. -Brian -Original Message- From: Soheil Eizadi [mailto:seiz...@infoblox.com] Sent: Tuesday, June 11, 2013 11:35 AM To: dev@cloudstack.apache.org Subject: UI Development I did not find any UI development resources on the Wiki. I need to update the UI to support a new Device. I wanted to know if there is there any recommended tooling for the CloudStack UI. I was planning to use Eclipse JavaScript Development Tools (JSDT), but wanted to see if there is any recommended setup also what the recommended debugging environment would look like? Thanks, -Soheil
UI Development
I did not find any UI development resources on the Wiki. I need to update the UI to support a new Device. I wanted to know if there is there any recommended tooling for the CloudStack UI. I was planning to use Eclipse JavaScript Development Tools (JSDT), but wanted to see if there is any recommended setup also what the recommended debugging environment would look like? Thanks, -Soheil
RE: UI Development
Hi Brian, Thanks for the detail. I have looked at the UI-Plugin page, is there a matching server side plugin component to go along with the UI-Plugin to extend the CloudStack functionality? -Soheil From: Brian Federle [brian.fede...@citrix.com] Sent: Tuesday, June 11, 2013 11:44 AM To: 'dev@cloudstack.apache.org' Subject: RE: UI Development Hi Soheil, For the most part pretty much any IDE/text editor will work for UI development, as the code base is pure JS+HTML+CSS. I usually use Firebug for debugging purposes. For IDEs, I would recommend IntelliJ IDEA, which has the best support for JS, including an integrated JS debugger. Not too familiar with Eclipse for web dev, though. Unfortunately UI documentation is a bit sparse right now; I'm in the process of adding more documentation when I can find time. For now, I would recommend going through the UI plugin development tutorial and see if it will address your needs for the feature: https://cwiki.apache.org/CLOUDSTACK/ui-plugin-tutorial.html. It goes through setting up a new list view with a set of actions. -Brian -Original Message- From: Soheil Eizadi [mailto:seiz...@infoblox.com] Sent: Tuesday, June 11, 2013 11:35 AM To: dev@cloudstack.apache.org Subject: UI Development I did not find any UI development resources on the Wiki. I need to update the UI to support a new Device. I wanted to know if there is there any recommended tooling for the CloudStack UI. I was planning to use Eclipse JavaScript Development Tools (JSDT), but wanted to see if there is any recommended setup also what the recommended debugging environment would look like? Thanks, -Soheil
RE: Storage VM to Management Server Connectivity Problem
For now I patched this by editing the file /var/cache/cloud/cmdline and fixing the IP Address and restarting the Cloud Service on Storage VM. Now it is communicating with MS: INFO [storage.secondary.SecondaryStorageListener] (AgentConnectTaskPool-1:) Received a host startup notification com.cloud.agent.api.StartupSecondaryStorageCommand INFO [network.security.SecurityGroupListener] (AgentConnectTaskPool-1:) Received a host startup notification INFO [storage.download.DownloadMonitorImpl] (AgentConnectTaskPool-1:) Template Sync found SystemVM Template (XenServer) already in the template host table INFO [storage.download.DownloadMonitorImpl] (AgentConnectTaskPool-1:) Template Sync did not find CentOS 5.5(64-bit) no GUI (KVM) on the server 2, will request download shortly ... From: Soheil Eizadi [seiz...@infoblox.com] Sent: Wednesday, June 05, 2013 10:44 PM To: dev@cloudstack.apache.org Subject: Storage VM to Management Server Connectivity Problem I am bringing up a Storage VM on my XenServer that is running on My MAC. I noticed that the Management Server IP Address is incorrect 192.168.56.1 versus 172.16.197.1. Checking if this is something others have seen? This address is in the last boot record for the Storage VM. The IP Address 192.168.56.1 is not valid on my MAC, at least not right now! -Soheil Storage VM root@s-1-VM:~# /usr/local/cloud/systemvm/ssvm-check.sh First DNS server is 172.16.197.135 PING 172.16.197.135 (172.16.197.135): 56 data bytes 64 bytes from 172.16.197.135: icmp_seq=0 ttl=64 time=17.099 ms 64 bytes from 172.16.197.135: icmp_seq=1 ttl=64 time=0.783 ms --- 172.16.197.135 ping statistics --- 2 packets transmitted, 2 packets received, 0% packet loss round-trip min/avg/max/stddev = 0.783/8.941/17.099/8.158 ms Good: Can ping DNS server Good: DNS resolves download.cloud.com NFS is currently mounted Management server is 192.168.56.1. Checking connectivity. ERROR: Cannot connect to 192.168.56.1 port 8250 2013/05/10 14:23:02 socat[9304] E connecting to AF=2 192.168.56.1:8250: Connection timed out root@s-1-VM:~# ifconfig eth0 Link encap:Ethernet HWaddr 0e:00:a9:fe:02:74 inet addr:169.254.2.116 Bcast:169.254.255.255 Mask:255.255.0.0 inet6 addr: fe80::c00:a9ff:fefe:274/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:234 errors:0 dropped:0 overruns:0 frame:0 TX packets:131 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:16832 (16.4 KiB) TX bytes:18684 (18.2 KiB) Interrupt:8 eth1 Link encap:Ethernet HWaddr 06:ea:18:00:00:1d inet addr:172.16.197.128 Bcast:172.16.197.255 Mask:255.255.255.0 inet6 addr: fe80::4ea:18ff:fe00:1d/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:7660 errors:0 dropped:0 overruns:0 frame:0 TX packets:7263 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:725043 (708.0 KiB) TX bytes:493022 (481.4 KiB) Interrupt:9 eth2 Link encap:Ethernet HWaddr 06:e3:d0:00:00:34 inet addr:172.16.197.160 Bcast:172.16.197.255 Mask:255.255.255.0 inet6 addr: fe80::4e3:d0ff:fe00:34/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:4460 errors:0 dropped:0 overruns:0 frame:0 TX packets:4 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:576789 (563.2 KiB) TX bytes:408 (408.0 B) Interrupt:10 eth3 Link encap:Ethernet HWaddr 06:b3:52:00:00:06 inet addr:172.16.197.105 Bcast:172.16.197.255 Mask:255.255.255.0 inet6 addr: fe80::4b3:52ff:fe00:6/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:4462 errors:0 dropped:0 overruns:0 frame:0 TX packets:4 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:576893 (563.3 KiB) TX bytes:408 (408.0 B) Interrupt:11 loLink encap:Local Loopback inet addr:127.0.0.1 Mask:255.0.0.0 inet6 addr: ::1/128 Scope:Host UP LOOPBACK RUNNING MTU:16436 Metric:1 RX packets:8 errors:0 dropped:0 overruns:0 frame:0 TX packets:8 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:560 (560.0 B) TX bytes:560 (560.0 B) Last Boot Record on XenServer for the Storage VM (Note host=192.168.56.1%port=8250) last-boot-record ( RO): '('struct' ('uuid' '4d44e826-2830-29f1-6610-7d7b27ab7b1f') ('allowed_operations' ('array' 'changing_dynamic_range
RE: Handling Self Signed Certs
What is missing is a facility to import a certificate into the store. If it was available you could use it for self signed CERTS. Ideally it should be part of GUI to add devices. I am implementing a similar HTTP Client. You are using DefaultHttpClient so it is based on the newer Apache libraries. The ones I found in CloudStack were older Commons HttpClient which was EOL. In my case I planned to wrap the Client as you have for development and for production have an API to import a certificate for SSL into the Certificate Store. I would call to AuthScope(host, 443) to limit access to only the specific host and port. -Soheil From: williamstev...@gmail.com [williamstev...@gmail.com] on behalf of Will Stevens [wstev...@cloudops.com] Sent: Thursday, June 06, 2013 1:08 PM To: dev@cloudstack.apache.org Subject: Re: Handling Self Signed Certs Hey Kelven, I am using the same https client libraries as elsewhere in Cloudstack (well one of them because there is more than one version of http client libs currently available in CS). I am using this client: import org.apache.http.impl.client.DefaultHttpClient; I initialize it like this: _httpclient = new DefaultHttpClient(); Then if self signed certs are allowed, I currently have a utility library in my plugin which allows me to do this: // Allows you to connect via SSL using unverified certs _httpclient = HttpClientWrapper.wrapClient(_httpclient); Is there a class that already exists in CloudStack which I can use to wrap my client to enable unverified certs, or will I need to add one? Should I create a global setting such as 'Allow unverified SSL certs' which would be checked by the code to determine if the http client should be wrapped? Thx, Will On Thu, Jun 6, 2013 at 2:43 PM, Kelven Yang kelven.y...@citrix.com wrote: Will, We have several other integrated components that have the similar situation, it makes sense to consolidate the HTTPS client we used across CloudStack and have a global configuration to deal with self-signed certificate for all in testing or POC. To help testing/POC process to be smooth, we may allow self-signed certificate by default(which is the current behave), security sensitive customers should disallow self-signed certificates in their production environment. Kelven On 6/6/13 9:08 AM, Will Stevens wstev...@cloudops.com wrote: Hey All, I am building integration between CS and an external Palo Alto Firewall device. The API calls to the PA device are done over HTTPS. In some cases (like testing or a POC), it makes sense to use a self signed cert for this connection. Currently I have a little http client wrapper which allows the use of a self signed cert. Obviously, I do not want to use the wrapper when a real cert is used. What I am thinking of doing is adding a checkbox on the 'Add Palo Alto Device' configuration overlay with an option for 'Using a self signed cert'. If this checkbox is checked, then the http client wrapper is used so the self signed cert will not throw errors, if it is not checked, the the http client wrapper will not be used and errors will be thrown if the cert is not valid. Is this a realistic approach to this problem? Is this problem handled in other parts of the system in a different way? Thanks, Will
RE: Storage VM to Management Server Connectivity Problem
My machine has multiple NICs but none of them have that IP address (see below). That IP Address comes from deploydb stage as the default value. For some reason when I ran the Management Server it did not update these values, may be this is normal behavior for my use case where I have many potential Management Interfaces. I fixed these values manually for now for my configuration and restarted the Management Server. -Soheil Administrators-MacBook-Pro-7:~ seizadi$ ifconfig lo0: flags=8049UP,LOOPBACK,RUNNING,MULTICAST mtu 16384 options=3RXCSUM,TXCSUM inet6 fe80::1%lo0 prefixlen 64 scopeid 0x1 inet 127.0.0.1 netmask 0xff00 inet6 ::1 prefixlen 128 gif0: flags=8010POINTOPOINT,MULTICAST mtu 1280 stf0: flags=0 mtu 1280 en0: flags=8863UP,BROADCAST,SMART,RUNNING,SIMPLEX,MULTICAST mtu 1500 options=2bRXCSUM,TXCSUM,VLAN_HWTAGGING,TSO4 ether 10:9a:dd:6a:2b:03 media: autoselect (none) status: inactive en1: flags=8863UP,BROADCAST,SMART,RUNNING,SIMPLEX,MULTICAST mtu 1500 ether e4:ce:8f:12:ff:1c inet6 fe80::e6ce:8fff:fe12:ff1c%en1 prefixlen 64 scopeid 0x5 inet 10.102.28.164 netmask 0xfe00 broadcast 10.102.29.255 media: autoselect status: active p2p0: flags=8843UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST mtu 2304 ether 06:ce:8f:12:ff:1c media: autoselect status: inactive fw0: flags=8863UP,BROADCAST,SMART,RUNNING,SIMPLEX,MULTICAST mtu 4078 lladdr 70:cd:60:ff:fe:b8:15:bc media: autoselect full-duplex status: inactive vmnet1: flags=8863UP,BROADCAST,SMART,RUNNING,SIMPLEX,MULTICAST mtu 1500 ether 00:50:56:c0:00:01 inet 192.168.217.1 netmask 0xff00 broadcast 192.168.217.255 vmnet8: flags=8863UP,BROADCAST,SMART,RUNNING,SIMPLEX,MULTICAST mtu 1500 ether 00:50:56:c0:00:08 inet 172.16.197.1 netmask 0xff00 broadcast 172.16.197.255 From: Wei ZHOU [ustcweiz...@gmail.com] Sent: Thursday, June 06, 2013 3:24 PM To: dev@cloudstack.apache.org Subject: Re: Storage VM to Management Server Connectivity Problem Soheil, I think, your machine have multiple nics. When you deployed cloudstack, 192.168.56.1 should be the ip of first nic, so cloudstack regarded this as the management ip. You need to change these values manually, restart management server, destroy the systemvms (SSVM and CPVM). -Wei 2013/6/6 Soheil Eizadi seiz...@infoblox.com The configuration database is definitely wrong, just not sure how it got that way. -Soheil mysql select * from configuration where name= host; +--+--+---+--+--+-+ | category | instance | component | name | value| description | +--+--+---+--+--+-+ | Advanced | DEFAULT | management-server | host | 192.168.56.1 | NULL | +--+--+---+--+--+-+ 1 row in set (0.10 sec) mysql select * from configuration where name= management.network.cidr; +--+--+---+-+-+-+ | category | instance | component | name| value | description | +--+--+---+-+-+-+ | Advanced | DEFAULT | management-server | management.network.cidr | 192.168.56.0/24 | NULL| +--+--+---+-+-+-+ 1 row in set (0.00 sec) mysql select * from configuration where name= secstorage.allowed.internal.sites; +--+--+---+---++-+ | category | instance | component | name | value | description | +--+--+---+---++-+ | Advanced | DEFAULT | management-server | secstorage.allowed.internal.sites | 192.168.56.0/8 | NULL| +--+--+---+---++-+ 1 row in set (0.03 sec) From: Wei ZHOU [ustcweiz...@gmail.com] Sent: Wednesday, June 05, 2013 11:16 PM To: dev@cloudstack.apache.org Subject: Re: Storage VM to Management Server Connectivity Problem What is the value in cloud.configuration table with name='host'? -Wei 2013/6/6, Soheil Eizadi seiz...@infoblox.com: For now I patched this by editing the file /var/cache/cloud/cmdline and fixing the IP Address and restarting the Cloud Service on Storage VM. Now it is communicating with MS: INFO [storage.secondary.SecondaryStorageListener] (AgentConnectTaskPool-1:) Received a host startup notification
Add Device associated with Network Plugins
Has there been any discussion of common GUI and abstraction for adding Network Devices for various Plugins? They all need some common facilities: - Physical Network that is served by Device - Device IP Address/FQDN - User - Password - Certificate Import facility, if using secure connection In addition each device might have custom fields that must be entered, e.g. Nicira Device requires the Transport Zone information. -Soheil
Add Device for Plugins
Has there been any discussion of common GUI and abstraction for adding network devices to CloudStack. They all need some common facilities: - Physical Network that is served by Device - Device IP Address/Name - UserName / Password - Certificate Import facility for Device if using secure connection In addition each device might have device specific custom fields that need to be entered, e.g. Nicira device needs the Transport Zone. -Soheil
RE: Add Device for Plugins
Sorry for the duplicate emails, my Outlook Client crashed so there are two emails. -Soheil From: Soheil Eizadi [seiz...@infoblox.com] Sent: Wednesday, June 05, 2013 9:36 AM To: dev@cloudstack.apache.org Subject: Add Device for Plugins Has there been any discussion of common GUI and abstraction for adding network devices to CloudStack. They all need some common facilities: - Physical Network that is served by Device - Device IP Address/Name - UserName / Password - Certificate Import facility for Device if using secure connection In addition each device might have device specific custom fields that need to be entered, e.g. Nicira device needs the Transport Zone. -Soheil
RE: Add Device for Plugins
I found GUI to add devices under the Physical Network Configure Network Service Providers The GUI is for a subset of all the devices (Virtual Router, Security Groups, NetScaler, Nicira and BigSwitch.) -Soheil From: Soheil Eizadi Sent: Wednesday, June 05, 2013 9:36 AM To: dev@cloudstack.apache.org Subject: Add Device for Plugins Has there been any discussion of common GUI and abstraction for adding network devices to CloudStack. They all need some common facilities: - Physical Network that is served by Device - Device IP Address/Name - UserName / Password - Certificate Import facility for Device if using secure connection In addition each device might have device specific custom fields that need to be entered, e.g. Nicira device needs the Transport Zone. -Soheil
Storage VM to Management Server Connectivity Problem
I am bringing up a Storage VM on my XenServer that is running on My MAC. I noticed that the Management Server IP Address is incorrect 192.168.56.1 versus 172.16.197.1. Checking if this is something others have seen? This address is in the last boot record for the Storage VM. The IP Address 192.168.56.1 is not valid on my MAC, at least not right now! -Soheil Storage VM root@s-1-VM:~# /usr/local/cloud/systemvm/ssvm-check.sh First DNS server is 172.16.197.135 PING 172.16.197.135 (172.16.197.135): 56 data bytes 64 bytes from 172.16.197.135: icmp_seq=0 ttl=64 time=17.099 ms 64 bytes from 172.16.197.135: icmp_seq=1 ttl=64 time=0.783 ms --- 172.16.197.135 ping statistics --- 2 packets transmitted, 2 packets received, 0% packet loss round-trip min/avg/max/stddev = 0.783/8.941/17.099/8.158 ms Good: Can ping DNS server Good: DNS resolves download.cloud.com NFS is currently mounted Management server is 192.168.56.1. Checking connectivity. ERROR: Cannot connect to 192.168.56.1 port 8250 2013/05/10 14:23:02 socat[9304] E connecting to AF=2 192.168.56.1:8250: Connection timed out root@s-1-VM:~# ifconfig eth0 Link encap:Ethernet HWaddr 0e:00:a9:fe:02:74 inet addr:169.254.2.116 Bcast:169.254.255.255 Mask:255.255.0.0 inet6 addr: fe80::c00:a9ff:fefe:274/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:234 errors:0 dropped:0 overruns:0 frame:0 TX packets:131 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:16832 (16.4 KiB) TX bytes:18684 (18.2 KiB) Interrupt:8 eth1 Link encap:Ethernet HWaddr 06:ea:18:00:00:1d inet addr:172.16.197.128 Bcast:172.16.197.255 Mask:255.255.255.0 inet6 addr: fe80::4ea:18ff:fe00:1d/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:7660 errors:0 dropped:0 overruns:0 frame:0 TX packets:7263 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:725043 (708.0 KiB) TX bytes:493022 (481.4 KiB) Interrupt:9 eth2 Link encap:Ethernet HWaddr 06:e3:d0:00:00:34 inet addr:172.16.197.160 Bcast:172.16.197.255 Mask:255.255.255.0 inet6 addr: fe80::4e3:d0ff:fe00:34/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:4460 errors:0 dropped:0 overruns:0 frame:0 TX packets:4 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:576789 (563.2 KiB) TX bytes:408 (408.0 B) Interrupt:10 eth3 Link encap:Ethernet HWaddr 06:b3:52:00:00:06 inet addr:172.16.197.105 Bcast:172.16.197.255 Mask:255.255.255.0 inet6 addr: fe80::4b3:52ff:fe00:6/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:4462 errors:0 dropped:0 overruns:0 frame:0 TX packets:4 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:576893 (563.3 KiB) TX bytes:408 (408.0 B) Interrupt:11 loLink encap:Local Loopback inet addr:127.0.0.1 Mask:255.0.0.0 inet6 addr: ::1/128 Scope:Host UP LOOPBACK RUNNING MTU:16436 Metric:1 RX packets:8 errors:0 dropped:0 overruns:0 frame:0 TX packets:8 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:560 (560.0 B) TX bytes:560 (560.0 B) Last Boot Record on XenServer for the Storage VM (Note host=192.168.56.1%port=8250) last-boot-record ( RO): '('struct' ('uuid' '4d44e826-2830-29f1-6610-7d7b27ab7b1f') ('allowed_operations' ('array' 'changing_dynamic_range' 'pool_migrate' 'changing_VCPUs_live' 'suspend' 'hard_reboot' 'hard_shutdown' 'clean_reboot' 'clean_shutdown' 'pause' 'checkpoint' 'snapshot')) ('current_operations' ('struct')) ('power_state' 'Running') ('name_label' 's-1-VM') ('name_description' 'Template that allows VM installation from Xen-aware Debian-based distros. To use this template from the CLI, install your VM using vm-install, then set other-config-install-repository to the path to your network repository, e.g. http://server/path In order to install Debian Squeeze from CD/DVD the multi-arch ISO image is required.') ('user_version' '1') ('is_a_template' ('boolean' '0')) ('suspend_VDI' 'OpaqueRef:NULL') ('resident_on' 'OpaqueRef:c74b3193-ee6e-1068-be81-6764bf33b391') ('affinity' 'OpaqueRef:c74b3193-ee6e-1068-be81-6764bf33b391') ('memory_overhead' '101711872') ('memory_target' '104857600') ('memory_static_max' '8589934592') ('memory_dynamic_max' '104857600') ('memory_dynamic_min' '104857600') ('memory_static_min' '134217728')
PhysicalNetworkServiceProviderDaoImpl.java / findByServiceProvider
I am looking at the code for findByServiceProvider in PhysicalNetworkServiceProviderDaoImpl.java: public PhysicalNetworkServiceProviderVO findByServiceProvider(long physicalNetworkId, String providerType) { SearchCriteriaPhysicalNetworkServiceProviderVO sc = physicalNetworkServiceProviderSearch.create(); sc.setParameters(physicalNetworkId, physicalNetworkId); sc.setParameters(serviceProvderType, providerType); return findOneBy(sc); } I don't see a field serviceProvderType (even if I fix the typo!) Am I missing something, it seems like this code is being used by the Networking code in the plugins. Seems like this should be changed to: public PhysicalNetworkServiceProviderVO findByServiceProvider(long physicalNetworkId, String providerName) { .. sc.setParameters(providerName, providerName); return findOneBy(sc); }
RE: CloudMonkey handling of Job Status Error Code
Yes, I installed it from PIP. Here is the version I get from it: Administrators-MacBook-Pro-7:~ seizadi$ cloudmonkey --version cloudmonkey 4.1.0-snapshot3 Command Line Interface for Apache CloudStack (http://incubator.apache.org/cloudstack) From: Prasanna Santhanam [t...@apache.org] Sent: Thursday, May 30, 2013 10:43 PM To: dev@cloudstack.apache.org Cc: bhais...@apache.org Subject: Re: CloudMonkey handling of Job Status Error Code On Fri, May 31, 2013 at 01:49:02AM +, Soheil Eizadi wrote: I don't know if the following is a known issue, while testing some negative test case, I added a device that was not part of network provider associated with the physical network from CloudMonkey, from the log I could see that they system returned an error as expected, but looks like CloudMonkey ignored the error and continued to poll the management server. -Soheil add infobloxdevice hostname=172.16.197.135 username=admin password=infoblox physicalnetworkid=cbcd337c-f024-47f3-b2d5-8ccfd73e9d52 Should've returned the error code. Is cloudmonkey installed from pip? . ^C 2013-05-30 18:03:39,253 DEBUG [cloud.async.AsyncJobManagerImpl] (Job-Executor-8:job-9) Executing org.apache.cloudstack.api.commands.AddInfobloxDeviceCmd for job-9 2013-05-30 18:03:39,293 DEBUG [cloud.api.ApiServlet] (1251250440@qtp-2080315477-50:null) ===END=== 0:0:0:0:0:0:0:1%0 -- GET apiKey=6Zj6pYbBnuIfJVKwIz4p8CcLffQ_qjQ7RuAxRLQChw6TJ74i3Zsp6ILhK4rpYlTaYF7ZijFJROc60VaMZvSiIgcommand=addInfobloxDevicehostname=172.16.197.135physicalnetworkid=cbcd337c-f024-47f3-b2d5-8ccfd73e9d52response=jsonusername=adminsignature=2zLO7njMWlL6oMX91d7JINFcKbg%3D 2013-05-30 18:03:42,908 DEBUG [cloud.api.ApiServlet] (1251250440@qtp-2080315477-50:null) ===START=== 0:0:0:0:0:0:0:1%0 -- GET apiKey=6Zj6pYbBnuIfJVKwIz4p8CcLffQ_qjQ7RuAxRLQChw6TJ74i3Zsp6ILhK4rpYlTaYF7ZijFJROc60VaMZvSiIgcommand=queryAsyncJobResultjobid=f6895915-bcc5-4e7c-84f9-4dbbbc236de4response=jsonsignature=%2Fedf6ovt%2BwtRZRMLKfA%2FfrZkTEQ%3D 2013-05-30 18:03:44,886 DEBUG [cloud.async.AsyncJobManagerImpl] (Job-Executor-8:job-9) Complete async job-9, jobStatus: 2, resultCode: 530, result: Error Code: 530 Error text: Network Service Provider: Infoblox is not enabled in the physical network: 200to add this device 2013-05-30 18:03:45,852 DEBUG [cloud.api.ApiServlet] (1251250440@qtp-2080315477-50:null) ===END=== 0:0:0:0:0:0:0:1%0 -- GET apiKey=6Zj6pYbBnuIfJVKwIz4p8CcLffQ_qjQ7RuAxRLQChw6TJ74i3Zsp6ILhK4rpYlTaYF7ZijFJROc60VaMZvSiIgcommand=queryAsyncJobResultjobid=f6895915-bcc5-4e7c-84f9-4dbbbc236de4response=jsonsignature=%2Fedf6ovt%2BwtRZRMLKfA%2FfrZkTEQ%3D 2013-05-30 18:03:45,864 DEBUG [cloud.cluster.ClusterManagerImpl] (Cluster-Heartbeat-1:null) Management server heartbeat takes too long to finish. profiler: Done. Duration: 1507ms, profilerHeartbeatUpdate: Done. Duration: 1506ms, profilerPeerScan: Done. Duration: 1ms, profilerAgentLB: Done. Duration: 0ms 2013-05-30 18:03:48,869 DEBUG [cloud.api.ApiServlet] (1251250440@qtp-2080315477-50:null) ===START=== 0:0:0:0:0:0:0:1%0 -- GET apiKey=6Zj6pYbBnuIfJVKwIz4p8CcLffQ_qjQ7RuAxRLQChw6TJ74i3Zsp6ILhK4rpYlTaYF7ZijFJROc60VaMZvSiIgcommand=queryAsyncJobResultjobid=f6895915-bcc5-4e7c-84f9-4dbbbc236de4response=jsonsignature=%2Fedf6ovt%2BwtRZRMLKfA%2FfrZkTEQ%3D 2013-05-30 18:03:48,877 DEBUG [cloud.async.AsyncJobManagerImpl] (1251250440@qtp-2080315477-50:null) Async job-9 completed 2013-05-30 18:03:49,022 DEBUG [cloud.api.ApiServlet] (1251250440@qtp-2080315477-50:null) ===END=== 0:0:0:0:0:0:0:1%0 -- GET apiKey=6Zj6pYbBnuIfJVKwIz4p8CcLffQ_qjQ7RuAxRLQChw6TJ74i3Zsp6ILhK4rpYlTaYF7ZijFJROc60VaMZvSiIgcommand=queryAsyncJobResultjobid=f6895915-bcc5-4e7c-84f9-4dbbbc236de4response=jsonsignature=%2Fedf6ovt%2BwtRZRMLKfA%2FfrZkTEQ%3D 2013-05-30 18:03:51,566 DEBUG [cloud.server.StatsCollector] (StatsCollector-3:null) VmStatsCollector is running... 2013-05-30 18:03:52,067 DEBUG [cloud.api.ApiServlet] (1251250440@qtp-2080315477-50:null) ===START=== 0:0:0:0:0:0:0:1%0 -- GET apiKey=6Zj6pYbBnuIfJVKwIz4p8CcLffQ_qjQ7RuAxRLQChw6TJ74i3Zsp6ILhK4rpYlTaYF7ZijFJROc60VaMZvSiIgcommand=queryAsyncJobResultjobid=f6895915-bcc5-4e7c-84f9-4dbbbc236de4response=jsonsignature=%2Fedf6ovt%2BwtRZRMLKfA%2FfrZkTEQ%3D 2013-05-30 18:03:52,213 DEBUG [cloud.async.AsyncJobManagerImpl] (1251250440@qtp-2080315477-50:null) Async job-9 completed 2013-05-30 18:03:52,239 DEBUG [cloud.api.ApiServlet] (1251250440@qtp-2080315477-50:null) ===END=== 0:0:0:0:0:0:0:1%0 -- GET apiKey=6Zj6pYbBnuIfJVKwIz4p8CcLffQ_qjQ7RuAxRLQChw6TJ74i3Zsp6ILhK4rpYlTaYF7ZijFJROc60VaMZvSiIgcommand=queryAsyncJobResultjobid=f6895915-bcc5-4e7c-84f9-4dbbbc236de4response=jsonsignature=%2Fedf6ovt%2BwtRZRMLKfA%2FfrZkTEQ%3D -- Prasanna., Powered by BigRock.com
CloudMonkey handling of Job Status Error Code
I don't know if the following is a known issue, while testing some negative test case, I added a device that was not part of network provider associated with the physical network from CloudMonkey, from the log I could see that they system returned an error as expected, but looks like CloudMonkey ignored the error and continued to poll the management server. -Soheil add infobloxdevice hostname=172.16.197.135 username=admin password=infoblox physicalnetworkid=cbcd337c-f024-47f3-b2d5-8ccfd73e9d52 . ^C 2013-05-30 18:03:39,253 DEBUG [cloud.async.AsyncJobManagerImpl] (Job-Executor-8:job-9) Executing org.apache.cloudstack.api.commands.AddInfobloxDeviceCmd for job-9 2013-05-30 18:03:39,293 DEBUG [cloud.api.ApiServlet] (1251250440@qtp-2080315477-50:null) ===END=== 0:0:0:0:0:0:0:1%0 -- GET apiKey=6Zj6pYbBnuIfJVKwIz4p8CcLffQ_qjQ7RuAxRLQChw6TJ74i3Zsp6ILhK4rpYlTaYF7ZijFJROc60VaMZvSiIgcommand=addInfobloxDevicehostname=172.16.197.135physicalnetworkid=cbcd337c-f024-47f3-b2d5-8ccfd73e9d52response=jsonusername=adminsignature=2zLO7njMWlL6oMX91d7JINFcKbg%3D 2013-05-30 18:03:42,908 DEBUG [cloud.api.ApiServlet] (1251250440@qtp-2080315477-50:null) ===START=== 0:0:0:0:0:0:0:1%0 -- GET apiKey=6Zj6pYbBnuIfJVKwIz4p8CcLffQ_qjQ7RuAxRLQChw6TJ74i3Zsp6ILhK4rpYlTaYF7ZijFJROc60VaMZvSiIgcommand=queryAsyncJobResultjobid=f6895915-bcc5-4e7c-84f9-4dbbbc236de4response=jsonsignature=%2Fedf6ovt%2BwtRZRMLKfA%2FfrZkTEQ%3D 2013-05-30 18:03:44,886 DEBUG [cloud.async.AsyncJobManagerImpl] (Job-Executor-8:job-9) Complete async job-9, jobStatus: 2, resultCode: 530, result: Error Code: 530 Error text: Network Service Provider: Infoblox is not enabled in the physical network: 200to add this device 2013-05-30 18:03:45,852 DEBUG [cloud.api.ApiServlet] (1251250440@qtp-2080315477-50:null) ===END=== 0:0:0:0:0:0:0:1%0 -- GET apiKey=6Zj6pYbBnuIfJVKwIz4p8CcLffQ_qjQ7RuAxRLQChw6TJ74i3Zsp6ILhK4rpYlTaYF7ZijFJROc60VaMZvSiIgcommand=queryAsyncJobResultjobid=f6895915-bcc5-4e7c-84f9-4dbbbc236de4response=jsonsignature=%2Fedf6ovt%2BwtRZRMLKfA%2FfrZkTEQ%3D 2013-05-30 18:03:45,864 DEBUG [cloud.cluster.ClusterManagerImpl] (Cluster-Heartbeat-1:null) Management server heartbeat takes too long to finish. profiler: Done. Duration: 1507ms, profilerHeartbeatUpdate: Done. Duration: 1506ms, profilerPeerScan: Done. Duration: 1ms, profilerAgentLB: Done. Duration: 0ms 2013-05-30 18:03:48,869 DEBUG [cloud.api.ApiServlet] (1251250440@qtp-2080315477-50:null) ===START=== 0:0:0:0:0:0:0:1%0 -- GET apiKey=6Zj6pYbBnuIfJVKwIz4p8CcLffQ_qjQ7RuAxRLQChw6TJ74i3Zsp6ILhK4rpYlTaYF7ZijFJROc60VaMZvSiIgcommand=queryAsyncJobResultjobid=f6895915-bcc5-4e7c-84f9-4dbbbc236de4response=jsonsignature=%2Fedf6ovt%2BwtRZRMLKfA%2FfrZkTEQ%3D 2013-05-30 18:03:48,877 DEBUG [cloud.async.AsyncJobManagerImpl] (1251250440@qtp-2080315477-50:null) Async job-9 completed 2013-05-30 18:03:49,022 DEBUG [cloud.api.ApiServlet] (1251250440@qtp-2080315477-50:null) ===END=== 0:0:0:0:0:0:0:1%0 -- GET apiKey=6Zj6pYbBnuIfJVKwIz4p8CcLffQ_qjQ7RuAxRLQChw6TJ74i3Zsp6ILhK4rpYlTaYF7ZijFJROc60VaMZvSiIgcommand=queryAsyncJobResultjobid=f6895915-bcc5-4e7c-84f9-4dbbbc236de4response=jsonsignature=%2Fedf6ovt%2BwtRZRMLKfA%2FfrZkTEQ%3D 2013-05-30 18:03:51,566 DEBUG [cloud.server.StatsCollector] (StatsCollector-3:null) VmStatsCollector is running... 2013-05-30 18:03:52,067 DEBUG [cloud.api.ApiServlet] (1251250440@qtp-2080315477-50:null) ===START=== 0:0:0:0:0:0:0:1%0 -- GET apiKey=6Zj6pYbBnuIfJVKwIz4p8CcLffQ_qjQ7RuAxRLQChw6TJ74i3Zsp6ILhK4rpYlTaYF7ZijFJROc60VaMZvSiIgcommand=queryAsyncJobResultjobid=f6895915-bcc5-4e7c-84f9-4dbbbc236de4response=jsonsignature=%2Fedf6ovt%2BwtRZRMLKfA%2FfrZkTEQ%3D 2013-05-30 18:03:52,213 DEBUG [cloud.async.AsyncJobManagerImpl] (1251250440@qtp-2080315477-50:null) Async job-9 completed 2013-05-30 18:03:52,239 DEBUG [cloud.api.ApiServlet] (1251250440@qtp-2080315477-50:null) ===END=== 0:0:0:0:0:0:0:1%0 -- GET apiKey=6Zj6pYbBnuIfJVKwIz4p8CcLffQ_qjQ7RuAxRLQChw6TJ74i3Zsp6ILhK4rpYlTaYF7ZijFJROc60VaMZvSiIgcommand=queryAsyncJobResultjobid=f6895915-bcc5-4e7c-84f9-4dbbbc236de4response=jsonsignature=%2Fedf6ovt%2BwtRZRMLKfA%2FfrZkTEQ%3D
RE: Palo Alto Firewall Integration - Review Process
This Wiki below might be of interst for unit tests and integrating into the build. The wiki does not go into the detail of how to setup a Maven project for unit test but you can get the recipe from one of the other projects.I have been running the JUnit tests from the Eclipse IDE, without having to do a system build. I would suggest you use the NicriaNVP a sample project for this more complete than I found in other projects. It does not have any unit tests for talking the real end device but you can write that also in JUnit and test you Device Specific API code. -Soheil https://cwiki.apache.org/confluence/display/CLOUDSTACK/Unit+Testing+with+JUnit+and+Spring From: Chip Childers [chip.child...@sungard.com] Sent: Tuesday, May 28, 2013 1:33 PM To: dev@cloudstack.apache.org Subject: Re: Palo Alto Firewall Integration - Review Process On Tue, May 28, 2013 at 04:31:27PM -0400, Will Stevens wrote: Thanks for the reply Chip. Are there any docs / guides for the test functionality? Yup: https://cwiki.apache.org/confluence/display/CLOUDSTACK/Marvin+-+Testing+with+Python
HttpClient 3.x versus 4.x upgrade
I am writing a new CloudStack Module and intend to use the newer Apache HttpClient 4.x library. I noted that none of the current CloudStack modules use this, they are using the older HttpClient 3.x that has been EOL by Apache. Commons HttpClient 3.x codeline is at the end of life. All users of Commons HttpClient 3.x are strongly encouraged to upgrade to HttpClient 4.1 http://hc.apache.org/httpclient-3.x/ Just wanted to the community aware of this issue and we can track it. -Soheil