Re: When i update 4.2.1 to 4.3.0,console don't work
I updated my CS from 4.2.1 to 4.3.0. Once operation has been completed , the console feature in UI can't work yet, then i try your method to change global config *.realhostip.com(default) to realhostip.com and it works. Hope this can help u .
Re: Snapshot exceptions on 4.2.1 with NFS and S3
Nux! Thanks for this link. I found this earlier through the list also. I initially discounted it as it seemed to be talking about VM snapshots on CentOS 6.5 and I'm having trouble with Volume snapshots on COS 6.4. However, I checked what version of RPM I had installed: Installed on my COS 6.4 box: - qemu-img-0.12.1.2-2.415.el6_5.6.x86_64 Your linked page shows this version: - qemu-img-0.12.1.2-2.355.el6_4_4.1.x86_64.rpm Hmmm. Different. My RPM looks like a newer version. I had a look at yum info qemu-img and my package comes from 6.4 Updates. Anyway - decided to uninstall my package and install the 355 version that you were using. After installing I rebooted. I really didn't expect anything to change but Volume Snapshots now work! YEAH! Snapshot also goes all the way to S3 so that part is working fine too. Happy days and thanks for your help! Tom. On Wed, 2014-04-02 at 02:08 +0100, Nux! wrote: On 27.03.2014 02:55, Thomas O'Dowd wrote: I remember this used to work on Cloudstack 4.2 when I was testing it with devcloud but with CloudPlatform 4.2.1 and KVM I can't get snapshots to work. Might be this http://www.nux.ro/archive/2014/01/Taking_KVM_volume_snapshots_with_Cloudstack_4_2_on_CentOS_6_5.html And update your OS. :) -- Cloudian KK - http://www.cloudian.com/get-started.html Fancy 10TB of full featured S3 Storage? Checkout the Cloudian® Community Edition!
RE: VPN for VPC feature in 4.3
Praveen, I can confirm that User VPN for VPC works just like the User VPN for a normal VR, but looking at your output below, you are missing eth2 Regards Geoff Higginbottom D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581 geoff.higginbot...@shapeblue.com -Original Message- From: Praveen Buravilli [mailto:praveen.buravi...@citrix.com] Sent: 02 April 2014 03:37 To: users@cloudstack.apache.org Subject: VPN for VPC feature in 4.3 Hi, I have noticed an issue in working with VPN for VPC which is a new feature introduced in CloudStack 4.3(1.1.6 Remote Access VPN for VPC section of CloudStack 4.3 release notes). Regular remote VPN for guest networks fine without any problem whereas, VPN for VPN isn't working. When I checked the VPC router, there is no IP address assigned to its public Nic. Has anyone noticed this behaviour? Does this seem like a bug? Any known workaround available? VPC router interface details: === root@r-38-VM:/etc/network# ifconfig -a eth0 Link encap:Ethernet HWaddr 0e:00:a9:fe:00:7d inet addr:169.254.0.125 Bcast:169.254.255.255 Mask:255.255.0.0 inet6 addr: fe80::c00:a9ff:fefe:7d/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:1478 errors:0 dropped:0 overruns:0 frame:0 TX packets:722 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:126628 (123.6 KiB) TX bytes:124068 (121.1 KiB) eth1 Link encap:Ethernet HWaddr 06:59:68:00:00:1a BROADCAST MULTICAST MTU:1500 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:0 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:0 (0.0 B) TX bytes:0 (0.0 B) loLink encap:Local Loopback inet addr:127.0.0.1 Mask:255.0.0.0 inet6 addr: ::1/128 Scope:Host UP LOOPBACK RUNNING MTU:16436 Metric:1 RX packets:2 errors:0 dropped:0 overruns:0 frame:0 TX packets:2 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:214 (214.0 B) TX bytes:214 (214.0 B) Thanks, Praveen Kumar Need Enterprise Grade Support for Apache CloudStack? Our CloudStack Infrastructure Supporthttp://shapeblue.com/cloudstack-infrastructure-support/ offers the best 24/7 SLA for CloudStack Environments. Apache CloudStack Bootcamp training courses **NEW!** CloudStack 4.2.1 traininghttp://shapeblue.com/cloudstack-training/ 18th-19th February 2014, Brazil. Classroomhttp://shapeblue.com/cloudstack-training/ 17th-23rd March 2014, Region A. Instructor led, On-linehttp://shapeblue.com/cloudstack-training/ 24th-28th March 2014, Region B. Instructor led, On-linehttp://shapeblue.com/cloudstack-training/ 16th-20th June 2014, Region A. Instructor led, On-linehttp://shapeblue.com/cloudstack-training/ 23rd-27th June 2014, Region B. Instructor led, On-linehttp://shapeblue.com/cloudstack-training/ This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
RE: When i update 4.2.1 to 4.3.0,console don't work
Hi I'm getting the same dns errors on the cloudstack Console Restarted VM Console And can ping and dns resolves fine from the consoles command prompt rolled back to 4.2.1 it's fine Please confirm if it's a bug Regards -Original Message- From: ma y [mailto:breeze7...@gmail.com] Sent: 02 April 2014 03:00 To: cloudstack-us...@incubator.apache.org Subject: When i update 4.2.1 to 4.3.0,console don't work When i open vm console, i got this info from management server log ,like https://192-168-28-2.*.realhostip.com/...,and it don't work. I think the problem is my computer can't resolve this domain name 192-168-28-2.*.realhostip.com. In CS 4.2.1 , that domain name like 192-168-28-2.realhostip.com , and it works well. So, is this a bug for CS 4.3.0 ? How to fix this? Thks!
RE: When i update 4.2.1 to 4.3.0,console don't work
Amough is on the money Fixed mine move from global settings consoleproxy.url.domain from *.realhostip.com to realhostip.com Regards Martin -Original Message- From: Martin Knott [mailto:mkn...@novemgroup.co.uk] Sent: 02 April 2014 10:15 To: users@cloudstack.apache.org Subject: RE: When i update 4.2.1 to 4.3.0,console don't work Hi I'm getting the same dns errors on the cloudstack Console Restarted VM Console And can ping and dns resolves fine from the consoles command prompt rolled back to 4.2.1 it's fine Please confirm if it's a bug Regards -Original Message- From: ma y [mailto:breeze7...@gmail.com] Sent: 02 April 2014 03:00 To: cloudstack-us...@incubator.apache.org Subject: When i update 4.2.1 to 4.3.0,console don't work When i open vm console, i got this info from management server log ,like https://192-168-28-2.*.realhostip.com/...,and it don't work. I think the problem is my computer can't resolve this domain name 192-168-28-2.*.realhostip.com. In CS 4.2.1 , that domain name like 192-168-28-2.realhostip.com , and it works well. So, is this a bug for CS 4.3.0 ? How to fix this? Thks!
Is it possible to run Virualbox vm Cloudstack vm using kvm as hypervisor together?
Hello, Is it possible to run Virualbox vm Cloudstack vm using kvm as hypervisor together? As my Virtualbox vm keep on getting stuck at starting state. Sugandh
Unable to deploy systemvms
Hi, I am trying to create system vms, in CS 4.3 with Xenserver 6.2 I am trying to create advance zone. I have 2nics. 1 for management network second is trunk. I am getting below error 2014-04-02 15:18:28,827 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl] (consoleproxy-1:ctx-774da64a) template 1 is already in store:1, type:Image 2014-04-02 15:18:28,831 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl] (consoleproxy-1:ctx-774da64a) template 1 is already in store:1, type:Primary 2014-04-02 15:18:28,832 DEBUG [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-774da64a) Found template routing-1 in storage pool 1 with VMTemplateStoragePool id: 4 2014-04-02 15:18:28,840 DEBUG [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-774da64a) Acquire lock on VMTemplateStoragePool 4 with timeout 3600 seconds 2014-04-02 15:18:30,903 WARN [c.c.h.x.r.XenServerStorageProcessor] (DirectAgent-111:ctx-f68bde71) destoryVDIbyNameLabel failed due to there are 0 VDIs with name cloud-cff5e443-72df-4aae-a4fd-1278fc0cbeb4 2014-04-02 15:18:30,903 WARN [c.c.h.x.r.XenServerStorageProcessor] (DirectAgent-111:ctx-f68bde71) can not create vdi in sr d2bf95cc-8761-c31d-37a5-173304cc621e 2014-04-02 15:18:30,904 WARN [c.c.h.x.r.XenServerStorageProcessor] (DirectAgent-111:ctx-f68bde71) Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr d2bf95cc-8761-c31d-37a5-173304cc621e com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr d2bf95cc-8761-c31d-37a5-173304cc621e at com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.copy_vhd_from_secondarystorage(XenServerStorageProcessor.java:848) at com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.copyTemplateToPrimaryStorage(XenServerStorageProcessor.java:918) at com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(StorageSubsystemCommandHandlerBase.java:75) at com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStorageCommands(StorageSubsystemCommandHandlerBase.java:50) at com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:609) at com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:59) at com.cloud.hypervisor.xen.resource.XenServer610Resource.executeRequest(XenServer610Resource.java:106) at com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:216) at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53) at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) at java.lang.Thread.run(Thread.java:679) 2014-04-02 15:18:30,904 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-111:ctx-f68bde71) Seq 1-524878146: Response Received: 2014-04-02 15:18:30,904 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-111:ctx-f68bde71) Seq 1-524878146: Response Received: 2014-04-02 15:18:30,905 DEBUG [c.c.a.t.Request] (DirectAgent-111:ctx-f68bde71) Seq 1-524878146: Processing: { Ans: , MgmtId: 345049296663, via: 1, Ver: v1, Flags: 10, [{org.apache.cloudstack.storage.command.CopyCmdAnswer:{result:false,details:Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr d2bf95cc-8761-c31d-37a5-173304cc621e,wait:0}}] } 2014-04-02 15:18:30,905 DEBUG [c.c.a.t.Request] (secstorage-1:ctx-4d6c3938) Seq 1-524878146: Received: { Ans: , MgmtId: 345049296663, via: 1, Ver: v1, Flags: 10, { CopyCmdAnswer } } 2014-04-02 15:18:30,915 INFO [o.a.c.s.v.VolumeServiceImpl] (secstorage-1:ctx-4d6c3938) releasing lock for VMTemplateStoragePool 4 2014-04-02 15:18:30,915 WARN [c.c.u.d.Merovingian2] (secstorage-1:ctx-4d6c3938) Was unable to find lock for the key template_spool_ref4 and thread id 404723302 2014-04-02 15:18:30,915 DEBUG [o.a.c.e.o.VolumeOrchestrator]
RE: VPN for VPC feature in 4.3
Thanks Geoff. Actually, eth1 for VPC router is missing. When I looked at log file, surprisingly a request has been sent to create router VM with two NICs(one link local and other public) whereas, the router was created with only one NIC. Any thoughts? fyi, I'm running CloudStack 4.3 with KVM nodes. Here attached is log file snippet containing both request and response info on router start command: (Highlighted NIC entries in the log with red and green texts). == 2014-04-02 06:00:47,968 DEBUG [c.c.a.t.Request] (Job-Executor-35:ctx-544b3513 ctx-5d9c4b47) Seq 6-1545667825: Sending { Cmd , MgmtId: 52237010300, via: 6(localhost.localdomain), Ver: v1, Flags: 100111, [{com.cloud.agent.api.StartCommand:{vm:{id:43,name:r-43-VM,type:DomainRouter,cpus:1,minSpeed:500,maxSpeed:500,minRam:134217728,maxRam:134217728,arch:x86_64,os:Debian GNU/Linux 7(64-bit),bootArgs: vpccidr=10.201.0.0/16 domain=cs7cloud.internal dns1=8.8.8.8 template=domP name=r-43-VM eth0ip=169.254.1.131 eth0mask=255.255.0.0 type=vpcrouter disable_rp_filter=true,rebootOnCrash:false,enableHA:true,limitCpuUse:false,enableDynamicallyScaleVm:false,vncPassword:21a870dc7723830,params:{},uuid:05b714cf-a511-42d9-b24a-6d077342865f,disks:[{data:{org.apache.cloudstack.storage.to.VolumeObjectTO:{uuid:b61da4e1-121e-4e02-b345-35719deec994,volumeType:ROOT,dataStore:{org.apache.cloudstack.storage.to.PrimaryDataStoreTO:{uuid:90ffa1df-e8bd-3e46-893d-bb9b63e0b180,id:2,poolType:NetworkFilesystem,host:172.20.105.2,path:/export/praveen/csprimary,port:2049,url:NetworkFilesystem://172.20.105.2//export/praveen/csprimary/?ROLE=PrimarySTOREUUID=90ffa1df-e8bd-3e46-893d-bb9b63e0b180}},name:ROOT-43,size:262144,path:b61da4e1-121e-4e02-b345-35719deec994,volumeId:46,vmName:r-43-VM,accountId:7,format:QCOW2,id:46,deviceId:0,hypervisorType:KVM}},diskSeq:0,path:b61da4e1-121e-4e02-b345-35719deec994,type:ROOT,_details:{managed:false,storagePort:2049,storageHost:172.20.105.2,volumeSize:262144}}],nics:[{deviceId:0,networkRateMbps:-1,defaultNic:false,uuid:2d4b2574-5e7d-45e7-bcbb-f64d1d9237c1,ip:169.254.1.131,netmask:255.255.0.0,gateway:169.254.0.1,mac:0e:00:a9:fe:01:83,broadcastType:LinkLocal,type:Control,isSecurityGroupEnabled:false}]},hostIp:172.20.210.7,executeInSequence:false,wait:0}},{com.cloud.agent.api.check.CheckSshCommand:{ip:169.254.1.131,port:3922,interval:6,retries:100,name:r-43-VM,wait:0}},{com.cloud.agent.api.GetDomRVersionCmd:{accessDetails:{router.ip:169.254.1.131,router.name:r-43-VM},wait:0}},{com.cloud.agent.api.PlugNicCommand:{nic:{deviceId:1,networkRateMbps:200,defaultNic:true,uuid:7f27078c-2123-4e53-9d4c-df2c6e4cb844,ip:172.20.211.132,netmask:255.255.255.0,gateway:172.20.211.1,mac:06:41:1a:00:00:20,broadcastType:Vlan,type:Public,broadcastUri:vlan://211,isolationUri:vlan://211,isSecurityGroupEnabled:false,name:cloudbr1},instanceName:r-43-VM,vmType:DomainRouter,wait:0}},{com.cloud.agent.api.routing.IpAssocVpcCommand:{ipAddresses:[{accountId:7,publicIp:172.20.211.132,sourceNat:true,add:true,oneToOneNat:false,firstIP:false,broadcastUri:211,vlanGateway:172.20.211.1,vlanNetmask:255.255.255.0,vifMacAddress:06:41:1a:00:00:20,networkRate:200,trafficType:Public,networkName:cloudbr1}],accessDetails:{router.guest.ip:172.20.211.132,zone.network.type:Advanced,router.ip:169.254.1.131,router.name:r-43-VM},wait:0}},{com.cloud.agent.api.routing.SetSourceNatCommand:{ipAddress:{accountId:7,publicIp:172.20.211.132,sourceNat:true,add:true,oneToOneNat:false,firstIP:false,broadcastUri:211,vlanGateway:172.20.211.1,vlanNetmask:255.255.255.0,vifMacAddress:06:41:1a:00:00:20,networkRate:200,trafficType:Public,networkName:cloudbr1},add:true,accessDetails:{zone.network.type:Advanced,router.ip:169.254.1.131,router.name:r-43-VM},wait:0}},{}] } 2014-04-02 06:01:43,695 DEBUG [c.c.a.t.Request] (AgentManager-Handler-10:null) Seq 6-1545667825: Processing: { Ans: , MgmtId: 52237010300, via: 6, Ver: v1, Flags: 110, [{com.cloud.agent.api.StartAnswer:{vm:{id:43,name:r-43-VM,type:DomainRouter,cpus:1,minSpeed:500,maxSpeed:500,minRam:134217728,maxRam:134217728,arch:x86_64,os:Debian GNU/Linux 7(64-bit),bootArgs: vpccidr=10.201.0.0/16 domain=cs7cloud.internal dns1=8.8.8.8 template=domP name=r-43-VM eth0ip=169.254.1.131 eth0mask=255.255.0.0 type=vpcrouter
RE: VPN for VPC feature in 4.3
Yes Benoit, I have 40% of free public IPs available. So, that should not be an issue. I don’t see any errors in log file too. Have you noticed any exceptions in log files by any chance when you encountered this issue? Thanks, Praveen Kumar -Original Message- From: benoit lair [mailto:kurushi4...@gmail.com] Sent: 02 April 2014 17:30 To: users@cloudstack.apache.org Subject: Re: VPN for VPC feature in 4.3 Hi Praveen, I already have this issue with vpc vr : Have you checked if you have some public ip adresses available on your zone ? Regards, Benoit. 2014-04-02 12:24 GMT+02:00 Praveen Buravilli praveen.buravi...@citrix.com: Thanks Geoff. Actually, eth1 for VPC router is missing. When I looked at log file, surprisingly a request has been sent to create router VM with two NICs(one link local and other public) whereas, the router was created with only one NIC. Any thoughts? fyi, I'm running CloudStack 4.3 with KVM nodes. Here attached is log file snippet containing both request and response info on router start command: (Highlighted NIC entries in the log with red and green texts). == 2014-04-02 06:00:47,968 DEBUG [c.c.a.t.Request] (Job-Executor-35:ctx-544b3513 ctx-5d9c4b47) Seq 6-1545667825: Sending { Cmd , MgmtId: 52237010300, via: 6(localhost.localdomain), Ver: v1, Flags: 100111, [{com.cloud.agent.api.StartCommand:{vm:{id:43,name:r-43-VM, type:DomainRouter,cpus:1,minSpeed:500,maxSpeed:500,minRam:1 34217728,maxRam:134217728,arch:x86_64,os:Debian GNU/Linux 7(64-bit),bootArgs: vpccidr=10.201.0.0/16domain=cs7cloud.internal dns1=8.8.8.8 template=domP name=r-43-VM eth0ip=169.254.1.131 eth0mask=255.255.0.0 type=vpcrouter disable_rp_filter=true,rebootOnCrash:false,enableHA:true,limitCp uUse:false,enableDynamicallyScaleVm:false,vncPassword:21a870dc77 23830,params:{},uuid:05b714cf-a511-42d9-b24a-6d077342865f,disk s:[{data:{org.apache.cloudstack.storage.to.VolumeObjectTO:{uuid :b61da4e1-121e-4e02-b345-35719deec994,volumeType:ROOT,dataStore :{org.apache.cloudstack.storage.to.PrimaryDataStoreTO:{uuid:90ff a1df-e8bd-3e46-893d-bb9b63e0b180,id:2,poolType:NetworkFilesystem ,host:172.20.105.2,path:/export/praveen/csprimary,port:2049 ,url:NetworkFilesystem:// 172.20.105.2//export/praveen/csprimary/?ROLE=PrimarySTOREUUID=90ffa1d f-e8bd-3e46-893d-bb9b63e0b180 }},name:ROOT-43,size:262144,path:b61da4e1-121e-4e02-b345-35719deec994,volumeId:46,vmName:r-43-VM,accountId:7,format:QCOW2,id:46,deviceId:0,hypervisorType:KVM}},diskSeq:0,path:b61da4e1-121e-4e02-b345-35719deec994,type:ROOT,_details:{managed:false,storagePort:2049,storageHost:172.20.105.2,volumeSize:262144}}],nics:[{deviceId:0,networkRateMbps:-1,defaultNic:false,uuid:2d4b2574-5e7d-45e7-bcbb-f64d1d9237c1,ip:169.254.1.131,netmask:255.255.0.0,gateway:169.254.0.1,mac:0e:00:a9:fe:01:83,broadcastType:LinkLocal,type:Control,isSecurityGroupEnabled:false}]},hostIp:172.20.210.7,executeInSequence:false,wait:0}},{com.cloud.agent.api.check.CheckSshCommand:{ip:169.254.1.131,port:3922,interval:6,retries:100,name:r-43-VM,wait:0}},{com.cloud.agent.api.GetDomRVersionCmd:{accessDetails:{router.ip:169.254.1.131, router.name :r-43-VM},wait:0}},{com.cloud.agent.api.PlugNicCommand:{nic:{deviceId:1,networkRateMbps:200,defaultNic:true,uuid:7f27078c-2123-4e53-9d4c-df2c6e4cb844,ip:172.20.211.132,netmask:255.255.255.0,gateway:172.20.211.1,mac:06:41:1a:00:00:20,broadcastType:Vlan,type:Public,broadcastUri:vlan://211,isolationUri:vlan://211,isSecurityGroupEnabled:false,name:cloudbr1},instanceName:r-43-VM,vmType:DomainRouter,wait:0}},{com.cloud.agent.api.routing.IpAssocVpcCommand:{ipAddresses:[{accountId:7,publicIp:172.20.211.132,sourceNat:true,add:true,oneToOneNat:false,firstIP:false,broadcastUri:211,vlanGateway:172.20.211.1,vlanNetmask:255.255.255.0,vifMacAddress:06:41:1a:00:00:20,networkRate:200,trafficType:Public,networkName:cloudbr1}],accessDetails:{router.guest.ip:172.20.211.132,zone.network.type:Advanced,router.ip:169.254.1.131, router.name :r-43-VM},wait:0}},{com.cloud.agent.api.routing.SetSourceNatCommand:{ipAddress:{accountId:7,publicIp:172.20.211.132,sourceNat:true,add:true,oneToOneNat:false,firstIP:false,broadcastUri:211,vlanGateway:172.20.211.1,vlanNetmask:255.255.255.0,vifMacAddress:06:41:1a:00:00:20,networkRate:200,trafficType:Public,networkName:cloudbr1},add:true,accessDetails:{zone.network.type:Advanced,router.ip:169.254.1.131, router.name:r-43-VM},wait:0}},{}] } 2014-04-02 06:01:43,695 DEBUG [c.c.a.t.Request] (AgentManager-Handler-10:null) Seq 6-1545667825: Processing: { Ans: , MgmtId: 52237010300, via: 6, Ver: v1, Flags: 110, [{com.cloud.agent.api.StartAnswer:{vm:{id:43,name:r-43-VM,t ype:DomainRouter,cpus:1,minSpeed:500,maxSpeed:500,minRam:13 4217728,maxRam:134217728,arch:x86_64,os:Debian GNU/Linux 7(64-bit),bootArgs: vpccidr=10.201.0.0/16domain=cs7cloud.internal dns1=8.8.8.8 template=domP
How do I remove a host from Cloudstack agent?
Hello all, I have two servers, one running both Cloudstack-server and Cloudstack-agent and the other one only running Cloudstack-agent. How do I remove the second host from Cloudstack. Thanks, Sugandh
Re: VPN for VPC feature in 4.3
Yes, i found exceptions in the log file, but the reason was because i ran out of public ips. Could you paste the complete mgmt log file onto pastebin.com ? Have you already succeded with the creation of a shared network including the creation of a vr vm ? Did it take a public ip ? By the past, i had issue with network's labeling onto my hypervisors (xenservers) and this is what caused this problem. Regards, Benoit Lair. 2014-04-02 13:19 GMT+02:00 Praveen Buravilli praveen.buravi...@citrix.com: Yes Benoit, I have 40% of free public IPs available. So, that should not be an issue. I don’t see any errors in log file too. Have you noticed any exceptions in log files by any chance when you encountered this issue? Thanks, Praveen Kumar -Original Message- From: benoit lair [mailto:kurushi4...@gmail.com] Sent: 02 April 2014 17:30 To: users@cloudstack.apache.org Subject: Re: VPN for VPC feature in 4.3 Hi Praveen, I already have this issue with vpc vr : Have you checked if you have some public ip adresses available on your zone ? Regards, Benoit. 2014-04-02 12:24 GMT+02:00 Praveen Buravilli praveen.buravi...@citrix.com : Thanks Geoff. Actually, eth1 for VPC router is missing. When I looked at log file, surprisingly a request has been sent to create router VM with two NICs(one link local and other public) whereas, the router was created with only one NIC. Any thoughts? fyi, I'm running CloudStack 4.3 with KVM nodes. Here attached is log file snippet containing both request and response info on router start command: (Highlighted NIC entries in the log with red and green texts). == 2014-04-02 06:00:47,968 DEBUG [c.c.a.t.Request] (Job-Executor-35:ctx-544b3513 ctx-5d9c4b47) Seq 6-1545667825: Sending { Cmd , MgmtId: 52237010300, via: 6(localhost.localdomain), Ver: v1, Flags: 100111, [{com.cloud.agent.api.StartCommand:{vm:{id:43,name:r-43-VM, type:DomainRouter,cpus:1,minSpeed:500,maxSpeed:500,minRam:1 34217728,maxRam:134217728,arch:x86_64,os:Debian GNU/Linux 7(64-bit),bootArgs: vpccidr=10.201.0.0/16domain=cs7cloud.internal dns1=8.8.8.8 template=domP name=r-43-VM eth0ip=169.254.1.131 eth0mask=255.255.0.0 type=vpcrouter disable_rp_filter=true,rebootOnCrash:false,enableHA:true,limitCp uUse:false,enableDynamicallyScaleVm:false,vncPassword:21a870dc77 23830,params:{},uuid:05b714cf-a511-42d9-b24a-6d077342865f,disk s:[{data:{org.apache.cloudstack.storage.to.VolumeObjectTO:{uuid :b61da4e1-121e-4e02-b345-35719deec994,volumeType:ROOT,dataStore :{org.apache.cloudstack.storage.to.PrimaryDataStoreTO:{uuid:90ff a1df-e8bd-3e46-893d-bb9b63e0b180,id:2,poolType:NetworkFilesystem ,host:172.20.105.2,path:/export/praveen/csprimary,port:2049 ,url:NetworkFilesystem:// 172.20.105.2//export/praveen/csprimary/?ROLE=PrimarySTOREUUID=90ffa1d f-e8bd-3e46-893d-bb9b63e0b180 }},name:ROOT-43,size:262144,path:b61da4e1-121e-4e02-b345-35719deec994,volumeId:46,vmName:r-43-VM,accountId:7,format:QCOW2,id:46,deviceId:0,hypervisorType:KVM}},diskSeq:0,path:b61da4e1-121e-4e02-b345-35719deec994,type:ROOT,_details:{managed:false,storagePort:2049,storageHost:172.20.105.2,volumeSize:262144}}],nics:[{deviceId:0,networkRateMbps:-1,defaultNic:false,uuid:2d4b2574-5e7d-45e7-bcbb-f64d1d9237c1,ip:169.254.1.131,netmask:255.255.0.0,gateway:169.254.0.1,mac:0e:00:a9:fe:01:83,broadcastType:LinkLocal,type:Control,isSecurityGroupEnabled:false}]},hostIp:172.20.210.7,executeInSequence:false,wait:0}},{com.cloud.agent.api.check.CheckSshCommand:{ip:169.254.1.131,port:3922,interval:6,retries:100,name:r-43-VM,wait:0}},{com.cloud.agent.api.GetDomRVersionCmd:{accessDetails:{router.ip:169.254.1.131, router.name :r-43-VM},wait:0}},{com.cloud.agent.api.PlugNicCommand:{nic:{deviceId:1,networkRateMbps:200,defaultNic:true,uuid:7f27078c-2123-4e53-9d4c-df2c6e4cb844,ip:172.20.211.132,netmask:255.255.255.0,gateway:172.20.211.1,mac:06:41:1a:00:00:20,broadcastType:Vlan,type:Public,broadcastUri:vlan://211,isolationUri:vlan://211,isSecurityGroupEnabled:false,name:cloudbr1},instanceName:r-43-VM,vmType:DomainRouter,wait:0}},{com.cloud.agent.api.routing.IpAssocVpcCommand:{ipAddresses:[{accountId:7,publicIp:172.20.211.132,sourceNat:true,add:true,oneToOneNat:false,firstIP:false,broadcastUri:211,vlanGateway:172.20.211.1,vlanNetmask:255.255.255.0,vifMacAddress:06:41:1a:00:00:20,networkRate:200,trafficType:Public,networkName:cloudbr1}],accessDetails:{router.guest.ip:172.20.211.132,zone.network.type:Advanced,router.ip:169.254.1.131, router.name
Re: Unable to deploy systemvms
Hi Yitao, xenbr0 : acting as Management network and no VLAN is assigned to it xenbr1 : acting as public, guest storage network. All of this are in same VLAN. Also I have given same name-label as here in Cloudstack network configuraion. I don't know much about xen VLAN networking..if anything wrong please point it out. [root@xen-dev ~]# xe network-list uuid ( RO): bfb89346-9eae-4554-a46a-59f9b4587983 name-label ( RW): cloud_link_local_network name-description ( RW): link local network used by system vms bridge ( RO): xapi0 uuid ( RO): eeb9fb94-7468-6b78-aaae-8d4e84b48afd name-label ( RW): Host internal management network name-description ( RW): Network on which guests will be assigned a private link-local IP address which can be used to talk XenAPI bridge ( RO): xenapi uuid ( RO): 90f6f78a-d4d8-463a-ccca-e28f7ea4e7d2 name-label ( RW): cloud-manage name-description ( RW): bridge ( RO): xenbr0 uuid ( RO): 88f0843e-feb9-44d0-5a04-06f32a258b81 name-label ( RW): cloud-public name-description ( RW): bridge ( RO): xenbr1 Regards, Tejas On Wed, Apr 2, 2014 at 5:42 PM, Yitao Jiang willier...@gmail.com wrote: Can you post your network configuration here, and do u able make operation on xenseever through xencenter? May be something wrong with ur storage On Apr 2, 2014 6:47 PM, Tejas Gadaria refond.g...@gmail.com wrote: Hi Punith, Thanks for reply, I have already uploaded systemvm64template-2014-01-14-master-xen.vhd.bz2 in secondary . [root@con-xen ~]# ls -lR /vol/ /vol/: total 8 drwxr-xr-x 2 root root 4096 Apr 2 12:46 primary drwxr-xr-x 3 root root 4096 Apr 2 12:14 secondary /vol/primary: total 4 -rw-r--r-- 1 root root 11 Apr 2 16:03 hb-ecff5b59-a2bc-4c0c-9ec8-05f7b4cda546 /vol/secondary: total 4 drwxr-xr-x 3 root root 4096 Apr 2 12:14 template /vol/secondary/template: total 4 drwxr-xr-x 3 root root 4096 Apr 2 12:14 tmpl /vol/secondary/template/tmpl: total 4 drwxr-xr-x 3 root root 4096 Apr 2 12:14 1 /vol/secondary/template/tmpl/1: total 4 drwxr-xr-x 2 root root 4096 Apr 2 12:26 1 /vol/secondary/template/tmpl/1/1: total 2565016 -rw-r--r-- 1 root root 2626564608 Apr 2 12:19 041bb2b7-2c84-4a72-a2bb-573d6c1ba56e.vhd -rw-r--r-- 1 root root287 Apr 2 12:26 template.properties Regards, Tejas On Wed, Apr 2, 2014 at 3:59 PM, Punith S punit...@cloudbyte.com wrote: hi, check whether you have seeded the vdh util for sysytem vms in secondary storage. http://docs.cloudstack.apache.org/projects/cloudstack-installation/en/latest/installation.html#prepare-the-system-vm-template thanks. On Wed, Apr 2, 2014 at 3:54 PM, Tejas Gadaria refond.g...@gmail.com wrote: Hi, I am trying to create system vms, in CS 4.3 with Xenserver 6.2 I am trying to create advance zone. I have 2nics. 1 for management network second is trunk. I am getting below error 2014-04-02 15:18:28,827 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl] (consoleproxy-1:ctx-774da64a) template 1 is already in store:1, type:Image 2014-04-02 15:18:28,831 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl] (consoleproxy-1:ctx-774da64a) template 1 is already in store:1, type:Primary 2014-04-02 15:18:28,832 DEBUG [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-774da64a) Found template routing-1 in storage pool 1 with VMTemplateStoragePool id: 4 2014-04-02 15:18:28,840 DEBUG [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-774da64a) Acquire lock on VMTemplateStoragePool 4 with timeout 3600 seconds 2014-04-02 15:18:30,903 WARN [c.c.h.x.r.XenServerStorageProcessor] (DirectAgent-111:ctx-f68bde71) destoryVDIbyNameLabel failed due to there are 0 VDIs with name cloud-cff5e443-72df-4aae-a4fd-1278fc0cbeb4 2014-04-02 15:18:30,903 WARN [c.c.h.x.r.XenServerStorageProcessor] (DirectAgent-111:ctx-f68bde71) can not create vdi in sr d2bf95cc-8761-c31d-37a5-173304cc621e 2014-04-02 15:18:30,904 WARN [c.c.h.x.r.XenServerStorageProcessor] (DirectAgent-111:ctx-f68bde71) Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr d2bf95cc-8761-c31d-37a5-173304cc621e com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr d2bf95cc-8761-c31d-37a5-173304cc621e at com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.copy_vhd_from_secondarystorage(XenServerStorageProcessor.java:848) at com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.copyTemplateToPrimaryStorage(XenServerStorageProcessor.java:918) at
Adding a host
Hi, I am building a new small CloudStack. I have the Managment server and DB together, and have a separate Storage server. The UI is operational, so some success. I would now like to add a host. I followed this guide https://cloudstack.apache.org/docs/en-US/Apache_CloudStack/4.2.0/html/Installation_Guide/hypervisor-kvm-install-flow.html specifically the bit about networking:- auto lo iface lo inet loopback # The primary network interface auto eth0.100 iface eth0.100 inet static address 192.168.42.11 netmask 255.255.255.240 gateway 192.168.42.1 dns-nameservers 8.8.8.8 8.8.4.4 dns-domain lab.example.org # Public network auto cloudbr0 iface cloudbr0 inet manual bridge_ports eth0.200 bridge_fd 5 bridge_stp off bridge_maxwait 1 # Private network auto cloudbr1 iface cloudbr1 inet manual bridge_ports eth0.300 bridge_fd 5 bridge_stp off bridge_maxwait 1 After doing this, and rebooting I lose connectivity. This is because eth0 is now tagged as suggested in the guide, but I don't think there is vLAN tagging on the rest of the network. What's the easy solution to this? Is it documented how to vLAN correctly the rest of my installation? Regards, Jon
Re: Is it possible to run Virualbox vm Cloudstack vm using kvm as hypervisor together?
Can you explain what you meant and what are you trying to do? Are you trying to run a VirtualBox VM in Cloudstack or vice versa? On Wed, Apr 2, 2014 at 3:13 AM, Sugandh S s.suga...@rocketmail.com wrote: Hello, Is it possible to run Virualbox vm Cloudstack vm using kvm as hypervisor together? As my Virtualbox vm keep on getting stuck at starting state. Sugandh
Re: LXC template
On 2014-04-02, 1:34 AM, Chinu wrote: Hello all, Please can someone advice how to create an LXC template image in tar format to spawn containers in KVM for Cloudstack version 4.2 or 4.3 Regards, Chinu I have that. This is for a CentOS image. I apologize for the formatting, I am using text emails ;) On your *HOST* run: |mkdir||/var/lib/libvirt/lxc/centos-6-x86_64/etc/yum||.repos.d/ -p | |cat||/etc/yum||.repos.d||/CentOS-Base||.repo |||sed||s/||'$releasever'||/6/g/var/lib/libvirt/lxc/centos-6-x86_64/etc/yum||.repos.d||/CentOS-Base||.repo| |yum groupinstall core --installroot=||/var/lib/libvirt/lxc/centos-6-x86_64/||--nogpgcheck -y| |yum||install||plymouth libselinux-python --installroot=||/var/lib/libvirt/lxc/centos-6-x86_64/||--nogpgcheck -y| On your *CHROOTED* container: |chroot||/var/lib/libvirt/lxc/centos-6-x86_64/| |echo||password |||passwd||root --stdin| |#Fix root login on console| |echo||pts/0/etc/securetty| |sed||-i s/||session required pam_selinux.so close||/||#session required pam_selinux.so close||/g||/etc/pam||.d||/login| |sed||-i s/||session required pam_selinux.so open||/||#session required pam_selinux.so open||/g||/etc/pam||.d||/login| |sed||-i s/||session required pam_loginuid.so||/||#session required pam_loginuid.so||/g||/etc/pam||.d||/login| |#Configuring basic networking| |cat/etc/sysconfig/network|| EOF| |NETWORKING=||yes| |HOSTNAME=lxc1.||test||.centos.org| |EOF| |cat/etc/sysconfig/network-scripts/ifcfg-eth0|| EOF| |DEVICE=eth0| |BOOTPROTO=dhcp| |ONBOOT=||yes| |EOF| |#Enabling sshd| |chkconfig sshd on| |# Fixing root login for sshd| |sed||-i s/||session required pam_selinux.so close||/||#session required pam_selinux.so close||/g||/etc/pam||.d||/sshd| |sed||-i s/||session required pam_loginuid.so||/||#session required pam_loginuid.so||/g||/etc/pam||.d||/sshd| |sed||-i s/||session required pam_selinux.so open env_params||/||#session required pam_selinux.so open env_params||/g||/etc/pam||.d||/sshd| || |cat/etc/fstab|| END| |/dev/root| |/ rootfs defaults0 0| |none ||/dev/shm| |tmpfs nosuid,nodev0 0| |END| || |cat/etc/init/lxc-sysinit||.conf END| |start on startup| |env||container| |pre-start script| |||if||[||x$container||!=||xlxc||-a||x$container||!=||xlibvirt||];||then| |||stop;| |||fi| |||initctl start||tty||TTY=console| |||rm||-f||/var/lock/subsys/||*| |||rm||-f||/var/run/||*.pid| |||telinit 3| |||exit||0;| |end script| |END| || |#Exit the chroot| |exit| Tar it: |cd||/var/lib/libvirt/lxc/centos-6-x86_64| |tar||cvf centos-6-x86_64_lxc.||tar||. Upload to CloudStack and enjoy! | -- Francois Gaudreault Architecte de Solution Cloud | Cloud Solutions Architect fgaudrea...@cloudops.com 514-629-6775 - - - CloudOps 420 rue Guy Montréal QC H3J 1S6 www.cloudops.com @CloudOps_
Re: LXC template
On 2014-04-02, 1:34 AM, Chinu wrote: Hello all, Please can someone advice how to create an LXC template image in tar format to spawn containers in KVM for Cloudstack version 4.2 or 4.3 Regards, Chinu Ok, the output was not as good as I though. Use this link instead :) http://pastebin.com/PuZd9gw6 -- Francois Gaudreault Architecte de Solution Cloud | Cloud Solutions Architect fgaudrea...@cloudops.com 514-629-6775 - - - CloudOps 420 rue Guy Montréal QC H3J 1S6 www.cloudops.com @CloudOps_
Check Virtual Machine deployment
Hello all, Is there anybody here who knows how to check if there is enough infrastructure available before the virtual machine deployment? Regards, Felippe Raposo.
Re: No outbound traffic with F5 as loadbalancer network offering
Sanjeev, Clearly the problem is in the VR, since I can see activities (using tcpdump) in my VR when I try to telnet to any external server on port 80 on my vm's. I enabled LOGGING on iptables in the VR and can see packets being dropped. Even after I make iptables everything ACCEPT, I can't go out to google on port 80. Is there any other log files that I can look at for some hints? Thanks Amin From: Sanjeev Neelarapu sanjeev.neelar...@citrix.com To: users@cloudstack.apache.org users@cloudstack.apache.org; Amin Pashapour jol...@yahoo.com Sent: Wednesday, April 2, 2014 12:58 AM Subject: RE: No outbound traffic with F5 as loadbalancer network offering Hi Amin, Have you checked whether the configured egress rules are programmed properly on VR ? -Sanjeev -Original Message- From: Amin Pashapour [mailto:jol...@yahoo.com] Sent: Wednesday, April 02, 2014 1:24 AM To: users@cloudstack.apache.org Subject: No outbound traffic with F5 as loadbalancer network offering I am still stuck with this issue. Looks like the virtualrouter is not allowing any outbound traffic, but I have set the egress to allow all TCP ports from 1-64000. I have restarted my virtualrouter several times and still nothing outbound. Any hints? Any buttons to push? Appreciate it in advance Amin From: Amin Pashapour jol...@yahoo.com To: users@cloudstack.apache.org users@cloudstack.apache.org Sent: Wednesday, March 26, 2014 10:21 AM Subject: Can't go out of a vm with F5 as loadbalancer network offering Hi All, On CloudStack 4.2.1, I have set up a network that uses an offering with F5 as loadbalancer. All other features use VirtualRouter. Everything is working fine going southbound to the two VM's I am loadbalancing. But when I am on either one of these VM's, I can't get to anything external. I can get to the virtual router/gateway or other internal VM's. I can resolve www.google.com but I can't telnet to google.com on port 80 I have set egress on my network to ALL protocols from 0.0.0.0/0. I have also disabled iptables and still nothing going out. I can go outside when I use the default network offering. Any hint on what could be the cause is greatly appreciated. Or any hint on how to troubleshoot! Thanks. Amin
Re: Adding a host
I removed the vLAN and swapped eth0 with cloudbr0 before it would even communicate. Not sure if that's a typo in the documentation, or if I've just kludged it through. Now when I attempt to add the host I get this output from setup.log DEBUG:root:execute:uname -r DEBUG:root:execute:uname -m DEBUG:root:execute:hostname -f DEBUG:root:execute:kvm-ok DEBUG:root:execute:service apparmor status DEBUG:root:execute:apparmor_status |grep libvirt DEBUG:root:Failed to execute: DEBUG:root:execute:sudo /usr/sbin/service libvirt-bin status DEBUG:root:execute:sudo /usr/sbin/service libvirt-bin stop DEBUG:root:Failed to execute:stop: Unknown instance: DEBUG:root:execute:sudo update-rc.d -f libvirt-bin remove DEBUG:root:execute:sudo update-rc.d -f libvirt-bin defaults DEBUG:root:execute:sudo /usr/sbin/service libvirt-bin status DEBUG:root:execute:sudo /usr/sbin/service libvirt-bin start DEBUG:root:execute:ufw allow 22 DEBUG:root:execute:ufw allow 1798 DEBUG:root:execute:ufw allow 16509 DEBUG:root:execute:ufw allow proto tcp from any to any port 5900:6100 DEBUG:root:execute:ufw allow proto tcp from any to any port 49152:49216 DEBUG:root:execute:sudo /usr/sbin/service ufw status DEBUG:root:execute:sudo /usr/sbin/service ufw stop DEBUG:root:execute:sudo /usr/sbin/service ufw status DEBUG:root:execute:sudo /usr/sbin/service ufw start DEBUG:root:execute:sudo /usr/sbin/service cloudstack-agent status DEBUG:root:Failed to execute: * could not access PID file for cloudstack-agent DEBUG:root:execute:sudo /usr/sbin/service cloudstack-agent stop DEBUG:root:execute:sleep 30 DEBUG:root:execute:sudo update-rc.d -f cloudstack-agent remove DEBUG:root:execute:sudo update-rc.d -f cloudstack-agent defaults DEBUG:root:execute:sudo /usr/sbin/service cloudstack-agent status DEBUG:root:Failed to execute: * could not access PID file for cloudstack-agent DEBUG:root:execute:sudo /usr/sbin/service cloudstack-agent start Any ideas what causes this, as I've scanned the internet to no avail. Regards, Jon On Wed, 2014-04-02 at 15:38 +0100, Jonathan Gowar wrote: Hi, I am building a new small CloudStack. I have the Managment server and DB together, and have a separate Storage server. The UI is operational, so some success. I would now like to add a host. I followed this guide https://cloudstack.apache.org/docs/en-US/Apache_CloudStack/4.2.0/html/Installation_Guide/hypervisor-kvm-install-flow.html specifically the bit about networking:- auto lo iface lo inet loopback # The primary network interface auto eth0.100 iface eth0.100 inet static address 192.168.42.11 netmask 255.255.255.240 gateway 192.168.42.1 dns-nameservers 8.8.8.8 8.8.4.4 dns-domain lab.example.org # Public network auto cloudbr0 iface cloudbr0 inet manual bridge_ports eth0.200 bridge_fd 5 bridge_stp off bridge_maxwait 1 # Private network auto cloudbr1 iface cloudbr1 inet manual bridge_ports eth0.300 bridge_fd 5 bridge_stp off bridge_maxwait 1 After doing this, and rebooting I lose connectivity. This is because eth0 is now tagged as suggested in the guide, but I don't think there is vLAN tagging on the rest of the network. What's the easy solution to this? Is it documented how to vLAN correctly the rest of my installation? Regards, Jon
Re: No outbound traffic with F5 as loadbalancer network offering
I re-did the whole thing again and this time it works perfectly. The only difference that I can tell is that in the new network offering with F5 as loadbalancer, I set the default egress policy to deny. Then I went ahead and set the egress allow policy on the the SourceNAT external IP for the new network. I also used the first additional IP for loadbalancing. Last time I had used the first one for portforwarding. Hope this helps others. Thanks. Amin From: Amin Pashapour jol...@yahoo.com To: users@cloudstack.apache.org users@cloudstack.apache.org Sent: Wednesday, April 2, 2014 1:01 PM Subject: Re: No outbound traffic with F5 as loadbalancer network offering Sanjeev, Clearly the problem is in the VR, since I can see activities (using tcpdump) in my VR when I try to telnet to any external server on port 80 on my vm's. I enabled LOGGING on iptables in the VR and can see packets being dropped. Even after I make iptables everything ACCEPT, I can't go out to google on port 80. Is there any other log files that I can look at for some hints? Thanks Amin From: Sanjeev Neelarapu sanjeev.neelar...@citrix.com To: users@cloudstack.apache.org users@cloudstack.apache.org; Amin Pashapour jol...@yahoo.com Sent: Wednesday, April 2, 2014 12:58 AM Subject: RE: No outbound traffic with F5 as loadbalancer network offering Hi Amin, Have you checked whether the configured egress rules are programmed properly on VR ? -Sanjeev -Original Message- From: Amin Pashapour [mailto:jol...@yahoo.com] Sent: Wednesday, April 02, 2014 1:24 AM To: users@cloudstack.apache.org Subject: No outbound traffic with F5 as loadbalancer network offering I am still stuck with this issue. Looks like the virtualrouter is not allowing any outbound traffic, but I have set the egress to allow all TCP ports from 1-64000. I have restarted my virtualrouter several times and still nothing outbound. Any hints? Any buttons to push? Appreciate it in advance Amin From: Amin Pashapour jol...@yahoo.com To: users@cloudstack.apache.org users@cloudstack.apache.org Sent: Wednesday, March 26, 2014 10:21 AM Subject: Can't go out of a vm with F5 as loadbalancer network offering Hi All, On CloudStack 4.2.1, I have set up a network that uses an offering with F5 as loadbalancer. All other features use VirtualRouter. Everything is working fine going southbound to the two VM's I am loadbalancing. But when I am on either one of these VM's, I can't get to anything external. I can get to the virtual router/gateway or other internal VM's. I can resolve www.google.com but I can't telnet to google.com on port 80 I have set egress on my network to ALL protocols from 0.0.0.0/0. I have also disabled iptables and still nothing going out. I can go outside when I use the default network offering. Any hint on what could be the cause is greatly appreciated. Or any hint on how to troubleshoot! Thanks. Amin
Re: Check Virtual Machine deployment
Cant you just check the dashboard area? It shows resource consumption. Or is there something else your looking for? On Apr 2, 2014 11:34 AM, Felippe da Motta Raposo felippe.ges...@corp.globo.com wrote: Hello all, Is there anybody here who knows how to check if there is enough infrastructure available before the virtual machine deployment? Regards, Felippe Raposo.
Re: Snapshot exceptions on 4.2.1 with NFS and S3
On 02.04.2014 08:38, Thomas O'Dowd wrote: Anyway - decided to uninstall my package and install the 355 version that you were using. After installing I rebooted. I really didn't expect anything to change but Volume Snapshots now work! YEAH! Glad it works. I'd still recommend my approach, though, otherwise you're left running an old and probably insecure KVM. HTH Lucian -- Sent from the Delta quadrant using Borg technology! Nux! www.nux.ro
Re: [SOLVED] Adding a host
Finally I have been able to add a host. This failed for 2 reasons, firstly I didn't edit libvirtd.conf correctly; with mdns_adv = 1 , it should equal 0, this prevented libvirtd from starting, and thus in turn cloudstack-agent. Secondly, I don't know if there's a typo in the documentation, but I had to use this network interface configuration; swapping eth0 and cloudbr0's static and manual lines:- # The primary network interface auto eth0 iface eth0 inet manual # Public network auto cloudbr0 iface cloudbr0 inet static address 192.168.42.11 netmask 255.255.255.240 gateway 192.168.42.1 dns-nameservers 8.8.8.8 8.8.4.4 dns-domain lab.example.org` bridge_ports eth0 bridge_fd 5 bridge_stp off bridge_maxwait 1 # Private network auto cloudbr1 iface cloudbr1 inet manual bridge_ports none bridge_fd 5 bridge_stp off bridge_maxwait 1
Removing a node from mgmt cluster
Is there a posted procedure for removing a node from a mgmt cluster?
Is this normal?
Are these two lines normal in the managment-server.log file? 2014-04-02 23:59:26,027 DEBUG [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Zone 1 is ready to launch secondary storage VM 2014-04-02 23:59:26,116 DEBUG [cloud.consoleproxy.ConsoleProxyManagerImpl] (consoleproxy-1:null) Zone 1 is ready to launch console proxy They constantly repeat themselves in the log file. They are both up and online. The ssvm seems to be working just fine. Thanks, Fred
cannot start system vms
Hey Folks, Hoping for some assistance here. Running cloudstack 4.0.2 what does avoid set mean? and how do i enable my kvm hosts? Here is the logging from the management head during system vm creation- Any and all help is appreciated! 2014-04-02 17:48:58,264 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Successfully released network resources for the vm VM[SecondaryStorageVm|s-6410-VM] 2014-04-02 17:48:58,264 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Successfully cleanued up resources for the vm VM[SecondaryStorageVm|s-6410-VM] in Starting state 2014-04-02 17:48:58,265 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) DeploymentPlanner allocation algorithm: random 2014-04-02 17:48:58,265 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Trying to allocate a host and storage pools from dc:1, pod:null,cluster:null, requested cpu: 500, requested ram: 268435456 2014-04-02 17:48:58,265 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Is ROOT volume READY (pool already allocated)?: No 2014-04-02 17:48:58,266 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Searching all possible resources under this Zone: 1 2014-04-02 17:48:58,267 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1 2014-04-02 17:48:58,267 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) CPUOverprovisioningFactor considered: 1.0 2014-04-02 17:48:58,271 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Checking resources in Cluster: 1 under Pod: 1 2014-04-02 17:48:58,271 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Calling HostAllocators to find suitable hosts 2014-04-02 17:48:58,271 DEBUG [allocator.impl.FirstFitAllocator] (secstorage-1:FirstFitRoutingAllocator) Looking for hosts in dc: 1 pod:1 cluster:1 2014-04-02 17:48:58,272 DEBUG [allocator.impl.FirstFitAllocator] (secstorage-1:FirstFitRoutingAllocator) FirstFitAllocator has 2 hosts to check for allocation: [Host[-28-Routing], Host[-29-Routing]] 2014-04-02 17:48:58,274 DEBUG [allocator.impl.FirstFitAllocator] (secstorage-1:FirstFitRoutingAllocator) Found 2 hosts for allocation after prioritization: [Host[-28-Routing], Host[-29-Routing]] 2014-04-02 17:48:58,274 DEBUG [allocator.impl.FirstFitAllocator] (secstorage-1:FirstFitRoutingAllocator) Looking for speed=500Mhz, Ram=256 2014-04-02 17:48:58,274 DEBUG [allocator.impl.FirstFitAllocator] (secstorage-1:FirstFitRoutingAllocator) Host name: slcai073.us.oracle.com, hostId: 28 is in avoid set, skipping this and trying other available hosts 2014-04-02 17:48:58,274 DEBUG [allocator.impl.FirstFitAllocator] (secstorage-1:FirstFitRoutingAllocator) Host name: slcai074, hostId: 29 is in avoid set, skipping this and trying other available hosts 2014-04-02 17:48:58,275 DEBUG [allocator.impl.FirstFitAllocator] (secstorage-1:FirstFitRoutingAllocator) Host Allocator returning 0 suitable hosts 2014-04-02 17:48:58,275 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) No suitable hosts found 2014-04-02 17:48:58,275 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) No suitable hosts found under this Cluster: 1 2014-04-02 17:48:58,275 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Could not find suitable Deployment Destination for this VM under any clusters, returning. 2014-04-02 17:48:58,277 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: 29 2014-04-02 17:48:58,279 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) Hosts's actual total CPU: 92832 and CPU after applying overprovisioning: 92832 2014-04-02 17:48:58,279 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) release cpu from host: 29, old used: 1000,reserved: 0, actual total: 92832, total with overprovisioning: 92832; new used: 500,reserved:0; movedfromreserved: false,moveToReserveredfalse 2014-04-02 17:48:58,280 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) release mem from host: 29, old used: 1342177280,reserved: 0, total: 271024279552; new used: 1073741824,reserved:0; movedfromreserved: false,moveToReserveredfalse 2014-04-02 17:48:58,281 WARN [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Exception while trying to start secondary storage vm com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[SecondaryStorageVm|s-6410-VM]Scope=interface com.cloud.dc.DataCenter; id=1 at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:734) at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:472) at
Unable to provision VMs
Hello, It appears as if I am unable to provision instances because for some reason Cloudstack cannot find a suitable storage pool. Here is the information from the log file for one instance I attempted to provision: 2014-04-03 00:37:43,459 DEBUG [cloud.api.ApiServlet] (catalina-exec-11:null) ===END=== 65.183.45.4 -- GET command=listVPCsresponse=jsonsessionkey=HIP6Nm7WuAHkrERfXgFrBrXqg8w%3D_=1396485198304 2014-04-03 00:37:43,518 DEBUG [cloud.api.ApiServlet] (catalina-exec-8:null) ===START=== 65.183.45.4 -- GET command=listNetworksresponse=jsonsessionkey=HIP6Nm7WuAHkrERfXgFrBrXqg8w%3DzoneId=f77ce551-6188-4366-a242-8c766acc3ab9canusefordeploy=truedomainid=8e69d968-ba30-11e3-9d11-00269e3cfedaaccount=admin_=1396485198339 2014-04-03 00:37:43,526 DEBUG [cloud.user.AccountManagerImpl] (catalina-exec-8:null) Access granted to Acct[05e9982a-baae-11e3-9d11-00269e3cfeda-admin] to Domain:1/ by AffinityGroupAccessChecker_EnhancerByCloudStack_cb9376be 2014-04-03 00:37:43,540 DEBUG [cloud.api.ApiServlet] (catalina-exec-8:null) ===END=== 65.183.45.4 -- GET command=listNetworksresponse=jsonsessionkey=HIP6Nm7WuAHkrERfXgFrBrXqg8w%3DzoneId=f77ce551-6188-4366-a242-8c766acc3ab9canusefordeploy=truedomainid=8e69d968-ba30-11e3-9d11-00269e3cfedaaccount=admin_=1396485198339 2014-04-03 00:37:43,552 DEBUG [cloud.api.ApiServlet] (catalina-exec-18:null) ===START=== 65.183.45.4 -- GET command=listNetworkOfferingsresponse=jsonsessionkey=HIP6Nm7WuAHkrERfXgFrBrXqg8w%3Dforvpc=falsezoneid=f77ce551-6188-4366-a242-8c766acc3ab9guestiptype=IsolatedsupportedServices=SourceNatspecifyvlan=falsestate=Enabled_=1396485198415 2014-04-03 00:37:43,577 DEBUG [cloud.api.ApiServlet] (catalina-exec-18:null) ===END=== 65.183.45.4 -- GET command=listNetworkOfferingsresponse=jsonsessionkey=HIP6Nm7WuAHkrERfXgFrBrXqg8w%3Dforvpc=falsezoneid=f77ce551-6188-4366-a242-8c766acc3ab9guestiptype=IsolatedsupportedServices=SourceNatspecifyvlan=falsestate=Enabled_=1396485198415 2014-04-03 00:37:43,966 DEBUG [cloud.server.StatsCollector] (StatsCollector-1:null) VmStatsCollector is running... 2014-04-03 00:37:45,519 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-14:null) SeqA 1-3439: Processing Seq 1-3439: { Cmd , MgmtId: -1, via: 1, Ver: v1, Flags: 11, [{com.cloud.agent.api.ConsoleProxyLoadReportCommand:{_proxyVmId:2,_loadInfo:{\n \connections\: []\n},wait:0}}] } 2014-04-03 00:37:45,585 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-14:null) SeqA 1-3439: Sending Seq 1-3439: { Ans: , MgmtId: 165863554778, via: 1, Ver: v1, Flags: 100010, [{com.cloud.agent.api.AgentControlAnswer:{result:true,wait:0}}] } 2014-04-03 00:37:48,387 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-12:null) Ping from 3 2014-04-03 00:37:53,228 DEBUG [cloud.api.ApiServlet] (catalina-exec-15:null) ===START=== 65.183.45.4 -- GET command=deployVirtualMachinezoneId=f77ce551-6188-4366-a242-8c766acc3ab9templateId=8ebdc956-ba30-11e3-9d11-00269e3cfedahypervisor=KVMserviceOfferingId=cef59ea0-767f-419f-9b80-bdf028a69eaanetworkIds=6bd0bdff-2f05-4a01-b242-803f3789aa67response=jsonsessionkey=HIP6Nm7WuAHkrERfXgFrBrXqg8w%3D_=1396485208038 2014-04-03 00:37:53,235 DEBUG [cloud.api.ApiDispatcher] (catalina-exec-15:null) InfrastructureEntity name is:com.cloud.offering.ServiceOffering 2014-04-03 00:37:53,237 DEBUG [cloud.api.ApiDispatcher] (catalina-exec-15:null) ControlledEntity name is:com.cloud.template.VirtualMachineTemplate 2014-04-03 00:37:53,239 DEBUG [cloud.api.ApiDispatcher] (catalina-exec-15:null) ControlledEntity name is:com.cloud.network.Network 2014-04-03 00:37:53,250 DEBUG [cloud.network.NetworkModelImpl] (catalina-exec-15:null) Service SecurityGroup is not supported in the network id=204 2014-04-03 00:37:53,329 DEBUG [cloud.vm.UserVmManagerImpl] (catalina-exec-15:null) Allocating in the DB for vm 2014-04-03 00:37:53,337 DEBUG [cloud.vm.VirtualMachineManagerImpl] (catalina-exec-15:null) Allocating entries for VM: VM[User|1deae872-9ab2-4d07-9932-e1b36f43ce42] 2014-04-03 00:37:53,337 DEBUG [cloud.vm.VirtualMachineManagerImpl] (catalina-exec-15:null) Allocating nics for VM[User|1deae872-9ab2-4d07-9932-e1b36f43ce42] 2014-04-03 00:37:53,338 DEBUG [cloud.network.NetworkManagerImpl] (catalina-exec-15:null) Allocating nic for vm VM[User|1deae872-9ab2-4d07-9932-e1b36f43ce42] in network Ntwk[204|Guest|8] with requested profile NicProfile[0-0-null-null-null 2014-04-03 00:37:53,420 DEBUG [cloud.network.NetworkModelImpl] (catalina-exec-15:null) Service SecurityGroup is not supported in the network id=204 2014-04-03 00:37:53,421 DEBUG [cloud.vm.VirtualMachineManagerImpl] (catalina-exec-15:null) Allocating disks for VM[User|1deae872-9ab2-4d07-9932-e1b36f43ce42] 2014-04-03 00:37:53,428 DEBUG [cloud.vm.VirtualMachineManagerImpl] (catalina-exec-15:null) Allocation completed for VM: VM[User|1deae872-9ab2-4d07-9932-e1b36f43ce42] 2014-04-03 00:37:53,428 DEBUG [cloud.vm.UserVmManagerImpl] (catalina-exec-15:null) Successfully allocated DB entry for
4.2.1 update to 4.3.0 and create VR get a problem
I follow this instruction http://docs.cloudstack.apache.org/projects/cloudstack-release-notes/en/latest/rnotes.html#upgrade-from-4-2-0-to-4-3; to do update work. When create a new VR , i get this : WARN [kvm.resource.LibvirtComputingResource] (agentRequest-Handler-5:null) Timed out: /usr/share/cloudstack-common/scripts/vm/hypervisor/kvm/patchviasocket.pl -n r-171-VM -p %template=domP%name=r-171-VM%eth2ip=192.168.28.4%eth2mask=255.255.255.0%gateway=192.168.28.254%eth0ip=10.1.1.1%eth0mask=255.255.255.0%domain= cloud.uc888.cn%dhcprange=10.1.1.1%eth1ip=169.254.1.146%eth1mask=255.255.0.0%type=router%disable_rp_filter=true%dns1=192.168.20.121%dns2=192.168.20.122 . Output is: The log above is kvm agent log. How to resolve it ? Thanks!
Service Offering Maximum Limit
Does anyone know if there is a maximum amount of service offerings that can be created?
RE: Cloud Stack 4.2.1 issue (Unable to start instance due to DB Exception)
Hello, Can anyone from the cloud stack guru's please help with the below issue? Kind Regards Amin -Original Message- From: Amin Samir Sent: Tuesday, 1 April 2014 1:29 PM To: users@cloudstack.apache.org Subject: Cloud Stack 4.2.1 issue (Unable to start instance due to DB Exception) Hello, We are facing an issue when we spin up a new instance with a new network (router VM), it gives the following error: Resource [Host:59] is unreachable: Host 59: Unable to start instance due to DB Exception on: com.mysql.jdbc.JDBC4PreparedStatement@5126808a: INSERT INTO user_statistics (user_statistics.data_center_id, user_statistics.account_id, user_statistics.public_ip_address, user_statistics.device_id, user_statistics.device_type, user_statistics.network_id, user_statistics.net_bytes_received, user_statistics.net_bytes_sent, user_statistics.current_bytes_received, user_statistics.current_bytes_sent, user_statistics.agg_bytes_received, user_statistics.agg_bytes_sent) VALUES (1, 28, null, 360, _binary'DomainRouter', 237, 0, 0, 0, 0, 0, 0) Also we are facing this error every now and then: (DirectAgent-93:null) GetStorageStats Exception:SR_BACKEND_FAILURE_40The SR scan failed [opterr=uuid=870ed96e-d62b-428a-88dc-41afc75d311a]host:13944281-3f7e-4065-8580-1dc5b64cfdb1storageid: 098d4f7a-a040-3462-add1-d618d6ec53c1 However when spinning a new instance with an existing network (router VM) it works fine!! Has anyone faced this issue, your help would be much appreciated. Thanks
Re: Limiting Bandwidth
I have checked the QOS settings on the VM, they are all set to 25600Kbps regardless of what I set the value to in the network offering. Is there something that I am missing, or are others also experiencing this issue? On 3/27/14, 3:43 AM, Sanjeev Neelarapu sanjeev.neelar...@citrix.com wrote: In XenServer the bandwidth setting will be part of QoS settings. Please check the QoS value on VMs vif. -Sanjeev -Original Message- From: Xerex Bueno [mailto:xbu...@lpsintegration.com] Sent: Thursday, March 27, 2014 8:25 AM To: users@cloudstack.apache.org Subject: Limiting Bandwidth I am running ACS 4.3 with Xenserver 6.2 fully patched. When I create a network offering and specify the bandwidth to be 1Mbps, then create a new network and VM it doesn't apply the bandwidth limit. Why is this happening? This document is PROPRIETARY and CONFIDENTIAL and may not be duplicated, redistributed, or displayed to any other party without the expressed written permission of LPS Integration, Inc. If you are not the intended recipient and have received this email in error, please destroy the email and contact the LPS Integration Security Officer at 866-577-2902 (Phone), 615-349-9009 (Fax) or 230 Great Circle Rd. Suite 218 Nashville, TN 37228 (US Mail) This document is PROPRIETARY and CONFIDENTIAL and may not be duplicated, redistributed, or displayed to any other party without the expressed written permission of LPS Integration, Inc. If you are not the intended recipient and have received this email in error, please destroy the email and contact the LPS Integration Security Officer at 866-577-2902 (Phone), 615-349-9009 (Fax) or 230 Great Circle Rd. Suite 218 Nashville, TN 37228 (US Mail)
Re: Is it possible to run Virualbox vm Cloudstack vm using kvm as hypervisor together?
Sorry that does not make sense to me. If you have migrated to Cloudstack from VirtualBox, what exactly do you want to start on VB now? A new VM or the old one which got migrated out? If the old VM is still in the system you can start with VirtualBox, I do not see the problem. But I suspect I am not understanding your question at all. On Wed, Apr 2, 2014 at 9:09 PM, Sugandh S s.suga...@rocketmail.com wrote: No, I have a vm instance running on Cloudstack but I also want to start a vm on Virtualbox that was running before we migrated to Cloudstack. On Wednesday, 2 April 2014 8:14 PM, Mir Islam mis...@mirislam.com wrote: Can you explain what you meant and what are you trying to do? Are you trying to run a VirtualBox VM in Cloudstack or vice versa? On Wed, Apr 2, 2014 at 3:13 AM, Sugandh S s.suga...@rocketmail.com wrote: Hello, Is it possible to run Virualbox vm Cloudstack vm using kvm as hypervisor together? As my Virtualbox vm keep on getting stuck at starting state. Sugandh
RE: How do I remove a host from Cloudstack agent?
Hi Sugandh, Put the host you want to remove in maintenance mode and then delete from CS. -Sanjeev -Original Message- From: Sugandh S [mailto:s.suga...@rocketmail.com] Sent: Wednesday, April 02, 2014 5:24 PM To: users@cloudstack.apache.org Subject: How do I remove a host from Cloudstack agent? Hello all, I have two servers, one running both Cloudstack-server and Cloudstack-agent and the other one only running Cloudstack-agent. How do I remove the second host from Cloudstack. Thanks, Sugandh
RE: Limiting Bandwidth
For User VM, I think you have set network rate in the service offering. Or globally in vm.network.throttling.rate. If not defined in service offering, it picks the global setting as the default value. -Original Message- From: Xerex Bueno [mailto:xbu...@lpsintegration.com] Sent: Thursday, April 03, 2014 7:10 AM To: users@cloudstack.apache.org Subject: Re: Limiting Bandwidth I have checked the QOS settings on the VM, they are all set to 25600Kbps regardless of what I set the value to in the network offering. Is there something that I am missing, or are others also experiencing this issue? On 3/27/14, 3:43 AM, Sanjeev Neelarapu sanjeev.neelar...@citrix.com wrote: In XenServer the bandwidth setting will be part of QoS settings. Please check the QoS value on VMs vif. -Sanjeev -Original Message- From: Xerex Bueno [mailto:xbu...@lpsintegration.com] Sent: Thursday, March 27, 2014 8:25 AM To: users@cloudstack.apache.org Subject: Limiting Bandwidth I am running ACS 4.3 with Xenserver 6.2 fully patched. When I create a network offering and specify the bandwidth to be 1Mbps, then create a new network and VM it doesn't apply the bandwidth limit. Why is this happening? This document is PROPRIETARY and CONFIDENTIAL and may not be duplicated, redistributed, or displayed to any other party without the expressed written permission of LPS Integration, Inc. If you are not the intended recipient and have received this email in error, please destroy the email and contact the LPS Integration Security Officer at 866-577-2902 (Phone), 615-349-9009 (Fax) or 230 Great Circle Rd. Suite 218 Nashville, TN 37228 (US Mail) This document is PROPRIETARY and CONFIDENTIAL and may not be duplicated, redistributed, or displayed to any other party without the expressed written permission of LPS Integration, Inc. If you are not the intended recipient and have received this email in error, please destroy the email and contact the LPS Integration Security Officer at 866-577-2902 (Phone), 615-349-9009 (Fax) or 230 Great Circle Rd. Suite 218 Nashville, TN 37228 (US Mail)