Re: CS 4.2.1 install can't get system vms to start

[jason pavao]

What does avoid set mean?

I've restarted both the cloudstack-management on the mgtm server along 
with cloudstakc-agent on the kvm host, both to no avail.


This is a fairly clean installation using bits from 
baseurl=http://cloudstack.apt-get.eu/rhel/4.2/


This is on OEL 6.4

Any additional feedback would be greatly appreciated!
Thanks!
-jason



On 12/4/2013 11:00 PM, Jayapal Reddy Uradi wrote:

Hi,

From the below logs the host is in avoid set.
Can you please check host status for up, try restarting MS server.




2013-12-04 23:36:07,519 DEBUG [allocator.impl.FirstFitAllocator] 
(secstorage-1:FirstFitRoutingAllocator) Host name: 
slcai547.us.oracle.com , hostId: 1 is 
in avoid set, skipping this and trying other available hosts
2013-12-04 23:36:07,520 DEBUG [allocator.impl.FirstFitAllocator] 
(secstorage-1:FirstFitRoutingAllocator) Host Allocator returning 0 
suitable hosts
2013-12-04 23:36:07,520 DEBUG 
[cloud.deploy.DeploymentPlanningManagerImpl] (secstorage-1:null) No 
suitable hosts found
2013-12-04 23:36:07,520 DEBUG 
[cloud.deploy.DeploymentPlanningManagerImpl] (secstorage-1:null) No 
suitable hosts found under this Cluster: 1
2013-12-04 23:36:07,521 DEBUG 
[cloud.deploy.DeploymentPlanningManagerImpl] (secstorage-1:null) Could 
not find suitable Deployment Destination for this VM under any 
clusters, returning.
2013-12-04 23:36:07,521 DEBUG [cloud.deploy.FirstFitPlanner] 
(secstorage-1:null) Searching all possible resources under this Zone: 1
2013-12-04 23:36:07,522 DEBUG [cloud.deploy.FirstFitPlanner] 
(secstorage-1:null) Listing clusters in order of aggregate capacity, 
that have (atleast one host with) enough CPU and RAM capacity under 
this Zone: 1
2013-12-04 23:36:07,523 DEBUG [cloud.deploy.FirstFitPlanner] 
(secstorage-1:null) Removing from the clusterId list these clusters 
from avoid set: [1]
2013-12-04 23:36:07,524 DEBUG [cloud.deploy.FirstFitPlanner] 
(secstorage-1:null) No clusters found after removing disabled clusters 
and clusters in avoid list, returning.
2013-12-04 23:36:07,527 DEBUG [cloud.capacity.CapacityManagerImpl] 
(secstorage-1:null) VM state transitted from :Starting to Stopped with 
event: OperationFailedvm's original host id: null new host id: null 
host id before state transition: 1



Thanks,
Jayapal

On 05-Dec-2013, at 12:11 PM, jason pavao >

 wrote:

2013-12-04 23:36:07,519 DEBUG [allocator.impl.FirstFitAllocator] 
(secstorage-1:FirstFitRoutingAllocator) Host 
name:slcai547.us.oracle.com , hostId: 
1 is in avoid set, skipping this and trying other available hosts
2013-12-04 23:36:07,520 DEBUG [allocator.impl.FirstFitAllocator] 
(secstorage-1:FirstFitRoutingAllocator) Host Allocator returning 0 
suitable hosts
2013-12-04 23:36:07,520 DEBUG 
[cloud.deploy.DeploymentPlanningManagerImpl] (secstorage-1:null) No 
suitable hosts found
2013-12-04 23:36:07,520 DEBUG 
[cloud.deploy.DeploymentPlanningManagerImpl] (secstorage-1:null) No 
suitable hosts found under this Cluster: 1
2013-12-04 23:36:07,521 DEBUG 
[cloud.deploy.DeploymentPlanningManagerImpl] (secstorage-1:null) 
Could not find suitable Deployment Destination for this VM under any 
clusters, returning.
2013-12-04 23:36:07,521 DEBUG [cloud.deploy.FirstFitPlanner] 
(secstorage-1:null) Searching all possible resources under this Zone: 1
2013-12-04 23:36:07,522 DEBUG [cloud.deploy.FirstFitPlanner] 
(secstorage-1:null) Listing clusters in order of aggregate capacity, 
that have (atleast one host with) enough CPU and RAM capacity under 
this Zone: 1
2013-12-04 23:36:07,523 DEBUG [cloud.deploy.FirstFitPlanner] 
(secstorage-1:null) Removing from the clusterId list these clusters 
from avoid set: [1]
2013-12-04 23:36:07,524 DEBUG [cloud.deploy.FirstFitPlanner] 
(secstorage-1:null) No clusters found after removing disabled 
clusters and clusters in avoid list, returning.
2013-12-04 23:36:07,527 DEBUG [cloud.capacity.CapacityManagerImpl] 
(secstorage-1:null) VM state transitted from :Starting to Stopped 
with event: OperationFailedvm's original host id: null new host id: 
null host id before state transition: 1

Re: CS 4.2.1 install can't get system vms to start

[Jayapal Reddy Uradi]

Hi,

>From the below logs the host is in avoid set.
Can you please check host status for up, try restarting MS server.





2013-12-04 23:36:07,519 DEBUG [allocator.impl.FirstFitAllocator] 
(secstorage-1:FirstFitRoutingAllocator) Host name: 
slcai547.us.oracle.com, hostId: 1 is in avoid 
set, skipping this and trying other available hosts
2013-12-04 23:36:07,520 DEBUG [allocator.impl.FirstFitAllocator] 
(secstorage-1:FirstFitRoutingAllocator) Host Allocator returning 0 suitable 
hosts
2013-12-04 23:36:07,520 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] 
(secstorage-1:null) No suitable hosts found
2013-12-04 23:36:07,520 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] 
(secstorage-1:null) No suitable hosts found under this Cluster: 1
2013-12-04 23:36:07,521 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] 
(secstorage-1:null) Could not find suitable Deployment Destination for this VM 
under any clusters, returning.
2013-12-04 23:36:07,521 DEBUG [cloud.deploy.FirstFitPlanner] 
(secstorage-1:null) Searching all possible resources under this Zone: 1
2013-12-04 23:36:07,522 DEBUG [cloud.deploy.FirstFitPlanner] 
(secstorage-1:null) Listing clusters in order of aggregate capacity, that have 
(atleast one host with) enough CPU and RAM capacity under this Zone: 1
2013-12-04 23:36:07,523 DEBUG [cloud.deploy.FirstFitPlanner] 
(secstorage-1:null) Removing from the clusterId list these clusters from avoid 
set: [1]
2013-12-04 23:36:07,524 DEBUG [cloud.deploy.FirstFitPlanner] 
(secstorage-1:null) No clusters found after removing disabled clusters and 
clusters in avoid list, returning.
2013-12-04 23:36:07,527 DEBUG [cloud.capacity.CapacityManagerImpl] 
(secstorage-1:null) VM state transitted from :Starting to Stopped with event: 
OperationFailedvm's original host id: null new host id: null host id before 
state transition: 1


Thanks,
Jayapal

On 05-Dec-2013, at 12:11 PM, jason pavao 
mailto:jason.pa...@oracle.com>>
 wrote:

2013-12-04 23:36:07,519 DEBUG [allocator.impl.FirstFitAllocator] 
(secstorage-1:FirstFitRoutingAllocator) Host name: 
slcai547.us.oracle.com, hostId: 1 is in avoid 
set, skipping this and trying other available hosts
2013-12-04 23:36:07,520 DEBUG [allocator.impl.FirstFitAllocator] 
(secstorage-1:FirstFitRoutingAllocator) Host Allocator returning 0 suitable 
hosts
2013-12-04 23:36:07,520 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] 
(secstorage-1:null) No suitable hosts found
2013-12-04 23:36:07,520 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] 
(secstorage-1:null) No suitable hosts found under this Cluster: 1
2013-12-04 23:36:07,521 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] 
(secstorage-1:null) Could not find suitable Deployment Destination for this VM 
under any clusters, returning.
2013-12-04 23:36:07,521 DEBUG [cloud.deploy.FirstFitPlanner] 
(secstorage-1:null) Searching all possible resources under this Zone: 1
2013-12-04 23:36:07,522 DEBUG [cloud.deploy.FirstFitPlanner] 
(secstorage-1:null) Listing clusters in order of aggregate capacity, that have 
(atleast one host with) enough CPU and RAM capacity under this Zone: 1
2013-12-04 23:36:07,523 DEBUG [cloud.deploy.FirstFitPlanner] 
(secstorage-1:null) Removing from the clusterId list these clusters from avoid 
set: [1]
2013-12-04 23:36:07,524 DEBUG [cloud.deploy.FirstFitPlanner] 
(secstorage-1:null) No clusters found after removing disabled clusters and 
clusters in avoid list, returning.
2013-12-04 23:36:07,527 DEBUG [cloud.capacity.CapacityManagerImpl] 
(secstorage-1:null) VM state transitted from :Starting to Stopped with event: 
OperationFailedvm's original host id: null new host id: null host id before 
state transition: 1

Re: CS 4.2.1 install can't get system vms to start

[Radek Smigielski]

This seemed to be a problem: 

Host name: 
slcai547.us.oracle.com, hostId: 1 is in avoid set, skipping this and 
trying other available hosts

Your host is in avoid set an CS cannot find a hypervisor host to deploy SSVM. 
Now the question is why the host is in avoid set?  Log you posted doesn't 
explain this.


Radek Śmigielski

CS 4.2.1 install can't get system vms to start

[jason pavao]

Folks,
I am working on installing a new 4.2.1 CS installation and I believe 
I've taken care of all the prerequisites, however I am unable to start 
my system vms and proceed with bringing up my cloud.


Below is output from my management-server.log

Can anyone lend a hand and let me know what i've done wrong/whats not 
working?


Many thanks in advance!
-jason

2013-12-04 23:36:07,268 DEBUG [cloud.vm.VirtualMachineManagerImpl] 
(secstorage-1:null) Cleaning up resources for the vm 
VM[SecondaryStorageVm|s-7-VM] in Starting state
2013-12-04 23:36:07,269 DEBUG [agent.transport.Request] 
(secstorage-1:null) Seq 1-1792016451: Sending  { Cmd , MgmtId: 
345049479113, via: 1, Ver: v1, Flags: 100111, 
[{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":true,"vmName":"s-7-VM","wait":0}}] 
}
2013-12-04 23:36:07,275 DEBUG [cloud.network.NetworkManagerImpl] 
(consoleproxy-1:null) Asking VirtualRouter to prepare for 
Nic[15-5-3824b517-c0cb-4032-930e-ffa838c1a875-10.240.186.240]
2013-12-04 23:36:07,276 DEBUG [cloud.network.NetworkManagerImpl] 
(consoleproxy-1:null) Asking SecurityGroupProvider to prepare for 
Nic[15-5-3824b517-c0cb-4032-930e-ffa838c1a875-10.240.186.240]
2013-12-04 23:36:07,279 DEBUG [cloud.network.NetworkManagerImpl] 
(consoleproxy-1:null) Network id=202 is already implemented
2013-12-04 23:36:07,291 DEBUG [cloud.network.NetworkManagerImpl] 
(consoleproxy-1:null) Network id=201 is already implemented
2013-12-04 23:36:07,300 DEBUG [network.guru.PodBasedNetworkGuru] 
(consoleproxy-1:null) Allocated a nic 
NicProfile[17-5-3824b517-c0cb-4032-930e-ffa838c1a875-10.240.186.238-null 
for VM[ConsoleProxy|v-5-VM]
2013-12-04 23:36:07,303 DEBUG [cloud.storage.VolumeManagerImpl] 
(consoleproxy-1:null) Checking if we need to prepare 1 volumes for 
VM[ConsoleProxy|v-5-VM]
2013-12-04 23:36:07,307 DEBUG [storage.image.TemplateDataFactoryImpl] 
(consoleproxy-1:null) template 3 is already in store:1, type:Image
2013-12-04 23:36:07,309 DEBUG [storage.datastore.PrimaryDataStoreImpl] 
(consoleproxy-1:null) Not found (templateId:3poolId:2) in 
template_spool_ref, persisting it
2013-12-04 23:36:07,312 DEBUG [storage.image.TemplateDataFactoryImpl] 
(consoleproxy-1:null) template 3 is already in store:2, type:Primary
2013-12-04 23:36:07,313 DEBUG [storage.volume.VolumeServiceImpl] 
(consoleproxy-1:null) Found template routing-3 in storage pool 2 with 
VMTemplateStoragePool id: 12
2013-12-04 23:36:07,317 DEBUG [storage.volume.VolumeServiceImpl] 
(consoleproxy-1:null) Acquire lock on VMTemplateStoragePool 12 with 
timeout 3600 seconds
2013-12-04 23:36:07,318 INFO  [storage.volume.VolumeServiceImpl] 
(consoleproxy-1:null) lock is acquired for VMTemplateStoragePool 12
2013-12-04 23:36:07,321 DEBUG [storage.motion.AncientDataMotionStrategy] 
(consoleproxy-1:null) copyAsync inspecting src type TEMPLATE copyAsync 
inspecting dest type TEMPLATE
2013-12-04 23:36:07,326 DEBUG [agent.transport.Request] 
(consoleproxy-1:null) Seq 1-1792016452: Waiting for Seq 1792016451 
Scheduling:  { Cmd , MgmtId: 345049479113, via: 1, Ver: v1, Flags: 
100111, 
[{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/1/3/","origUrl":"http://download.cloud.com/templates/4.2/systemvmtemplate-2013-06-12-master-kvm.qcow2.bz2","uuid":"77aa140e-5ca7-11e3-a598-0050568d37c9","id":3,"format":"QCOW2","accountId":1,"checksum":"6cea42b2633841648040becb588bd8f0","hvm":false,"displayText":"SystemVM 
Template 
(KVM)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://slcnas5043.us.oracle.com/export/osn_images/cloud/cloudstack/secondary","_role":"Image"}},"name":"routing-3","hypervisorType":"KVM"}},"destTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"origUrl":"http://download.cloud.com/templates/4.2/systemvmtemplate-2013-06-12-master-kvm.qcow2.bz2","uuid":"77aa140e-5ca7-11e3-a598-0050568d37c9","id":3,"format":"QCOW2","accountId":1,"checksum":"6cea42b2633841648040becb588bd8f0","hvm":false,"displayText":"SystemVM 
Template 
(KVM)","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"57f8e728-f0b8-324d-96cb-fdad763e14be","id":2,"poolType":"NetworkFilesystem","host":"slcnas504.us.oracle.com","path":"/export/osn_images/cloud/cloudstack/primary","port":2049}},"name":"routing-3","hypervisorType":"KVM"}},"executeInSequence":true,"wait":10800}}] 
}
2013-12-04 23:36:07,486 DEBUG [agent.transport.Request] 
(AgentManager-Handler-12:null) Seq 1-1792016451: Processing:  { Ans: , 
MgmtId: 345049479113, via: 1, Ver: v1, Flags: 110, 
[{"com.cloud.agent.api.StopAnswer":{"vncPort":0,"result":true,"wait":0}}] }
2013-12-04 23:36:07,486 DEBUG [agent.manager.AgentAttache] 
(AgentManager-Handler-12:null) Seq 1-1792016452: Sending now.  is 
current sequence.
2013-12-04 23:36:07,487 DEBUG [agent.transport.Request] 
(secstorage-1:null) Seq 1-1792016451: Received:  { Ans: , MgmtId: 
345049479113, via: 1, Ver: v1, Flags: 110, { StopAnswer } }
201

RE: xenserver 6.2 added to pool

[Adam Harvey]

If it were only that way with these for me. They're completely stock I am at a 
loss of why this is occurring.

-Original Message-
From: Shanker Balan [mailto:shanker.ba...@shapeblue.com] 
Sent: Wednesday, December 04, 2013 8:05 PM
To: CloudStack-Users
Subject: Re: xenserver 6.2 added to pool

On 05-Dec-2013, at 4:47 am, Adam Harvey  wrote:

> 2013-12-04 23:13:44,097 DEBUG [utils.script.Script] 
> (DirectAgent-119:null) Looking for 
> scripts/vm/hypervisor/xenserver/xenserver60/patch in the classpath
> 2013-12-04 23:13:44,097 DEBUG [utils.script.Script] 
> (DirectAgent-119:null) System resource: null
> 2013-12-04 23:13:44,097 DEBUG [utils.script.Script] 
> (DirectAgent-119:null) Classpath resource: 
> file:/usr/share/cloudstack-management/webapps/client/WEB-INF/classes/s
> cripts/vm/hypervisor/xenserver/xenserver60/patch
> 2013-12-04 23:13:44,098 DEBUG [utils.script.Script] 
> (DirectAgent-119:null) Absolute path =  
> /usr/share/cloudstack-management/webapps/client/WEB-INF/classes/script
> s/vm/hypervisor/xenserver/xenserver60/patch
> 2013-12-04 23:13:44,098 DEBUG [xen.resource.CitrixResourceBase] 
> (DirectAgent-119:null) Copying 
> /usr/share/cloudstack-management/webapps/client/WEB-INF/classes/script
> s/vm/hypervisor/xenserver/xenserver60/../cloudstack_pluginlib.py to 
> /etc /xapi.d/plugins on *removed* with permission 0755
> 2013-12-04 23:13:44,163 DEBUG [xen.resource.CitrixResourceBase] 
> (DirectAgent-119:null) Copying 
> /usr/share/cloudstack-management/webapps/client/WEB-INF/classes/script
> s/vm/hypervisor/xenserver/xenserver60/../vmopsSnapshot to 
> /etc/xapi.d/pl ugins on *removed* with permission 0755
> 2013-12-04 23:13:44,164 DEBUG [xen.resource.CitrixResourceBase] 
> (DirectAgent-119:null) Unable to create destination path: 
> /etc/xapi.d/plugins on *removed* but trying anyway
> 2013-12-04 23:13:44,245 DEBUG [xen.resource.CitrixResourceBase] 
> (DirectAgent-119:null) Copying 
> /usr/share/cloudstack-management/webapps/client/WEB-INF/classes/script
> s/vm/hypervisor/xenserver/xenserver60/../ovs-vif-flows.py to 
> /etc/xapi.d /plugins on *removed* with permission 0755
> 2013-12-04 23:13:44,245 DEBUG [xen.resource.CitrixResourceBase] 
> (DirectAgent-119:null) Unable to create destination path: 
> /etc/xapi.d/plugins on *removed* but trying anyway
> 2013-12-04 23:13:44,327 DEBUG [xen.resource.CitrixResourceBase] 
> (DirectAgent-119:null) Copying 
> /usr/share/cloudstack-management/webapps/client/WEB-INF/classes/script
> s/vm/hypervisor/xenserver/xenserver60/../cloud-setup-bonding.sh to 
> /opt/ xensource/bin on *removed* with permission 0755
>
> This occurring w/anyone else?  Running CS 4.2 with xenserver 6.2 I've 
> verified vhd-util is the proper one recommended in the documentation and I 
> have it placed in:

The only place I put vhd-util is under 
/usr/share/cloudstack-common/scripts/vm/hypervisor/xenserver/
ON the management server before adding the XenServer hosts to ACS. See below 
ansible recipe.

- name: Copy vhd-util
  action: copy src=vhd-util 
dest=/usr/share/cloudstack-common/scripts/vm/hypervisor/xenserver/vhd-util 
mode=0755
  tags: cloudstack

The management server then does:

[root@csman1-1 ~]# grep vhd-util 
/var/log/cloudstack/management/management-server.log
2013-12-05 00:01:02,612 DEBUG [xen.resource.CitrixResourceBase] 
(DirectAgent-1:null) Copying 
/usr/share/cloudstack-common/scripts/vm/hypervisor/xenserver/xenserver60/../vhd-util
 to /opt/xensource/bin on 192.168.44.23 with permission 0755
2013-12-05 00:01:12,294 DEBUG [xen.resource.CitrixResourceBase] 
(DirectAgent-9:null) Copying 
/usr/share/cloudstack-common/scripts/vm/hypervisor/xenserver/xenserver60/../vhd-util
 to /opt/xensource/bin on 192.168.44.24 with permission 0755


> /usr/share/cloudstack-common/scripts/vm/hypervisor/xenserver/vhd-util
> /usr/share/cloudstack-common/scripts/vm/hypervisor/xenserver/xenserver
> 60/vhd-util 
> /usr/share/cloudstack-management/webapps/client/WEB-INF/classes/script
> s/vm/hypervisor/xenserver/xenserver60/vhd-util

Been adding and removing XenServer 6.2 clusters all day yesterday on stock ACS 
4.2.0 without issues.

Regards.

--
@shankerbalan

M: +91 98860 60539 | O: +91 (80) 67935867 shanker.ba...@shapeblue.com | 
www.shapeblue.com | Twitter:@shapeblue ShapeBlue Services India LLP, 22nd 
floor, Unit 2201A, World Trade Centre, Bangalore - 560 055

This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England & Wales. ShapeBlue Services India LLP is a company 
incorporated in India a

System VMs not starting

[Vosbury, David]

I've been trying to get an new install of CloudStack 4.2 working with a Vsphere 
cluster. I've went through creating my zone with advanced networking. I can see 
the system VMs but they are not started. The secondary storage vm seems to keep 
appearing and disappearing however. When I look in vcenter I see that vms are 
being created one after another named root-2 and then root-192, root-193 etc. 
They keep creating one after another until I shutdown the management service. 
Here is part of the management-server.log

Has anyone seen this before. I've seen some references to bugs that sound like 
this problem that were supposedly fixed back in August. I don' t know if I have 
an earlier build of 4.2, but I downloaded and compiled it just last week and 
I'm having this issue.

2013-12-05 00:07:28,642 WARN  [utils.crypt.EncryptionSecretKeyChecker] 
(Timer-2:null) Encryption already enabled, is check() called twice?
2013-12-05 00:07:29,394 DEBUG [cloud.server.ConfigurationServerImpl] 
(Timer-2:null) mount: warning: /systemvm_mnt seems to be mounted read-only.
2013-12-05 00:07:30,316 INFO  [xen.resource.XenServerConnectionPool] 
(Timer-2:null) XenServer Connection Pool Configs: 
manage.xenserver.pool.master=true; sleep.interval.on.error=1
2013-12-05 00:07:30,997 WARN  [utils.crypt.EncryptionSecretKeyChecker] 
(Timer-2:null) Encryption already enabled, is check() called twice?
2013-12-05 00:07:34,050 WARN  [apache.cloudstack.alerts] 
(Cluster-Notification-1:null)  alertType:: 14 // dataCenterId:: 0 // podId:: 0 
// clusterId:: null // message:: Management server node 10.2.150.100 is up
2013-12-05 00:07:34,071 WARN  [cloud.cluster.ClusterManagerImpl] 
(Cluster-Notification-1:null) Notifying management server join event took 39 ms
2013-12-05 00:08:33,140 ERROR [storage.resource.VmwareStorageProcessor] 
(DirectAgent-2:esxi2.ammscloud.com) clone volume from base image failed due to 
Exception: java.lang.RuntimeException
java.lang.RuntimeException: The name 'ROOT-2' already exists.
2013-12-05 00:08:33,145 DEBUG [agent.transport.Request] (DirectAgent-2:null) 
Seq 1-1861287941: Processing:  { Ans: , MgmtId: 146454222325, via: 1, Ver: v1, 
Flags: 110, 
[{"org.apache.cloudstack.storage.command.CopyCmdAnswer":{"result":false,"details":"java.lang.RuntimeException:
 The name 'ROOT-2' already exists.","wait":0}}] }
2013-12-05 00:08:33,163 WARN  [storage.datastore.ObjectInDataStoreManagerImpl] 
(consoleproxy-1:null) Unsupported data object (VOLUME, 
org.apache.cloudstack.storage.datastore.PrimaryDataStoreImpl@4838d3f7), no need 
to delete from object in store ref table
2013-12-05 00:08:33,164 DEBUG [cloud.storage.VolumeManagerImpl] 
(consoleproxy-1:null) Unable to create 
Vol[2|vm=2|ROOT]:java.lang.RuntimeException: The name 'ROOT-2' already exists.
2013-12-05 00:08:33,169 INFO  [cloud.vm.VirtualMachineManagerImpl] 
(consoleproxy-1:null) Unable to contact resource.
com.cloud.exception.StorageUnavailableException: Resource [StoragePool:4] is 
unreachable: Unable to create Vol[2|vm=2|ROOT]:java.lang.RuntimeException: The 
name 'ROOT-2' already exists.
2013-12-05 00:08:56,958 ERROR [storage.resource.VmwareStorageProcessor] 
(DirectAgent-4:esxi1.ammscloud.com) clone volume from base image failed due to 
Exception: java.lang.RuntimeException
java.lang.RuntimeException: File [iSCSI-Datastore-1] ROOT-203/ROOT-203.vmdk was 
not found
2013-12-05 00:08:56,960 DEBUG [agent.transport.Request] (DirectAgent-4:null) 
Seq 2-2058223621: Processing:  { Ans: , MgmtId: 146454222325, via: 2, Ver: v1, 
Flags: 110, 
[{"org.apache.cloudstack.storage.command.CopyCmdAnswer":{"result":false,"details":"java.lang.RuntimeException:
 File [iSCSI-Datastore-1] ROOT-203/ROOT-203.vmdk was not found","wait":0}}] }
2013-12-05 00:08:56,978 WARN  [storage.datastore.ObjectInDataStoreManagerImpl] 
(secstorage-1:null) Unsupported data object (VOLUME, 
org.apache.cloudstack.storage.datastore.PrimaryDataStoreImpl@6e0e449e), no need 
to delete from object in store ref table
2013-12-05 00:08:56,979 DEBUG [cloud.storage.VolumeManagerImpl] 
(secstorage-1:null) Unable to create 
Vol[203|vm=203|ROOT]:java.lang.RuntimeException: File [iSCSI-Datastore-1] 
ROOT-203/ROOT-203.vmdk was not found
2013-12-05 00:08:56,980 INFO  [cloud.vm.VirtualMachineManagerImpl] 
(secstorage-1:null) Unable to contact resource.
com.cloud.exception.StorageUnavailableException: Resource [StoragePool:4] is 
unreachable: Unable to create Vol[203|vm=203|ROOT]:java.lang.RuntimeException: 
File [iSCSI-Datastore-1] ROOT-203/ROOT-203.vmdk was not found
2013-12-05 00:08:57,231 DEBUG [cloud.capacity.CapacityManagerImpl] 
(consoleproxy-1:null) VM state transitted from :Starting to Stopped with event: 
OperationFailedvm's original host id: null new host id: null host id before 
state transition: 2
2013-12-05 00:08:57,272 WARN  [cloud.consoleproxy.ConsoleProxyManagerImpl] 
(consoleproxy-1:null) Exception while trying to start console proxy
com.cloud.exception.InsufficientServerCapacityException: Unable to cre

RE: Storage/Console SSVM loose connectivity (can't ping them anymore) after creating the first guest instance

[Sanjeev Neelarapu]

Hi,

Make sure that iptable rules are configured properly for icmp and ssh traffic 
on kvm host. 
I think icmp is disabled by default on SSVM and CPVM on control IP address, but 
should be allowed on public IP address.

Thanks,
Sanjeev

-Original Message-
From: Francesco Maria Magnini [mailto:fmm1...@gmail.com] 
Sent: Wednesday, December 04, 2013 9:23 PM
To: users@cloudstack.apache.org
Subject: Storage/Console SSVM loose connectivity (can't ping them anymore) 
after creating the first guest instance

I'm experiencing problems in Cloudstack 4.2 installation on both Ubuntu Server 
12.04 and 13.10.

   - Installed Cloudstack Management Controller and a KVM host in two
   separate boxes
   - Cloudstack installations went fine
   - Created a basic networking zone, all is green, storage ok, vvms ok

At this point, I'm able to ping physical hosts, Storage and Proxy SSVM public 
IP Address.

   - Created instance with basic template of CentOS, fine
   - Automatically created System Router

At this point I'm still able to ping physical hosts, but no longer Storage 
SSMV, Proxy SSVM and the CentOS instance created a while ago.

No errors, all is green, all processes running fine, just connectivity issue on 
the public network side of Proxy/Storage VVMS and Instances.

*IMPORTANT* I've configured Cloudstack in CentOS enviroment before testing 
Ubuntu Server, with both Basic and Advanced Networking (VLAN separation) 
without problems.

Security group is already configured with ICMP/SSH rules for inbound.

Any ideas? Thanks

RE: Password reset feature and "User Data" service

[Sanjeev Neelarapu]

Hi,

Create another network offering with dhcp,dns and userdata service and undate 
the shared network with these offerings. While doing the network update choose 
not to change the network cidr.

Thanks,
Sanjeev

-Original Message-
From: Andrija Panic [mailto:andrija.pa...@gmail.com] 
Sent: Wednesday, December 04, 2013 3:31 PM
To: users@cloudstack.apache.org
Subject: Password reset feature and "User Data" service

Hi,

I have kind of problem and need advice please.

I have 1 shared network for assigning public IP addresses to all VMs we create 
- with DHCP,DNS, and Virtual Router, as the services that are enabled in this 
networking tempalte.


Now I want to enable "password management/reset" features, but I got error 
messages "user data" service is not enabled for my network id=212.

So since modifications of Network tempalte is not possible, and the 
modification of the already deployed Network (id=212) is not possible
is there a change to hack the database to include the "User Data" service as 
the service in both the netowrk template, and for the already used network 
(id=212)

Any help would be really appriciated...

Thanks,
-- 

Andrija Panić

Re: Cloudstack user-data empty for VMs

[Derek Cole]

I will see what I can do. I dont have a github presently, but since I am
mostly working with FreeBSD I had to fix puppet's service resource, jason
hancocks section that look for dhcp leases and a couple of other things.
The userdata fix I put in seems to be working, though not when the puppet
agent is ubuntu presently, so I am trying to track that down.

I only saw one other branch in dans and it was showing like 9 months ago
for the latest work - is that the correct place I am looking?

-Derek
 On Dec 4, 2013 8:57 PM, "David Nalley"  wrote:

> Yeah - it's definitely a work in progress - if you look at Dan Bode's
> cloudstack_resources, he actually has a ton of additional work in a
> different branch that hasn't yet been validated. It's on my list to
> get around to that in the next few weeks. What you likely saw (esp if
> it was my presentation) was a combination of Jason Hancock's work
> around userdata and his fact - and then separately the resources and
> types for CloudStack. There are some folks who use CloudStack's
> records of hosts as a ENC - and that's where the 'Group=' stuff leaks
> into the presentation - essentially they query for the host - and
> parse the Group records and make catalog decisions off of that rather
> than a fact. (Keep in mind the 'down side' of going the fact route, is
> that essentially an attacker could pass any information back to puppet
> and get anything in the catalog theoretically)
>
> Please do submit a pull request for the userdata feature (feel free to
> submit it against my repo or Dan's)
>
> --David
>
> On Wed, Dec 4, 2013 at 6:44 PM, Derek Cole  wrote:
> > Well I started to post about getting something broken. I modified
> > cloudstack_resources to take an argument for userdata. I was getting all
> > kinds of issues with that, until I realized that the argument in userdata
> > has to be base64 encoded. I fixed that, and now my VMs can get their
> > metadata! I had seen a demo with this software at a puppet conference but
> > it's become clear to me it's not exactly complete, so I have been
> fighting
> > to learn ruby ever since to make things work.
> >
> > Thanks for the help.
>

Re: SecurityGroups, Advanced Zone And DefaultSharedNetworkOfferingWithSGService

[Shanker Balan]

On 05-Dec-2013, at 3:06 am, Radek Smigielski  wrote:

>>> FWIW, it works over here with the DB hack. :)
> Interesting, have you destroyed and re-created VR after you made a db hack?

Not yet.

I just redid the setup with Advanced Zone + Security Groups enabled.
I don’t really like the “reduced” functionality so gonna keep it simple with
a Basic Zone and an Advanced Zone.


--
@shankerbalan

M: +91 98860 60539 | O: +91 (80) 67935867
shanker.ba...@shapeblue.com | www.shapeblue.com | Twitter:@shapeblue
ShapeBlue Services India LLP, 22nd floor, Unit 2201A, World Trade Centre, 
Bangalore - 560 055

This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England & Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue Ltd. Shape 
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
operated under license from Shape Blue Ltd. ShapeBlue is a registered trademark.

Re: xenserver 6.2 added to pool

[Shanker Balan]

On 05-Dec-2013, at 4:47 am, Adam Harvey  wrote:

> 2013-12-04 23:13:44,097 DEBUG [utils.script.Script] (DirectAgent-119:null) 
> Looking for scripts/vm/hypervisor/xenserver/xenserver60/patch in the classpath
> 2013-12-04 23:13:44,097 DEBUG [utils.script.Script] (DirectAgent-119:null) 
> System resource: null
> 2013-12-04 23:13:44,097 DEBUG [utils.script.Script] (DirectAgent-119:null) 
> Classpath resource: 
> file:/usr/share/cloudstack-management/webapps/client/WEB-INF/classes/scripts/vm/hypervisor/xenserver/xenserver60/patch
> 2013-12-04 23:13:44,098 DEBUG [utils.script.Script] (DirectAgent-119:null) 
> Absolute path =  
> /usr/share/cloudstack-management/webapps/client/WEB-INF/classes/scripts/vm/hypervisor/xenserver/xenserver60/patch
> 2013-12-04 23:13:44,098 DEBUG [xen.resource.CitrixResourceBase] 
> (DirectAgent-119:null) Copying 
> /usr/share/cloudstack-management/webapps/client/WEB-INF/classes/scripts/vm/hypervisor/xenserver/xenserver60/../cloudstack_pluginlib.py
>  to /etc
> /xapi.d/plugins on *removed* with permission 0755
> 2013-12-04 23:13:44,163 DEBUG [xen.resource.CitrixResourceBase] 
> (DirectAgent-119:null) Copying 
> /usr/share/cloudstack-management/webapps/client/WEB-INF/classes/scripts/vm/hypervisor/xenserver/xenserver60/../vmopsSnapshot
>  to /etc/xapi.d/pl
> ugins on *removed* with permission 0755
> 2013-12-04 23:13:44,164 DEBUG [xen.resource.CitrixResourceBase] 
> (DirectAgent-119:null) Unable to create destination path: /etc/xapi.d/plugins 
> on *removed* but trying anyway
> 2013-12-04 23:13:44,245 DEBUG [xen.resource.CitrixResourceBase] 
> (DirectAgent-119:null) Copying 
> /usr/share/cloudstack-management/webapps/client/WEB-INF/classes/scripts/vm/hypervisor/xenserver/xenserver60/../ovs-vif-flows.py
>  to /etc/xapi.d
> /plugins on *removed* with permission 0755
> 2013-12-04 23:13:44,245 DEBUG [xen.resource.CitrixResourceBase] 
> (DirectAgent-119:null) Unable to create destination path: /etc/xapi.d/plugins 
> on *removed* but trying anyway
> 2013-12-04 23:13:44,327 DEBUG [xen.resource.CitrixResourceBase] 
> (DirectAgent-119:null) Copying 
> /usr/share/cloudstack-management/webapps/client/WEB-INF/classes/scripts/vm/hypervisor/xenserver/xenserver60/../cloud-setup-bonding.sh
>  to /opt/
> xensource/bin on *removed* with permission 0755
>
> This occurring w/anyone else?  Running CS 4.2 with xenserver 6.2
> I've verified vhd-util is the proper one recommended in the documentation and 
> I have it placed in:

The only place I put vhd-util is under 
/usr/share/cloudstack-common/scripts/vm/hypervisor/xenserver/
ON the management server before adding the XenServer hosts to ACS. See below 
ansible recipe.

- name: Copy vhd-util
  action: copy src=vhd-util 
dest=/usr/share/cloudstack-common/scripts/vm/hypervisor/xenserver/vhd-util 
mode=0755
  tags: cloudstack

The management server then does:

[root@csman1-1 ~]# grep vhd-util 
/var/log/cloudstack/management/management-server.log
2013-12-05 00:01:02,612 DEBUG [xen.resource.CitrixResourceBase] 
(DirectAgent-1:null) Copying 
/usr/share/cloudstack-common/scripts/vm/hypervisor/xenserver/xenserver60/../vhd-util
 to /opt/xensource/bin on 192.168.44.23 with permission 0755
2013-12-05 00:01:12,294 DEBUG [xen.resource.CitrixResourceBase] 
(DirectAgent-9:null) Copying 
/usr/share/cloudstack-common/scripts/vm/hypervisor/xenserver/xenserver60/../vhd-util
 to /opt/xensource/bin on 192.168.44.24 with permission 0755


> /usr/share/cloudstack-common/scripts/vm/hypervisor/xenserver/vhd-util
> /usr/share/cloudstack-common/scripts/vm/hypervisor/xenserver/xenserver60/vhd-util
> /usr/share/cloudstack-management/webapps/client/WEB-INF/classes/scripts/vm/hypervisor/xenserver/xenserver60/vhd-util

Been adding and removing XenServer 6.2 clusters all day yesterday on
stock ACS 4.2.0 without issues.

Regards.

--
@shankerbalan

M: +91 98860 60539 | O: +91 (80) 67935867
shanker.ba...@shapeblue.com | www.shapeblue.com | Twitter:@shapeblue
ShapeBlue Services India LLP, 22nd floor, Unit 2201A, World Trade Centre, 
Bangalore - 560 055

This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England & Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue Ltd. Shape 
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
operated under license from Shape Blue Ltd. ShapeBlue is a registered trademark.

Re: Cloudstack user-data empty for VMs

[David Nalley]

Yeah - it's definitely a work in progress - if you look at Dan Bode's
cloudstack_resources, he actually has a ton of additional work in a
different branch that hasn't yet been validated. It's on my list to
get around to that in the next few weeks. What you likely saw (esp if
it was my presentation) was a combination of Jason Hancock's work
around userdata and his fact - and then separately the resources and
types for CloudStack. There are some folks who use CloudStack's
records of hosts as a ENC - and that's where the 'Group=' stuff leaks
into the presentation - essentially they query for the host - and
parse the Group records and make catalog decisions off of that rather
than a fact. (Keep in mind the 'down side' of going the fact route, is
that essentially an attacker could pass any information back to puppet
and get anything in the catalog theoretically)

Please do submit a pull request for the userdata feature (feel free to
submit it against my repo or Dan's)

--David

On Wed, Dec 4, 2013 at 6:44 PM, Derek Cole  wrote:
> Well I started to post about getting something broken. I modified
> cloudstack_resources to take an argument for userdata. I was getting all
> kinds of issues with that, until I realized that the argument in userdata
> has to be base64 encoded. I fixed that, and now my VMs can get their
> metadata! I had seen a demo with this software at a puppet conference but
> it's become clear to me it's not exactly complete, so I have been fighting
> to learn ruby ever since to make things work.
>
> Thanks for the help.

Re: Cloudstack user-data empty for VMs

[Derek Cole]

Well I started to post about getting something broken. I modified
cloudstack_resources to take an argument for userdata. I was getting all
kinds of issues with that, until I realized that the argument in userdata
has to be base64 encoded. I fixed that, and now my VMs can get their
metadata! I had seen a demo with this software at a puppet conference but
it's become clear to me it's not exactly complete, so I have been fighting
to learn ruby ever since to make things work.

Thanks for the help.

RE: Issue with imported VHD from CS 4.0

[Adam Harvey]

Hi Geoff thank you for your response.

Fortunately (or contextually unfortunately =) ) it is running. 
Currently the advanced setup has 4 different VLAN tagged and this particular 
VHD will for test purposes connect to one.

Hmm, after another attempt I've received:

2013-12-04 23:34:31,699 INFO  [cloud.vm.VirtualMachineManagerImpl] 
(Job-Executor-36:job-131 = [ 4f6a0267-7d26-4a4c-a160-fb22bd450fe5 ]) Unable to 
contact resource.
com.cloud.exception.StorageUnavailableException: Resource [StoragePool:1] is 
unreachable: Unable to create Vol[44|vm=40|ROOT]:Catch Exception 
com.cloud.utils.exception.CloudRuntimeException for template +  due to 
com.cloud.utils.exceptio
n.CloudRuntimeException: failed
at 
com.cloud.storage.VolumeManagerImpl.recreateVolume(VolumeManagerImpl.java:2544)
at 
com.cloud.storage.VolumeManagerImpl.prepare(VolumeManagerImpl.java:2592)
at 
com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:889)
at 
com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:578)
at 
org.apache.cloudstack.engine.cloud.entity.api.VMEntityManagerImpl.deployVirtualMachine(VMEntityManagerImpl.java:227)
at 
org.apache.cloudstack.engine.cloud.entity.api.VirtualMachineEntityImpl.deploy(VirtualMachineEntityImpl.java:209)
at 
com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3406)
at 
com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:2966)
at 
com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:2952)
at 
com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
at 
org.apache.cloudstack.api.command.user.vm.DeployVMCmd.execute(DeployVMCmd.java:420)
at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:158)
at 
com.cloud.async.AsyncJobManagerImpl$1.run(AsyncJobManagerImpl.java:531)
at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:701)

In addition to the previous errors listed below.

The storage setup: 10gb NFS primary and secondary storage on a Netapp.  
Hypervisors have acceptable settings for read/write.



-Original Message-
From: Geoff Higginbottom [mailto:geoff.higginbot...@shapeblue.com] 
Sent: Wednesday, December 04, 2013 3:29 PM
To: 
Cc: users@cloudstack.apache.org
Subject: Re: Issue with imported VHD from CS 4.0

Adam,

Is the VR running for the network you are trying to connect the VM to?  I often 
see VMs failing to start when it's actually the VR failing to start which is 
the real cause of the issue.

Regards

Geoff Higginbottom
CTO / Cloud Architect


D: +44 20 3603 0542 | S: +44 20 3603 0540 
| M: +447968161581

geoff.higginbot...@shapeblue.com | 
www.shapeblue.com

ShapeBlue Ltd, 53 Chandos Place, Covent Garden, London, WC2N 
4HS



On 4 Dec 2013, at 23:21, "Adam Harvey" 
mailto:ahar...@enmasse.com>> wrote:

After importing a VHD (centos 6.4) as a template into CS4.2 (The vhd was 
running previously on a CS4.0 cloud), running into the following issue when 
attempting to deploy it as a small instance:

2013-12-04 23:18:18,637 DEBUG 
[network.router.VirtualNetworkApplianceManagerImpl] 
(RouterStatusMonitor-1:null) Found 0 routers to update status.
2013-12-04 23:18:18,638 DEBUG 
[network.router.VirtualNetworkApplianceManagerImpl] 
(RouterStatusMonitor-1:null) Found 0 networks to update RvR status.
2013-12-04 23:18:18,659 DEBUG 
[network.router.VirtualNetworkApplianceManagerImpl] 
(RouterStatusMonitor-1:null) Found 0 routers to update status.
2013-12-04 23:18:18,660 DEBUG 
[network.router.VirtualNetworkApplianceManagerImpl] 
(RouterStatusMonitor-1:null) Found 0 networks to update RvR status.
2013-12-04 23:18:21,065 WARN  [xen.resource.XenServerStorageProcessor] 
(DirectAgent-223:null) failed
2013-12-04 23:18:21,065 WARN  [xen.resource.XenServerStorageProcessor] 
(DirectAgent-223:null) Catch Exception 
com.cloud.utils.exception.CloudRuntimeException for template +  due to 
com.cloud.utils.exception.CloudRuntimeException: failed
com.cloud.utils.exception.CloudRuntimeException: failed
   at 
com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.copy_vhd_from_secondarystorage(XenServerStorageProcessor.java:792)
   at 
com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.copyTemplateToPrimaryStorage(XenServerStorageProcessor.java:863)
   at 
com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(StorageSubsystemCom

Re: Issue with imported VHD from CS 4.0

[Geoff Higginbottom]

Adam,

Is the VR running for the network you are trying to connect the VM to?  I often 
see VMs failing to start when it's actually the VR failing to start which is 
the real cause of the issue.

Regards

Geoff Higginbottom
CTO / Cloud Architect


D: +44 20 3603 0542 | S: +44 20 3603 0540 
| M: +447968161581

geoff.higginbot...@shapeblue.com | 
www.shapeblue.com

ShapeBlue Ltd, 53 Chandos Place, Covent Garden, London, WC2N 
4HS



On 4 Dec 2013, at 23:21, "Adam Harvey" 
mailto:ahar...@enmasse.com>> wrote:

After importing a VHD (centos 6.4) as a template into CS4.2 (The vhd was 
running previously on a CS4.0 cloud), running into the following issue when 
attempting to deploy it as a small instance:

2013-12-04 23:18:18,637 DEBUG 
[network.router.VirtualNetworkApplianceManagerImpl] 
(RouterStatusMonitor-1:null) Found 0 routers to update status.
2013-12-04 23:18:18,638 DEBUG 
[network.router.VirtualNetworkApplianceManagerImpl] 
(RouterStatusMonitor-1:null) Found 0 networks to update RvR status.
2013-12-04 23:18:18,659 DEBUG 
[network.router.VirtualNetworkApplianceManagerImpl] 
(RouterStatusMonitor-1:null) Found 0 routers to update status.
2013-12-04 23:18:18,660 DEBUG 
[network.router.VirtualNetworkApplianceManagerImpl] 
(RouterStatusMonitor-1:null) Found 0 networks to update RvR status.
2013-12-04 23:18:21,065 WARN  [xen.resource.XenServerStorageProcessor] 
(DirectAgent-223:null) failed
2013-12-04 23:18:21,065 WARN  [xen.resource.XenServerStorageProcessor] 
(DirectAgent-223:null) Catch Exception 
com.cloud.utils.exception.CloudRuntimeException for template +  due to 
com.cloud.utils.exception.CloudRuntimeException: failed
com.cloud.utils.exception.CloudRuntimeException: failed
   at 
com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.copy_vhd_from_secondarystorage(XenServerStorageProcessor.java:792)
   at 
com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.copyTemplateToPrimaryStorage(XenServerStorageProcessor.java:863)
   at 
com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(StorageSubsystemCommandHandlerBase.java:70)
   at 
com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStorageCommands(StorageSubsystemCommandHandlerBase.java:49)
   at 
com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:621)
   at 
com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:73)
   at 
com.cloud.hypervisor.xen.resource.XenServer610Resource.executeRequest(XenServer610Resource.java:104)
   at 
com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.java:186)
   at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
   at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
   at java.util.concurrent.FutureTask.run(FutureTask.java:166)
   at 
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165)
   at 
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266)
   at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
   at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   at java.lang.Thread.run(Thread.java:701)

A few moments later it will be followed by:
2013-12-04 23:18:21,326 INFO  [user.vm.DeployVMCmd] (Job-Executor-35:job-130 = 
[ 6bf6e24d-2ccb-4e47-a6d1-9dc12208ec7b ]) Unable to create a deployment for 
VM[User|96e3bd39-e29d-4ce4-9e16-b5ea86d7fd23]
com.cloud.exception.InsufficientServerCapacityException: Unable to create a 
deployment for VM[User|96e3bd39-e29d-4ce4-9e16-b5ea86d7fd23]Scope=interface 
com.cloud.dc.DataCenter; id=1
   at 
com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:842)
   at 
com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:578)
   at 
org.apache.cloudstack.engine.cloud.entity.api.VMEntityManagerImpl.deployVirtualMachine(VMEntityManagerImpl.java:237)
   at 
org.apache.cloudstack.engine.cloud.entity.api.VirtualMachineEntityImpl.deploy(VirtualMachineEntityImpl.java:209)
   at 
com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3406)
   at 
com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:2966)
   at 
com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:2952)
   at 
com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
   at 
org.apache.cloudstack.api.command.user.vm.DeployVMCmd.execute(DeployVMCmd.java:420)
   at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:158)
   at 
com.cloud.async.AsyncJobManagerImpl$1.run(AsyncJobManagerImpl.java:531)
   at 
java.util.concurrent.Execut

Issue with imported VHD from CS 4.0

[Adam Harvey]

After importing a VHD (centos 6.4) as a template into CS4.2 (The vhd was 
running previously on a CS4.0 cloud), running into the following issue when 
attempting to deploy it as a small instance:

2013-12-04 23:18:18,637 DEBUG 
[network.router.VirtualNetworkApplianceManagerImpl] 
(RouterStatusMonitor-1:null) Found 0 routers to update status.
2013-12-04 23:18:18,638 DEBUG 
[network.router.VirtualNetworkApplianceManagerImpl] 
(RouterStatusMonitor-1:null) Found 0 networks to update RvR status.
2013-12-04 23:18:18,659 DEBUG 
[network.router.VirtualNetworkApplianceManagerImpl] 
(RouterStatusMonitor-1:null) Found 0 routers to update status.
2013-12-04 23:18:18,660 DEBUG 
[network.router.VirtualNetworkApplianceManagerImpl] 
(RouterStatusMonitor-1:null) Found 0 networks to update RvR status.
2013-12-04 23:18:21,065 WARN  [xen.resource.XenServerStorageProcessor] 
(DirectAgent-223:null) failed
2013-12-04 23:18:21,065 WARN  [xen.resource.XenServerStorageProcessor] 
(DirectAgent-223:null) Catch Exception 
com.cloud.utils.exception.CloudRuntimeException for template +  due to 
com.cloud.utils.exception.CloudRuntimeException: failed
com.cloud.utils.exception.CloudRuntimeException: failed
at 
com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.copy_vhd_from_secondarystorage(XenServerStorageProcessor.java:792)
at 
com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.copyTemplateToPrimaryStorage(XenServerStorageProcessor.java:863)
at 
com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(StorageSubsystemCommandHandlerBase.java:70)
at 
com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStorageCommands(StorageSubsystemCommandHandlerBase.java:49)
at 
com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:621)
at 
com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:73)
at 
com.cloud.hypervisor.xen.resource.XenServer610Resource.executeRequest(XenServer610Resource.java:104)
at 
com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.java:186)
at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at 
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165)
at 
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:701)

A few moments later it will be followed by:
2013-12-04 23:18:21,326 INFO  [user.vm.DeployVMCmd] (Job-Executor-35:job-130 = 
[ 6bf6e24d-2ccb-4e47-a6d1-9dc12208ec7b ]) Unable to create a deployment for 
VM[User|96e3bd39-e29d-4ce4-9e16-b5ea86d7fd23]
com.cloud.exception.InsufficientServerCapacityException: Unable to create a 
deployment for VM[User|96e3bd39-e29d-4ce4-9e16-b5ea86d7fd23]Scope=interface 
com.cloud.dc.DataCenter; id=1
at 
com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:842)
at 
com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:578)
at 
org.apache.cloudstack.engine.cloud.entity.api.VMEntityManagerImpl.deployVirtualMachine(VMEntityManagerImpl.java:237)
at 
org.apache.cloudstack.engine.cloud.entity.api.VirtualMachineEntityImpl.deploy(VirtualMachineEntityImpl.java:209)
at 
com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3406)
at 
com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:2966)
at 
com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:2952)
at 
com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
at 
org.apache.cloudstack.api.command.user.vm.DeployVMCmd.execute(DeployVMCmd.java:420)
at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:158)
at 
com.cloud.async.AsyncJobManagerImpl$1.run(AsyncJobManagerImpl.java:531)
at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:701)
2013-12-04 23:18:21,328 DEBUG [cloud.async.AsyncJobManagerImpl] 
(Job-Executor-35:job-130 = [ 6bf6e24

xenserver 6.2 added to pool

[Adam Harvey]

2013-12-04 23:13:44,097 DEBUG [utils.script.Script] (DirectAgent-119:null) 
Looking for scripts/vm/hypervisor/xenserver/xenserver60/patch in the classpath
2013-12-04 23:13:44,097 DEBUG [utils.script.Script] (DirectAgent-119:null) 
System resource: null
2013-12-04 23:13:44,097 DEBUG [utils.script.Script] (DirectAgent-119:null) 
Classpath resource: 
file:/usr/share/cloudstack-management/webapps/client/WEB-INF/classes/scripts/vm/hypervisor/xenserver/xenserver60/patch
2013-12-04 23:13:44,098 DEBUG [utils.script.Script] (DirectAgent-119:null) 
Absolute path =  
/usr/share/cloudstack-management/webapps/client/WEB-INF/classes/scripts/vm/hypervisor/xenserver/xenserver60/patch
2013-12-04 23:13:44,098 DEBUG [xen.resource.CitrixResourceBase] 
(DirectAgent-119:null) Copying 
/usr/share/cloudstack-management/webapps/client/WEB-INF/classes/scripts/vm/hypervisor/xenserver/xenserver60/../cloudstack_pluginlib.py
 to /etc
/xapi.d/plugins on *removed* with permission 0755
2013-12-04 23:13:44,163 DEBUG [xen.resource.CitrixResourceBase] 
(DirectAgent-119:null) Copying 
/usr/share/cloudstack-management/webapps/client/WEB-INF/classes/scripts/vm/hypervisor/xenserver/xenserver60/../vmopsSnapshot
 to /etc/xapi.d/pl
ugins on *removed* with permission 0755
2013-12-04 23:13:44,164 DEBUG [xen.resource.CitrixResourceBase] 
(DirectAgent-119:null) Unable to create destination path: /etc/xapi.d/plugins 
on *removed* but trying anyway
2013-12-04 23:13:44,245 DEBUG [xen.resource.CitrixResourceBase] 
(DirectAgent-119:null) Copying 
/usr/share/cloudstack-management/webapps/client/WEB-INF/classes/scripts/vm/hypervisor/xenserver/xenserver60/../ovs-vif-flows.py
 to /etc/xapi.d
/plugins on *removed* with permission 0755
2013-12-04 23:13:44,245 DEBUG [xen.resource.CitrixResourceBase] 
(DirectAgent-119:null) Unable to create destination path: /etc/xapi.d/plugins 
on *removed* but trying anyway
2013-12-04 23:13:44,327 DEBUG [xen.resource.CitrixResourceBase] 
(DirectAgent-119:null) Copying 
/usr/share/cloudstack-management/webapps/client/WEB-INF/classes/scripts/vm/hypervisor/xenserver/xenserver60/../cloud-setup-bonding.sh
 to /opt/
xensource/bin on *removed* with permission 0755

This occurring w/anyone else?  Running CS 4.2 with xenserver 6.2
I've verified vhd-util is the proper one recommended in the documentation and I 
have it placed in:
/usr/share/cloudstack-common/scripts/vm/hypervisor/xenserver/vhd-util
/usr/share/cloudstack-common/scripts/vm/hypervisor/xenserver/xenserver60/vhd-util
/usr/share/cloudstack-management/webapps/client/WEB-INF/classes/scripts/vm/hypervisor/xenserver/xenserver60/vhd-util

Thanks,
Adam

Re: Unable to execute PrimaryStorageDownloadCommand

[Nitin Mehta]

Sean - I can confirm from the code that what you have seen is a valid bug.
But should be a problem only for templates occurring in multiple zones.
Would you mind filing a bug for this please ?

Thanks,
-Nitin

On 04/12/13 1:44 PM, "Sean Hamilton"  wrote:

>We're seeing a bug where cloudstack tries to spool a template from any
>secondary storage in any zone in a region to primary storage.
>
>DB selects show a rand() at the end, it took a few attempts to get the
>template onto primary storage.
>
>Must be a bug. 
>
>> On 4 Dec 2013, at 13:23, John Skinner  wrote:
>> 
>> I did confirm that the template does exist in the directory.
>>> On Dec 3, 2013, at 11:05 PM, Sanjeev Neelarapu
>>> wrote:
>>> 
>>> Hi,
>>> 
>>> Can you make sure that the template with which you are trying to
>>>deploy a VM is present on the secondary Storage inside 244 directory?
>>> 
>>> -Sanjeev
>>> -Original Message-
>>> From: John Skinner [mailto:john.skin...@appcore.com]
>>> Sent: Wednesday, December 04, 2013 12:55 AM
>>> To: users@cloudstack.apache.org
>>> Subject: Unable to execute PrimaryStorageDownloadCommand
>>> 
>>> Environment running CloudStack 4.1.1 with VMware vSphere 5.1 nodes and
>>>NFS backed Primary Storage data stores. We are currently having issues
>>>creating VMs from a template when we have to copy the template from
>>>secondary storage. If the template already exists on primary storage
>>>then the VM gets created just fine. I have already checked the mount
>>>points and vCenter has read/write access to the NFS share for secondary
>>>storage, and the secondary storage VM has the share mounted and can
>>>read/write to it as well.
>>> 
>>> This is the exception from the management server logs:
>>> 
>>> 2013-12-03 09:13:10,468 DEBUG [agent.manager.AgentManagerImpl]
>>>(Job-Executor-9:job-14655) Details from executing class
>>>com.cloud.agent.api.storage.PrimaryStorageDownloadCommand: Unable to
>>>execute PrimaryStorageDownloadCommand due to exception
>>> 2013-12-03 09:13:10,468 DEBUG [cloud.template.TemplateManagerImpl]
>>>(Job-Executor-9:job-14655) Template 244 download to pool 222 failed due
>>>to Unable to execute PrimaryStorageDownloadCommand due to exception
>>> 2013-12-03 09:13:10,469 DEBUG [cloud.template.TemplateManagerImpl]
>>>(Job-Executor-9:job-14655) Template 244 is not found on and can not be
>>>downloaded to pool 222
>>> 2013-12-03 09:13:10,469 DEBUG [cloud.storage.StorageManagerImpl]
>>>(Job-Executor-9:job-14655) Cannot use this pool
>>>Pool[222|NetworkFilesystem] because we can't propagate template
>>>Tmpl[244-OVA-244-2-0e18671b-1f2a-3b10-8b1a-7608bda5695c
>>> 2013-12-03 09:13:10,505 DEBUG [agent.manager.AgentAttache]
>>>(AgentManager-Handler-15:null) Seq 59-806028519: No more commands found
>>> 2013-12-03 09:13:10,580 INFO  [cloud.vm.VirtualMachineManagerImpl]
>>>(Job-Executor-9:job-14655) Unable to contact resource.
>>> com.cloud.exception.StorageUnavailableException: Resource
>>>[StoragePool:222] is unreachable: Unable to create
>>>Vol[11319|vm=11283|ROOT]
>>>   at 
>>>com.cloud.storage.StorageManagerImpl.prepare(StorageManagerImpl.java:348
>>>8)
>>>   at 
>>>com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManage
>>>rImpl.java:748)
>>>   at 
>>>com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.j
>>>ava:471)
>>>   at 
>>>org.apache.cloudstack.engine.cloud.entity.api.VMEntityManagerImpl.deploy
>>>VirtualMachine(VMEntityManagerImpl.java:212)
>>>   at 
>>>org.apache.cloudstack.engine.cloud.entity.api.VirtualMachineEntityImpl.d
>>>eploy(VirtualMachineEntityImpl.java:209)
>>>   at 
>>>com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.jav
>>>a:3871)
>>>   at 
>>>com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.jav
>>>a:3464)
>>>   at 
>>>com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.jav
>>>a:3450)
>>>   at 
>>>com.cloud.utils.component.ComponentInstantiationPostProcessor$Intercepto
>>>rDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
>>>   at 
>>>org.apache.cloudstack.api.command.user.vm.DeployVMCmd.execute(DeployVMCm
>>>d.java:379)
>>>   at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:162)
>>>   at 
>>>com.cloud.async.AsyncJobManagerImpl$1.run(AsyncJobManagerImpl.java:437)
>>>   at 
>>>java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>>>   at 
>>>java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
>>>   at java.util.concurrent.FutureTask.run(FutureTask.java:166)
>>>   at 
>>>java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.jav
>>>a:1146)
>>>   at 
>>>java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.ja
>>>va:615)
>>>   at java.lang.Thread.run(Thread.java:679)
>>> 2013-12-03 09:13:10,660 DEBUG [cloud.vm.VirtualMachineManagerImpl]
>>>(Job-Executor-9:job-14655) Cleaning up resources for the vm
>>>VM[User|OrangeTest] in Starting s

Re: Unable to execute PrimaryStorageDownloadCommand

[Sean Hamilton]

We're seeing a bug where cloudstack tries to spool a template from any 
secondary storage in any zone in a region to primary storage. 

DB selects show a rand() at the end, it took a few attempts to get the template 
onto primary storage. 

Must be a bug. 

> On 4 Dec 2013, at 13:23, John Skinner  wrote:
> 
> I did confirm that the template does exist in the directory.
>> On Dec 3, 2013, at 11:05 PM, Sanjeev Neelarapu 
>>  wrote:
>> 
>> Hi,
>> 
>> Can you make sure that the template with which you are trying to deploy a VM 
>> is present on the secondary Storage inside 244 directory?
>> 
>> -Sanjeev
>> -Original Message-
>> From: John Skinner [mailto:john.skin...@appcore.com] 
>> Sent: Wednesday, December 04, 2013 12:55 AM
>> To: users@cloudstack.apache.org
>> Subject: Unable to execute PrimaryStorageDownloadCommand
>> 
>> Environment running CloudStack 4.1.1 with VMware vSphere 5.1 nodes and NFS 
>> backed Primary Storage data stores. We are currently having issues creating 
>> VMs from a template when we have to copy the template from secondary 
>> storage. If the template already exists on primary storage then the VM gets 
>> created just fine. I have already checked the mount points and vCenter has 
>> read/write access to the NFS share for secondary storage, and the secondary 
>> storage VM has the share mounted and can read/write to it as well.
>> 
>> This is the exception from the management server logs:
>> 
>> 2013-12-03 09:13:10,468 DEBUG [agent.manager.AgentManagerImpl] 
>> (Job-Executor-9:job-14655) Details from executing class 
>> com.cloud.agent.api.storage.PrimaryStorageDownloadCommand: Unable to execute 
>> PrimaryStorageDownloadCommand due to exception
>> 2013-12-03 09:13:10,468 DEBUG [cloud.template.TemplateManagerImpl] 
>> (Job-Executor-9:job-14655) Template 244 download to pool 222 failed due to 
>> Unable to execute PrimaryStorageDownloadCommand due to exception
>> 2013-12-03 09:13:10,469 DEBUG [cloud.template.TemplateManagerImpl] 
>> (Job-Executor-9:job-14655) Template 244 is not found on and can not be 
>> downloaded to pool 222
>> 2013-12-03 09:13:10,469 DEBUG [cloud.storage.StorageManagerImpl] 
>> (Job-Executor-9:job-14655) Cannot use this pool Pool[222|NetworkFilesystem] 
>> because we can't propagate template 
>> Tmpl[244-OVA-244-2-0e18671b-1f2a-3b10-8b1a-7608bda5695c
>> 2013-12-03 09:13:10,505 DEBUG [agent.manager.AgentAttache] 
>> (AgentManager-Handler-15:null) Seq 59-806028519: No more commands found
>> 2013-12-03 09:13:10,580 INFO  [cloud.vm.VirtualMachineManagerImpl] 
>> (Job-Executor-9:job-14655) Unable to contact resource.
>> com.cloud.exception.StorageUnavailableException: Resource [StoragePool:222] 
>> is unreachable: Unable to create Vol[11319|vm=11283|ROOT]
>>   at 
>> com.cloud.storage.StorageManagerImpl.prepare(StorageManagerImpl.java:3488)
>>   at 
>> com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:748)
>>   at 
>> com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:471)
>>   at 
>> org.apache.cloudstack.engine.cloud.entity.api.VMEntityManagerImpl.deployVirtualMachine(VMEntityManagerImpl.java:212)
>>   at 
>> org.apache.cloudstack.engine.cloud.entity.api.VirtualMachineEntityImpl.deploy(VirtualMachineEntityImpl.java:209)
>>   at 
>> com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3871)
>>   at 
>> com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3464)
>>   at 
>> com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3450)
>>   at 
>> com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
>>   at 
>> org.apache.cloudstack.api.command.user.vm.DeployVMCmd.execute(DeployVMCmd.java:379)
>>   at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:162)
>>   at 
>> com.cloud.async.AsyncJobManagerImpl$1.run(AsyncJobManagerImpl.java:437)
>>   at 
>> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>>   at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
>>   at java.util.concurrent.FutureTask.run(FutureTask.java:166)
>>   at 
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
>>   at 
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>>   at java.lang.Thread.run(Thread.java:679)
>> 2013-12-03 09:13:10,660 DEBUG [cloud.vm.VirtualMachineManagerImpl] 
>> (Job-Executor-9:job-14655) Cleaning up resources for the vm 
>> VM[User|OrangeTest] in Starting state
>> 
>> And this is the same error, however this is from the systemvm.log on the 
>> Secondary Storage VM:
>> 
>> 2013-12-03 15:26:43,125 DEBUG [cloud.agent.Agent] (agentRequest-Handler-5:) 
>> Processing command: com.cloud.agent.api.storage.PrimaryStorageDownloadCommand
>> 2013-12-03 15:26:43,126 DEBUG 
>> [storage.resource.VmwareSec

Re: SecurityGroups, Advanced Zone And DefaultSharedNetworkOfferingWithSGService

[Radek Smigielski]

>> FWIW, it works over here with the DB hack. :)
Interesting, have you destroyed and re-created VR after you made a db hack?
 


- Radoslaw  Smigielski

Re: WG: ERROR: Adding volumes when a VMs were deploy.

[Radek Smigielski]

  
>> -->The Zone isn’t configure with “local storage”-Save.
>> Primary- and Secondary-Storage is on the management-Server.
How is configured your primary storage? Is it shared mount-point? This could be 
misleading for the mgmt server and that's why you see that local storage is not 
available. 

What I see interesting in the logs is this:

2013-12-04 15:33:43,846 DEBUG [cloud.deploy.FirstFitPlanner] 
(Job-Executor-8:job-54 = [ bb6690cc-ef26-4557-baf6-829a5f6a9b4f ]) Listing 
clusters in order of aggregate
 capacity, that have (atleast one host with) enough CPU and RAM capacity under 
this Zone: 1
2013-12-04 15:33:43,848 DEBUG [cloud.deploy.FirstFitPlanner] 
(Job-Executor-8:job-54 = [ bb6690cc-ef26-4557-baf6-829a5f6a9b4f ]) No clus ters 
found having a host with enough capacity, returning.


Radek.

Re: Cloudstack user-data empty for VMs

[Carlos Reátegui]

What you want to do should work. 
Not familiar with cloudstack_resources. Does it have a means to set user data 
when creating an instance?  If so, have you checked the user data manually (ie 
querying the vr/dhcp server) to see that it was set?


> On Dec 4, 2013, at 3:19 PM, Derek Cole  wrote:
> 
> Hrmm - Maybe I am not being exactly clear.
> 
> I originally started out trying to use puppet to not only configure my VMs,
> but provision them in the cloud as well. I started out with a template in
> cloudstack, and have been using cloudstack_resources to create new VMs
> automatically when my puppet manifest is applied.
> 
> Creating the VMs and all seems to work, however, I need a way to push
> specific configurations to specific boxes based on their role, so I was
> hoping to use the "role=whatever" userdata to be able to distinguish the
> different types of VMs that I have provisioned without having to have a
> bunch of node blocks to distinguish them by name.
> 
> Maybe using cloudmonkey or some other tool is more effective, however I
> guess I was just trying to figure out how to use the supposedly already
> written puppet types to give me something out of the box that is "one
> command" provisioning and configuring.
> 
> -Derek
> 
> 
> On Wed, Dec 4, 2013 at 2:56 PM, Hiroki Ohashi wrote:
> 
>> Hi Derek
>> 
>> When you use user-data, you have to provide user-data and deliver it
>> to virtual router. Unfortunately, CloudStack only provides REST API to
>> deliver user-data to virtual router now. This API is
>> deployVirtualMachine that creates instance and set instance specific
>> data.
>> 
>> For example, I assume you want to deliver a shell script as user-data
>> below.
>> 
>>--
>>#! /bin/sh
>> 
>>echo "Hello user-data!"
>>--
>> 
>> In this case, you can call deployVirtualMachine by CloudMonkey like
>> this.
>> 
>>$ cloudmonkey deploy virtualmachine serviceofferingid=XXX
>> templateid=XXX zoneid=XXX networkids=XXX
>> userdata='IyEgL2Jpbi9zaAoKZWNobyAiSGVsbG8gdXNlci1kYXRhISIK'
>> 
>> As a result of the command, a new instance is created with user-data
>> delivered to virtual router, so you can access user-data from the
>> instance.
>> 
>> CloudMonkey is CLI tool to call CloudStack REST API easily and you can
>> give parameters as key value pair. In the example, user-data is base64
>> encoded shell script and provied as a parameter.
>> 
>> Best regards
>> Hiroki Ohashi
>> 
>> 2013/12/5 Derek Cole :
>>> I was kind of wondering about that, when I saw it earlier. It appears
>> that
>>> maybe the cloudstack_resources module has become out of date? I think you
>>> are the preparer of a slide-show I was following here:
>>> http://www.slideshare.net/PuppetLabs/cloudstack-18489665
>>> 
>>> It seems like in those slides, Group was being used to hold the roles?
>> This
>>> is why I assumed that was OK. I was doing something like
>>> 
>>>case $::role {
>>>'db': {
>>>notify {"detected a fact named role with value
>> db"
>>> :}
>>>}
>>>}
>>> because I thought that the custom fact here:
>>> 
>> https://github.com/jasonhancock/puppet-facts/blob/master/cloudstack_userdata.rb
>>> 
>>> Turned the cloudstack userdata into a fact where if you had
>>> "role=db,foo=bar" you would get two custom facts, role and foo, with
>> their
>>> respective values.
>>> 
>>> May I ask for some clarity if that is not the intended usage?
>>> 
>>> In my case, obviously cloudstack_userdata is not generating the correct
>>> facts, because the wget that is in that code returns nothing because
>>> userdata is empty.
>>> 
>>> Thanks,
>>> 
>>> -Derek
>>> 
>>> 
>>> 
 On Wed, Dec 4, 2013 at 12:57 PM, David Nalley  wrote:
 
 Hi Derek:
 
 Glad that the puppet resources are useful.
 
 Setting user-data is different than setting group:
 
 Look at the options here:
 
 
>> http://cloudstack.apache.org/docs/api/apidocs-4.2/user/deployVirtualMachine.html
 
 --David
 
 On Wed, Dec 4, 2013 at 11:54 AM, Derek Cole 
>> wrote:
> Hello,
> 
> I am attempting to use the cloudstack API to get user-data for my VMs.
> 
> I am creating the VMs with the puppet cloudstack-resources module,
>> and it
> seems to populate it (From the cloudstack GUI, under "Group" I see my
 data)
> 
> However, when I do a
> 
> wget http://router/latest/user-data
> 
> I get back an empty file. On the VR itself I have checked and there
>> are a
> bunch of /var/www/html/userdata/IP/user-data files, but every one of
>> them
> is empty. This same applies to VMs that I added the "Group" user data
> manually.
> 
> The VM's are all FreeBSD10, and I am using xenserver 6.2, and
>> cloudstack
 4.2
> 
> Is this a bug? Is there a workaround

Re: Cloudstack user-data empty for VMs

[Derek Cole]

Hrmm - Maybe I am not being exactly clear.

I originally started out trying to use puppet to not only configure my VMs,
but provision them in the cloud as well. I started out with a template in
cloudstack, and have been using cloudstack_resources to create new VMs
automatically when my puppet manifest is applied.

Creating the VMs and all seems to work, however, I need a way to push
specific configurations to specific boxes based on their role, so I was
hoping to use the "role=whatever" userdata to be able to distinguish the
different types of VMs that I have provisioned without having to have a
bunch of node blocks to distinguish them by name.

Maybe using cloudmonkey or some other tool is more effective, however I
guess I was just trying to figure out how to use the supposedly already
written puppet types to give me something out of the box that is "one
command" provisioning and configuring.

-Derek


On Wed, Dec 4, 2013 at 2:56 PM, Hiroki Ohashi wrote:

> Hi Derek
>
> When you use user-data, you have to provide user-data and deliver it
> to virtual router. Unfortunately, CloudStack only provides REST API to
> deliver user-data to virtual router now. This API is
> deployVirtualMachine that creates instance and set instance specific
> data.
>
> For example, I assume you want to deliver a shell script as user-data
> below.
>
> --
> #! /bin/sh
>
> echo "Hello user-data!"
> --
>
> In this case, you can call deployVirtualMachine by CloudMonkey like
> this.
>
> $ cloudmonkey deploy virtualmachine serviceofferingid=XXX
> templateid=XXX zoneid=XXX networkids=XXX
> userdata='IyEgL2Jpbi9zaAoKZWNobyAiSGVsbG8gdXNlci1kYXRhISIK'
>
> As a result of the command, a new instance is created with user-data
> delivered to virtual router, so you can access user-data from the
> instance.
>
> CloudMonkey is CLI tool to call CloudStack REST API easily and you can
> give parameters as key value pair. In the example, user-data is base64
> encoded shell script and provied as a parameter.
>
> Best regards
> Hiroki Ohashi
>
> 2013/12/5 Derek Cole :
> > I was kind of wondering about that, when I saw it earlier. It appears
> that
> > maybe the cloudstack_resources module has become out of date? I think you
> > are the preparer of a slide-show I was following here:
> > http://www.slideshare.net/PuppetLabs/cloudstack-18489665
> >
> > It seems like in those slides, Group was being used to hold the roles?
> This
> > is why I assumed that was OK. I was doing something like
> >
> > case $::role {
> > 'db': {
> > notify {"detected a fact named role with value
> db"
> > :}
> > }
> > }
> > because I thought that the custom fact here:
> >
> https://github.com/jasonhancock/puppet-facts/blob/master/cloudstack_userdata.rb
> >
> > Turned the cloudstack userdata into a fact where if you had
> > "role=db,foo=bar" you would get two custom facts, role and foo, with
> their
> > respective values.
> >
> > May I ask for some clarity if that is not the intended usage?
> >
> > In my case, obviously cloudstack_userdata is not generating the correct
> > facts, because the wget that is in that code returns nothing because
> > userdata is empty.
> >
> > Thanks,
> >
> > -Derek
> >
> >
> >
> > On Wed, Dec 4, 2013 at 12:57 PM, David Nalley  wrote:
> >
> >> Hi Derek:
> >>
> >> Glad that the puppet resources are useful.
> >>
> >> Setting user-data is different than setting group:
> >>
> >> Look at the options here:
> >>
> >>
> http://cloudstack.apache.org/docs/api/apidocs-4.2/user/deployVirtualMachine.html
> >>
> >> --David
> >>
> >> On Wed, Dec 4, 2013 at 11:54 AM, Derek Cole 
> wrote:
> >> > Hello,
> >> >
> >> > I am attempting to use the cloudstack API to get user-data for my VMs.
> >> >
> >> > I am creating the VMs with the puppet cloudstack-resources module,
> and it
> >> > seems to populate it (From the cloudstack GUI, under "Group" I see my
> >> data)
> >> >
> >> > However, when I do a
> >> >
> >> > wget http://router/latest/user-data
> >> >
> >> > I get back an empty file. On the VR itself I have checked and there
> are a
> >> > bunch of /var/www/html/userdata/IP/user-data files, but every one of
> them
> >> > is empty. This same applies to VMs that I added the "Group" user data
> >> > manually.
> >> >
> >> > The VM's are all FreeBSD10, and I am using xenserver 6.2, and
> cloudstack
> >> 4.2
> >> >
> >> > Is this a bug? Is there a workaround or a fix?
> >> >
> >> > Thanks
> >>
>
>
>
> --
> 大橋 宏樹
> mail: silvernsh...@gmail.com
>

Re: Cloudstack user-data empty for VMs

[Hiroki Ohashi]

Hi Derek

When you use user-data, you have to provide user-data and deliver it
to virtual router. Unfortunately, CloudStack only provides REST API to
deliver user-data to virtual router now. This API is
deployVirtualMachine that creates instance and set instance specific
data.

For example, I assume you want to deliver a shell script as user-data
below.

--
#! /bin/sh

echo "Hello user-data!"
--

In this case, you can call deployVirtualMachine by CloudMonkey like
this.

$ cloudmonkey deploy virtualmachine serviceofferingid=XXX
templateid=XXX zoneid=XXX networkids=XXX
userdata='IyEgL2Jpbi9zaAoKZWNobyAiSGVsbG8gdXNlci1kYXRhISIK'

As a result of the command, a new instance is created with user-data
delivered to virtual router, so you can access user-data from the
instance.

CloudMonkey is CLI tool to call CloudStack REST API easily and you can
give parameters as key value pair. In the example, user-data is base64
encoded shell script and provied as a parameter.

Best regards
Hiroki Ohashi

2013/12/5 Derek Cole :
> I was kind of wondering about that, when I saw it earlier. It appears that
> maybe the cloudstack_resources module has become out of date? I think you
> are the preparer of a slide-show I was following here:
> http://www.slideshare.net/PuppetLabs/cloudstack-18489665
>
> It seems like in those slides, Group was being used to hold the roles? This
> is why I assumed that was OK. I was doing something like
>
> case $::role {
> 'db': {
> notify {"detected a fact named role with value db"
> :}
> }
> }
> because I thought that the custom fact here:
> https://github.com/jasonhancock/puppet-facts/blob/master/cloudstack_userdata.rb
>
> Turned the cloudstack userdata into a fact where if you had
> "role=db,foo=bar" you would get two custom facts, role and foo, with their
> respective values.
>
> May I ask for some clarity if that is not the intended usage?
>
> In my case, obviously cloudstack_userdata is not generating the correct
> facts, because the wget that is in that code returns nothing because
> userdata is empty.
>
> Thanks,
>
> -Derek
>
>
>
> On Wed, Dec 4, 2013 at 12:57 PM, David Nalley  wrote:
>
>> Hi Derek:
>>
>> Glad that the puppet resources are useful.
>>
>> Setting user-data is different than setting group:
>>
>> Look at the options here:
>>
>> http://cloudstack.apache.org/docs/api/apidocs-4.2/user/deployVirtualMachine.html
>>
>> --David
>>
>> On Wed, Dec 4, 2013 at 11:54 AM, Derek Cole  wrote:
>> > Hello,
>> >
>> > I am attempting to use the cloudstack API to get user-data for my VMs.
>> >
>> > I am creating the VMs with the puppet cloudstack-resources module, and it
>> > seems to populate it (From the cloudstack GUI, under "Group" I see my
>> data)
>> >
>> > However, when I do a
>> >
>> > wget http://router/latest/user-data
>> >
>> > I get back an empty file. On the VR itself I have checked and there are a
>> > bunch of /var/www/html/userdata/IP/user-data files, but every one of them
>> > is empty. This same applies to VMs that I added the "Group" user data
>> > manually.
>> >
>> > The VM's are all FreeBSD10, and I am using xenserver 6.2, and cloudstack
>> 4.2
>> >
>> > Is this a bug? Is there a workaround or a fix?
>> >
>> > Thanks
>>



-- 
大橋 宏樹
mail: silvernsh...@gmail.com

Re: Cloudstack user-data empty for VMs

[Derek Cole]

I was kind of wondering about that, when I saw it earlier. It appears that
maybe the cloudstack_resources module has become out of date? I think you
are the preparer of a slide-show I was following here:
http://www.slideshare.net/PuppetLabs/cloudstack-18489665

It seems like in those slides, Group was being used to hold the roles? This
is why I assumed that was OK. I was doing something like

case $::role {
'db': {
notify {"detected a fact named role with value db"
:}
}
}
because I thought that the custom fact here:
https://github.com/jasonhancock/puppet-facts/blob/master/cloudstack_userdata.rb

Turned the cloudstack userdata into a fact where if you had
"role=db,foo=bar" you would get two custom facts, role and foo, with their
respective values.

May I ask for some clarity if that is not the intended usage?

In my case, obviously cloudstack_userdata is not generating the correct
facts, because the wget that is in that code returns nothing because
userdata is empty.

Thanks,

-Derek



On Wed, Dec 4, 2013 at 12:57 PM, David Nalley  wrote:

> Hi Derek:
>
> Glad that the puppet resources are useful.
>
> Setting user-data is different than setting group:
>
> Look at the options here:
>
> http://cloudstack.apache.org/docs/api/apidocs-4.2/user/deployVirtualMachine.html
>
> --David
>
> On Wed, Dec 4, 2013 at 11:54 AM, Derek Cole  wrote:
> > Hello,
> >
> > I am attempting to use the cloudstack API to get user-data for my VMs.
> >
> > I am creating the VMs with the puppet cloudstack-resources module, and it
> > seems to populate it (From the cloudstack GUI, under "Group" I see my
> data)
> >
> > However, when I do a
> >
> > wget http://router/latest/user-data
> >
> > I get back an empty file. On the VR itself I have checked and there are a
> > bunch of /var/www/html/userdata/IP/user-data files, but every one of them
> > is empty. This same applies to VMs that I added the "Group" user data
> > manually.
> >
> > The VM's are all FreeBSD10, and I am using xenserver 6.2, and cloudstack
> 4.2
> >
> > Is this a bug? Is there a workaround or a fix?
> >
> > Thanks
>

Security groups for a real network behind CS?

[Nux!]

Hi,

Would it be possible to somehow make the traffic for a bunch of real 
servers go through Cloudstack? My crazy idea is to control the firewall 
for those servers from cloudstack's security groups.

Does this make any sense, could it be done in a semi-elegant way?

Lucian


--
Sent from the Delta quadrant using Borg technology!

Nux!
www.nux.ro

Re: Cloudstack user-data empty for VMs

[David Nalley]

Hi Derek:

Glad that the puppet resources are useful.

Setting user-data is different than setting group:

Look at the options here:
http://cloudstack.apache.org/docs/api/apidocs-4.2/user/deployVirtualMachine.html

--David

On Wed, Dec 4, 2013 at 11:54 AM, Derek Cole  wrote:
> Hello,
>
> I am attempting to use the cloudstack API to get user-data for my VMs.
>
> I am creating the VMs with the puppet cloudstack-resources module, and it
> seems to populate it (From the cloudstack GUI, under "Group" I see my data)
>
> However, when I do a
>
> wget http://router/latest/user-data
>
> I get back an empty file. On the VR itself I have checked and there are a
> bunch of /var/www/html/userdata/IP/user-data files, but every one of them
> is empty. This same applies to VMs that I added the "Group" user data
> manually.
>
> The VM's are all FreeBSD10, and I am using xenserver 6.2, and cloudstack 4.2
>
> Is this a bug? Is there a workaround or a fix?
>
> Thanks

Cloudstack user-data empty for VMs

[Derek Cole]

Hello,

I am attempting to use the cloudstack API to get user-data for my VMs.

I am creating the VMs with the puppet cloudstack-resources module, and it
seems to populate it (From the cloudstack GUI, under "Group" I see my data)

However, when I do a

wget http://router/latest/user-data

I get back an empty file. On the VR itself I have checked and there are a
bunch of /var/www/html/userdata/IP/user-data files, but every one of them
is empty. This same applies to VMs that I added the "Group" user data
manually.

The VM's are all FreeBSD10, and I am using xenserver 6.2, and cloudstack 4.2

Is this a bug? Is there a workaround or a fix?

Thanks

Storage/Console SSVM loose connectivity (can't ping them anymore) after creating the first guest instance

[Francesco Maria Magnini]

I'm experiencing problems in Cloudstack 4.2 installation on both Ubuntu
Server 12.04 and 13.10.

   - Installed Cloudstack Management Controller and a KVM host in two
   separate boxes
   - Cloudstack installations went fine
   - Created a basic networking zone, all is green, storage ok, vvms ok

At this point, I'm able to ping physical hosts, Storage and Proxy SSVM
public IP Address.

   - Created instance with basic template of CentOS, fine
   - Automatically created System Router

At this point I'm still able to ping physical hosts, but no longer Storage
SSMV, Proxy SSVM and the CentOS instance created a while ago.

No errors, all is green, all processes running fine, just connectivity
issue on the public network side of Proxy/Storage VVMS and Instances.

*IMPORTANT* I've configured Cloudstack in CentOS enviroment before testing
Ubuntu Server, with both Basic and Advanced Networking (VLAN separation)
without problems.

Security group is already configured with ICMP/SSH rules for inbound.

Any ideas? Thanks

RE: SecurityGroups, Advanced Zone And DefaultSharedNetworkOfferingWithSGService

[Geoff Higginbottom]

Radek is correct, you cannot use the DefaultSharedNetworkOfferingWithSGService 
in a 'standard' advanced Zone, only one which had Security Groups enabled when 
it was created

Regards

Geoff Higginbottom

D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581

geoff.higginbot...@shapeblue.com

-Original Message-
From: Radek Smigielski [mailto:radek.smigiel...@ymail.com]
Sent: 04 December 2013 13:51
To: users@cloudstack.apache.org
Subject: Re: SecurityGroups, Advanced Zone And 
DefaultSharedNetworkOfferingWithSGService

On Wednesday, 4 December 2013, 13:26:07, Nux!  wrote:

On 04.12.2013 07:54, Shanker Balan wrote:
> Helo,
>
> My Advanced Zone itself has security groups disabled. I have enabled
> the SecurityGroupsProvider and created a SharedNetwork with
> DefaultSharedNetworkOfferingWithSGService offering.

If I am not mistaken, you can not enable security groups for an existing zone. 
SG needs to be enabled while you creating zone.
Also in adv zone, SG works only on KVM.


- Radek Śmigielski
This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England & Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue Ltd. Shape 
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
operated under license from Shape Blue Ltd. ShapeBlue is a registered trademark.

Re: SecurityGroups, Advanced Zone And DefaultSharedNetworkOfferingWithSGService

[Shanker Balan]

On 04-Dec-2013, at 8:24 pm, Geoff Higginbottom 
 wrote:

> Radek is correct, you cannot use the 
> DefaultSharedNetworkOfferingWithSGService in a 'standard' advanced Zone, only 
> one which had Security Groups enabled when it was created

FWIW, it works over here with the DB hack. :)

--
@shankerbalan

M: +91 98860 60539 | O: +91 (80) 67935867
shanker.ba...@shapeblue.com | www.shapeblue.com | Twitter:@shapeblue
ShapeBlue Services India LLP, 22nd floor, Unit 2201A, World Trade Centre, 
Bangalore - 560 055

This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England & Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue Ltd. Shape 
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
operated under license from Shape Blue Ltd. ShapeBlue is a registered trademark.

Re: SecurityGroups, Advanced Zone And DefaultSharedNetworkOfferingWithSGService

[Shanker Balan]

On 04-Dec-2013, at 6:54 pm, Nux!  wrote:

> On 04.12.2013 07:54, Shanker Balan wrote:
>> Helo,
>> My Advanced Zone itself has security groups disabled. I have enabled
>> the SecurityGroupsProvider and created a SharedNetwork with
>> DefaultSharedNetworkOfferingWithSGService offering.
>> With this, I am now able to create a new VM in the shared network by
>> specifying the network ids as the SharedNetwork’s id. The shared VMs end up
>> in the “default” SG and the rules seems to be working correctly. I added ICMP
>> and SSH Ingress rules and I was able to reach the VM. I am also able to 
>> create
>> new security groups with rules.
>> I am however, unable to deploy VMs to security groups other than to
>> the “default” SG.
>
> Shankar,
>
> I'm testing an Adv zone with SG and I can define and use new groups.
> This is on 4.2.0, which version are you testing?

Am using 4.2.0. Let me rebuild and try.

Thanks.


--
@shankerbalan

M: +91 98860 60539 | O: +91 (80) 67935867
shanker.ba...@shapeblue.com | www.shapeblue.com | Twitter:@shapeblue
ShapeBlue Services India LLP, 22nd floor, Unit 2201A, World Trade Centre, 
Bangalore - 560 055

This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England & Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue Ltd. Shape 
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
operated under license from Shape Blue Ltd. ShapeBlue is a registered trademark.

WG: ERROR: Adding volumes when a VMs were deploy.

[Kmiotek, Daniel]

Hi!

I have one problem with CloudStack.
When I add a volume, nothing error appears.
But when I add a instance, the server can't add a volume.
The Log is in the attachment.

-->The Zone isn't configure with "local storage"-Save.

Primary- and Secondary-Storage is on the management-Server.
The hypervisor (KVM) on the second Server.

How  can I fix this problem?

Thank you for your help!


=== Volumes === 
2013-12-04 15:31:50,797 DEBUG [cloud.async.AsyncJobManagerImpl] 
(catalina-exec-9:null) submit async job-53 = [ 
c377b3c6-6e33-4166-b43b-71ad970daba8 ], details: AsyncJobVO {id:53, userId: 2, 
accountId: 2, sessionKey: null, instanceType: Volume, instanceId: 27, cmd: 
org.apache.cloudstack.api.command.user.volume.CreateVolumeCmd, cmdOriginator: 
null, cmdInfo: 
{"id":"27","response":"json","sessionkey":"RSBXBjzhTAHTSLN5fzPjTUwx2k4\u003d","cmdEventType":"VOLUME.CREATE","ctxUserId":"2","diskOfferingId":"fb3dcc38-b0d2-43d4-a1ec-e94ace68ad02","name":"testformail","httpmethod":"GET","_":"1386167501410","ctxAccountId":"2","ctxStartEventId":"192","zoneId":"fdcd8291-6b5b-42e5-90b7-318e8e3d9ed1"},
 cmdVersion: 0, callbackType: 0, callbackAddress: null, status: 0, 
processStatus: 0, resultCode: 0, result: null, initMsid: 207373009954, 
completeMsid: null, lastUpdated: null, lastPolled: null, created: null}
2013-12-04 15:31:50,798 DEBUG [cloud.async.AsyncJobManagerImpl] 
(Job-Executor-7:job-53 = [ c377b3c6-6e33-4166-b43b-71ad970daba8 ]) Executing 
org.apache.cloudstack.api.command.user.volume.CreateVolumeCmd for job-53 = [ 
c377b3c6-6e33-4166-b43b-71ad970daba8 ]


=== Instance ===
2013-12-04 15:33:43,810 DEBUG [cloud.api.ApiDispatcher] (Job-Executor-8:job-54 
= [ bb6690cc-ef26-4557-baf6-829a5f6a9b4f ]) InfrastructureEntity name 
is:com.cloud.offering.ServiceOffering
2013-12-04 15:33:43,811 DEBUG [cloud.api.ApiDispatcher] (Job-Executor-8:job-54 
= [ bb6690cc-ef26-4557-baf6-829a5f6a9b4f ]) ControlledEntity name 
is:com.cloud.template.VirtualMachineTemplate
2013-12-04 15:33:43,813 DEBUG [cloud.api.ApiDispatcher] (Job-Executor-8:job-54 
= [ bb6690cc-ef26-4557-baf6-829a5f6a9b4f ]) ControlledEntity name 
is:com.cloud.network.Network
2013-12-04 15:33:43,815 DEBUG [cloud.api.ApiDispatcher] (Job-Executor-8:job-54 
= [ bb6690cc-ef26-4557-baf6-829a5f6a9b4f ]) InfrastructureEntity name 
is:com.cloud.offering.DiskOffering
2013-12-04 15:33:43,832 DEBUG [cloud.network.NetworkModelImpl] 
(Job-Executor-8:job-54 = [ bb6690cc-ef26-4557-baf6-829a5f6a9b4f ]) Service 
SecurityGroup is not supported in the network id=206
2013-12-04 15:33:43,834 DEBUG [cloud.network.NetworkModelImpl] 
(Job-Executor-8:job-54 = [ bb6690cc-ef26-4557-baf6-829a5f6a9b4f ]) Service 
SecurityGroup is not supported in the network id=206
2013-12-04 15:33:43,844 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] 
(Job-Executor-8:job-54 = [ bb6690cc-ef26-4557-baf6-829a5f6a9b4f ]) Deploy 
avoids pods: [], clusters: [], hosts: []
2013-12-04 15:33:43,845 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] 
(Job-Executor-8:job-54 = [ bb6690cc-ef26-4557-baf6-829a5f6a9b4f ]) 
DeploymentPlanner allocation algorithm: 
com.cloud.deploy.FirstFitPlanner_EnhancerByCloudStack_170ebe5b@7ffcf959
2013-12-04 15:33:43,845 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] 
(Job-Executor-8:job-54 = [ bb6690cc-ef26-4557-baf6-829a5f6a9b4f ]) Trying to 
allocate a host and storage pools from dc:1, pod:null,cluster:null, requested 
cpu: 1000, requested ram: 1073741824
2013-12-04 15:33:43,846 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] 
(Job-Executor-8:job-54 = [ bb6690cc-ef26-4557-baf6-829a5f6a9b4f ]) Is ROOT 
volume READY (pool already allocated)?: No
2013-12-04 15:33:43,846 DEBUG [cloud.deploy.FirstFitPlanner] 
(Job-Executor-8:job-54 = [ bb6690cc-ef26-4557-baf6-829a5f6a9b4f ]) Searching 
all possible resources under this Zone: 1
2013-12-04 15:33:43,846 DEBUG [cloud.deploy.FirstFitPlanner] 
(Job-Executor-8:job-54 = [ bb6690cc-ef26-4557-baf6-829a5f6a9b4f ]) Listing 
clusters in order of aggregate capacity, that have (atleast one host with) 
enough CPU and RAM capacity under this Zone: 1
2013-12-04 15:33:43,848 DEBUG [cloud.deploy.FirstFitPlanner] 
(Job-Executor-8:job-54 = [ bb6690cc-ef26-4557-baf6-829a5f6a9b4f ]) No clusters 
found having a host with enough capacity, returning.
2013-12-04 15:33:43,850 DEBUG [cloud.vm.UserVmManagerImpl] 
(Job-Executor-8:job-54 = [ bb6690cc-ef26-4557-baf6-829a5f6a9b4f ]) Destroying 
vm VM[User|5399c8d3-ba45-469d-9c79-bf9bdb151097] as it failed to create on Host 
with Id:null
2013-12-04 15:33:43,857 DEBUG [cloud.capacity.CapacityManagerImpl] 
(Job-Executor-8:job-54 = [ bb6690cc-ef26-4557-baf6-829a5f6a9b4f ]) VM state 
transitted from :Stopped to Error with event: OperationFailedToErrorvm's 
original host id: null new host id: null host id before state transition: null
2013-12-04 15:33:43,864 WARN  [apache.cloudstack.alerts] (Job-Executor-8:job-54 
= [ bb6690cc-ef26-4557-baf6-829a5f6a9b4f ])  alertType:: 8 // dataCenterId:: 1 
// podId:: null // clusterId:

Re: SecurityGroups, Advanced Zone And DefaultSharedNetworkOfferingWithSGService

[Radek Smigielski]

On Wednesday, 4 December 2013, 13:26:07, Nux!  wrote:
 
On 04.12.2013 07:54, Shanker Balan wrote:
> Helo,
> 
> My Advanced Zone itself has security groups disabled. I have enabled
> the SecurityGroupsProvider and created a SharedNetwork with
> DefaultSharedNetworkOfferingWithSGService offering.

If I am not mistaken, you can not enable security groups for an existing zone. 
SG needs to be enabled while you creating zone. 
Also in adv zone, SG works only on KVM.


- Radek Śmigielski

Re: SecurityGroups, Advanced Zone And DefaultSharedNetworkOfferingWithSGService

[Nux!]

On 04.12.2013 07:54, Shanker Balan wrote:

Helo,

My Advanced Zone itself has security groups disabled. I have enabled
the SecurityGroupsProvider and created a SharedNetwork with
DefaultSharedNetworkOfferingWithSGService offering.

With this, I am now able to create a new VM in the shared network by
specifying the network ids as the SharedNetwork’s id. The shared VMs 
end up
in the “default” SG and the rules seems to be working correctly. I 
added ICMP
and SSH Ingress rules and I was able to reach the VM. I am also able 
to create

new security groups with rules.

I am however, unable to deploy VMs to security groups other than to
the “default” SG.


Shankar,

I'm testing an Adv zone with SG and I can define and use new groups. 
This is on 4.2.0, which version are you testing?


HTH
Lucian

--
Sent from the Delta quadrant using Borg technology!

Nux!
www.nux.ro

Re: Unable to execute PrimaryStorageDownloadCommand

[John Skinner]

I did confirm that the template does exist in the directory.
On Dec 3, 2013, at 11:05 PM, Sanjeev Neelarapu  
wrote:

> Hi,
> 
> Can you make sure that the template with which you are trying to deploy a VM 
> is present on the secondary Storage inside 244 directory?
> 
> -Sanjeev
> -Original Message-
> From: John Skinner [mailto:john.skin...@appcore.com] 
> Sent: Wednesday, December 04, 2013 12:55 AM
> To: users@cloudstack.apache.org
> Subject: Unable to execute PrimaryStorageDownloadCommand
> 
> Environment running CloudStack 4.1.1 with VMware vSphere 5.1 nodes and NFS 
> backed Primary Storage data stores. We are currently having issues creating 
> VMs from a template when we have to copy the template from secondary storage. 
> If the template already exists on primary storage then the VM gets created 
> just fine. I have already checked the mount points and vCenter has read/write 
> access to the NFS share for secondary storage, and the secondary storage VM 
> has the share mounted and can read/write to it as well.
> 
> This is the exception from the management server logs:
> 
> 2013-12-03 09:13:10,468 DEBUG [agent.manager.AgentManagerImpl] 
> (Job-Executor-9:job-14655) Details from executing class 
> com.cloud.agent.api.storage.PrimaryStorageDownloadCommand: Unable to execute 
> PrimaryStorageDownloadCommand due to exception
> 2013-12-03 09:13:10,468 DEBUG [cloud.template.TemplateManagerImpl] 
> (Job-Executor-9:job-14655) Template 244 download to pool 222 failed due to 
> Unable to execute PrimaryStorageDownloadCommand due to exception
> 2013-12-03 09:13:10,469 DEBUG [cloud.template.TemplateManagerImpl] 
> (Job-Executor-9:job-14655) Template 244 is not found on and can not be 
> downloaded to pool 222
> 2013-12-03 09:13:10,469 DEBUG [cloud.storage.StorageManagerImpl] 
> (Job-Executor-9:job-14655) Cannot use this pool Pool[222|NetworkFilesystem] 
> because we can't propagate template 
> Tmpl[244-OVA-244-2-0e18671b-1f2a-3b10-8b1a-7608bda5695c
> 2013-12-03 09:13:10,505 DEBUG [agent.manager.AgentAttache] 
> (AgentManager-Handler-15:null) Seq 59-806028519: No more commands found
> 2013-12-03 09:13:10,580 INFO  [cloud.vm.VirtualMachineManagerImpl] 
> (Job-Executor-9:job-14655) Unable to contact resource.
> com.cloud.exception.StorageUnavailableException: Resource [StoragePool:222] 
> is unreachable: Unable to create Vol[11319|vm=11283|ROOT]
>at 
> com.cloud.storage.StorageManagerImpl.prepare(StorageManagerImpl.java:3488)
>at 
> com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:748)
>at 
> com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:471)
>at 
> org.apache.cloudstack.engine.cloud.entity.api.VMEntityManagerImpl.deployVirtualMachine(VMEntityManagerImpl.java:212)
>at 
> org.apache.cloudstack.engine.cloud.entity.api.VirtualMachineEntityImpl.deploy(VirtualMachineEntityImpl.java:209)
>at 
> com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3871)
>at 
> com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3464)
>at 
> com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3450)
>at 
> com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
>at 
> org.apache.cloudstack.api.command.user.vm.DeployVMCmd.execute(DeployVMCmd.java:379)
>at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:162)
>at 
> com.cloud.async.AsyncJobManagerImpl$1.run(AsyncJobManagerImpl.java:437)
>at 
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
>at java.util.concurrent.FutureTask.run(FutureTask.java:166)
>at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
>at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>at java.lang.Thread.run(Thread.java:679)
> 2013-12-03 09:13:10,660 DEBUG [cloud.vm.VirtualMachineManagerImpl] 
> (Job-Executor-9:job-14655) Cleaning up resources for the vm 
> VM[User|OrangeTest] in Starting state
> 
> And this is the same error, however this is from the systemvm.log on the 
> Secondary Storage VM:
> 
> 2013-12-03 15:26:43,125 DEBUG [cloud.agent.Agent] (agentRequest-Handler-5:) 
> Processing command: com.cloud.agent.api.storage.PrimaryStorageDownloadCommand
> 2013-12-03 15:26:43,126 DEBUG 
> [storage.resource.VmwareSecondaryStorageResourceHandler] 
> (agentRequest-Handler-5:) Executing resource PrimaryStorageDownloadCommand: 
> {"localPath":"/mnt/e2955a69-77f1-3888-a810-d2d54bd6bb0f","poolUuid":"e2955a69-77f1-3888-a810-d2d54bd6bb0f","poolId":218,"primaryPool":{"id":218,"uuid":"e2955a69-77f1-3888-a810-d2d54bd6bb0f","host":"10.1.100.19","path":"/vol/vol_aCloud_1_01_7k","port":2049,"type":"NetworkFile

RE: DR in CloudStack ?

[Michal Rodzos]

Hi Octavian,

In addition there is a lot of redundancy  built into the Virtual Router.
Good explanation available here
http://blogs.clogeny.com/understanding-the-redundant-virtual-router-in-citri
x-cloudplatform/

These articles provide pretty good overview of High Availability in
CloudStack:
http://blogs.clogeny.com/high-availability-disaster-recovery-for-apache-clou
dstack/ 
http://blog.remibergsma.com/2012/05/02/high-availability-with-automatic-fail
over-for-cloudstack-management-servers/ 

Regards,
Michal Rodzos
Solutions Architect

Phone: 1300 144 007 | Mobile: +61 421 834 204
| Skype: michal.rodzos | Twitter


-Original Message-
From: Geoff Higginbottom [mailto:geoff.higginbot...@shapeblue.com] 
Sent: Wednesday, 4 December 2013 11:08 PM
To: users@cloudstack.apache.org
Subject: RE: DR in CloudStack ?

Octavian,

Your Compute Offering needs to be flagged as HA Enabled, this will then
ensure that the VM will move to a new Host in the event of a Host failure.
(FYI if you put a Host into Maintenance Mode, all VMs are migrated,
regardless of their HA status)

To move VMs between Clusters, you need to move the storage first, so this is
not handled automatically.

However the latest version (4.2) now supports Zone Wide Primary Storage for
KVM and VMware so moving VMs between Clusters is possible if you are using
this type of storage configuration.

For XenServer you can use XenStorage Motion to live migrate VMs across
Clusters, but I believe this is initiated by Root Admins, and not after a HA
event.

Regards

Geoff Higginbottom

D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581

geoff.higginbot...@shapeblue.com

-Original Message-
From: Octavian Popescu [mailto:octavian.pope...@interoute.com]
Sent: 04 December 2013 12:02
To: users@cloudstack.apache.org
Subject: RE: DR in CloudStack ?

Hi Geoff,

Thanks, are there any specific features or options in regards to pure DR,
rather than HA? For instance, moving VMs between clusters, pods or zones?

Octavian

>-Original Message-
>From: Geoff Higginbottom [mailto:geoff.higginbot...@shapeblue.com]
>Sent: 04 December 2013 11:36
>To: users@cloudstack.apache.org
>Subject: RE: DR in CloudStack ?
>
>Octavian,
>
>CloudStack provides VM HA enabling VMs to fail-over to alternate Hosts 
>within the same Cluster so long as the VM is using Shared Storage.
>
>For XenServer and KVM, CloudStack initiates the HA failover when it 
>detects a Host has gone down.  For VMware, vCenter handles the HA event.
>
>Regards
>
>Geoff Higginbottom
>
>D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581
>
>geoff.higginbot...@shapeblue.com
>
>-Original Message-
>From: Octavian Popescu [mailto:octavian.pope...@interoute.com]
>Sent: 04 December 2013 10:28
>To: users@cloudstack.apache.org
>Subject: DR in CloudStack ?
>
>Hi,
>
>I would like to understand what kind of disaster recovery options are 
>provided by CloudStack in case of VM or host failures (e.g. can it do 
>failovers from a host to another? from a zone to another?)
>
>Thank you,
>Octavian
>
>This email and any attachments to it may be confidential and are 
>intended solely for the use of the individual to whom it is addressed.
>Any views or opinions expressed are solely those of the author and do 
>not necessarily represent those of Shape Blue Ltd or related companies.
>If you are not the intended recipient of this email, you must neither 
>take any action based upon its contents, nor copy or show it to anyone.
>Please contact the sender if you believe you have received this email 
>in error. Shape Blue Ltd is a company incorporated in England & Wales.
>ShapeBlue Services India LLP is a company incorporated in India and is
operated under license from Shape Blue Ltd.
>Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil 
>and is operated under license from Shape Blue Ltd. ShapeBlue is a 
>registered trademark.
This email and any attachments to it may be confidential and are intended
solely for the use of the individual to whom it is addressed. Any views or
opinions expressed are solely those of the author and do not necessarily
represent those of Shape Blue Ltd or related companies. If you are not the
intended recipient of this email, you must neither take any action based
upon its contents, nor copy or show it to anyone. Please contact the sender
if you believe you have received this email in error. Shape Blue Ltd is a
company incorporated in England & Wales. ShapeBlue Services India LLP is a
company incorporated in India and is operated under license from Shape Blue
Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil
and is operated under license from Shape Blue Ltd. ShapeBlue is a registered
trademark.

RE: DR in CloudStack ?

[Geoff Higginbottom]

Octavian,

Your Compute Offering needs to be flagged as HA Enabled, this will then ensure 
that the VM will move to a new Host in the event of a Host failure.  (FYI if 
you put a Host into Maintenance Mode, all VMs are migrated, regardless of their 
HA status)

To move VMs between Clusters, you need to move the storage first, so this is 
not handled automatically.

However the latest version (4.2) now supports Zone Wide Primary Storage for KVM 
and VMware so moving VMs between Clusters is possible if you are using this 
type of storage configuration.

For XenServer you can use XenStorage Motion to live migrate VMs across 
Clusters, but I believe this is initiated by Root Admins, and not after a HA 
event.

Regards

Geoff Higginbottom

D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581

geoff.higginbot...@shapeblue.com

-Original Message-
From: Octavian Popescu [mailto:octavian.pope...@interoute.com]
Sent: 04 December 2013 12:02
To: users@cloudstack.apache.org
Subject: RE: DR in CloudStack ?

Hi Geoff,

Thanks, are there any specific features or options in regards to pure DR, 
rather than HA? For instance, moving VMs between clusters, pods or zones?

Octavian

>-Original Message-
>From: Geoff Higginbottom [mailto:geoff.higginbot...@shapeblue.com]
>Sent: 04 December 2013 11:36
>To: users@cloudstack.apache.org
>Subject: RE: DR in CloudStack ?
>
>Octavian,
>
>CloudStack provides VM HA enabling VMs to fail-over to alternate Hosts
>within the same Cluster so long as the VM is using Shared Storage.
>
>For XenServer and KVM, CloudStack initiates the HA failover when it
>detects a Host has gone down.  For VMware, vCenter handles the HA event.
>
>Regards
>
>Geoff Higginbottom
>
>D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581
>
>geoff.higginbot...@shapeblue.com
>
>-Original Message-
>From: Octavian Popescu [mailto:octavian.pope...@interoute.com]
>Sent: 04 December 2013 10:28
>To: users@cloudstack.apache.org
>Subject: DR in CloudStack ?
>
>Hi,
>
>I would like to understand what kind of disaster recovery options are
>provided by CloudStack in case of VM or host failures (e.g. can it do
>failovers from a host to another? from a zone to another?)
>
>Thank you,
>Octavian
>
>This email and any attachments to it may be confidential and are
>intended solely for the use of the individual to whom it is addressed.
>Any views or opinions expressed are solely those of the author and do
>not necessarily represent those of Shape Blue Ltd or related companies.
>If you are not the intended recipient of this email, you must neither
>take any action based upon its contents, nor copy or show it to anyone.
>Please contact the sender if you believe you have received this email
>in error. Shape Blue Ltd is a company incorporated in England & Wales.
>ShapeBlue Services India LLP is a company incorporated in India and is 
>operated under license from Shape Blue Ltd.
>Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil
>and is operated under license from Shape Blue Ltd. ShapeBlue is a
>registered trademark.
This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England & Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue Ltd. Shape 
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
operated under license from Shape Blue Ltd. ShapeBlue is a registered trademark.

RE: DR in CloudStack ?

[Octavian Popescu]

Hi Geoff,

Thanks, are there any specific features or options in regards to pure DR, 
rather than HA? For instance, moving VMs between clusters, pods or zones?

Octavian

>-Original Message-
>From: Geoff Higginbottom [mailto:geoff.higginbot...@shapeblue.com]
>Sent: 04 December 2013 11:36
>To: users@cloudstack.apache.org
>Subject: RE: DR in CloudStack ?
>
>Octavian,
>
>CloudStack provides VM HA enabling VMs to fail-over to alternate Hosts
>within the same Cluster so long as the VM is using Shared Storage.
>
>For XenServer and KVM, CloudStack initiates the HA failover when it detects a
>Host has gone down.  For VMware, vCenter handles the HA event.
>
>Regards
>
>Geoff Higginbottom
>
>D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581
>
>geoff.higginbot...@shapeblue.com
>
>-Original Message-
>From: Octavian Popescu [mailto:octavian.pope...@interoute.com]
>Sent: 04 December 2013 10:28
>To: users@cloudstack.apache.org
>Subject: DR in CloudStack ?
>
>Hi,
>
>I would like to understand what kind of disaster recovery options are provided
>by CloudStack in case of VM or host failures (e.g. can it do failovers from a
>host to another? from a zone to another?)
>
>Thank you,
>Octavian
>
>This email and any attachments to it may be confidential and are intended
>solely for the use of the individual to whom it is addressed. Any views or
>opinions expressed are solely those of the author and do not necessarily
>represent those of Shape Blue Ltd or related companies. If you are not the
>intended recipient of this email, you must neither take any action based upon
>its contents, nor copy or show it to anyone. Please contact the sender if you
>believe you have received this email in error. Shape Blue Ltd is a company
>incorporated in England & Wales. ShapeBlue Services India LLP is a company
>incorporated in India and is operated under license from Shape Blue Ltd.
>Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is
>operated under license from Shape Blue Ltd. ShapeBlue is a registered
>trademark.

Re: SecurityGroups, Advanced Zone And DefaultSharedNetworkOfferingWithSGService

[Shanker Balan]

On 04-Dec-2013, at 1:24 pm, Shanker Balan  wrote:

> Helo,
>
> My Advanced Zone itself has security groups disabled. I have enabled
> the SecurityGroupsProvider and created a SharedNetwork with
> DefaultSharedNetworkOfferingWithSGService offering.
>
> With this, I am now able to create a new VM in the shared network by
> specifying the network ids as the SharedNetwork’s id. The shared VMs end up
> in the “default” SG and the rules seems to be working correctly. I added ICMP
> and SSH Ingress rules and I was able to reach the VM. I am also able to create
> new security groups with rules.
>
> I am however, unable to deploy VMs to security groups other than to
> the “default” SG.
>
>> deploy virtualmachine displayname=dmz10
>  diskofferingid=9c8c46f0-9b7a-4d7a-8a9b-0ae085e90316
>  name=dmz10 serviceofferingid=6554c4c6-d1c6-40c7-9b6b-3ec904422c79
>  templateid=69686130-5b3e-11e3-a4b9-000c2931adcf
>  securitygroupnames=AdminVM
>  networkids=3240155c-e7a2-4ede-aa73-63e21b0c558e
>  zoneid=66870482-b34e-4218-92cd-954cf639f493 hypervisor=KVM
> : Can't create vm with security groups; security group feature is not enabled 
> per zone
>
> If I leave securitygroupnames (or securitygroupids) out of the 
> deployVirtualMachine
> command, the VM does get created in the shared network and end up in the 
> default SG.
>
> Should I not be able to choose a SG while deploying VMs to a
> DefaultSharedNetworkOfferingWithSGService network?


DB workaround. Am sure it has repercussions elsewhere but makes
deployVirtualmachine happy with securitygroupnames.

mysql> UPDATE data_center SET is_security_group_enabled=1 WHERE id=1;

Regards.


--
@shankerbalan

M: +91 98860 60539 | O: +91 (80) 67935867
shanker.ba...@shapeblue.com | www.shapeblue.com | Twitter:@shapeblue
ShapeBlue Services India LLP, 22nd floor, Unit 2201A, World Trade Centre, 
Bangalore - 560 055

This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England & Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue Ltd. Shape 
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
operated under license from Shape Blue Ltd. ShapeBlue is a registered trademark.

Re: public ip of system vm and public ip of guest vm on same network segment overlaps

[Shanker Balan]

On 04-Dec-2013, at 1:35 pm, Domenico De Monte  wrote:

> Before all, thank you for your reply. You explain me many concepts, really
> important to know, that were not clear in CS documentation.

There are four traffic types in CloudStack:

(1) Management
(2) Storage
(3) Guest
(4) Public

Don’t call it by any other name, just use the ones listed above. :)

> In total there are 4 NIC on each server, 2 assigned to vSwitch0 and 2 to 
> vSwitch1.
>
> In according of what you replied, my new zone configuration will be:
>
> 1 physical interface for internet traffic ( Public traffic, Guest Public
> traffic both connected to vSwitch0 )

There is no “guest public” traffic type.

vSwitch0 will carry GUEST *and* PUBLIC traffic.


> 1 physical interface for internal traffic ( Management traffic, Storage 
> traffic,
> guest internal traffic both connected to vSwitch1 ).

There is no “internal" traffic type. You have Management and Storage
traffic on vSwitch1.

> I want separate guest internal traffic with guest public traffic for many 
> reasons.

Again, there is no “guest internal” traffic type and “guest public” traffic
type. Its just GUEST traffic and PUBLIC traffic. :)

> You said that for guest traffic, a hard requirement is VLAN usage. Meanwhile
> for public traffic, management and storage VLAN is not needed.

Thats correct.

> This point here is crucial because i still do not understand difference 
> between
> public traffic and guest public traffic.

:)

So there is no “guest public” traffic type. Just “GUEST” and “PUBLIC”
traffic types. Ok?

Q. What is “GUEST" traffic?

A. From 
http://cloudstack.apache.org/docs/en-US/Apache_CloudStack/4.2.0/html-single/Installation_Guide/#advanced-zone-network-traffic-types

"Guest. When end users run VMs, they generate guest traffic. The guest
VMs communicate with each other over a network that can be referred to
as the guest network. This network can be isolated or shared. In an isolated
guest network, the administrator needs to reserve VLAN ranges to provide
isolation for each CloudStack account’s network (potentially a large number
of VLANs). In a shared guest network, all guest VMs share a single network”

Q. What is “PUBLIC” traffic?

Again, from 
http://cloudstack.apache.org/docs/en-US/Apache_CloudStack/4.2.0/html-single/Installation_Guide/#advanced-zone-network-traffic-types:

"Public traffic is generated when VMs in the cloud access the Internet.
Publicly accessible IPs must be allocated for this purpose. End users can
use the CloudStack UI to acquire these IPs to implement NAT between their
guest network and the public network, as described in “Acquiring a New IP 
Address”
in the Administration Guide.”

The same link also described Management and Storage traffic types also.

> If i understand, public traffic of a zone is for system vm only ?

Incorrect. See 
http://cloudstack.apache.org/docs/en-US/Apache_CloudStack/4.2.0/html-single/Installation_Guide/#advanced-zone-network-traffic-types

> And guest public traffic is for guest vm only ?

There is no such traffic type as “guest public”. Its just PUBLIC traffic.

Again, see 
http://cloudstack.apache.org/docs/en-US/Apache_CloudStack/4.2.0/html-single/Installation_Guide/#advanced-zone-network-traffic-types


> If so, why if we use basic network configuration, we do not have “overlaps”
> network issue ?

Basic networks is a shared network and does not have PUBLIC traffic type.
Only Management, Storage and GUEST.

The documentation at 
http://cloudstack.apache.org/docs/en-US/Apache_CloudStack/4.2.0/html-single/Installation_Guide/#basic-zone-network-traffic-types
 is not
very clear in the regard.

A basic network is a big flat network similar to AWS EC2 while advanced
network is like an AWS VPC.


> Of course in this case we can not let users use internal physical
> switch ( vswitch1 ) for lan traffic.


What is LAN traffic here? There is Management, Storage, Guest and Public
traffic only. Guest traffic (traffic between the customer’s VM) is isolated 
with VLANs.

In your case, it will be over vSwitch0.

> Anyway my target is still to reduce public IPs usage and of course do not use 
> SNAT.

By default CloudStack will provision *one* Public IP per customer. This single
public IP is assigned to the customer’s Virtual Router automatically. The 
customer can then
create Egress/Ingress rules to filer traffic and enable port forwarding
to his VMs.

All of the customer’s VMs will be on a dedicated VLAN with private IPs
in the 10.1.1.0/24 (default) range.

A customer can have many VMs. Each of these VMs will only have private IPs
and the single public IP enabled Virtual Router will continue to provide NAT 
services.

So, if you had 10 customers:

1) There would be 10 VLANs created
2) Each VLAN will have 1 Virtual Router
3) Each Virtual Router will have one public IP address used to provide NAT/SNAT 
services
4) Many many VMs which are on private subnet


> In order to do so, i want definitively follow your guide: 
> http://shank

RE: DR in CloudStack ?

[Geoff Higginbottom]

Octavian,

CloudStack provides VM HA enabling VMs to fail-over to alternate Hosts within 
the same Cluster so long as the VM is using Shared Storage.

For XenServer and KVM, CloudStack initiates the HA failover when it detects a 
Host has gone down.  For VMware, vCenter handles the HA event.

Regards

Geoff Higginbottom

D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581

geoff.higginbot...@shapeblue.com

-Original Message-
From: Octavian Popescu [mailto:octavian.pope...@interoute.com]
Sent: 04 December 2013 10:28
To: users@cloudstack.apache.org
Subject: DR in CloudStack ?

Hi,

I would like to understand what kind of disaster recovery options are provided 
by CloudStack in case of VM or host failures (e.g. can it do failovers from a 
host to another? from a zone to another?)

Thank you,
Octavian

This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England & Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue Ltd. Shape 
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
operated under license from Shape Blue Ltd. ShapeBlue is a registered trademark.

DR in CloudStack ?

[Octavian Popescu]

Hi,

I would like to understand what kind of disaster recovery options are provided 
by CloudStack in case of VM or host failures (e.g. can it do failovers from a 
host to another? from a zone to another?)

Thank you,
Octavian

RE: VM's on cloudstack hosts not communicating to the internet (advanced networking mode)

[Whyspirit]

Envoyé avec AquaMail pour Android
http://www.aqua-mail.com


Le 3 décembre 2013 04:34:04 Amin Samir  a écrit :
Hi but i did not select security groups in the zone wizard, how can i do 
this now or do i have to recreate the zone? I found issue with no 
resolution exactly similar to what is 
happening.http://mail-archives.apache.org/mod_mbox/cloudstack-users/201310.mbox/%3c1382640326.52696ac6e7...@webmail.manske.org%3E


> Date: Tue, 3 Dec 2013 11:29:55 +0800
> Subject: Re: VM's on cloudstack hosts not communicating to the internet 
(advanced networking mode)

> From: dj199...@gmail.com
> To: users@cloudstack.apache.org
> Cloudstack 4.2 is a bit different from 4.0.I have met your problem
> before.You need not only configure firewall rules but also security group
> about egress.
>
> 2013/12/3 Amin Samir 
> >

RE: VM's on cloudstack hosts not communicating to the internet (advanced networking mode)

[Whyspirit]

Envoyé avec AquaMail pour Android
http://www.aqua-mail.com


Le 3 décembre 2013 04:34:04 Amin Samir  a écrit :
Hi but i did not select security groups in the zone wizard, how can i do 
this now or do i have to recreate the zone? I found issue with no 
resolution exactly similar to what is 
happening.http://mail-archives.apache.org/mod_mbox/cloudstack-users/201310.mbox/%3c1382640326.52696ac6e7...@webmail.manske.org%3E


> Date: Tue, 3 Dec 2013 11:29:55 +0800
> Subject: Re: VM's on cloudstack hosts not communicating to the internet 
(advanced networking mode)

> From: dj199...@gmail.com
> To: users@cloudstack.apache.org
> Cloudstack 4.2 is a bit different from 4.0.I have met your problem
> before.You need not only configure firewall rules but also security group
> about egress.
>
> 2013/12/3 Amin Samir 
> >

Password reset feature and "User Data" service

[Andrija Panic]

Hi,

I have kind of problem and need advice please.

I have 1 shared network for assigning public IP addresses to all VMs we
create - with DHCP,DNS, and Virtual Router, as the services that are
enabled in this networking tempalte.


Now I want to enable "password management/reset" features, but I got error
messages "user data" service is not enabled for my network id=212.

So since modifications of Network tempalte is not possible, and the
modification of the already deployed Network (id=212) is not possible
is there a change to hack the database to include the "User Data" service
as the service in both the netowrk template, and for the already used
network (id=212)

Any help would be really appriciated...

Thanks,
-- 

Andrija Panić

upgrade 4.0.2 to 4.2 fail

[Jaro 2079]

Hello
after upgrade when I run "cloudstack-management start"  cloudstack
successfully prepare database
" Upgrade completed for version 4.2.0"

 and stops on
utils.crypt.DBEncryptionUtil] (Timer-2:null) Error while decrypting: true

in mysql last log seen
UPDATE configuration SET value = 'qUC9aJDgXXXMX1ST/ZA==' WHERE name =
'init'

in catalina.out



Exception in thread "Timer-2"
org.jasypt.exceptions.EncryptionOperationNotPossibleException
at
org.jasypt.encryption.pbe.StandardPBEByteEncryptor.decrypt(StandardPBEByteEncryptor.java:918)
at
org.jasypt.encryption.pbe.StandardPBEStringEncryptor.decrypt(StandardPBEStringEncryptor.java:725)
at
com.cloud.utils.crypt.DBEncryptionUtil.decrypt(DBEncryptionUtil.java:65)
at
com.cloud.configuration.ConfigurationVO.getValue(ConfigurationVO.java:92)
at
com.cloud.configuration.dao.ConfigurationDaoImpl.getConfiguration(ConfigurationDaoImpl.java:84)
at
com.cloud.configuration.dao.ConfigurationDaoImpl_EnhancerByCloudStack_daa8e77a.CGLIB$getConfiguration$6()
at
com.cloud.configuration.dao.ConfigurationDaoImpl_EnhancerByCloudStack_daa8e77a_FastClassByCloudStack_f2c2e518.invoke()
at net.sf.cglib.proxy.MethodProxy.invokeSuper(MethodProxy.java:228)
at
com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
at
com.cloud.configuration.dao.ConfigurationDaoImpl_EnhancerByCloudStack_daa8e77a.getConfiguration()
at
com.cloud.cluster.ClusterManagerImpl.configure(ClusterManagerImpl.java:1287)
at
com.cloud.utils.component.ComponentContext.initComponentsLifeCycle(ComponentContext.java:111)
at
com.cloud.servlet.CloudStartupServlet$1.run(CloudStartupServlet.java:54)
at java.util.TimerThread.mainLoop(Timer.java:534)
at java.util.TimerThread.run(Timer.java:484)

Re: SSVM won't start

[Sebastian Trampler]

Hello again,

it still doesn't work. But many thanks for the hints.

Here are the facts:
- Cloudstack 4.2 is installed on Ubuntu 12.04.
- Primary and secondary storage are NFS share on Cloudstack server
- Xenserver 6.2
- vhd-util is downloaded from 
http://download.cloud.com.s3.amazonaws.com/tools/vhd-util
- I copied vhd-util on cloudstack server in following directories with 
permission 0755

 1) /usr/share/cloudstack-common/scripts/vm/hypervisor/xenserver
 2) 
/usr/share/cloudstack-common/scripts/vm/hypervisor/xenserver/xenserver60
 3) 
/usr/share/cloudstack-management/webapps/client/WEB-INF/classes/scripts/vm/hypervisor/xenserver
 4) 
/usr/share/cloudstack-management/webapps/client/WEB-INF/classes/scripts/vm/hypervisor/xenserver/xenserver60

- On Xen Server I copied the vhd-util to /opt/xensource/bin

I suppose that the Exception has nothing to do with the vhd-util because 
I had an other exception before I copied the vhd-utils to the mentioned 
directories.


Regards

Sebastian

On 12/04/2013 03:16 AM, Amin Samir wrote:

Hello,
Two three paths that vhd-util needs to be in place.1) 
/usr/share/cloudstack-management/webapps/client/WEB-INF/classes/scripts/vm/hypervisor/xenserver/xenserver60/
 (depends on your xen server version you may want to place also under 
/xenserver56FP1 or /xenserver56).
2) cd
/usr/share/cloudstack-common/scripts/vm/hypervisor/xenserver/xenserver60  
(depends on your xen server version you may want to place also under 
/xenserver56FP1 or /xenserver56).
3) On the xen server it self, /opt/xensource/bin.
Try destroying the system vm's they will be created automatically.

Amin

Subject: Re: SSVM won't start
From: create...@gmail.com
Date: Tue, 3 Dec 2013 12:41:32 -0600
To: users@cloudstack.apache.org

Try the vhd-util that the docs tell you to download. Put that one in 
/opt/xensource/bin


On Dec 3, 2013, at 9:20 AM, Sebastian Trampler  
wrote:

Hello again,

after copying the vhd-util on the XenServer to /opt/xensource/bin it first 
seems to work, but the ssvm still won't come up.
After reading the log-messages I found the exception below. Any suggestions?

Regards

Sebastian


2013-12-03 16:08:34,861 DEBUG [xen.resource.CitrixResourceBase] 
(DirectAgent-472:null) VBD a6598c97-b54f-8d12-6785-a9eb1baff098 created for 
com.cloud.agent.api.to.DiskTO@422d7ffa
2013-12-03 16:08:34,882 DEBUG [xen.resource.CitrixResourceBase] 
(DirectAgent-472:null) Creating VIF for s-4-VM on nic 
[Nic:Guest-XXX.XXX.XXX.XXX-vlan://untagged]
2013-12-03 16:08:34,902 DEBUG [xen.resource.CitrixResourceBase] 
(DirectAgent-472:null) Created a vif 940b3765-dd22-a488-4391-25ef188a4ef9 on 2
2013-12-03 16:08:34,902 DEBUG [xen.resource.CitrixResourceBase] 
(DirectAgent-472:null) Creating VIF for s-4-VM on nic 
[Nic:Control-169.254.1.83-null]
2013-12-03 16:08:34,929 DEBUG [xen.resource.CitrixResourceBase] 
(DirectAgent-472:null) already have a vif on dom0 for link local network
2013-12-03 16:08:35,208 DEBUG 
[network.router.VirtualNetworkApplianceManagerImpl] 
(RouterStatusMonitor-1:null) Found 0 routers to update status.
2013-12-03 16:08:35,210 DEBUG 
[network.router.VirtualNetworkApplianceManagerImpl] 
(RouterStatusMonitor-1:null) Found 0 networks to update RvR status.
2013-12-03 16:08:35,217 DEBUG 
[network.router.VirtualNetworkApplianceManagerImpl] 
(RouterStatusMonitor-1:null) Found 0 routers to update status.
2013-12-03 16:08:35,219 DEBUG 
[network.router.VirtualNetworkApplianceManagerImpl] 
(RouterStatusMonitor-1:null) Found 0 networks to update RvR status.
2013-12-03 16:08:35,355 DEBUG [xen.resource.CitrixResourceBase] 
(DirectAgent-472:null) Created a vif 4919c69e-b711-1ae4-7276-903cffd0524e on 0
2013-12-03 16:08:35,355 DEBUG [xen.resource.CitrixResourceBase] 
(DirectAgent-472:null) Creating VIF for s-4-VM on nic 
[Nic:Management-XXX.XXX.XXX.XXX-null]
2013-12-03 16:08:35,376 DEBUG [xen.resource.CitrixResourceBase] 
(DirectAgent-472:null) Created a vif 4ae05ccd-a0b3-5586-4542-9e4dde9250c2 on 1
2013-12-03 16:08:35,377 DEBUG [xen.resource.CitrixResourceBase] 
(DirectAgent-472:null) Creating VIF for s-4-VM on nic 
[Nic:Storage-XXX.XXX.XXX.XXX-null]
2013-12-03 16:08:35,398 DEBUG [xen.resource.CitrixResourceBase] 
(DirectAgent-472:null) Created a vif 5f2d5aee-18c0-4c61-af26-edbbd50c7bed on 3
2013-12-03 16:08:39,453 WARN  [xen.resource.CitrixResourceBase] 
(DirectAgent-472:null) Task failed! Task record: uuid: 
bc1b04c5-b891-357c-6151-73f68806c136
   nameLabel: Async.VM.start_on
 nameDescription:
   allowedOperations: []
   currentOperations: {}
 created: Tue Dec 03 16:08:35 CET 2013
finished: Tue Dec 03 16:08:38 CET 2013
  status: failure
  residentOn: com.xensource.xenapi.Host@8bc3a55e
progress: 1.0
type: 
  result:
   errorInfo: [INTERNAL_ERROR, xenopsd internal error: 
XenguestHelper.Xenctrl_dom_linux_build_failure(2, " panic: xc_dom_core.c:609: 
xc_dom_find_loader: no loader\\\"")]
 otherConfig: {}
   

RE: SSVM showing alert status

[Geoff Higginbottom]

Jake,

If it's simply the Secondary Storage which is at alert state, then follow these 
steps to resolve (its effectively a bug)

http://dave.ie/cloudstack-secondarystorage-alarm-on-dashboard/

However if it's your SSVM that is at alert state, the simple thing to do is 
destroy it and let the system re-create it.  If the new SSVM also goes to alert 
state take a look at 
https://cwiki.apache.org/confluence/display/CLOUDSTACK/SSVM%2C+templates%2C+Secondary+storage+troubleshooting
 for more help

Regards

Geoff Higginbottom

D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581

geoff.higginbot...@shapeblue.com

-Original Message-
From: Kirk Kosinski [mailto:kirkkosin...@gmail.com]
Sent: 04 December 2013 05:11
To: users@cloudstack.apache.org
Subject: Re: SSVM showing alert status

Hi, Jake.  Is the SSVM really in Alert state, or is it actually the Secondary 
Storage share?  If the latter is in Alert state it can be ignored.  The state 
of the share is not used or updated and will likely be in Alert state unless 
you manually update it in the database.

Best regards,
Kirk

On 12/02/2013 01:33 AM, Jake G. wrote:
> Hi all,
>
> My SSVM is showing ALERT as its status. How can I troubleshoot this? Also, 
> Any tips on how to log into the SSVM and CPVM?
>
> Thanks,
> Jake
>
This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England & Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue Ltd. Shape 
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
operated under license from Shape Blue Ltd. ShapeBlue is a registered trademark.

Re: public ip of system vm and public ip of guest vm on same network segment overlaps

[Domenico De Monte]

Before all, thank you for your reply. You explain me many concepts, really 
important to know, that were not clear in CS documentation. 

In total there are 4 NIC on each server, 2 assigned to vSwitch0 and 2 to 
vSwitch1.

In according of what you replied, my new zone configuration will be:

1 physical interface for internet traffic ( Public traffic, Guest Public 
traffic both connected to vSwitch0 )
1 physical interface for internal traffic ( Management traffic, Storage 
traffic, guest internal traffic both connected to vSwitch1 ). I want separate 
guest internal traffic with guest public traffic for many reasons. 

You said that for guest traffic, a hard requirement is VLAN usage. Meanwhile 
for public traffic, management and storage VLAN is not needed.

This point here is crucial because i still do not understand difference between 
public traffic and guest public traffic.

If i understand, public traffic of a zone is for system vm only ? And guest 
public traffic is for guest vm only ?

If so, why if we use basic network configuration, we do not have “overlaps” 
network issue ? Of course in this case we can not let users use internal 
physical switch ( vswitch1 ) for lan traffic.


Anyway my target is still to reduce public IPs usage and of course do not use 
SNAT.

In order to do so, i want definitively follow your guide: 
http://shankerbalan.net/blog/create-a-shared-network-with-public-ips-in-cloudstack/
 ( i read it also before, very well done :) )

But following this i still have problem of CS network overlaps if i want use 
same /24 for both type of public traffic.


Consider that we want let customers use a public IP and a private IP directly 
on their vm. For internet traffic without vlan. This is our goal.

Assign for each vm a VLAN for public traffic, we will lose many ips just for 
subnetting. 


So there is no way to use a single /24 for public system traffic and guests 
public traffic without split this /24 in smaller subnet ?

I think key is to assign just 2 physical interface as you suggest and try to 
see if overlaps issue goes away, like it was for basic network configuration.


Waiting for your reply

Best regards


Il giorno 04/dic/2013, alle ore 05:24, Shanker Balan 
 ha scritto:

> Comments inline.
> 
> On 04-Dec-2013, at 6:18 am, Domenico De Monte  wrote:
> 
>> Hello,
>> i added a zone with advanced network with following network configuration on
>> CS 4.2 but i was not able to setup same IP class on public traffic ( of 
>> system vm )
>> and guest traffic ( of guest vm ).
>> 
>> Scenario
>> Servers with VMware ESXi 5.1 have multiple nic:
> 
>> 2 nic connected to physical internet switch ( vSwitch0 standard )
> 
> Am not intricately familiar with ESXi but I assume these 2 NICs
> are in a bond (LACP/LAGG) and configured as vSwitch0 for Internet traffic.
> 
>> 2 nic connected to physical private switch ( vSwitch1 standard )
> 
> vSWitch1 is also a LACAP/LAGG bond of 2 NICs?
> 
>> On CS i create a zone with advanced network and 5 physical interface:
> 
> You would only require 2 CloudStack physical interface. “Physical Interface 1”
> for Internet vSwitch0 traffic and “Physical Interface 2” for Internal 
> vSwitch1 traffic.
> 
>> 1 physical interface for Public traffic connected to vSwitch0
>> ( i think it's system vm public traffic ).
> 
> The “untrusted” public Internet traffic would go to “Physical Interface 1”.
> The “Public Traffic” includes all public Internet traffic (Guest VM Public
> traffic + SSVM Public Traffic + CPVM Public Traffic etc).
> 
>> 1 physical interface for Guest traffic connected to vSwitch0
>> ( i think it's guest vm public traffic ).
> 
> The “untrusted” guest traffic would also go to “Physical Interface 1”.
> 
>> 1 physical interface for Guest traffic connected to vSwitch1
>> ( i think it's guest vm lan traffic ).
> 
> So basically all Guest VM traffic and any Public traffic gets combined
> onto “Physical Interface 1” which is mapped to vSwitch0
> 
> 
>> 1 physical interface for Storage traffic connected to
>> vSwitch1 ( i am sure it's storage traffic for snapshot, deploy and so on ).
> 
> Yep, so storage traffic is on “Physical Interface 2” which is mapped to 
> vSwitch1
> 
> 
>> 1 physical interface for Management traffic connected to vSwitch1
>> ( i am sure it's for system vm traffic and so on ).
> 
> Yep, so Management traffic is also on “Physical Interface 2”.
> 
>> I do not want use vlan and i read on ml that if i do not setup them,
>> they are just ignore from CS.
> 
> You require VLANs for “GUEST” VM traffic. This is a hard requirement.
> VLAN is optional for the other traffic types of “PUBLIC”, “MANAGEMENT” and 
> “STORAGE”.
> 
> To sum up,
> 
> Public Traffic -> Physical Interface 1 -> vSwitch0 -> 2xNICs (LACP/LAGG)
> Guest Traffic  -> Physical Interface 1 -> vSwitch0 -> 2xNICs (LACP/LAGG)
> Management Traffic -> Physical Interface 2 -> vSwitch1 -> 2xNICs (LACP/LAGG)
> Storage Traffic-> Physical Interface 2 -> vSwitch1 -> 2xNICs (LACP/LAGG)
> 
>