Re: Cloudstack Management Network Scheme

2014-04-26 Thread Marty Sweet
Hi Matthew,

I assume you haven't got a response due to the slight ambiguity of
your question.
I guess you are going to setup advance networking in Cloudstack? The
way you have planned is inline with Pod documentation.
Have you tried setting up a Cloudstack Cluster before? It might be a
bit of trial and error until you find a suitable setup.

Let us know how you get on,
Marty

On 24 April 2014 22:01, Matthew Midgett supp...@trickhosting.biz wrote:
 I was just watching a video on youtube where Geoff from shapeblue was
 talking about it was better to split up the management network instead of a
 /16

 I am planning for 5000 VM's so just roughly doing the math I will need 100
 physical servers 4 Pods and 3 clusters per pod with 8 servers per cluster.
 Btw I'm using xenserver as my hypervisor so thats where the 8 hosts per
 cluster comes in.

 Does this look right and why should I do it this way.

 Zone PVDC
 POD 1 PVDC-PX1
 Cluster X1,X2,X3
 172.16.1.0/26 Network
1.10-0.29 System Reserved
1.30-0.62 Hosts
 PVDC-PX1-X1-1   172.16.1.30 255.255.255.192 172.168.1.1 Vlan
 101
 PVDC-PX1-X1-2   172.16.1.31 255.255.255.192 172.168.1.1 Vlan
 101
 PVDC-PX1-X1-3   172.16.1.32 255.255.255.192 172.168.1.1 Vlan
 101
 PVDC-PX1-X1-4   172.16.1.33 255.255.255.192 172.168.1.1 Vlan
 101
 PVDC-PX1-X1-5   172.16.1.34 255.255.255.192 172.168.1.1 Vlan
 101
 PVDC-PX1-X1-6   172.16.1.35 255.255.255.192 172.168.1.1 Vlan
 101
 PVDC-PX1-X1-7   172.16.1.36 255.255.255.192 172.168.1.1 Vlan
 101
 PVDC-PX1-X1-8   172.16.1.37 255.255.255.192 172.168.1.1 Vlan
 101

 PVDC-PX1-X2-1   172.16.1.38 255.255.255.192 172.168.1.1 Vlan
 101
 PVDC-PX1-X2-2   172.16.1.39 255.255.255.192 172.168.1.1 Vlan
 101
 PVDC-PX1-X2-3   172.16.1.40 255.255.255.192 172.168.1.1 Vlan
 101
 PVDC-PX1-X2-4   172.16.1.41 255.255.255.192 172.168.1.1 Vlan
 101
 PVDC-PX1-X2-5   172.16.1.42 255.255.255.192 172.168.1.1 Vlan
 101
 PVDC-PX1-X2-6   172.16.1.43 255.255.255.192 172.168.1.1 Vlan
 101
 PVDC-PX1-X2-7   172.16.1.44 255.255.255.192 172.168.1.1 Vlan
 101
 PVDC-PX1-X2-8   172.16.1.45 255.255.255.192 172.168.1.1 Vlan
 101

 PVDC-PX1-X3-1   172.16.1.46 255.255.255.192 172.168.1.1 Vlan
 101
 PVDC-PX1-X3-2   172.16.1.47 255.255.255.192 172.168.1.1 Vlan
 101
 PVDC-PX1-X3-3   172.16.1.48 255.255.255.192 172.168.1.1 Vlan
 101
 PVDC-PX1-X3-4   172.16.1.49 255.255.255.192 172.168.1.1 Vlan
 101
 PVDC-PX1-X3-5   172.16.1.50 255.255.255.192 172.168.1.1 Vlan
 101
 PVDC-PX1-X3-6   172.16.1.51 255.255.255.192 172.168.1.1 Vlan
 101
 PVDC-PX1-X3-7   172.16.1.52 255.255.255.192 172.168.1.1 Vlan
 101
 PVDC-PX1-X3-8   172.16.1.53 255.255.255.192 172.168.1.1 Vlan
 101

 Zone PVDC
 POD 2 PVDC-PX2
 Cluster X4,X5,X6
 172.16.1.64/26
1.75-1.94 System Reserved
1.95-1.126 Hosts
 PVDC-PX2-X4-1   172.16.1.95  255.255.255.192 172.168.1.64   Vlan
 102
 PVDC-PX2-X4-2   172.16.1.96  255.255.255.192 172.168.1.64   Vlan
 102
 PVDC-PX2-X4-3   172.16.1.97  255.255.255.192 172.168.1.64   Vlan
 102
 PVDC-PX2-X4-4   172.16.1.98  255.255.255.192 172.168.1.64   Vlan
 102
 PVDC-PX2-X4-5   172.16.1.99  255.255.255.192 172.168.1.64   Vlan
 102
 PVDC-PX2-X4-6   172.16.1.100 255.255.255.192 172.168.1.64   Vlan
 102
 PVDC-PX2-X4-7   172.16.1.101 255.255.255.192 172.168.1.64   Vlan
 102
 PVDC-PX2-X4-8   172.16.1.102 255.255.255.192 172.168.1.64   Vlan
 102

 PVDC-PX2-X5-1   172.16.1.103 255.255.255.192 172.168.1.64   Vlan
 102
 PVDC-PX2-X5-2   172.16.1.104 255.255.255.192 172.168.1.64   Vlan
 102
 PVDC-PX2-X5-3   172.16.1.105 255.255.255.192 172.168.1.64   Vlan
 102
 PVDC-PX2-X5-4   172.16.1.106 255.255.255.192 172.168.1.64   Vlan
 102
 PVDC-PX2-X5-5   172.16.1.107 255.255.255.192 172.168.1.64   Vlan
 102
 PVDC-PX2-X5-6   172.16.1.108 255.255.255.192 172.168.1.64   Vlan
 102
 PVDC-PX2-X5-7   172.16.1.109 255.255.255.192 172.168.1.64   Vlan
 102
 PVDC-PX2-X5-8   172.16.1.110 255.255.255.192 172.168.1.64   Vlan
 102

 PVDC-PX2-X6-1   172.16.1.111 255.255.255.192 172.168.1.64   Vlan
 102
 PVDC-PX2-X6-2   172.16.1.112 255.255.255.192 172.168.1.64   Vlan
 102
 PVDC-PX2-X6-3   172.16.1.113 255.255.255.192 172.168.1.64   Vlan
 102
 PVDC-PX2-X6-4   172.16.1.114 255.255.255.192 172.168.1.64   Vlan
 102
 PVDC-PX2-X6-5   172.16.1.115 255.255.255.192 172.168.1.64   Vlan
 102
 PVDC-PX2-X6-6   172.16.1.116 255.255.255.192 172.168.1.64   Vlan
 102
 PVDC-PX2-X6-7 

Re: CS4.3 XS 6.2 ConsoleVm SSVM stopped

2014-04-26 Thread Anton Rubets
I think its with network, but not sure.
I cant understand from documentation if i need to give tags to network or
not. Maybe someone has good manual about this?


On Fri, Apr 25, 2014 at 9:19 PM, Amogh Vasekar amogh.vase...@citrix.comwrote:

 2014-04-25 12:30:04,737 DEBUG [c.c.a.m.a.i.FirstFitAllocator]
 (consoleproxy-1:ctx-1f9a4185 FirstFitRoutingAllocator) Host name: ark3,
 hostId: 1 is in avoid set, skipping this and trying other available hosts
 2014-04-25 12:30:04,737 DEBUG [c.c.a.m.a.i.FirstFitAllocator]
 (consoleproxy-1:ctx-1f9a4185 FirstFitRoutingAllocator) Host Allocator
 returning 0 suitable hosts
 2014-04-25 12:30:04,737 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
 (consoleproxy-1:ctx-1f9a4185) No suitable hosts found
 2014-04-25 12:30:04,737 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
 (consoleproxy-1:ctx-1f9a4185) No suitable hosts found under this Cluster: 1

 You may want to check why this went into the avoid set. Most likely
 network configuration issues?

 Amogh

 From: Anton Rubets plejik@gmail.commailto:plejik@gmail.com
 Reply-To: users@cloudstack.apache.orgmailto:users@cloudstack.apache.org
 users@cloudstack.apache.orgmailto:users@cloudstack.apache.org
 Date: Friday, April 25, 2014 2:33 AM
 To: users@cloudstack.apache.orgmailto:users@cloudstack.apache.org 
 users@cloudstack.apache.orgmailto:users@cloudstack.apache.org
 Subject: CS4.3 XS 6.2 ConsoleVm SSVM stopped

 Hi all
 I have the trouble with xen setup
 Zone created, host added, but there trouble with default VM start
 Log in attach
 P.S. vhd-util download from link in manual, template download, use local
 storage, host in zone is up




Re: CS4.3 XS 6.2 ConsoleVm SSVM stopped

2014-04-26 Thread Amogh Vasekar
Hi,
Are you using basic zone or advanced zone?

Amogh

On 4/26/14 12:43 AM, Anton Rubets plejik@gmail.com wrote:

I think its with network, but not sure.
I cant understand from documentation if i need to give tags to network or
not. Maybe someone has good manual about this?


On Fri, Apr 25, 2014 at 9:19 PM, Amogh Vasekar
amogh.vase...@citrix.comwrote:

 2014-04-25 12:30:04,737 DEBUG [c.c.a.m.a.i.FirstFitAllocator]
 (consoleproxy-1:ctx-1f9a4185 FirstFitRoutingAllocator) Host name: ark3,
 hostId: 1 is in avoid set, skipping this and trying other available
hosts
 2014-04-25 12:30:04,737 DEBUG [c.c.a.m.a.i.FirstFitAllocator]
 (consoleproxy-1:ctx-1f9a4185 FirstFitRoutingAllocator) Host Allocator
 returning 0 suitable hosts
 2014-04-25 12:30:04,737 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
 (consoleproxy-1:ctx-1f9a4185) No suitable hosts found
 2014-04-25 12:30:04,737 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
 (consoleproxy-1:ctx-1f9a4185) No suitable hosts found under this
Cluster: 1

 You may want to check why this went into the avoid set. Most likely
 network configuration issues?

 Amogh

 From: Anton Rubets plejik@gmail.commailto:plejik@gmail.com
 Reply-To: 
users@cloudstack.apache.orgmailto:users@cloudstack.apache.org
 users@cloudstack.apache.orgmailto:users@cloudstack.apache.org
 Date: Friday, April 25, 2014 2:33 AM
 To: users@cloudstack.apache.orgmailto:users@cloudstack.apache.org 
 users@cloudstack.apache.orgmailto:users@cloudstack.apache.org
 Subject: CS4.3 XS 6.2 ConsoleVm SSVM stopped

 Hi all
 I have the trouble with xen setup
 Zone created, host added, but there trouble with default VM start
 Log in attach
 P.S. vhd-util download from link in manual, template download, use local
 storage, host in zone is up





Re: CS4.3 XS 6.2 ConsoleVm SSVM stopped

2014-04-26 Thread Anton Rubets
Hi
Advanced zone with local storage


On Sat, Apr 26, 2014 at 12:02 PM, Amogh Vasekar amogh.vase...@citrix.comwrote:

 Hi,
 Are you using basic zone or advanced zone?

 Amogh

 On 4/26/14 12:43 AM, Anton Rubets plejik@gmail.com wrote:

 I think its with network, but not sure.
 I cant understand from documentation if i need to give tags to network or
 not. Maybe someone has good manual about this?
 
 
 On Fri, Apr 25, 2014 at 9:19 PM, Amogh Vasekar
 amogh.vase...@citrix.comwrote:
 
  2014-04-25 12:30:04,737 DEBUG [c.c.a.m.a.i.FirstFitAllocator]
  (consoleproxy-1:ctx-1f9a4185 FirstFitRoutingAllocator) Host name: ark3,
  hostId: 1 is in avoid set, skipping this and trying other available
 hosts
  2014-04-25 12:30:04,737 DEBUG [c.c.a.m.a.i.FirstFitAllocator]
  (consoleproxy-1:ctx-1f9a4185 FirstFitRoutingAllocator) Host Allocator
  returning 0 suitable hosts
  2014-04-25 12:30:04,737 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
  (consoleproxy-1:ctx-1f9a4185) No suitable hosts found
  2014-04-25 12:30:04,737 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
  (consoleproxy-1:ctx-1f9a4185) No suitable hosts found under this
 Cluster: 1
 
  You may want to check why this went into the avoid set. Most likely
  network configuration issues?
 
  Amogh
 
  From: Anton Rubets plejik@gmail.commailto:plejik@gmail.com
  Reply-To:
 users@cloudstack.apache.orgmailto:users@cloudstack.apache.org
  users@cloudstack.apache.orgmailto:users@cloudstack.apache.org
  Date: Friday, April 25, 2014 2:33 AM
  To: users@cloudstack.apache.orgmailto:users@cloudstack.apache.org 
  users@cloudstack.apache.orgmailto:users@cloudstack.apache.org
  Subject: CS4.3 XS 6.2 ConsoleVm SSVM stopped
 
  Hi all
  I have the trouble with xen setup
  Zone created, host added, but there trouble with default VM start
  Log in attach
  P.S. vhd-util download from link in manual, template download, use local
  storage, host in zone is up
 
 




Re: How to migrate volumes of Virtual routers

2014-04-26 Thread Amir Abbasi

Hi,

Thanks, is there any way to force CS to create virtual machines on a 
particular Primary-storage from now on (I wan to remove older Primary 
storage as soon as possible)?


- Original Message - 
From: Rajesh Battala rajesh.batt...@citrix.com

To: users@cloudstack.apache.org
Sent: Saturday, April 26, 2014 10:52 AM
Subject: RE: How to migrate volumes of Virtual routers


Reboot VR, a new VR will be re-created with new disks and all the rules will 
be applied again.


-Original Message-
From: Amir Abbasi [mailto:abb...@tebyanidc.ir]
Sent: Saturday, April 26, 2014 10:23 AM
To: users@cloudstack.apache.org
Subject: Re: How to migrate volumes of Virtual routers

originally I face 2 problems;

1- The VPN which has been enabled and working since a few months ago is not 
working (error 789) after facing the Read-only file system issue and I 
can't delete the VPN users (but I can add new users).


2- sometimes web service of instances (which uses this router) does not load 
js queries properly, I suspect the VR is not working properly.


- Original Message -
From: Rajesh Battala rajesh.batt...@citrix.com
To: users@cloudstack.apache.org
Cc: Sanjeev Neelarapu sanjeev.neelar...@citrix.com
Sent: Saturday, April 26, 2014 8:52 AM
Subject: RE: How to migrate volumes of Virtual routers


Reboot the VR. It will recreate disks and apply all the rules.

Thanks
Rajesh Battala

-Original Message-
From: Amir Abbasi [mailto:abb...@tebyanidc.ir]
Sent: Saturday, April 26, 2014 9:34 AM
To: users@cloudstack.apache.org
Cc: Sanjeev Neelarapu
Subject: Re: How to migrate volumes of Virtual routers

Hi,

Thank you, Is it possible to force cloudstack to recreate VR instance from
scratch (not only cleaning up)?


- Original Message - 
From: Sanjeev Neelarapu sanjeev.neelar...@citrix.com

To: users@cloudstack.apache.org
Sent: Thursday, April 24, 2014 8:23 AM
Subject: RE: How to migrate volumes of Virtual routers


Hi,

If the host on which VR is running is disconnected and connected back to
Primary storage then the instance becomes read-only. This is the linux
behavior nothing to do with the cloudstack. Please restart the VR to make
the disk writable.

-Sanjeev

-Original Message-
From: Amir Abbasi [mailto:abb...@tebyanidc.ir]
Sent: Wednesday, April 23, 2014 10:58 AM
To: users@cloudstack.apache.org
Subject: How to migrate volumes of Virtual routers

Hi,

I've assigned two primary storages. All virtual routers have been created on
Primary-Storage1 but sometimes I face Read-only file system on some VR
instances. I found no option to migrate their volumes. I have cloudstack
3.0.



RE: Frequent NFS not responding, timed out issue

2014-04-26 Thread Hung Nguyen The
Hi Shanker,

Thanks for your comment. I am trying to figure out why the network latency is 
high.

It is good to know if the issue with 10Gbps is no longer the case.

I am not sure whether there is a problem with the physical switch (IBM Flex 
switch) or something has to do with the driver of network card.

I attached with the NIC info and driver version. I don’t know if this is the 
latest version or not.



With thanks,

Nguyễn Thế Hùng







-Original Message-
From: Shanker Balan [mailto:shanker.ba...@shapeblue.com]
Sent: Friday, April 25, 2014 12:27 PM
To: CloudStack-Users
Subject: Re: Frequent NFS not responding, timed out issue



Hi Hung,



Comments inline.



On 25-Apr-2014, at 2:14 am, Hùng Nguyễn Thế 
thehung.ngu...@live.commailto:thehung.ngu...@live.com wrote:



 Hi all,

 We experience an intermittent NFS connection from our Xenserver 6.2 Sp1 
 latest patch.

 /var/log/kern.log shows the exact messages as in the known issues from 
 Xenserver 6.0 Release Notes [1]:

 kernel: nfs: server 10.0.0.1 not responding, timed out

 Our enviroment is indeed 10Gbps, storage is IBM Storwize v7000.

 Hope someone can give us some hints on this matter.





Would you have any monitoring running of the network itself? SNMP information 
collected from the switches and the physical network interfaces of the various 
devices on the network would be helpful to narrow down the issue.



Most likely there is saturation somewhere.







 Buying Citrix support subscription is on the way.

 Some addtional information:

 nfsstat -m:

 rw,relatime,vers=3,rsize=1048576,wsize=1048576,namlen=255,acregmin=0,

 acregmax=0,acdirmin=0,acdirmax=0,soft,proto=tcp,port=65535,timeo=133,r

 etrans=0, sec=sys,mountport=65535,local_lock=none,addr=192.168.x.x



 I have captured tcpdump and seen some symtomps like TCP retransmission, tcp 
 acked unseen segment.

 Network seems okay, the only unusual thing is the latency from xenserver to 
 the storage is fluctuating, from 1ms to several XX ms.



Try to get access to the network level metrics to debug further.



Regards.





--

@shankerbalan



M: +91 98860 60539 | O: +91 (80) 67935867 
shanker.ba...@shapeblue.commailto:shanker.ba...@shapeblue.com | 
www.shapeblue.comhttp://www.shapeblue.com | Twitter:@shapeblue ShapeBlue 
Services India LLP, 22nd floor, Unit 2201A, World Trade Centre, Bangalore - 560 
055



Need Enterprise Grade Support for Apache CloudStack?

Our CloudStack Infrastructure 
Supporthttp://shapeblue.com/cloudstack-infrastructure-support/ offers the 
best 24/7 SLA for CloudStack Environments.



Apache CloudStack Bootcamp training courses



**NEW!** CloudStack 4.2.1 traininghttp://shapeblue.com/cloudstack-training/

28th-29th May 2014, Bangalore. 
Classrommhttp://shapeblue.com/cloudstack-training/

16th-20th June 2014, Region A. Instructor led, 
On-linehttp://shapeblue.com/cloudstack-training/

23rd-27th June 2014, Region B. Instructor led, 
On-linehttp://shapeblue.com/cloudstack-training/

15th-20th September 2014, Region A. Instructor led, 
On-linehttp://shapeblue.com/cloudstack-training/

22nd-27th September 2014, Region B. Instructor led, 
On-linehttp://shapeblue.com/cloudstack-training/

1st-6th December 2014, Region A. Instructor led, 
On-linehttp://shapeblue.com/cloudstack-training/

8th-12th December 2014, Region B. Instructor led, 
On-linehttp://shapeblue.com/cloudstack-training/



This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England  Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue Ltd. Shape 
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
operated under license from Shape Blue Ltd. ShapeBlue is a registered trademark.


Re: Cloudstack with iscsi storage

2014-04-26 Thread Ignazio Cassano
You must not create gfs or other file system because with clvm virtual
machines disks are created on logical volumes .
 Il giorno 25/apr/2014 20:02, Nux! n...@li.nux.ro ha scritto:

 On 25.04.2014 17:59, rammohan ganapavarapu wrote:

 Do i have to create gfs or extfs on that lvm or i can just present logical
 vol itself (/dev/mapper/vg01_vol01)?



 You need to configure CLVM, check for tutorials on the web.



 --
 Sent from the Delta quadrant using Borg technology!

 Nux!
 www.nux.ro



Re: How to migrate volumes of Virtual routers

2014-04-26 Thread Geoff Higginbottom
Amir,

Use storage tags to ensure new VMs are placed on a specific Pri storage

Regards

Geoff Higginbottom
CTO / Cloud Architect

D: +44 20 3603 0542tel:+442036030542 | S: +44 20 3603 0540tel:+442036030540 
| M: +447968161581tel:+447968161581

geoff.higginbot...@shapeblue.commailto:geoff.higginbot...@shapeblue.com | 
www.shapeblue.comhtp://www.shapeblue.com/ | 
Twitter:@cloudstackguruhttps://twitter.com/#!/cloudstackguru

ShapeBlue Ltd, 53 Chandos Place, Covent Garden, London, WC2N 
4HSx-apple-data-detectors://5


On 26 Apr 2014, at 10:20, Amir Abbasi 
abb...@tebyanidc.irmailto:abb...@tebyanidc.ir wrote:

Hi,

Thanks, is there any way to force CS to create virtual machines on a particular 
Primary-storage from now on (I wan to remove older Primary storage as soon as 
possible)?

- Original Message - From: Rajesh Battala 
rajesh.batt...@citrix.commailto:rajesh.batt...@citrix.com
To: users@cloudstack.apache.orgmailto:users@cloudstack.apache.org
Sent: Saturday, April 26, 2014 10:52 AM
Subject: RE: How to migrate volumes of Virtual routers


Reboot VR, a new VR will be re-created with new disks and all the rules will be 
applied again.

-Original Message-
From: Amir Abbasi [mailto:abb...@tebyanidc.ir]
Sent: Saturday, April 26, 2014 10:23 AM
To: users@cloudstack.apache.orgmailto:users@cloudstack.apache.org
Subject: Re: How to migrate volumes of Virtual routers

originally I face 2 problems;

1- The VPN which has been enabled and working since a few months ago is not 
working (error 789) after facing the Read-only file system issue and I can't 
delete the VPN users (but I can add new users).

2- sometimes web service of instances (which uses this router) does not load js 
queries properly, I suspect the VR is not working properly.

- Original Message -
From: Rajesh Battala 
rajesh.batt...@citrix.commailto:rajesh.batt...@citrix.com
To: users@cloudstack.apache.orgmailto:users@cloudstack.apache.org
Cc: Sanjeev Neelarapu 
sanjeev.neelar...@citrix.commailto:sanjeev.neelar...@citrix.com
Sent: Saturday, April 26, 2014 8:52 AM
Subject: RE: How to migrate volumes of Virtual routers


Reboot the VR. It will recreate disks and apply all the rules.

Thanks
Rajesh Battala

-Original Message-
From: Amir Abbasi [mailto:abb...@tebyanidc.ir]
Sent: Saturday, April 26, 2014 9:34 AM
To: users@cloudstack.apache.orgmailto:users@cloudstack.apache.org
Cc: Sanjeev Neelarapu
Subject: Re: How to migrate volumes of Virtual routers

Hi,

Thank you, Is it possible to force cloudstack to recreate VR instance from
scratch (not only cleaning up)?


- Original Message - From: Sanjeev Neelarapu 
sanjeev.neelar...@citrix.commailto:sanjeev.neelar...@citrix.com
To: users@cloudstack.apache.orgmailto:users@cloudstack.apache.org
Sent: Thursday, April 24, 2014 8:23 AM
Subject: RE: How to migrate volumes of Virtual routers


Hi,

If the host on which VR is running is disconnected and connected back to
Primary storage then the instance becomes read-only. This is the linux
behavior nothing to do with the cloudstack. Please restart the VR to make
the disk writable.

-Sanjeev

-Original Message-
From: Amir Abbasi [mailto:abb...@tebyanidc.ir]
Sent: Wednesday, April 23, 2014 10:58 AM
To: users@cloudstack.apache.orgmailto:users@cloudstack.apache.org
Subject: How to migrate volumes of Virtual routers

Hi,

I've assigned two primary storages. All virtual routers have been created on
Primary-Storage1 but sometimes I face Read-only file system on some VR
instances. I found no option to migrate their volumes. I have cloudstack
3.0.

Need Enterprise Grade Support for Apache CloudStack?
Our CloudStack Infrastructure 
Supporthttp://shapeblue.com/cloudstack-infrastructure-support/ offers the 
best 24/7 SLA for CloudStack Environments.

Apache CloudStack Bootcamp training courses

**NEW!** CloudStack 4.2.1 traininghttp://shapeblue.com/cloudstack-training/
28th-29th May 2014, Bangalore. 
Classrommhttp://shapeblue.com/cloudstack-training/
16th-20th June 2014, Region A. Instructor led, 
On-linehttp://shapeblue.com/cloudstack-training/
23rd-27th June 2014, Region B. Instructor led, 
On-linehttp://shapeblue.com/cloudstack-training/
15th-20th September 2014, Region A. Instructor led, 
On-linehttp://shapeblue.com/cloudstack-training/
22nd-27th September 2014, Region B. Instructor led, 
On-linehttp://shapeblue.com/cloudstack-training/
1st-6th December 2014, Region A. Instructor led, 
On-linehttp://shapeblue.com/cloudstack-training/
8th-12th December 2014, Region B. Instructor led, 
On-linehttp://shapeblue.com/cloudstack-training/

This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or 

Re: Agent excesive RAM usage...

2014-04-26 Thread Andrija Panic
Is there any way to hack and limit RAM consumtion, java heap size, etc. ?
After 24h uptime, cloudstack-agent daemin is again 5GB on one of the
servers...
Thanks


On 25 April 2014 22:28, Andrija Panic andrija.pa...@gmail.com wrote:

 I'm on CentOS 6.5 x64...very interesting size... BTW main
 cloudstack-management process is much less in size...strange to see agent
 so big...


 On 25 April 2014 19:55, Marty Sweet msweet@gmail.com wrote:

 This is interesting, what OS do you have them running on?

 This is the first time I have looked at this, I am running Ubuntu
 12.04.4 x64 with CS4.2.0.

 ==
   PID USER  PR  NI  VIRT  RES  SHR S %CPU %MEMTIME+  COMMAND
 41874 root  20   0 63.8g  58g 6952 S  134 23.3 501156:53 kvm
 24987 root  20   0 6862m 6.0g 6960 S   56  2.4  17283:27 kvm
 65308 root  20   0 8870m 4.1g 6916 S   22  1.6  65734:54 kvm
 47506 root  20   0 7032m 4.0g 6908 S   14  1.6  36832:54 kvm
  1737 root  20   0 8608m 4.1g 6948 S2  1.6   2436:28 kvm
 28310 root  20   0 46.5g  11g  17m S1  4.4   1650:01 jsvc
 28309 root  20   0 10656  412  292 S0  0.0   0:06.54 jsvc
 28307 root  20   0 10656  296  204 S0  0.0   0:00.00 jsvc

 ==
 root@aurora:~# free -g
  total   used   free sharedbuffers cached
 Mem:   251245  6  0  0156
 -/+ buffers/cache: 88163
 Swap:5  0  4
 ==

 So I currently am using 88GB on this host, which approx
 (58+6+4+4+4+11). It's intresting why the jsvc for the Cloudstack
 Hypervisor agent would require 11GB of RAM.

 Usage vs. Uptime
 178 days = 10G
 179 days = 14G
 179 days = 11G
 51 days   = 5.2G

 Do we need to be limiting the Java heap size?

 Marty

 On 25 April 2014 18:07, Andrija Panic andrija.pa...@gmail.com wrote:
  Ok, my bad. It is cloudstack-agent daemon on physical host. installed
 from
  official CS repo.
  thanks
  On Apr 25, 2014 5:36 PM, Michael Phillips mphilli7...@hotmail.com
 wrote:
 
  Curious as to what agent you are referring to. the cloud agent
 installed
  on the vm's, the system vm's etc...
 
   Date: Fri, 25 Apr 2014 17:34:12 +0200
   Subject: Re: Agent excesive RAM usage...
   From: andrija.pa...@gmail.com
   To: users@cloudstack.apache.org
  
   ah sorry, 4.2.1... (was upgrade from 4.0.0 I think...)
  
   Best,
  
  
   On 25 April 2014 17:30, Michael Phillips mphilli7...@hotmail.com
  wrote:
  
What agent are you referring to?
   
 Date: Fri, 25 Apr 2014 17:28:44 +0200
 Subject: Agent excesive RAM usage...
 From: andrija.pa...@gmail.com
 To: users@cloudstack.apache.org

 Hi,

 I just noticed that I had cloudstack agent taking over 9GB on one
servers,
 and over 5GB on others...

 Is there a know bug or something ?

 Thanks,

 --

 Andrija Panić
   
   
  
  
  
   --
  
   Andrija Panić
   --
 http://admintweets.com
   --
 




 --

 Andrija Panić
 --
   http://admintweets.com
 --




-- 

Andrija Panić
--
  http://admintweets.com
--


Re: Agent excesive RAM usage...

2014-04-26 Thread Marty Sweet
Adding '-Xmx1124M' should work by adding into the init script
somewhere. I am not sure if the Cloudstack Agent would care about this
however, probably worth a try on something that isn't important :P

Marty

On 26 April 2014 14:36, Andrija Panic andrija.pa...@gmail.com wrote:
 Is there any way to hack and limit RAM consumtion, java heap size, etc. ?
 After 24h uptime, cloudstack-agent daemin is again 5GB on one of the
 servers...
 Thanks


 On 25 April 2014 22:28, Andrija Panic andrija.pa...@gmail.com wrote:

 I'm on CentOS 6.5 x64...very interesting size... BTW main
 cloudstack-management process is much less in size...strange to see agent
 so big...


 On 25 April 2014 19:55, Marty Sweet msweet@gmail.com wrote:

 This is interesting, what OS do you have them running on?

 This is the first time I have looked at this, I am running Ubuntu
 12.04.4 x64 with CS4.2.0.

 ==
   PID USER  PR  NI  VIRT  RES  SHR S %CPU %MEMTIME+  COMMAND
 41874 root  20   0 63.8g  58g 6952 S  134 23.3 501156:53 kvm
 24987 root  20   0 6862m 6.0g 6960 S   56  2.4  17283:27 kvm
 65308 root  20   0 8870m 4.1g 6916 S   22  1.6  65734:54 kvm
 47506 root  20   0 7032m 4.0g 6908 S   14  1.6  36832:54 kvm
  1737 root  20   0 8608m 4.1g 6948 S2  1.6   2436:28 kvm
 28310 root  20   0 46.5g  11g  17m S1  4.4   1650:01 jsvc
 28309 root  20   0 10656  412  292 S0  0.0   0:06.54 jsvc
 28307 root  20   0 10656  296  204 S0  0.0   0:00.00 jsvc

 ==
 root@aurora:~# free -g
  total   used   free sharedbuffers cached
 Mem:   251245  6  0  0156
 -/+ buffers/cache: 88163
 Swap:5  0  4
 ==

 So I currently am using 88GB on this host, which approx
 (58+6+4+4+4+11). It's intresting why the jsvc for the Cloudstack
 Hypervisor agent would require 11GB of RAM.

 Usage vs. Uptime
 178 days = 10G
 179 days = 14G
 179 days = 11G
 51 days   = 5.2G

 Do we need to be limiting the Java heap size?

 Marty

 On 25 April 2014 18:07, Andrija Panic andrija.pa...@gmail.com wrote:
  Ok, my bad. It is cloudstack-agent daemon on physical host. installed
 from
  official CS repo.
  thanks
  On Apr 25, 2014 5:36 PM, Michael Phillips mphilli7...@hotmail.com
 wrote:
 
  Curious as to what agent you are referring to. the cloud agent
 installed
  on the vm's, the system vm's etc...
 
   Date: Fri, 25 Apr 2014 17:34:12 +0200
   Subject: Re: Agent excesive RAM usage...
   From: andrija.pa...@gmail.com
   To: users@cloudstack.apache.org
  
   ah sorry, 4.2.1... (was upgrade from 4.0.0 I think...)
  
   Best,
  
  
   On 25 April 2014 17:30, Michael Phillips mphilli7...@hotmail.com
  wrote:
  
What agent are you referring to?
   
 Date: Fri, 25 Apr 2014 17:28:44 +0200
 Subject: Agent excesive RAM usage...
 From: andrija.pa...@gmail.com
 To: users@cloudstack.apache.org

 Hi,

 I just noticed that I had cloudstack agent taking over 9GB on one
servers,
 and over 5GB on others...

 Is there a know bug or something ?

 Thanks,

 --

 Andrija Panić
   
   
  
  
  
   --
  
   Andrija Panić
   --
 http://admintweets.com
   --
 




 --

 Andrija Panić
 --
   http://admintweets.com
 --




 --

 Andrija Panić
 --
   http://admintweets.com
 --


RE: How to migrate volumes of Virtual routers

2014-04-26 Thread Rajesh Battala
Add the new primary store.
Enable Maintenance mode on the old primary store.
CS will take care of migrating the VM's running the old store to the new one.
Once the migrations are complete CS will report the status. 
Then remove the old store.

Yes You can use tags to force CS to pick the tagged resources.

Thanks
Rajesh Battala


-Original Message-
From: Amir Abbasi [mailto:abb...@tebyanidc.ir] 
Sent: Saturday, April 26, 2014 2:50 PM
To: users@cloudstack.apache.org
Subject: Re: How to migrate volumes of Virtual routers

Hi,

Thanks, is there any way to force CS to create virtual machines on a particular 
Primary-storage from now on (I wan to remove older Primary storage as soon as 
possible)?

- Original Message -
From: Rajesh Battala rajesh.batt...@citrix.com
To: users@cloudstack.apache.org
Sent: Saturday, April 26, 2014 10:52 AM
Subject: RE: How to migrate volumes of Virtual routers


Reboot VR, a new VR will be re-created with new disks and all the rules will 
be applied again.

-Original Message-
From: Amir Abbasi [mailto:abb...@tebyanidc.ir]
Sent: Saturday, April 26, 2014 10:23 AM
To: users@cloudstack.apache.org
Subject: Re: How to migrate volumes of Virtual routers

originally I face 2 problems;

1- The VPN which has been enabled and working since a few months ago is not 
working (error 789) after facing the Read-only file system issue and I 
can't delete the VPN users (but I can add new users).

2- sometimes web service of instances (which uses this router) does not load 
js queries properly, I suspect the VR is not working properly.

- Original Message -
From: Rajesh Battala rajesh.batt...@citrix.com
To: users@cloudstack.apache.org
Cc: Sanjeev Neelarapu sanjeev.neelar...@citrix.com
Sent: Saturday, April 26, 2014 8:52 AM
Subject: RE: How to migrate volumes of Virtual routers


Reboot the VR. It will recreate disks and apply all the rules.

Thanks
Rajesh Battala

-Original Message-
From: Amir Abbasi [mailto:abb...@tebyanidc.ir]
Sent: Saturday, April 26, 2014 9:34 AM
To: users@cloudstack.apache.org
Cc: Sanjeev Neelarapu
Subject: Re: How to migrate volumes of Virtual routers

Hi,

Thank you, Is it possible to force cloudstack to recreate VR instance from
scratch (not only cleaning up)?


- Original Message - 
From: Sanjeev Neelarapu sanjeev.neelar...@citrix.com
To: users@cloudstack.apache.org
Sent: Thursday, April 24, 2014 8:23 AM
Subject: RE: How to migrate volumes of Virtual routers


Hi,

If the host on which VR is running is disconnected and connected back to
Primary storage then the instance becomes read-only. This is the linux
behavior nothing to do with the cloudstack. Please restart the VR to make
the disk writable.

-Sanjeev

-Original Message-
From: Amir Abbasi [mailto:abb...@tebyanidc.ir]
Sent: Wednesday, April 23, 2014 10:58 AM
To: users@cloudstack.apache.org
Subject: How to migrate volumes of Virtual routers

Hi,

I've assigned two primary storages. All virtual routers have been created on
Primary-Storage1 but sometimes I face Read-only file system on some VR
instances. I found no option to migrate their volumes. I have cloudstack
3.0.



Re: Cloudstack with iscsi storage

2014-04-26 Thread rammohan ganapavarapu
Ok thank you.
On Apr 26, 2014 3:25 AM, Ignazio Cassano ignaziocass...@gmail.com wrote:

 You must not create gfs or other file system because with clvm virtual
 machines disks are created on logical volumes .
  Il giorno 25/apr/2014 20:02, Nux! n...@li.nux.ro ha scritto:

  On 25.04.2014 17:59, rammohan ganapavarapu wrote:
 
  Do i have to create gfs or extfs on that lvm or i can just present
 logical
  vol itself (/dev/mapper/vg01_vol01)?
 
 
 
  You need to configure CLVM, check for tutorials on the web.
 
 
 
  --
  Sent from the Delta quadrant using Borg technology!
 
  Nux!
  www.nux.ro
 



How delete or inactive snapshot

2014-04-26 Thread Yesid Mora
Hello, please your collaboration inform how delete the task for snapshot 
frequently for the vm (disk) specific.

Thanks, 
Email asegurado por Check Point


Re: How to migrate volumes of Virtual routers

2014-04-26 Thread Amir Abbasi
What about the SSVM's or Virtual routers? How to migrate their volumes to 
second primary storage?


- Original Message - 
From: Rajesh Battala rajesh.batt...@citrix.com

To: users@cloudstack.apache.org
Sent: Saturday, April 26, 2014 8:20 PM
Subject: RE: How to migrate volumes of Virtual routers


Add the new primary store.
Enable Maintenance mode on the old primary store.
CS will take care of migrating the VM's running the old store to the new 
one.

Once the migrations are complete CS will report the status.
Then remove the old store.

Yes You can use tags to force CS to pick the tagged resources.

Thanks
Rajesh Battala


-Original Message-
From: Amir Abbasi [mailto:abb...@tebyanidc.ir]
Sent: Saturday, April 26, 2014 2:50 PM
To: users@cloudstack.apache.org
Subject: Re: How to migrate volumes of Virtual routers

Hi,

Thanks, is there any way to force CS to create virtual machines on a 
particular Primary-storage from now on (I wan to remove older Primary 
storage as soon as possible)?


- Original Message -
From: Rajesh Battala rajesh.batt...@citrix.com
To: users@cloudstack.apache.org
Sent: Saturday, April 26, 2014 10:52 AM
Subject: RE: How to migrate volumes of Virtual routers


Reboot VR, a new VR will be re-created with new disks and all the rules will
be applied again.

-Original Message-
From: Amir Abbasi [mailto:abb...@tebyanidc.ir]
Sent: Saturday, April 26, 2014 10:23 AM
To: users@cloudstack.apache.org
Subject: Re: How to migrate volumes of Virtual routers

originally I face 2 problems;

1- The VPN which has been enabled and working since a few months ago is not
working (error 789) after facing the Read-only file system issue and I
can't delete the VPN users (but I can add new users).

2- sometimes web service of instances (which uses this router) does not load
js queries properly, I suspect the VR is not working properly.

- Original Message -
From: Rajesh Battala rajesh.batt...@citrix.com
To: users@cloudstack.apache.org
Cc: Sanjeev Neelarapu sanjeev.neelar...@citrix.com
Sent: Saturday, April 26, 2014 8:52 AM
Subject: RE: How to migrate volumes of Virtual routers


Reboot the VR. It will recreate disks and apply all the rules.

Thanks
Rajesh Battala

-Original Message-
From: Amir Abbasi [mailto:abb...@tebyanidc.ir]
Sent: Saturday, April 26, 2014 9:34 AM
To: users@cloudstack.apache.org
Cc: Sanjeev Neelarapu
Subject: Re: How to migrate volumes of Virtual routers

Hi,

Thank you, Is it possible to force cloudstack to recreate VR instance from
scratch (not only cleaning up)?


- Original Message - 
From: Sanjeev Neelarapu sanjeev.neelar...@citrix.com

To: users@cloudstack.apache.org
Sent: Thursday, April 24, 2014 8:23 AM
Subject: RE: How to migrate volumes of Virtual routers


Hi,

If the host on which VR is running is disconnected and connected back to
Primary storage then the instance becomes read-only. This is the linux
behavior nothing to do with the cloudstack. Please restart the VR to make
the disk writable.

-Sanjeev

-Original Message-
From: Amir Abbasi [mailto:abb...@tebyanidc.ir]
Sent: Wednesday, April 23, 2014 10:58 AM
To: users@cloudstack.apache.org
Subject: How to migrate volumes of Virtual routers

Hi,

I've assigned two primary storages. All virtual routers have been created on
Primary-Storage1 but sometimes I face Read-only file system on some VR
instances. I found no option to migrate their volumes. I have cloudstack
3.0.



RE: How to migrate volumes of Virtual routers

2014-04-26 Thread Rajesh Battala
Process I had mentioned will work for all system vms.

Thanks
Rajesh Battala

-Original Message-
From: Amir Abbasi [mailto:abb...@tebyanidc.ir] 
Sent: Sunday, April 27, 2014 9:47 AM
To: users@cloudstack.apache.org
Subject: Re: How to migrate volumes of Virtual routers

What about the SSVM's or Virtual routers? How to migrate their volumes to 
second primary storage?

- Original Message -
From: Rajesh Battala rajesh.batt...@citrix.com
To: users@cloudstack.apache.org
Sent: Saturday, April 26, 2014 8:20 PM
Subject: RE: How to migrate volumes of Virtual routers


Add the new primary store.
Enable Maintenance mode on the old primary store.
CS will take care of migrating the VM's running the old store to the new 
one.
Once the migrations are complete CS will report the status.
Then remove the old store.

Yes You can use tags to force CS to pick the tagged resources.

Thanks
Rajesh Battala


-Original Message-
From: Amir Abbasi [mailto:abb...@tebyanidc.ir]
Sent: Saturday, April 26, 2014 2:50 PM
To: users@cloudstack.apache.org
Subject: Re: How to migrate volumes of Virtual routers

Hi,

Thanks, is there any way to force CS to create virtual machines on a 
particular Primary-storage from now on (I wan to remove older Primary 
storage as soon as possible)?

- Original Message -
From: Rajesh Battala rajesh.batt...@citrix.com
To: users@cloudstack.apache.org
Sent: Saturday, April 26, 2014 10:52 AM
Subject: RE: How to migrate volumes of Virtual routers


Reboot VR, a new VR will be re-created with new disks and all the rules will
be applied again.

-Original Message-
From: Amir Abbasi [mailto:abb...@tebyanidc.ir]
Sent: Saturday, April 26, 2014 10:23 AM
To: users@cloudstack.apache.org
Subject: Re: How to migrate volumes of Virtual routers

originally I face 2 problems;

1- The VPN which has been enabled and working since a few months ago is not
working (error 789) after facing the Read-only file system issue and I
can't delete the VPN users (but I can add new users).

2- sometimes web service of instances (which uses this router) does not load
js queries properly, I suspect the VR is not working properly.

- Original Message -
From: Rajesh Battala rajesh.batt...@citrix.com
To: users@cloudstack.apache.org
Cc: Sanjeev Neelarapu sanjeev.neelar...@citrix.com
Sent: Saturday, April 26, 2014 8:52 AM
Subject: RE: How to migrate volumes of Virtual routers


Reboot the VR. It will recreate disks and apply all the rules.

Thanks
Rajesh Battala

-Original Message-
From: Amir Abbasi [mailto:abb...@tebyanidc.ir]
Sent: Saturday, April 26, 2014 9:34 AM
To: users@cloudstack.apache.org
Cc: Sanjeev Neelarapu
Subject: Re: How to migrate volumes of Virtual routers

Hi,

Thank you, Is it possible to force cloudstack to recreate VR instance from
scratch (not only cleaning up)?


- Original Message - 
From: Sanjeev Neelarapu sanjeev.neelar...@citrix.com
To: users@cloudstack.apache.org
Sent: Thursday, April 24, 2014 8:23 AM
Subject: RE: How to migrate volumes of Virtual routers


Hi,

If the host on which VR is running is disconnected and connected back to
Primary storage then the instance becomes read-only. This is the linux
behavior nothing to do with the cloudstack. Please restart the VR to make
the disk writable.

-Sanjeev

-Original Message-
From: Amir Abbasi [mailto:abb...@tebyanidc.ir]
Sent: Wednesday, April 23, 2014 10:58 AM
To: users@cloudstack.apache.org
Subject: How to migrate volumes of Virtual routers

Hi,

I've assigned two primary storages. All virtual routers have been created on
Primary-Storage1 but sometimes I face Read-only file system on some VR
instances. I found no option to migrate their volumes. I have cloudstack
3.0.



Re: Frequent NFS not responding, timed out issue

2014-04-26 Thread Shanker Balan
Comments inline.

On 26-Apr-2014, at 3:06 pm, Hung Nguyen The 
hung...@saobacdau.vnmailto:hung...@saobacdau.vn wrote:

Hi Shanker,
Thanks for your comment. I am trying to figure out why the network latency is 
high.

I would like to know how you determined that the network latency is high. Did 
you do some
kind of ping test? If so, does the latency change during peak / non-peak times?

Real metrics would be useful to identify patterns.

It is good to know if the issue with 10Gbps is no longer the case.

Goes back to the availability of metrics. :)

I am not sure whether there is a problem with the physical switch (IBM Flex 
switch) or something has to do with the driver of network card.

At the risk of sounding like a broken record, do you have metrics for your 
network?

I usually deploy a central collectd poller to pull SNMP information for all 
devices and XenServers.

I attached with the NIC info and driver version. I don’t know if this is the 
latest version or not.

You will need to check XenServer site / Citrix for the details I guess.

Regards.
@shankerbalan




With thanks,
Nguyễn Thế Hùng



-Original Message-
From: Shanker Balan [mailto:shanker.ba...@shapeblue.com]
Sent: Friday, April 25, 2014 12:27 PM
To: CloudStack-Users
Subject: Re: Frequent NFS not responding, timed out issue

Hi Hung,

Comments inline.

On 25-Apr-2014, at 2:14 am, Hùng Nguyễn Thế 
thehung.ngu...@live.commailto:thehung.ngu...@live.com wrote:

 Hi all,
 We experience an intermittent NFS connection from our Xenserver 6.2 Sp1 
 latest patch.
 /var/log/kern.log shows the exact messages as in the known issues from 
 Xenserver 6.0 Release Notes [1]:
 kernel: nfs: server 10.0.0.1 not responding, timed out
 Our enviroment is indeed 10Gbps, storage is IBM Storwize v7000.
 Hope someone can give us some hints on this matter.


Would you have any monitoring running of the network itself? SNMP information 
collected from the switches and the physical network interfaces of the various 
devices on the network would be helpful to narrow down the issue.

Most likely there is saturation somewhere.



 Buying Citrix support subscription is on the way.
 Some addtional information:
 nfsstat -m:
 rw,relatime,vers=3,rsize=1048576,wsize=1048576,namlen=255,acregmin=0,
 acregmax=0,acdirmin=0,acdirmax=0,soft,proto=tcp,port=65535,timeo=133,r
 etrans=0, sec=sys,mountport=65535,local_lock=none,addr=192.168.x.x

 I have captured tcpdump and seen some symtomps like TCP retransmission, tcp 
 acked unseen segment.
 Network seems okay, the only unusual thing is the latency from xenserver to 
 the storage is fluctuating, from 1ms to several XX ms.

Try to get access to the network level metrics to debug further.

Regards.


--
@shankerbalan

M: +91 98860 60539 | O: +91 (80) 67935867
shanker.ba...@shapeblue.commailto:shanker.ba...@shapeblue.com | 
www.shapeblue.comhttp://www.shapeblue.com | Twitter:@shapeblue
ShapeBlue Services India LLP, 22nd floor, Unit 2201A, World Trade Centre, 
Bangalore - 560 055

Need Enterprise Grade Support for Apache CloudStack?
Our CloudStack Infrastructure 
Supporthttp://shapeblue.com/cloudstack-infrastructure-support/ offers the 
best 24/7 SLA for CloudStack Environments.

Apache CloudStack Bootcamp training courses

**NEW!** CloudStack 4.2.1 traininghttp://shapeblue.com/cloudstack-training/
28th-29th May 2014, Bangalore. 
Classrommhttp://shapeblue.com/cloudstack-training/
16th-20th June 2014, Region A. Instructor led, 
On-linehttp://shapeblue.com/cloudstack-training/
23rd-27th June 2014, Region B. Instructor led, 
On-linehttp://shapeblue.com/cloudstack-training/
15th-20th September 2014, Region A. Instructor led, 
On-linehttp://shapeblue.com/cloudstack-training/
22nd-27th September 2014, Region B. Instructor led, 
On-linehttp://shapeblue.com/cloudstack-training/
1st-6th December 2014, Region A. Instructor led, 
On-linehttp://shapeblue.com/cloudstack-training/
8th-12th December 2014, Region B. Instructor led, 
On-linehttp://shapeblue.com/cloudstack-training/

This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England  Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue Ltd. Shape 
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
operated under license from Shape Blue Ltd. ShapeBlue is a registered trademark.