Re: ShapeBlue Repository Down ?

[Carlos Reátegui]

Hi Rohit,

You may want to have a look at this: https://github.com/rgrp/s3-bucket-listing 


Works well.

cheers,
Carlos


> On Nov 2, 2016, at 10:55 AM, Rohit Yadav  wrote:
> 
> Hi Mārtiņš,
> 
> 
> Thanks for sharing the issue, we've moved packages.shapeblue.com 
>  to S3 where directory listing is not 
> supported. I'll update the page to include links to the hypervisor specific 
> templates soon.
> 
> 
> Regards.
> 
> 
> From: Mārtiņš Jakubovičs  >
> Sent: 01 November 2016 21:01:29
> To: users@cloudstack.apache.org 
> Subject: Re: ShapeBlue Repository Down ?
> 
> Hello,
> 
> Are there any way to list files in ShapeBlue repositories? For example,
> I want to download 4.5.2 template from
> https://packages.shapeblue.com/systemvmtemplate/4.5
> 
> 
> On 2016.09.16. 11:17, Glenn Wagner wrote:
>> Hi,
>> 
>> The mirror site is a duplicate of the packages.shapeblue.com site so if you 
>> used 4.8 main it will be the same on the mirror
>> 
>> Glenn
>> 
>> 
>> glenn.wag...@shapeblue.com
>> www.shapeblue.com > >
>> First Floor, Victoria Centre, 7 Victoria Street, Somerset West, Cape Town  
>> 7129South Africa
>> @shapeblue
>> 
>> 
>> 
>> 
>> -Original Message-
>> From: Cristian Ciobanu [mailto:cristian.c@istream.today 
>> ]
>> Sent: Friday, 16 September 2016 10:14 AM
>> To: users@cloudstack.apache.org 
>> Subject: RE: ShapeBlue Repository Down ?
>> 
>> Thank you, my last question, can I use 4.8 main for VMware 5.5 ?
>> 
>> 
>> Regards,
>> Cristian
>> 
>> -Original Message-
>> From: Glenn Wagner [mailto:glenn.wag...@shapeblue.com 
>> ]
>> Sent: Friday, September 16, 2016 10:53 AM
>> To: users@cloudstack.apache.org 
>> Subject: RE: ShapeBlue Repository Down ?
>> 
>> Hi Cristian,
>> 
>> We are aware of the issue and are working to get it fixed
>> 
>> You can use a mirror of the server if urgent
>> 
>> http://mirrors.coreix.net/packages.shapeblue.com/cloudstack/ 
>> 
>> 
>> Regards
>> Glenn
>> 
>> 
>> 
>> glenn.wag...@shapeblue.com 
>> www.shapeblue.com > >
>> First Floor, Victoria Centre, 7 Victoria Street, Somerset West, Cape Town  
>> 7129South Africa @shapeblue
>> 
>> 
>> 
>> 
>> -Original Message-
>> From: Cristian Ciobanu [mailto:cristian.c@istream.today 
>> ]
>> Sent: Friday, 16 September 2016 9:28 AM
>> To: users@cloudstack.apache.org 
>> Subject: ShapeBlue Repository Down ?
>> 
>> Hello,
>> 
>> 
>> 
>>   Will the ShapeBlue Repo come back online ?
>> 
>> 
>> 
>> Thank you
>> 
>> Cristian.
>> 
>> 
>> 
>> 
> 
> 
> rohit.ya...@shapeblue.com  
> www.shapeblue.com 
> 53 Chandos Place, Covent Garden, London  WC2N 4HSUK
> @shapeblue

Re: Cloudstack management server changing msid

[Carlos Reátegui]

Thanks…. That makes sense.  I do have a bond for my NICs which means the OS 
will pick one of the underlying MACs for the bond MAC upon boot (and not always 
the same one).

And since my NIC card has been replaced twice that is why my table looks like 
this:

mysql> select id,hex(msid),runid,state,version,last_update,removed from mshost;
++--+---+---+-+-+-+
| id | hex(msid)| runid | state | version | last_update | 
removed |
++--+---+---+-+-+-+
|  1 | 90B11C2005CF | 1438989683052 | Up| 4.5.1   | 2016-02-24 23:11:01 | 
NULL|
|  2 | C81F66E36518 | 1472507558962 | Up| 4.5.2.1 | 2016-09-23 16:30:06 | 
NULL|
|  3 | C81F66E36516 | 1474876304188 | Up| 4.5.2.1 | 2016-09-26 07:54:20 | 
NULL|
|  4 | 44A8421593B2 | 1475849685464 | Up| 4.5.2.1 | 2016-10-08 00:09:44 | 
NULL|
|  5 | 44A8421593B0 | 1475199571333 | Up| 4.5.2.1 | 2016-09-30 02:01:31 | 
NULL|
++--+---+---+-+-+-+
5 rows in set (0.00 sec)

I’m going to set the hwaddress as you suggest to keep the bond MAC from 
changing.

Should I mark the “old” msids removed?

thank you!



> On Oct 7, 2016, at 12:51 AM, Stephan Seitz 
>  wrote:
> 
> Hi Carlos,
> 
> we encountered the same issue after introducing nic-bonding on the
> management net which changed the MAC.
> 
> The msid includes the MAC of the interface which has the service_ip
> bound to. If that MAC changes, your management node encounters an
> identity crisis ;)
> 
> We solved that, by updating the msid field in the cloud.mshost table.
> 
> The msid is the decimal representation of the MAC. So, in our case
> 57177340185274 (dec) = 3400a30d0aba (hex) (34:00:a3:0d:0a:ba)
> 
> This currently shows:
> 
> mysql> select * from mshost where id=1 \G
> *** 1. row ***
>   id: 1
> msid: 57177340185274 <---
>runid: 1474366224657
> name: acs-management-1
>state: Up
>  version: 4.9.0
>   service_ip: 10.97.13.1
> service_port: 9090
>  last_update: 2016-10-07 07:43:59
>  removed: NULL
>  alert_count: 0
> 1 row in set (0.00 sec)
> 
> 
> # ip addr show dev bond0
> 4: bond0:  mtu 1500 qdisc
> noqueue state UP group default qlen 1000
> link/ether 34:00:a3:0d:0a:ba brd ff:ff:ff:ff:ff:ff
> inet 10.97.13.1/22 brd 10.97.15.255 scope global bond0
>valid_lft forever preferred_lft forever
> 
> 
> Another way to solve this issue could be changing the MAC of the
> management interface to a known (and fixed) value. E.g. by using
> ethtool.
> 
> If you know the removed hardware is no longer used in the same network
> segment, and you do know the previos MAC, you could change your network
> configuration by setting the MAC on the new hardware to the previously
> one.
> 
> To be safe from further changes, we did this additionally by using the
> hwaddress keyword in /etc/network/interfaces. This is the debian/ubuntu
> way.
> 
> auto bond0
> iface bond0 inet static
>   address 10.97.13.1
>   netmask 255.255.252.0
>   gateway 10.97.12.1
>   dns-nameservers 
>   dns-search XXX
>   hwaddress 34:00:a3:0d:0a:ba
>   bond-slaves eth0 eth1
>   bond-mode 4
>   bond-lacp-rate 1
>   bond-miimon 100
>   bond-updelay 200
>   bond-downdelay 200
> 
> 
> Hope this helps!
> 
> cheers,
> 
> - Stephan
> 
> Am Donnerstag, den 06.10.2016, 23:41 -0700 schrieb Carlos Reátegui:
>> Hi,
>> I have had this issue a few times now with my management server.  I
>> have had a couple unfortunate hw issues that have caused the machine
>> to crash (have replaced motherboard, backplane and network cards….
>> don’t ask).  Upon restoring the machine there is a new entry in the
>> mshost table.  However the host table mgmt_server_id still references
>> the old mshost.msid and therefore my management server is unable to
>> “manage” the hosts.
>> 
>> The only way to fix this is to :
>> update host set mgmt_server_id= where mgmt_server_id=> msid>;
>> 
>> Anyone else run across this?  Is there a proper way to restore a
>> management server?  How does the management server decide it is a new
>> mshost and create a new entry in the mshost table?
>> 
>> Currently my mshost table has 5 entries and they all claim to be in
>> the “Up” state even though there is only 1 management server.  One of
>> the entries is for the original 4.5.1 install.  The other 4 are for
>> the current 4.5.2.1 upgrade.  They all have the same IP address.
>> 
>> thanks,
>> Carlos

Cloudstack management server changing msid

[Carlos Reátegui]

Hi,
I have had this issue a few times now with my management server.  I have had a 
couple unfortunate hw issues that have caused the machine to crash (have 
replaced motherboard, backplane and network cards…. don’t ask).  Upon restoring 
the machine there is a new entry in the mshost table.  However the host table 
mgmt_server_id still references the old mshost.msid and therefore my management 
server is unable to “manage” the hosts.

The only way to fix this is to :
update host set mgmt_server_id= where mgmt_server_id=;

Anyone else run across this?  Is there a proper way to restore a management 
server?  How does the management server decide it is a new mshost and create a 
new entry in the mshost table?

Currently my mshost table has 5 entries and they all claim to be in the “Up” 
state even though there is only 1 management server.  One of the entries is for 
the original 4.5.1 install.  The other 4 are for the current 4.5.2.1 upgrade.  
They all have the same IP address.

thanks,
Carlos

Re: Cloudstack Old env messed up!

[Carlos Reátegui]

Hi Gagan,

I have found that the “insufficient capacity” error can be misleading.  What 
version of CloudStack are you using and what hypervisor are your hosts?

With CS 4.5.1 + XenServer 6.5, I just saw “insufficient capacity” when trying 
to start a stopped instance but the problem was actually a bootloader problem 
on the bad instance.  

The best thing to do would be to tail the management log while trying to create 
the new instance to see what the error in the log is.  That is how I found what 
the actual error was in my case.

regards,
-Carlos

> On Jul 29, 2015, at 10:27 PM, gagan chhabra  wrote:
> 
> I am just trying to get the Env up and running and its just private to my
> Institute. There are 4 instances which are being used. There are other
> stopped VMs which need not be affected during resolving the issues. So
> cannot wipe everything clean and do a fresh installation.
> 
> I had been looking into it and 3 hosts are up now. I am able to start the
> old VMs but cannot create new instances(encounter insufficient capacity
> error), although almost entire primary storage and secondary storage is
> unused.
> Major issues are now:
> 1. I had management server restart once, but I found one Exception (cannot
> ping mgmt-server at 9090).
> 2. The primary storage usage on admin dashboard is different and in
> storage_pool is different(it shows almost complete used up in database).
> May be this causes insufficient  capacity error.
> 
> Gagandeep S. Chhabra
> Reasearch Assitant, IITB
> Mob: +91 97049 28427
> 
> 
> On Tue, Jul 28, 2015 at 7:34 PM, Daan Hoogland 
> wrote:
> 
>> yeah, what Dag said but not as diplomatic ;)
>> 
>> On Tue, Jul 28, 2015 at 4:01 PM, Dag Sonstebo
>>  wrote:
>>> Hi Gagan,
>>> 
>>> Sounds like you might have a number of problems in your environment.
>>> Before starting to dig too deep can you clarify what you are actually
>>> trying to recover? I.e. are you just trying to get the CloudStack
>>> environment up and running again or do you have production VM instances
>>> running which you need to recover?
>>> 
>>> Regards,
>>> Dag Sonstebo
>>> Cloud Architect
>>> ShapeBlue
>>> 
>>> 
>>> 
>>> On 28/07/2015 14:54, "gagan chhabra"  wrote:
>>> 
 I have been given an already set-up Cloud stack environment with 6 hosts
 (2
 clusters with 3 hosts each) ,1 management server and one NFS storage as
 primary storage. So in total there are 8 physical machines (6 hosts + 1
 cloudstack-mgmt-server + 1 NFS:13TBytes). Management server's storage
 space
 is used as secondary storage.
 
 I just have one host up and running in cluster-2 and there is no host
 working in cluster-1. People who worked before me, may have messed up
>> with
 persistent tier changing values of states, status for hosts,vms,storage
 etc
 for their testing administering the cloudstack-setup . So now Admin UI
 always shows error in notifications area, unable to change state to
 maintenance, cannot expunge vms, cannot  create VMs and what not.
 *One major issue is for primary storage, used_bytes in storage_pool table
 is set to high value in MySQL database but on admin-dashboard it shows
 540GB used(total capacity being 13TB). So while creating VMs,
>> insufficient
 capacity error is encountered. *
 
 Any suggestion where to start for this? Doing everything from the scratch
 will be plan-B.
 
 
 Gagandeep S. Chhabra
 Mob: +91 97049 28427
>>> 
>>> Find out more about ShapeBlue and our range of CloudStack related
>> services
>>> 
>>> IaaS Cloud Design & Build<
>> http://shapeblue.com/iaas-cloud-design-and-build//>
>>> CSForge – rapid IaaS deployment framework
>>> CloudStack Consulting
>>> CloudStack Software Engineering<
>> http://shapeblue.com/cloudstack-software-engineering/>
>>> CloudStack Infrastructure Support<
>> http://shapeblue.com/cloudstack-infrastructure-support/>
>>> CloudStack Bootcamp Training Courses<
>> http://shapeblue.com/cloudstack-training/>
>>> 
>>> This email and any attachments to it may be confidential and are
>> intended solely for the use of the individual to whom it is addressed. Any
>> views or opinions expressed are solely those of the author and do not
>> necessarily represent those of Shape Blue Ltd or related companies. If you
>> are not the intended recipient of this email, you must neither take any
>> action based upon its contents, nor copy or show it to anyone. Please
>> contact the sender if you believe you have received this email in error.
>> Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue
>> Services India LLP is a company incorporated in India and is operated under
>> license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a
>> company incorporated in Brasil and is operated under license from Shape
>> Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of
>> S

Re: More disk space for primary storage.

[Carlos Reátegui]

Dan,
Is the compute offering you are using for your VMs set to use local storage?  
You will need to create new compute offerings if not and launch your VMs with 
those offerings.

Cheers,
Carlos


> On Mar 18, 2015, at 7:20 AM, Dan Dong  wrote:
> 
> The problem is that I can not launch many VMs as the primary storage of 2TB
> will be filled quickly.  Why the primary storage could not utilize local
> storage on hypervisor nodes? Some other global settings?
> 
> system.vm.use.local.storage=true
> And I have set to use local storage in my compute offering already.
> 
> Local storage enabledYes
> On dashboard I see:
> Primary Storage Allocated: 1.24 TB / 1.79 TB
> Local Storage: Allocated: 630.28 GB / 21.21 TB
> 
> Cheers,
> Dan
> 
> 
> 
> 2015-03-17 16:28 GMT-05:00 Somesh Naidu :
> 
>> Local Storage is used for UserVM and SystemVM deployment based on the
>> values set for "system.vm.use.local.storage" and "Local storage enabled".
>> Of course, you need compute offering using local storage as well.
>> 
>> Somesh
>> CloudPlatform Escalations
>> Citrix Systems, Inc.
>> 
>> 
>> -Original Message-
>> From: Dan Dong [mailto:dongda...@gmail.com]
>> Sent: Tuesday, March 17, 2015 3:23 PM
>> To: users@cloudstack.apache.org
>> Subject: Re: More disk space for primary storage.
>> 
>> Hi, Somesh,
>>  Yes, all the local storage are listed in storage_pool table with e.g:
>> 
>> used_bytes managed  6690078720
>> capacity_bytes 3886517903360
>> 
>> And
>> Local storage enabledYes
>> On dashboard I see:
>> Primary Storage Allocated: 1.24 TB / 1.79 TB
>> Local Storage: Allocated: 630.28 GB / 21.21 TB
>> 
>> Confused what this Local Storage are used for?
>> 
>> Cheers,
>> Dan
>> 
>> 
>> 
>> 2015-03-17 13:37 GMT-05:00 Somesh Naidu :
>> 
>>> Dan,
>>> 
>>> Are all the local storage listed in the storage_pool table? If so, what
>>> does the capacity_bytes column for these reflect?
>>> 
>>> In addition, what do you have "Local storage enabled" flag set to for the
>>> Zone where the KVM hosts reside?
>>> 
>>> Somesh
>>> CloudPlatform Escalations
>>> Citrix Systems, Inc.
>>> 
>>> -Original Message-
>>> From: Dan Dong [mailto:dongda...@gmail.com]
>>> Sent: Monday, March 16, 2015 11:08 AM
>>> To: users@cloudstack.apache.org
>>> Subject: More disk space for primary storage.
>>> 
>>> Hi, All,
>>> I found a weird situation here:
>>> 1. My cloudstack cluster contains 1 Management Server+7KVM Hypervisor
>>> nodes.
>>> 2. 1TB disk is allocated to primary storage on Management Server.
>>> 3. Each KVM Hypervisor has 4TB disk space, no manual disk partitions on
>> it.
>>> 4. system.vm.use.local.storage=true
>>> 5. But found only 2TB size of primary storage on dashboard.
>>> 
>>> So seems the 7 KVM nodes altogether contribute only 1TB for primary
>>> storage. How to allocate more disk space to primary storage? Any global
>>> settings I did not set? Thanks.
>>> 
>>> Cheers,
>>> Dan
>>> 
>> 

Re: XenServer 6.2, mgmt nic bonding, bridge mode and cloudstack 4.4.2 error

[Carlos Reátegui]

You can use vswitch if you change the network offering and remove security 
groups (if that is ok for your deployment).  However I have had problems with 
some versions of CS that will not let you add anything but bridge. 
Unfortunately can't remember which off the top of my head. 

Also make sure that vhdutil got copied over to the hosts. CS needs a different 
version than the one on XS.  I hear the one on 6.5 is ok, but I believe all 
other versions need the one that the docs tell you to install. In earlier 
versions of the docs they had the wrong location on the management server to 
put it on. Not sure if this has been corrected. 

On some of my setups I have not had luck with iptables and had to disable it 
for networking to work between my hosts (not an issue for my use to have the fw 
off).  I think this was mostly due to me patching XS and CS not supporting the 
updated XS. Don't think this is an issue for 6.2 though. 



> On Feb 21, 2015, at 2:57 AM, Chris  wrote:
> 
> G'day all,
> 
> Quick run down of the configuration and architecture I've got;
> 
> 1 x management server (mgmt) running Centos 6.6 x64, cloudstack management
> installed, one nic
> 2 x xenserver 6.2 (xen1 & xen2) no patches installed, 4 nics
> 1 x nas (nas) sharing primary and secondary nfs, 2 nics
> 
> On the xenservers, I've created a pool with xen1 being the master, then
> I've created two network bonds - bond0 for eth0 & 1, bond1 for eth2 & 3 .
> Management interface has been assigned to bond0. labels are cloud-private
> bond0 , cloud-public bond1 .
> 
> At this point, i made no changes to the xe-switch-network-backend, leaving
> it on vswitch.
> 
> When adding pool (using xen1 ip address) to cloudstack using the basic
> setup wizzard, the below error occurs when attempting to add host:
> 
> Cannot transit agent status with event AgentDisconnected for host 1,
> mangement server id is 94980626781222,Unable to transition to a new state
> from Creating via AgentDisconnected
> 
> After some research, I saw notes on the need to setup bridge mode by using
> the command xe-switch-network-backend bridge . Also to edit the bridge
> settings in sysctl.conf by using the following command;
> sed -i -e '/net.bridge.bridge-nf-call-iptables/
> c\net.bridge.bridge-nf-call-iptables = 1' -e
> '/net.bridge.bridge-nf-call-arptables/
> c\net.bridge.bridge-nf-call-arptables = 1' /etc/sysctl.conf
> 
> After performing this on both my xenserver nodes and rebooting - they no
> longer have any network connectivity, they can't ping each other nor
> anything else on the network. It's not until I switch it back to vswitch
> and reboot that they resume on the network. However this configuration
> isn't supported by CloudStack.
> 
> Any thoughts on how I can fix this?
> 
> Cheers!

Re: [RESOLVED] Can't launch VMs

[Carlos Reátegui]

Hi All,

Thanks to Chiradeep on the dev list I am back in business.  For anyone stuck 
with the same problem I have opened 
https://issues.apache.org/jira/browse/CLOUDSTACK-7674

To resolve the issue you must edit the db and set the broadcast_uri in the 
networks table for your Guest network to vlan://untagged

Cheers,
Carlos


On Oct 2, 2014, at 12:22 PM, Carlos Reátegui  wrote:

> Hi Ilya 
> I understand that. However the problem is I already have this environment 
> deployed and it was working fine but now my users can't launch new instances 
> because apparently there is no vlan configured. I would like to get this 
> working again. 
> Thanks
> Carlos
> 
> 
> 
>> On Oct 2, 2014, at 12:02 PM, ilya musayev  
>> wrote:
>> 
>> Carlos,
>> 
>> VLAN tagging is one of the main reasons why you want to use advanced zone. 
>> Thats the difference between basic and advanced zones.
>> 
>> Regards
>> ilya
>> 
>> 
>>> On 10/2/14, 10:04 AM, Carlos Reátegui wrote:
>>> I don't see anywhere in the basic network wizard where I can add a vlan 
>>> tag. I see it in the advanced network wizard.
>>> 
>>> Do you know where in the DB I can add the tag to get my system back online? 
>>> Or can you point me to the jira.
>>> 
>>> Thank you
>>> Carlos
>>> 
>>> 
>>> 
>>>> On Oct 2, 2014, at 8:30 AM, Daan Hoogland  wrote:
>>>> 
>>>> The add zone wizard provides a field during physical network creation. Not
>>>> sure if that answers your question. Not in case you are using the api of
>>>> course.
>>>> 
>>>>> On Thu, Oct 2, 2014 at 3:46 PM, Carlos Reátegui  
>>>>> wrote:
>>>>> 
>>>>> 
>>>>> 
>>>>>>> On Oct 2, 2014, at 12:57 AM, Daan Hoogland 
>>>>>> wrote:
>>>>>> 
>>>>>> On Thu, Oct 2, 2014 at 12:29 AM, Carlos Reátegui 
>>>>>> wrote:
>>>>>> 
>>>>>>> Daan,
>>>>>>> Any chance you got to look at this?  I am still confused why for a basic
>>>>>>> network with no vlans the code is expecting a uri for a vlan.
>>>>>>> thanks
>>>>>> ​
>>>>>> It is a known issue, can you do your setup with specifying a vlan? I
>>>>>> suspect this being the issue. It won't use the vlan but it needs a value.
>>>>> Where do I do that?
>>>>> 
>>>>>> Needs fixing but I think it will work with this work around. I am not
>>>>> sure
>>>>>> what the most solid fix would be and that would be more a discussion for
>>>>>> dev@...
>>>>>> 
>>>>>> You could think of inserting a default value when doing basic networking
>>>>> or
>>>>>> a check on networking type when creating the router/instances. Both seem
>>>>>> quirky, though.
>>>>>> 
>>>>>> regards,
>>>>>> --
>>>>>> Daan
>>>> 
>>>> 
>>>> -- 
>>>> Daan
>> 

Re: Can't launch VMs

[Carlos Reátegui]

Hi Ilya 
I understand that. However the problem is I already have this environment 
deployed and it was working fine but now my users can't launch new instances 
because apparently there is no vlan configured. I would like to get this 
working again. 
Thanks
Carlos



> On Oct 2, 2014, at 12:02 PM, ilya musayev  
> wrote:
> 
> Carlos,
> 
> VLAN tagging is one of the main reasons why you want to use advanced zone. 
> Thats the difference between basic and advanced zones.
> 
> Regards
> ilya
> 
> 
>> On 10/2/14, 10:04 AM, Carlos Reátegui wrote:
>> I don't see anywhere in the basic network wizard where I can add a vlan tag. 
>> I see it in the advanced network wizard.
>> 
>> Do you know where in the DB I can add the tag to get my system back online? 
>> Or can you point me to the jira.
>> 
>> Thank you
>> Carlos
>> 
>> 
>> 
>>> On Oct 2, 2014, at 8:30 AM, Daan Hoogland  wrote:
>>> 
>>> The add zone wizard provides a field during physical network creation. Not
>>> sure if that answers your question. Not in case you are using the api of
>>> course.
>>> 
>>>> On Thu, Oct 2, 2014 at 3:46 PM, Carlos Reátegui  
>>>> wrote:
>>>> 
>>>> 
>>>> 
>>>>>> On Oct 2, 2014, at 12:57 AM, Daan Hoogland 
>>>>> wrote:
>>>>> 
>>>>> On Thu, Oct 2, 2014 at 12:29 AM, Carlos Reátegui 
>>>>> wrote:
>>>>> 
>>>>>> Daan,
>>>>>> Any chance you got to look at this?  I am still confused why for a basic
>>>>>> network with no vlans the code is expecting a uri for a vlan.
>>>>>> thanks
>>>>> ​
>>>>> It is a known issue, can you do your setup with specifying a vlan? I
>>>>> suspect this being the issue. It won't use the vlan but it needs a value.
>>>> Where do I do that?
>>>> 
>>>>> Needs fixing but I think it will work with this work around. I am not
>>>> sure
>>>>> what the most solid fix would be and that would be more a discussion for
>>>>> dev@...
>>>>> 
>>>>> You could think of inserting a default value when doing basic networking
>>>> or
>>>>> a check on networking type when creating the router/instances. Both seem
>>>>> quirky, though.
>>>>> 
>>>>> regards,
>>>>> --
>>>>> Daan
>>> 
>>> 
>>> -- 
>>> Daan
> 

Re: Can't launch VMs

[Carlos Reátegui]

I don't see anywhere in the basic network wizard where I can add a vlan tag. I 
see it in the advanced network wizard.

Do you know where in the DB I can add the tag to get my system back online? Or 
can you point me to the jira. 

Thank you
Carlos



> On Oct 2, 2014, at 8:30 AM, Daan Hoogland  wrote:
> 
> The add zone wizard provides a field during physical network creation. Not
> sure if that answers your question. Not in case you are using the api of
> course.
> 
>> On Thu, Oct 2, 2014 at 3:46 PM, Carlos Reátegui  wrote:
>> 
>> 
>> 
>>>> On Oct 2, 2014, at 12:57 AM, Daan Hoogland 
>>> wrote:
>>> 
>>> On Thu, Oct 2, 2014 at 12:29 AM, Carlos Reátegui 
>>> wrote:
>>> 
>>>> Daan,
>>>> Any chance you got to look at this?  I am still confused why for a basic
>>>> network with no vlans the code is expecting a uri for a vlan.
>>>> thanks
>>> ​
>>> It is a known issue, can you do your setup with specifying a vlan? I
>>> suspect this being the issue. It won't use the vlan but it needs a value.
>> 
>> Where do I do that?
>> 
>>> Needs fixing but I think it will work with this work around. I am not
>> sure
>>> what the most solid fix would be and that would be more a discussion for
>>> dev@...
>>> 
>>> You could think of inserting a default value when doing basic networking
>> or
>>> a check on networking type when creating the router/instances. Both seem
>>> quirky, though.
>>> 
>>> regards,
>>> --
>>> Daan
> 
> 
> 
> -- 
> Daan

Re: Can't launch VMs

[Carlos Reátegui]

> On Oct 2, 2014, at 12:57 AM, Daan Hoogland  wrote:
> 
> On Thu, Oct 2, 2014 at 12:29 AM, Carlos Reátegui 
> wrote:
> 
>> Daan,
>> Any chance you got to look at this?  I am still confused why for a basic
>> network with no vlans the code is expecting a uri for a vlan.
>> thanks
> ​
> It is a known issue, can you do your setup with specifying a vlan? I
> suspect this being the issue. It won't use the vlan but it needs a value.

Where do I do that?

> Needs fixing but I think it will work with this work around. I am not sure
> what the most solid fix would be and that would be more a discussion for
> dev@...
> 
> You could think of inserting a default value when doing basic networking or
> a check on networking type when creating the router/instances. Both seem
> quirky, though.
> 
> regards,
> -- 
> Daan

Re: Can't launch VMs

[Carlos Reátegui]

Daan,
Any chance you got to look at this?  I am still confused why for a basic 
network with no vlans the code is expecting a uri for a vlan.
thanks
Carlos


On Sep 30, 2014, at 11:37 AM, Carlos Reategui  wrote:

> ok.  I see. Although wouldn't it be easier to query the DB based on what it 
> is looking for to see what is missing?
> 
> When I originally set it up, I did not us the initial wizard.  Instead I 
> created it from "Infrastructure->Zones->Add Zone" and then following:
> 1) Zone Type:
> Basic Network
> 
> 2) Setup Zone:
> fill in values for DNS
> Hypervisor: ZenServer
> Network Offering: DefaultSharedNetworkOffering
> Network Domain: blank
> Dedicated: NO
> LocalStorageEnabled: YES (I do option 1 from the warning -- start zone in 
> disabled state and add primary storage) 
> 
> 3) Setup Network
> POD:
> Physical Network: xapi1 (Management and Guest) did not drag storage in.
> GUEST TRAFFIC:
>  *Reserved system gateway: 172.30.45.1
>  *Reserved system netmask: 255.255.255.0
>  *Start Reserved system IP: 172.30.45.50
>  End Reserved system IP: 172.30.45.80
> 
>  Guest Gateway: 172.30.45.1
>  Guest Netmask: 255.255.255.0
>  Guest start IP: 172.30.45.100
>  Guest end IP: 172.30.45.250
>   
> 4) Add Resources:
> CLUSTER:
> Hypervisor: Xenserver
> HOST:
> add the xenserver pool master info
> 
> 5) Launch
> SECONDARY STORAGE:
> Add NFS storage
> 
> Launch zone disabled
> 
> The go to "Infrastructure->Primary Storage(view all)->Add Primary Storage" 
> and add primary NFS storage.
> 
> This was working fine previously.
> 
> 
> 
> 
> On Tue, Sep 30, 2014 at 10:19 AM, Daan Hoogland  
> wrote:
> Carlos, the line of code that breaks expects a uri for a vlan. That is why
> I want more information from you. I can not judge whether the code is
> broken and should have dealt with the nullpointer or whether the
> configuration is incorrect. What are your guest/management/storage
> networks? what are the cidrs and ip-ranges you chose?
> 
> On Tue, Sep 30, 2014 at 4:41 PM, Carlos Reátegui 
> wrote:
> 
> > Daan,
> > Thanks for having a look
> >
> > On Sep 30, 2014, at 2:16 AM, Daan Hoogland 
> > wrote:
> >
> > >> 2014-09-29 16:26:25,834 WARN  [c.c.h.x.r.CitrixResourceBase]
> > >> (DirectAgent-235:ctx-7f8db7ac) Catch Exception: class
> > >> java.lang.NullPointerException due to java.lang.NullPointerException
> > >>
> > >> java.lang.NullPointerException
> > >>
> > >>at
> > >>
> > >
> > com.cloud.network.Networks$BroadcastDomainType.getSchemeValue(Networks.java:173)
> > >>
> > >>at
> > >>
> > com.cloud.network.Networks$BroadcastDomainType.getValue(Networks.java:228)
> > >>
> > >>at
> > >>
> > >
> > com.cloud.hypervisor.xen.resource.CitrixResourceBase.getNetwork(CitrixResourceBase.java:1035)
> > >>
> > > ​...​
> > >
> > > ​Can you describe how you set up your network? Which cidrs/network
> > > types/vlans/ etc?​
> > >
> >
> > This is a basic network.  No security groups.  No vlans.
> >
> > ACS: 4.3.1 (On ubuntu 12.04) + XS 6.2
> >
> > > --
> > > Daan
> >
> >
> 
> 
> --
> Daan
> 

Re: Errors in management log files

[Carlos Reátegui]

Daan,

So if I install the usage server these should go away?

Thanks,
Carlos

On Sep 30, 2014, at 2:26 AM, Daan Hoogland  wrote:

> Carlos, this one is nothing to worry about, except when you want to use the
> usage service. it is an error in the handling of xapi output that causes
> the stats collection to stop. It should be fixed in newer versions, safe
> that it encounters a vm for which it can not collect data. volume data IIRC.
> 
> On Mon, Sep 29, 2014 at 7:10 PM, Carlos Reategui 
> wrote:

Re: Can't launch VMs

[Carlos Reátegui]

Daan,
Thanks for having a look

On Sep 30, 2014, at 2:16 AM, Daan Hoogland  wrote:

>> 2014-09-29 16:26:25,834 WARN  [c.c.h.x.r.CitrixResourceBase]
>> (DirectAgent-235:ctx-7f8db7ac) Catch Exception: class
>> java.lang.NullPointerException due to java.lang.NullPointerException
>> 
>> java.lang.NullPointerException
>> 
>>at
>> 
> com.cloud.network.Networks$BroadcastDomainType.getSchemeValue(Networks.java:173)
>> 
>>at
>> com.cloud.network.Networks$BroadcastDomainType.getValue(Networks.java:228)
>> 
>>at
>> 
> com.cloud.hypervisor.xen.resource.CitrixResourceBase.getNetwork(CitrixResourceBase.java:1035)
>> 
> ​...​
> 
> ​Can you describe how you set up your network? Which cidrs/network
> types/vlans/ etc?​
> 

This is a basic network.  No security groups.  No vlans.

ACS: 4.3.1 (On ubuntu 12.04) + XS 6.2

> -- 
> Daan

Re: Problems with firewall

[Carlos Reátegui]

Is there a way to uninstall the CSP?

Although, I do remember encountering a problem adding hosts without the CSP on 
a different setup.


On Sep 10, 2014, at 11:02 PM, Kirk Kosinski  wrote:

> I (vaguely) recall seeing something like this.  I think you aren't
> supposed to install the CSP on hosts in a basic zone without SG.  Some
> but not all iptables get programmed for some reason, and it doesn't
> work.  I would check if it works on a host without CSP.  It definitely
> isn't needed in such a configuration anyway.
> 
> Best regards,
> Kirk
> 
> On 09/10/2014 10:26 PM, Jayapal Reddy Uradi wrote:
>> Hi,
>> 
>> iptables rules are configured on the host that means CSP is there.
>> 
>> The setup is basic shared network with out security groups but there are
>> SG rules configured for the VM in the host and there is no ingress/egress 
>> rules config option.
>> Not sure about with out SG configuring rules for VM is a bug.
>> 
>> Thanks,
>> Jayapal
>> 
>> 
>> On 11-Sep-2014, at 10:27 AM, Kirk Kosinski 
>> wrote:
>> 
>>> Hi, Carlos.  Did you install the CSP on your XS hosts?  Also is Open
>>> vSwitch enabled or disabled?
>>> 
>>> Best regards,
>>> Kirk
>>> 
>>> On 09/10/2014 02:55 PM, Carlos Reategui wrote:
 Hi All,
 This is a problem I have had for a while and worked around but would like
 to get a proper solution for.   I have configured a basic shared network
 without security groups.  The hosts are Xen 6.0.2.  I am currently on 4.3
 but had this problem previously on 4.1.x and 4.2.x also.
 
 The problem is that the iptables firewall is not getting configured
 properly on the hosts and therefore I am unable to connect to any of the
 VM's on that particular host.  My current solution is to have a crontab
 every 5 minutes issue an "/etc/init.d/iptables stop".  The reason I have to
 have it on a cron is that every time I create a new instance, the
 cloudstack management server also sends a command to configure the firewall
 which also turns it back on  (I guess I could also put an exit near the top
 of the iptables script but that is still a workaround).  My network
 offering does not have security groups so, as expected, I don't have a
 means to edit ingress/egress rules.
 
 Has anyone else run into this?  Is this a bug or something that I have not
 properly configured?
 
 Here is the output of the firewall on one of the hosts after creating a new
 instance:
 # iptables -L -n
 Chain INPUT (policy ACCEPT)
 target prot opt source   destination
 
 Chain FORWARD (policy ACCEPT)
 target prot opt source   destination
 BRIDGE-FIREWALL  all  --  0.0.0.0/00.0.0.0/0   PHYSDEV
 match --physdev-is-bridged
 ACCEPT all  --  0.0.0.0/00.0.0.0/0   PHYSDEV match
 --physdev-out eth2+ --physdev-is-bridged
 ACCEPT all  --  0.0.0.0/00.0.0.0/0   PHYSDEV match
 --physdev-out eth6+ --physdev-is-bridged
 ACCEPT all  --  0.0.0.0/00.0.0.0/0   PHYSDEV match
 --physdev-out eth5+ --physdev-is-bridged
 ACCEPT all  --  0.0.0.0/00.0.0.0/0   PHYSDEV match
 --physdev-out eth7+ --physdev-is-bridged
 ACCEPT all  --  0.0.0.0/00.0.0.0/0   PHYSDEV match
 --physdev-out eth3+ --physdev-is-bridged
 ACCEPT all  --  0.0.0.0/00.0.0.0/0   PHYSDEV match
 --physdev-out eth1+ --physdev-is-bridged
 ACCEPT all  --  0.0.0.0/00.0.0.0/0   PHYSDEV match
 --physdev-out eth4+ --physdev-is-bridged
 ACCEPT all  --  0.0.0.0/00.0.0.0/0   PHYSDEV match
 --physdev-out bond0+ --physdev-is-bridged
 ACCEPT all  --  0.0.0.0/00.0.0.0/0   PHYSDEV match
 --physdev-out eth0+ --physdev-is-bridged
 ACCEPT all  --  0.0.0.0/00.0.0.0/0   PHYSDEV match
 --physdev-out bond1+ --physdev-is-bridged
 DROP   all  --  0.0.0.0/00.0.0.0/0
 
 Chain OUTPUT (policy ACCEPT)
 target prot opt source   destination
 
 Chain BRIDGE-DEFAULT-FIREWALL (1 references)
 target prot opt source   destination
 ACCEPT all  --  0.0.0.0/00.0.0.0/0   state
 RELATED,ESTABLISHED
 ACCEPT udp  --  0.0.0.0/00.0.0.0/0   PHYSDEV match
 --physdev-is-bridged udp spt:68 dpt:67
 ACCEPT udp  --  0.0.0.0/00.0.0.0/0   PHYSDEV match
 --physdev-is-bridged udp spt:67 dpt:68
 
 Chain BRIDGE-FIREWALL (1 references)
 target prot opt source   destination
 BRIDGE-DEFAULT-FIREWALL  all  --  0.0.0.0/00.0.0.0/0
 i-3-93-def  all  --  0.0.0.0/00.0.0.0/0   PHYSDEV match
 --physdev-in vif20.0 --physdev-is-bridged
 i-3-9

Re: Strange UI 8080/client/

[Carlos Reátegui]

You should not be start/stopping tomcat. Only cloudstack-management. It will 
take care of dealing with tomcat. 

> On Sep 9, 2014, at 3:41 AM, Piers  wrote:
> 
>> On 09/09/14 19:42, Rohit Yadav wrote:
>> Piers, what you shared is not helpful, first check that the management 
>> server is able to communicate with the MySQL server and there is not much 
>> latency between these two servers.
> 
> All of the services are on the same server - it is a test implementation.
> 
>> For users, I recommend using the 4.3.0 release for now and avoid using 4.4.0 
>> release.
> 
> One of the key things to me as a user is having dependencies managed by 
> yum/rpm which means that when I follow the documented CentOS install I end up 
> with 4.4
> 
> I apologise for not being helpful but as a new user there is much to learn 
> and if I (or others) encounter undocumented experiences then we are blind to 
> our understanding of the software being is grounded or not.
> 
> Thanks for taking the time to respond.
> 
> P
> 

Re: CloudStack MS wont start post db outage

[Carlos Reátegui]

What error are you seeing in the logs?

On Aug 25, 2014, at 9:04 PM, ilya musayev  wrote:

> Nope, thats not the case :(
> On 8/25/14, 3:16 PM, Carlos Reátegui wrote:
>> Here’s a shot in the dark….
>> Any chance there are duplicate entries in the mshost table for your MS?
>> 
>> On Aug 25, 2014, at 1:50 PM, ilya musayev  
>> wrote:
>> 
>>> I'm experiencing an issue with bringing up one of 2 management hosts due to 
>>> db outage.
>>> 
>>> Sample layout:
>>> Host A - had running MS
>>> Host B - MS was down due to maintenance
>>> Host C - dedicated database host
>>> 
>>> The database outage occurred on host C and cloudstack ms gracefully stopped 
>>> it self. As a result, i'm not able to bring up the Host A, but i could 
>>> start MS on Host B.
>>> 
>>> IIRC, there was something cloudstack was doing to replay the uncommitted 
>>> transactions or possible kept some cached files that prevent Host A from 
>>> starting.
>>> 
>>> Would anyone know where it may be and what can be purged from the Host A to 
>>> bring it up?
>>> 
>>> Thanks
>>> ilya
>>> 
> 

Re: CloudStack MS wont start post db outage

[Carlos Reátegui]

Here’s a shot in the dark….
Any chance there are duplicate entries in the mshost table for your MS?

On Aug 25, 2014, at 1:50 PM, ilya musayev  wrote:

> I'm experiencing an issue with bringing up one of 2 management hosts due to 
> db outage.
> 
> Sample layout:
> Host A - had running MS
> Host B - MS was down due to maintenance
> Host C - dedicated database host
> 
> The database outage occurred on host C and cloudstack ms gracefully stopped 
> it self. As a result, i'm not able to bring up the Host A, but i could start 
> MS on Host B.
> 
> IIRC, there was something cloudstack was doing to replay the uncommitted 
> transactions or possible kept some cached files that prevent Host A from 
> starting.
> 
> Would anyone know where it may be and what can be purged from the Host A to 
> bring it up?
> 
> Thanks
> ilya
> 

Re: KVM cloudstack createnewvm

[Carlos Reátegui]

I’m not familiar with KVM, but on XenServer with NFS shared storage what I see 
is the following which may explain what you are seeing.

When I first use a template it is copied over from secondary to primary and the 
root disk for my new instance is created as a differencing VHD pointing to the 
template copy as the parent.  All other instances that use that same template 
will simply create new child VHD files pointing to the original parent VHD.

Assuming qcow2 files in CS with KVM are used in the same way, I think this may 
explain what you are seeing.

With VHDs I can use the vhd-util command to scan files and see the parent child 
relationships.  With qcow2 files give "qemu-img info" a try to see if it will 
give you similar info on the files in your primary store.

Cheers,
-Carlos

On Aug 18, 2014, at 6:14 PM, Ivan Rodriguez  wrote:

> Hi there,
> 
> 
> One of our templates in secondary storage needs some minor changes,
> I was able to track down the path from the secondary storage getting the
> reference from
> vm_template (unique_name)
> 
> 
> Then look for the template id on the properties
> 
> find . -name "*.properties" -exec grep -il
> "2d1f46882-755a-3239-a9b8-019eca89e86b" {} \;
> 
> I believe I have the right qcow2 image when I open it up with guestfish
> I can see that is actually my template so I do my changes save the image
> then provision a new vm from that template and my changues are not there so
> I'm wondering if cloudstack is copying the template from secondary storage
> into primary storage for fast provisioning.
> 
> 
> Later on I bump into the script createvm.sh which is basically using
> qemu-img to create the new root disk I've been checking this process and I
> can't figure out who is actually provisioning the new root disk.
> 
> I don't think is the secondary storage since it doesn't look like its
> mounting primary storage, and also on the compute hypervisor side
> it doesn't look like its mounting the secondary storage to copy the
> template.
> 
> Any advise will be really appreciate it.
> 
> Also is there a place where internal process for cloudstack are explained ?
> or you gotta jump in the source code and try to figure it out ?
> 
> Pd. I know I can destroy the template and upload it again with the changes
> but it would be nice if I can understand the cloudstack process.
> 
> 
> Thanks in advance
> Ivan

Re: Disk performance

[Carlos Reátegui]

Ilya,
Isn’t the network throttling for the guest/public network?  How does it affect 
the primary storage network?


On Aug 18, 2014, at 3:17 PM, ilya musayev  wrote:

> As someone probably already mentioned, check if throttle enabled/set in 
> global settings as well as under network offering.
> 
> Regards
> ilya
> 
> On 8/18/14, 1:01 PM, Carlos Reátegui wrote:
>> You sure VR is traversed for nfs traffic?  In my setup the NAS subnet is 
>> completely separate from any that CS uses.  The hosts know about it but none 
>> of the system vms know about it.
>> 
>> In my setup I am using shared network so the VR is not involved in network 
>> traffic.
>> 
>> One of my setups:
>> NAS (ubuntu nfs, HW raid10 with ssd cache) connected with 10Gbe on a subnet 
>> that CS does not know about other than the ip to the NFS server.
>> XenServer Hosts: 4 x 1Gbe for primary storage, 4x1 Gbe for CloudStack (e.g. 
>> guest, management, secondary storage)
>> 
>> Using bonnie++ I am seeing ~135Mbps read ~109Mbps write from an ubuntu 12.04 
>> vm.
>> 
>> 
>> On Aug 18, 2014, at 10:20 AM, Jeff Crystal  wrote:
>> 
>>> Management server: HP Proliant ML350 G5 18GB RAM dual quad-core 2.0Ghz 
>>> server
>>> SAN: HP Proliant ML350 G6 28GB RAM dual quad-core 2.66Ghz server running 
>>> Open-e DSS v7 lite
>>> Virtual Hosts (2 identical servers)
>>> HP Proliant ML 350 G5 24GB RAM 2.66Ghz dual Quad-core with (4) gigabit nics
>>> Public, Guest, Storage, and Management networks are all assigned dedicated 
>>> nics (cloudbr0-3)
>>> 
>>> Using NFS I'm getting 6-7Mbps write and 45-50Mbps read speeds with this 
>>> setup.
>>> 
>>> Using Microsoft software iSCSI from a Windows Vm running in this 
>>> environment and attached to the same SAN, I get 13-14Mbps read/write 
>>> speeds.  (Access to the SAN traverses the virtual router.  I'm not sure if 
>>> this is affecting the speed or not.)
>>> 
>>> From: Carlos Reátegui [mailto:create...@gmail.com]
>>> Sent: Monday, August 18, 2014 1:07 PM
>>> To: users@cloudstack.apache.org
>>> Subject: Re: Disk performance
>>> 
>>> What is your network setup?
>>> 
>>> 
>>> On Aug 18, 2014, at 10:04 AM, Jeff Crystal 
>>> <mailto:jcrys...@idsi4it.com%3e> wrote:
>>> 
>>>> No, I need a shared storage solution. I'm wondering what others are using 
>>>> in place of NFS. OCFS2? GFS2? GlusterFS? I tried setting up CLVM, but it 
>>>> seems very problematic (server won't shut down without manual intervention 
>>>> to leave the cluster, server won't join the cluster on boot without manual 
>>>> commands. Not very enterprisey!) I'll have to give Ceph a look...
>>>> 
>>>> -Original Message-
>>>> From: Ahmad Emneina [mailto:aemne...@gmail.com]
>>>> Sent: Monday, August 18, 2014 11:52 AM
>>>> To: Cloudstack users mailing list
>>>> Subject: Re: Disk performance
>>>> 
>>>> local storage is probably your most performant storage type... you dont 
>>>> get the awesome of HA or easy volume recovery, but if all youre after is 
>>>> performance. Thats the one.
>>>> 
>>>> 
>>>> On Mon, Aug 18, 2014 at 8:47 AM, Randy Smith 
>>>> <mailto:rbsm...@adams.edu%3e> wrote:
>>>> 
>>>>> Jeff,
>>>>> 
>>>>> I'm a big fan of ceph for clustered storage for block devices.
>>>>> 
>>>>> Beyond that, there are a bunch of crazy things you can do to tune NFS
>>>>> but it's rarely worth it.
>>>>> 
>>>>> 
>>>>> On Mon, Aug 18, 2014 at 9:10 AM, Jeff Crystal 
>>>>> <mailto:jcrys...@idsi4it.com%3e>
>>>>> wrote:
>>>>> 
>>>>>> Anyone have any suggestions for improving disk performance with
>>>>>> Cloudstack and KVM? Using NFS is pretty craptastic, even with
>>>>>> dedicated network adapters and switches for storage traffic.
>>>>>> 
>>>>>> 
>>>>>> 
>>>>>> 
>>>>>> 
>>>>>> [image: JCrystal Signature2013-1]
>>>>>> 
>>>>>> 
>>>>>> 
>>>>> 
>>>>> 
>>>>> --
>>>>> Randall Smith
>>>>> Computing Services
>>>>> Adams State University
>>>>> http://www.adams.edu/
>>>>> 719-587-7741
>>>>> 
>>> 
>>> 
> 

Re: Disk performance

[Carlos Reátegui]

You sure VR is traversed for nfs traffic?  In my setup the NAS subnet is 
completely separate from any that CS uses.  The hosts know about it but none of 
the system vms know about it. 

In my setup I am using shared network so the VR is not involved in network 
traffic.

One of my setups:
NAS (ubuntu nfs, HW raid10 with ssd cache) connected with 10Gbe on a subnet 
that CS does not know about other than the ip to the NFS server.
XenServer Hosts: 4 x 1Gbe for primary storage, 4x1 Gbe for CloudStack (e.g. 
guest, management, secondary storage)

Using bonnie++ I am seeing ~135Mbps read ~109Mbps write from an ubuntu 12.04 vm.


On Aug 18, 2014, at 10:20 AM, Jeff Crystal  wrote:

> Management server: HP Proliant ML350 G5 18GB RAM dual quad-core 2.0Ghz server
> SAN: HP Proliant ML350 G6 28GB RAM dual quad-core 2.66Ghz server running 
> Open-e DSS v7 lite
> Virtual Hosts (2 identical servers)
> HP Proliant ML 350 G5 24GB RAM 2.66Ghz dual Quad-core with (4) gigabit nics
> Public, Guest, Storage, and Management networks are all assigned dedicated 
> nics (cloudbr0-3)
> 
> Using NFS I'm getting 6-7Mbps write and 45-50Mbps read speeds with this setup.
> 
> Using Microsoft software iSCSI from a Windows Vm running in this environment 
> and attached to the same SAN, I get 13-14Mbps read/write speeds.  (Access to 
> the SAN traverses the virtual router.  I'm not sure if this is affecting the 
> speed or not.)
> 
> From: Carlos Reátegui [mailto:create...@gmail.com]
> Sent: Monday, August 18, 2014 1:07 PM
> To: users@cloudstack.apache.org
> Subject: Re: Disk performance
> 
> What is your network setup?
> 
> 
> On Aug 18, 2014, at 10:04 AM, Jeff Crystal 
> <mailto:jcrys...@idsi4it.com%3e> wrote:
> 
>> No, I need a shared storage solution. I'm wondering what others are using in 
>> place of NFS. OCFS2? GFS2? GlusterFS? I tried setting up CLVM, but it seems 
>> very problematic (server won't shut down without manual intervention to 
>> leave the cluster, server won't join the cluster on boot without manual 
>> commands. Not very enterprisey!) I'll have to give Ceph a look...
>> 
>> -Original Message-
>> From: Ahmad Emneina [mailto:aemne...@gmail.com]
>> Sent: Monday, August 18, 2014 11:52 AM
>> To: Cloudstack users mailing list
>> Subject: Re: Disk performance
>> 
>> local storage is probably your most performant storage type... you dont get 
>> the awesome of HA or easy volume recovery, but if all youre after is 
>> performance. Thats the one.
>> 
>> 
>> On Mon, Aug 18, 2014 at 8:47 AM, Randy Smith 
>> <mailto:rbsm...@adams.edu%3e> wrote:
>> 
>>> Jeff,
>>> 
>>> I'm a big fan of ceph for clustered storage for block devices.
>>> 
>>> Beyond that, there are a bunch of crazy things you can do to tune NFS
>>> but it's rarely worth it.
>>> 
>>> 
>>> On Mon, Aug 18, 2014 at 9:10 AM, Jeff Crystal 
>>> <mailto:jcrys...@idsi4it.com%3e>
>>> wrote:
>>> 
>>>> Anyone have any suggestions for improving disk performance with
>>>> Cloudstack and KVM? Using NFS is pretty craptastic, even with
>>>> dedicated network adapters and switches for storage traffic.
>>>> 
>>>> 
>>>> 
>>>> 
>>>> 
>>>> [image: JCrystal Signature2013-1]
>>>> 
>>>> 
>>>> 
>>> 
>>> 
>>> 
>>> --
>>> Randall Smith
>>> Computing Services
>>> Adams State University
>>> http://www.adams.edu/
>>> 719-587-7741
>>> 
> 
> 
> 

Re: Disk performance

[Carlos Reátegui]

What is your network setup?  


On Aug 18, 2014, at 10:04 AM, Jeff Crystal  wrote:

> No, I need a shared storage solution.  I'm wondering what others are using in 
> place of NFS.  OCFS2?  GFS2? GlusterFS?  I tried setting up CLVM, but it 
> seems very problematic (server won't shut down without manual intervention to 
> leave the cluster, server won't join the cluster on boot without manual 
> commands.  Not very enterprisey!)  I'll have to give Ceph a look...
> 
> -Original Message-
> From: Ahmad Emneina [mailto:aemne...@gmail.com] 
> Sent: Monday, August 18, 2014 11:52 AM
> To: Cloudstack users mailing list
> Subject: Re: Disk performance
> 
> local storage is probably your most performant storage type... you dont get 
> the awesome of HA or easy volume recovery, but if all youre after is 
> performance. Thats the one.
> 
> 
> On Mon, Aug 18, 2014 at 8:47 AM, Randy Smith  wrote:
> 
>> Jeff,
>> 
>> I'm a big fan of ceph for clustered storage for block devices.
>> 
>> Beyond that, there are a bunch of crazy things you can do to tune NFS 
>> but it's rarely worth it.
>> 
>> 
>> On Mon, Aug 18, 2014 at 9:10 AM, Jeff Crystal 
>> wrote:
>> 
>>> Anyone have any suggestions for improving disk performance with 
>>> Cloudstack and KVM?  Using NFS is pretty craptastic, even with 
>>> dedicated network adapters and switches for storage traffic.
>>> 
>>> 
>>> 
>>> 
>>> 
>>> [image: JCrystal Signature2013-1]
>>> 
>>> 
>>> 
>> 
>> 
>> 
>> --
>> Randall Smith
>> Computing Services
>> Adams State University
>> http://www.adams.edu/
>> 719-587-7741
>> 

Re: Import instances from previous deployment

[Carlos Reátegui]

On Aug 11, 2014, at 6:23 PM, Nitin Mehta  wrote:

> This is superb Carlos.
thank you
> So you created dummy vms to create records in CS db
> and then changed the volume path to reflect the old vhds.
Exactly.

> Yes, I think it should be fine to delete the dummy vids created with the
> new instance.
Thanks for the confirmation.  I was concerned that there is a uuid in the 
volume table and I was not sure how or if that was used in the system.
> 
> Thanks,
> -Nitin
> 
> On 11/08/14 5:49 PM, "Carlos Reategui"  wrote:
> 
>> Hi Nitin,
>> I created a new primary store share in NFS for the new deployment and
>> removed the old one from exports.  The XS hosts where re-used and
>> installed
>> fresh so nothing was using the old primary store.  The new CS deployment
>> only knows about the new primary store.
>> 
>> I used 'vhd-util scan -f -p -v -m old/path/*.vhd' to check the chain of
>> vhd
>> and copied over all the ones I needed from the old path to the new path.
>> I
>> got the old paths from by db backup.
>> 
>> Yes I changed the path in the volumes table to point to the 'old' vhd
>> file.
>> I stopped the instances from CS before editing the db. When I started
>> them my old instances were back.
>> 
>> It was only 10 instances any more and I probably would have scripted
>> it.
>> 
>> The vhd files that were created with the new instances are still there on
>> the primary store and I am guessing I should be ok to delete them.
>> 
>> Thanks,
>> Carlos
>> 
>> PS. I did run into a problem with the primary store scan/cleanup process
>> the first time I tried where it cleaned up the parent of one of the child
>> vhd before I had a chance to copy the child over.  I stopped management
>> server and included all the files in the same copy command which seemed to
>> get me past that.
>> 
>> 
>> On Mon, Aug 11, 2014 at 5:30 PM, Nitin Mehta 
>> wrote:
>> 
>>> Carlos - This looks fine to me. Have a couple of questions though
>>> So you reintroduced the old storage pool back on the new MS instance -
>>> make sure the old instances are shutdown and do not access the same
>>> storage else they can corrupt the volumes ?
>>> Did you mean that you changed the path in the volumes table ?
>>> 
>>> Thanks,
>>> -Nitin
>>> 
>>> On 11/08/14 11:56 AM, "Carlos Reategui"  wrote:
>>> 
 Hi All,
 Follow-up on my recovery process.  After failing to upgrade to 4.4 I
>>> did a
 fresh install and decided to go ahead and also do fresh installs of
 XenServer to upgrade those to XS6.2.
 
 Instead of importing each of the vhd from all my instances as templates
 and
 creating instances from those, I created new instances matching the the
 previous ones and then edited the volumes table with the vhd of the
 original instance from the previous deployment (had to make sure to
 include
 parent vhd).  My volumes were all on shared NFS storage.
 
 Things appear to be working ok, but want to check if any of you foresee
 any
 issues with the method I followed.
 
 thanks,
 Carlos
>>> 
>>> 
> 

Re: Could use a little help

[Carlos Reátegui]

Usually the log entries just before the exception provide some hints as to what 
may have happened



On Aug 8, 2014, at 7:40 PM, Xerex Bueno  wrote:

> We have just installed ACS 4.4 on Vmware running Nexus 1000v.  It creates the 
> zone but has issues starting the system Vms.  Can someone take a look at the 
> log below and give me your best guess as to what is going wrong please.
> 
> java.lang.NumberFormatException: null
> at java.lang.Integer.parseInt(Integer.java:454)
> at java.lang.Integer.parseInt(Integer.java:527)
> at 
> com.cloud.hypervisor.vmware.mo.HypervisorHostHelper.prepareNetwork(HypervisorHostHelper.java:484)
> at 
> com.cloud.hypervisor.vmware.resource.VmwareResource.prepareNetworkFromNicInfo(VmwareResource.java:2351)
> at 
> com.cloud.hypervisor.vmware.resource.VmwareResource.execute(VmwareResource.java:1607)
> at 
> com.cloud.hypervisor.vmware.resource.VmwareResource.executeRequest(VmwareResource.java:449)
> at 
> com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:216)
> at 
> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
> at 
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
> at 
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
> at 
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
> at 
> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at 
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
> at 
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
> at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> 2014-08-08 21:20:44,999 DEBUG [c.c.a.m.DirectAgentAttache] 
> (DirectAgent-11:ctx-da7b943b) Seq 1-6699385920690323610: Cancelling because 
> one of the answers is false and it is stop on error.
> 2014-08-08 21:20:44,999 DEBUG [c.c.a.m.DirectAgentAttache] 
> (DirectAgent-11:ctx-da7b943b) Seq 1-6699385920690323610: Response Received: 
> 2014-08-08 21:20:45,000 DEBUG [c.c.a.t.Request] (DirectAgent-11:ctx-da7b943b) 
> Seq 1-6699385920690323610: Processing:  { Ans: , MgmtId: 345052286326, via: 
> 1, Ver: v1, Flags: 10, 
> [{"com.cloud.agent.api.StartAnswer":{"vm":{"id":6,"name":"v-6-VM","bootloader":"HVM","type":"ConsoleProxy","cpus":1,"minSpeed":500,"maxSpeed":500,"minRam":1073741824,"maxRam":1073741824,"hostName":"v-6-VM","arch":"x86_64","os":"Debian
>  GNU/Linux 5.0 (64-bit)","platformEmulator":"debian5Guest","bootArgs":" 
> template=domP type=consoleproxy host=10.10.1.12 port=8250 name=v-6-VM zone=1 
> pod=1 guid=Proxy.6 proxy_vm=6 disable_rp_filter=true eth2ip=96.38.39.84 
> eth2mask=255.255.255.0 gateway=96.38.39.81 eth0ip=0.0.0.0 eth0mask=0.0.0.0 
> eth1ip=10.100.1.171 eth1mask=255.255.255.0 mgmtcidr=10.10.1.0/24 
> localgw=10.100.1.1 internaldns1=10.10.1.10 dns1=8.8.8.8 
> dns2=4.2.2.2","rebootOnCrash":false,"enableHA":false,"limitCpuUse":false,"enableDynamicallyScaleVm":false,"vncPassword":"df11bf739d02f384","params":{"nicAdapter":"E1000","vmware.reserve.cpu":"false","vmware.reserve.mem":"false"},"uuid":"42f0c842-ccdd-47bd-a6e3-9edb35ddd0ea","disks":[{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"6b0fce07-bff8-4523-aec4-4fdcf2186f5e","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"62160fe2-b9e5-4357-b4ef-987626f26a56","id":1,"poolType":"LVM","host":"10.100.1.12","path":"datastore-16","port":0,"url":"LVM://10.100.1.12/datastore-16/?ROLE=Primary&STOREUUID=62160fe2-b9e5-4357-b4ef-987626f26a56"}},"name":"ROOT-6","size":0,"path":"ROOT-6-01","volumeId":6,"vmName":"v-6-VM","accountId":1,"format":"OVA","id":6,"deviceId":0,"hypervisorType":"VMware"}},"diskSeq":0,"path":"ROOT-6-01","type":"ROOT","_details":{"managed":"false","storagePort":"0","storageHost":"10.100.1.12","volumeSize":"0"}}],"nics":[{"deviceId":2,"networkRateMbps":-1,"defaultNic":true,"uuid":"a9c80c9c-bac3-4357-b0dd-34db97f4f0e4","ip":"96.38.39.84","netmask":"255.255.255.0","gateway":"96.38.39.81","mac":"06:79:04:00:00:65","dns1":"8.8.8.8","dns2":"4.2.2.2","broadcastType":"Vlan","type":"Public","broadcastUri":"vlan://999","isolationUri":"vlan://999","isSecurityGroupEnabled":false,"name":"n1kv-eth-2,,nexusdvs"},{"deviceId":0,"networkRateMbps":-1,"defaultNic":false,"uuid":"4612129e-c57f-4ebb-9b34-d1bb882cbea5","mac":"02:00:33:39:00:06","broadcastType":"LinkLocal","type":"Control","isSecurityGroupEnabled":false

Re: FreeBSD

[Carlos Reátegui]

On Aug 8, 2014, at 12:40 PM, Shanker Balan  wrote:

> Hi Mo,
> 
> comments inline.
> 
> On 09-Aug-2014, at 12:04 am, mo mailto:m...@daoenix.com>> 
> wrote:
> 
> Shanker,
> 
> The issue I encountered, was of course user error. I did not realize, I only 
> had to utilize the boot-only FreeBSD ISO. After reviewing your update, I 
> replicated it & was able to easily boot into FreeBSD 64-bit, so this issue is 
> resolved.
> 
> Glad to hear its fixed. Please remember to rebuild kernel with XENHVM for 
> better performance.
> 
> 
> Thanks to everyone who assisted with this, I do have a question; how easily 
> is it to remove system template of CentOS 5.5. As I would not at all utilize 
> this, but is this a change in the database? Or?
> 
> I think you would need to do it via the DB. But I suggest you leave it there 
> as its a known good template
> to test when you run into issues.
> 

Just edit the template from the UI and uncheck the public box and it won’t show 
up for your users.  On the the admin.

> 
> 
> - Mo
> 
> 
> On August 8, 2014 at 7:45:08 AM, Shanker Balan 
> (shanker.ba...@shapeblue.com) wrote:
> 
> Hi Mo,
> 
> Comments inline...
> 
> On 07-Aug-2014, at 9:27 pm, mo 
> mailto:m...@daoenix.com>> wrote:
> 
> I am using Cloudstack 4.4 | FreeBSD 9.3, however, choosing other 64-bit and 
> installing the 64-bit of FreeBSD 10 or 9.3 hangs at boot.
> 
> FreeBSD 9 32bit ad 64bit are also working locally for me. See 
> http://imgur.com/OSvXVpX,RcHuF26#0 and
> http://imgur.com/OSvXVpX,RcHuF26#1.
> 
> Environment: ACS 4.3
> XenServer 6.2
> OS Type: Other 32bit and Other 64bit
> ISO Used: FreeBSD-9.3-RELEASE-amd64-bootonly.iso and 
> FreeBSD-9.3-RELEASE-i386-bootonly.iso
> 
> For optimum performance, you could use XENHVM also.
> 
> http://svnweb.freebsd.org/base/stable/9/sys/amd64/conf/XENHVM?view=markup
> http://svnweb.freebsd.org/base/stable/9/sys/i386/conf/XENHVM?view=markup
> 
> --
> @shankerbalan
> 
> M: +91 98860 60539 | O: +91 (80) 67935867
> shanker.ba...@shapeblue.com
>  | 
> www.shapeblue.com>
>  | Twitter:@shapeblue
> ShapeBlue Services India LLP, 22nd floor, Unit 2201A, World Trade Centre, 
> Bangalore - 560 055
> 
> Find out more about ShapeBlue and our range of CloudStack related services
> 
> IaaS Cloud Design & Build
> CSForge - rapid IaaS deployment framework
> CloudStack Consulting
> CloudStack Infrastructure 
> Support
> CloudStack Bootcamp Training 
> Courses
> 
> This email and any attachments to it may be confidential and are intended 
> solely for the use of the individual to whom it is addressed. Any views or 
> opinions expressed are solely those of the author and do not necessarily 
> represent those of Shape Blue Ltd or related companies. If you are not the 
> intended recipient of this email, you must neither take any action based upon 
> its contents, nor copy or show it to anyone. Please contact the sender if you 
> believe you have received this email in error. Shape Blue Ltd is a company 
> incorporated in England & Wales. ShapeBlue Services India LLP is a company 
> incorporated in India and is operated under license from Shape Blue Ltd. 
> Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
> operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company 
> registered by The Republic of South Africa and is traded under license from 
> Shape Blue Ltd. ShapeBlue is a registered trademark.
> 
> --
> @shankerbalan
> 
> M: +91 98860 60539 | O: +91 (80) 67935867
> shanker.ba...@shapeblue.com | 
> www.shapeblue.com | Twitter:@shapeblue
> ShapeBlue Services India LLP, 22nd floor, Unit 2201A, World Trade Centre, 
> Bangalore - 560 055
> 
> Find out more about ShapeBlue and our range of CloudStack related services
> 
> IaaS Cloud Design & Build
> CSForge - rapid IaaS deployment framework
> CloudStack Consulting
> CloudStack Infrastructure 
> Support
> CloudStack Bootcamp Training 
> Courses
> 
> This email and any attachments to it may be confidential and are intended 
> solely for the use of the individual to whom it is addressed. Any views or 
> opinions expressed are solely those of the author and do not necessarily 
> represent those of Shape Blue Ltd or related companies. If you are not the 
> intended recipient of this em

4.4 install observations

[Carlos Reátegui]

Hi All
I just did a new install of 4.4 on Ubuntu 12.04 with XenServer 6.2 using:

$ cat /etc/apt/sources.list.d/cloudstack.list 
deb http://cloudstack.apt-get.eu/ubuntu precise 4.4

This is a basic networking deployment with no security groups 
(defaultGuestNetwork).

1) I seeded the templates with:
$ 
/usr/share/cloudstack-common/scripts/storage/secondary/cloud-install-sys-tmplt 
-m /mnt/secondary -u 
http://cloudstack.apt-get.eu/systemvm/4.4/systemvm64template-4.4.0-6-xen.vhd.bz2
 -h xenserver -F

The above template is the one put into into the secondary tmpl/1/1, however the 
DB does not reflect this download source (see sql below).  Although the 
template is correct, something about this mechanism that goes out of band to 
seed the template does not feel right.  Why not have the management server 
process be the one to download the template and place it on the secondary 
storage?  The initial entry can be part of the sql scripts so no need for the 
install template script. This would also make the upgrade process simpler so 
that one does not have to add the new template before shutting down the 
management process, an entry could be made by the upgrade sql.

$ mysql -ucloud -p cloud -e "select url from template_view where id=1;"
Enter password: 
+--+
| url   
   |
+--+
| 
http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2
 |
+--+

2) XenServer 6.2 hosts do not get vhd-util deployed to them.  I assume it is 
because default vhd-util in 6.2 has appropriate functions.  Install doc should 
state this.

2a) As an aside, I believe doc has the wrong location to put vhd-util for the 
other XenServer versions. It should be placed here:  
/usr/share/cloudstack-management/webapps/client/WEB-INF/classes/scripts/vm/hypervisor/xenserver

3) bridge networking is required to add hosts for basic networking even if not 
using security groups otherwise will fail.  It is my understanding that ova is 
ok without SG but this is not possible as you can’t add hosts with ova.

4) optional IP address in "Step 6 Network" of the launch instance does not 
appear to work or is misleading.  I hoped it would allow me to request an IP 
from my range but I am guessing it is for something else and does not apply to 
my offering type.  Is it possible to disable this screen so my users are not 
confused?


Otherwise things apear to be working correctly.  I’ll report back if I run into 
anything.

Cheers,
-Carlos

Re: awsapi vs ec2stack

[Carlos Reátegui]

On Aug 1, 2014, at 7:39 AM, Sebastien Goasguen  wrote:

> 
> On Jul 31, 2014, at 11:51 PM, Carlos Reátegui  wrote:
> 
>> Anyone out there using or have experience either/both of these that can 
>> comment on pros and cons?
>> 
>> Previously I was unsuccessful at getting awsapi working on 4.1 and only just 
>> today found out about ec2stack.  I was going to give it another try now that 
>> I am on 4.4 on one of my setups and was wondering if anyone had any 
>> comments/thoughts on these two options.
>> 
>> thanks,
>> Carlos
> 
> Carlos,
> 
> I was part of the project that wrote ec2stack with Darren and Ian in cc.
> 
> ec2stack is a python application using Flask micro framework to expose the 
> ec2 query API. It is uncoupled from cloudstack and can run on the mgt server 
> or even on your local machine.
> You might want to check this short tutorial: http://codac.co/ec2/README.html
> 
> The github page also has docs:
> https://github.com/BroganD1993/ec2stack
> https://github.com/BroganD1993/ec2stack/wiki/User-Guide
> 
> It is mostly aimed at supporting basic zones, but also has support for VPC 
> since 3 weeks ago.
> 
> IMHO it is easier to maintain/extend and a much smaller code footprint. Right 
> now it is not an official cloudstack release even though Darren, Ian and I 
> are part of cloudstack community. We might put it under ASF governance if 
> there is interest in it.
> 
> Awsapi has you know is strongly tied to cloudstack and the app comes bundled 
> in the source and in the package repo. It is java based and built dynamically 
> from the AWS wsdl. other than that since it's Java I don't know much about 
> it. My personal opinion is that very people in the community know about its 
> internals and it has proven difficult to maintain plus package properly. So I 
> prefer ec2stack mostly because I know how it's written and that it is 
> decoupled from cloudstack.
> 
> Would be great to have you try ec2stack and give us some feedback, either on 
> this list or on the github page.

I’ll give it a try next week and report back.  Thanks!
> 
> Cheers,
> 
> -Sebastien
> 

awsapi vs ec2stack

[Carlos Reátegui]

Anyone out there using or have experience either/both of these that can comment 
on pros and cons?

Previously I was unsuccessful at getting awsapi working on 4.1 and only just 
today found out about ec2stack.  I was going to give it another try now that I 
am on 4.4 on one of my setups and was wondering if anyone had any 
comments/thoughts on these two options.

thanks,
Carlos

Re: VR will not start after upgrade from 4.1.1 to 4.3

[Carlos Reátegui]

That didn’t work.

I have resorted my db to 4.1.1 as well we XenServer metadata and re-installed 
CS 4.1.1.

The system starts up but VR won’t start now with the following:
Catch Exception: class com.xensource.xenapi.Types$UuidInvalid due to The uuid 
you supplied was invalid.

My understanding is that this is because CS and XS are out of sync.  Any 
thoughts on getting them back in sync?

Thanks,
Carlos

On Jul 26, 2014, at 12:45 PM, Andrei Mikhailovsky  wrote:

> Carlos, 
> 
> usually, when you delete a VR and do the corresponding network restart using 
> the Clean up option, ACS will create a new VR from the systemvm template. 
> 
> So, give it a go and see if it works. 
> 
> Andrei 
> 
> -- 
> Andrei Mikhailovsky 
> Director 
> Arhont Information Security 
> 
> Web: http://www.arhont.com 
> http://www.wi-foo.com 
> Tel: +44 (0)870 4431337 
> Fax: +44 (0)208 429 3111 
> PGP: Key ID - 0x2B3438DE 
> PGP: Server - keyserver.pgp.com 
> 
> DISCLAIMER 
> 
> The information contained in this email is intended only for the use of the 
> person(s) to whom it is addressed and may be confidential or contain legally 
> privileged information. If you are not the intended recipient you are hereby 
> notified that any perusal, use, distribution, copying or disclosure is 
> strictly prohibited. If you have received this email in error please 
> immediately advise us by return email at and...@arhont.com and delete and 
> purge the email and any attachments without making a copy. 
> 
> 
> - Original Message -
> 
> From: "Carlos Reátegui"  
> To: d...@cloudstack.apache.org 
> Sent: Saturday, 26 July, 2014 8:16:19 PM 
> Subject: Re: VR will not start after upgrade from 4.1.1 to 4.3 
> 
> I already destroyed it once and that didn’t do it. I guess I can try again 
> unless you mean something else. 
> 
> 
> On Jul 26, 2014, at 12:13 PM, Marcus  wrote: 
> 
>> Can you just delete the router and let it create a new one? 
>> On Jul 26, 2014 12:44 PM, "Carlos Reátegui"  wrote: 
>> 
>>> Making some progress. I mounted the VR root and verified that it is 
>>> indeed version 4.3. 
>>> 
>>> I decided to stop the MS service before it killed the VR so that I could 
>>> manually try the command. 
>>> 
>>> And the problem is the id_rsa.cloud key. So how do I find the correct key 
>>> and put it on the xenhosts? 
>>> 
>>> I tried using the one from 
>>> /usr/share/cloudstack-common/scripts/vm/systemvm/id_rsa.cloud but it did 
>>> not work. 
>>> 
>>> thanks, 
>>> _Carlos 
>>> 
>>> On Jul 26, 2014, at 9:44 AM, Carlos Reátegui  wrote: 
>>> 
>>>> Adding dev list 
>>>> 
>>>> Thanks Andrei, although not what I wanted to hear. 
>>>> 
>>>> I decided to try upgrading to 4.4 in hopes the results would be 
>>> different. Unfortunately not. 
>>>> 
>>>> So here is what is happening. I did the upgrade from 4.1.1 with 
>>> everything completely stopped. I had previously registered the new 4.3 svm 
>>> template which should work for both 4.3 and 4.4. 
>>>> 
>>>> The problem is that the VR needs to be upgraded, but it can’t since it 
>>> is stopped. But starting it also fails because it does not respond 
>>> correctly to /opt/cloud/bin/router_proxy.sh get_template_version.sh. 
>>>> 
>>>> So looks like I have 2 options. 
>>>> - 1) Go back to 4.1.1 and make sure the VR is running before attempting 
>>> the upgrade to 4.3/4 
>>>> - 2) Mount the VR VHD and try to fix GetDomRVersionCmd so that the VR 
>>> starts and I am then able to upgrade it from the UI (since 
>>> cloudstack-sysvmadm does not work on ubuntu — CLOUDSTACK-4778) 
>>>> 
>>>> Any thoughts on #2? 
>>>> 
>>>> thanks, 
>>>> Carlos 
>>>> 
>>>> 
>>>> 
>>>> On Jul 26, 2014, at 4:31 AM, Andrei Mikhailovsky  
>>> wrote: 
>>>> 
>>>>> I had a similar problem with upgrading to 4.3. My cpvm and ssvm would 
>>> start fine, but I was not able to create new VRs. Most of my existing VRs 
>>> would actually start, but no new VRs would get created. So, I was not able 
>>> to create new networks and not able to restart existing networks with the 
>>> clean up option. 
>>>>> 
>>>>> No one was able to help me fix the issue, so I ended up moving back to 
>>> 4.2.1. After the downgrade the problem went away. 
>>>>> 

Re: VR will not start after upgrade from 4.1.1 to 4.3

[Carlos Reátegui]

Making some progress.  I mounted the VR root and verified that it is indeed 
version 4.3.

I decided to stop the MS service before it killed the VR so that I could 
manually try the command.

And the problem is the id_rsa.cloud key.  So how do I find the correct key and 
put it on the xenhosts?

I tried using the one from 
/usr/share/cloudstack-common/scripts/vm/systemvm/id_rsa.cloud  but it did not 
work.

thanks,
_Carlos

On Jul 26, 2014, at 9:44 AM, Carlos Reátegui  wrote:

> Adding dev list
> 
> Thanks Andrei, although not what I wanted to hear.
> 
> I decided to try upgrading to 4.4 in hopes the results would be different.  
> Unfortunately not.
> 
> So here is what is happening.  I did the upgrade from 4.1.1 with everything 
> completely stopped.  I had previously registered the new 4.3 svm template 
> which should work for both 4.3 and 4.4.
> 
> The problem is that the VR needs to be upgraded, but it can’t since it is 
> stopped.  But starting it also fails because it does not respond correctly to 
> /opt/cloud/bin/router_proxy.sh get_template_version.sh.  
> 
> So looks like I have 2 options. 
> - 1) Go back to 4.1.1 and make sure the VR is running before attempting the 
> upgrade to 4.3/4
> - 2) Mount the VR VHD and try to fix GetDomRVersionCmd so that the VR starts 
> and I am then able to upgrade it from the UI (since cloudstack-sysvmadm does 
> not work on ubuntu — CLOUDSTACK-4778)
> 
> Any thoughts on #2?
> 
> thanks,
> Carlos
> 
> 
> 
> On Jul 26, 2014, at 4:31 AM, Andrei Mikhailovsky  wrote:
> 
>> I had a similar problem with upgrading to 4.3. My cpvm and ssvm would start 
>> fine, but I was not able to create new VRs. Most of my existing VRs would 
>> actually start, but no new VRs would get created. So, I was not able to 
>> create new networks and not able to restart existing networks with the clean 
>> up option. 
>> 
>> No one was able to help me fix the issue, so I ended up moving back to 
>> 4.2.1. After the downgrade the problem went away. 
>> 
>> I do hope these problems would be fixed in 4.3.1. 
>> 
>> Cheers 
>> 
>> -- 
>> Andrei Mikhailovsky 
>> Director 
>> Arhont Information Security 
>> 
>> Web: http://www.arhont.com 
>> http://www.wi-foo.com 
>> Tel: +44 (0)870 4431337 
>> Fax: +44 (0)208 429 3111 
>> PGP: Key ID - 0x2B3438DE 
>> PGP: Server - keyserver.pgp.com 
>> 
>> DISCLAIMER 
>> 
>> The information contained in this email is intended only for the use of the 
>> person(s) to whom it is addressed and may be confidential or contain legally 
>> privileged information. If you are not the intended recipient you are hereby 
>> notified that any perusal, use, distribution, copying or disclosure is 
>> strictly prohibited. If you have received this email in error please 
>> immediately advise us by return email at and...@arhont.com and delete and 
>> purge the email and any attachments without making a copy. 
>> 
>> 
>> - Original Message -
>> 
>> From: "Carlos Reátegui"  
>> To: "CloudStack-Users"  
>> Sent: Saturday, 26 July, 2014 6:49:34 AM 
>> Subject: VR will not start after upgrade from 4.1.1 to 4.3 
>> 
>> I have tried destroying the VR and restarting it but it won’t go. The SSVM 
>> and Console VM are up. 
>> 
>> The MS does not like the response it is getting from the VR but I am not 
>> sure how to fix. 
>> 
>> Here is the template info: 
>> mysql> select name, display_text,url,guest_os_name,hypervisor_type,state 
>> from template_view where display_text='systemvm-xenserver-4.3'; 
>> +++--++-+---+
>>  
>> | name | display_text | url | guest_os_name | hypervisor_type | state | 
>> +++--++-+---+
>>  
>> | systemvm-xenserver-4.3 | systemvm-xenserver-4.3 | 
>> http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2
>>  | Debian GNU/Linux 6(64-bit) | XenServer | Ready | 
>> +++--++-+---+
>>  
>> 
>> 
>> Here are the relevant logs: 
>> 
>> 2014-07-26 10:49:05,137 DEBU

Re: VR will not start after upgrade from 4.1.1 to 4.3

[Carlos Reátegui]

Adding dev list

Thanks Andrei, although not what I wanted to hear.

I decided to try upgrading to 4.4 in hopes the results would be different.  
Unfortunately not.

So here is what is happening.  I did the upgrade from 4.1.1 with everything 
completely stopped.  I had previously registered the new 4.3 svm template which 
should work for both 4.3 and 4.4.

The problem is that the VR needs to be upgraded, but it can’t since it is 
stopped.  But starting it also fails because it does not respond correctly to 
/opt/cloud/bin/router_proxy.sh get_template_version.sh.  

So looks like I have 2 options. 
- 1) Go back to 4.1.1 and make sure the VR is running before attempting the 
upgrade to 4.3/4
- 2) Mount the VR VHD and try to fix GetDomRVersionCmd so that the VR starts 
and I am then able to upgrade it from the UI (since cloudstack-sysvmadm does 
not work on ubuntu — CLOUDSTACK-4778)

Any thoughts on #2?

thanks,
Carlos



On Jul 26, 2014, at 4:31 AM, Andrei Mikhailovsky  wrote:

> I had a similar problem with upgrading to 4.3. My cpvm and ssvm would start 
> fine, but I was not able to create new VRs. Most of my existing VRs would 
> actually start, but no new VRs would get created. So, I was not able to 
> create new networks and not able to restart existing networks with the clean 
> up option. 
> 
> No one was able to help me fix the issue, so I ended up moving back to 4.2.1. 
> After the downgrade the problem went away. 
> 
> I do hope these problems would be fixed in 4.3.1. 
> 
> Cheers 
> 
> -- 
> Andrei Mikhailovsky 
> Director 
> Arhont Information Security 
> 
> Web: http://www.arhont.com 
> http://www.wi-foo.com 
> Tel: +44 (0)870 4431337 
> Fax: +44 (0)208 429 3111 
> PGP: Key ID - 0x2B3438DE 
> PGP: Server - keyserver.pgp.com 
> 
> DISCLAIMER 
> 
> The information contained in this email is intended only for the use of the 
> person(s) to whom it is addressed and may be confidential or contain legally 
> privileged information. If you are not the intended recipient you are hereby 
> notified that any perusal, use, distribution, copying or disclosure is 
> strictly prohibited. If you have received this email in error please 
> immediately advise us by return email at and...@arhont.com and delete and 
> purge the email and any attachments without making a copy. 
> 
> 
> - Original Message -
> 
> From: "Carlos Reátegui"  
> To: "CloudStack-Users"  
> Sent: Saturday, 26 July, 2014 6:49:34 AM 
> Subject: VR will not start after upgrade from 4.1.1 to 4.3 
> 
> I have tried destroying the VR and restarting it but it won’t go. The SSVM 
> and Console VM are up. 
> 
> The MS does not like the response it is getting from the VR but I am not sure 
> how to fix. 
> 
> Here is the template info: 
> mysql> select name, display_text,url,guest_os_name,hypervisor_type,state from 
> template_view where display_text='systemvm-xenserver-4.3'; 
> +++--++-+---+
>  
> | name | display_text | url | guest_os_name | hypervisor_type | state | 
> +++--++-+---+
>  
> | systemvm-xenserver-4.3 | systemvm-xenserver-4.3 | 
> http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2
>  | Debian GNU/Linux 6(64-bit) | XenServer | Ready | 
> +++--++-+---+
>  
> 
> 
> Here are the relevant logs: 
> 
> 2014-07-26 10:49:05,137 DEBUG [c.c.h.x.r.CitrixResourceBase] 
> (DirectAgent-467:ctx-6cb72049) Trying to connect to 169.254.2.69 attempt 2 of 
> 100 
> 2014-07-26 10:49:05,460 DEBUG [c.c.a.ApiServlet] 
> (catalina-exec-25:ctx-b6b6006f) ===START=== 10.110.3.50 -- GET 
> command=queryAsyncJobResult&jobId=0cfb6b86-dc2e-4040-a06e-f080aee83a15&response=json&sessionkey=TziV%2FqqSUFAO1eiR6bCbh0lq%2FDc%3D&_=1406351949321
>  
> 2014-07-26 10:49:05,480 DEBUG [c.c.a.ApiServlet] 
> (catalina-exec-25:ctx-b6b6006f ctx-782d64ad) ===END=== 10.110.3.50 -- GET 
> command=queryAsyncJobResult&jobId=0cfb6b86-dc2e-4040-a06e-f080aee83a15&response=json&sessionkey=TziV%2FqqSUFAO1eiR6bCbh0lq%2FDc%3D&_=1406351949321
>  
> 2014-07-26 10:49:07,414 DEBUG [c.c.h.x.r.CitrixResourceBase] 
> (DirectAgent-467:ctx-6cb72049) Ping command port succeeded for vm r-98-VM 
> 2014-07-26 10:49:08,113 

VR will not start after upgrade from 4.1.1 to 4.3

[Carlos Reátegui]

I have tried destroying the VR and restarting it but it won’t go.  The SSVM and 
Console VM are up.

The MS does not like the response it is getting from the VR but I am not sure 
how to fix.

Here is the template info:
mysql> select name, display_text,url,guest_os_name,hypervisor_type,state from 
template_view where display_text='systemvm-xenserver-4.3';
+++--++-+---+
| name   | display_text   | url 
 | guest_os_name
  | hypervisor_type | state |
+++--++-+---+
| systemvm-xenserver-4.3 | systemvm-xenserver-4.3 | 
http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2
 | Debian GNU/Linux 6(64-bit) | XenServer   | Ready |
+++--++-+---+


Here are the relevant logs: 

2014-07-26 10:49:05,137 DEBUG [c.c.h.x.r.CitrixResourceBase] 
(DirectAgent-467:ctx-6cb72049) Trying to connect to 169.254.2.69 attempt 2 of 
100
2014-07-26 10:49:05,460 DEBUG [c.c.a.ApiServlet] 
(catalina-exec-25:ctx-b6b6006f) ===START===  10.110.3.50 -- GET  
command=queryAsyncJobResult&jobId=0cfb6b86-dc2e-4040-a06e-f080aee83a15&response=json&sessionkey=TziV%2FqqSUFAO1eiR6bCbh0lq%2FDc%3D&_=1406351949321
2014-07-26 10:49:05,480 DEBUG [c.c.a.ApiServlet] (catalina-exec-25:ctx-b6b6006f 
ctx-782d64ad) ===END===  10.110.3.50 -- GET  
command=queryAsyncJobResult&jobId=0cfb6b86-dc2e-4040-a06e-f080aee83a15&response=json&sessionkey=TziV%2FqqSUFAO1eiR6bCbh0lq%2FDc%3D&_=1406351949321
2014-07-26 10:49:07,414 DEBUG [c.c.h.x.r.CitrixResourceBase] 
(DirectAgent-467:ctx-6cb72049) Ping command port succeeded for vm r-98-VM
2014-07-26 10:49:08,113 DEBUG [c.c.a.m.DirectAgentAttache] 
(DirectAgent-467:ctx-6cb72049) Seq 3-1423704582: Cancelling because one of the 
answers is false and it is stop on error.
2014-07-26 10:49:08,114 DEBUG [c.c.a.m.DirectAgentAttache] 
(DirectAgent-467:ctx-6cb72049) Seq 3-1423704582: Response Received: 
2014-07-26 10:49:08,116 DEBUG [c.c.a.t.Request] (DirectAgent-467:ctx-6cb72049) 
Seq 3-1423704582: Processing:  { Ans: , MgmtId: 159090355471825, via: 3, Ver: 
v1, Flags: 10, 
[{"com.cloud.agent.api.StartAnswer":{"vm":{"id":98,"name":"r-98-VM","bootloader":"PyGrub","type":"DomainRouter","cpus":1,"minSpeed":500,"maxSpeed":500,"minRam":134217728,"maxRam":134217728,"arch":"x86_64","os":"Debian
 GNU/Linux 6(64-bit)","bootArgs":" template=domP name=r-98-VM 
eth0ip=10.120.60.219 eth0mask=255.255.255.0 gateway=10.120.60.254 
domain=cs1cloud.internal dhcprange=10.120.60.1 eth1ip=169.254.2.69 
eth1mask=255.255.0.0 type=dhcpsrvr disable_rp_filter=true dns1=8.8.8.8 
dns2=202.56.230.6","rebootOnCrash":false,"enableHA":true,"limitCpuUse":false,"enableDynamicallyScaleVm":false,"vncPassword":"72af77840162bb9e","params":{},"uuid":"a1197b63-760e-4c5c-86d2-401cfd3ac3b4","disks":[{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"b5b1a6cb-165e-4f7f-97a6-00011a5c7061","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"db74fb7a-1647-3599-b751-57658758d8d1","id":206,"poolType":"NetworkFilesystem","host":"192.168.200.1","path":"/export/primary","port":2049,"url":"NetworkFilesystem://192.168.200.1//export/primary/?ROLE=Primary&STOREUUID=db74fb7a-1647-3599-b751-57658758d8d1"}},"name":"ROOT-98","size":262144,"path":"213c90cc-09a7-46e7-80c9-d96dc11afa64","volumeId":160,"vmName":"r-98-VM","accountId":1,"format":"VHD","id":160,"deviceId":0,"hypervisorType":"XenServer"}},"diskSeq":0,"path":"213c90cc-09a7-46e7-80c9-d96dc11afa64","type":"ROOT","_details":{"managed":"false","storagePort":"2049","storageHost":"192.168.200.1","volumeSize":"262144"}}],"nics":[{"deviceId":0,"networkRateMbps":200,"defaultNic":true,"uuid":"c78beb1c-8a23-43bc-b65f-ebca67b5fad4","ip":"10.120.60.219","netmask":"255.255.255.0","gateway":"10.120.60.254","mac":"06:3e:ca:00:00:3c","dns1":"8.8.8.8","dns2":"202.56.230.6","broadcastType":"Vlan","type":"Guest","broadcastUri":"vlan://untagged","isolationUri":"ec2://untagged","isSecurityGroupEnabled":false},{"deviceId":1,"networkRateMbps":-1,"defaultNic":false,"uuid":"42408069-20d3-4b7d-8722-c328a5f7018c","ip":"169.254.2.69","netmask":"255.255.0.0","gateway":"169.254.0.1","mac":"0e:00:a9:fe:02:45","broadcastType":"LinkLocal","type":"Control","isSecurityGroupEnabled":false}]},"_iqnToPath":{},"result":true,"wait":0}},{"com.cloud.agent.api.check.CheckSshAnswer":{"result":true,"wait":0}},{"com.cl

Moving SVM range

[Carlos Reátegui]

Feeling good about moving my basic network deployment from one subnet to 
another, I would now like to move the System VM ip range and expand the guest 
VM range.

I had been sharing the previous subnet with others and only had from .150 up 
through .249.  The new subnet is all mine.  As part of the re-IP I moved the 
hosts down to .30-.36.  Now I want to move the system VMs from .160-.174 to 
.50-.64 (BTW what is a good number of IPs to reserve for system VMs?).  After 
that I want to bring down the Guest VM IP start from .175 to .100 or so.

I was planning on stopping all instances and system VMs prior to shutting down 
the MS and making sure in XenCenter that they were destroyed.

My initial thought is to script iterating through each of the IPs in the 
current SVM range (i.e. .160-.180) and do a global replace with .50-.64.  This 
would take care of most tables like: host, host_pod_ref, nics, 
op_dc_ip_address_alloc, vm_instance.  Since I am not expanding/contracting this 
range of IPs it seems simple enough.

Then for the expansion of the Guest range seems like I need to edit vlan.  But 
then the tricky one appears to be the user_ip_address table.  Seems like it has 
pre-defined rows for all IPs and their current state (i.e. allocated or not).  
Will CS automatically fill this in for me if it notices a discrepancy with the 
range in vlan?  Do I need to create the missing entries myself?  Can I use 
uuidgen to generate uuids?  Can I insert the new ones after the existing ones 
(or should they all be in increasing ip values)?  If I put them in order I need 
to change the id but what about the mac_address column.  It looks like that 
value matches the last octet of the MAC in the nic table so I should probably 
leave the existing ones as is and that column won’t be ordered.  

any other thoughts? 

thanks,
Carlos

Re: Change IP subnet of cluster [SOLVED]

[Carlos Reátegui]

My system is back up and running. 

As I suspected in my second email the problem was related to the msid in the 
mshost table.  Upon bringing up my system a new mshost entry was being created 
for the same MS and for some reason it was unable to connect to my XenServer 
hosts.

I decided to go back to my edited sql with the new IPs and change the existing 
mshost entry to have the new msid value:

sed -i.bak4 's/159090355471823/159090355471825/g' cloudstack_cloud-newips.sql

I did a global replace since there are foreign key constraints on the msid that 
I saw in the host and async_job tables

After reloading this new sql and starting the MS everything is back to normal, 
but with a new subnet for my hosts and guests (this is a basic network).


Question for the Devs:

Lets say the machine my MS was running on crashed and I replaced it with a new 
machine.  Since the msid is derived from the MAC wouldn’t I have encountered 
this same problem and not been able to have the new machine connect to the 
hosts?  

thanks,
Carlos




On Jul 25, 2014, at 8:46 AM, Carlos Reátegui  wrote:

> Any thoughts out there?
> 
> It keeps trying to connect to the hosts but it is unable to and there are no 
> clues in the logs as to why.  I am successfully connected with XenCenter to 
> the pool and also am able to ssh to all the hosts from the MS.
> 
> What does “Disable Cluster” or “Unmanage Cluster” do?  Should I try that and 
> re-enable/manage?
> 
> From the UI, things appear ok but starting any instance fails.
> 
> Thanks,
> Carlos
> 
> Log snippet form this am:
> 
> 2014-07-25 21:03:19,599 DEBUG [agent.manager.ClusteredAgentAttache] 
> (StatsCollector-2:null) Seq 2-65931749: Forwarding null to 159090355471823
> 2014-07-25 21:03:19,599 DEBUG [agent.manager.ClusteredAgentAttache] 
> (AgentManager-Handler-13:null) Seq 2-65931749: Routing from 159090355471825
> 2014-07-25 21:03:19,599 DEBUG [agent.manager.ClusteredAgentAttache] 
> (AgentManager-Handler-13:null) Seq 2-65931749: Link is closed
> 2014-07-25 21:03:19,600 DEBUG [agent.manager.ClusteredAgentManagerImpl] 
> (AgentManager-Handler-13:null) Seq 2-65931749: MgmtId 159090355471825: Req: 
> Resource [Host:2] is
>  unreachable: Host 2: Link is closed
> 2014-07-25 21:03:19,600 DEBUG [agent.manager.ClusteredAgentManagerImpl] 
> (AgentManager-Handler-13:null) Seq 2--1: MgmtId 159090355471825: Req: Routing 
> to peer
> 2014-07-25 21:03:19,601 DEBUG [agent.manager.ClusteredAgentManagerImpl] 
> (AgentManager-Handler-14:null) Seq 2--1: MgmtId 159090355471825: Req: Cancel 
> request received
> 2014-07-25 21:03:19,601 DEBUG [agent.manager.AgentAttache] 
> (AgentManager-Handler-14:null) Seq 2-65931749: Cancelling.
> 2014-07-25 21:03:19,601 DEBUG [agent.manager.AgentAttache] 
> (StatsCollector-2:null) Seq 2-65931749: Waiting some more time because this 
> is the current command
> 2014-07-25 21:03:19,601 DEBUG [agent.manager.AgentAttache] 
> (StatsCollector-2:null) Seq 2-65931749: Waiting some more time because this 
> is the current command
> 2014-07-25 21:03:19,601 INFO  [utils.exception.CSExceptionErrorCode] 
> (StatsCollector-2:null) Could not find exception: 
> com.cloud.exception.OperationTimedoutException in
>  error code list for exceptions
> 2014-07-25 21:03:19,601 WARN  [agent.manager.AgentAttache] 
> (StatsCollector-2:null) Seq 2-65931749: Timed out on null
> 2014-07-25 21:03:19,601 DEBUG [agent.manager.AgentAttache] 
> (StatsCollector-2:null) Seq 2-65931749: Cancelling.
> 2014-07-25 21:03:19,601 WARN  [agent.manager.AgentManagerImpl] 
> (StatsCollector-2:null) Operation timed out: Commands 65931749 to Host 2 
> timed out after 3600
> 2014-07-25 21:03:19,601 WARN  [cloud.resource.ResourceManagerImpl] 
> (StatsCollector-2:null) Unable to obtain host 2 statistics. 
> 2014-07-25 21:03:19,601 WARN  [cloud.server.StatsCollector] 
> (StatsCollector-2:null) Received invalid host stats for host: 2
> 2014-07-25 21:03:19,606 DEBUG [agent.manager.ClusteredAgentAttache] 
> (StatsCollector-2:null) Seq 3-602278373: Forwarding null to 159090355471823
> 2014-07-25 21:03:19,607 DEBUG [agent.manager.ClusteredAgentAttache] 
> (AgentManager-Handler-15:null) Seq 3-602278373: Routing from 159090355471825
> 2014-07-25 21:03:19,607 DEBUG [agent.manager.ClusteredAgentAttache] 
> (AgentManager-Handler-15:null) Seq 3-602278373: Link is closed
> 2014-07-25 21:03:19,607 DEBUG [agent.manager.ClusteredAgentManagerImpl] 
> (AgentManager-Handler-15:null) Seq 3-602278373: MgmtId 159090355471825: Req: 
> Resource [Host:3] is unreachable: Host 3: Link is closed
> 2014-07-25 21:03:19,608 DEBUG [agent.manager.ClusteredAgentManagerImpl] 
> (AgentManager-Handler-15:null) Seq 3--1: MgmtId 159090355471825: Req: Routing 
> to peer
> 2014-07-25 21:03:19,608 DEBUG [agent.manager.ClusteredAgentManager

Re: Change IP subnet of cluster

[Carlos Reátegui]

 [agent.manager.ClusteredAgentAttache] 
(StatsCollector-2:null) Seq 5-1311574501: Forwarding null to 159090355471823
2014-07-25 21:03:19,617 DEBUG [agent.manager.ClusteredAgentAttache] 
(AgentManager-Handler-1:null) Seq 5-1311574501: Routing from 159090355471825
2014-07-25 21:03:19,617 DEBUG [agent.manager.ClusteredAgentAttache] 
(AgentManager-Handler-1:null) Seq 5-1311574501: Link is closed
2014-07-25 21:03:19,617 DEBUG [agent.manager.ClusteredAgentManagerImpl] 
(AgentManager-Handler-1:null) Seq 5-1311574501: MgmtId 159090355471825: Req: 
Resource [Host:5] is unreachable: Host 5: Link is closed



On Jul 24, 2014, at 10:59 PM, Carlos Reátegui  wrote:

> Not sure if it is related but I see 2 entries in the mshost for my same 
> server but with different msid.  Both show as ‘Up’.  In reading the table 
> comments it seems the msid is based on the MAC.  I am guessing this may be 
> due to using a bond and that it may be have selected a different NIC to get 
> the bond MAC from.  Is it ok to have both of these entries?  Should I mark 
> the old one as Down?
> 
> Along these lines is there something similar with the hosts and that is why 
> the MS is having problems connecting to them, ie. the MACs don’t match?
> 
> thanks,
> Carlos
> 
> 
> On Jul 24, 2014, at 3:35 PM, Carlos Reategui  wrote:
> 
>> Hi All,
>> 
>> Had to move one of my clusters to a new subnet but it is not working (e.g. 
>> 192.168.1.0/24 to 10.100.1.0/24).  These are the steps I took:
>> 
>> Environment: CS 4.1.1 on Ubuntu 12.04, XenServer 6.1, Shared NFS SR.
>> 
>> 1) stopped all instances using cloudstack UI
>> 2) stop cloudstack-management service on MS
>> 3) Used XenCenter to kill the system VMs (no other instances running)
>> 4) Created backup of cloud db.
>> 5) Followed http://support.citrix.com/article/CTX123477 and successfully 
>> changed the IP of hosts.  According to XenCenter everything is good 
>> including SR.
>> 6) Changed IP of MS
>> 7) verified communication between MS and Hosts using ssh and ping with new 
>> IPs.
>> 8) used sed to search and replace all old IPs with new IPs in cloud backup 
>> sql file (e.g. sed -i.bak 's/192.168.1./10.100.1./g' clouddb.sql).
>> 9) visually verified all diffs in the sql file and made sure no references 
>> to 192.168 left.
>> 10) loaded up new sql
>> 11) search all files under /etc on MS for old IP. found and edited: 
>> /etc/cloudstack/management/db.properties
>> 12) start cloudstack-management service on MS
>> 
>> Unfortunately things are not working.  The MS is apparently unable to 
>> connect to the hosts but I can not figure out why from the logs.
>> 
>> Logs here: https://www.dropbox.com/s/s5glxrbyatmsoug/management-server.log
>> 
>> Any help recovering is appreciated.  I do not want to have to re-install and 
>> create/import template for each of the instance VHDs.
>> 
>> thank you,
>> -Carlos
> 

Re: Change IP subnet of cluster

[Carlos Reátegui]

Not sure if it is related but I see 2 entries in the mshost for my same server 
but with different msid.  Both show as ‘Up’.  In reading the table comments it 
seems the msid is based on the MAC.  I am guessing this may be due to using a 
bond and that it may be have selected a different NIC to get the bond MAC from. 
 Is it ok to have both of these entries?  Should I mark the old one as Down?

Along these lines is there something similar with the hosts and that is why the 
MS is having problems connecting to them, ie. the MACs don’t match?

thanks,
Carlos


On Jul 24, 2014, at 3:35 PM, Carlos Reategui  wrote:

> Hi All,
> 
> Had to move one of my clusters to a new subnet but it is not working (e.g. 
> 192.168.1.0/24 to 10.100.1.0/24).  These are the steps I took:
> 
> Environment: CS 4.1.1 on Ubuntu 12.04, XenServer 6.1, Shared NFS SR.
> 
> 1) stopped all instances using cloudstack UI
> 2) stop cloudstack-management service on MS
> 3) Used XenCenter to kill the system VMs (no other instances running)
> 4) Created backup of cloud db.
> 5) Followed http://support.citrix.com/article/CTX123477 and successfully 
> changed the IP of hosts.  According to XenCenter everything is good including 
> SR.
> 6) Changed IP of MS
> 7) verified communication between MS and Hosts using ssh and ping with new 
> IPs.
> 8) used sed to search and replace all old IPs with new IPs in cloud backup 
> sql file (e.g. sed -i.bak 's/192.168.1./10.100.1./g' clouddb.sql).
> 9) visually verified all diffs in the sql file and made sure no references to 
> 192.168 left.
> 10) loaded up new sql
> 11) search all files under /etc on MS for old IP. found and edited: 
> /etc/cloudstack/management/db.properties
> 12) start cloudstack-management service on MS
> 
> Unfortunately things are not working.  The MS is apparently unable to connect 
> to the hosts but I can not figure out why from the logs.
> 
> Logs here: https://www.dropbox.com/s/s5glxrbyatmsoug/management-server.log
> 
> Any help recovering is appreciated.  I do not want to have to re-install and 
> create/import template for each of the instance VHDs.
> 
> thank you,
> -Carlos

Re: 4.1.x -> 4.2.x major migration issue

[Carlos Reátegui]

What is your environment? i.e. what management server os and hypervisors are 
you using?


On Jul 7, 2014, at 6:42 PM, Nick Wales  wrote:

> I upgraded following the guide exactly.
> 
> https://cloudstack.apache.org/docs/en-US/Apache_CloudStack/4.2.1/html/Release_Notes/upgrade-instructions.html#upgrade-from-4.1-to-4.2.1
> 
> Everything went fine until running the script to restart the system VM's.
> 
> cloudstack-sysvmadm -u cloud -p  -a
> 
> 
> The console vm restarted but the agent stayed disconnected. The SSVM failed
> to restart, the VR restarted ok.
> 
> I couldn't work out why the agent wouldn't connect so decided to destroy
> console and SSVM's so they would come back happy as they usually do.
> 
> They didn't come back. Now my secondary storage is showing up as 0KB in
> size, and the system templates status is 'No space left on device'  so I
> can't start any new systemvm's.
> 
> I don't know where to begin to fix this, any ideas?

Re: recreate iptables rules on hosts

[Carlos Reátegui]

As in service network restart on the hosts or something in the cloudstack UI?

> On Jul 7, 2014, at 6:06 AM, Sanjeev Neelarapu  
> wrote:
> 
> Restart network might help you.
> 
> -Original Message-----
> From: Carlos Reátegui [mailto:create...@gmail.com] 
> Sent: Monday, July 07, 2014 12:05 PM
> To: CloudStack-Users
> Subject: recreate iptables rules on hosts
> 
> I just upgraded to 4.3 from 4.1.
> 
> On 4.1 I had disabled iptables on my XenServer hosts because I had had 
> problems accessing my instances.   Which now I believe was due to ipset not 
> working with the kernel I had (see my other threads on that if interested).
> 
> Now that I am on 4.3 (and with a properly working ipset in XenServer), it 
> looks like every time a new instance is created, iptables is getting started 
> and a new rule added to access the new instance (as expected).  However, all 
> my existing instances become unreachable because they do not have rules.  Is 
> there tool to have Cloudstack re-create all the rules for existing instances 
> on the hosts?
> 
> In case it matters I am using basic networking without security groups.
> 
> thanks,
> Carlos

recreate iptables rules on hosts

[Carlos Reátegui]

I just upgraded to 4.3 from 4.1.

On 4.1 I had disabled iptables on my XenServer hosts because I had had problems 
accessing my instances.   Which now I believe was due to ipset not working with 
the kernel I had (see my other threads on that if interested).

Now that I am on 4.3 (and with a properly working ipset in XenServer), it looks 
like every time a new instance is created, iptables is getting started and a 
new rule added to access the new instance (as expected).  However, all my 
existing instances become unreachable because they do not have rules.  Is there 
tool to have Cloudstack re-create all the rules for existing instances on the 
hosts?

In case it matters I am using basic networking without security groups.

thanks,
Carlos

Re: Realhostip.com Migration

[Carlos Reátegui]

Thank you.  I destroyed the console vm from the UI and when it came back this 
now works.

Would rebooting the CPVM have been enough?


On Jul 3, 2014, at 5:44 AM, Amogh Vasekar  wrote:

> You need to recreate the CPVM when you switch between HTTP and HTTPS so
> the ports get reconfigured correctly.
> 
> Thanks,
> Amogh
> 
> On 7/2/14 9:43 PM, "Carlos Reátegui"  wrote:
> 
>> 
>> 
>>> On Jul 2, 2014, at 9:38 PM, Amogh Vasekar 
>>> wrote:
>>> 
>>> Hi,
>>> 
>>> Can you please let us know the procedure followed?
>> I blanked the three parameters mentioned by Suresh and restarted MS.
>>> Also, are you still
>>> using 4.1 version?
>> 4.3
>>> To start with debugging, you can log into the CPVM (same process as
>>> SSVM)
>>> and check if the java HTTP server is up and listening to the correct
>>> port.
>> I'll try that and get back to you.
>>> 
>>> HTH
>>> Amogh
>> Thank you
>>> 
>>>> On 7/2/14 6:02 PM, "Carlos Reategui"  wrote:
>>>> 
>>>> On Thu, Jun 19, 2014 at 10:43 PM, Suresh Sadhu
>>>> 
>>>> wrote:
>>>> 
>>>>> Yes its enabled by default in 4.1 and support for http method is newly
>>>>> introduced in 4.3 .you can disable it after upgrade by clearing the
>>>>> values
>>>>> of 2 global config parameters.(make it empty)
>>>>> secstorage.ssl.cert.domain
>>>>> consoleproxy.url.domain
>>>>> 
>>>>> also change below setting from true to false
>>>>> 
>>>>> secstorage.encrypt.copy=false
>>>>> 
>>>>> 
>>>>> 
>>>>> -sadhu
>>>>> 
>>>>> Hi Sahdu,
>>>> 
>>>> I finally got around to this but it is not working for me.  I am
>>>> getting a
>>>> connection timeout.  What should I look for in determining the reason
>>>> the
>>>> console is not working?  Iptables is stopped on my hosts.
>>>> 
>>>> Here are my logs:
>>>> 2014-07-02 17:57:43,263 DEBUG [c.c.a.t.Request] (catalina-exec-13:null)
>>>> Seq
>>>> 2-1359609904: Sending  { Cmd , MgmtId: 233845174730255, via:
>>>> 2(srvengxen02), Ver: v1, Flags: 100011,
>>>> 
>>>> [{"com.cloud.agent.api.GetVncPortCommand":{"id":4,"name":"i-3-4-VM","wai
>>>> t"
>>>> :0}}]
>>>> }
>>>> 2014-07-02 17:57:43,263 DEBUG [c.c.a.t.Request] (catalina-exec-13:null)
>>>> Seq
>>>> 2-1359609904: Executing:  { Cmd , MgmtId: 233845174730255, via:
>>>> 2(srvengxen02), Ver: v1, Flags: 100011,
>>>> 
>>>> [{"com.cloud.agent.api.GetVncPortCommand":{"id":4,"name":"i-3-4-VM","wai
>>>> t"
>>>> :0}}]
>>>> }
>>>> 2014-07-02 17:57:43,264 DEBUG [c.c.a.m.DirectAgentAttache]
>>>> (DirectAgent-84:ctx-564e2527) Seq 2-1359609904: Executing request
>>>> 2014-07-02 17:57:43,481 DEBUG [c.c.a.m.DirectAgentAttache]
>>>> (DirectAgent-84:ctx-564e2527) Seq 2-1359609904: Response Received:
>>>> 2014-07-02 17:57:43,482 DEBUG [c.c.a.t.Request]
>>>> (DirectAgent-84:ctx-564e2527) Seq 2-1359609904: Processing:  { Ans: ,
>>>> MgmtId: 233845174730255, via: 2, Ver: v1, Flags: 10,
>>>> [{"com.cloud.agent.api.GetVncPortAnswer":{"address":"consoleurl=
>>>> 
>>>> https://172.30.45.32/console?uuid=7be1ff7e-8b38-6818-1e29-ea99ff60f308&s
>>>> es
>>>> 
>>>> sionref=OpaqueRef:659841c7-ca0c-6955-f0a8-4c6308f0b646","port":-1,"resul
>>>> t"
>>>> :true,"wait":0}}]
>>>> }
>>>> 2014-07-02 17:57:43,482 DEBUG [c.c.a.t.Request] (catalina-exec-13:null)
>>>> Seq
>>>> 2-1359609904: Received:  { Ans: , MgmtId: 233845174730255, via: 2, Ver:
>>>> v1,
>>>> Flags: 10, { GetVncPortAnswer } }
>>>> 2014-07-02 17:57:43,482 DEBUG [c.c.s.ConsoleProxyServlet]
>>>> (catalina-exec-13:null) Port info consoleurl=
>>>> 
>>>> https://172.30.45.32/console?uuid=7be1ff7e-8b38-6818-1e29-ea99ff60f308&s
>>>> es
>>>> sionref=OpaqueRef:659841c7-ca0c-6955-f0a8-4c6308f0b646
>>>> 2014-07-02 17:57:43,482 INFO  [c.c.s.ConsoleProx

4.3 Error while collecting disk stats

[Carlos Reátegui]

I have upgraded to 4.3 and am see this error in the logs on a very regular 
basis.  

appears to be: https://issues.apache.org/jira/browse/CLOUDSTACK-5834

Any ideas on how to determine the VBD it is referring to?  I am wondering if I 
can mark it as deleted/inactive in the db.


2014-07-02 22:44:32,434 DEBUG [c.c.a.m.AgentManagerImpl] 
(AgentManager-Handler-15:null) SeqA 8-3981: Sending Seq 8-3981:  { Ans: , MgmtId
: 233845174730255, via: 8, Ver: v1, Flags: 100010, 
[{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2014-07-02 22:44:34,428 DEBUG [c.c.s.StatsCollector] 
(StatsCollector-2:ctx-e7021ad2) VmStatsCollector is running...
2014-07-02 22:44:34,464 DEBUG [c.c.a.m.DirectAgentAttache] 
(DirectAgent-215:ctx-09244596) Seq 1-1007289330: Executing request
2014-07-02 22:44:35,267 DEBUG [c.c.h.x.r.CitrixResourceBase] 
(DirectAgent-215:ctx-09244596) Vm cpu utilization 0.87875
2014-07-02 22:44:35,268 DEBUG [c.c.h.x.r.CitrixResourceBase] 
(DirectAgent-215:ctx-09244596) Vm cpu utilization 0.4
2014-07-02 22:44:35,268 DEBUG [c.c.h.x.r.CitrixResourceBase] 
(DirectAgent-215:ctx-09244596) Vm cpu utilization 0.11499
2014-07-02 22:44:35,268 DEBUG [c.c.h.x.r.CitrixResourceBase] 
(DirectAgent-215:ctx-09244596) Vm cpu utilization 0.145
2014-07-02 22:44:35,268 DEBUG [c.c.h.x.r.CitrixResourceBase] 
(DirectAgent-215:ctx-09244596) Vm cpu utilization 0.21
2014-07-02 22:44:35,268 DEBUG [c.c.h.x.r.CitrixResourceBase] 
(DirectAgent-215:ctx-09244596) Vm cpu utilization 0.13
2014-07-02 22:44:35,268 DEBUG [c.c.h.x.r.CitrixResourceBase] 
(DirectAgent-215:ctx-09244596) Vm cpu utilization 0.8
2014-07-02 22:44:35,268 DEBUG [c.c.h.x.r.CitrixResourceBase] 
(DirectAgent-215:ctx-09244596) Vm cpu utilization 0.25
2014-07-02 22:44:35,309 WARN  [c.c.h.x.r.CitrixResourceBase] 
(DirectAgent-215:ctx-09244596) Error while collecting disk stats from : 
You gave an invalid object reference.  The object may have recently been 
deleted.  The class parameter gives the type of reference given,
 and the handle parameter echoes the bad value given.
at com.xensource.xenapi.Types.checkResponse(Types.java:209)
at com.xensource.xenapi.Connection.dispatch(Connection.java:368)
at 
com.cloud.hypervisor.xen.resource.XenServerConnectionPool$XenServerConnection.dispatch(XenServerConnectionPool.java:909)
at com.xensource.xenapi.VBDMetrics.getIoReadKbs(VBDMetrics.java:210)
at 
com.cloud.hypervisor.xen.resource.CitrixResourceBase.getVmStats(CitrixResourceBase.java:2863)
at 
com.cloud.hypervisor.xen.resource.CitrixResourceBase.execute(CitrixResourceBase.java:2763)
at 
com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:493)
at 
com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:59)
at 
com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:216)
at 
org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
at 
org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at 
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at 
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at 
org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at 
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
at 
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:744)
2014-07-02 22:44:35,310 DEBUG [c.c.a.m.DirectAgentAttache] 
(DirectAgent-215:ctx-09244596) Seq 1-1007289330: Response Received: 
2014-07-02 22:44:35,311 DEBUG [c.c.a.t.Request] (StatsCollector-2:ctx-e7021ad2) 
Seq 1-1007289330: Received:  { Ans: , MgmtId: 23384517473
0255, via: 1, Ver: v1, Flags: 10, { GetVmStatsAnswer } }
2014-07-02 22:44:35,358 DEBUG [c.c.a.m.DirectAgentAttache] 
(DirectAgent-364:ctx-77c17ef2) Seq 2-1359610876: Executing request
2014-07-02 22:44:35,959 DEBUG [c.c.c.ConsoleProxyManagerImpl] 
(consoleproxy-1:ctx-b89b8193) Zone 1 is ready to launch console proxy
2014-07-02 22:44:36,002 DEBUG [c.c.h.x.r.CitrixResourceBase] 
(DirectAgent-364:ctx-77c17ef2) Vm cpu utilization 0.35003
2014-07-02 22:44:36,002 DEBUG [c.c.h.x.r.CitrixResourceBase] 
(DirectAgent-364:ctx-77c17ef2) Vm cpu utilization

Re: Cloudstack re-install/migrate

[Carlos Reátegui]

I have managed to do an upgrade to 4.3 and am reconsidering the path below.  

The docs say that the awsapi only works in a fresh install of ACS.  Is this 
correct?  Is there any way (I’m ok with editing the DB) to get it to work on an 
upgraded install?  Anyone done this?

thanks,
Carlos


On Jul 1, 2014, at 6:36 PM, Carlos Reategui  wrote:

> Given the issues I am having looks like my best option is going to be to 
> redeploy my Cloudstack install.  I am looking for best practices for 
> migrating an existing deployment.
> 
> My thoughts are to do the following:
> 1) shutdown all instances.  Luckily I only have 21 of them.
> 2) shutdown management server
> 3) backup primary storage, secondary storage, cloud db
> 4) export all disks (root and data
> - either copy the associated VHD (if no chains) or export using xencenter
> 5) Fresh install of XenServer 6.2 (part of my current prob is that current 
> 6.0.2 kernel is not supported by CSP)
> 6) Remove Cloudstack:
> - apt-get remove/purge
> - delete known file paths
> - remove cloud/could_usage dbs
> - clear secondary storage
> 7) Reinstall Cloudstack 4.3 (or 4.4)
> - re-create of offerings and users
> - configure AWS (this is also another reason to reinstall as the docs say I 
> can't get this with an upgrade)
> 8) Import each of my previous instance vhds as templates under correct user
> 9) create new instances (delete template after?) 
> 10) import data disks and attach those to instances.
> 
> Thoughts?  Has anyone else gone through this before?
> 
> thanks,
> Carlos

Re: 4.4 upgrade issues

[Carlos Reátegui]

An update on this.

I finally succeeded in getting my hosts out of alert state by reverting to an 
earlier version of the kernel (see other thread).  Unfortunately when it came 
up I realized I had installed the 4.3 systemvm template and not the 4.4 one so 
I just reverted to my 4.1.1 installation and did the upgrade to 4.3 which 
appears to work.  I am seeing some errors in the log which I’ll post to a 
separate thread.  I’ll wait to test 4.4 when it is released.

With regards to the db.properties file.  I looked into it in more detail and 
the problem was that the file had somehow gotten re-ordered in a random fashion 
which is why I could not make sense out of the diff during the install.  Not 
sure how that happened but my concern mentioned below is probably a non-issue.

regards,
-Carlos


On Jun 30, 2014, at 5:11 PM, Carlos Reátegui  wrote:

> I set encryption to none in db.properties and updated the passwords in 
> host_details to unencrypted versions so I could make progress. 
> 
> I don’t know what exactly the problem was but this is probably something that 
> needs better testing.  I’m pretty sure I had all the encryption stuff correct 
> in the db.properties file but could not get it to work.
> 
> It would be nice if there was a specialized merging utility for the 
> db.properties given the change in the organization of the file.  I am 
> guessing if the file had not been reorganized it would have been more obvious 
> how to merge the 2 and I may have avoided this issue. 
> 
> Now my hosts come up in an alert state and I’m not sure where to go from 
> here.  Please note I am not using bridge mode because I wanted to to a 4 nic 
> bridge which bridge does not allow (only 2 nics).  This was working fine in 
> 4.1 so hopefully this is not a requirement for 4.4.  I am not using security 
> groups which was my understanding is what requires bridge networking:
> 
> The error in the log is this:
> 2014-06-30 14:06:50,073 WARN  [c.c.h.x.r.CitrixResourceBase] 
> (DirectAgent-1:ctx-35941dc7) Failed to configure brige firewall
> 2014-06-30 14:06:50,073 WARN  [c.c.h.x.r.CitrixResourceBase] 
> (DirectAgent-1:ctx-35941dc7) Check host 172.30.45.32 for CSP is installed or 
> not and check network mode for bridge
> 2014-06-30 14:06:50,074 DEBUG [c.c.a.m.DirectAgentAttache] 
> (DirectAgent-1:ctx-35941dc7) Seq 2-6232418934327345153: Response Received: 
> 2014-06-30 14:06:50,075 DEBUG [c.c.a.t.Request] (DirectAgent-1:ctx-35941dc7) 
> Seq 2-6232418934327345153: Processing:  { Ans: , MgmtId: 233845174730253, 
> via: 2, Ver: v1, Flags: 110, [{"com.cloud.agent.api
> .SetupAnswer":{"_reconnect":true,"result":false,"details":"Failed to 
> configure brige firewall","wait":0}}] }
> 2014-06-30 14:06:50,075 DEBUG [c.c.a.t.Request] 
> (AgentTaskPool-2:ctx-b360d1bb) Seq 2-6232418934327345153: Received:  { Ans: , 
> MgmtId: 233845174730253, via: 2, Ver: v1, Flags: 110, { SetupAnswer } }
> 2014-06-30 14:06:50,076 DEBUG [c.c.a.m.AgentAttache] 
> (DirectAgent-1:ctx-35941dc7) Seq 2-6232418934327345153: No more commands found
> 2014-06-30 14:06:50,076 WARN  [c.c.h.x.d.XcpServerDiscoverer] 
> (AgentTaskPool-2:ctx-b360d1bb) Unable to setup agent 2 due to Failed to 
> configure brige firewall
> 2014-06-30 14:06:50,079 INFO  [c.c.u.e.CSExceptionErrorCode] 
> (AgentTaskPool-2:ctx-b360d1bb) Could not find exception: 
> com.cloud.exception.ConnectionException in error code list for exceptions
> 2014-06-30 14:06:50,079 WARN  [c.c.a.m.AgentManagerImpl] 
> (AgentTaskPool-2:ctx-b360d1bb) Monitor XcpServerDiscoverer says there is an 
> error in the connect process for 2 due to Reinitialize agent after se
> tup.
> 2014-06-30 14:06:50,079 INFO  [c.c.a.m.AgentManagerImpl] 
> (AgentTaskPool-2:ctx-b360d1bb) Host 2 is disconnecting with event 
> AgentDisconnected
> 2014-06-30 14:06:50,085 DEBUG [c.c.a.m.AgentManagerImpl] 
> (AgentTaskPool-2:ctx-b360d1bb) The next status of agent 2is Alert, current 
> status is Connecting
> 2014-06-30 14:06:50,085 DEBUG [c.c.a.m.AgentManagerImpl] 
> (AgentTaskPool-2:ctx-b360d1bb) Deregistering link for 2 with state Alert
> 2014-06-30 14:06:50,085 DEBUG [c.c.a.m.AgentManagerImpl] 
> (AgentTaskPool-2:ctx-b360d1bb) Remove Agent : 2
> 2014-06-30 14:06:50,085 DEBUG [c.c.a.m.DirectAgentAttache] 
> (AgentTaskPool-2:ctx-b360d1bb) Processing disconnect 2(srvengxen02)
> 2014-06-30 14:06:50,085 DEBUG [c.c.a.m.AgentManagerImpl] 
> (AgentTaskPool-2:ctx-b360d1bb) Sending Disconnect to listener: 
> com.cloud.hypervisor.xen.discoverer.XcpServerDiscoverer
> 2014-06-30 14:06:50,085 DEBUG [c.c.a.m.AgentManagerImpl] 
> (AgentTaskPool-2:ctx-b360d1bb) Sending Disconnect to listener: 
> com.cloud.hypervisor.hyperv.discoverer.HypervServerDiscoverer
> 2014-06-30 14:06:50,085 DEBUG [c.c

Re: Host in Alert state after upgrade

[Carlos Reátegui]

On Jul 2, 2014, at 9:31 PM, Jayapal Reddy Uradi  
wrote:

> Hi Carlos,
> 
> For the xen 5.6, 6.0 and 6.0.2 CSP packages are available.
> http://cloudstack.apache.org/docs/en-US/Apache_CloudStack/4.2.0/html/Installation_Guide/citrix-xenserver-installation.html#xenserver-support-pkg-installation
Yes that is where I got it from
> For xenserver 6.2, I think CSP comes by default.
Correct
> 
> After installing CSP, If you insert ipset modules manually, Is it not working 
> ?
It only installs the upset-modules into the 542 kernel.  If you mount the CSP 
iso you will see that is the only version that RPM exists for.

Are you suggesting I copy the modules from the 542 kernel to the 611 kernel?  
Would I then insmod or modprobe them?  I did not try that as I assumed they 
would have to be built for the specific kernel.  Either way shouldn’t this be 
documented?

# rpm -ql ipset-modules-xen-2.6.32.12-0.7.1.xs6.0.2.542.170665 
/lib/modules/2.6.32.12-0.7.1.xs6.0.2.542.170665xen
/lib/modules/2.6.32.12-0.7.1.xs6.0.2.542.170665xen/extra
/lib/modules/2.6.32.12-0.7.1.xs6.0.2.542.170665xen/extra/ipset
/lib/modules/2.6.32.12-0.7.1.xs6.0.2.542.170665xen/extra/ipset/ip_set.ko
/lib/modules/2.6.32.12-0.7.1.xs6.0.2.542.170665xen/extra/ipset/ip_set_iphash.ko
/lib/modules/2.6.32.12-0.7.1.xs6.0.2.542.170665xen/extra/ipset/ip_set_ipmap.ko
/lib/modules/2.6.32.12-0.7.1.xs6.0.2.542.170665xen/extra/ipset/ip_set_ipporthash.ko
/lib/modules/2.6.32.12-0.7.1.xs6.0.2.542.170665xen/extra/ipset/ip_set_ipportiphash.ko
/lib/modules/2.6.32.12-0.7.1.xs6.0.2.542.170665xen/extra/ipset/ip_set_ipportnethash.ko
/lib/modules/2.6.32.12-0.7.1.xs6.0.2.542.170665xen/extra/ipset/ip_set_iptree.ko
/lib/modules/2.6.32.12-0.7.1.xs6.0.2.542.170665xen/extra/ipset/ip_set_iptreemap.ko
/lib/modules/2.6.32.12-0.7.1.xs6.0.2.542.170665xen/extra/ipset/ip_set_macipmap.ko
/lib/modules/2.6.32.12-0.7.1.xs6.0.2.542.170665xen/extra/ipset/ip_set_nethash.ko
/lib/modules/2.6.32.12-0.7.1.xs6.0.2.542.170665xen/extra/ipset/ip_set_portmap.ko
/lib/modules/2.6.32.12-0.7.1.xs6.0.2.542.170665xen/extra/ipset/ip_set_setlist.ko
/lib/modules/2.6.32.12-0.7.1.xs6.0.2.542.170665xen/extra/ipset/ipt_SET.ko
/lib/modules/2.6.32.12-0.7.1.xs6.0.2.542.170665xen/extra/ipset/ipt_set.ko

# ll /lib/modules/
total 24
drwxr-xr-x 4 root root 4096 Apr 11  2013 2.6.32.12-0.7.1.xs6.0.2.542.170665kdump
drwxr-xr-x 4 root root 4096 Apr 11  2013 2.6.32.12-0.7.1.xs6.0.2.542.170665xen
drwxr-xr-x 4 root root 4096 Apr 29  2013 2.6.32.12-0.7.1.xs6.0.2.587.170693kdump
drwxr-xr-x 4 root root 4096 Apr 29  2013 2.6.32.12-0.7.1.xs6.0.2.587.170693xen
drwxr-xr-x 3 root root 4096 Jan 15 14:26 2.6.32.12-0.7.1.xs6.0.2.611.170703kdump
drwxr-xr-x 3 root root 4096 Jan 15 14:26 2.6.32.12-0.7.1.xs6.0.2.611.170703xen


> After installing CSP, did you try restarting host ?
Yes.  No luck.
> 
> Thanks,
> Jayapal
thanks
> 
> 
> On 03-Jul-2014, at 6:41 AM, Carlos Reategui  wrote:
> 
>> anybody?  I restarted my XS hosts with the fallback kernel and I was able
>> to proceed with the upgrade.  Servers are now out of alert state.
>> 
>> This seems like an issue that needs to be addressed in the docs.  How does
>> one go about getting the ipset-modules for the updated XenServer kernels?
>> 
>> 
>> On Tue, Jul 1, 2014 at 10:50 AM, Carlos Reategui 
>> wrote:
>> 
>>> So upset is part of the CSP.  I tried re-installing it but the kernel
>>> modules are not there for my current kernel version.
>>> 
>>> Here are the contents of the CSP:
>>> 
>>> mount -o loop xenserver-cloud-supp.iso /mnt/tmp
>>> # ll /mnt/tmp/
>>> total 1437
>>> -r--r--r-- 1 root root  31340 Jan 24  2012 arptables-0.0.3-4.i686.rpm
>>> -r--r--r-- 1 root root   3506 Jan 24  2012 csp-pack-6.0.2-53069p.noarch.rpm
>>> -r--r--r-- 1 root root  98961 Jan 24  2012
>>> ebtables-2.0.9-1.el5.1.xs.i386.rpm
>>> -r-xr-xr-x 1 root root   7163 Jan 24  2012 install.sh
>>> -r--r--r-- 1 root root  46791 Jan 24  2012 ipset-4.5-1.xs32.i686.rpm
>>> *-r--r--r-- 1 root root  47895 Jan 24  2012
>>> ipset-modules-kdump-2.6.32.12-0.7.1.xs6.0.2.542.170665-4.5-1.xs32.i686.rpm*
>>> *-r--r--r-- 1 root root  48020 Jan 24  2012
>>> ipset-modules-xen-2.6.32.12-0.7.1.xs6.0.2.542.170665-4.5-1.xs32.i686.rpm*
>>> -r--r--r-- 1 root root 247133 Jan 24  2012
>>> iptables-1.3.5-5.3.el5_4.1.1.xs32.i386.rpm
>>> -r--r--r-- 1 root root 719799 Jan 24  2012
>>> iptables-debuginfo-1.3.5-5.3.el5_4.1.1.xs32.i386.rpm
>>> -r--r--r-- 1 root root  49657 Jan 24  2012
>>> iptables-devel-1.3.5-5.3.el5_4.1.1.xs32.i386.rpm
>>> -r--r--r-- 1 root root 166044 Jan 24  2012
>>> iptables-ipv6-1.3.5-5.3.el5_4.1.1.xs32.i386.rpm
>>> -r--r--r-- 1 root root   1600 Jan 24  2012 XS-PACKAGES
>>> -r--r--r-- 1 root root262 Jan 24  2012 XS-REPOSITORY
>>> 
>>> How do I go about getting the required kernel modules for:
>>> # uname -a
>>> Linux srvengxen02 2.6.32.12-0.7.1.xs6.0.2.611.170703xen #1 SMP Mon Oct 21
>>> 11:21:50 EDT 2013 i686 i686 i386 GNU/Linux
>>> 
>>> How is this supposed to be handled in general when one applies XenServer
>>> kernel patches?
>>>

Re: Realhostip.com Migration

[Carlos Reátegui]

> On Jul 2, 2014, at 9:38 PM, Amogh Vasekar  wrote:
> 
> Hi,
> 
> Can you please let us know the procedure followed?
I blanked the three parameters mentioned by Suresh and restarted MS. 
> Also, are you still
> using 4.1 version?
4.3
> To start with debugging, you can log into the CPVM (same process as SSVM)
> and check if the java HTTP server is up and listening to the correct port.
I'll try that and get back to you.
> 
> HTH
> Amogh
Thank you
> 
>> On 7/2/14 6:02 PM, "Carlos Reategui"  wrote:
>> 
>> On Thu, Jun 19, 2014 at 10:43 PM, Suresh Sadhu 
>> wrote:
>> 
>>> Yes its enabled by default in 4.1 and support for http method is newly
>>> introduced in 4.3 .you can disable it after upgrade by clearing the
>>> values
>>> of 2 global config parameters.(make it empty)
>>> secstorage.ssl.cert.domain
>>> consoleproxy.url.domain
>>> 
>>> also change below setting from true to false
>>> 
>>> secstorage.encrypt.copy=false
>>> 
>>> 
>>> 
>>> -sadhu
>>> 
>>> Hi Sahdu,
>> 
>> I finally got around to this but it is not working for me.  I am getting a
>> connection timeout.  What should I look for in determining the reason the
>> console is not working?  Iptables is stopped on my hosts.
>> 
>> Here are my logs:
>> 2014-07-02 17:57:43,263 DEBUG [c.c.a.t.Request] (catalina-exec-13:null)
>> Seq
>> 2-1359609904: Sending  { Cmd , MgmtId: 233845174730255, via:
>> 2(srvengxen02), Ver: v1, Flags: 100011,
>> [{"com.cloud.agent.api.GetVncPortCommand":{"id":4,"name":"i-3-4-VM","wait"
>> :0}}]
>> }
>> 2014-07-02 17:57:43,263 DEBUG [c.c.a.t.Request] (catalina-exec-13:null)
>> Seq
>> 2-1359609904: Executing:  { Cmd , MgmtId: 233845174730255, via:
>> 2(srvengxen02), Ver: v1, Flags: 100011,
>> [{"com.cloud.agent.api.GetVncPortCommand":{"id":4,"name":"i-3-4-VM","wait"
>> :0}}]
>> }
>> 2014-07-02 17:57:43,264 DEBUG [c.c.a.m.DirectAgentAttache]
>> (DirectAgent-84:ctx-564e2527) Seq 2-1359609904: Executing request
>> 2014-07-02 17:57:43,481 DEBUG [c.c.a.m.DirectAgentAttache]
>> (DirectAgent-84:ctx-564e2527) Seq 2-1359609904: Response Received:
>> 2014-07-02 17:57:43,482 DEBUG [c.c.a.t.Request]
>> (DirectAgent-84:ctx-564e2527) Seq 2-1359609904: Processing:  { Ans: ,
>> MgmtId: 233845174730255, via: 2, Ver: v1, Flags: 10,
>> [{"com.cloud.agent.api.GetVncPortAnswer":{"address":"consoleurl=
>> https://172.30.45.32/console?uuid=7be1ff7e-8b38-6818-1e29-ea99ff60f308&ses
>> sionref=OpaqueRef:659841c7-ca0c-6955-f0a8-4c6308f0b646","port":-1,"result"
>> :true,"wait":0}}]
>> }
>> 2014-07-02 17:57:43,482 DEBUG [c.c.a.t.Request] (catalina-exec-13:null)
>> Seq
>> 2-1359609904: Received:  { Ans: , MgmtId: 233845174730255, via: 2, Ver:
>> v1,
>> Flags: 10, { GetVncPortAnswer } }
>> 2014-07-02 17:57:43,482 DEBUG [c.c.s.ConsoleProxyServlet]
>> (catalina-exec-13:null) Port info consoleurl=
>> https://172.30.45.32/console?uuid=7be1ff7e-8b38-6818-1e29-ea99ff60f308&ses
>> sionref=OpaqueRef:659841c7-ca0c-6955-f0a8-4c6308f0b646
>> 2014-07-02 17:57:43,482 INFO  [c.c.s.ConsoleProxyServlet]
>> (catalina-exec-13:null) Parse host info returned from executing
>> GetVNCPortCommand. host info: consoleurl=
>> https://172.30.45.32/console?uuid=7be1ff7e-8b38-6818-1e29-ea99ff60f308&ses
>> sionref=OpaqueRef:659841c7-ca0c-6955-f0a8-4c6308f0b646
>> 2014-07-02 17:57:43,488 DEBUG [c.c.s.ConsoleProxyServlet]
>> (catalina-exec-13:null) Compose console url:
>> http://172.30.45.104/ajax?token=QK4fjJqdcNofgiLB-bzWbSLYWY2Zt7nwDyDo_iQBcB
>> gg0f0VpUmt-vtEUnBloZY5KDik2PMN_W9L3KPDJ_Z2kBtsresT_gmNNpyWOxkp_v7NtTgdfG3S
>> 0Mn7LZtEHTG5UfSYvbnsl8R7oEwG_ISIJmpqpq_RHYz5e8XZd8A5LHmkO25d8dkGj01XmduCyI
>> Q27iETF19qnv2YODMA-MDBzQFIJzvqElsE55TF6a3xlvZ30sJJOFApmHQEuB7aNLomKqAbQ_IV
>> ZQvrmIlsOWuyLaS0nxuiePkCEpEu958N3MUgnLJ3QmnqD866gpPHWt3a4Mn4TYGJ-fTj5YgqBw
>> hNQizpCxVcTFEMjkG8QiT8lZiw7DX1TNHQ0nxMjkB5Wlzbve0TmFerinZvP3iv23lV6uWFDrOL
>> hhZxtfCEXGRDlih_n3wPa4Eb_bDAC0TJhblc8BQCeskFXZ1D5ADbvsJlKbG3RnLCUSosyyUA5p
>> 2hlSc
>> 2014-07-02 17:57:43,488 DEBUG [c.c.s.ConsoleProxyServlet]
>> (catalina-exec-13:null) the console url is ::
>> Carlos(UbuntuImages)http://172.30.45.104/ajax?token=QK4fjJqdcNofgiLB-bzWbSLYWY2Zt7nwDyDo_iQBcB
>> gg0f0VpUmt-vtEUnBloZY5KDik2PMN_W9L3KPDJ_Z2kBtsresT_gmNNpyWOxkp_v7NtTgdfG3S
>> 0Mn7LZtEHTG5UfSYvbnsl8R7oEwG_ISIJmpqpq_RHYz5e8XZd8A5LHmkO25d8dkGj01XmduCyI
>> Q27iETF19qnv2YODMA-MDBzQFIJzvqElsE55TF6a3xlvZ30sJJOFApmHQEuB7aNLomKqAbQ_IV
>> ZQvrmIlsOWuyLaS0nxuiePkCEpEu958N3MUgnLJ3QmnqD866gpPHWt3a4Mn4TYGJ-fTj5YgqBw
>> hNQizpCxVcTFEMjkG8QiT8lZiw7DX1TNHQ0nxMjkB5Wlzbve0TmFerinZvP3iv23lV6uWFDrOL
>> hhZxtfCEXGRDlih_n3wPa4Eb_bDAC0TJhblc8BQCeskFXZ1D5ADbvsJlKbG3RnLCUSosyyUA5p
>> 2hlSc
>> ">
>> 2014-07-02 17:57:43,718 DEBUG [c.c.a.m.AgentManagerImpl]
>> (AgentManager-Handler-11:null) SeqA 8-1040: Processing Seq 8-1040:  { Cmd
>> ,
>> MgmtId: -1, via: 8, Ver: v1, Flags: 11,
>> [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":60,"_l
>> oadInfo":"{\n
>> \"connections\": []\n}","wait":0}}] }
>> 2014-07-02 17:57:43,723 DEBUG [c.c.a.m.AgentManagerImpl]
>> (AgentManager-Handler-11:

Re: vhd-util location

[Carlos Reátegui]

On Jul 1, 2014, at 3:25 AM, Rohit Yadav  wrote:

> Hi Carlos,
> 
> Carlos Reátegui wrote:
>> Hi All,
>> 
>> When does stuff get copied from [1] to [2] ?
>> 
>> I ask because the docs 
>> (http://docs.cloudstack.apache.org/projects/cloudstack-installation/en/latest/installation.html)
>>  say to download vhd-util and place it in [1] however the script that pushes 
>> it to the hosts looks for it in [2].
>> 
>> In my case I don’t recall at when I placed it in [1], if it was in the order 
>> described in the install docs or if it was after I realized it had not been 
>> deployed to my hosts and did it manually.
>> 
>> Is this a bug?
>> 
>> [1] /usr/share/cloudstack-common/scripts/vm/hypervisor/xenserver
>> [2] 
>> /usr/share/cloudstack-management/webapps/client/WEB-INF/classes/scripts/vm/hypervisor/xenserver
> 
> The vhd-util gets copied to [2] during build phase (where maven compiles
> a war package). When building the source, I usually download the
> vhd-util and place it under ./scripts/vm/hypervisor/xenserver/vhd-util
> so that it ends up in systemvm.iso and other archives. If you're
> building from source, I recommend that you download and put vhd-util to
> this path to avoid these issues.
I am installing from deb packages I built from source.  I built theses on a 
different machine and created a repo for this upgrade from 4.1.1 on an ubuntu 
12.04 machine.

The point I was trying to get across is that the docs say to put it in one 
place but the add host function looks for it in another.  This is likely the 
reason we have seen a few messages in the past about vhd-util not getting put 
on the hosts and having to do that manually. 

I would say this is a documentation bug but was trying to verify if maybe it 
was more of a timing of when I did things.

> 
> When CloudStack adds a Xen(Server/Project) host it copies these files
> and tries to /opt/cloud/bin from [2]'s path. But when executing commands
> I think it looks at both /opt/cloud/bin and /opt/xensource/bin/ for
> vhd-util.
> 
> I think it could be path issue for you, which distribution are you using
> (Debian or Fedora/Centos/RPM based)? I think we could have the code
> fixed that uses vhd-util (for converting raw/images to vhd) to check if
> it's not available then download and set it up.
> 
> The linux distro specific builds create the cloudstack-common which does
> not have this binary due to licensing issues. AFAIK, we need to download
> and copy/chmod +x the file as the INSTALL.md and the document you shared
> says.
> 
> I think in future, with work on xapi and XenServer plugin, we may not
> need vhd-util (Tim and other Xen folks can comment?).
> 
> Regards,
> Rohit Yadav
> Software Architect, ShapeBlue
> M. +91 88 262 30892 | rohit.ya...@shapeblue.com
> Blog: bhaisaab.org | Twitter: @_bhaisaab
> Find out more about ShapeBlue and our range of CloudStack related services
> 
> IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
> CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
> CloudStack Infrastructure 
> Support<http://shapeblue.com/cloudstack-infrastructure-support/>
> CloudStack Bootcamp Training 
> Courses<http://shapeblue.com/cloudstack-training/>
> 
> This email and any attachments to it may be confidential and are intended 
> solely for the use of the individual to whom it is addressed. Any views or 
> opinions expressed are solely those of the author and do not necessarily 
> represent those of Shape Blue Ltd or related companies. If you are not the 
> intended recipient of this email, you must neither take any action based upon 
> its contents, nor copy or show it to anyone. Please contact the sender if you 
> believe you have received this email in error. Shape Blue Ltd is a company 
> incorporated in England & Wales. ShapeBlue Services India LLP is a company 
> incorporated in India and is operated under license from Shape Blue Ltd. 
> Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
> operated under license from Shape Blue Ltd. ShapeBlue is a registered 
> trademark.

Re: 4.4 upgrade issues

[Carlos Reátegui]

0,086 DEBUG [c.c.a.m.AgentManagerImpl] 
(AgentTaskPool-2:ctx-b360d1bb) Sending Disconnect to listener: 
com.cloud.network.SshKeysDistriMonitor
2014-06-30 14:06:50,086 DEBUG [c.c.a.m.AgentManagerImpl] 
(AgentTaskPool-2:ctx-b360d1bb) Sending Disconnect to listener: 
com.cloud.network.router.VirtualNetworkApplianceManagerImpl
2014-06-30 14:06:50,086 DEBUG [c.c.a.m.AgentManagerImpl] 
(AgentTaskPool-2:ctx-b360d1bb) Sending Disconnect to listener: 
com.cloud.consoleproxy.ConsoleProxyListener
2014-06-30 14:06:50,091 DEBUG [c.c.a.m.AgentManagerImpl] 
(AgentTaskPool-2:ctx-b360d1bb) Sending Disconnect to listener: 
com.cloud.network.SshKeysDistriMonitor
2014-06-30 14:06:50,091 DEBUG [c.c.a.m.AgentManagerImpl] 
(AgentTaskPool-2:ctx-b360d1bb) Sending Disconnect to listener: 
com.cloud.network.router.VpcVirtualNetworkApplianceManagerImpl
2014-06-30 14:06:50,091 DEBUG [c.c.a.m.AgentManagerImpl] 
(AgentTaskPool-2:ctx-b360d1bb) Sending Disconnect to listener: 
com.cloud.storage.LocalStoragePoolListener
2014-06-30 14:06:50,091 DEBUG [c.c.a.m.AgentManagerImpl] 
(AgentTaskPool-2:ctx-b360d1bb) Sending Disconnect to listener: 
com.cloud.storage.upload.UploadListener
2014-06-30 14:06:50,093 DEBUG [c.c.a.m.AgentManagerImpl] 
(AgentTaskPool-2:ctx-b360d1bb) Sending Disconnect to listener: 
com.cloud.capacity.StorageCapacityListener
2014-06-30 14:06:50,093 DEBUG [c.c.a.m.AgentManagerImpl] 
(AgentTaskPool-2:ctx-b360d1bb) Sending Disconnect to listener: 
com.cloud.capacity.ComputeCapacityListener
2014-06-30 14:06:50,093 DEBUG [c.c.a.m.AgentManagerImpl] 
(AgentTaskPool-2:ctx-b360d1bb) Sending Disconnect to listener: 
com.cloud.network.NetworkUsageManagerImpl$DirectNetworkStatsListener
2014-06-30 14:06:50,093 DEBUG [c.c.n.NetworkUsageManagerImpl] 
(AgentTaskPool-2:ctx-b360d1bb) Disconnected called on 2 with status Alert
2014-06-30 14:06:50,093 DEBUG [c.c.a.m.AgentManagerImpl] 
(AgentTaskPool-2:ctx-b360d1bb) Sending Disconnect to listener: 
com.cloud.agent.manager.AgentManagerImpl$BehindOnPingListener
2014-06-30 14:06:50,093 DEBUG [c.c.h.Status] (AgentTaskPool-2:ctx-b360d1bb) 
Transition:[Resource state = Enabled, Agent event = AgentDisconnected, Host id 
= 2, name = srvengxen02]
2014-06-30 14:06:50,102 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] 
(AgentTaskPool-2:ctx-b360d1bb) Notifying other nodes of to disconnect
2014-06-30 14:06:50,108 DEBUG [c.c.h.x.r.CitrixResourceBase] 
(DirectAgent-2:ctx-59808af2) Copying 
/usr/share/cloudstack-management/webapps/client/WEB-INF/classes/scripts/vm/hypervisor/xenserver/xenserver60/../../../../network/domr//router_proxy.sh
 to /opt/cloud/bin on 172.30.45.32 with permission 0755
2014-06-30 14:06:50,108 DEBUG [c.c.h.x.r.CitrixResourceBase] 
(DirectAgent-2:ctx-59808af2) Unable to create destination path: /opt/cloud/bin 
on 172.30.45.32 but trying anyway
2014-06-30 14:06:50,110 WARN  [c.c.r.ResourceManagerImpl] 
(AgentTaskPool-2:ctx-b360d1bb) Unable to connect due to 
com.cloud.exception.ConnectionException: Reinitialize agent after setup.
at 
com.cloud.hypervisor.xen.discoverer.XcpServerDiscoverer.processConnect(XcpServerDiscoverer.java:656)
at 
com.cloud.agent.manager.AgentManagerImpl.notifyMonitorsOfConnection(AgentManagerImpl.java:514)
at 
com.cloud.agent.manager.AgentManagerImpl.handleDirectConnectAgent(AgentManagerImpl.java:1427)
at 
com.cloud.resource.ResourceManagerImpl.createHostAndAgent(ResourceManagerImpl.java:1765)
at 
com.cloud.resource.ResourceManagerImpl.createHostAndAgent(ResourceManagerImpl.java:1891)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at 
org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)




On Jun 30, 2014, at 1:57 PM, Carlos Reátegui  wrote:

> Making a little progress but still stuck…
> 
> I realized that when I did the upgrade it had asked me if to keep the old 
> dp.properties or use the new one.  The structure of the file seemed different 
> enough and I did not recall using anything but the defaults so I went ahead 
> and told it to use the new one.  Seems this was not the right thing to do.
> 
> I have updated the password/ecryption settings to match the old file but it 
> is still not working.  Now I am getting stuck here:
> 
> 2014-06-30 13:50:32,139 DEBUG [c.c.s.d.VMTemplateDaoImpl] (main:null) Found 
> parameter routing unique name null
> 2014-06-30 13:50:32,139 DEBUG [c.c.s.d.VMTemplateDaoImpl] (main:null) Use 
> console proxy template : routing
> 2014-06-30 13:50:32,143 INFO  [c.c.u.d.GenericDaoBase] (main:null) Cache 
> created: [ name = HostPodDaoImpl status = STATUS_ALIVE eternal = false 
> overflowToDisk = false maxEntriesLocalHeap = 50 maxEntriesLocalDi

vhd-util location

[Carlos Reátegui]

Hi All,

When does stuff get copied from [1] to [2] ?

I ask because the docs 
(http://docs.cloudstack.apache.org/projects/cloudstack-installation/en/latest/installation.html)
 say to download vhd-util and place it in [1] however the script that pushes it 
to the hosts looks for it in [2].  

In my case I don’t recall at when I placed it in [1], if it was in the order 
described in the install docs or if it was after I realized it had not been 
deployed to my hosts and did it manually.

Is this a bug?  

[1] /usr/share/cloudstack-common/scripts/vm/hypervisor/xenserver 
[2] 
/usr/share/cloudstack-management/webapps/client/WEB-INF/classes/scripts/vm/hypervisor/xenserver

Re: 4.4 upgrade issues

[Carlos Reátegui]

 cacheEventListeners: 
net.sf.ehcache.statistics.LiveCacheStatisticsWrapper  hitCount = 0 
memoryStoreHitCount = 0 diskStoreHitCount = 0 missCountNotFound = 0 
missCountExpired = 0 maxBytesLocalHeap = 0 overflowToOffHeap = false 
maxBytesLocalOffHeap = 0 maxBytesLocalDisk = 0 pinned = false ]
2014-06-30 13:50:32,189 INFO  [c.c.u.d.GenericDaoBase] (main:null) Cache 
created: [ name = vnet Alloc status = STATUS_ALIVE eternal = false 
overflowToDisk = false maxEntriesLocalHeap = 50 maxEntriesLocalDisk = 0 
memoryStoreEvictionPolicy = LRU timeToLiveSeconds = 600 timeToIdleSeconds = 300 
persistence = none diskExpiryThreadIntervalSeconds = 120 cacheEventListeners: 
net.sf.ehcache.statistics.LiveCacheStatisticsWrapper  hitCount = 0 
memoryStoreHitCount = 0 diskStoreHitCount = 0 missCountNotFound = 0 
missCountExpired = 0 maxBytesLocalHeap = 0 overflowToOffHeap = false 
maxBytesLocalOffHeap = 0 maxBytesLocalDisk = 0 pinned = false ]
2014-06-30 13:50:32,198 INFO  [c.c.u.d.GenericDaoBase] (main:null) Cache 
created: [ name = VlanDaoImpl status = STATUS_ALIVE eternal = false 
overflowToDisk = false maxEntriesLocalHeap = 30 maxEntriesLocalDisk = 0 
memoryStoreEvictionPolicy = LRU timeToLiveSeconds = 3600 timeToIdleSeconds = 
300 persistence = none diskExpiryThreadIntervalSeconds = 120 
cacheEventListeners: net.sf.ehcache.statistics.LiveCacheStatisticsWrapper  
hitCount = 0 memoryStoreHitCount = 0 diskStoreHitCount = 0 missCountNotFound = 
0 missCountExpired = 0 maxBytesLocalHeap = 0 overflowToOffHeap = false 
maxBytesLocalOffHeap = 0 maxBytesLocalDisk = 0 pinned = false ]
2014-06-30 13:50:32,232 DEBUG [c.c.u.c.DBEncryptionUtil] (main:null) Error 
while decrypting: true

The key is still the default password and I have decrypted all the ENC 
parameters from the db.properties file and they seem ok.  What am I missing?

thanks,
Carlos


On Jun 30, 2014, at 1:16 PM, Carlos Reátegui  wrote:

> I found the comments in: 
> https://issues.apache.org/jira/browse/CLOUDSTACK-3990 useful but how do I 
> find out the database key so that I can set the pw.
> 
> Also in looking at my previous backups for the host_details table it seems 
> like the password entry changes on a regular basis.
> 
> Is there something the keeps updating the db key and re-ecrypts the host 
> passwords?
> 
> On Jun 30, 2014, at 1:01 PM, Carlos Reátegui  wrote:
> 
>> Hi All,
>> 
>> I am having problems bringing my system back up.  I have not checked the 
>> credentials of my hosts but the upgraded management server is unable to 
>> connect to them.  Where is the password stored?
>> 
>> thanks.
>> Carlos
>> 
>> 
>> 2014-06-30 12:55:59,277 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] 
>> (ClusteredAgentManager Timer:ctx-060c8ace) Loading directly connected host 
>> 1(srvengxen01)
>> 2014-06-30 12:56:04,394 DEBUG [c.c.n.l.LBHealthCheckManagerImpl] 
>> (LBHealthCheck-1:ctx-c6869648) LB HealthCheck Manager is running and getting 
>> the updates from LB providers and updating service status
>> 2014-06-30 12:56:04,428 DEBUG [c.c.n.l.LBHealthCheckManagerImpl] 
>> (LBHealthCheck-1:ctx-c6869648) LB HealthCheck Manager is running and getting 
>> the updates from LB providers and updating service status
>> 2014-06-30 12:56:06,844 DEBUG [c.c.h.x.r.XenServerConnectionPool] 
>> (ClusteredAgentManager Timer:ctx-060c8ace) Unable to create master 
>> connection to host(172.30.45.31) , due to The credentials given by the user 
>> are incorrect, so access has been denied, and you have not been issued a 
>> session handle.
>> 2014-06-30 12:56:06,848 DEBUG [c.c.h.Status] (ClusteredAgentManager 
>> Timer:ctx-060c8ace) Transition:[Resource state = Enabled, Agent event = 
>> AgentDisconnected, Host id = 1, name = srvengxen01]
>> 2014-06-30 12:56:06,862 WARN  [c.c.a.m.ClusteredAgentManagerImpl] 
>> (ClusteredAgentManager Timer:ctx-060c8ace)  can not load directly connected 
>> host 1(srvengxen01) due to 
>> com.cloud.utils.exception.CloudRuntimeException: Unable to create master 
>> connection to host(172.30.45.31) , due to The credentials given by the user 
>> are incorrect, so access has been denied, and you have not been issued a 
>> session handle.
>>   at 
>> com.cloud.hypervisor.xen.resource.XenServerConnectionPool.getConnect(XenServerConnectionPool.java:168)
>>   at 
>> com.cloud.hypervisor.xen.resource.CitrixResourceBase.CheckXenHostInfo(CitrixResourceBase.java:5722)
>>   at 
>> com.cloud.hypervisor.xen.resource.CitrixResourceBase.configure(CitrixResourceBase.java:5705)
>>   at 
>> com.cloud.resource.DiscovererBase.reloadResource(DiscovererBase.java:157)
>>   at 
>> com.cloud.agent.manager.AgentManagerImpl.loadDirectlyConnec

Re: 4.4 upgrade issues

[Carlos Reátegui]

I found the comments in: https://issues.apache.org/jira/browse/CLOUDSTACK-3990 
useful but how do I find out the database key so that I can set the pw.

Also in looking at my previous backups for the host_details table it seems like 
the password entry changes on a regular basis.

Is there something the keeps updating the db key and re-ecrypts the host 
passwords?

On Jun 30, 2014, at 1:01 PM, Carlos Reátegui  wrote:

> Hi All,
> 
> I am having problems bringing my system back up.  I have not checked the 
> credentials of my hosts but the upgraded management server is unable to 
> connect to them.  Where is the password stored?
> 
> thanks.
> Carlos
> 
> 
> 2014-06-30 12:55:59,277 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] 
> (ClusteredAgentManager Timer:ctx-060c8ace) Loading directly connected host 
> 1(srvengxen01)
> 2014-06-30 12:56:04,394 DEBUG [c.c.n.l.LBHealthCheckManagerImpl] 
> (LBHealthCheck-1:ctx-c6869648) LB HealthCheck Manager is running and getting 
> the updates from LB providers and updating service status
> 2014-06-30 12:56:04,428 DEBUG [c.c.n.l.LBHealthCheckManagerImpl] 
> (LBHealthCheck-1:ctx-c6869648) LB HealthCheck Manager is running and getting 
> the updates from LB providers and updating service status
> 2014-06-30 12:56:06,844 DEBUG [c.c.h.x.r.XenServerConnectionPool] 
> (ClusteredAgentManager Timer:ctx-060c8ace) Unable to create master connection 
> to host(172.30.45.31) , due to The credentials given by the user are 
> incorrect, so access has been denied, and you have not been issued a session 
> handle.
> 2014-06-30 12:56:06,848 DEBUG [c.c.h.Status] (ClusteredAgentManager 
> Timer:ctx-060c8ace) Transition:[Resource state = Enabled, Agent event = 
> AgentDisconnected, Host id = 1, name = srvengxen01]
> 2014-06-30 12:56:06,862 WARN  [c.c.a.m.ClusteredAgentManagerImpl] 
> (ClusteredAgentManager Timer:ctx-060c8ace)  can not load directly connected 
> host 1(srvengxen01) due to 
> com.cloud.utils.exception.CloudRuntimeException: Unable to create master 
> connection to host(172.30.45.31) , due to The credentials given by the user 
> are incorrect, so access has been denied, and you have not been issued a 
> session handle.
>at 
> com.cloud.hypervisor.xen.resource.XenServerConnectionPool.getConnect(XenServerConnectionPool.java:168)
>at 
> com.cloud.hypervisor.xen.resource.CitrixResourceBase.CheckXenHostInfo(CitrixResourceBase.java:5722)
>at 
> com.cloud.hypervisor.xen.resource.CitrixResourceBase.configure(CitrixResourceBase.java:5705)
>at 
> com.cloud.resource.DiscovererBase.reloadResource(DiscovererBase.java:157)
>at 
> com.cloud.agent.manager.AgentManagerImpl.loadDirectlyConnectedHost(AgentManagerImpl.java:672)
>at 
> com.cloud.agent.manager.ClusteredAgentManagerImpl.scanDirectAgentToLoad(ClusteredAgentManagerImpl.java:218)
>at 
> com.cloud.agent.manager.ClusteredAgentManagerImpl.runDirectAgentScanTimerTask(ClusteredAgentManagerImpl.java:184)
>at 
> com.cloud.agent.manager.ClusteredAgentManagerImpl.access$100(ClusteredAgentManagerImpl.java:98)
>at 
> com.cloud.agent.manager.ClusteredAgentManagerImpl$DirectAgentScanTimerTask.runInContext(ClusteredAgentManagerImpl.java:234)
>at 
> org.apache.cloudstack.managed.context.ManagedContextTimerTask$1.runInContext(ManagedContextTimerTask.java:30)
>at 
> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
>at 
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
>at 
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
>at 
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
>at 
> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
>at 
> org.apache.cloudstack.managed.context.ManagedContextTimerTask.run(ManagedContextTimerTask.java:27)
>at java.util.TimerThread.mainLoop(Timer.java:555)
>at java.util.TimerThread.run(Timer.java:505)
> Caused by: The credentials given by the user are incorrect, so access has 
> been denied, and you have not been issued a session handle.
>at com.xensource.xenapi.Types.checkResponse(Types.java:322)
>at com.xensource.xenapi.Connection.dispatch(Connection.java:350)
>at com.xensource.xenapi.Session.loginWithPassword(Session.java:537)
>at 
> com.cloud.hypervisor.xen.resource.XenServerConnectionPool.loginWithPassword(XenServerConnectionPool.java:321)
>at 
> com.cloud.hypervisor.xen.resource.XenServerConnectionPool.getConnect(XenServerConnection

Re: 4.4 upgrade issues

[Carlos Reátegui]

Hi All,

I am having problems bringing my system back up.  I have not checked the 
credentials of my hosts but the upgraded management server is unable to connect 
to them.  Where is the password stored?

thanks.
Carlos


2014-06-30 12:55:59,277 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] 
(ClusteredAgentManager Timer:ctx-060c8ace) Loading directly connected host 
1(srvengxen01)
2014-06-30 12:56:04,394 DEBUG [c.c.n.l.LBHealthCheckManagerImpl] 
(LBHealthCheck-1:ctx-c6869648) LB HealthCheck Manager is running and getting 
the updates from LB providers and updating service status
2014-06-30 12:56:04,428 DEBUG [c.c.n.l.LBHealthCheckManagerImpl] 
(LBHealthCheck-1:ctx-c6869648) LB HealthCheck Manager is running and getting 
the updates from LB providers and updating service status
2014-06-30 12:56:06,844 DEBUG [c.c.h.x.r.XenServerConnectionPool] 
(ClusteredAgentManager Timer:ctx-060c8ace) Unable to create master connection 
to host(172.30.45.31) , due to The credentials given by the user are incorrect, 
so access has been denied, and you have not been issued a session handle.
2014-06-30 12:56:06,848 DEBUG [c.c.h.Status] (ClusteredAgentManager 
Timer:ctx-060c8ace) Transition:[Resource state = Enabled, Agent event = 
AgentDisconnected, Host id = 1, name = srvengxen01]
2014-06-30 12:56:06,862 WARN  [c.c.a.m.ClusteredAgentManagerImpl] 
(ClusteredAgentManager Timer:ctx-060c8ace)  can not load directly connected 
host 1(srvengxen01) due to 
com.cloud.utils.exception.CloudRuntimeException: Unable to create master 
connection to host(172.30.45.31) , due to The credentials given by the user are 
incorrect, so access has been denied, and you have not been issued a session 
handle.
at 
com.cloud.hypervisor.xen.resource.XenServerConnectionPool.getConnect(XenServerConnectionPool.java:168)
at 
com.cloud.hypervisor.xen.resource.CitrixResourceBase.CheckXenHostInfo(CitrixResourceBase.java:5722)
at 
com.cloud.hypervisor.xen.resource.CitrixResourceBase.configure(CitrixResourceBase.java:5705)
at 
com.cloud.resource.DiscovererBase.reloadResource(DiscovererBase.java:157)
at 
com.cloud.agent.manager.AgentManagerImpl.loadDirectlyConnectedHost(AgentManagerImpl.java:672)
at 
com.cloud.agent.manager.ClusteredAgentManagerImpl.scanDirectAgentToLoad(ClusteredAgentManagerImpl.java:218)
at 
com.cloud.agent.manager.ClusteredAgentManagerImpl.runDirectAgentScanTimerTask(ClusteredAgentManagerImpl.java:184)
at 
com.cloud.agent.manager.ClusteredAgentManagerImpl.access$100(ClusteredAgentManagerImpl.java:98)
at 
com.cloud.agent.manager.ClusteredAgentManagerImpl$DirectAgentScanTimerTask.runInContext(ClusteredAgentManagerImpl.java:234)
at 
org.apache.cloudstack.managed.context.ManagedContextTimerTask$1.runInContext(ManagedContextTimerTask.java:30)
at 
org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
at 
org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at 
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at 
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at 
org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
at 
org.apache.cloudstack.managed.context.ManagedContextTimerTask.run(ManagedContextTimerTask.java:27)
at java.util.TimerThread.mainLoop(Timer.java:555)
at java.util.TimerThread.run(Timer.java:505)
Caused by: The credentials given by the user are incorrect, so access has been 
denied, and you have not been issued a session handle.
at com.xensource.xenapi.Types.checkResponse(Types.java:322)
at com.xensource.xenapi.Connection.dispatch(Connection.java:350)
at com.xensource.xenapi.Session.loginWithPassword(Session.java:537)
at 
com.cloud.hypervisor.xen.resource.XenServerConnectionPool.loginWithPassword(XenServerConnectionPool.java:321)
at 
com.cloud.hypervisor.xen.resource.XenServerConnectionPool.getConnect(XenServerConnectionPool.java:154)
... 17 more
2014-06-30 12:56:06,864 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] 
(ClusteredAgentManager Timer:ctx-060c8ace) Loading directly connected host 
2(srvengxen02)
2014-06-30 12:56:09,225 DEBUG [c.c.s.StatsCollector] 
(StatsCollector-1:ctx-8458e286) HostStatsCollector is running...
2014-06-30 12:56:09,226 DEBUG [c.c.s.StatsCollector] 
(StatsCollector-2:ctx-aa245eed) VmStatsCollector is running...
2014-06-30 12:56:09,227 DEBUG [c.c.s.StatsCollector] 
(StatsCollector-3:ctx-19894fa1) StorageCollector is running...
2014-06-30 12:56:09,230 DEBUG [c.c.s.StatsCollector] 
(StatsCollector-4:ctx-d66c71fb) AutoScaling Monitor is running...



On Jun 30, 2014, at 9:54 AM, Carlos Reátegui  wrote:

> Hi Sudha,
> Thanks for checking in.  I was out for the weeke

Re: 4.4 upgrade issues

[Carlos Reátegui]

Hi Sudha,
Thanks for checking in.  I was out for the weekend and just getting back to 
this now.

My main question at this point is if it is ok for me to kill the system vms 
with the xe vm-shutdown command since the script provided by cloudstack does 
not work with ubuntu.

Also it would be great if someone could have a look at my logs to see if they 
look normal. I am seeing a lot of HA-Worker messages but I do not have an HA 
deployment (unless this is the thread that keeps the system vas running).

thanks,
Carlos



On Jun 29, 2014, at 11:51 PM, Sudha Ponnaganti  
wrote:

> Hi Carlos,
> 
> Were you able to resolve the following? Was your upgrade successful?
> 
> Thanks
> /sudha
> 
> -Original Message-
> From: Carlos Reátegui [mailto:create...@gmail.com] 
> Sent: Friday, June 27, 2014 8:55 PM
> To: CloudStack-Users
> Cc: d...@cloudstack.apache.org
> Subject: 4.4 upgrade issues
> 
> I am trying out the upgrade instructions from 
> http://docs.cloudstack.apache.org/projects/cloudstack-release-notes/en/4.3/rnotes.html#upgrade-from-4-1-x-to-4-3
>  but going to 4.4 built from source today.
> 
> My setup: XenServer 6.0.2 Hosts, Management Server on Ubuntu 12.04, Primary 
> and Secondary on NFS, Basic Network, no security groups
> 
> -
> Notes on the docs:
> 
> 8.4 - 8.6: This is only for hosts that use the cloudstack agent. Does not 
> apply to KVM. In general this whole section does not do a good job of 
> explaining what is on the MS vs the Hosts.
> 
> 13: This fails on ubuntu because: cloudstack-sysvmadm sources 
> /etc/rc.d/init.d/functions which does not exist on ubuntu/debian systems.
> 
> 14: Copy vhf-util from where? Also the path 
> /usr/share/cloudstack-common/scripts/vm/hypervisor/xenserver does not exist 
> on the hosts so I am assuming this is on the MS, however the MS already has 
> it since it is an upgrade and was put there by the original install.  Or is 
> this a new version that needs to be grabbed from somewhere?
> 
> Other: earlier versions like 4.1 worked with JDK 1.6 current releases require 
> 1.7 but the Upgrade doc does not mention that.
> 
> --
> Issues:
> 
> Saw the following in catalina.out, not sure if it is an issues:
> Jun 27, 2014 5:28:42 PM org.apache.catalina.loader.WebappClassLoader 
> validateJarFile
> INFO: 
> validateJarFile(/usr/share/cloudstack-management/webapps/client/WEB-INF/lib/servlet-api-2.5-20081211.jar)
>  - jar not loaded. See Servlet Spec 2.3, section 9.7.2. Offending class: 
> javax/servlet/Servlet.class Jun 27, 2014 5:28:42 PM 
> org.apache.catalina.loader.WebappClassLoader validateJarFile
> INFO: 
> validateJarFile(/usr/share/cloudstack-management/webapps/client/WEB-INF/lib/tomcat-embed-core-7.0.30.jar)
>  - jar not loaded. See Servlet Spec 2.3, section 9.7.2. Offending class: 
> javax/servlet/Servlet.class
> 
> Since the above script in step 13 did not work is it ok to do "xe vm-shutdown 
> vm=." on each of the system vms?  Will CloudStack notice they are ton and 
> start new ones?
> 
> Here are my log files (please note I stopped the service prior to capturing 
> these logs in case you are wondering):
> Management server log: 
> https://www.dropbox.com/s/7xhkutt8e724il1/management-server.log
> Catalina log: 
> https://www.dropbox.com/s/f45ypkbazhkogyj/catalina.2014-06-27.log
> 
> 
> 
> 

4.4 upgrade issues

[Carlos Reátegui]

I am trying out the upgrade instructions from 
http://docs.cloudstack.apache.org/projects/cloudstack-release-notes/en/4.3/rnotes.html#upgrade-from-4-1-x-to-4-3
 but going to 4.4 built from source today.

My setup: XenServer 6.0.2 Hosts, Management Server on Ubuntu 12.04, Primary and 
Secondary on NFS, Basic Network, no security groups

-
Notes on the docs:

8.4 - 8.6: This is only for hosts that use the cloudstack agent. Does not apply 
to KVM. In general this whole section does not do a good job of explaining what 
is on the MS vs the Hosts.

13: This fails on ubuntu because: cloudstack-sysvmadm sources 
/etc/rc.d/init.d/functions which does not exist on ubuntu/debian systems.

14: Copy vhf-util from where? Also the path 
/usr/share/cloudstack-common/scripts/vm/hypervisor/xenserver does not exist on 
the hosts so I am assuming this is on the MS, however the MS already has it 
since it is an upgrade and was put there by the original install.  Or is this a 
new version that needs to be grabbed from somewhere?

Other: earlier versions like 4.1 worked with JDK 1.6 current releases require 
1.7 but the Upgrade doc does not mention that.

——
Issues:

Saw the following in catalina.out, not sure if it is an issues:
Jun 27, 2014 5:28:42 PM org.apache.catalina.loader.WebappClassLoader 
validateJarFile
INFO: 
validateJarFile(/usr/share/cloudstack-management/webapps/client/WEB-INF/lib/servlet-api-2.5-20081211.jar)
 - jar not loaded. See Servlet Spec 2.3, section 9.7.2. Offending class: 
javax/servlet/Servlet.class
Jun 27, 2014 5:28:42 PM org.apache.catalina.loader.WebappClassLoader 
validateJarFile
INFO: 
validateJarFile(/usr/share/cloudstack-management/webapps/client/WEB-INF/lib/tomcat-embed-core-7.0.30.jar)
 - jar not loaded. See Servlet Spec 2.3, section 9.7.2. Offending class: 
javax/servlet/Servlet.class

Since the above script in step 13 did not work is it ok to do "xe vm-shutdown 
vm=…” on each of the system vms?  Will CloudStack notice they are ton and start 
new ones?

Here are my log files (please note I stopped the service prior to capturing 
these logs in case you are wondering):
Management server log: 
https://www.dropbox.com/s/7xhkutt8e724il1/management-server.log
Catalina log: https://www.dropbox.com/s/f45ypkbazhkogyj/catalina.2014-06-27.log

Re: Debian + Cloud-Init

[Carlos Reátegui]

On Jun 23, 2014, at 4:09 PM, Ian Duffy  wrote:

> Hi Carlos,
> 
> I'm using 0.7.3-2 from the Debian Wheezy backports repo.
> 
> I didn't have any issues acquiring metadata as long as I used
> isc-dhcp-client as the dhcp client (Had issues when using pump).
> 
> I believe even with your patch the password on the root account will not be
> set.
Correct.  We share similar launch/user-data scripts for AWS and CloudStack so 
we use the cloud-init standard public-keys metadata type for enabling VM access 
and therefore have no need for the CS password service.

Re: Debian + Cloud-Init

[Carlos Reátegui]

Hi Ian,
What version of cloud-init are you using?  The default one that comes with 
ubuntu 12.04 has a bug that causes is not to work on Cloudstack (uses gateway 
instead of dhcp server as metadata server). 

I did something similar to convert the cloud images from ubuntu into a 
XenServer image and have a patch for DataSourceCloudStack in cloud-init here: 
https://github.com/creategui/CloudStackImageScripts/blob/master/DataSourceCloudStack.patch

cheers,
-Carlos


On Jun 23, 2014, at 1:17 PM, Ian Duffy  wrote:

> Lucian,
> 
> You were spot on. It is not supported. I've done similar to your work
> around by giving a init.d script.
> 
> I've upload a automated system using packer for generating a OVA of a
> debian x64 template to github
> https://github.com/imduffy15/cloudstack-templates
> 
> I included a built version of the template for xenserver to save somebody
> time in the future.
> https://github.com/imduffy15/cloudstack-templates/releases
> 
> If people are interested I might build this out to generate KVM, Xen,
> HyperV and vSphere images and add CentOS and Ubuntu.
> 
> 
> On 23 June 2014 18:40, Ian Duffy  wrote:
> 
>> Thanks Lucian!
>> 
>> I'm currently digging through the cloud-init documentation. I'll let you
>> know if I find another way.
>> 
>> 
>> On 23 June 2014 18:34, Nux!  wrote:
>> 
>>> Yes, the Cloudstack root password feature is (to my knowledge) totally
>>> unsupported by cloud-init.
>>> So only ssh keys and user data works.
>>> To work around it, I usually throw the cloudstack-set-root-password
>>> script in /var/lib/cloud/scripts/per-boot so cloud-init will execute it
>>> every time the VM boots.
>>> 
>>> HTH
>>> Lucian
>>> 
>>> --
>>> Sent from the Delta quadrant using Borg technology!
>>> 
>>> Nux!
>>> www.nux.ro
>>> 
>>> 
>>> - Original Message -
>>> From: "Ian Duffy" 
>>> To: users@cloudstack.apache.org
>>> Sent: Monday, 23 June, 2014 6:09:30 PM
>>> Subject: Debian + Cloud-Init
>>> 
>>> Hi All,
>>> 
>>> In the past i've used the community supplied scripts over at
>>> https://github.com/shankerbalan/cloudstack-scripts for doing injection of
>>> password / ssh keys.
>>> 
>>> I'm trying to move to cloud-init to handle this for me however I am having
>>> some issues.
>>> 
>>> I modified my /etc/cloud/cloud.cfg file to use CloudStack as a datasource:
>>> 
>>> datasource_list: ['CloudStack']
>>> 
>>> datasource:
>>> 
>>>  CloudStack: {}
>>> 
>>> 
>>> I also set the following:
>>> 
>>> disable_root: False
>>> 
>>> user: root
>>> 
>>> ssh_pwauth: True
>>> 
>>> ssh_deletekeys: True
>>> 
>>> ssh_genkeytypes: ['rsa', 'dsa']
>>> 
>>> ssh_svcname: ssh
>>> 
>>> 
>>> On booting up the machine I see the script run successfully and pull the
>>> metadata down from the VR. The hostname is also set and new ssh keys are
>>> generated.
>>> 
>>> On attempting to login as root with the password provided on the
>>> Cloudstack
>>> UI I am unsuccessful. I'm unsure why.
>>> 
>>> 
>>> Anybody got an idea where I'm going wrong?
>>> 
>>> 
>>> Thanks,
>>> 
>>> Ian
>>> 
>> 
>> 

Re: Cloudstack-4.3 xenserver-6.2 equallogic SAN

[Carlos Reátegui]

Hi Ian,
I used XenCenter to setup my network on the first host and then added the 
others to the cluster within XenCenter.  When you add the primary host to 
CloudStack all hosts will get added.

If you follow the install instructions on the site 
(http://docs.cloudstack.apache.org/projects/cloudstack-installation/en/latest/) 
you should be ok.

I think the main thing that usually trips up folks is the vhd-util step.  Make 
sure that the one you download per the instructions ends up on the hosts in the 
/opt/xensource/bin directory.  In the past there were problems with the script 
that added the hosts not copying it from the management server.  Please note 
that this vhd-util is a different version than the one that comes with 
XenServer and you should leave that one alone.

cheers,
-Carlos

On Jun 23, 2014, at 8:45 AM, Dean Kamali  wrote:

> You could ​export shares via NFS and add your shares as primary or
> secondary storage to your CS accordingly, you may export your shares
> via ISCSI volumes as well.
> 
> There is not specific guide for Dell EQLX.
> 
> cheers
> 
> Dean
> ​
> 
> 
> On Mon, Jun 23, 2014 at 3:01 AM, Ian Marshall  wrote:
> 
>> Hi Everyone
>> 
>> Does anyone have a guide to help a new user setup a cloudstack with
>> xenserver and equallogic SAN?
>> 
>> I've read the guides on the cloudstack site and found a link to the Dell
>> guide for integrating EQLX to xenserver but unsure if this is correct for
>> cloudstack setup. Also not sure what should/can be configured using the xen
>> centre admin once cloudstack is implemented.
>> 
>> Regards
>> Ian

Re: building and testing 4.4.

[Carlos Reátegui]

On Jun 20, 2014, at 12:13 PM, Rohit Yadav  wrote:

> On Fri, Jun 20, 2014 at 10:15 PM, Carlos Reátegui 
> wrote:
> 
>> Hi Rohit,
>> 
>> On Jun 19, 2014, at 11:30 PM, Rohit Yadav  wrote:
>> 
>>> Hi Carlos,
>>> 
>>> On Fri, Jun 20, 2014 at 4:17 AM, Carlos Reategui 
>>> wrote:
>>> 
>>>> Hi Rohit,
>>>> Thanks for the info, but I was asking about the non-oss.  Is that
>> included
>>>> in Wido's released versions?
>>>> 
>>> 
>>> This is oss (I checked the 4.3 release debs, and could not find vmware
>> jars
>>> and other non-oss stuff).
>>> 
>> Thanks for checking... I guess I could have done that.
>> 
>>> 
>>>> 
>>>> I'm assuming the zip file you linked below will give me the same as:
>>>> git checkout remotes/origin/4.4
>>>> 
>>> 
>>> Yes :)
>>> 
>>> 
>>>> Also, what is the issue with tomcat 6.0.35?  I just noticed that my
>>>> Management Server is running the default Ubuntu tomcat6 which is 6.0.35.
>>>> Are all versions of CloudStack affected?
>>>> 
>>> 
>>> Historically we've been using 6.0.33, we need to revisit it. For now I
>>> would recommend you to use Tomcat 6.0.33.
>> How do you recommend dealing with the tomcat6 dependency check in the
>> cloudstack install? I found 6.0.32 debs here:
>> https://launchpad.net/ubuntu/precise/amd64/tomcat6/6.0.32-5ubuntu1 would
>> those be ok?  Should I build my own? I am assuming these instructions
>> should work for ubuntu:
>> http://plone.uconn.edu/workspaces/uits-linux/standard-operating-procedures-sop/packaging-tomcat-6-for-debian
> 
> 
> I think 6.0.32 would work. I build from source and run using maven so I
> don't use debian/rpms builds myself, whether using 6.0.35 or 6.0.32 from
> default repo will work (it may); just try them both, the worst case would
> be that it will fail after which you can try building your own.
I have been running 4.1.1 since last year on 6.0.35 without any issues that I 
can tell.  I tried searching for the issues with .35 but can’t find anything 
concrete.  The build docs just say there is a known issue but don’t specify 
what that is.  Anyone know what this known issue is?

I see this as a bigger documentation/installation problem as the install docs 
don’t mention how to get around this dependency.  If you just follow the 
instructions you end up with .35 on ubuntu 12.04.

> 
> Any debian user/sysadmin want to comment here?
> 
> Regards.
> 
> 
>> 
>> 
>>> 
>>> Thanks for filing the doc bug.
>> No prob.  I wold have made the changes myself but wasn't sure what the
>> preferred solution for the above dependency should be.
>> 
>>> 
>>> Regards.
>>> 
>> 

Re: Additional nics fails to get ip for ubuntu guest vm

[Carlos Reátegui]

Saurav,
Have you tried checking the meta-data for the VM to see what is there.  Maybe 
you can get the additional IPs and statically assign them.

metadata=`grep dhcp-server-identifier /var/lib/dhc*/dhclient.eth0.leases | grep 
-Eo '([0-9]{1,3}\.){3}[0-9]{1,3}' | tail -1`
curl http://$metadata/latest/meta-data/public-ipv4
curl http://$metadata/latest/meta-data/local-ipv4
curl http://$metadata/latest/meta-data/




On Jun 20, 2014, at 8:27 AM, Saurav Lahiri  wrote:

> :-). Once again thanks for the helpful inputs. And sure i will check the
> AWS templates.
> 
> Saurav
> 
> 
> On Fri, Jun 20, 2014 at 8:44 PM, Shanker Balan 
> wrote:
> 
>> Comments inline.
>> 
>> On 20-Jun-2014, at 7:25 pm, Saurav Lahiri 
>> wrote:
>> 
>>> Hello Shanker,
>>> Appreciate ur inputs. Also I would like to know whats the best practice
>> in
>>> pre-populating the interfaces file given that it is not known how many
>>> additional nics users might want to create on their vms. If we
>> pre-populate
>>> eth0 to eth4 with dhcp method in the template will that break anything?
>> 
>> Running DHCP on multiple interfaces can cause the default gateway
>> to switch. This has caused me a lot of PITA on AWS EC2 instances.
>> 
>> I now statically assign the IP Addressed on the non primary interfaces. As
>> far
>> as template creation goes, I only check for eth0. Its upto the end user
>> to decide how he wants to get his additional interfaces up.
>> 
>> If you can, check a AWS CentOS/Ubuntu template on how they handle it.
>> 
>> 
>> 
>> 
>> 
>>> 
>>> Thanks
>>> Saurav
>>> 
>>> 
>>> On Fri, Jun 20, 2014 at 9:33 AM, Shanker Balan <
>> shanker.ba...@shapeblue.com>
>>> wrote:
>>> 
 Comments inline.
 
 On 19-Jun-2014, at 7:55 pm, Saurav Lahiri 
 wrote:
 
> Hello,
> We are running an ubuntu 13.10 vm. In addition to the default network,
> another nic has been added to the vm.  Now when the vm boots up, the
>> new
> interface eth1 is seen inside the guest but does not have an ip
>> address.
> Executing a "dhclient eth1" does get the correct IP.
> 
> A look at  the "/etc/network/interaces" file  shows an entry
 corresponding
> to the eth0.  There is no entry for eth1. On adding an entry for eth1,
 the
> problems appears to get fixed.
> 
> Is this manual step to add the additional nics in the interfaces file
> missing in the documentation or is this a bug ?
> 
> ===
> auto eth0
> iface eth0 inet dhcp
> ==
 
 
 This is change that needs to be done by the creator of the template.
 CloudStack
 does not make any changes internal to the template as it does not
>> (should
 not)
 have access to it.
 
 
 --
 @shankerbalan
 
 M: +91 98860 60539 | O: +91 (80) 67935867
 shanker.ba...@shapeblue.com | www.shapeblue.com | Twitter:@shapeblue
 ShapeBlue Services India LLP, 22nd floor, Unit 2201A, World Trade
>> Centre,
 Bangalore - 560 055
 
 Find out more about ShapeBlue and our range of CloudStack related
>> services
 
 IaaS Cloud Design & Build<
 http://shapeblue.com/iaas-cloud-design-and-build//>
 CSForge – rapid IaaS deployment framework>> 
 CloudStack Consulting
 CloudStack Infrastructure Support<
 http://shapeblue.com/cloudstack-infrastructure-support/>
 CloudStack Bootcamp Training Courses<
 http://shapeblue.com/cloudstack-training/>
 
 This email and any attachments to it may be confidential and are
>> intended
 solely for the use of the individual to whom it is addressed. Any views
>> or
 opinions expressed are solely those of the author and do not necessarily
 represent those of Shape Blue Ltd or related companies. If you are not
>> the
 intended recipient of this email, you must neither take any action based
 upon its contents, nor copy or show it to anyone. Please contact the
>> sender
 if you believe you have received this email in error. Shape Blue Ltd is
>> a
 company incorporated in England & Wales. ShapeBlue Services India LLP
>> is a
 company incorporated in India and is operated under license from Shape
>> Blue
 Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in
>> Brasil
 and is operated under license from Shape Blue Ltd. ShapeBlue is a
 registered trademark.
 
>> 
>> --
>> @shankerbalan
>> 
>> M: +91 98860 60539 | O: +91 (80) 67935867
>> shanker.ba...@shapeblue.com | www.shapeblue.com | Twitter:@shapeblue
>> ShapeBlue Services India LLP, 22nd floor, Unit 2201A, World Trade Centre,
>> Bangalore - 560 055
>> 
>> Find out more about ShapeBlue and our range of CloudStack related services
>> 
>> IaaS Cloud Design & Build<
>> http://shapeblue.com/iaas-cloud-design-and-build//>
>> CSForge – rapid IaaS deployment framework
>> CloudStack Consulting

Re: building and testing 4.4.

[Carlos Reátegui]

Hi Rohit,

On Jun 19, 2014, at 11:30 PM, Rohit Yadav  wrote:

> Hi Carlos,
> 
> On Fri, Jun 20, 2014 at 4:17 AM, Carlos Reategui 
> wrote:
> 
>> Hi Rohit,
>> Thanks for the info, but I was asking about the non-oss.  Is that included
>> in Wido's released versions?
>> 
> 
> This is oss (I checked the 4.3 release debs, and could not find vmware jars
> and other non-oss stuff).
> 
Thanks for checking… I guess I could have done that.

> 
>> 
>> I'm assuming the zip file you linked below will give me the same as:
>> git checkout remotes/origin/4.4
>> 
> 
> Yes :)
> 
> 
>> Also, what is the issue with tomcat 6.0.35?  I just noticed that my
>> Management Server is running the default Ubuntu tomcat6 which is 6.0.35.
>> Are all versions of CloudStack affected?
>> 
> 
> Historically we've been using 6.0.33, we need to revisit it. For now I
> would recommend you to use Tomcat 6.0.33.
How do you recommend dealing with the tomcat6 dependency check in the 
cloudstack install? I found 6.0.32 debs here: 
https://launchpad.net/ubuntu/precise/amd64/tomcat6/6.0.32-5ubuntu1 would those 
be ok?  Should I build my own? I am assuming these instructions should work for 
ubuntu: 
http://plone.uconn.edu/workspaces/uits-linux/standard-operating-procedures-sop/packaging-tomcat-6-for-debian

> 
> Thanks for filing the doc bug.
No prob.  I wold have made the changes myself but wasn’t sure what the 
preferred solution for the above dependency should be.

> 
> Regards.
> 

Re: Kemp load balancers

[Carlos Reátegui]

Hi Ilya,
This should not be that hard to script either.  If you use one of the APIs 
(like CloudMonkey) to launch your VMs you can query to see what IP was assigned 
to the machine(s) and then communicate that to your LB using whatever API kemp 
has.
-Carlos


On Jun 19, 2014, at 10:30 PM, Shanker Balan  wrote:

> Comments inline.
> 
> On 20-Jun-2014, at 10:29 am, Ian Marshall  wrote:
> 
>> Hi Ilya
>> 
>> I might of not been specific enough in my original email, I want to use the
>> Kemps as load balancers/ssl termination for the VMs and not for the
>> Cloudstack system. Yes, it would be great to have them integrated into
>> Cloudstack like the Netscallers and F5 but I don't have the time and
>> resource to consider using my java development team to write a plugin at
>> this stage.
>> 
>> My plan based on my Openstack scenario, is the Kemps which are clustered
>> have VIPs set tot he front end web servers which are running on VMs inside
>> the cloud.
> 
> Since the vendor or the ACS community has not integrated ACS with Kemps, you
> can workaround the situation as below:
> 
> 1) Spin up your VMs
> 2) Note down the IPs of the VMs
> 3) Run the Kemps in the same network or atleast ensure that the Kemp can
> route traffic to the VM subnet
> 4) Configure your VIP on the Kemp and add the VMs are reals
> 5) Modify VM’s ACLs to allow inbound traffic from the VIP
> 
> 
> With the Kemp integration into cloudstack, all of this should be doable
> from the ACS UI itself but that will have to wait.
> 
> 
> 
>> 
>> My setup is 2 management servers which would be running mariadb cluster and
>> two KVM hosts and a Dell EQLX SAN for running the VMs [to replicate the
>> 'running VMs from SAN - block storage' in Openstack.
>> 
>> Is this workable and is there any potential issues with this setup?
> 
> Looks straightforward enough to get started on ACS.
> 
> Regards.
> @shankerbalan
> 
> 
> --
> @shankerbalan
> 
> M: +91 98860 60539 | O: +91 (80) 67935867
> shanker.ba...@shapeblue.com | www.shapeblue.com | Twitter:@shapeblue
> ShapeBlue Services India LLP, 22nd floor, Unit 2201A, World Trade Centre, 
> Bangalore - 560 055
> 
> Find out more about ShapeBlue and our range of CloudStack related services
> 
> IaaS Cloud Design & Build
> CSForge – rapid IaaS deployment framework
> CloudStack Consulting
> CloudStack Infrastructure 
> Support
> CloudStack Bootcamp Training 
> Courses
> 
> This email and any attachments to it may be confidential and are intended 
> solely for the use of the individual to whom it is addressed. Any views or 
> opinions expressed are solely those of the author and do not necessarily 
> represent those of Shape Blue Ltd or related companies. If you are not the 
> intended recipient of this email, you must neither take any action based upon 
> its contents, nor copy or show it to anyone. Please contact the sender if you 
> believe you have received this email in error. Shape Blue Ltd is a company 
> incorporated in England & Wales. ShapeBlue Services India LLP is a company 
> incorporated in India and is operated under license from Shape Blue Ltd. 
> Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
> operated under license from Shape Blue Ltd. ShapeBlue is a registered 
> trademark.

Re: Realhostip.com Migration

[Carlos Reátegui]

Since this is an internal deployment I don’t really care about SSL at this time.

Does 4.1 enable SSL by default?  If so how do I disable it prior to upgrading?


On Jun 18, 2014, at 9:18 PM, Suresh Sadhu  wrote:

> If  you are upgrading from 4.2 to 4.4(before upgrade  you uploaded 
> certificates successfully) still  you need to re-upload the your  SSL  
> certificates  after upgrade for the new fixes to take effect. 
> 
> In 4.2 ssl is enabled(by default) and after upgrade CS keeps the same  
> configuration(i.e ssl enabled by default) but for  fresh 4.3/4.4 
> installations SSL is disabled by default.
> 
> 
> Regards
> Sadhu
> 
> 
> 
> 
> 
> 
> 
> 
> 
> -Original Message-
> From: Amogh Vasekar [mailto:amogh.vase...@citrix.com] 
> Sent: 19 June 2014 00:21
> To: users@cloudstack.apache.org
> Subject: Re: Realhostip.com Migration
> 
> Hi,
> 
> If you wish to enable SSL for console access and SSVM, yes :-) For fresh 
> installs, SSL would be disabled by default.
> 
> Thanks,
> Amogh
> 
> On 6/18/14 11:48 AM, "Carlos Reátegui"  wrote:
> 
>> So if I upgrade to 4.4 once it is available do I still need to follow 
>> the steps for realhostip migration?
>> 
>> On Jun 18, 2014, at 11:07 AM, Amogh Vasekar 
>> wrote:
>> 
>>> Hi,
>>> 
>>> Please refer to
>>> http://comments.gmane.org/gmane.comp.apache.cloudstack.user/12350 for 
>>> the  bugs that may exist in versions prior to CloudStack 4.4
>>> 
>>> Thanks,
>>> Amogh
>>> 
>>> On 6/17/14 9:33 PM, "Shweta Agarwal"  wrote:
>>> 
>>>> Its supported for 4.2 , 4.3 and 4.4 as well.
>>>> 
>>>> 
>>>> Shweta
>>>> 
>>>> -Original Message-
>>>> From: Tim Mackey [mailto:tmac...@gmail.com]
>>>> Sent: Tuesday, June 17, 2014 10:50 PM
>>>> To: users@cloudstack.apache.org
>>>> Subject: Re: Realhostip.com Migration
>>>> 
>>>> Rich,
>>>> 
>>>> I followed the Citrix KB article referenced here (
>>>> 
>>>> https://cwiki.apache.org/confluence/display/CLOUDSTACK/Realhost+IP+ch
>>>> ang
>>>> es
>>>> )
>>>> with 4.2 and it worked fine for me using SSL.  Just remember to get 
>>>> a  wildcard SSL cert, and be careful pasting it into the CloudStack UI.
>>>> 
>>>> -tim
>>>> 
>>>> 
>>>> On Tue, Jun 17, 2014 at 12:18 PM, Richard Chatterton < 
>>>> richard.chatter...@contegix.com> wrote:
>>>> 
>>>>> Folks,
>>>>> 
>>>>> I was just reading through my backlog of messages and I see that 
>>>>> the Realhostip.com service has been extended to September 30th. Hurray!
>>>>> 
>>>>> I also see the following in the message where that was announced:
>>>>> 
>>>>>> While testing Realhostip fixes additional product issues were 
>>>>>> found
>>>>> which are tracked in following three defects CLOUDSTACK-6499 [1],
>>>>> CLOUDSTACK-6599 [2], CLOUDSTACK-6824 [3] . These defects are fixed 
>>>>> in
>>>>> 4.4 and master branch. Please verify in your setups. If you are on 
>>>>> older version of CloudStack do plan on upgrading to 4.4 . 
>>>>> Additional details on fixes are available in JIRA.  Updated wiki 
>>>>> with steps will be published shortly.
>>>>> 
>>>>> Is it strictly necessary to upgrade CloudStack to 4.4 before 
>>>>> migrating away from realhostip.com? Has anyone successfully 
>>>>> migrated away from it on an older version of CloudStack?
>>>>> 
>>>>> Best,
>>>>> Rich Chatterton
>>>>> 
>>> 
>> 
> 

Re: [POLL] Who uses "awsapi" with CloudStack in production?

[Carlos Reátegui]

Hi Daan,

I have not tried 4.3.  I saw some of the issues people were having and decided 
to hold off from trying.

Do you suggest I try with 4.3 or should I build my own deb packages and try 4.4?

BTW I am on ubuntu 12.04 + XenServer 6.0.2


On Jun 19, 2014, at 12:35 AM, Daan Hoogland  wrote:

> Carlos, please export your db and do a test upgrade on a lab machine?
> Now is the time to solve any upgrade issues in 4.4.
> 
> Have you tried the 4.3 upgrade already?
> 
> regards,
> Daan
> 
> On Wed, Jun 18, 2014 at 7:04 PM, Carlos Reátegui  wrote:
>> Hi Rohit,
>> 
>> The awsapi was one of the reasons we chose to use ACS.  We have developed 
>> some internal tools and apps to manage our deployments on AWS that we want 
>> to re-use on ACS.  We have not been able to use it yet because it was broken 
>> in 4.1.1.  We tried to upgrade to 4.2 and were unsuccessful and are now 
>> waiting for 4.4 to finally upgrade and hopefully be able to use the awsapi.
>> 
>> We use ACS internally for development and testing of our applications that 
>> we push to AWS.
>> 
>> thanks,
>> Carlos
>> 
>> 
>> On Jun 18, 2014, at 12:11 AM, Rohit Yadav  wrote:
>> 
>>> Hi,
>>> 
>>> Who uses "awsapi" or any other EC2 compatible interface such as ec2stack
>>> with CloudStack (or CloudStack distros such as Citrix CloudPlatform) in
>>> production? And, if marketing and publicity are/were big motivation(s)?
>>> 
>>> In case you don't want to discuss on this thread, please take this
>>> anonymous poll:
>>> http://www.polljunkie.com/poll/fbyfdc/who-uses-awsapi-with-cloudstack-in-prouduction
>>> 
>>> # Some stats
>>> 
>>> I've been watching Collab14 videos and found references where many speakers
>>> reference overall CloudStack codebase to be about 1.5M (million) lines of
>>> Java code which is not "exactly" true. Let me share some findings;
>>> 
>>> - As of today, CloudStack master is about 1.7M lines of Java code [1]
>>> - CloudStack "awsapi" artifact is 1.04M lines of Java code [2]
>>> - Code excluding "awsapi", tests and license/comment is about 590k lines of
>>> Java code [3]
>>> - The core excluding plugins, api and the above is about 300k lines of Java
>>> code [4]
>>> 
>>> Why should  I care:
>>> - some useful/fun stats to keep in mind
>>> - it's not a giant mammoth that cannot be fixed or developed upon
>>> - encouraging for new developers that if they try they can understand and
>>> fix it
>>> 
>>> FYI, this started on twitter yesterday:
>>> https://twitter.com/_bhaisaab/status/479007075414974465
>>> 
>>> [1] cd cloudstack-repo && find . | grep java$ | xargs cat | wc -l
>>> [2] cd cloudstack-repo && find awsapi | grep java$ | xargs cat | wc -l
>>> [3] cd cloudstack-repo && find . | grep -v awsapi | grep -v [tT]est | grep
>>> java$ | xargs cat | grep -v '^//' | wc -l
>>> [4] cd cloudstack-repo && find . | grep -v awsapi | grep -v [Tt]est | grep
>>> -v plugins | grep -v api | grep java$ | xargs cat | grep -v '^//' | wc -l
>>> 
>>> Regards.
>> 
> 
> 
> 
> -- 
> Daan

Re: Realhostip.com Migration

[Carlos Reátegui]

So if I upgrade to 4.4 once it is available do I still need to follow the steps 
for realhostip migration?

On Jun 18, 2014, at 11:07 AM, Amogh Vasekar  wrote:

> Hi,
> 
> Please refer to 
> http://comments.gmane.org/gmane.comp.apache.cloudstack.user/12350 for the
> bugs that may exist in versions prior to CloudStack 4.4
> 
> Thanks,
> Amogh
> 
> On 6/17/14 9:33 PM, "Shweta Agarwal"  wrote:
> 
>> Its supported for 4.2 , 4.3 and 4.4 as well.
>> 
>> 
>> Shweta
>> 
>> -Original Message-
>> From: Tim Mackey [mailto:tmac...@gmail.com]
>> Sent: Tuesday, June 17, 2014 10:50 PM
>> To: users@cloudstack.apache.org
>> Subject: Re: Realhostip.com Migration
>> 
>> Rich,
>> 
>> I followed the Citrix KB article referenced here (
>> https://cwiki.apache.org/confluence/display/CLOUDSTACK/Realhost+IP+changes
>> )
>> with 4.2 and it worked fine for me using SSL.  Just remember to get a
>> wildcard SSL cert, and be careful pasting it into the CloudStack UI.
>> 
>> -tim
>> 
>> 
>> On Tue, Jun 17, 2014 at 12:18 PM, Richard Chatterton <
>> richard.chatter...@contegix.com> wrote:
>> 
>>> Folks,
>>> 
>>> I was just reading through my backlog of messages and I see that the
>>> Realhostip.com service has been extended to September 30th. Hurray!
>>> 
>>> I also see the following in the message where that was announced:
>>> 
 While testing Realhostip fixes additional product issues were found
>>> which are tracked in following three defects CLOUDSTACK-6499 [1],
>>> CLOUDSTACK-6599 [2], CLOUDSTACK-6824 [3] . These defects are fixed in
>>> 4.4 and master branch. Please verify in your setups. If you are on
>>> older version of CloudStack do plan on upgrading to 4.4 . Additional
>>> details on fixes are available in JIRA.  Updated wiki with steps will
>>> be published shortly.
>>> 
>>> Is it strictly necessary to upgrade CloudStack to 4.4 before migrating
>>> away from realhostip.com? Has anyone successfully migrated away from
>>> it on an older version of CloudStack?
>>> 
>>> Best,
>>> Rich Chatterton
>>> 
> 

Re: [POLL] Who uses "awsapi" with CloudStack in production?

[Carlos Reátegui]

Hi Rohit,

The awsapi was one of the reasons we chose to use ACS.  We have developed some 
internal tools and apps to manage our deployments on AWS that we want to re-use 
on ACS.  We have not been able to use it yet because it was broken in 4.1.1.  
We tried to upgrade to 4.2 and were unsuccessful and are now waiting for 4.4 to 
finally upgrade and hopefully be able to use the awsapi.

We use ACS internally for development and testing of our applications that we 
push to AWS.

thanks,
Carlos


On Jun 18, 2014, at 12:11 AM, Rohit Yadav  wrote:

> Hi,
> 
> Who uses "awsapi" or any other EC2 compatible interface such as ec2stack
> with CloudStack (or CloudStack distros such as Citrix CloudPlatform) in
> production? And, if marketing and publicity are/were big motivation(s)?
> 
> In case you don't want to discuss on this thread, please take this
> anonymous poll:
> http://www.polljunkie.com/poll/fbyfdc/who-uses-awsapi-with-cloudstack-in-prouduction
> 
> # Some stats
> 
> I've been watching Collab14 videos and found references where many speakers
> reference overall CloudStack codebase to be about 1.5M (million) lines of
> Java code which is not "exactly" true. Let me share some findings;
> 
> - As of today, CloudStack master is about 1.7M lines of Java code [1]
> - CloudStack "awsapi" artifact is 1.04M lines of Java code [2]
> - Code excluding "awsapi", tests and license/comment is about 590k lines of
> Java code [3]
> - The core excluding plugins, api and the above is about 300k lines of Java
> code [4]
> 
> Why should  I care:
> - some useful/fun stats to keep in mind
> - it's not a giant mammoth that cannot be fixed or developed upon
> - encouraging for new developers that if they try they can understand and
> fix it
> 
> FYI, this started on twitter yesterday:
> https://twitter.com/_bhaisaab/status/479007075414974465
> 
> [1] cd cloudstack-repo && find . | grep java$ | xargs cat | wc -l
> [2] cd cloudstack-repo && find awsapi | grep java$ | xargs cat | wc -l
> [3] cd cloudstack-repo && find . | grep -v awsapi | grep -v [tT]est | grep
> java$ | xargs cat | grep -v '^//' | wc -l
> [4] cd cloudstack-repo && find . | grep -v awsapi | grep -v [Tt]est | grep
> -v plugins | grep -v api | grep java$ | xargs cat | grep -v '^//' | wc -l
> 
> Regards.

Re: Is there any in-guest agent need to be installed on CloudStack Instances?

[Carlos Reátegui]

Cloud-init works on cloudstack too. The UI does not support userdata but you 
can pass it in if you start instances via API. 

Please note there is a bug in Ubuntu 12.04 default cloudinit that does not use 
the correct metadata server.  If you use that OS let me know. 

Once the vms are up, I would suggest using one of the various config management 
options out there (eg puppet, chef, cfengine, etc). 


> On May 31, 2014, at 5:44 AM, hossein zabolzadeh  wrote:
> 
> But, how the virtual machine provisioned with specific configuration(Like
> IP Address, SSH Key, ...)? In other words how the Virtual Machine fetch
> these information during spawal?
> For example openStack instances use cloud-init to fetch these type of
> information. What about the CloudStack?
> Thanks in advance.
> 
> 
> On Sat, May 31, 2014 at 5:10 PM, Andrija Panic 
> wrote:
> 
>> true :)
>> 
>> 
>>> On 31 May 2014 14:39, hossein zabolzadeh  wrote:
>>> 
>>> Oh, That was host agent.
>>> Thanks.
>>> 
>>> 
 On Sat, May 31, 2014 at 5:03 PM, Nux!  wrote:
 
> On 31.05.2014 13:24, hossein zabolzadeh wrote:
> 
> Dear Andrija.
> What about the agent on KVM machine? Check the page 27 of the
>> following
> presentation.
> http://www.slideshare.net/cloudstack/cloudstack-architecture
> 
 
 That "agent" is the software installed on the HV, aka cloudstack-agent.
>>> No
 software is needed in the virtual machine.
 
 HTH
 Lucian
 
 --
 Sent from the Delta quadrant using Borg technology!
 
 Nux!
 www.nux.ro
 
>>> 
>> 
>> 
>> 
>> --
>> 
>> Andrija Panić
>> --
>>  http://admintweets.com
>> --
>> 

Re: X on CentOS instance

[Carlos Reátegui]

What about forwarding X with ssh -Y? 

On May 27, 2014, at 6:25 PM, Kirk Kosinski  wrote:

> Hi, this is due to PV mode VMs on XenServer not having a virtual
> graphics card.  The console for such VMs is a serial console so X cannot
> run.  If you need a GUI, try configuring VNC in the VM and connect
> directly using a VNC client.
> 
> Best regards,
> Kirk
> 
> On 05/27/2014 11:52 AM, Hollman Enciso R. wrote:
>> On Tue, May 27, 2014 at 12:47 PM, Ahmad Emneina  wrote:
>> 
>>> looks like this is your issue:
>>> 
>>> (EE) open /dev/fb0: No such device
>>> 
>>> The guest cant find the frame buffer device. You should be able to google
>>> that up and hopefully find some solutions.
>>> 
>> 
>> I'm looking for a solution to CloudStack level but not at the level of OS.
>> 
>> This happens to me whenever I do an installation of centos or redhat with
>> CloudStack.
>> I use the same iso on another hypervisor not managed by CloudStack and works
>> ok
>> 
>> I tested another iso and install new instances (RedHat and CentOS / with
>> graphicall enviorement) and the result it's the same :(
>> 
>> 

Re: XenServer 6.2 and ACS XenServer Support Package

[Carlos Reátegui]

I believe OVS is only required for security groups in a basic network.

I am using a shared network without security groups in a basic zone with OVS.  
No issues over the last 9 months.  With a bridge backend you are limited to 2 
NICs in a bond on the XenCenter UI, but with OVS you can use 4 NICs.


On May 20, 2014, at 2:34 PM, Tim Mackey  wrote:

> Andrei,
> 
> Those commands are still required for use in a CloudStack basic zone.  If
> you are using an advanced zone, then the default XenServer backend of ovs
> is correct.
> 
> -tim
> 
> 
> On Tue, May 20, 2014 at 5:29 PM, Andrei Mikhailovsky wrote:
> 
>> Hi guys,
>> 
>> I am looking at the installation guide for XenServer hypervisor and got a
>> question about this section:
>> 
>> 
>> http://docs.cloudstack.apache.org/projects/cloudstack-installation/en/latest/hypervisor/xenserver.html#install-cloudstack-xenserver-support-package-csp
>> 
>> It states that the CSP functionality is already present in XenServer 6.1.
>> I assume it is also present in XenServer 6.2.
>> 
>> The question is do I still need to run the following commands as shown in
>> the guide as Optional:
>> 
>> 
>> 
>> xe-switch-network-backend bridge
>> 
>> net.bridge.bridge-nf-call-iptables = 1
>> net.bridge.bridge-nf-call-ip6tables = 0
>> net.bridge.bridge-nf-call-arptables = 1
>> 
>> $ sysctl -p /etc/sysctl.conf
>> 
>> 
>> Would I still be able to use the XenServer hypervisor with default
>> settings?
>> 
>> Thanks
>> 
>> Andrei
>> 
>> 
>> 
>> 
>> 

Re: Troubles with CloudStack 4.3 (new user)

[Carlos Reátegui]

try setting secstorage.allowed.internal.sites in Global Settings in the UI to 
include that ip or subnet 10.19.40.0/24


On May 19, 2014, at 4:44 PM, Steve Cleveland  
wrote:

> 
> On 05/19/2014 04:30 PM, Carlos Reátegui wrote:
>> Not sure if this will help but try disabling iptables on the XS host.
> 
> The 10.19.40.81 address is the MS.  I have tried disabling iptables on both 
> MS and XS but no change.
> 
> - Steve
> 
> 
>> 
>> 
>> On May 19, 2014, at 3:51 PM, Steve Cleveland  
>> wrote:
>> 
>>> I'm running into a few problems setting up cloudstack for the first time.  
>>> Most I've resolved, but I wanted to share.  I'm using CentOS 6.5 and 
>>> XenServer 6.2.  Both have the latest updates installed.  And I'm using an 
>>> external MariaDB 5.5.35 server and an external NFS server (both primary and 
>>> secondary storage).  I'm following these instructions:
>>> 
>>> http://docs.cloudstack.apache.org/projects/cloudstack-installation/en/latest/installation.html
>>> 
>>> 1. The RPM package repository shows setting up 4.2.  Substituting 4.3 works 
>>> fine.
>>> 
>>> 2. The section on MySQL running on the MS says to run 
>>> cloudstack-setup-management on step 9.  Using an external MySQL section 
>>> does not include this step, but causes errors if I manually try to start 
>>> the cloudstack-managment service.  I assume that's just a documentation 
>>> problem and that I'm supposed to run cloudstack-setup-management.
>>> 
>>> 3. After running 'cloudstack-setup-management' it starts the service.  But 
>>> the web interface never comes up (I get a service unavailable error).  The 
>>> management-server.log file has this error:
>>> 
>>> 2014-05-19 13:19:42,120 ERROR [c.c.u.DatabaseUpgradeChecker] (main:null) 
>>> Unable to execute upgrade script: 
>>> /usr/share/cloudstack-management/setup/db/schema-421to430.sql
>>> java.sql.SQLException: You can't specify target table 'configuration' for 
>>> update in FROM clause
>>> 
>>> I've duplicated this multiple times.  It appears that the 
>>> cloudstack-setup-databases script configures an older database layout and 
>>> then has to run this script when it first starts.  But there are two lines 
>>> that are invalid, at least to MariaDB.
>>> 
>>> UPDATE `cloud`.`configuration` SET value = CONCAT("*.",(SELECT 
>>> `temptable`.`value` FROM (SELECT * FROM `cloud`.`configuration` WHERE 
>>> `name`="consoleproxy.url.domain") AS `temptable` WHERE 
>>> `temptable`.`name`="consoleproxy.url.domain")) WHERE 
>>> `name`="consoleproxy.url.domain";
>>> UPDATE `cloud`.`configuration` SET `value` = CONCAT("*.",(SELECT 
>>> `temptable`.`value` FROM (SELECT * FROM `cloud`.`configuration` WHERE 
>>> `name`="secstorage.ssl.cert.domain") AS `temptable` WHERE 
>>> `temptable`.`name`="secstorage.ssl.cert.domain")) WHERE 
>>> `name`="secstorage.ssl.cert.domain";
>>> 
>>> That table is empty on a new install anyway (which may be the reason for 
>>> the error), so I commented them out.  Since it failed part way through, it 
>>> generates more errors.  So I've had to delete the databases and rerun 
>>> cloudstack-setup-databases and restart the service.
>>> 
>>> 4. I download vhd-util to 
>>> /usr/share/cloudstack-common/scripts/vm/hypervisor/xenserver on the MS 
>>> before adding the XenServer, but it doesn't get copied to 
>>> /opt/xensource/bin.  I manually copy it and is then able to create the 
>>> system VMs.
>>> 
>>> 5. After I setup the zone, I finally get the s- and v- VMs running. But I'm 
>>> not getting the CentOS built-in template.  It just says "Ready: No".  If I 
>>> login to the SSVM and look at /var/log/cloud.log, I see:
>>> 
>>> 2014-05-19 22:29:59,143 INFO  [utils.nio.NioClient] (Agent-Selector:null) 
>>> Connecting to 10.19.40.81:8250
>>> 2014-05-19 22:29:59,147 ERROR [utils.nio.NioConnection] 
>>> (Agent-Selector:null) Unable to initialize the threads.
>>> java.io.IOException: SSL: Fail to init SSL! java.io.IOException: Connection 
>>> closed with -1 on reading size.
>>>at com.cloud.utils.nio.NioClient.init(NioClient.java:84)
>>>at com.cloud.utils.nio.NioConnection.run(NioConnection.java:108)
>>>at java.lang.Thread.run(Thread.java:679)
>>> 
>>> It happens over and over about every five seconds.  I'm guessing this is 
>>> the source of my problem.  If I run 
>>> /usr/local/cloud/systemvm/ssvm-check.sh, it reports everything is Good.  I 
>>> haven't setup SSL in any fashion as it's an early PoC.
>>> 
>>> The Systems VM page shows both system VMs as up.  But the 
>>> management-server.log file prints this every 30 seconds:
>>> 
>>> 2014-05-19 15:41:38,556 DEBUG [c.c.s.s.SecondaryStorageManagerImpl] 
>>> (secstorage-1:ctx-ed6e40a6) Zone 1 is ready to launch secondary storage VM
>>> 
>>> Any help with this last issue is greatly appreciated.  Again, this a 
>>> brand-new, unmodified installation.
>>> 
>>> Thanks,
>>> - Steve
>> 

Re: Troubles with CloudStack 4.3 (new user)

[Carlos Reátegui]

Not sure if this will help but try disabling iptables on the XS host.


On May 19, 2014, at 3:51 PM, Steve Cleveland  
wrote:

> I'm running into a few problems setting up cloudstack for the first time.  
> Most I've resolved, but I wanted to share.  I'm using CentOS 6.5 and 
> XenServer 6.2.  Both have the latest updates installed.  And I'm using an 
> external MariaDB 5.5.35 server and an external NFS server (both primary and 
> secondary storage).  I'm following these instructions:
> 
> http://docs.cloudstack.apache.org/projects/cloudstack-installation/en/latest/installation.html
> 
> 1. The RPM package repository shows setting up 4.2.  Substituting 4.3 works 
> fine.
> 
> 2. The section on MySQL running on the MS says to run 
> cloudstack-setup-management on step 9.  Using an external MySQL section does 
> not include this step, but causes errors if I manually try to start the 
> cloudstack-managment service.  I assume that's just a documentation problem 
> and that I'm supposed to run cloudstack-setup-management.
> 
> 3. After running 'cloudstack-setup-management' it starts the service.  But 
> the web interface never comes up (I get a service unavailable error).  The 
> management-server.log file has this error:
> 
> 2014-05-19 13:19:42,120 ERROR [c.c.u.DatabaseUpgradeChecker] (main:null) 
> Unable to execute upgrade script: 
> /usr/share/cloudstack-management/setup/db/schema-421to430.sql
> java.sql.SQLException: You can't specify target table 'configuration' for 
> update in FROM clause
> 
> I've duplicated this multiple times.  It appears that the 
> cloudstack-setup-databases script configures an older database layout and 
> then has to run this script when it first starts.  But there are two lines 
> that are invalid, at least to MariaDB.
> 
> UPDATE `cloud`.`configuration` SET value = CONCAT("*.",(SELECT 
> `temptable`.`value` FROM (SELECT * FROM `cloud`.`configuration` WHERE 
> `name`="consoleproxy.url.domain") AS `temptable` WHERE 
> `temptable`.`name`="consoleproxy.url.domain")) WHERE 
> `name`="consoleproxy.url.domain";
> UPDATE `cloud`.`configuration` SET `value` = CONCAT("*.",(SELECT 
> `temptable`.`value` FROM (SELECT * FROM `cloud`.`configuration` WHERE 
> `name`="secstorage.ssl.cert.domain") AS `temptable` WHERE 
> `temptable`.`name`="secstorage.ssl.cert.domain")) WHERE 
> `name`="secstorage.ssl.cert.domain";
> 
> That table is empty on a new install anyway (which may be the reason for the 
> error), so I commented them out.  Since it failed part way through, it 
> generates more errors.  So I've had to delete the databases and rerun 
> cloudstack-setup-databases and restart the service.
> 
> 4. I download vhd-util to 
> /usr/share/cloudstack-common/scripts/vm/hypervisor/xenserver on the MS before 
> adding the XenServer, but it doesn't get copied to /opt/xensource/bin.  I 
> manually copy it and is then able to create the system VMs.
> 
> 5. After I setup the zone, I finally get the s- and v- VMs running. But I'm 
> not getting the CentOS built-in template.  It just says "Ready: No".  If I 
> login to the SSVM and look at /var/log/cloud.log, I see:
> 
> 2014-05-19 22:29:59,143 INFO  [utils.nio.NioClient] (Agent-Selector:null) 
> Connecting to 10.19.40.81:8250
> 2014-05-19 22:29:59,147 ERROR [utils.nio.NioConnection] (Agent-Selector:null) 
> Unable to initialize the threads.
> java.io.IOException: SSL: Fail to init SSL! java.io.IOException: Connection 
> closed with -1 on reading size.
>at com.cloud.utils.nio.NioClient.init(NioClient.java:84)
>at com.cloud.utils.nio.NioConnection.run(NioConnection.java:108)
>at java.lang.Thread.run(Thread.java:679)
> 
> It happens over and over about every five seconds.  I'm guessing this is the 
> source of my problem.  If I run /usr/local/cloud/systemvm/ssvm-check.sh, it 
> reports everything is Good.  I haven't setup SSL in any fashion as it's an 
> early PoC.
> 
> The Systems VM page shows both system VMs as up.  But the 
> management-server.log file prints this every 30 seconds:
> 
> 2014-05-19 15:41:38,556 DEBUG [c.c.s.s.SecondaryStorageManagerImpl] 
> (secstorage-1:ctx-ed6e40a6) Zone 1 is ready to launch secondary storage VM
> 
> Any help with this last issue is greatly appreciated.  Again, this a 
> brand-new, unmodified installation.
> 
> Thanks,
> - Steve

Re: Ubuntu instances + cloud-init

[Carlos Reátegui]

Hi Nux,
You can have a look at the patch that I created to fix the default cloud-init 
version on 12.04:

https://github.com/creategui/CloudStackImageScripts

The file you are looking for is DataSourceCloudStack.patch

Regards,
-Carlos

On Apr 15, 2014, at 10:32 AM, Nux!  wrote:

> On 15.04.2014 17:25, Rafael Weingartner wrote:
>> what script are you talking about ? the one to enable password changes?
> 
> Yes, that one.
> Ideally I'd hook it into cloud-init like I do with CentOS[1].
> 
> 
> [1] - http://li.nux.ro/download/cloudstack/ks/CentOS6_64bit_password_sshkey.ks
> 
> -- 
> Sent from the Delta quadrant using Borg technology!
> 
> Nux!
> www.nux.ro

Re: about openvswitch

[Carlos Reátegui]

Steven,
I am using ovs on xenserver 6.0.2 and 6.1 with CS 4.1.  The main benefit for me 
was being able to create 4 nic bonds, with bridge you are limited to 2 nics per 
bond.  The downside however is that you can not use security groups in a basic 
network so I had to create an offering without them.  For my use that was ok.  
This may have changed in more recent versions of CS.

-Carlos

On Mar 10, 2014, at 1:59 PM, Steven Liang  wrote:

> Hi,
> 
> I found from the document that we can use openvswitch instead of
> traditional bridge.
> Who can tell me the benefit using openvswitch?
> I used basic zone, and I cannot read usage info. If I use openvswitch,
> can I get usage info?
> Thank you.
> 
> Regards,
> Steven
> 

Re: Disk IO on Cloudstack VMs

[Carlos Reátegui]

BTW the centos machine below is a 1 core machine and the ubuntu one is a 2 core 
machine.  Not sure if that makes a difference.  You may want to experiment.

On Mar 6, 2014, at 8:32 PM, Carlos Reátegui  wrote:

> Nishan,
> How did you originally setup your networks?  Did you do it all through 
> XenCenter, xe CLI, OS?  I believe I did it all through XC.  I am running XS 
> 6.0.2 with CS 4.1.  Did you switch to bridge networking?  I did not as it 
> only supports 2 nic bonds.
> 
> My hosts are set up with 4x1Gbe bond for NAS network (storage label) and 
> 4x1Gbe bond for CS Management/CS Storage/CS Guest (cloud-public label).  Both 
> bonds are active active.  I am using basic networking but without security 
> groups since that requires bridge networking.  Security is not really an 
> issue for this setup as it is used internally by QA and dev.
> 
> On one of my hosts:
> # dd if=/dev/zero of=test.dmp bs=1M conv=fdatasync count=1000
> 1000+0 records in
> 1000+0 records out
> 1048576000 bytes (1.0 GB) copied, 9.97504 seconds, 105 MB/s
> 
> On a CentOS 5 guest:
> # dd if=/dev/zero of=/mnt/test.dmp bs=1M conv=fdatasync count=1000
> 1000+0 records in
> 1000+0 records out
> 1048576000 bytes (1.0 GB) copied, 13.1997 seconds, 79.4 MB/s
> 
> On an ubuntu 12.04 guest:
> $ dd if=/dev/zero of=test.dmp bs=1M conv=fdatasync count=1000
> 1000+0 records in
> 1000+0 records out
> 1048576000 bytes (1.0 GB) copied, 9.85764 s, 106 MB/s
> 
> I tried the above a handful of times on each and they were within a couple % 
> of each other every time.  Both of the guests are on the same host I tested 
> above.  The SR is on NFS on the same machine as the CS Management stack 
> (Ubuntu 12.04).  That machine is connected to the storage via 10Gbe and a 
> 2x1Gbe bond to the cloud-public network.  No routes exist between these 2 
> networks.  MTU is 1500 for both networks.  I have another setup at a 
> different location where I set the MTU to 9000 and I seem to remember getting 
> a bit faster throughput at least on the hosts.  I’ll check later and let you 
> know.
> 
> Let me know if there is anything you want me to check in my setup to compare.
> 
> Carlos
> 
> 
> On Mar 6, 2014, at 5:14 PM, Nishan Sanjeewa Gunasekara 
>  wrote:
> 
>> Hi Shankar,
>> 
>> 10% overhead for virtual disk seems reasonable.
>> My VM is PV and I've installed xenserver tools as well. But still getting
>> 20Mbps where as on the host its 150Mbps.
>> 
>> Have you tuned up your VM or changed any parameters?
>> 
>> Regards,
>> Nishan
>> 
>> 
>> On Wed, Mar 5, 2014 at 4:15 PM, Shanker Balan
>> wrote:
>> 
>>> Comments inline.
>>> 
>>> On 05-Mar-2014, at 10:01 am, Nishan Sanjeewa Gunasekara <
>>> nishan.sanje...@gmail.com> wrote:
>>> 
>>>> Hi,
>>>> 
>>>> I'm running CS 4.2.1 on XenServer 6.2 hosts.
>>>> 
>>>> My primary storage is a ZFS file system provided via NFS.
>>>> 
>>>> When I do a dd test directly from one of the hosts on the NFS mount I
>>> get a
>>>> write speed of about 150MBps
>>>> 
>>>> dd if=/dev/zero of=test.dmp bs=1M conv=fdatasync count=1000
>>>> 1000+0 records in
>>>> 1000+0 records out
>>>> 1048576000 bytes (1.0 GB) copied, 6.99829 seconds, 150 MB/s
>>>> 
>>>> But when I do the same test on a Cloudstack VM running on the same host
>>>> (root disk on the same nfs mount ofcourse) I get a very low write speed.
>>>> 20MBps.
>>>> 
>>>> dd if=/dev/zero of=test.dmp bs=1M conv=fdatasync count=1000
>>>> 1000+0 records in
>>>> 1000+0 records out
>>>> 1048576000 bytes (1.0 GB) copied, 44.6171 s, 23.5 MB/s
>>>> 
>>>> Any ideas how I can improve this ?
>>> 
>>> 
>>> Is this a PV VM?
>>> 
>>> I just did a unscientific test in my lab on a PV VM. Results below:
>>> 
>>> On the XenServer:
>>> 
>>> [root@vxen1-1 ebb66062-d46f-7b3a-07be-b9ec583ec1a9]# dd if=/dev/zero
>>> of=test.dmp bs=1M conv=fdatasync count=1000
>>> 1000+0 records in
>>> 1000+0 records out
>>> 1048576000 bytes (1.0 GB) copied, 26.1396 seconds, 40.1 MB/s
>>> 
>>> On a VM:
>>> 
>>> [root@scan1 ~]# dd if=/dev/zero of=test.dmp bs=1M conv=fdatasync
>>> count=1000
>>> 1000+0 records in
>>> 1000+0 records out
>>> 1048576000 bytes (1.0 GB) copied, 29.4688 s, 35.6 MB/s
>>> 
>>> 
>>> I guess 10% is the virtual d

Re: Disk IO on Cloudstack VMs

[Carlos Reátegui]

Nishan,
How did you originally setup your networks?  Did you do it all through 
XenCenter, xe CLI, OS?  I believe I did it all through XC.  I am running XS 
6.0.2 with CS 4.1.  Did you switch to bridge networking?  I did not as it only 
supports 2 nic bonds.

My hosts are set up with 4x1Gbe bond for NAS network (storage label) and 4x1Gbe 
bond for CS Management/CS Storage/CS Guest (cloud-public label).  Both bonds 
are active active.  I am using basic networking but without security groups 
since that requires bridge networking.  Security is not really an issue for 
this setup as it is used internally by QA and dev.

On one of my hosts:
# dd if=/dev/zero of=test.dmp bs=1M conv=fdatasync count=1000
1000+0 records in
1000+0 records out
1048576000 bytes (1.0 GB) copied, 9.97504 seconds, 105 MB/s

On a CentOS 5 guest:
# dd if=/dev/zero of=/mnt/test.dmp bs=1M conv=fdatasync count=1000
1000+0 records in
1000+0 records out
1048576000 bytes (1.0 GB) copied, 13.1997 seconds, 79.4 MB/s

On an ubuntu 12.04 guest:
$ dd if=/dev/zero of=test.dmp bs=1M conv=fdatasync count=1000
1000+0 records in
1000+0 records out
1048576000 bytes (1.0 GB) copied, 9.85764 s, 106 MB/s

I tried the above a handful of times on each and they were within a couple % of 
each other every time.  Both of the guests are on the same host I tested above. 
 The SR is on NFS on the same machine as the CS Management stack (Ubuntu 
12.04).  That machine is connected to the storage via 10Gbe and a 2x1Gbe bond 
to the cloud-public network.  No routes exist between these 2 networks.  MTU is 
1500 for both networks.  I have another setup at a different location where I 
set the MTU to 9000 and I seem to remember getting a bit faster throughput at 
least on the hosts.  I’ll check later and let you know.

Let me know if there is anything you want me to check in my setup to compare.

Carlos


On Mar 6, 2014, at 5:14 PM, Nishan Sanjeewa Gunasekara 
 wrote:

> Hi Shankar,
> 
> 10% overhead for virtual disk seems reasonable.
> My VM is PV and I've installed xenserver tools as well. But still getting
> 20Mbps where as on the host its 150Mbps.
> 
> Have you tuned up your VM or changed any parameters?
> 
> Regards,
> Nishan
> 
> 
> On Wed, Mar 5, 2014 at 4:15 PM, Shanker Balan
> wrote:
> 
>> Comments inline.
>> 
>> On 05-Mar-2014, at 10:01 am, Nishan Sanjeewa Gunasekara <
>> nishan.sanje...@gmail.com> wrote:
>> 
>>> Hi,
>>> 
>>> I'm running CS 4.2.1 on XenServer 6.2 hosts.
>>> 
>>> My primary storage is a ZFS file system provided via NFS.
>>> 
>>> When I do a dd test directly from one of the hosts on the NFS mount I
>> get a
>>> write speed of about 150MBps
>>> 
>>> dd if=/dev/zero of=test.dmp bs=1M conv=fdatasync count=1000
>>> 1000+0 records in
>>> 1000+0 records out
>>> 1048576000 bytes (1.0 GB) copied, 6.99829 seconds, 150 MB/s
>>> 
>>> But when I do the same test on a Cloudstack VM running on the same host
>>> (root disk on the same nfs mount ofcourse) I get a very low write speed.
>>> 20MBps.
>>> 
>>> dd if=/dev/zero of=test.dmp bs=1M conv=fdatasync count=1000
>>> 1000+0 records in
>>> 1000+0 records out
>>> 1048576000 bytes (1.0 GB) copied, 44.6171 s, 23.5 MB/s
>>> 
>>> Any ideas how I can improve this ?
>> 
>> 
>> Is this a PV VM?
>> 
>> I just did a unscientific test in my lab on a PV VM. Results below:
>> 
>> On the XenServer:
>> 
>> [root@vxen1-1 ebb66062-d46f-7b3a-07be-b9ec583ec1a9]# dd if=/dev/zero
>> of=test.dmp bs=1M conv=fdatasync count=1000
>> 1000+0 records in
>> 1000+0 records out
>> 1048576000 bytes (1.0 GB) copied, 26.1396 seconds, 40.1 MB/s
>> 
>> On a VM:
>> 
>> [root@scan1 ~]# dd if=/dev/zero of=test.dmp bs=1M conv=fdatasync
>> count=1000
>> 1000+0 records in
>> 1000+0 records out
>> 1048576000 bytes (1.0 GB) copied, 29.4688 s, 35.6 MB/s
>> 
>> 
>> I guess 10% is the virtual disk overhead.
>> 
>> 
>> 
>> 
>> --
>> @shankerbalan
>> 
>> M: +91 98860 60539 | O: +91 (80) 67935867
>> shanker.ba...@shapeblue.com | www.shapeblue.com | Twitter:@shapeblue
>> ShapeBlue Services India LLP, 22nd floor, Unit 2201A, World Trade Centre,
>> Bangalore - 560 055
>> 
>> Need Enterprise Grade Support for Apache CloudStack?
>> Our CloudStack Infrastructure Support<
>> http://shapeblue.com/cloudstack-infrastructure-support/> offers the best
>> 24/7 SLA for CloudStack Environments.
>> 
>> Apache CloudStack Bootcamp training courses
>> 
>> **NEW!** CloudStack 4.2.1 training<
>> http://shapeblue.com/cloudstack-training/>
>> 18th-19th February 2014, Brazil. Classroom<
>> http://shapeblue.com/cloudstack-training/>
>> 17th-23rd March 2014, Region A. Instructor led, On-line<
>> http://shapeblue.com/cloudstack-training/>
>> 24th-28th March 2014, Region B. Instructor led, On-line<
>> http://shapeblue.com/cloudstack-training/>
>> 16th-20th June 2014, Region A. Instructor led, On-line<
>> http://shapeblue.com/cloudstack-training/>
>> 23rd-27th June 2014, Region B. Instructor led, On-line<
>> http://shapeblue.com/cloudstack-training/>
>> 
>> This email and any attachments to 

Re: Qcow2 to VHD and VHD files size questions

[Carlos Reátegui]

Re bz2:  all my templates are registered as bz2 so I know it works. 

> On Jan 18, 2014, at 4:39 PM, Nux!  wrote:
> 
>> On 18.01.2014 23:20, Carlos Reátegui wrote:
>> This may apply to you.  I was able to copy out a vhd from vbox and
>> load it into ACS to use on XenServer hosts. This only worked if I
>> selected the dynamic type of vhd not the fixed size one.  It only
>> worked in non PV mode but I think that was because I did not have a
>> proper grub file with the correct root device.  Prior to uploading the
>> vhd as a template you can bzip2 it to shrink the size.
> 
> Thanks, I'll have a look at the vbox converter then. Re bz2, I think ACS will 
> complain if it's an archive instead of the real thing.
> 
> Lucian
> 
> -- 
> Sent from the Delta quadrant using Borg technology!
> 
> Nux!
> www.nux.ro

Re: Qcow2 to VHD and VHD files size questions

[Carlos Reátegui]

This may apply to you.  I was able to copy out a vhd from vbox and load it into 
ACS to use on XenServer hosts. This only worked if I selected the dynamic type 
of vhd not the fixed size one.  It only worked in non PV mode but I think that 
was because I did not have a proper grub file with the correct root device.  
Prior to uploading the vhd as a template you can bzip2 it to shrink the size. 

> On Jan 18, 2014, at 1:07 PM, Nux!  wrote:
> 
> Hi,
> 
> Most of my templates are Qcow2 files for KVM and I'd like to convert them in 
> a format that XenServer can use.
> I managed to use qemu-img from the KVM tools to convert one in VHD format, 
> however this seems to be a 50 GB (the virtual size of the qcow2) sparse file. 
> Downloading this file from my HTTP template repo into cloudstack takes ages.
> Does anyone know how this situation can be improved?
> 
> Regards,
> Lucian
> 
> -- 
> Sent from the Delta quadrant using Borg technology!
> 
> Nux!
> www.nux.ro

Re: Xen Nic missing after reboot ,10 hosts

[Carlos Reátegui]

Hi Peter
I experienced a similar problem. I believe it is due to interface renaming that 
happens at boot. Unfortunately I don't have access to my machines so I can't 
check the specific thing you need to do but do a search for "XenServer 
interface rename" and hopefully you'll get enough pointers. If I remember 
correctly I had to edit a file that is used by the rename process to set it to 
my original nic. Eg eth1 had been turned into eth13. This happened with 5 of my 
8 nics. After putting them all back, I rebooted and was back in business. 

Hope this helps
Carlos

> On Dec 5, 2013, at 3:15 PM, Peter Zhai  wrote:
> 
> Hello,
> 
> My cloudstack 4.02 environment has 10 Xen 6.0 hosts ,i did not change
> anything lately but start from last week ,many of my Xen hosts will lost
> NIC after reboot ,which caused the VM instance on those hosts are not able
> to start also.
> 
> I guess it is not pool master issue because some of the slave host still
> function . I installed all the Xen server hotfix i can found but it did not
> help at all .
> 
> There is still enough disk space on host .
> 
> Any one met the same issue before on Xen host ??  or KVM is more stable
> than Xen ?
> 
> 
> Peter

Re: Cloudstack user-data empty for VMs

[Carlos Reátegui]

What you want to do should work. 
Not familiar with cloudstack_resources. Does it have a means to set user data 
when creating an instance?  If so, have you checked the user data manually (ie 
querying the vr/dhcp server) to see that it was set?


> On Dec 4, 2013, at 3:19 PM, Derek Cole  wrote:
> 
> Hrmm - Maybe I am not being exactly clear.
> 
> I originally started out trying to use puppet to not only configure my VMs,
> but provision them in the cloud as well. I started out with a template in
> cloudstack, and have been using cloudstack_resources to create new VMs
> automatically when my puppet manifest is applied.
> 
> Creating the VMs and all seems to work, however, I need a way to push
> specific configurations to specific boxes based on their role, so I was
> hoping to use the "role=whatever" userdata to be able to distinguish the
> different types of VMs that I have provisioned without having to have a
> bunch of node blocks to distinguish them by name.
> 
> Maybe using cloudmonkey or some other tool is more effective, however I
> guess I was just trying to figure out how to use the supposedly already
> written puppet types to give me something out of the box that is "one
> command" provisioning and configuring.
> 
> -Derek
> 
> 
> On Wed, Dec 4, 2013 at 2:56 PM, Hiroki Ohashi wrote:
> 
>> Hi Derek
>> 
>> When you use user-data, you have to provide user-data and deliver it
>> to virtual router. Unfortunately, CloudStack only provides REST API to
>> deliver user-data to virtual router now. This API is
>> deployVirtualMachine that creates instance and set instance specific
>> data.
>> 
>> For example, I assume you want to deliver a shell script as user-data
>> below.
>> 
>>--
>>#! /bin/sh
>> 
>>echo "Hello user-data!"
>>--
>> 
>> In this case, you can call deployVirtualMachine by CloudMonkey like
>> this.
>> 
>>$ cloudmonkey deploy virtualmachine serviceofferingid=XXX
>> templateid=XXX zoneid=XXX networkids=XXX
>> userdata='IyEgL2Jpbi9zaAoKZWNobyAiSGVsbG8gdXNlci1kYXRhISIK'
>> 
>> As a result of the command, a new instance is created with user-data
>> delivered to virtual router, so you can access user-data from the
>> instance.
>> 
>> CloudMonkey is CLI tool to call CloudStack REST API easily and you can
>> give parameters as key value pair. In the example, user-data is base64
>> encoded shell script and provied as a parameter.
>> 
>> Best regards
>> Hiroki Ohashi
>> 
>> 2013/12/5 Derek Cole :
>>> I was kind of wondering about that, when I saw it earlier. It appears
>> that
>>> maybe the cloudstack_resources module has become out of date? I think you
>>> are the preparer of a slide-show I was following here:
>>> http://www.slideshare.net/PuppetLabs/cloudstack-18489665
>>> 
>>> It seems like in those slides, Group was being used to hold the roles?
>> This
>>> is why I assumed that was OK. I was doing something like
>>> 
>>>case $::role {
>>>'db': {
>>>notify {"detected a fact named role with value
>> db"
>>> :}
>>>}
>>>}
>>> because I thought that the custom fact here:
>>> 
>> https://github.com/jasonhancock/puppet-facts/blob/master/cloudstack_userdata.rb
>>> 
>>> Turned the cloudstack userdata into a fact where if you had
>>> "role=db,foo=bar" you would get two custom facts, role and foo, with
>> their
>>> respective values.
>>> 
>>> May I ask for some clarity if that is not the intended usage?
>>> 
>>> In my case, obviously cloudstack_userdata is not generating the correct
>>> facts, because the wget that is in that code returns nothing because
>>> userdata is empty.
>>> 
>>> Thanks,
>>> 
>>> -Derek
>>> 
>>> 
>>> 
 On Wed, Dec 4, 2013 at 12:57 PM, David Nalley  wrote:
 
 Hi Derek:
 
 Glad that the puppet resources are useful.
 
 Setting user-data is different than setting group:
 
 Look at the options here:
 
 
>> http://cloudstack.apache.org/docs/api/apidocs-4.2/user/deployVirtualMachine.html
 
 --David
 
 On Wed, Dec 4, 2013 at 11:54 AM, Derek Cole 
>> wrote:
> Hello,
> 
> I am attempting to use the cloudstack API to get user-data for my VMs.
> 
> I am creating the VMs with the puppet cloudstack-resources module,
>> and it
> seems to populate it (From the cloudstack GUI, under "Group" I see my
 data)
> 
> However, when I do a
> 
> wget http://router/latest/user-data
> 
> I get back an empty file. On the VR itself I have checked and there
>> are a
> bunch of /var/www/html/userdata/IP/user-data files, but every one of
>> them
> is empty. This same applies to VMs that I added the "Group" user data
> manually.
> 
> The VM's are all FreeBSD10, and I am using xenserver 6.2, and
>> cloudstack
 4.2
> 
> Is this a bug? Is there a workaround

Re: SSVM won't start

[Carlos Reátegui]

Try the vhd-util that the docs tell you to download. Put that one in 
/opt/xensource/bin

> On Dec 3, 2013, at 9:20 AM, Sebastian Trampler  
> wrote:
> 
> Hello again,
> 
> after copying the vhd-util on the XenServer to /opt/xensource/bin it first 
> seems to work, but the ssvm still won't come up.
> After reading the log-messages I found the exception below. Any suggestions?
> 
> Regards
> 
> Sebastian
> 
> 
> 2013-12-03 16:08:34,861 DEBUG [xen.resource.CitrixResourceBase] 
> (DirectAgent-472:null) VBD a6598c97-b54f-8d12-6785-a9eb1baff098 created for 
> com.cloud.agent.api.to.DiskTO@422d7ffa
> 2013-12-03 16:08:34,882 DEBUG [xen.resource.CitrixResourceBase] 
> (DirectAgent-472:null) Creating VIF for s-4-VM on nic 
> [Nic:Guest-XXX.XXX.XXX.XXX-vlan://untagged]
> 2013-12-03 16:08:34,902 DEBUG [xen.resource.CitrixResourceBase] 
> (DirectAgent-472:null) Created a vif 940b3765-dd22-a488-4391-25ef188a4ef9 on 2
> 2013-12-03 16:08:34,902 DEBUG [xen.resource.CitrixResourceBase] 
> (DirectAgent-472:null) Creating VIF for s-4-VM on nic 
> [Nic:Control-169.254.1.83-null]
> 2013-12-03 16:08:34,929 DEBUG [xen.resource.CitrixResourceBase] 
> (DirectAgent-472:null) already have a vif on dom0 for link local network
> 2013-12-03 16:08:35,208 DEBUG 
> [network.router.VirtualNetworkApplianceManagerImpl] 
> (RouterStatusMonitor-1:null) Found 0 routers to update status.
> 2013-12-03 16:08:35,210 DEBUG 
> [network.router.VirtualNetworkApplianceManagerImpl] 
> (RouterStatusMonitor-1:null) Found 0 networks to update RvR status.
> 2013-12-03 16:08:35,217 DEBUG 
> [network.router.VirtualNetworkApplianceManagerImpl] 
> (RouterStatusMonitor-1:null) Found 0 routers to update status.
> 2013-12-03 16:08:35,219 DEBUG 
> [network.router.VirtualNetworkApplianceManagerImpl] 
> (RouterStatusMonitor-1:null) Found 0 networks to update RvR status.
> 2013-12-03 16:08:35,355 DEBUG [xen.resource.CitrixResourceBase] 
> (DirectAgent-472:null) Created a vif 4919c69e-b711-1ae4-7276-903cffd0524e on 0
> 2013-12-03 16:08:35,355 DEBUG [xen.resource.CitrixResourceBase] 
> (DirectAgent-472:null) Creating VIF for s-4-VM on nic 
> [Nic:Management-XXX.XXX.XXX.XXX-null]
> 2013-12-03 16:08:35,376 DEBUG [xen.resource.CitrixResourceBase] 
> (DirectAgent-472:null) Created a vif 4ae05ccd-a0b3-5586-4542-9e4dde9250c2 on 1
> 2013-12-03 16:08:35,377 DEBUG [xen.resource.CitrixResourceBase] 
> (DirectAgent-472:null) Creating VIF for s-4-VM on nic 
> [Nic:Storage-XXX.XXX.XXX.XXX-null]
> 2013-12-03 16:08:35,398 DEBUG [xen.resource.CitrixResourceBase] 
> (DirectAgent-472:null) Created a vif 5f2d5aee-18c0-4c61-af26-edbbd50c7bed on 3
> 2013-12-03 16:08:39,453 WARN  [xen.resource.CitrixResourceBase] 
> (DirectAgent-472:null) Task failed! Task record: uuid: 
> bc1b04c5-b891-357c-6151-73f68806c136
>   nameLabel: Async.VM.start_on
> nameDescription:
>   allowedOperations: []
>   currentOperations: {}
> created: Tue Dec 03 16:08:35 CET 2013
>finished: Tue Dec 03 16:08:38 CET 2013
>  status: failure
>  residentOn: com.xensource.xenapi.Host@8bc3a55e
>progress: 1.0
>type: 
>  result:
>   errorInfo: [INTERNAL_ERROR, xenopsd internal error: 
> XenguestHelper.Xenctrl_dom_linux_build_failure(2, " panic: xc_dom_core.c:609: 
> xc_dom_find_loader: no loader\\\"")]
> otherConfig: {}
>   subtaskOf: com.xensource.xenapi.Task@aaf13f6f
>subtasks: []
> 
> 2013-12-03 16:08:39,456 WARN  [xen.resource.CitrixResourceBase] 
> (DirectAgent-472:null) Unable to start VM(s-4-VM) on 
> host(7c86321f-788d-4a4a-9837-8553b432d738) due to Task failed! Task record:   
>   uuid: bc1b04c5-b891-357c-6151-73f68806c136
>   nameLabel: Async.VM.start_on
> nameDescription:
>   allowedOperations: []
>   currentOperations: {}
> created: Tue Dec 03 16:08:35 CET 2013
>finished: Tue Dec 03 16:08:38 CET 2013
>  status: failure
>  residentOn: com.xensource.xenapi.Host@8bc3a55e
>progress: 1.0
>type: 
>  result:
>   errorInfo: [INTERNAL_ERROR, xenopsd internal error: 
> XenguestHelper.Xenctrl_dom_linux_build_failure(2, " panic: xc_dom_core.c:609: 
> xc_dom_find_loader: no loader\\\"")]
> otherConfig: {}
>   subtaskOf: com.xensource.xenapi.Task@aaf13f6f
>subtasks: []
> 
> Task failed! Task record: uuid: 
> bc1b04c5-b891-357c-6151-73f68806c136
>   nameLabel: Async.VM.start_on
> nameDescription:
>   allowedOperations: []
>   currentOperations: {}
> created: Tue Dec 03 16:08:35 CET 2013
>finished: Tue Dec 03 16:08:38 CET 2013
>  status: failure
>  residentOn: com.xensource.xenapi.Host@8bc3a55e
>progress: 1.0
>type: 
>  result:
>   errorInfo: [INTERNAL_ERROR, xenopsd internal error: 
> XenguestHelper.Xenctrl_dom_linux_build_failure(2, " panic: xc

Re: Auto-resize partition when create VM

[Carlos Reátegui]

Fariborz
Not sure if it is clear from your emails or not but the disk size you are 
selecting in the add instance wizard is not the root disk size, instead it is 
the size of an extra disk that will be available and attached to your instance. 
Hopefully Nux's emails make more sense to you now. 

> On Nov 21, 2013, at 4:05 AM, Fariborz Navidan  wrote:
> 
> Hi.
> Can I write down the above into a shell script and add it to first boot?
> Can I then resize the root volume?
> 
> 
>> On Thu, Nov 21, 2013 at 3:22 PM, Nux!  wrote:
>> 
>>> On 21.11.2013 11:30, Fariborz Navidan wrote:
>>> 
>>> If I use LVM on template, can I add a script that resizes the root logical
>>> volume (LV) via LVM on the first boot? Then how to get the allocated disk
>>> size from cloudstack?
>> 
>> If you user LVM inside the template, then once you add another disk (if
>> you're on KVM it's going to be called "/dev/vdb") you can just do:
>> - pvcreate /dev/vdb
>> - vgextend ExistingVolumeGrop /dev/vdb
>> - lvextend -l +100%FREE /dev/ExistingVolumeGrop/VolumeName
>> - resize2fs /dev/ExistingVolumeGrop/VolumeName
>> 
>> All the above can be run live, no reboot required (if you use ext4).
>> 
>> 
>> 
>> --
>> Sent from the Delta quadrant using Borg technology!
>> 
>> Nux!
>> www.nux.ro
> 
> 
> 
> -- 
> Fariborz Navidan
> Sales & Technical Manager
> Shetab Rayan Limited.
> www.shetabrayan.com

Re: VM created from template has no network access

[Carlos Reátegui]

Make sure to set onboot=yes in ifcfg-eth0 in your template. 

> On Nov 20, 2013, at 7:37 AM, Fariborz Navidan  wrote:
> 
> Hi.
> 
> I have created a CentOS 6.4 template from a VM. When create a VM using this
> template, network settings are not applied to it and it starts with no
> network access and as a result password script cannot be run.
> 
> I have created the template from the VM's volume.
> 
> Please advise.
> TIA

Re: 回复： Starting Cloudstack-specific Tomcat engine cloudstack-management [fail]

[Carlos Reátegui]

The 64 bit requirement on the host I believe is a hw requirement not a 
hypervisor os. Eg XenServer is 32 bit (at least up to 6.1). 

> On Nov 17, 2013, at 2:09 AM, Shanker Balan  
> wrote:
> 
>> On 16-Nov-2013, at 7:52 pm, 5度倾斜 <465296...@qq.com> wrote:
>> 
>> thank you for your suggestion :D
>> I made CloudStack4.2.0 started successfully, by install a 64-bit Ubuntu 
>> server OS rather than the old 32-bit one.
>> Reboot can't solve the problem,i've tried many times,and i still don't know 
>> the reason,maybe just don't suppport 32-bit OS ?
>> best wishes for you,thank u!
> 
> 
> http://cloudstack.apache.org/docs/en-US/Apache_CloudStack/4.2.0/html-single/Installation_Guide/index.html#minimum-system-requirements
> 
> 64-bit is a pre-req for both management server and hypervisor hosts.
> 
> 
> --
> @shankerbalan
> 
> M: +91 98860 60539 | O: +91 (80) 67935867
> shanker.ba...@shapeblue.com | www.shapeblue.com | Twitter:@shapeblue
> ShapeBlue Services India LLP, 22nd floor, Unit 2201A, World Trade Centre, 
> Bangalore - 560 055
> 
> CloudStack Bootcamp Training on 27/28 November, Bangalore
> http://www.shapeblue.com/cloudstack-training/
> 
> 
> 
> 
> This email and any attachments to it may be confidential and are intended 
> solely for the use of the individual to whom it is addressed. Any views or 
> opinions expressed are solely those of the author and do not necessarily 
> represent those of Shape Blue Ltd or related companies. If you are not the 
> intended recipient of this email, you must neither take any action based upon 
> its contents, nor copy or show it to anyone. Please contact the sender if you 
> believe you have received this email in error. Shape Blue Ltd is a company 
> incorporated in England & Wales. ShapeBlue Services India LLP is a company 
> incorporated in India and is operated under license from Shape Blue Ltd. 
> Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
> operated under license from Shape Blue Ltd. ShapeBlue is a registered 
> trademark.

Re: Guest VMs not able to acquire DHCP IP from Virtual Router unless Guest and VR are on the same KVM host

[Carlos Reátegui]

Did you also check the host firewall?  Try disabling. 

> On Nov 16, 2013, at 1:51 PM, Adam  wrote:
> 
> The hosts have static IPs (10.97.38.[10-14]) and can all see and talk to
> each other via IP and hostname. I'm only using a basic zone so no VLAN
> tagging or anything funky like that.
> 
> Best Regards,
> 
> 
> 
> Adam Scarcella
> 
> 
> On Sat, Nov 16, 2013 at 4:17 PM, Andrei Mikhailovsky wrote:
> 
>> 
>> 
>> Adam, it sounds like a networking issue, check that all hosts can talk to
>> each other on the same vlan that is used for guest network. I had the same
>> issue with advanced networking when my vlans were not properly setup on the
>> switches.
>> 
>> Andrei
>> 
>> - Original Message -
>> 
>> From: "Adam" 
>> To: users@cloudstack.apache.org
>> Sent: Saturday, 16 November, 2013 7:08:50 PM
>> Subject: Guest VMs not able to acquire DHCP IP from Virtual Router unless
>> Guest and VR are on the same KVM host
>> 
>> Hi All,
>> 
>> I have a new and very strange issue that for the life of me I cannot seem
>> to track down and fix.
>> 
>> I have CS 4.2 running on 5 hosts in a simple basic zone. All is working
>> fine, except that my Guest VMs cannot seem to get a DHCP lease from the
>> Virtual Router unless I migrate the Guest VM to the same physical KVM
>> Host running the VR. That would seem to indicate a firewall issue, but I've
>> tested by turning off both the firewalls (VR KVM Host iptables & Guest VM
>> KVM Host iptables). It didn't help. The only way to fix it is to migrate
>> the Guest VM to the same KVM Host that's running the Virtual Router.
>> 
>> NOTE: The Console Proxy has worked flawlessly this whole time.
>> 
>> So, if a Guest VM starts on a different physical KVM Host, it will not get
>> an internal IP of 169.254.x.x. All along the Console Proxy works fine. Then
>> if I migrate the Guest VM to the same KVM host that's running the VR, DHCP
>> automatically starts working and the Guest VM receives a proper IP address
>> of 10.97.38.x. Then I can migrate the Guest VM back to any other physical
>> KVM Host and believe it or not, it continues to work flawlessly, until I
>> either reboot the VM or restart the network services. Then it cannot see
>> the VR again and instead receives an internal IP of 169.254.x.x. If I set a
>> static IP address & DNS everything works fine, no matter where the Guest VM
>> is running.
>> 
>> Setting static IPs is not an option
>> Running all the Guest VMs on the same physical KVM host is not an option
>> 
>> I desperately need to track down the root cause of this issue so I can
>> release this cloud to my entire department by Monday morning. Someone
>> please help!
>> 
>> Best Regards,
>> 
>> 
>> 
>> Adam Scarcella
>> 
>> 

Re: Which vhd-util

[Carlos Reátegui]

It is supposed to be on the management server only because the scripts that add 
a host are supposed to copy them to the xen hosts. It does not run on the ms.  
There appears to be a bug that the script is not pushing it to the hosts. Hence 
the suggestion below to copy it to xensource/bin. Leave the other one in sbin 
there. That is part of the XenServer distribution but is missing some of the 
options that cloudstack uses. 

> On Nov 1, 2013, at 7:34 AM, Vahric Muhtaryan  wrote:
> 
> Dear Fazy , 
> 
> Really confused after your words and last answer
> 
> Vhd-util really need to be on management node ?
> Or it should be on Xen Servers ?
> Or On both side ?
> 
> Regards
> VM
> 
>> On 01/11/13 16:00, "Erdősi Péter"  wrote:
>> 
>> 2013.11.01. 13:50 keltezéssel, Vahric Muhtaryan írta:
>>> Second all vhd-utils on Management and Xen server should be same ? Or i
>>> do
>>> not have to care about Xen Server.
>> Actually I tried to run vhd-utils on ubuntu, with no success, but I
>> think, this is not needed.
>> Do this on all xenserver node:
>> 
>> wget http://download.cloud.com.s3.amazonaws.com/tools/vhd-util
>> chmod +x vhd-util
>> cp vhd-util /opt/xensource/bin/
>> 
>> And then you will be fine.
>> 
>> Regards,
>> Fazy
> 
> 

Re: Adding another XenServer host, ./cloud-setup-bonding.sh needed?

[Carlos Reátegui]

CS does not create the bond. XS does. Make sure to add the new host to the XS 
pool before adding to CS. 

> On Sep 26, 2013, at 2:23 AM, France  wrote:
> 
> Tnx both for your response.
> I will remove the bond i created and let CS create it.
> I also won't run ./cloud-setup-bonding.sh on master.
> Will check after host will be added if bond was created.
> 
>> On 25/9/13 4:08 PM, Dean Kamali wrote:
>> If you have the node added to the pool, it will inherent all network
>> settings from the master, and you don't need to create or modify any
>> network config.
>> 
>> 
>>> On Wed, Sep 25, 2013 at 9:58 AM, France  wrote:
>>> 
>>> I have a XenServer 6.0.2 pool managed by CS 4.1.1.
>>> When adding another host to the XS cluster, do i need to run:
>>> ./cloud-setup-bonding.sh again on the master?
>>> I don't think so, but just to be sure.
>>> 
>>> I've already set up default network using xe pif-list; xe network-create
>>> name-label=all; xe bond-create network-UUDI= pif-uuid=UUIDofPIF#1,**
>>> UUIDofPIF#2,...
>>> 
>>> 
>>> Tnx for help.
> 

Re: Adding another XenServer host, ./cloud-setup-bonding.sh needed?

[Carlos Reátegui]

I don't think you were supposed to create the bond on it. When you add it to 
the pool the bond will be created by XS.  Also it needs to have all the same 
hot fixes in order to add it too. 

> On Sep 25, 2013, at 6:58 AM, France  wrote:
> 
> I have a XenServer 6.0.2 pool managed by CS 4.1.1.
> When adding another host to the XS cluster, do i need to run: 
> ./cloud-setup-bonding.sh again on the master?
> I don't think so, but just to be sure.
> 
> I've already set up default network using xe pif-list; xe network-create 
> name-label=all; xe bond-create network-UUDI= 
> pif-uuid=UUIDofPIF#1,UUIDofPIF#2,...
> 
> 
> Tnx for help.

Re: Cloudstack 4.1.1 + XCP 1.6 fresh install

[Carlos Reátegui]

On a recent install of CS4.1.1 + XS6.1 I thought I had vhd-util in the right 
place but it did not get copied to the hosts. It maybe a similar issue here. 

Try to copy the vhd-util to the hosts and see if things start working. They did 
for me. 

On Sep 18, 2013, at 7:28 AM, Vadim Kimlaychuk  wrote:

> Yes, its over there (I have Ubuntu 12.04 LTS) :
> 
> root@mgmt4xcp:/home/vadim# ls -al  
> /usr/share/cloudstack-common/scripts/vm/hypervisor/xenserver/vh*
> -rwxr-xr-x 1 root root 318977 Sep 18 15:55 
> /usr/share/cloudstack-common/scripts/vm/hypervisor/xenserver/vhd-util
> 
> Vadim
> 
> -Original Message-
> From: Ian Duffy [mailto:i...@ianduffy.ie] 
> Sent: Wednesday, September 18, 2013 5:26 PM
> To: users@cloudstack.apache.org
> Subject: Re: Cloudstack 4.1.1 + XCP 1.6 fresh install
> 
> Did you copy over vhd-util to the correct folder and chmod +x it?
> On 18 Sep 2013 15:13, "Vadim Kimlaychuk"  wrote:
> 
>> Hello all,
>> 
>>Trying to install subj. several times I have decided to 
>> ask your help. May be someone already faced the same problem? I did 
>> the configuration according to “Installation guide” and always end up 
>> with the same problem: on system VM creation I got repeated errors like this:
>> 
>> 2013-09-18 16:49:21,605 DEBUG [cloud.storage.StorageManagerImpl]
>> (consoleproxy-1:null) Creating volume: Vol[2|vm=2|ROOT]
>> 2013-09-18 16:49:21,605 DEBUG [cloud.storage.StorageManagerImpl]
>> (consoleproxy-1:null) Trying to create in Pool[200|NetworkFilesystem]
>> 2013-09-18 16:49:23,381 WARN  [xen.resource.CitrixResourceBase]
>> (DirectAgent-4:null) kill_copy_process failed
>> 2013-09-18 16:49:23,381 WARN  [xen.resource.CitrixResourceBase]
>> (DirectAgent-4:null) can not create vdi in sr
>> c6e55039-1fb0-5e5d-37d5-118a9ac3abb6
>> 2013-09-18 16:49:23,382 WARN  [xen.resource.CitrixResourceBase]
>> (DirectAgent-4:null) Catch Exception
>> com.cloud.utils.exception.CloudRuntimeException on
>> host:e6a339ee-521c-4c67-ac55-cbd256607150 for template: nfs:// 
>> 192.168.107.142/export/secondary/template/tmpl/1/1/ due to
>> com.cloud.utils.exception.CloudRuntimeException: can not create vdi in 
>> sr
>> c6e55039-1fb0-5e5d-37d5-118a9ac3abb6
>> com.cloud.utils.exception.CloudRuntimeException: can not create vdi in 
>> sr
>> c6e55039-1fb0-5e5d-37d5-118a9ac3abb6
>>at
>> com.cloud.hypervisor.xen.resource.CitrixResourceBase.copy_vhd_from_secondarystorage(CitrixResourceBase.java:2707)
>>at
>> com.cloud.hypervisor.xen.resource.CitrixResourceBase.execute(CitrixResourceBase.java:2729)
>>at
>> com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:501)
>>at
>> com.cloud.hypervisor.xen.resource.XcpServerResource.executeRequest(XcpServerResource.java:51)
>>at
>> com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.java:186)
>>at
>> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>>at
>> java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
>>at java.util.concurrent.FutureTask.run(FutureTask.java:166)
>>at
>> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165)
>>at
>> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266)
>>at
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
>>at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>>at java.lang.Thread.run(Thread.java:679)
>> 2013-09-18 16:49:23,384 DEBUG [agent.manager.DirectAgentAttache]
>> (DirectAgent-4:null) Seq 1-1333067786: Response Received:
>> 2013-09-18 16:49:23,385 DEBUG [agent.transport.Request]
>> (DirectAgent-4:null) Seq 1-1333067786: Processing:  { Ans: , MgmtId:
>> 8796752993784, via: 1, Ver: v1, Flags: 110, 
>> [{"storage.PrimaryStorageDownloadAnswer":{"templateSize":0,"result":fa
>> lse,"details":"Catch Exception 
>> com.cloud.utils.exception.CloudRuntimeException on
>> host:e6a339ee-521c-4c67-ac55-cbd256607150 for template: nfs:// 
>> 192.168.107.142/export/secondary/template/tmpl/1/1/ due to
>> com.cloud.utils.exception.CloudRuntimeException: can not create vdi in 
>> sr c6e55039-1fb0-5e5d-37d5-118a9ac3abb6","wait":0}}] }
>> 2013-09-18 16:49:23,385 DEBUG [agent.transport.Request]
>> (secstorage-1:null) Seq 1-1333067786: Received:  { Ans: , MgmtId:
>> 8796752993784, via: 1, Ver: v1, Flags: 110, { 
>> PrimaryStorageDownloadAnswer } }
>> 2013-09-18 16:49:23,385 DEBUG [agent.manager.AgentManagerImpl]
>> (secstorage-1:null) Details from executing class
>> com.cloud.agent.api.storage.PrimaryStorageDownloadCommand: Catch 
>> Exception com.cloud.utils.exception.CloudRuntimeException on
>> host:e6a339ee-521c-4c67-ac55-cbd256607150 for template: nfs:// 
>> 192.168.107.142/export/secondary/template/tmpl/1/1/ due t

Re: Ubuntu 12.04 LTS or 14.04 on XenServer 6.0.2 with CS 4.1.1? templates in general?

[Carlos Reátegui]

Any reason for needing partitions?  Previously is was creating them but found 
them to be more of a pain. 

On Sep 9, 2013, at 1:16 PM, France  wrote:

> Updating kernel from 52 to 53 worked too. :-)
> ubuntu@u1204test:~$ uname -a
> Linux u1204test 3.2.0-53-virtual #81-Ubuntu SMP Thu Aug 22 21:21:26 UTC 2013 
> x86_64 x86_64 x86_64 GNU/Linux
> 
> Personally I'm missing partition layout, but at least now i have a Ubuntu 
> 12.04 install and a script which i can modify to create image with 
> partitions. :-)
> 
> Thanks again, Carlos.
> 
> 
> On 9/9/13 9:55 PM, France wrote:
>> Works for me. Even password was set successfully.
>> Now i need to test if updating (apt-get update && apt-get dist-upgrage) 
>> doesn't kill the install, then create a new compressed 20GB template from it.
>> Thank you Carlos!
>> 
>> Also to Dean, hopefully you decompressed the file before importing? :-) I 
>> did.
>> 
>> Regards,
>> F.
>> 
>> On 9/9/13 9:33 PM, Dean Kamali wrote:
>>> Thanks Carlos
>>> 
>>> I have setup it as "Other PV 64 bit" (Xenserver 6.0.2 and CS 4.1.1 )
>>> however I'm getting an exception "RuntimeError: Unable to find partition
>>> containing kernel"
>>> 
>>> http://pastebin.com/raw.php?i=FiNbxBHn
>>> 
>>> So far, this template is broken :(
>>> 
>>> Dean
>>> 
>>> 
>>> 
>>> 
>>> On Mon, Sep 9, 2013 at 1:42 PM, Carlos Reategui  wrote:
>>> 
>>>> try this:
>>>> http://reategui.com/CSImages/ubuntu-12.04.3-server-cloudimg-amd64.vhd.bz2 
>>>> 
>>>> Just created this with the script and tested it on CS 4.1.1 + XS 6.0.2
>>>> (patched up to 22).
>>>> 
>>>> ubuntu/passw0rd
>>>> 
>>>> Register it as Other PV 64 bit
>>>> 
>>>> You can check the "Password Enabled" flag and the password will be set by
>>>> CS.
>>>> 
>>>> Alternatively you can you can set ssh keys in meta-data and that should
>>>> work too.
>>>> 
>>>> You can also set user-data and that should work with cloud-init (I have not
>>>> been able to get the CS ec2-api working so have not validated this -- going
>>>> to try with cloud monkey instead).
>>>> 
>>>> Should have xe-guest-utilities_6.0.2-766 installed too.
>>>> 
>>>> Let me know if you have probs with it.
>>>> 
>>>> Regards,
>>>> -Carlos
>>>> 
>>>> 
>>>> 
>>>> On Mon, Sep 9, 2013 at 9:44 AM, Carlos Reategui 
>>>> wrote:
>>>> 
>>>>> It's possible because he ran the script from CentOS instead of ubuntu.  I
>>>>> will be uploading a working template shortly.
>>>>> 
>>>>> 
>>>>> On Mon, Sep 9, 2013 at 9:32 AM, Dean Kamali 
>>>> wrote:
>>>>>> if I set template to Ubuntu 12.4 it will boot with (no bootable devises
>>>>>> found), and if I set template to other PV 64 bit, it won't boot, and it
>>>>>> will keep on looping.
>>>>>> 
>>>>>> what else can I try?
>>>>>> 
>>>>>> 
>>>>>> 
>>>>>> On Mon, Sep 9, 2013 at 9:53 AM, Travis Graham 
>>>> wrote:
>>>>>>> If you change the LINK to
>>>> http://cloud-images.ubuntu.com/releases/precise/release/ubuntu-12.04-server-cloudimg-amd64-root.tar.gzitwontredirect
>>>>  and things should stay current for newer point releases
>>>>>>> and you wont have to update the script when newer versions are cut.
>>>>>>> 
>>>>>>> On Sep 9, 2013, at 9:43 AM, Carlos Reátegui 
>>>>>> wrote:
>>>>>>>> I'll upload and image in a couple hours.
>>>>>>>> 
>>>>>>>> On Sep 9, 2013, at 4:31 AM, France  wrote:
>>>>>>>> 
>>>>>>>>> As i have no NFS primary storage (all NFS servers are mounted as
>>>>>>> secondary storages in CS 4.1.1) i have to find another way of
>>>> converting
>>>>>>> ubuntu-12.04-server-cloudimg-amd64.fs to .vhd. :-/
>>>>>>>>> On 9/9/13 12:20 PM, France wrote:
>>>>>>>>>> That fixed the first error, but there are two more:
>>>>>>>>>> -- 

Re: Ubuntu 12.04 LTS or 14.04 on XenServer 6.0.2 with CS 4.1.1? templates in general?

[Carlos Reátegui]

I register it as is, compressed. Have not had any issues doing it that way with 
these or the CentOS 5 templates I've created. 

On Sep 9, 2013, at 12:55 PM, France  wrote:

> Works for me. Even password was set successfully.
> Now i need to test if updating (apt-get update && apt-get dist-upgrage) 
> doesn't kill the install, then create a new compressed 20GB template from it.
> Thank you Carlos!
> 
> Also to Dean, hopefully you decompressed the file before importing? :-) I did.
> 
> Regards,
> F.
> 
> On 9/9/13 9:33 PM, Dean Kamali wrote:
>> Thanks Carlos
>> 
>> I have setup it as "Other PV 64 bit" (Xenserver 6.0.2 and CS 4.1.1 )
>> however I'm getting an exception "RuntimeError: Unable to find partition
>> containing kernel"
>> 
>> http://pastebin.com/raw.php?i=FiNbxBHn
>> 
>> So far, this template is broken :(
>> 
>> Dean
>> 
>> 
>> 
>> 
>> On Mon, Sep 9, 2013 at 1:42 PM, Carlos Reategui  wrote:
>> 
>>> try this:
>>> http://reategui.com/CSImages/ubuntu-12.04.3-server-cloudimg-amd64.vhd.bz2
>>> 
>>> Just created this with the script and tested it on CS 4.1.1 + XS 6.0.2
>>> (patched up to 22).
>>> 
>>> ubuntu/passw0rd
>>> 
>>> Register it as Other PV 64 bit
>>> 
>>> You can check the "Password Enabled" flag and the password will be set by
>>> CS.
>>> 
>>> Alternatively you can you can set ssh keys in meta-data and that should
>>> work too.
>>> 
>>> You can also set user-data and that should work with cloud-init (I have not
>>> been able to get the CS ec2-api working so have not validated this -- going
>>> to try with cloud monkey instead).
>>> 
>>> Should have xe-guest-utilities_6.0.2-766 installed too.
>>> 
>>> Let me know if you have probs with it.
>>> 
>>> Regards,
>>> -Carlos
>>> 
>>> 
>>> 
>>> On Mon, Sep 9, 2013 at 9:44 AM, Carlos Reategui 
>>> wrote:
>>> 
>>>> It's possible because he ran the script from CentOS instead of ubuntu.  I
>>>> will be uploading a working template shortly.
>>>> 
>>>> 
>>>> On Mon, Sep 9, 2013 at 9:32 AM, Dean Kamali 
>>> wrote:
>>>>> if I set template to Ubuntu 12.4 it will boot with (no bootable devises
>>>>> found), and if I set template to other PV 64 bit, it won't boot, and it
>>>>> will keep on looping.
>>>>> 
>>>>> what else can I try?
>>>>> 
>>>>> 
>>>>> 
>>>>> On Mon, Sep 9, 2013 at 9:53 AM, Travis Graham 
>>> wrote:
>>>>>> If you change the LINK to
>>> http://cloud-images.ubuntu.com/releases/precise/release/ubuntu-12.04-server-cloudimg-amd64-root.tar.gzitwontredirect
>>>  and things should stay current for newer point releases
>>>>>> and you wont have to update the script when newer versions are cut.
>>>>>> 
>>>>>> On Sep 9, 2013, at 9:43 AM, Carlos Reátegui 
>>>>> wrote:
>>>>>>> I'll upload and image in a couple hours.
>>>>>>> 
>>>>>>> On Sep 9, 2013, at 4:31 AM, France  wrote:
>>>>>>> 
>>>>>>>> As i have no NFS primary storage (all NFS servers are mounted as
>>>>>> secondary storages in CS 4.1.1) i have to find another way of
>>> converting
>>>>>> ubuntu-12.04-server-cloudimg-amd64.fs to .vhd. :-/
>>>>>>>> On 9/9/13 12:20 PM, France wrote:
>>>>>>>>> That fixed the first error, but there are two more:
>>>>>>>>> --
>>>>>>>>> Saving to: `cloud-set-guest-password-ubuntu'
>>> 100%[>]
>>>>>> 4,153   --.-K/s   in 0s
>>>>>>>>> 2013-09-09 08:59:45 (50.8 MB/s) -
>>> `cloud-set-guest-password-ubuntu'
>>>>>> saved [4153/4153]
>>>>>>>>> cp: cannot stat `/run/resolvconf/resolv.conf': No such file or
>>>>>> directory
>>>>>>>>> FATAL: kernel too old
>>>>>>>>> rm: cannot remove
>>>>>> `ubuntu-12.04-server-cloudimg-amd64/run/resolvconf/resolv.conf': No
>>> such
>>>&g

Re: Ubuntu 12.04 LTS or 14.04 on XenServer 6.0.2 with CS 4.1.1? templates in general?

[Carlos Reátegui]

Hmm. Don't know. I don't have partitions on it. 

What os is your management server?  I am wondering if there is a difference in 
the way the template is getting registered. 


On Sep 9, 2013, at 12:33 PM, Dean Kamali  wrote:

> Thanks Carlos
> 
> I have setup it as "Other PV 64 bit" (Xenserver 6.0.2 and CS 4.1.1 )
> however I'm getting an exception "RuntimeError: Unable to find partition
> containing kernel"
> 
> http://pastebin.com/raw.php?i=FiNbxBHn
> 
> So far, this template is broken :(
> 
> Dean
> 
> 
> 
> 
> On Mon, Sep 9, 2013 at 1:42 PM, Carlos Reategui  wrote:
> 
>> try this:
>> http://reategui.com/CSImages/ubuntu-12.04.3-server-cloudimg-amd64.vhd.bz2
>> 
>> Just created this with the script and tested it on CS 4.1.1 + XS 6.0.2
>> (patched up to 22).
>> 
>> ubuntu/passw0rd
>> 
>> Register it as Other PV 64 bit
>> 
>> You can check the "Password Enabled" flag and the password will be set by
>> CS.
>> 
>> Alternatively you can you can set ssh keys in meta-data and that should
>> work too.
>> 
>> You can also set user-data and that should work with cloud-init (I have not
>> been able to get the CS ec2-api working so have not validated this -- going
>> to try with cloud monkey instead).
>> 
>> Should have xe-guest-utilities_6.0.2-766 installed too.
>> 
>> Let me know if you have probs with it.
>> 
>> Regards,
>> -Carlos
>> 
>> 
>> 
>> On Mon, Sep 9, 2013 at 9:44 AM, Carlos Reategui 
>> wrote:
>> 
>>> It's possible because he ran the script from CentOS instead of ubuntu.  I
>>> will be uploading a working template shortly.
>>> 
>>> 
>>> On Mon, Sep 9, 2013 at 9:32 AM, Dean Kamali 
>> wrote:
>>> 
>>>> if I set template to Ubuntu 12.4 it will boot with (no bootable devises
>>>> found), and if I set template to other PV 64 bit, it won't boot, and it
>>>> will keep on looping.
>>>> 
>>>> what else can I try?
>>>> 
>>>> 
>>>> 
>>>> On Mon, Sep 9, 2013 at 9:53 AM, Travis Graham 
>> wrote:
>>>> 
>>>>> If you change the LINK to
>> http://cloud-images.ubuntu.com/releases/precise/release/ubuntu-12.04-server-cloudimg-amd64-root.tar.gzitwontredirect
>>  and things should stay current for newer point releases
>>>>> and you wont have to update the script when newer versions are cut.
>>>>> 
>>>>> On Sep 9, 2013, at 9:43 AM, Carlos Reátegui 
>>>> wrote:
>>>>> 
>>>>>> I'll upload and image in a couple hours.
>>>>>> 
>>>>>> On Sep 9, 2013, at 4:31 AM, France  wrote:
>>>>>> 
>>>>>>> As i have no NFS primary storage (all NFS servers are mounted as
>>>>> secondary storages in CS 4.1.1) i have to find another way of
>> converting
>>>>> ubuntu-12.04-server-cloudimg-amd64.fs to .vhd. :-/
>>>>>>> 
>>>>>>> On 9/9/13 12:20 PM, France wrote:
>>>>>>>> That fixed the first error, but there are two more:
>>>>>>>> --
>>>>>>>> Saving to: `cloud-set-guest-password-ubuntu'
>> 100%[>]
>>>>> 4,153   --.-K/s   in 0s
>>>>>>>> 
>>>>>>>> 2013-09-09 08:59:45 (50.8 MB/s) -
>> `cloud-set-guest-password-ubuntu'
>>>>> saved [4153/4153]
>>>>>>>> 
>>>>>>>> cp: cannot stat `/run/resolvconf/resolv.conf': No such file or
>>>>> directory
>>>>>>>> FATAL: kernel too old
>>>>>>>> rm: cannot remove
>>>>> `ubuntu-12.04-server-cloudimg-amd64/run/resolvconf/resolv.conf': No
>> such
>>>>> file or directory
>>>>>>>> Done creating image. You can mount it to check it out using:
>>>>>>>> mount -o loop ubuntu-12.04-server-cloudimg-amd64.fs
>>>>> ubuntu-12.04-server-cloudimg-amd64
>>>>>>>> 
>>>>>>>> If you are happy with it, copy
>> ubuntu-12.04-server-cloudimg-amd64.fs
>>>>> to one of your XenServer hosts and create the vhd file using
>>>> createVHD.sh
>>>>>>>> --
>>>>>>>>

Re: Ubuntu 12.04 LTS or 14.04 on XenServer 6.0.2 with CS 4.1.1? templates in general?

[Carlos Reátegui]

I'll upload and image in a couple hours. 

On Sep 9, 2013, at 4:31 AM, France  wrote:

> As i have no NFS primary storage (all NFS servers are mounted as secondary 
> storages in CS 4.1.1) i have to find another way of converting 
> ubuntu-12.04-server-cloudimg-amd64.fs to .vhd. :-/
> 
> On 9/9/13 12:20 PM, France wrote:
>> That fixed the first error, but there are two more:
>> -- 
>> Saving to: `cloud-set-guest-password-ubuntu'
>> 
>> 100%[>]
>>  4,153   --.-K/s   in 0s
>> 
>> 2013-09-09 08:59:45 (50.8 MB/s) - `cloud-set-guest-password-ubuntu' saved 
>> [4153/4153]
>> 
>> cp: cannot stat `/run/resolvconf/resolv.conf': No such file or directory
>> FATAL: kernel too old
>> rm: cannot remove 
>> `ubuntu-12.04-server-cloudimg-amd64/run/resolvconf/resolv.conf': No such 
>> file or directory
>> Done creating image. You can mount it to check it out using:
>> mount -o loop ubuntu-12.04-server-cloudimg-amd64.fs 
>> ubuntu-12.04-server-cloudimg-amd64
>> 
>> If you are happy with it, copy ubuntu-12.04-server-cloudimg-amd64.fs to one 
>> of your XenServer hosts and create the vhd file using createVHD.sh
>> -- 
>> 
>> First is about resolv.conf which is at /etc/resolv.conf in my CentOS 
>> install. I can work around that by creating softlink, even thou resolv.conf 
>> is normally populated using DHCP client.
>> 
>> The other "FATAL: kernel too old" might be in relation to CentOS kernel, 
>> once script chroots into Ubuntu install. I'm just going to leave this for 
>> now and install xen tools or guest utilities once i have the first Ubuntu VM 
>> running in case if they weren't already.
>> 
>> Now it's time to test .vhd creation.
>> 
>> Regards,
>> F.
>> 
>> On 9/9/13 12:00 PM, France wrote:
>>> I just found the first error:
>>> 
>>> Script downloads ubuntu-12.04-server-cloudimg-amd64-root.tar.gz (actually 
>>> ubuntu-12.04.3-server-cloudimg-amd64-root.tar.gz redirects to 
>>> ubuntu-12.04-server-cloudimg-amd64-root.tar.gz), but then tries to 
>>> uncompress ubuntu-12.04.3-server-cloudimg-amd64-root.tar.gz:
>>> 
>>> ---
>>> This filesystem will be automatically checked every 34 mounts or
>>> 180 days, whichever comes first.  Use tune2fs -c or -i to override.
>>> Untar file system
>>> tar: ubuntu-12.04.3-server-cloudimg-amd64-root.tar.gz: Cannot open: No such 
>>> file or directory
>>> tar: Error is not recoverable: exiting now
>>> tar: Child returned status 2
>>> tar: Error exit delayed from previous errors
>>> Extract done
>>> Begin customizing image
>>> ./createUbuntuCSimageXen.sh: line 66: etc/init/hvc0.conf: No such file or 
>>> directory
>>> sed: can't read boot/grub/menu.lst: No such file or directory
>>> sed: can't read etc/fstab: No such file or directory
>>> sed: can't read boot/grub/grub.cfg: No such file or directory
>>> sed: can't read etc/fstab: No such file or directory
>>> sed: can't read etc/fstab: No such file or directory
>>> sed: can't read etc/cloud/cloud.cfg: No such file or directory
>>> ./createUbuntuCSimageXen.sh: line 80: etc/cloud/cloud.cfg.d/90_dpkg.cfg: No 
>>> such file or directory
>>> can't find file to patch at input line 3
>>> Perhaps you used the wrong -p or --strip option?
>>> The text leading up to this was:
>>> --
>>> |--- /usr/lib/python2.7/dist-packages/cloudinit/DataSourceCloudStack.py.old 
>>> 2012-04-11 03:54:56.0 +
>>> |+++ /usr/lib/python2.7/dist-packages/cloudinit/DataSourceCloudStack.py 
>>> 2013-09-07 01:01:02.482498743 +
>>> --
>>> File to patch:
>>> ---
>>> 
>>> I'll just change that LINK variable to: 
>>> http://cloud-images.ubuntu.com/releases/precise/release/ubuntu-12.04-server-cloudimg-amd64-root.tar.gz
>>> 
>>> On 9/9/13 11:14 AM, France wrote:
 Carlos,
 
 just one quick question. Which OS type should be used when registering 
 this Ubuntu created VHD on CS 4.1.1 with XS 6.0.2?
 https://github.com/creategui/CloudStackImageScripts
 
 Tnx.
 F.
> 

Re: Ubuntu 12.04 LTS or 14.04 on XenServer 6.0.2 with CS 4.1.1? templates in general?

[Carlos Reátegui]

The script should be run from an Ubuntu 12.04 machine otherwise chroot will not 
work right. 

On Sep 9, 2013, at 3:20 AM, France  wrote:

> That fixed the first error, but there are two more:
> --
> Saving to: `cloud-set-guest-password-ubuntu'
> 
> 100%[>]
>  4,153   --.-K/s   in 0s
> 
> 2013-09-09 08:59:45 (50.8 MB/s) - `cloud-set-guest-password-ubuntu' saved 
> [4153/4153]
> 
> cp: cannot stat `/run/resolvconf/resolv.conf': No such file or directory
> FATAL: kernel too old
> rm: cannot remove 
> `ubuntu-12.04-server-cloudimg-amd64/run/resolvconf/resolv.conf': No such file 
> or directory
> Done creating image. You can mount it to check it out using:
> mount -o loop ubuntu-12.04-server-cloudimg-amd64.fs 
> ubuntu-12.04-server-cloudimg-amd64
> 
> If you are happy with it, copy ubuntu-12.04-server-cloudimg-amd64.fs to one 
> of your XenServer hosts and create the vhd file using createVHD.sh
> --
> 
> First is about resolv.conf which is at /etc/resolv.conf in my CentOS install. 
> I can work around that by creating softlink, even thou resolv.conf is 
> normally populated using DHCP client.
> 
> The other "FATAL: kernel too old" might be in relation to CentOS kernel, once 
> script chroots into Ubuntu install. I'm just going to leave this for now and 
> install xen tools or guest utilities once i have the first Ubuntu VM running 
> in case if they weren't already.
> 
> Now it's time to test .vhd creation.
> 
> Regards,
> F.
> 
> On 9/9/13 12:00 PM, France wrote:
>> I just found the first error:
>> 
>> Script downloads ubuntu-12.04-server-cloudimg-amd64-root.tar.gz (actually 
>> ubuntu-12.04.3-server-cloudimg-amd64-root.tar.gz redirects to 
>> ubuntu-12.04-server-cloudimg-amd64-root.tar.gz), but then tries to 
>> uncompress ubuntu-12.04.3-server-cloudimg-amd64-root.tar.gz:
>> 
>> ---
>> This filesystem will be automatically checked every 34 mounts or
>> 180 days, whichever comes first.  Use tune2fs -c or -i to override.
>> Untar file system
>> tar: ubuntu-12.04.3-server-cloudimg-amd64-root.tar.gz: Cannot open: No such 
>> file or directory
>> tar: Error is not recoverable: exiting now
>> tar: Child returned status 2
>> tar: Error exit delayed from previous errors
>> Extract done
>> Begin customizing image
>> ./createUbuntuCSimageXen.sh: line 66: etc/init/hvc0.conf: No such file or 
>> directory
>> sed: can't read boot/grub/menu.lst: No such file or directory
>> sed: can't read etc/fstab: No such file or directory
>> sed: can't read boot/grub/grub.cfg: No such file or directory
>> sed: can't read etc/fstab: No such file or directory
>> sed: can't read etc/fstab: No such file or directory
>> sed: can't read etc/cloud/cloud.cfg: No such file or directory
>> ./createUbuntuCSimageXen.sh: line 80: etc/cloud/cloud.cfg.d/90_dpkg.cfg: No 
>> such file or directory
>> can't find file to patch at input line 3
>> Perhaps you used the wrong -p or --strip option?
>> The text leading up to this was:
>> --
>> |--- /usr/lib/python2.7/dist-packages/cloudinit/DataSourceCloudStack.py.old 
>> 2012-04-11 03:54:56.0 +
>> |+++ /usr/lib/python2.7/dist-packages/cloudinit/DataSourceCloudStack.py 
>> 2013-09-07 01:01:02.482498743 +
>> --
>> File to patch:
>> ---
>> 
>> I'll just change that LINK variable to: 
>> http://cloud-images.ubuntu.com/releases/precise/release/ubuntu-12.04-server-cloudimg-amd64-root.tar.gz
>> 
>> On 9/9/13 11:14 AM, France wrote:
>>> Carlos,
>>> 
>>> just one quick question. Which OS type should be used when registering this 
>>> Ubuntu created VHD on CS 4.1.1 with XS 6.0.2?
>>> https://github.com/creategui/CloudStackImageScripts
>>> 
>>> Tnx.
>>> F.
> 

Re: Ubuntu 12.04 LTS or 14.04 on XenServer 6.0.2 with CS 4.1.1? templates in general?

[Carlos Reátegui]

Other PV 64

On Sep 9, 2013, at 2:14 AM, France  wrote:

> Carlos,
> 
> just one quick question. Which OS type should be used when registering this 
> Ubuntu created VHD on CS 4.1.1 with XS 6.0.2?
> https://github.com/creategui/CloudStackImageScripts
> 
> Tnx.
> F.

Re: Ubuntu 12.04 LTS or 14.04 on XenServer 6.0.2 with CS 4.1.1? templates in general?

[Carlos Reátegui]

This is odd. It downloads it as .3 for me. Hmm. I'll change it so that one 
downloads the tar outside of the script and passes it in instead. 

On Sep 9, 2013, at 3:00 AM, France  wrote:

> I just found the first error:
> 
> Script downloads ubuntu-12.04-server-cloudimg-amd64-root.tar.gz (actually 
> ubuntu-12.04.3-server-cloudimg-amd64-root.tar.gz redirects to 
> ubuntu-12.04-server-cloudimg-amd64-root.tar.gz), but then tries to uncompress 
> ubuntu-12.04.3-server-cloudimg-amd64-root.tar.gz:
> 
> ---
> This filesystem will be automatically checked every 34 mounts or
> 180 days, whichever comes first.  Use tune2fs -c or -i to override.
> Untar file system
> tar: ubuntu-12.04.3-server-cloudimg-amd64-root.tar.gz: Cannot open: No such 
> file or directory
> tar: Error is not recoverable: exiting now
> tar: Child returned status 2
> tar: Error exit delayed from previous errors
> Extract done
> Begin customizing image
> ./createUbuntuCSimageXen.sh: line 66: etc/init/hvc0.conf: No such file or 
> directory
> sed: can't read boot/grub/menu.lst: No such file or directory
> sed: can't read etc/fstab: No such file or directory
> sed: can't read boot/grub/grub.cfg: No such file or directory
> sed: can't read etc/fstab: No such file or directory
> sed: can't read etc/fstab: No such file or directory
> sed: can't read etc/cloud/cloud.cfg: No such file or directory
> ./createUbuntuCSimageXen.sh: line 80: etc/cloud/cloud.cfg.d/90_dpkg.cfg: No 
> such file or directory
> can't find file to patch at input line 3
> Perhaps you used the wrong -p or --strip option?
> The text leading up to this was:
> --
> |--- /usr/lib/python2.7/dist-packages/cloudinit/DataSourceCloudStack.py.old 
> 2012-04-11 03:54:56.0 +
> |+++ /usr/lib/python2.7/dist-packages/cloudinit/DataSourceCloudStack.py 
> 2013-09-07 01:01:02.482498743 +
> --
> File to patch:
> ---
> 
> I'll just change that LINK variable to: 
> http://cloud-images.ubuntu.com/releases/precise/release/ubuntu-12.04-server-cloudimg-amd64-root.tar.gz
> 
> On 9/9/13 11:14 AM, France wrote:
>> Carlos,
>> 
>> just one quick question. Which OS type should be used when registering this 
>> Ubuntu created VHD on CS 4.1.1 with XS 6.0.2?
>> https://github.com/creategui/CloudStackImageScripts
>> 
>> Tnx.
>> F.
> 

Re: Cs 4.1.0 plus Xen 6.1 No Instances or VR's starting up

[Carlos Reátegui]

Is your host able to mount secondary storage?

On Aug 24, 2013, at 3:34 PM, Kent Johnson  wrote:

> Thank you Kirk. 
> As a preface to my response a virtual router is automatically created every 
> time I create my first virtual machine. I have not yet successfully been able 
> to add an instance. The virtual router created when I make an instance is the 
> VR I am having problems with.
> 
> In answering your questions,
> 1. The virtual router goes into the starting state and never makes it to 
> running. It errors out and then goes from starting state to stopping. I did 
> see some suspicious lines on the log file:
> 2013-08-23 18:47:58,361 DEBUG [xen.resource.CitrixResourceBase] 
> (DirectAgent-9:null) Trying to connect to 169.254.3.124
> 2013-08-23 18:47:59,178 DEBUG [xen.resource.CitrixResourceBase] 
> (DirectAgent-9:null) Ping command port succeeded for vm r-11-VM
> 2013-08-23 18:47:59,561 DEBUG [agent.manager.DirectAgentAttache] 
> (DirectAgent-9:null) Seq 1-585236521: Cancelling because one of the answers 
> is false and it is stop on error.
> 
> Do you think the problem with my router not starting up is related to the 
> "stop on error" part of those log lines? A few lines later in the log it 
> tells me the guru did not like the answers so is stopping the router:
> 
> 2013-08-23 18:47:59,623 INFO  [cloud.vm.VirtualMachineManagerImpl] 
> (Job-Executor-11:job-31) The guru did not like the answers so stopping 
> VM[DomainRouter|r-11-VM]
> 2013-08-23 18:47:59,626 DEBUG [agent.transport.Request] 
> (Job-Executor-11:job-31) Seq 1-585236524: Sending  { Cmd , MgmtId: 
> 166316981724, via: 1, Ver: v1, Flags: 100111, 
> [{"StopCommand":{"isProxy":false,"vmName":"r-11-VM","wait":0}}] }
> 2013-08-23 18:47:59,627 DEBUG [agent.transport.Request] 
> (Job-Executor-11:job-31) Seq 1-585236524: Executing:  { Cmd , MgmtId: 
> 166316981724, via: 1, Ver: v1, Flags: 100111, 
> [{"StopCommand":{"isProxy":false,"vmName":"r-11-VM","wait":0}}] }
> 2013-08-23 18:47:59,627 DEBUG [agent.manager.DirectAgentAttache] 
> (DirectAgent-22:null) Seq 1-585236524: Executing request
> 2013-08-23 18:47:59,774 DEBUG [xen.resource.CitrixResourceBase] 
> (DirectAgent-22:null) 9. The VM r-11-VM is in Stopping state
> 2013-08-23 18:48:00,101 INFO  [xen.resource.CitrixResourceBase] 
> (DirectAgent-22:null) Removed  network rules for vm r-11-VM
> 
> Later it says it is in stopped state and that stopping succeeded:
> 2013-08-23 18:48:08,312 DEBUG [xen.resource.CitrixResourceBase] 
> (DirectAgent-22:null) 10. The VM r-11-VM is in Stopped state
> 2013-08-23 18:48:08,313 DEBUG [agent.manager.AgentManagerImpl] 
> (Job-Executor-11:job-31) Details from executing class 
> com.cloud.agent.api.StopCommand: Stop VM r-11-VM Succeed
> 
> Then it tells me the error was in finalizeStart:
> 2013-08-23 18:48:08,313 ERROR [cloud.vm.VirtualMachineManagerImpl] 
> (Job-Executor-11:job-31) Failed to start instance VM[DomainRouter|r-11-VM]
> com.cloud.utils.exception.ExecutionException: Unable to start 
> VM[DomainRouter|r-11-VM] due to error in finalizeStart, not retrying
> 
> Where can I see the finalizeStart method and the part of it that is failing? 
> 
> 2. I checked the /var/log/SMlog on the XenServer host and did not find any 
> lines that contained "getDomRVersion" How would I know if any of the entries 
> are related to the getDomRVersion script?
> I did notice that when I tried to start the VR then the SMlog showed a 
> failure after running router_proxy.sh and get_template_version.sh (shown in 
> the log below):
> [31327] 2013-08-24 16:14:20.346551 VMOPS enter  routerProxy 
> [31327] 2013-08-24 16:14:20.346675['/bin/bash', 
> '/opt/xensource/bin/router_proxy.sh', 'get_template_version.sh', 
> '169.254.3.168']
> [31327] 2013-08-24 16:14:20.464558FAILED in util.pread: (rc 255) stdout: 
> '', stderr: ''
> [31327] 2013-08-24 16:14:20.464766routerProxy command 
> get_template_version.sh 169.254.3.168 failed 
> [31327] 2013-08-24 16:14:20.464872 VMOPS exit  routerProxy 
> 
> 3. I checked for the /root/.ssh/id_rsa.cloud file on the XenServer host and 
> it did exist.
> 
> 4. I tried forcing reconnect through the UI and that did not solve the 
> problem.
> 5. I tried unmanaging and re-managing the cluster (I had to put my host in 
> maintenance mode first)
> 6. I tried clearing the host tags
> 
> None of this solved my problem. I did see some entries in the SMlog that made 
> me wonder if vhd-util needs to be in my primary or secondary storage 
> directory. To your knowledge, does it need to be? I thought vhd-util only 
> needed to be in /usr/bin and /opt/xensource/bin. Is there somewhere else it 
> needs to be?
> 
> 
> I am starting to wonder if I should reinstall everything and use KVM with 
> Libvirt. I really want to use Xen and CloudStack. This problem with my 
> instances and the virtual router really is an impasse for my project.
> 
> Thank you for your help, Kirk.
> 
> Best,
> 
> Kent Johnson
> University of Utah
> Gradu

Re: SSVM unable to connect to DNS

[Carlos Reátegui]

On Apr 30, 2013, at 7:09 PM, Ahmad Emneina  wrote:

> What version cloudstack are you running. First time hearing of this issue, 
> I'd imagine its a bug.

4.0.1 from Ubuntu package. 

Hosts are XS 6.0.2 fully patched up. Don't know if it makes a difference but I 
don't recall having this problem when I did not use network bonds. 

> 
> Ahmad
> 
> On Apr 30, 2013, at 6:32 PM, Carlos Reategui  wrote:
> 
>> I decided to stop iptables on the host and now the SSVM works and is able
>> to get to DNS and download the default Centos template.  Is this a known
>> issue?
>> 
>> This is what it looked like before I stopped it:
>> 
>> [root@srvengxen01 ~]# iptables -L
>> Chain INPUT (policy ACCEPT)
>> target prot opt source   destination
>> RH-Firewall-1-INPUT  all  --  anywhere anywhere
>> 
>> Chain FORWARD (policy ACCEPT)
>> target prot opt source   destination
>> RH-Firewall-1-INPUT  all  --  anywhere anywhere
>> 
>> Chain OUTPUT (policy ACCEPT)
>> target prot opt source   destination
>> 
>> Chain RH-Firewall-1-INPUT (2 references)
>> target prot opt source   destination
>> ACCEPT all  --  anywhere anywhere
>> ACCEPT icmp --  anywhere anywhereicmp any
>> ACCEPT esp  --  anywhere anywhere
>> ACCEPT ah   --  anywhere anywhere
>> ACCEPT udp  --  anywhere 224.0.0.251 udp dpt:mdns
>> ACCEPT udp  --  anywhere anywhereudp dpt:ipp
>> ACCEPT tcp  --  anywhere anywheretcp dpt:ipp
>> ACCEPT udp  --  anywhere anywhereudp dpt:bootps
>> ACCEPT all  --  anywhere anywherestate
>> RELATED,ESTABLISHED
>> ACCEPT udp  --  anywhere anywherestate NEW udp
>> dpt:ha-cluster
>> ACCEPT tcp  --  anywhere anywherestate NEW tcp
>> dpt:ssh
>> ACCEPT tcp  --  anywhere anywherestate NEW tcp
>> dpt:http
>> ACCEPT tcp  --  anywhere anywherestate NEW tcp
>> dpt:https
>> REJECT all  --  anywhere anywherereject-with
>> icmp-host-prohibited
>> 
>> 
>> 
>> On Tue, Apr 30, 2013 at 6:19 PM, Carlos Reategui wrote:
>> 
>>> Looks like my previous email only went to Ahmad...
>>> 
>>> To add to my below response.  I also installed bind9 on my management
>>> server and set it up as a caching dns to rule out issues with our corporate
>>> MS dns servers and still does not work.
>>> 
>>> 
>>> 
>>> On Tue, Apr 30, 2013 at 3:41 PM, Carlos Reategui wrote:
>>> 
 
 On Tue, Apr 30, 2013 at 3:18 PM, Ahmad Emneina wrote:
 
> looks like you cant route out to the internet. can you ping 8.8.8.8
> directly from the ssvm?
 
 Network connectivity appears fine.  As you can see from the test script
 it is able to ping the internal DNS server.  I am also able to ping
 Google's DNS:
 
 root@s-1-VM:~# ping 8.8.8.8
 PING 8.8.8.8 (8.8.8.8): 56 data bytes
 64 bytes from 8.8.8.8: icmp_seq=0 ttl=45 time=30.694 ms
 64 bytes from 8.8.8.8: icmp_seq=1 ttl=45 time=23.546 ms
 
 However I just recalled our corporate network does not allow external dns
 so I need to stick to the internal one that the SSVM is already configured
 for.
 
 The odd thing is if I try to telnet to port 53 it says no route to host
 (Is there a similar way to test a udp connection?):
 root@s-1-VM:~# telnet 172.30.20.176 53
 Trying 172.30.20.176...
 telnet: Unable to connect to remote host: No route to host
 
 But yet a ping works.
 
 root@s-1-VM:~# ping 172.30.20.176
 PING 172.30.20.176 (172.30.20.176): 56 data bytes
 64 bytes from 172.30.20.176: icmp_seq=0 ttl=127 time=0.690 ms
 64 bytes from 172.30.20.176: icmp_seq=1 ttl=127 time=0.674 ms
 64 bytes from 172.30.20.176: icmp_seq=2 ttl=127 time=0.674 ms
 
 Traceroute looks ok:
 root@s-1-VM:~# traceroute -n 172.30.20.176
 traceroute to 172.30.20.176 (172.30.20.176), 30 hops max, 60 byte packets
 1  172.30.45.32  0.273 ms !X  0.235 ms !X  0.211 ms !X
 
 any other ideas?
>>> 

Re: secondary storage, zone creation

[Carlos Reátegui]

You need to provide the path by which your hosts will be able to connect to 
them.  for example if you where to mount it from the host with the following 
command:

mount -t nfs  192.168.1.1:/export/primary /mnt/tmp

then your server would be: 192.168.1.1
and your path would be: /export/primary




On Apr 29, 2013, at 7:24 AM, Seif Eddine Jemli  
wrote:

> Hi,
> 
> i am trying to create a basic zone for simple trial, i am using the most
> basic configuration (database , nfs server and management server on the
> same machine,  and one host on which i installed xenserver)
> 
> my question is:
> 
> which path should i give (during the zone creation) to primary storage? is
> it /mnt/primary or the /export/primary   ?  (same question for the
> secondary storage)
> 
> 
> thanks

Re: CloudStack with Xen and vShere

[Carlos Reátegui]

Until Cloudstack 4.1 is released I suggest you stick to XenServer 6.0 and not 
try to swap its default xen. 

I finally have a custom build of CS 4.0.1 working with Ubuntu + xcp-xapi but it 
was a real pain to get there and don't recommend you go that route for eval 
purposes. CS 4.1 is supposed to make those pains go away and bring proper 
support for XS 6.2, XCP 1.6 and Ubuntu/Debian + xcp-xapi. 

Cheers
Carlos

On Apr 7, 2013, at 8:59 AM, paul snom  wrote:

> thanks!!
> 
> To test Xen should I just follow the installations steps in the
> Installation Manual for Citrix Xenserver, but using the binaries from
> xen.org? any good instructional links on xen and cloudstack?
> 
> Thanks, again!!
> Paul
> 
> 
> On Sun, Apr 7, 2013 at 11:37 AM, David Nalley  wrote:
> 
>> On Sun, Apr 7, 2013 at 11:31 AM, paul snom  wrote:
>>> Hi;
>>> 
>>> I'm evaluating CloudStack, I have a couple of questions I hope someone
>>> can clarify for me:
>>> Q 1: Is CloudStack compatible with Xen Hypervisor (xen.org)?  the
>>> installation manual refers to Citrix XenServer but not Xen as far as I
>>> could see.
>> 
>> 
>> CloudStack uses XAPI to interact with Xen - so technically Xen.org
>> will work provided you have XAPI in place. In practice this means
>> XenServer, XCP, or Xen + XAPI on Debian/Ubuntu.
>> 
>>> 
>>> Q 2: to continue using my vSphere hosts do I need to keep vCenter?
>> 
>> Yes - CloudStack interacts with the vCenter API, not directly with
>> vSphere hosts.
>> 
>> --David
>>