Re: Upgrading from 4.9.3 to 4.11

[ilya musayev]

You’d have to put a separate Advanced Zone to use L2 Networking. 

What would be delegating DHCP and managing DNS? 

If you can keep the DHCP+Metadata with cloudstack Router VM (it will only do 
DHCP and Metadata and no routing) - you can use everything else from upstream 
provider. This is how most Advanced Zones with VLAN isolation deployed and we 
have many of these.

You can probably manage to abstract DHCP as well but integrating with a 
provider/plugin.. GloboDNS guys wrote some sort of integration like it - 
sometime ago.

Regards,
ilya

> On Oct 31, 2018, at 10:03 AM, McClune, James  
> wrote:
> 
> Hello CloudStack Community,
> 
> I work for a school district in Ohio and we've been running ACS 4.9.3 for
> over a year now. Great piece of software! We're using Ceph (Luminous) for
> our storage backend and KVM/libvirt for virtualization.
> 
> We're starting to expand our private cloud. We'd like to rely on external
> systems for IP services (e.g. DHCP, DNS, routing, etc.). Right now, we're
> running a basic network zone (with ACS managing IP services). I'm building
> a roadmap for upgrading to ACS 4.11. I'm looking to implement the L2
> functionality in 4.11, as described here:
> 
> https://www.shapeblue.com/layer-2-networks-in-cloudstack/
> 
> I was wondering if anyone has advice on upgrading to 4.11 from 4.9.3 (i.e.
> important things to watch for, problems encountered, etc.). I'm referencing
> the documentation here:
> 
> http://docs.cloudstack.apache.org/projects/cloudstack-release-notes/en/4.11.0.0/upgrade/upgrade-4.9.html
> 
> I appreciate all input! :)
> 
> Thanks,
> 
> --
> 
> James McClune
> 
> Technical Support Specialist
> 
> Norwalk City Schools
> 
> Phone: 419-660-6590
> 
> mcclu...@norwalktruckers.net

Re: ISOs not readying?

[ilya musayev]

I came across something similar and was troubleshooting the problem as
well. See if restart of management server and secondary store system vm
allows you to download it.

If it does - we have to troubleshoot further, I suspect we have a thread
leak. Please check on number of open file handles on management server as
well before restart.

On Fri, Oct 26, 2018 at 11:47 AM Andrija Panic 
wrote:

> Just tested URL above, with normal (not direct) download, and it works
> fine. (ACS 4.11.2 RC3)
>
> Did you check the health of the Secondary Storage Virtual Machine - I would
> suggest to do so, since this seems as possible issue with SSVM and it might
> means other issues for your deployment also.
>
>
>1.
>
>ssh -i  /root/.ssh/id.rsa_cloud  -p 3922 root@SSVM>
>2. *SSVM health check* - Run the following script inside ssvm:
>/usr/local/cloud/systemvm/ssvm-check.sh
>It checks for 1)connectivity with  DNS server 2) resolving of  domain
>names 3)status of secondary storage 4)ability to write to secondary
> storage
>5)connectivity with management server at port 8250 and 6) status of java
>process.
>
>
> Please try to add template:
> http://dl.openvm.eu/cloudstack/ubuntu/x86_64/ubuntu-16.04-kvm.qcow2.bz2 -
> if this works...
>
> Cheers,
> Andrija
>
> On Fri, 26 Oct 2018 at 19:41, Alexandre Bruyere <
> bruyere.alexan...@gmail.com>
> wrote:
>
> > Direct download that bypasses secondary storage seems to make it ready
> > instantly (with the correct filesize), so I'm going to assume the link is
> > good.
> >
> > On Fri, Oct 26, 2018 at 1:28 PM Alexandre Bruyere <
> > bruyere.alexan...@gmail.com> wrote:
> >
> > > No progress in UI, no status.
> > >
> > > How would I make sure there are no redirections? At a glance there
> > doesn't
> > > seem to be any.
> > >
> > > On Fri, Oct 26, 2018 at 12:33 PM Andrija Panic <
> andrija.pa...@gmail.com>
> > > wrote:
> > >
> > >> Make sure no http redirections, no ssl support (not sure if https URLs
> > are
> > >> supported now in 4.11 or not). Only plain http adn status code 200 :)
> > >>
> > >> Do you see percentage /download progress in UI ?
> > >>
> > >> On Fri, Oct 26, 2018, 18:20 Alexandre Bruyere <
> > >> bruyere.alexan...@gmail.com>
> > >> wrote:
> > >>
> > >> > Hello.
> > >> >
> > >> > I've set up a Ubuntu 16.04.5 Cloudstack setup using this tutorial:
> > >> >
> > >> > https://rohityadav.cloud/blog/cloudstack-kvm/
> > >> >
> > >> > The only place I've strayed is that I've configured four network
> > >> interfaces
> > >> > - enp3s0 set as manual config, enp3s0.10 set as manual config (I've
> > made
> > >> > sure my system was VLAN-enabled), cloudbr0 as a
> statically-configured
> > >> > bridge to enp3s0 and cloudbr1 as a statically-configured bridge to
> > >> > enp3s0.10 on VLAN 10.
> > >> >
> > >> > My problem is, I'm currently trying to import an iso (Ubuntu Server)
> > >> from
> > >> > URL (
> http://releases.ubuntu.com/16.04/ubuntu-16.04.5-server-amd64.iso
> > )
> > >> in
> > >> > two zones (one on cloudbr0, one on cloudbr1).
> > >> >
> > >> > Adding the ISO seems to work fine, but they never become "ready".
> Any
> > >> tips
> > >> > as to why?
> > >> >
> > >> > (I will be testing direct download shortly)
> > >> >
> > >>
> > >
> >
>
>
> --
>
> Andrija Panić
>

Re: Host HA vs transient NFS problems on KVM

[ilya musayev]

Would you please file the JIRA bugs describing in exact details

1) your setup
2) what was done or happened
3) expected result

I imagine this will be fixed in the next point release if issues are indeed
correct. We’ve yet to try this framework and if it does not work as
anticipated we will have lots of issues.



On Tue, Oct 23, 2018 at 8:30 AM Andrei Mikhailovsky
 wrote:

> Hi Jean,
>
> I have previously done some HA testing and have pretty much came to
> similar conclusions as you have. My testing showed that using HA is very
> unreliable at best and data loosing at worst cases. I have had the
> following outcome from various testing scenarios:
>
> 1. Works as expected (very rarely)
> 2. Starts 2 vms on different hosts (data loss / corruption)
> 3. Reboots ALL KVM hosts (even those hosts that do not have a single vm
> with nfs volumes)
>
> Now, I can not justify having HA with even a slim chances of having 2 or 3
> above. Honestly, I do not know a single business that is happy to accept
> those scenarios. Frankly speaking, for me the cloudstack HA options create
> more problems than solve and thus I've not enabled them. I have decided
> that ACS with KVM is not HA friendly, full stop. Having said this, I've not
> tested the latest couple of releases, so I will give it a benefit of the
> doubt and wait for user's reports to prove my conclusion otherwise. I've
> wasted enough of my own time on KVM HA.
>
> My HA approach to ACS is more of a manual nature, which is far more
> reliable and is less prone to issues in my experience. I have a monitoring
> system sending me alerts when VMs, host servers and storage become
> unreachable. It is not as convenient as a fully working automatic HA, I
> agree, but it is far better to be woken up at 3am to deal with restarting a
> handful of vms and perhaps a KVM host force reboot than dealing with mass
> KVM hosts reboots and/or trying to find duplicate vms lurking somewhere on
> the host servers. Been there, done that - NO THANKS!
>
> Cheers
>
> Andrei
>
> - Original Message -
> > From: "Jean-Francois Nadeau" 
> > To: "users" 
> > Sent: Monday, 22 October, 2018 22:13:35
> > Subject: Host HA vs transient NFS problems on KVM
>
> > Dear community,
> >
> > I want to share my concern upgrading from 4.9 to 4.11 in regards to how
> the
> > host HA framework works and the handling of various failure conditions.
> >
> > Since we have been running CS on 4.9.3 with NFS on KVM,  VM HA have been
> > working as expected when hypervisor crashed and I agree we might have
> > been lucky knowing the limitations of the KVM investigator and the
> > possibility to fire the same VM on 2 KVM hosts is real when you know the
> > recipe for it.
> >
> > Still, on 4.9.3 we were tolerant to transient primary NFS storage access
> > issues, typical of a network problem (and we've seen it lately for a 22
> > minutes disconnection).  Although these events are quite rare,  when they
> > do happen their blast radius can be a huge impact on the business.
> >
> > So when we initially tested CS on 4.9.3 we purposely blocked access to
> NFS
> > and we observe the results.   Changing the kvmhearbeat.sh script so it
> > doesn't reboot the node after 5 minutes has been essential to defuse the
> > potential of a massive KVM hosts reboot.In the end,  it's far less
> > damage to let NFS recover than having all those VMs rebooted.   On 4.9.3
> > the cloudtack-agent will remain "Up"  and not fire any VM twice if the
> NFS
> > storage becomes available again within 30 minutes.
> >
> > Now, testing the upgrade from 4.9 to 4.11 in our lab and the same
> failure
> > conditions we rapidly saw a different behavior although not perfectly
> > consistent.  On 4.11.2 without host HA enabled,  we will see the agent
> > "try" to disconnect after 5 minutes tho sometimes the KVM host goes into
> > Disconnect state and sometimes it goes straight to Down state.  In that
> > case we'll see a duplicate VM created in no time and once the NFS issue
> is
> > resolved,  we have 2 copies of that VM and cloudstack only knowns about
> > that last copy.   This is obviously a disaster forcing us to look at how
> > host HA can help.
> >
> > Now with host HA enabled and simulating the same NFS hiccup,  we won't
> get
> > duplicate VMs but we will get a KVM host reset.  The problem here is
> that,
> > yes the host HA does ensure we don't have dup VMs but at scale this would
> > also provoke a lot of KVM host resets (if not all of them).   If we are
> at
> > risk with host HA to have massive KVM host resets,  then I might prefer
> to
> > disable host/VM HA entirely and just handle KVM host failures manually.
> > This is supper annoying for the ops team,  but far less risky for the
> > business.
> >
> > Im trying to find if there's a middle ground here between the 4.9
> behavior
> > with NFS hiccups and the reliability of the new host HA framework.
> >
> > best,
> >
> > Jean-Francois
>

Re: Buggy dashboard statistics

[ilya musayev]

I dont see these issues in my env and both views are ok.

We’ve worked with ShapeBlue on testing ACS rather extensively from from 4.5 -> 
4.11.. no issues of this type have been observed.

I can only assume you tried chrome “incognito” mode and its not caching issue.. 

You should be able to see where the errors are if you view the console.. 

> On Aug 22, 2018, at 9:59 PM, Ivan Kudryavtsev  
> wrote:
> 
> That interface doesn't work for me completely))
> https://box.bw-sw.com/f/959fb9b92a74424eaf0b/
> 
> capacity.check.period is 30 (300 seconds)
> 
> Actually, I don't care about those metrics at all because use Zabbix, but
> you know, enterprise users will not be happy with such a trashy look.
> 
> 2018-08-23 11:54 GMT+07:00 ilya musayev :
> 
>> Oh - i never pay attention to these in general - but thats rather
>> alarming.
>> 
>> Have you tried using “metrics” tab under infrastructure - does that look
>> red when you drill down from zone -> cluster -> host?
>> 
>> Lastly - what is you interval for checking capacity set to in global
>> settings?
>> 
>>> On Aug 22, 2018, at 9:47 PM, Ivan Kudryavtsev 
>> wrote:
>>> 
>>> Ok, let's go.
>>> Share it here: https://box.bw-sw.com/f/f264de747a5b4d38ac07/
>>> As you can see, all gauges are red, despite should be almost fine.
>>> 
>>> 2018-08-23 10:52 GMT+07:00 ilya musayev :
>>> 
>>>> Can you share screenshot somewhere please..
>>>> 
>>>> 
>>>> 
>>>>> On Aug 22, 2018, at 5:22 AM, Ivan Kudryavtsev <
>> kudryavtsev...@bw-sw.com>
>>>> wrote:
>>>>> 
>>>>> Hi, it's all red in my case. Buggy, indeed.
>>>>> 
>>>>> ср, 22 авг. 2018 г., 18:46 Benjamin Naber <
>> benjamin.na...@coders-area.de
>>>>> :
>>>>> 
>>>>>> Hi @all,
>>>>>> 
>>>>>> 
>>>>>> i successfully upgraded our environment from 4.10 to 4.11.1.
>>>>>> 
>>>>>> The Management gui looks at Dashboard statistics now abit buggy.
>> Someone
>>>>>> other have a similar problem with 4.11.1 ?
>>>>>> 
>>>>>> Browser cache clearing has no effect. Are there any Server Cache that
>>>> can
>>>>>> be cleared.
>>>>>> 
>>>>>> King regards
>>>>>> 
>>>>>> Ben
>>>>>> 
>>>>>> 
>>>> 
>>>> 
>>> 
>>> 
>>> --
>>> With best regards, Ivan Kudryavtsev
>>> Bitworks LLC
>>> Cell: +7-923-414-1515
>>> WWW: http://bitworks.software/ <http://bw-sw.com/>
>> 
>> 
> 
> 
> -- 
> With best regards, Ivan Kudryavtsev
> Bitworks LLC
> Cell: +7-923-414-1515
> WWW: http://bitworks.software/ <http://bw-sw.com/>

Re: Buggy dashboard statistics

[ilya musayev]

Oh - i never pay attention to these in general - but thats rather alarming. 

Have you tried using “metrics” tab under infrastructure - does that look red 
when you drill down from zone -> cluster -> host?

Lastly - what is you interval for checking capacity set to in global settings?

> On Aug 22, 2018, at 9:47 PM, Ivan Kudryavtsev  
> wrote:
> 
> Ok, let's go.
> Share it here: https://box.bw-sw.com/f/f264de747a5b4d38ac07/
> As you can see, all gauges are red, despite should be almost fine.
> 
> 2018-08-23 10:52 GMT+07:00 ilya musayev :
> 
>> Can you share screenshot somewhere please..
>> 
>> 
>> 
>>> On Aug 22, 2018, at 5:22 AM, Ivan Kudryavtsev 
>> wrote:
>>> 
>>> Hi, it's all red in my case. Buggy, indeed.
>>> 
>>> ср, 22 авг. 2018 г., 18:46 Benjamin Naber >> :
>>> 
>>>> Hi @all,
>>>> 
>>>> 
>>>> i successfully upgraded our environment from 4.10 to 4.11.1.
>>>> 
>>>> The Management gui looks at Dashboard statistics now abit buggy. Someone
>>>> other have a similar problem with 4.11.1 ?
>>>> 
>>>> Browser cache clearing has no effect. Are there any Server Cache that
>> can
>>>> be cleared.
>>>> 
>>>> King regards
>>>> 
>>>> Ben
>>>> 
>>>> 
>> 
>> 
> 
> 
> -- 
> With best regards, Ivan Kudryavtsev
> Bitworks LLC
> Cell: +7-923-414-1515
> WWW: http://bitworks.software/ <http://bw-sw.com/>

Re: Buggy dashboard statistics

[ilya musayev]

Can you share screenshot somewhere please..



> On Aug 22, 2018, at 5:22 AM, Ivan Kudryavtsev  
> wrote:
> 
> Hi, it's all red in my case. Buggy, indeed.
> 
> ср, 22 авг. 2018 г., 18:46 Benjamin Naber :
> 
>> Hi @all,
>> 
>> 
>> i successfully upgraded our environment from 4.10 to 4.11.1.
>> 
>> The Management gui looks at Dashboard statistics now abit buggy. Someone
>> other have a similar problem with 4.11.1 ?
>> 
>> Browser cache clearing has no effect. Are there any Server Cache that can
>> be cleared.
>> 
>> King regards
>> 
>> Ben
>> 
>> 

Re: 4.9 to 4.11 upgrade broken

[ilya musayev]

yes - please try the proper 4.11 systemvm templates.

> On Aug 21, 2018, at 1:54 PM, Asai  wrote:
> 
> Can I manually download the systemvm template from here? 
> http://download.cloudstack.org/systemvm/4.11/ 
> <http://download.cloudstack.org/systemvm/4.11/>
> 
> Then manually overwrite it in the filesystem and update it accordingly in the 
> database?
> 
> Asai
> 
> 
>> On Aug 21, 2018, at 1:40 PM, Asai  wrote:
>> 
>> 4.11.0
>> 
>> As outlined in this 
>> http://docs.cloudstack.apache.org/projects/cloudstack-release-notes/en/4.11.0.0/upgrade/upgrade-4.9.html
>>  
>> <http://docs.cloudstack.apache.org/projects/cloudstack-release-notes/en/4.11.0.0/upgrade/upgrade-4.9.html>
>>> On Aug 21, 2018, at 1:37 PM, ilya musayev  
>>> wrote:
>>> 
>>> which template did you use? 
>>> 
>>>> On Aug 21, 2018, at 1:36 PM, Asai  wrote:
>>>> 
>>>> Greetings,
>>>> 
>>>> I just tried to upgrade from 4.9 to 4.11, but it looks like the system VM 
>>>> template I downloaded according to the upgrade guide is the wrong 
>>>> template.  It’s 4.11, but I upgraded to 4.11.1 and I get this error 
>>>> message:
>>>> 
>>>> Caused by: com.cloud.utils.exception.CloudRuntimeException: 4.11.1.0KVM 
>>>> SystemVm template not found. Cannot upgrade system Vms
>>>>at 
>>>> com.cloud.upgrade.dao.Upgrade41100to41110.updateSystemVmTemplates(Upgrade41100to41110.java:281)
>>>>at 
>>>> com.cloud.upgrade.dao.Upgrade41100to41110.performDataMigration(Upgrade41100to41110.java:68)
>>>>at 
>>>> com.cloud.upgrade.DatabaseUpgradeChecker.upgrade(DatabaseUpgradeChecker.java:578)
>>>>... 53 more
>>>> 2018-08-21 13:28:25,257 INFO  [o.e.j.s.h.ContextHandler] (main:null) 
>>>> (logid:) Started o.e.j.s.h.MovedContextHandler@15bfd87{/,null,AVAILABLE}
>>>> 2018-08-21 13:28:25,317 INFO  [o.e.j.s.AbstractConnector] (main:null) 
>>>> (logid:) Started ServerConnector@4b1c1ea0{HTTP/1.1,[http/1.1]}{:::8080}
>>>> 2018-08-21 13:28:25,318 INFO  [o.e.j.s.Server] (main:null) (logid:) 
>>>> Started @20725ms
>>>> 
>>>> Can anyone assist with getting this corrected?
>>>> 
>>>> Thank you,
>>>> Asai
>>>> 
>>>> 
>>> 
>> 
> 

Re: 4.9 to 4.11 upgrade broken

[ilya musayev]

which template did you use? 

> On Aug 21, 2018, at 1:36 PM, Asai  wrote:
> 
> Greetings,
> 
> I just tried to upgrade from 4.9 to 4.11, but it looks like the system VM 
> template I downloaded according to the upgrade guide is the wrong template.  
> It’s 4.11, but I upgraded to 4.11.1 and I get this error message:
> 
> Caused by: com.cloud.utils.exception.CloudRuntimeException: 4.11.1.0KVM 
> SystemVm template not found. Cannot upgrade system Vms
>   at 
> com.cloud.upgrade.dao.Upgrade41100to41110.updateSystemVmTemplates(Upgrade41100to41110.java:281)
>   at 
> com.cloud.upgrade.dao.Upgrade41100to41110.performDataMigration(Upgrade41100to41110.java:68)
>   at 
> com.cloud.upgrade.DatabaseUpgradeChecker.upgrade(DatabaseUpgradeChecker.java:578)
>   ... 53 more
> 2018-08-21 13:28:25,257 INFO  [o.e.j.s.h.ContextHandler] (main:null) (logid:) 
> Started o.e.j.s.h.MovedContextHandler@15bfd87{/,null,AVAILABLE}
> 2018-08-21 13:28:25,317 INFO  [o.e.j.s.AbstractConnector] (main:null) 
> (logid:) Started ServerConnector@4b1c1ea0{HTTP/1.1,[http/1.1]}{:::8080}
> 2018-08-21 13:28:25,318 INFO  [o.e.j.s.Server] (main:null) (logid:) Started 
> @20725ms
> 
> Can anyone assist with getting this corrected?
> 
> Thank you,
> Asai
> 
> 

Re: Upgrading from 4.9 to 4.10

[ilya musayev]

+1 on 4.11 - it’s LTS release and got much more attention

On Wed, Aug 15, 2018 at 9:13 AM Dag Sonstebo 
wrote:

> Asai,
>
> First of all I strongly advise you to upgrade to 4.11.1 instead of 4.10 –
> this will cause you a lot less pain.
>
> With regards to the template upload in 4.9 – do template uploads normally
> work? I’d suggest you check through the management-server.log and cloud.log
> on the SSVM to troubleshoot further. Also maybe destroy the SSVM and let
> this recreate, just in case it’s not healthy.
>
> Regards,
> Dag Sonstebo
> Cloud Architect
> ShapeBlue
>
> On 15/08/2018, 17:09, "Asai"  wrote:
>
> Greetings,
>
> We’re attempting an upgrade from 4.9 to 4.10, but we cannot seem to
> get past the SystemVM 4.10 download stage.  When registering a new template
> according to the documentation, the newly created systemvm-4.10 never
> enters the ready state.  I have tried downloading from the repository as
> well as uploading the systemvm from my local computer but it never seems to
> complete, and we cannot move forward.
>
> Can anyone share any insights into this problem?
> Asai
>
>
> dag.sonst...@shapeblue.com
> www.shapeblue.com
> 53 Chandos Place, Covent Garden, London  WC2N 4HSUK
> @shapeblue
>
>
>
>

Re: LDAP in 4.11.1

[ilya musayev]

You are most likely getting incorrect query to ldap.

If you can - use ldap connectivity without ssl and do tcpdump to see if you
can capture the ldapquery.

You can then identify the issue. Alternately, you can look into enabling
trace logging for ldap module and perhaps it prints the query.

Daan can shed more details on this issue as he was the one working on it.

On Thu, Aug 2, 2018 at 12:55 PM  wrote:

> Yes, full restart of management server to be safe. I have tried putting in
> the LDAP name, the Pre-Windows name, etc..
>
> -Original Message-
> From: Rafael Weingärtner 
> Sent: Thursday, August 2, 2018 1:22 PM
> To: users 
> Subject: Re: LDAP in 4.11.1
>
> Did you restart ACS after configuring it?
>
> On Thu, Aug 2, 2018 at 2:03 PM,  wrote:
>
> > Hello guys,
> >
> >
> >
> > I am attempting to bind an ACS domain to an LDAP domain and I get the
> > error "can not link a domain unless a basedn is configured for it" but
> > this is set in the settings. Anyone seen this?
> >
> >
> >
> >
> >
> >
>
>
> --
> Rafael Weingärtner
>
>

Re: [PROPOSE] Combining Apache CloudStack Documentation

[ilya musayev]

I like it but wonder if Upgrade section needs to be added? ..

On Tue, Jul 24, 2018 at 2:25 AM Paul Angus  wrote:

> Hi All,
>
> We currently have four sources of documentation [1]. Which make managing
> the documentation convoluted, and worse, make navigating and searching the
> documentation really difficult.
>
> I have taken the current documentation and combined them into one repo,
> then created 7 sections:
>
> CloudStack Concepts and Terminology
> Quick Installation Guide
> Installation Guide
> Usage Guide
> Developers Guide
> Plugins Guide
> Release Notes
>
> I haven't changed any of the content, but I've moved some of it around to
> make more sense (to me).  You can see the result on RTD [2]
>
> I'd like to PROPOSE to move this demo version of the documentation over to
> the Apache repos and make it THE documentation source, update the website,
> and mark the current repos/sites as archive data.
>
> [1]
> https://github.com/apache/cloudstack-docs.git <
> https://github.com/apache/cloudstack-docs.git> is a bit of a dodge-podge
> of resources
> https://github.com/apache/cloudstack-docs-install.git is the install guide
> https://github.com/apache/cloudstack-docs-admin.git is the current admin
> manual.
> https://github.com/apache/cloudstack-docs-rn.git is the release notes for
> individual releases
>
> [2]  https://beta-cloudstack-docs.readthedocs.io/en/latest/
>
> paul.an...@shapeblue.com
> www.shapeblue.com
> 53 Chandos Place, Covent Garden, London  WC2N 4HSUK
> @shapeblue
>
>
>
>

Re: 4.11.0 -> 4.11.1 problem: Guest VMs losing connection after few minutes

[ilya musayev]

Have you tried destroying router vm and let CloudStack create new one ?

On Fri, Jul 20, 2018 at 1:33 AM Jevgeni Zolotarjov 
wrote:

> - an ip-address conflict.
>   JZ: unlikely, but not impossible. I tried to restart router VM in
> Network-Guest networks -> defaultGuestNetwork -> VirtualAppliances
> While rebooting ping to this router VM disappeared. Hence, no other device
> is using the same IP.
> But!!! when this virtual router started, then network connection to all
> guest VMs disappeared. So, it must be something with this virtual router.
>
> - flakey hardware being one of
> -+ if card in the host
> JZ: higly unlikely
>
> -+ a router with bad firmware
> JZ: also unlikely
>
> - of course a strange cofiguration of the software router in you host might
> be the issue as well
> JZ: I didnt do any special configuration. Just used default.
>
> by all I know this happening after upgrade sounds like an unhappy incident
> but can't be sure.
> The iptables restart, was this on the VirtualRouter or on the host, or
> maybe on the guest? and the restart network?
>
> JZ: iptables restart on host machine. (or network restart on host)
>
>
>
> On Fri, Jul 20, 2018 at 11:14 AM Daan Hoogland 
> wrote:
>
> > that behaviour sound familiar from a couple of cases:
> > - an ip-address conflict.
> > - flakey hardware being one of
> > -+ if card in the host
> > -+ a router with bad firmware
> > - of course a strange cofiguration of the software router in you host
> might
> > be the issue as well
> >
> > by all I know this happening after upgrade sounds like an unhappy
> incident
> > but can't be sure.
> > The iptables restart, was this on the VirtualRouter or on the host, or
> > maybe on the guest? and the restart network?
> >
> >
> > On Fri, Jul 20, 2018 at 7:43 AM, Jevgeni Zolotarjov <
> > j.zolotar...@gmail.com>
> > wrote:
> >
> > > I updated cloudstack 4.11.0 -> 4.11.1
> > >
> > > Everything went OK during update, but after host reboot guest VMs lost
> > > connection after few minutes of normal work.
> > > I tried restarting network - systemctl restart network.service
> > > then connection was restored again for few minutes
> > >
> > > Finally I could restore connection by restarting iptables - systemctl
> > > restart iptables.service
> > >
> > > But then again guest VMs lost connection after few minutes of normal
> > > operation.
> > > The time of normal operation can be 5 minutes, but sometimes up to 40
> > > minutes.
> > >
> > > Please help me to track the root cause and fix it
> > >
> > > Host OS - Centos 7.5
> > > virtualisation - KVM
> > >
> >
> >
> >
> > --
> > Daan
> >
>

Re: Storage traffic clarification.

[ilya musayev]

Jon

with Basic Network - it implies you have all in one network for everything.

If you have a storage network that is L3 routable and you don’t want to use
guest network - then when you create a zone - use storage label and define
what bridge will be used to get there.

If it’s not guest bridge you wan to use - then use the management Bridge.

 Regards
Ilya

On Wed, Jun 20, 2018 at 12:25 AM Jon Marshall  wrote:

> I am probably missing something obvious but according to this article (
> https://www.shapeblue.com/understanding-cloudstacks-physical-networking-architecture/)
> by default primary and secondary storage traffic travels across the
> management network.
>
> As an example assume basic networking with 2 NICS, one for management with
> an IP subnet,  the other NIC for guest traffic using a different subnet. A
> physical host should only have one default gateway and this would have to
> be from the guest VM subnet.
>
> I setup two tests  -
>
> 1) the NFS server had an IP address from the management subnet
>
> 2) the NFS server was on a completely different IP subnet ie. not the
> management or the guest IP subnets.
>
> Both worked but in test 2 I can't see how the storage traffic could be
> using the management NIC because there is no default gateway on the compute
> nodes for the management subnet and the NFS server is on a remote network.
>
> So is storage traffic in test 2 actually running across the guest NIC ?
>
> And as the recommendation is to have separate storage from guest traffic
> does this mean the NFS server has to be in the management subnet ?
>
> Thanks
>

Convert KVM Instance to CloudStack

[ilya musayev]

Hi Users and Dev

I apologize for cross posting.. 

I have bunch of VMs that were deployed by CloudStack - however - the management 
server along with a DB is no longer available.

This is a POC environment - but i would love not to loose and recreate the VMs 
if possible,

Hence i’m thinking of writing re-injestion process of existing running KVM 
instances back into new cloudstack - without doing template imports and such.

Has anyone create a tooling for this endevour by any chance? If not - i might 
have to create one :(


Thanks
ilya

Re: Dynamic roles question

[ilya musayev]

Ivan

This is already done in 4.11, I’m not next to comp to check but ShapeBlue
has a feature created that would allow for movement between different roles.

Regards
ilya

On Thu, May 17, 2018 at 6:03 AM Ivan Kudryavtsev 
wrote:

> Hello, community.
>
> I'm thinking about implementing the feature for accounts which permits to
> change account role. Basically, the rationale is trials or demonstration
> modes which restricts users from doing extra stuff, like VM creation,
> service offering changes, etc. Basically, after trial the account should be
> switched to a normal mode or removed. By permitting such role switching we
> can support the feature, otherwise we have to create unique role for every
> user and manage it separately. Please, let me know your thoughts about
> that. Have a good day.
>
> --
> With best regards, Ivan Kudryavtsev
> Bitworks Software, Ltd.
> Cell: +7-923-414-1515
> WWW: http://bitworks.software/ 
>

Re: related to CLOUDSTACK-10310 Fix KVM reboot on storage issue need workaround

[ilya musayev]

We maybe missing a bit of context here - are you using NFS as shared
storage in the cluster?

If so - are you certain you aren’t loosing connectivity to NFS primary
storage?

Please upload the agent.log to pastebin or similar site and share the link.



On Tue, May 15, 2018 at 3:13 AM hanumant borwandkar <
hanumant.borwand...@gmail.com> wrote:

> Hi,
>
> We are using cloudstack inhouse with the version
>
> cloudstack-common-4.9.2.0-1.el7.centos.x86_64
> cloudstack-agent-4.9.2.0-1.el7.centos.x86_64
>
> But unfortunately sometime or after every few day compute host getting
> rebooted by cloudstack-agent and all VM running on that compute get
> affected.
>
> It seems that I m facing issue related to* CLOUDSTACK-10310 Fix KVM reboot
> on storage issue.*
>
> I tried to modify
> /usr/share/cloudstack-common/scripts/vm/hypervisor/kvm/kvmheartbeat.sh
> as per github follows
>
> *  /usr/bin/logger -t heartbeat "kvmheartbeat.sh stopped cloudstack-agent
> because it was unable to write the heartbeat to the storage."*
> *  sync &*
> *  sleep 5*
> *  #echo b > /proc/sysrq-trigger*
> * service cloudstack-agent stop*
>
> But no improvement still compute getting rebooted .
>
> Can someone able to provide workaround or fix for this issue
>
> Regards,
> Hanumant Borwandkar
>

Re: Cloudtack manager UI returns Error 404

[ilya musayev]

You must be running java 1.7 - I assume Suresh was alluding to this.
We’ve seen this error with 1.8...

On Wed, May 16, 2018 at 10:36 PM Suresh Kumar Anaparti <
sureshkumar.anapa...@gmail.com> wrote:

> Hi Natalia,
>
> Any changes in the java version or system configuration?
>
> -Suresh
>
> On Thu, May 17, 2018 at 4:14 AM, Dag Sonstebo 
> wrote:
>
> > Hi Natalia,
> >
> > My guess is you have some sort of corruption on your original host. Since
> > the management service itself is stateless it’s generally much quicker
> just
> > building a new one than trying to recover the old one.
> >
> > So my suggestions would be:
> > - Recover your DB to a dedicated DB host if you haven’t done so already.
> > - Build a new management server and just point this to the original DB as
> > described in http://docs.cloudstack.apache.org/projects/cloudstack-
> > installation/en/4.9/management-server/index.html#
> > additional-management-servers
> > NOTE: do not use the “–deploy-as” option as this will write a new blank
> > database. If you used encryption keys during the original setup you also
> > need to specify these.
> >
> > Once you have these two speaking you should in theory be back up and
> > running again.
> >
> > Regards,
> > Dag Sonstebo
> > Cloud Architect
> > ShapeBlue
> >
> >
> > dag.sonst...@shapeblue.com
> > www.shapeblue.com
> > 53 Chandos Place, Covent Garden, London  WC2N 4HSUK
> > @shapeblue
> >
> >
> >
> > On 16/05/2018, 16:44, "Natalia Costas Lago"  wrote:
> >
> >
> > Dear all,
> >
> > For some reason our cloudstack manager died and now we are not able
> to
> > make it work. Our cloudstack version is 4.9.0.
> >
> > We tried to do a clean install of the manager and recover the
> database
> > from the last backup, but we were not able to recover the service.
> >
> > At present we can see in the logs that it almost boot, but at the end
> > we
> > get this error:
> >
> > May 16 17:33:51 cldmanager.srv.cesga.es server: INFO
> > [o.a.c.e.o.NetworkOrchestrator] (localhost-startStop-1:null) (logid:)
> > Network Manager will run the NetworkGarbageCollector every '600'
> > seconds.
> > May 16 17:33:51 cldmanager.srv.cesga.es server: INFO
> > [c.c.a.ApiServer]
> > (Thread-12:null) (logid:) ApiServer listening on port 8096
> > May 16 17:33:51 cldmanager.srv.cesga.es server: INFO
> > [o.a.c.s.SecondaryStorageManagerImpl] (localhost-startStop-1:null)
> > (logid:) Start secondary storage vm manager
> > May 16 17:33:52 cldmanager.srv.cesga.es server: log4j:WARN No
> > appenders
> > could be found for logger (com.cloud.utils.db.ConnectionConcierge).
> > May 16 17:33:52 cldmanager.srv.cesga.es server: log4j:WARN Please
> > initialize the log4j system properly.
> > May 16 17:33:52 cldmanager.srv.cesga.es server: log4j:WARN See
> > http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
> > May 16 17:34:20 cldmanager.srv.cesga.es server: Exception in thread
> > "CapacityChecker" java.lang.NoClassDefFoundError:
> > org/apache/cloudstack/managed/context/ManagedContextTimerTask$1
> > May 16 17:34:20 cldmanager.srv.cesga.es server: at
> > org.apache.cloudstack.managed.context.ManagedContextTimerTask.run(
> > ManagedContextTimerTask.java:27)
> > May 16 17:34:20 cldmanager.srv.cesga.es server: at
> > java.util.TimerThread.mainLoop(Timer.java:555)
> > May 16 17:34:20 cldmanager.srv.cesga.es server: at
> > java.util.TimerThread.run(Timer.java:505)
> > May 16 17:34:20 cldmanager.srv.cesga.es server: Caused by:
> > java.lang.ClassNotFoundException:
> > org.apache.cloudstack.managed.context.ManagedContextTimerTask$1
> > May 16 17:34:20 cldmanager.srv.cesga.es server: at
> > org.apache.catalina.loader.WebappClassLoaderBase.loadClass(
> > WebappClassLoaderBase.java:1892)
> > May 16 17:34:20 cldmanager.srv.cesga.es server: at
> > org.apache.catalina.loader.WebappClassLoaderBase.loadClass(
> > WebappClassLoaderBase.java:1735)
> > May 16 17:34:20 cldmanager.srv.cesga.es server: ... 3 more
> > May 16 17:34:24 cldmanager.srv.cesga.es server: Exception in thread
> > "Timer-1" java.lang.NoClassDefFoundError:
> > org/apache/cloudstack/managed/context/ManagedContextTimerTask$1
> > May 16 17:34:24 cldmanager.srv.cesga.es server: at
> > org.apache.cloudstack.managed.context.ManagedContextTimerTask.run(
> > ManagedContextTimerTask.java:27)
> > May 16 17:34:24 cldmanager.srv.cesga.es server: at
> > java.util.TimerThread.mainLoop(Timer.java:555)
> > May 16 17:34:24 cldmanager.srv.cesga.es server: at
> > java.util.TimerThread.run(Timer.java:505)
> >
> > Any help is appreciated..
> >
> > Kind regards,
> >
> > NOTA: Para cualquier incidencia/consulta/petición que requiera
> > seguimiento por favor enviar a helpdesk_comunicacio...@cesga.es
> >
> > --
> > 
> > Natalia Costas Lag

Re: ssvm NFS public ip

[ilya musayev]

There is a global setting you have to set to use internal non public IP.

Try setting sec.storage.allow.internal.site to an internal network cidr.

You may need to destroy ssvm for settings to take effect. In my case there
is some sort of minor bug where it takes upward of 5 minutes for ssvm to
program the internal routes, but since this is onetime operation - I just
live with it.

On Wed, Apr 11, 2018 at 10:50 AM Nicolas Bouige  wrote:

> a small update about my problem.
>
> I 've recreated the zone from scratch this morning and  one of my
> "cloudbr" used for the secondary storage was misconfigured.
>
> So Now, I can ping the secondary storage from KVM host, CS-MGMT,  SSVM and
> mount the nfs on them...but...the agent still not going up and the
> ssvm_check.sh give me an ip public for the nfs instead of the private.
>
>
> i got only this error in /var/log:cloud.log :
>
> 17:30:22,600 ERROR AgentShell:477 - Unable to start agent: Resource class
> not found: com.cloud.storage.resource.PremiumSecondaryStorageResource due
> to: java.lang.ClassNotFoundException:
> com.cloud.storage.resource.PremiumSecondaryStorageReso
>   urce
> Unable to start agent: Resource class not found:
> com.cloud.storage.resource.Prem
> iumSecondaryStorageResource due to: java.lang.ClassNotFoundException:
> com.cloud.
> storage.resource.PremiumSecondaryStorageResource
>
> i've tried to update a differente systemvm template with no success...
> I 've compared the configuration of the ssvm with one of our deployment
> and i juste noticed the "resource"
> (org.apache.cloudstack.storage.resource.NfsSecondaryResource) was not the
> same.
> i changed it but still the same error...
>
> There is a way to find java binaries/script and  upload them on the ssvm ?
>
> If one of you have an idea, it would be appreciate.
>
> Thanks !
>
> Best regards,
> N.B
>
>

Re: [DISCUSS] CloudMonkey 6.0.0-alpha (about six years after initial version in 2012)

[ilya musayev]

This is great news and cloud monkey is used more than you think :)

I will share the news with my team.

On Tue, Apr 10, 2018 at 5:07 AM Will Stevens  wrote:

> +1. It has been a great tool for years.  Looking forward to the golang
> version.
>
> On Apr 10, 2018 7:59 AM, "Rohit Yadav"  wrote:
>
> All,
>
>
> Few months ago, I started porting the current code to be compatible with
> both Python2 and Python3 to make it run with both Python2 (for older
> systems such as CentOS6 etc) and Python3 (for newer platforms). The work
> was not a success, another problem was that cloudmonkey was not easy to
> install and required several dependencies that would certainly fail on
> older systems with Python 2.6.x.
>
>
> Considering all things, I started working on an experimental golang port
> [2] and happy to announce that the initial alpha version shows a lot of
> promise and is 5-20x faster than the python based cli [1]. The compiled
> binary runs on several targets, including windows [1].
>
>
> I cannot commit to a timeline/release date yet but the aim of this thread
> is to discuss and propose the simplification of the CLI which may require
> removal of some features and some breaking changes may be introduced:
>
>
> - Make json the default output format
>
> - Remove coloured output
>
> - Remove unpopular, least user output formats? xml, default (line-separate
> key=value), table?
>
> - Remove `set` options: color, expires, (custom) prompt
>
> - Remove `paramcompletion` option, this will be true/enabled by default
>
> - Remove signature version and expires (I'm not sure why this is needed or
> used)
>
> - Remove history_file, cache_file, log_file options, use the default paths
> in folder at (user's  home directory)/.cloudmonkey.
>
> - Remove shell based execution from interactive interpreter mode (using !
> or shell keywords)
>
> - Remove support for CloudStack older than 4.5, i.e. it won't be tested
> against older cloudstacks.
>
> - Remove a default API cache with the client, for a fresh env without any
> ~/.cloudmonkey/cache; users can run `sync` command against a management
> server.
>
> - Interactive API parameter completion in CLI mode: the current API
> parameter completion requires the user to manually copy/paste the uuids, or
> autocomplete by typing parts of the uuids/option.
>
> - Improve how maps are passed.
>
> - Good to have: bash/zsh completion.
>
>
> Please share your thoughts, and objections (especially if you're using the
> proposed features to be removed in version 6.x).
>
>
> [1] https://twitter.com/rhtyd/status/983448788059770882
>
> [2] https://github.com/rhtyd/cmk
>
>
> - Rohit
>
> 
>
>
>
> rohit.ya...@shapeblue.com
> www.shapeblue.com
> 53 Chandos Place, Covent Garden, London  WC2N 4HSUK
> @shapeblue
>

Re: 4.11.0.0 problem adding new shared network NIC to VM "A NIC with this MAC address exits for network:"

[ilya musayev]

Stephan

Please kindly open a jira issue as a blocker for 4.11

Thank you


On Tue, Apr 3, 2018 at 2:12 AM Stephan Seitz 
wrote:

> Hi there!
>
> After upgrading a working 4.9.2 setup to 4.11.0.0 we've noticed that we're
> unable to add a NIC (shared network) to a running VM via GUI.
> The Error is "A NIC with this MAC address exits for network: (uuid of the
> current (other NIC) network)"
> Using cloudmonkey and giving a self-computed MAC-address does not rise the
> error and works as expected.
>
> After digging into the code, I think I've found the problem, but am too
> bad in java to provide a sustainable fix.
>
> I've attached a patch which obviously (with own manual tests) fixes that
> issue by simply commenting out the respective codeblock.
>
> As far as I dug into the code, the third parameter of NicProfile is
> handled by
>
> NetUtils.long2Mac(NetUtils.createSequenceBasedMacAddress(ipVO.getMacAddress(),
> NetworkModel.MACIdentifier.value())
>
> inside
>
> NicProfileHelperImpl.java
>
> I assume createSequenceBasedMacAddress can handle null as MAC, but doesn't
> get called at all if
>
>
> _nicDao.findByNetworkIdAndMacAddress(networkId, macAddress) results !=
> null if macAddress is null.
>
>
>
> Sorry, if I'm wrong, didn't had decent IDE at hand :)
>
>
>
> Cheers,
>
> Stephan Seitz
>
> --
>
> Heinlein Support GmbH
> Schwedter Str. 8/9b, 10119 Berlin
>
> http://www.heinlein-support.de
>
> Tel: 030 / 405051-44
> Fax: 030 / 405051-19
>
> Zwangsangaben lt. §35a GmbHG: HRB 93818 B / Amtsgericht
> Berlin-Charlottenburg,
> Geschäftsführer: Peer Heinlein -- Sitz: Berlin
>
>
>

Re: CS 4.11 : Erreor : status Index: 0, Size: 0 When Migrate instance !

[ilya musayev]

I was going to mention same thing.

Try MariaDB 5.5 - which is equivalent to MySQL 5.6

I know we did work to support MySQL 5.7 - but I personally haven’t tested
it and have no experience. I’m not certain what MariaDB equivalent would be.

Also check the output of Catalina.out for SQL related errors.

On Wed, Mar 28, 2018 at 12:10 PM Dag Sonstebo 
wrote:

> Hi Olivier,
>
>
>
> I’ve just spun the same environment as you have up in the lab, using
> CentOS7 management, XS6.5SP1 hypervisors, advanced zone and installing from
> http://cloudstack.apt-get.eu/centos/7/4.11/ , and I can’t reproduce the
> issues you are seeing.
>
> The only difference in my environment is the MariaDB version – and I
> suspect this may be your problem.
>
>
>
> [root@ref-trl-418-x-cs411-dsonstebo-mgmt1 ~]# cat
> /etc/yum.repos.d/cloudstack.repo | grep http
>
> baseurl=http://cloudstack.apt-get.eu/centos/7/4.11/
>
>
>
> [root@ref-trl-418-x-cs411-dsonstebo-mgmt1 ~]# cat /etc/redhat-release
>
> CentOS Linux release 7.4.1708 (Core)
>
>
>
> [root@ref-trl-418-x-cs411-dsonstebo-mgmt1 ~]# mysql --version
>
> *mysql  Ver 15.1 Distrib 5.5.56-MariaDB, for Linux (x86_64) using readline
> 5.1   My lab version*
>
> *mysql  Ver 15.1 Distrib 10.0.34-MariaDB, for Linux (x86_64) using
> readline 5.1 << Your version *
>
>
>
> > SELECT * FROM cloud.version
>
>
>
> + --- +  +  + - +
>
> | id  | version  | updated  | step  |
>
> + --- +  +  + - +
>
> | 1   | 4.0.0| 2018-03-28 18:44:26 | Complete  |
>
> | 2   | 4.1.0| 2018-03-28 18:44:49 | Complete  |
>
> …..
>
> | 21  | 4.9.3.0  | 2018-03-28 18:45:02 | Complete  |
>
> | 22  | 4.10.0.0 | 2018-03-28 18:45:03 | Complete  |
>
> | 23  | 4.11.0.0 | 2018-03-28 18:45:03 | Complete  |
>
>
>
> > SELECT * FROM cloud.host_view
>
>
>
>  1. row *
>
>   id: 1
>
> uuid: df4cbefc-3dc1-4f41-ac7e-723920808114
>
> name: ref-trl-418-x-cs411-dsonstebo-xs1
>
>   status: Up
>
> disconnected:
>
> type: Routing
>
>   private_ip_address: removed
>
>  version: 4.11.0.0
>
>  hypervisor_type: XenServer
>
>   hypervisor_version: 6.5.0
>
> capabilities: xen-3.0-x86_64 , xen-3.0-x86_32p ,
> hvm-3.0-x86_32 , hvm-3.0-x86_32p , hvm-3.0-x86_64
>
>last_ping: 1486584835
>
>  created: 2018-03-28 18:52:06
>
>  removed:
>
>   resource_state: Enabled
>
>   mgmt_server_id: 7393350059856
>
>  cpu_sockets: 3
>
> cpus: 3
>
>speed: 1994
>
>  ram: 7427139712
>
>   cluster_id: 1
>
> cluster_uuid: 30cb6537-8d6e-4a42-965c-b50c30262a55
>
> cluster_name: p1-c1
>
> cluster_type: CloudManaged
>
>   data_center_id: 1
>
> data_center_uuid: 407346a2-4ee3-4fa2-b17f-37f1fa1150df
>
> data_center_name: ref-trl-418-x-cs411-dsonstebo
>
> data_center_type: Advanced
>
>   pod_id: 1
>
> pod_uuid: 68481e39-9427-486f-a983-71b36737fae4
>
> pod_name: Pod1
>
>  tag: GPU
>
> guest_os_category_id:
>
>   guest_os_category_uuid:
>
>   guest_os_category_name:
>
> memory_used_capacity: 536870912
>
> memory_reserved_capacity: 0
>
>cpu_used_capacity: 500
>
>cpu_reserved_capacity: 0
>
>   job_id:
>
> job_uuid:
>
>   job_status:
>
>   job_account_id:
>
> oobm_enabled:
>
> oobm_power_state:
>
>   ha_enabled:
>
> ha_state:
>
>  ha_provider:
>
>   annotation:
>
>   last_annotated:
>
> username:
>
>  2. row *
>
>
>
>
>
> Regards,
>
> Dag Sonstebo
>
> Cloud Architect
>
> ShapeBlue
>
>
>
> dag.sonst...@shapeblue.com
> www.shapeblue.com
> @shapeblue
>
>
>
>
> *From: *Olivier GUIN 
>
>
> *Reply-To: *"users@cloudstack.apache.org" , "
> olivier.g...@ariasnet.com" 
>
> *Date: *Wednesday, 28 March 2018 at 15:35
>
>
> *To: *"users@cloudstack.apache.org" 
> *Subject: *Re: CS 4.11 : Erreor : status Index: 0, Size: 0 When Migrate
> instance !
>
>
>
> Hi,
>
> It's new install, CS 4.11 on CentOS7, I've mariadb cluster
>
> I use my script https://cloudbox.wayscom.com/index.php/s/FHCwWt35fGZk0gD
>
> [root@crtl-1 opt]# mysql --version
> mysql  Ver 15.1 Distrib 10.0.34-MariaDB, for Linux (x86_64) using readline
> 5.1
> [root@crtl-1 opt]# cat /etc/redhat-release
> CentOS Linux release 7.4.1708 (Core)
>
> My cloudstack.repo :
> [cloudstack]
> name=cloudstack
> baseurl=http://cloudstack.apt-get.eu/centos/$releasever/4.11/
> enabled=1
> gpgcheck=0
>
> For the query, returns nothing  ! also with clouds

Re: Welcoming Mike as the new Apache CloudStack VP

[ilya musayev]

Welcome Mike, thank you Wido!

On Mon, Mar 26, 2018 at 8:59 AM Simon Weller 
wrote:

> Thanks for all of your hard work Wido, we really appreciate it.
>
>
> Congratulations Mike!
>
>
> - Si
>
> 
> From: Wido den Hollander 
> Sent: Monday, March 26, 2018 9:11 AM
> To: d...@cloudstack.apache.org; users@cloudstack.apache.org
> Subject: Welcoming Mike as the new Apache CloudStack VP
>
> Hi all,
>
> It's been a great pleasure working with the CloudStack project as the
> ACS VP over the past year.
>
> A big thank you from my side for everybody involved with the project in
> the last year.
>
> Hereby I would like to announce that Mike Tutkowski has been elected to
> replace me as the Apache Cloudstack VP in our annual VP rotation.
>
> Mike has a long history with the project and I am are happy welcome him
> as the new VP for CloudStack.
>
> Welcome Mike!
>
> Thanks,
>
> Wido
>

Re: KVM HostHA

[ilya musayev]

KVM HostHA was developed to bring it to a closer parity with how VMware
vSphere handles its HA.

Basically in old model - there were several corner cases where CloudStack
did not know whether
Hypervisor crashed or just lost connectivity to Management server.

We’ve added a logic to make sure that hypervisor is truly dead - only then
we can choose to use IPMI, power off or reboot hypervisor and bring up
guest VMs elsewhere.

There is a lot more that goes on behind the scenes - Rohit did a talk about
it and it should be available on YouTube.

On Wed, Mar 14, 2018 at 7:36 AM Parth Patel 
wrote:

> Hi Paul and Adrina,
>
> I don't know the functioning of Host-HA features but what Paul explained,
> my ACS 4.11 does the same without even host HA or ipmi access. As I stated
> earlier multiple times, without host HA and ipmi, my ha-enabled VMs
> executing on a normal host get restarted on another suitable host in
> cluster after approximately 3 minutes of event ping timeout. After which
> the cloudstack agent with no connection to management server because of
> unplugged NIC (all my machines currently have only one NIC / whole zone is
> in a flat network) reboots itself (the reason was explained by Rohit in an
> another thread). The management server marks the host down and only
> Ha-enabled VMs executing on it get restarted on another host (without any
> mention of host HA or ipmi or fencing in management server logs) while
> normal VMs executing on it are stopped.
>
> I don't know if this was a desired outcome, but I think my current ACS 4.11
> installation has features (at least performs some ;) provided by Host HA
> without configuring it or ipmi.
>
> Regards,
> Parth Patel
>
> On Wed 14 Mar, 2018, 18:41 Boris Stoyanov, 
> wrote:
>
> > yes, KVM + NFS shared storage.
> >
> > Boris.
> >
> >
> > boris.stoya...@shapeblue.com
> > www.shapeblue.com
> > 53 Chandos Place, Covent Garden, London  WC2N 4HSUK
> > @shapeblue
> >
> >
> >
> > > On 14 Mar 2018, at 14:51, Andrija Panic 
> wrote:
> > >
> > > Hi Boris,
> > >
> > > ok thanks for the explanation - that makes sense, and covers my
> > "exception
> > > case" that I have.
> > >
> > > This is atm only available for NFS as I could read (KVM on NFS) ?
> > >
> > > Cheers
> > >
> > > On 14 March 2018 at 13:02, Boris Stoyanov <
> boris.stoya...@shapeblue.com>
> > > wrote:
> > >
> > >> Hi Andrija,
> > >>
> > >> There’s two types of checks Host-HA is doing to determine if host if
> > >> healthy.
> > >>
> > >> 1. Health checks - pings the host as soon as there’s connection issues
> > >> with the agent
> > >>
> > >> If that fails,
> > >>
> > >> 2. Activity checks - checks if there are any writing operations on the
> > >> Disks of the VMs that are running on the hosts. This is to determine
> if
> > the
> > >> VMs are actually alive and executing processes. Only if no disk
> > operations
> > >> are executed on the shared storage, only then it’s trying to Recover
> the
> > >> host with IPMI call, if that eventually fails, it migrates the VMs to
> a
> > >> healthy host and Fences the faulty one.
> > >>
> > >> Hope that explains your case.
> > >>
> > >> Boris.
> > >>
> > >>
> > >> boris.stoya...@shapeblue.com
> > >> www.shapeblue.com
> > >> 53 Chandos Place, Covent Garden, London  WC2N 4HSUK
> > >> @shapeblue
> > >>
> > >>
> > >>
> > >>> On 14 Mar 2018, at 13:53, Andrija Panic 
> > wrote:
> > >>>
> > >>> Hi Paul,
> > >>>
> > >>> sorry to bump in the middle of the thread, but just curious about the
> > >> idea
> > >>> behing host-HA and why it behaves the way you exlained above:
> > >>>
> > >>>
> > >>> Would it be more sense (or not?), that when MGMT detects agents is
> > >>> unreachable or host unreachable (or after unsuccessful i.e. agent
> > >> restart,
> > >>> etc...,to be defined), to actually use IPMI to STONITH the node, thus
> > >>> making sure no VMS running and then to really start all HA-enabled
> VMs
> > on
> > >>> other hosts ?
> > >>>
> > >>> I'm just trying to make parallel to the corosync/pacemaker as
> > clustering
> > >>> suite/services in Linux (RHEL and others), where when majority of
> nodes
> > >>> detect that one node is down, a common thing (especially for shared
> > >>> storage) is to STONITH that node, make sure it;s down, then move
> > >> "resource"
> > >>> (in our case VMs) to other cluster nodes ?
> > >>>
> > >>> I see it's  actually much broader setup per
> > >>> https://cwiki.apache.org/confluence/display/CLOUDSTACK/Host+HA but
> > >> again -
> > >>> whole idea (in my head at least...) is when host get's down, we make
> > sure
> > >>> it's down (avoid VM corruption, by doint STONITH to that node) and
> then
> > >>> start HA VMs on ohter hosts.
> > >>>
> > >>> I understand there might be exceptions as I have right now (4.8) -
> > >> libvirt
> > >>> get stuck (librbd exception or similar) so agent get's disconnected,
> > but
> > >>> VMs are still running fine... (except DB get messed up, all NICs
> loose
> > >>> isolation_uri, VR's loose MAC addresses and 

Re: Intel meltdown/spectre kvm upgrade results

[ilya musayev]

Thanks Ivan

On Fri, Jan 12, 2018 at 9:00 PM Ivan Kudryavtsev 
wrote:

> Hi, colleagues,
>
> just would like to share that yesterday successfuly upgraded my ubuntu
> 14.04 kvm cloud to custom built linux 4.14.11 keenel with ubuntu 2018/01/08
> intel cpu microcode update. Compute CPUs - Xeon E5-2670, Xeon X5650,
> everything works nice, no claims from customers, no sensitive load change.
> Live migration between new and old kernels goes well, back migration too.
> It seems that kvm, libvirt and qemu patches are not here yet for Ubuntu.
> Waiting for additional updates. Btw, It is CS4.3.
>
> Have a nice migration.
>

Re: Performance considerations related to Intel Meltdown on KVM CPU types

[ilya musayev]

Thanks for sharing

On Mon, Jan 8, 2018 at 7:11 AM Nux!  wrote:

> Hello,
>
> Just stumbled upon this
> https://twitter.com/berrange/status/950209752486817792
>
> "ensure KVM guest CPU model you choose has the "pcid" feature, otherwise
> guests will suffer terrible performance from the Meltdown fixes. This means
> using a named Haswell, Broadwell or Skylake based model or host passthrough"
>
>
> This means whoever is running with the KVM default CPU (like I do) as
> opposed to specific ones or host passthrough needs to change this in order
> to avoid bad performance once the new mitigating kernel is installed.
>
>
> Bad news is older Xeons do not support this, check if "invpcid" flag shows
> up in /proc/cpuinfo (you might see "pcid", that one is not enough).
>
>
>
>
>
> --
> Sent from the Delta quadrant using Borg technology!
>
> Nux!
> www.nux.ro
>

Re: KVM+HA

[ilya musayev]

Apology for fragmented messages, in existing framework cloudstack does not
know for certain if your VMs are dead, or KVM hypervisor crashed, or its
just a network blip, or perhaps you stopped kvm agent (or agent died). It
takes a conservative approach and does not re-start the VMs on other
hypervisors to avoid split brain scenario.

The only time it will restart KVM hypervisor and move VMs over - is when
you loose a primary storage access to one of the hypervisors in the cluster
- using NFS heartbeat method i mentioned earlier.

New framework addresses the limitations above by
1) checking if there is any disk activity on VMs that are in uncertain
state - if no activity for ALL VMs for "x" number of seconds
2) cloudstack will issue IPMI fence command to power down/reboot a host
(via ILO or DRAC or something else similar)
3) the VMs will be restarted elsewhere

Regards
ilya

On Tue, Jul 18, 2017 at 6:10 AM, ilya musayev 
wrote:

> What share primary storage backend do you have for your VMs?
>
> If it is NFS - cloudstack agent writes heartbeat. When issue occurs - the
> neighbor hosts will check if the hypervisor that failed - still writes to
> heartbeat file. There are bunch of corner case where cloudstack HA does not
> kick in - due to uncertainty.
>
> The new framework should address those uncertainties.
>
> KVM HA with IPMI Fencing - Apache Cloudstack - Apache Software ...
> <https://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=1&cad=rja&uact=8&ved=0ahUKEwi59uv58pLVAhXHslQKHSU_B5YQFgg2MAA&url=https%3A%2F%2Fcwiki.apache.org%2Fconfluence%2Fdisplay%2FCLOUDSTACK%2FKVM%2BHA%2Bwith%2BIPMI%2BFencing&usg=AFQjCNG_-JHCYhcZm0lM9M4gKM4vKQ3hew>
> [CLOUDSTACK-8943] KVM HA is broken, let's fix it - ASF JIRA
> <https://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=2&cad=rja&uact=8&ved=0ahUKEwi59uv58pLVAhXHslQKHSU_B5YQFgg9MAE&url=https%3A%2F%2Fissues.apache.org%2Fjira%2Fbrowse%2FCLOUDSTACK-8943&usg=AFQjCNGkOyC0hR4otCJ1LZF4j-2HSayMyQ>
>
> Regards
> ilya
>
> On Tue, Jul 18, 2017 at 6:06 AM, ilya musayev <
> ilya.mailing.li...@gmail.com> wrote:
>
>> Hi Victor
>>
>> We recently rewrote KVM HA framework. Its being merged into latest build.
>>
>>
>> On Tue, Jul 18, 2017 at 5:39 AM, victor  wrote:
>>
>>> Hello Guys,
>>>
>>> I am facing the same issue that mentioned in the following url .
>>>
>>> -
>>>
>>> https://issues.apache.org/jira/browse/CLOUDSTACK-3535
>>>
>>> -
>>>
>>> When the host is put in maintenance mode , then ha enabled VM's are
>>> automatically migrated to available host. But when the kvm host is down, no
>>> HA is done. The vm's are still down until I put the host node back up.
>>>
>>>
>>> I have tried everything like the following.
>>>
>>> =
>>>
>>> 1, system VM's  and client vm's are created in shared storage
>>>
>>> 3, Added ha.tag host tags
>>>
>>> 2, Created host by adding ha tag
>>>
>>> 3, Created VE's  in Ha enabled host with ha enabled service offering
>>>
>>> 
>>>
>>> Do you guys have successfully tested Ha. I am really stuck at this part.
>>>
>>> Regards
>>>
>>>
>>>
>>>
>>
>

Re: KVM+HA

[ilya musayev]

What share primary storage backend do you have for your VMs?

If it is NFS - cloudstack agent writes heartbeat. When issue occurs - the
neighbor hosts will check if the hypervisor that failed - still writes to
heartbeat file. There are bunch of corner case where cloudstack HA does not
kick in - due to uncertainty.

The new framework should address those uncertainties.

KVM HA with IPMI Fencing - Apache Cloudstack - Apache Software ...
<https://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=1&cad=rja&uact=8&ved=0ahUKEwi59uv58pLVAhXHslQKHSU_B5YQFgg2MAA&url=https%3A%2F%2Fcwiki.apache.org%2Fconfluence%2Fdisplay%2FCLOUDSTACK%2FKVM%2BHA%2Bwith%2BIPMI%2BFencing&usg=AFQjCNG_-JHCYhcZm0lM9M4gKM4vKQ3hew>
[CLOUDSTACK-8943] KVM HA is broken, let's fix it - ASF JIRA
<https://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=2&cad=rja&uact=8&ved=0ahUKEwi59uv58pLVAhXHslQKHSU_B5YQFgg9MAE&url=https%3A%2F%2Fissues.apache.org%2Fjira%2Fbrowse%2FCLOUDSTACK-8943&usg=AFQjCNGkOyC0hR4otCJ1LZF4j-2HSayMyQ>

Regards
ilya

On Tue, Jul 18, 2017 at 6:06 AM, ilya musayev 
wrote:

> Hi Victor
>
> We recently rewrote KVM HA framework. Its being merged into latest build.
>
>
> On Tue, Jul 18, 2017 at 5:39 AM, victor  wrote:
>
>> Hello Guys,
>>
>> I am facing the same issue that mentioned in the following url .
>>
>> -
>>
>> https://issues.apache.org/jira/browse/CLOUDSTACK-3535
>>
>> -
>>
>> When the host is put in maintenance mode , then ha enabled VM's are
>> automatically migrated to available host. But when the kvm host is down, no
>> HA is done. The vm's are still down until I put the host node back up.
>>
>>
>> I have tried everything like the following.
>>
>> =
>>
>> 1, system VM's  and client vm's are created in shared storage
>>
>> 3, Added ha.tag host tags
>>
>> 2, Created host by adding ha tag
>>
>> 3, Created VE's  in Ha enabled host with ha enabled service offering
>>
>> 
>>
>> Do you guys have successfully tested Ha. I am really stuck at this part.
>>
>> Regards
>>
>>
>>
>>
>

Re: KVM+HA

[ilya musayev]

Hi Victor

We recently rewrote KVM HA framework. Its being merged into latest build.


On Tue, Jul 18, 2017 at 5:39 AM, victor  wrote:

> Hello Guys,
>
> I am facing the same issue that mentioned in the following url .
>
> -
>
> https://issues.apache.org/jira/browse/CLOUDSTACK-3535
>
> -
>
> When the host is put in maintenance mode , then ha enabled VM's are
> automatically migrated to available host. But when the kvm host is down, no
> HA is done. The vm's are still down until I put the host node back up.
>
>
> I have tried everything like the following.
>
> =
>
> 1, system VM's  and client vm's are created in shared storage
>
> 3, Added ha.tag host tags
>
> 2, Created host by adding ha tag
>
> 3, Created VE's  in Ha enabled host with ha enabled service offering
>
> 
>
> Do you guys have successfully tested Ha. I am really stuck at this part.
>
> Regards
>
>
>
>

[NOTICE] Meeting with Accelerite Leadership

[ilya musayev]

Dear CloudStackers,

Last week, Johh Kinsella and myself were suppose to meet with Accelerite
leadership team. Unfortunately John could not make it - so i was alone.

We discussed ways we can improve community collaboration and leverage
Accelerite"s resources to align and drive larger community agenda including
extendes roadmap.

Many topics have been mentioned, below is the summary of our discussion. I
will list things in the order i see being important.


---
1) Proposal was made to have a quarterly call (or more often as needed)
with all interested parties to discuss:
Upcoming Features you are working on developing (to avoid collision
and
maintain the roadmap)
Blockers that are impacting release and adoption
Other topics

The length of the call would be 90 minutes. Each party will get a
fair
amount of time. The agenda will be collated and presented prior to the
call with a link to FS on Confluence and time allotted for each topic.

Minutes will be taken and posted on dev list. If there are issues and or
suggestions, we will note it down in few sentences, identify interested
parties and have them do a "post" discussion on the mailing list.

The proposed date and time  - Thursday August 17th 9AM PT

--
2) Accelerite is considering funding a position for a person who will be
working within community - as community manager. Help organize and
facilitate discussions, make sure Confluence and JIRA are up to date,
help new users with answering basic questions or finding right
individual to assist with solution. While funded by Accelerite - it must
be clear that the person is working with/for Apache CloudStack project.

3) Marketing was mentioned, i suggested we do more press releases - and
possibly make use of interns

4) OpenStack VS CloudStack (unbiased technology comparison), there is a
common question - we need to come up something that can help justify
Apache CloudStack to clients leadership

5) Cinder integration with Cloudstack was mentioned - but no solid plans
yet.

6) Creating Appliances of CloudStack - that are ready to be consumed and
user can spin nested VMs to try CloudStack effortlessly

7) CoudStack Template Repository (plugin)- there is a code written for it by
Citrix and resides on ASF git - but for some reason it was dropped or
never completed. If we can give user a rich marketplace of appliances to
consume - we will certainly get a good edge. This can improve the adoption.

8) MeetUps - we need to re-kickstart this initiative within SF Bay Area
and stream it to other locations/meetups.

9) Demo environment of CloudStack.  David mentioned Citrix donated gear
is in one of ASF locations - but sitting idle. I proposed we make use of
it and let new CloudStack explorers try it out - without the hassle of
deploying it.

10) If we can get CloudStack into EPEL fedora and ubuntu upstream
repositories - it will help with adoption as well.

Please let me know if you would be interested in item #1, which is
quarterly meeting. The proposed time is 9am PST, August 17th.

I will help setting up the first few initial calls and be a moderator.

Looking forward to your comments

Regards
ilya

Re: Template and ISO downloaded but stuck at "installing template / installing ISO"

[ilya musayev]

Indra,

While I see there is a solution to your problem due to cloudstack changes
with web servers, there is also another tangent to this issue..

Let me know if your issue is resolved by leveraging a different web server
for image downloads.

But if not, or someone else comes across this message thread, here is a
another tangent to this problem.


Below is a summary to the problem we've seen that seem very similar

In the nutshell, here is what we've seen and what we believe cause the
issue.

CloudStack Java Agent initiates 2 https sessions when attempting to
download.

1) Session is established to web server to get the header information and
keep it open..
2) Session is established to download the content - this is usually a
longer stream operation


What we've seen happen, as session # 2 goes on downloading, somehow http
session #1 gets corrupted. Session #2 is eventually terminated as it
completes the operation, yet session #1 remains to be open.

This defies the logic in a way, because no packets are sent over the open
session between SSVM and HTTP server. I'd expect for one of two parties
sending termination packet - but that never happens. As the result - the
1st session hangs and prevents agent from proceed to the next stage of
installing the template. I've seen the socket being open for days on SSVM
and yet not a single packet comes - not even keep alive.

Patch should be out soon. Credit goes to Marcus for figuring this out.


I also have a shell script that can resolve the specific stuck template
download, but i've made it geared toward QCOW2.  I can post it if need be,
but we should probably release a proper fix..

Regards
ilya





On Wed, May 11, 2016 at 4:37 AM, Indra Pramana  wrote:

> Dear all,
>
> I setup a test environment using CloudStack 4.8.0 (latest from repository),
> one management server and two KVM agent hosts running Ubuntu 14.04 LTS.
> Setup a zone with basic networking because the test environment doesn't
> support VLAN and the test management server only have 1 NIC. The private
> and public network are using the same subnet. Using Ceph RBD as primary
> storage and NFS as secondary storage.
>
> Zone is created successfully, the two hosts are added successfully and
> connected to the management servers. SSVM and CPVM are created without any
> issues. However, the default
> "CentOS 5.5(64-bit) no GUI (KVM)" template is stuck at "Installing
> Template" status and Ready = "No" although it seems to be downloaded
> successfully. I also tried registering an Ubuntu ISO and it faces the same
> problem, it's downloaded successfully but then will stuck at "Installing
> ISO" status.
>
> I ran the SSVM health check and everything is OK. Also go through the
> troubleshooting steps as per below documentation but still unable to
> determine the root cause:
>
>
> https://cwiki.apache.org/confluence/display/CLOUDSTACK/SSVM,+templates,+Secondary+storage+troubleshooting
>
> I tried restarting the SSVM service, stop and start the SSVM and restarting
> the management-server service, it will cause the download of the ISO and
> template to be restarted, but it will then stuck at installing again.
>
> Logs from management server shows below lines which keeps on appearing /
> looping every several seconds:
>
> ===
> 2016-05-11 19:31:29,031 DEBUG [c.c.h.o.r.Ovm3HypervisorGuru]
> (Timer-6:ctx-369bfc57) (logid:0b1754a2) getCommandHostDelegation: class
> org.apache.cloudstack.storage.command.DownloadProgressCommand
> 2016-05-11 19:31:29,031 DEBUG [c.c.h.XenServerGuru] (Timer-6:ctx-369bfc57)
> (logid:0b1754a2) getCommandHostDelegation: class
> org.apache.cloudstack.storage.command.DownloadProgressCommand
> 2016-05-11 19:31:29,031 DEBUG [o.a.c.s.RemoteHostEndPoint]
> (Timer-6:ctx-369bfc57) (logid:0b1754a2) Sending command
> org.apache.cloudstack.storage.command.DownloadProgressCommand to host: 3
> 2016-05-11 19:31:29,034 DEBUG [c.c.a.t.Request] (Timer-6:ctx-369bfc57)
> (logid:0b1754a2) Seq 3-3028107799453237894: Sending  { Cmd , MgmtId:
> 181122461655966, via: 3(s-3-VM), Ver: v1, Flags: 100011,
> [{"org.apache.cloudstack.storage.command
>
> .DownloadProgressCommand":{"jobId":"cab4ada2-e52f-4c25-9c30-9ec23dc3fcd4","request":"GET_STATUS","hvm":false,"description":"CentOS
> 5.5(64-bit) no GUI
>
> (KVM)","checksum":"ed0e788280ff2912ea40f7f91ca7a249","maxDownloadSizeInBytes":536870912
>
> 00,"id":4,"resourceType":"TEMPLATE","installPath":"template/tmpl/1/4","_store":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://x.x.0.242/export/cloudstack","_role":"Image"}},"url":"
> http://download.cloud.com/releases/2.2.0/eec2209b-987
>
> 5-3c8d-92be-c001bd8a0faf.qcow2.bz2","format":"QCOW2","accountId":1,"name":"centos55-x86_64","secUrl":"nfs://x.x.0.242/export/cloudstack","wait":0}}]
> }
> 2016-05-11 19:31:29,081 DEBUG [c.c.a.t.Request]
> (AgentManager-Handler-8:null) (logid:) Seq 3-3028107799453237894:
> Processing:  { Ans: , MgmtId: 181122461655966, via: 3, Ver: v1, Flags: 10,
> [{"com.cloud.agent.api.storage.DownloadAn

Re: Multiple Disks created on Live Migration

[ilya musayev]

That wont work. You should not bypass cloudstack in this manner as it 
keeps track of all configs in its DB.


When you do stop and start VM, it recreated the config file each time. 
If you were to add another disk or make any changes outside of 
cloudstack, they will not be persistent.


This could be a bug, but i'm surprised why no-one else reported this 
behavior yet.


Tell us about your setup.

Regards
ilya

On 3/16/15 12:48 PM, raja sekhar wrote:

Hi Andrija,

I have a small doubt here,why the xenserver is creating two root disks.
by default cloudstack will boot from one disk,i manually made it to boot
from another disk by updating volumes table(since two disks are showing
full size) ,now cloudstack is throwing error invalid uuid supplied.
any idea?
one thing we have to observe here is cloudstack doesn't know about the
second disk.

On Thu, Mar 12, 2015 at 11:25 PM, raja sekhar 
wrote:


ok thanks

On Thu, Mar 12, 2015 at 3:06 AM, Andrija Panic 
wrote:


2 volumes are showed while migration is running - old volume should be
deleted afterwards...
On Mar 11, 2015 9:51 PM, "raja sekhar"  wrote:


Hi All,

Iam using CS 4.3.1
When ever i have live migrated the root volume from one primary to

another

primary, it will creates two root disks after migration and the vm boots
from one of the root disk.
is this bug?


Regards,
Rajasekhar.

Re: Something went wrong, authentication error

[ilya musayev]

Mike,

Check if Root SSH is allowed on KVM host and username/password match.

Review the /var/log/secure on KVM host for ssh attempts.

Regards,
ilya

On 3/16/15 5:34 PM, Mike wrote:

Hello all,

I am more than a bit stumped. I've followed the Quick Installation Guide
in the CS Installation Documentation, release 4.4.1 , using CentOS 6.6
and CS 4.4. I am unable add add the first (or any) host.

I have a simple, flat network with one private address subnet. The
attempt to add a host fails with a message from the Web GUI, "Something
went wrong; please correct the following: Authentication error". All
steps leading up to this error (Create Zone, Pod, Cluster) complete
successfully.

A review of /var/log/cloudstack/management/management-server.log
returns:

2015-03-16 18:16:02,064 DEBUG [c.c.a.ApiServlet] (catalina-exec-12:ctx-
f410fff4) ===START===  192.168.255.61 -- POST
command=addHost&response=json&sessionkey=bTd1eGd%2FIM6XUup0oWNQoexUQm8%3
D
2015-03-16 18:16:02,074 WARN  [c.c.a.d.ParamGenericValidationWorker]
(catalina-exec-12:ctx-f410fff4 ctx-0760ac45) Received unknown parameters
for command addHost. Unknown parameters : clustertype
2015-03-16 18:16:02,079 INFO  [c.c.r.ResourceManagerImpl] (catalina-
exec-12:ctx-f410fff4 ctx-0760ac45) Trying to add a new host at
http://192.168.255.23 in data center 1
2015-03-16 18:16:04,171 DEBUG [c.c.h.k.d.LibvirtServerDiscoverer]
(catalina-exec-12:ctx-f410fff4 ctx-0760ac45) Failed to authenticate
2015-03-16 18:16:04,173 WARN  [o.a.c.a.c.a.h.AddHostCmd] (catalina-exec-
12:ctx-f410fff4 ctx-0760ac45) Exception:
com.cloud.exception.DiscoveredWithErrorException: Authentication error
 at
com.cloud.hypervisor.kvm.discoverer.LibvirtServerDiscoverer.find(Libvirt
ServerDiscoverer.java:158)
 at
com.cloud.resource.ResourceManagerImpl.discoverHostsFull(ResourceManager
Impl.java:735)
 at
com.cloud.resource.ResourceManagerImpl.discoverHosts(ResourceManagerImpl
.java:586)
 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
 at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.jav
a:57)
 at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessor
Impl.java:43)
 at java.lang.reflect.Method.invoke(Method.java:606)
 at
org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(
AopUtils.java:317)
 at
org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinp
oint(ReflectiveMethodInvocation.java:183)
 at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(Ref
lectiveMethodInvocation.java:150)
 at
org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(E
xposeInvocationInterceptor.java:91)
 at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(Ref
lectiveMethodInvocation.java:172)
 at
org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAo
pProxy.java:204)
 at com.sun.proxy.$Proxy148.discoverHosts(Unknown Source)
 at
org.apache.cloudstack.api.command.admin.host.AddHostCmd.execute(AddHostC
md.java:142)
 at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:141)
 at com.cloud.api.ApiServer.queueCommand(ApiServer.java:682)
 at com.cloud.api.ApiServer.handleRequest(ApiServer.java:511)
 at
com.cloud.api.ApiServlet.processRequestInContext(ApiServlet.java:330)
 at com.cloud.api.ApiServlet.access$000(ApiServlet.java:54)
 at com.cloud.api.ApiServlet$1.run(ApiServlet.java:118)
 at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(
DefaultManagedContext.java:56)
 at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWit
hContext(DefaultManagedContext.java:103)
 at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWith
Context(DefaultManagedContext.java:53)
 at com.cloud.api.ApiServlet.processRequest(ApiServlet.java:115)
 at com.cloud.api.ApiServlet.doPost(ApiServlet.java:82)
 at javax.servlet.http.HttpServlet.service(HttpServlet.java:637)
 at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
 at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Applica
tionFilterChain.java:290)
 at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilt
erChain.java:206)
 at
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValv
e.java:233)
 at
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValv
e.java:191)
 at
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java
:127)
 at
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java
:102)
 at
org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:555
)
 at
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.
java:109)
 at
org.apach

Re: Sending Notifications Back to the User via UI

[ilya musayev]

Kyle

This is better suited for Dev Mailing List if you get no response

Regards
ilya

On 3/5/15 8:49 AM, Kyle Flavin wrote:

I'm using the event notification framework to handle post tasks for VM creation and 
deletion.  Following a VM create, I do a post task, which in the case where this post 
task fails, I go back and remove the VM that was just created, using the API.  I'd like 
to be able to notify the user through the web UI that this has happened.  Is there a way 
to pass messages back into cloudstack for the user?  It looks like I can create an alert 
using the API, but I'd like something that gives more obvious notice to the user that 
their build failed, ie: a notification that appears in their browser window under 
"Notifications" or a pop up window for some sort.

Thanks.

Re: Unable to add new hosts to existing cluster

[ilya musayev]

I'm running CS 4.3 with vSphere 5.5 (very sizable infrastructure). I 
dont see these issues in 4.3


4.5 will come out hopefully this week, you can consider upgrading to see 
if that issue will be addressed.


In the meantime, please note the time and try the addition again, then 
post a complete log on pastebin/google drive, usually there are multiple 
pointers any issue, perhaps what you posted was not complete.


regards
ilya
On 3/4/15 9:29 AM, Franky Hall wrote:

Oh, I tried that originally. They are in a DRS cluster so vmware starts 
migrating machines to them if they’re not in maintenance mode. That’s not a 
good thing since they aren’t in cloudstack yet. I got the same error when they 
were not in maintenance mode though…

Thanks!
Franky


On Mar 4, 2015, at 9:27 AM, ilya musayev  wrote:


Franky,

MM - Maintenance Mode.

Take the hosts out of Maintenance mode and try again.

Regards,
ilya
On 3/4/15 8:59 AM, Franky Hall wrote:

Hi Ilya,

Thanks for your reply.

I’m not sure what MM stands for, sorry. Please elaborate.

As for the URL, I’m not putting it in. I just type in a hostname for the new 
server under add host “hq-core-vmware07.blurb.com” - the URL is generated in CS 
and shows in the management log.

I did not remove anything from the log snippet except part of the back trace. I 
work for blurb :) The only other sensitive info is the first letter of my root 
password, which isn’t a big deal since that password doesn’t exist anywhere 
except on this cloud, and the cloud is not accessible from the Internet. Thank 
you for your concern.

Regards,
Franky Hall

On Mar 3, 2015, at 7:52 PM, ilya musayev  wrote:


Frank,

Take them out of MM and try again.

The URL should be using HTTPS and not HTTP from what i see. Have you sanitized 
the for private info or this is what you get?

Regards
ilya



On 3/3/15 3:55 PM, Franky Hall wrote:

Hello,

I have a 4-node cluster using VMware 5.5 and CS 4.4.1. It works great, but I need 
to expand it. I have two more identical servers already added to the HA-cluster in 
vCenter (in maintenance mode). I’m trying to add them into CS via the “Add Host” 
button in Infrastructure->Hosts. I immediately get an error with some 
correlating log entries. The host has four networks configured; three of them for 
iSCSI and one for Management. Other than the networking I added the iSCSI data 
stores. I’m not sure what I’m missing or what setting I need to tweak to make 
these hosts add-able. Any help is greatly appreciated.

Warm regards,
Franky Hall

Here’s the relevant log snippet:
2015-03-03 15:48:31,978 DEBUG [c.c.a.ApiServlet] (catalina-exec-15:ctx-c2c30a12) 
===START===  192.168.5.115 -- POST  
command=addHost&response=json&sessionkey=2Pq%2BiiJSbkYbYnCSJUHRhkyO%2B%2FU%3D
2015-03-03 15:48:31,983 WARN  [c.c.a.d.ParamGenericValidationWorker] 
(catalina-exec-15:ctx-c2c30a12 ctx-55597ee3) Received unknown parameters for 
command addHost. Unknown parameters : clustertype
2015-03-03 15:48:31,985 INFO  [c.c.r.ResourceManagerImpl] 
(catalina-exec-15:ctx-c2c30a12 ctx-55597ee3) Trying to add a new host at 
http://hq-core-vcenter02.blurb.com/HQ/Cluster1/hq-core-vmware07.blurb.com in 
data center 1
2015-03-03 15:48:31,985 INFO  [c.c.h.v.VmwareServerDiscoverer] 
(catalina-exec-15:ctx-c2c30a12 ctx-55597ee3) Discover host. dc: 1, pod: 1, 
cluster: 1, uri host: hq-core-vcenter02.blurb.com
2015-03-03 15:48:32,006 INFO  [c.c.h.v.VmwareServerDiscoverer] 
(catalina-exec-15:ctx-c2c30a12 ctx-55597ee3) Detected private network label : 
vSwitch0,140
2015-03-03 15:48:32,006 DEBUG [c.c.h.v.r.VmwareContextFactory] 
(catalina-exec-15:ctx-c2c30a12 ctx-55597ee3) initialize VmwareContext. url: 
https://hq-core-vcenter02.blurb.com/sdk/vimService, username: root, password: 
w
2015-03-03 15:48:32,094 INFO  [c.c.h.v.u.VmwareContext] 
(catalina-exec-15:ctx-c2c30a12 ctx-55597ee3) New VmwareContext object, current 
outstanding count: 6
2015-03-03 15:48:32,107 ERROR [c.c.h.v.u.VmwareContext] 
(catalina-exec-15:ctx-c2c30a12 ctx-55597ee3) Path element points to an 
un-existing inventory entity
2015-03-03 15:48:32,107 ERROR [c.c.h.v.m.VmwareManagerImpl] 
(catalina-exec-15:ctx-c2c30a12 ctx-55597ee3) Unable to find host from inventory 
path: /HQ/Cluster1/hq-core-vmware07.blurb.com
2015-03-03 15:48:32,107 INFO  [c.c.h.v.VmwareServerDiscoverer] 
(catalina-exec-15:ctx-c2c30a12 ctx-55597ee3) Found 0 hosts.
2015-03-03 15:48:32,107 ERROR [c.c.h.v.VmwareServerDiscoverer] 
(catalina-exec-15:ctx-c2c30a12 ctx-55597ee3) Unable to find host or cluster 
based on url: /HQ/Cluster1/hq-core-vmware07.blurb.com
2015-03-03 15:48:32,107 INFO  [c.c.h.v.u.VmwareContext] 
(catalina-exec-15:ctx-c2c30a12 ctx-55597ee3) Disconnecting VMware session
2015-03-03 15:48:32,110 WARN  [c.c.r.ResourceManagerImpl] 
(catalina-exec-15:ctx-c2c30a12 ctx-55597ee3) Unable to find the server 
resources at 
http://hq-core-vcenter02.blurb.com/HQ/Cluster1/hq-core-vmware07.blurb.com
2015-03-03 15:48:32,111 INFO  [c.c.u.e.CSEx

Re: unused standard vswitches

[ilya musayev]

Michael,

Cloudstack manages portgroups and creates them if needed. So if you were 
to delete it - it will be re-created.


It does not delete though, which is kinda messy - but on the other side 
its also a much safer approach.


Regards
ilya

On 3/4/15 4:17 PM, Michael Phillips wrote:

So I am using cloudstack with esxi as the hypervisor. I am also using advanced network 
using vlans for network isolation. As such cloudstack has vmware create a new port group 
for each network.  If I wanted to clean up the "unused" port groups can I 
simply delete them from vmware, or would I need to do something extra in cloudstack as 
well? Or is it even necessary to delete them or will cloudstack reuse the unused port 
groups if necessary? Hopefully this makes sense.

Re: Unable to add new hosts to existing cluster

[ilya musayev]

Franky,

MM - Maintenance Mode.

Take the hosts out of Maintenance mode and try again.

Regards,
ilya
On 3/4/15 8:59 AM, Franky Hall wrote:

Hi Ilya,

Thanks for your reply.

I’m not sure what MM stands for, sorry. Please elaborate.

As for the URL, I’m not putting it in. I just type in a hostname for the new 
server under add host “hq-core-vmware07.blurb.com” - the URL is generated in CS 
and shows in the management log.

I did not remove anything from the log snippet except part of the back trace. I 
work for blurb :) The only other sensitive info is the first letter of my root 
password, which isn’t a big deal since that password doesn’t exist anywhere 
except on this cloud, and the cloud is not accessible from the Internet. Thank 
you for your concern.

Regards,
Franky Hall

On Mar 3, 2015, at 7:52 PM, ilya musayev  wrote:


Frank,

Take them out of MM and try again.

The URL should be using HTTPS and not HTTP from what i see. Have you sanitized 
the for private info or this is what you get?

Regards
ilya



On 3/3/15 3:55 PM, Franky Hall wrote:

Hello,

I have a 4-node cluster using VMware 5.5 and CS 4.4.1. It works great, but I need 
to expand it. I have two more identical servers already added to the HA-cluster in 
vCenter (in maintenance mode). I’m trying to add them into CS via the “Add Host” 
button in Infrastructure->Hosts. I immediately get an error with some 
correlating log entries. The host has four networks configured; three of them for 
iSCSI and one for Management. Other than the networking I added the iSCSI data 
stores. I’m not sure what I’m missing or what setting I need to tweak to make 
these hosts add-able. Any help is greatly appreciated.

Warm regards,
Franky Hall

Here’s the relevant log snippet:
2015-03-03 15:48:31,978 DEBUG [c.c.a.ApiServlet] (catalina-exec-15:ctx-c2c30a12) 
===START===  192.168.5.115 -- POST  
command=addHost&response=json&sessionkey=2Pq%2BiiJSbkYbYnCSJUHRhkyO%2B%2FU%3D
2015-03-03 15:48:31,983 WARN  [c.c.a.d.ParamGenericValidationWorker] 
(catalina-exec-15:ctx-c2c30a12 ctx-55597ee3) Received unknown parameters for 
command addHost. Unknown parameters : clustertype
2015-03-03 15:48:31,985 INFO  [c.c.r.ResourceManagerImpl] 
(catalina-exec-15:ctx-c2c30a12 ctx-55597ee3) Trying to add a new host at 
http://hq-core-vcenter02.blurb.com/HQ/Cluster1/hq-core-vmware07.blurb.com in 
data center 1
2015-03-03 15:48:31,985 INFO  [c.c.h.v.VmwareServerDiscoverer] 
(catalina-exec-15:ctx-c2c30a12 ctx-55597ee3) Discover host. dc: 1, pod: 1, 
cluster: 1, uri host: hq-core-vcenter02.blurb.com
2015-03-03 15:48:32,006 INFO  [c.c.h.v.VmwareServerDiscoverer] 
(catalina-exec-15:ctx-c2c30a12 ctx-55597ee3) Detected private network label : 
vSwitch0,140
2015-03-03 15:48:32,006 DEBUG [c.c.h.v.r.VmwareContextFactory] 
(catalina-exec-15:ctx-c2c30a12 ctx-55597ee3) initialize VmwareContext. url: 
https://hq-core-vcenter02.blurb.com/sdk/vimService, username: root, password: 
w
2015-03-03 15:48:32,094 INFO  [c.c.h.v.u.VmwareContext] 
(catalina-exec-15:ctx-c2c30a12 ctx-55597ee3) New VmwareContext object, current 
outstanding count: 6
2015-03-03 15:48:32,107 ERROR [c.c.h.v.u.VmwareContext] 
(catalina-exec-15:ctx-c2c30a12 ctx-55597ee3) Path element points to an 
un-existing inventory entity
2015-03-03 15:48:32,107 ERROR [c.c.h.v.m.VmwareManagerImpl] 
(catalina-exec-15:ctx-c2c30a12 ctx-55597ee3) Unable to find host from inventory 
path: /HQ/Cluster1/hq-core-vmware07.blurb.com
2015-03-03 15:48:32,107 INFO  [c.c.h.v.VmwareServerDiscoverer] 
(catalina-exec-15:ctx-c2c30a12 ctx-55597ee3) Found 0 hosts.
2015-03-03 15:48:32,107 ERROR [c.c.h.v.VmwareServerDiscoverer] 
(catalina-exec-15:ctx-c2c30a12 ctx-55597ee3) Unable to find host or cluster 
based on url: /HQ/Cluster1/hq-core-vmware07.blurb.com
2015-03-03 15:48:32,107 INFO  [c.c.h.v.u.VmwareContext] 
(catalina-exec-15:ctx-c2c30a12 ctx-55597ee3) Disconnecting VMware session
2015-03-03 15:48:32,110 WARN  [c.c.r.ResourceManagerImpl] 
(catalina-exec-15:ctx-c2c30a12 ctx-55597ee3) Unable to find the server 
resources at 
http://hq-core-vcenter02.blurb.com/HQ/Cluster1/hq-core-vmware07.blurb.com
2015-03-03 15:48:32,111 INFO  [c.c.u.e.CSExceptionErrorCode] 
(catalina-exec-15:ctx-c2c30a12 ctx-55597ee3) Could not find exception: 
com.cloud.exception.DiscoveryException in error code list for exceptions
2015-03-03 15:48:32,111 WARN  [o.a.c.a.c.a.h.AddHostCmd] 
(catalina-exec-15:ctx-c2c30a12 ctx-55597ee3) Exception:
com.cloud.exception.DiscoveryException: Unable to add the host
 at 
com.cloud.resource.ResourceManagerImpl.discoverHostsFull(ResourceManagerImpl.java:791)
 at 
com.cloud.resource.ResourceManagerImpl.discoverHosts(ResourceManagerImpl.java:586)
 
 at java.lang.Thread.run(Thread.java:744)
2015-03-03 15:48:32,112 INFO  [c.c.a.ApiServer] (catalina-exec-15:ctx-c2c30a12 
ctx-55597ee3) Unable to add the host
2015-03-03 15:48:32,112 DEBUG [c.c.a.ApiServlet] (catalina-exec-15:ctx-c2c30a12 
ctx-55597

Re: CS 4.3.2 not reconnecting after losing connection to the database.

[ilya musayev]

I think it fences itself for safety reasons.

Please make your db more reliable or write a monit script that will 
restart when connection becomes available again.


Regards
ilya


On 3/3/15 12:56 PM, Dave Hoffman wrote:

Hello,

We have an environment that we are currently stress testing fault tolerance
and we ran into an issue that I can't seem to find much on.

If Cloudstack loses connection to the database server, it gives up
reconnecting pretty quickly.  We rebooted the database server to see if
Cloudstack would reconnect when it came back up and it fails to reconnect.

Is there something we can adjust so Cloudstack will reconnect without
having to restart cloudstack-management?

Re: Unable to add new hosts to existing cluster

[ilya musayev]

Frank,

Take them out of MM and try again.

The URL should be using HTTPS and not HTTP from what i see. Have you 
sanitized the for private info or this is what you get?


Regards
ilya



On 3/3/15 3:55 PM, Franky Hall wrote:

Hello,

I have a 4-node cluster using VMware 5.5 and CS 4.4.1. It works great, but I need 
to expand it. I have two more identical servers already added to the HA-cluster in 
vCenter (in maintenance mode). I’m trying to add them into CS via the “Add Host” 
button in Infrastructure->Hosts. I immediately get an error with some 
correlating log entries. The host has four networks configured; three of them for 
iSCSI and one for Management. Other than the networking I added the iSCSI data 
stores. I’m not sure what I’m missing or what setting I need to tweak to make 
these hosts add-able. Any help is greatly appreciated.

Warm regards,
Franky Hall

Here’s the relevant log snippet:
2015-03-03 15:48:31,978 DEBUG [c.c.a.ApiServlet] (catalina-exec-15:ctx-c2c30a12) 
===START===  192.168.5.115 -- POST  
command=addHost&response=json&sessionkey=2Pq%2BiiJSbkYbYnCSJUHRhkyO%2B%2FU%3D
2015-03-03 15:48:31,983 WARN  [c.c.a.d.ParamGenericValidationWorker] 
(catalina-exec-15:ctx-c2c30a12 ctx-55597ee3) Received unknown parameters for 
command addHost. Unknown parameters : clustertype
2015-03-03 15:48:31,985 INFO  [c.c.r.ResourceManagerImpl] 
(catalina-exec-15:ctx-c2c30a12 ctx-55597ee3) Trying to add a new host at 
http://hq-core-vcenter02.blurb.com/HQ/Cluster1/hq-core-vmware07.blurb.com in 
data center 1
2015-03-03 15:48:31,985 INFO  [c.c.h.v.VmwareServerDiscoverer] 
(catalina-exec-15:ctx-c2c30a12 ctx-55597ee3) Discover host. dc: 1, pod: 1, 
cluster: 1, uri host: hq-core-vcenter02.blurb.com
2015-03-03 15:48:32,006 INFO  [c.c.h.v.VmwareServerDiscoverer] 
(catalina-exec-15:ctx-c2c30a12 ctx-55597ee3) Detected private network label : 
vSwitch0,140
2015-03-03 15:48:32,006 DEBUG [c.c.h.v.r.VmwareContextFactory] 
(catalina-exec-15:ctx-c2c30a12 ctx-55597ee3) initialize VmwareContext. url: 
https://hq-core-vcenter02.blurb.com/sdk/vimService, username: root, password: 
w
2015-03-03 15:48:32,094 INFO  [c.c.h.v.u.VmwareContext] 
(catalina-exec-15:ctx-c2c30a12 ctx-55597ee3) New VmwareContext object, current 
outstanding count: 6
2015-03-03 15:48:32,107 ERROR [c.c.h.v.u.VmwareContext] 
(catalina-exec-15:ctx-c2c30a12 ctx-55597ee3) Path element points to an 
un-existing inventory entity
2015-03-03 15:48:32,107 ERROR [c.c.h.v.m.VmwareManagerImpl] 
(catalina-exec-15:ctx-c2c30a12 ctx-55597ee3) Unable to find host from inventory 
path: /HQ/Cluster1/hq-core-vmware07.blurb.com
2015-03-03 15:48:32,107 INFO  [c.c.h.v.VmwareServerDiscoverer] 
(catalina-exec-15:ctx-c2c30a12 ctx-55597ee3) Found 0 hosts.
2015-03-03 15:48:32,107 ERROR [c.c.h.v.VmwareServerDiscoverer] 
(catalina-exec-15:ctx-c2c30a12 ctx-55597ee3) Unable to find host or cluster 
based on url: /HQ/Cluster1/hq-core-vmware07.blurb.com
2015-03-03 15:48:32,107 INFO  [c.c.h.v.u.VmwareContext] 
(catalina-exec-15:ctx-c2c30a12 ctx-55597ee3) Disconnecting VMware session
2015-03-03 15:48:32,110 WARN  [c.c.r.ResourceManagerImpl] 
(catalina-exec-15:ctx-c2c30a12 ctx-55597ee3) Unable to find the server 
resources at 
http://hq-core-vcenter02.blurb.com/HQ/Cluster1/hq-core-vmware07.blurb.com
2015-03-03 15:48:32,111 INFO  [c.c.u.e.CSExceptionErrorCode] 
(catalina-exec-15:ctx-c2c30a12 ctx-55597ee3) Could not find exception: 
com.cloud.exception.DiscoveryException in error code list for exceptions
2015-03-03 15:48:32,111 WARN  [o.a.c.a.c.a.h.AddHostCmd] 
(catalina-exec-15:ctx-c2c30a12 ctx-55597ee3) Exception:
com.cloud.exception.DiscoveryException: Unable to add the host
 at 
com.cloud.resource.ResourceManagerImpl.discoverHostsFull(ResourceManagerImpl.java:791)
 at 
com.cloud.resource.ResourceManagerImpl.discoverHosts(ResourceManagerImpl.java:586)
 
 at java.lang.Thread.run(Thread.java:744)
2015-03-03 15:48:32,112 INFO  [c.c.a.ApiServer] (catalina-exec-15:ctx-c2c30a12 
ctx-55597ee3) Unable to add the host
2015-03-03 15:48:32,112 DEBUG [c.c.a.ApiServlet] (catalina-exec-15:ctx-c2c30a12 
ctx-55597ee3) ===END===  192.168.5.115 -- POST  
command=addHost&response=json&sessionkey=2Pq%2BiiJSbkYbYnCSJUHRhkyO%2B%2FU%3D

Re: [VOTE] Apache CloudStack CloudMonkey 5.3.1 RC4

[ilya musayev]

+1 (binding)  tested basic functionality - seems to work well.

On 2/27/15 1:27 AM, Abhinandan Prateek wrote:

+1
I have been using cloud monkey to bootstrap a cloud with advance zone.

-abhi


On 27-Feb-2015, at 11:33 am, Rohit Yadav  wrote:

Hi Lucian/Geoff,

Yeah, I had included both users@ and dev@ ML so please reply to dev@ or both to 
get it on dev@ :)


On 26-Feb-2015, at 9:11 pm, Nux!  wrote:

+1 from me, as well.


PS: shouldn't this also go to dev@ ?

--
Sent from the Delta quadrant using Borg technology!

Nux!
www.nux.ro

- Original Message -

From: "Geoff Higginbottom" 
To: users@cloudstack.apache.org
Sent: Thursday, 26 February, 2015 15:19:46
Subject: RE: [VOTE] Apache CloudStack CloudMonkey 5.3.1 RC4
+1

Have been using on a daily basis for a number of weeks using both command line
and heavily in many different scripts.

Regards

Geoff Higginbottom

D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581

geoff.higginbot...@shapeblue.com

-Original Message-
From: Rohit Yadav [mailto:rohit.ya...@shapeblue.com]
Sent: 26 February 2015 10:56
To: dev; users@cloudstack.apache.org
Subject: [VOTE] Apache CloudStack CloudMonkey 5.3.1 RC4

Hi All,

CloudMonkey master branch has been rather stable since last two months.
It has been already tested by many since the last three 5.3.1 RC candidates.
Please take some time to do basic tests and vote for a speedy release. Thanks.

I've created a 5.3.1 release candidate of CloudMonkey, with the following
artifacts up for a vote:

Git Branch and Commit SH:
https://git-wip-us.apache.org/repos/asf?p=cloudstack-cloudmonkey.git;a=shortlog;h=refs/heads/master
Commit: 7b66d39376d2711443a4b91af8375bdf3ae690b5

List of changes:
https://git-wip-us.apache.org/repos/asf?p=cloudstack-cloudmonkey.git;a=blob_plain;f=CHANGES.md

Source release (checksums and signatures are available at the same
location):
https://dist.apache.org/repos/dist/dev/cloudstack/cloudmonkey-5.3.1/

PGP release keys (signed using 0EE3D884):
https://dist.apache.org/repos/dist/release/cloudstack/KEYS

For ease of testing, the CloudMonkey 5.3.1 RC4 candidate is uploaded on PYPI and
can be installed using:

pip install cloudmonkey==5.3.1

Though the PYPI page will have 5.3.0 as default until we unhide 5.3.1 package on
https://pypi.python.org/pypi/cloudmonkey

For usage and other information please refer to this wiki:
https://cwiki.apache.org/confluence/display/CLOUDSTACK/CloudStack+cloudmonkey+CLI

Vote will be open for 72 hours.

For sanity in tallying the vote, can PMC members please be sure to indicate
"(binding)" with their vote?

[ ] +1  approve
[ ] +0  no opinion
[ ] -1  disapprove (and reason why)

Regards,
Rohit Yadav
Software Architect, ShapeBlue
M. +91 8826230892 | rohit.ya...@shapeblue.com
Blog: bhaisaab.org | Twitter: @_bhaisaab

Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build
CSForge – rapid IaaS deployment framework
CloudStack Consulting
CloudStack Software
Engineering
CloudStack Infrastructure
Support
CloudStack Bootcamp Training Courses

This email and any attachments to it may be confidential and are intended solely
for the use of the individual to whom it is addressed. Any views or opinions
expressed are solely those of the author and do not necessarily represent those
of Shape Blue Ltd or related companies. If you are not the intended recipient
of this email, you must neither take any action based upon its contents, nor
copy or show it to anyone. Please contact the sender if you believe you have
received this email in error. Shape Blue Ltd is a company incorporated in
England & Wales. ShapeBlue Services India LLP is a company incorporated in
India and is operated under license from Shape Blue Ltd. Shape Blue Brasil
Consultoria Ltda is a company incorporated in Brasil and is operated under
license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by
The Republic of South Africa and is traded under license from Shape Blue Ltd.
ShapeBlue is a registered trademark.
Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build
CSForge – rapid IaaS deployment framework
CloudStack Consulting
CloudStack Software
Engineering
CloudStack Infrastructure
Support
CloudStack Bootcamp Training Courses

This email and any attachments to it may be confidential and are intended solely
for the use of the individual to wh

[LIVE STREAM] Docker, Kubernetes, CoreOS and Big Data in Apache CloudStack by Sebastien Goasguen hosted @ Apple

[ilya musayev]

Hi all,

We are going to live stream Sebastien’s presentation on Docker,
Kubernetes, CoreOS and Big Data in Apache CloudStack on Tuesday,
February 24th. If you would like to watch it, you can register here:
clds.co/1CURN2T

Presentation: Docker, Kubernetes, CoreOS and Big Data in Apache
CloudStack by Sebastien Goasguen
Date: February 24th, 2015
Time: 6:30pm – 8:30pm Pacific
You must register in order to watch the webinar: clds.co/1CURN2T
If you are in the Silicon Valley and attending in-person, register here:
http://www.meetup.com/CloudStack-Silicon-Valley-User-Group/events/220330313/

Help promote!

Click to tweet: http://ctt.ec/Zcd6B - The #Docker #Kubernetes #CoreOS &
#BigData in #CloudStack talk by @sebgoa on Feb 24 will be streamed live!
Sign up: clds.co/1CURN2T

Thanks,
CloudStack SV Group

Re: VM's not in host report...turning themselves off.

[ilya musayev]

Here is when we've seen this and how we addressed it:

1) stop the VM and CloudStack and note down the instance id of the VM, 
i.e. if its something like i-34-987-VM, 987 is instance_id

2) backup your mysql db
3) delete eveything with your instance id in cloud.op_ha_work table
* you should see a job stuck there that should not be current based on 
time stamp

4) start cloudstack
5) start vm


Also noticed disabling vmware's HA once the cluster, once helped to 
address this issue - but i think it was coincidence more than a solution.




On 1/12/15 9:59 AM, Dave Dunaway wrote:

Anyone come across this log message:

-VM is now missing from host report but we detected that it might be
migrated to other host by vCenter

In our case we had a host recently go into maintenance mode with asyncjobs
left running for VM's on that host. We set the asyncjobs to 'Done' and the
machine boots but then gets turned off again 5 mins later. The log keeps on
mentionning this "host report" but I can't find any reference to it
anywhere.

Anyone experience this before or have an idea of what might be going on?


Thanks!

Dave.

Re: Job failed due to exception Unable to create a deployment for VM[User|i-2-192-VM] - ACS 4.4.1 XenServer 6.2

[ilya musayev]

Motty

I'm not a Xen person, but looking at the logs, i dont see any specific 
error. Would you please check logs on XenServer?

Can you force power on VM on Xen directly to see what happens?

Regards,
ilya
On 2/17/15 2:35 PM, Motty Cruz wrote:
Hello, I am unable to start VM in Cloudstack, I get a very generic 
error, unable to create deployment. I was working, however I need to 
detach a 2nd disk. I shutdown the VM, detach the 2nd Disk, restart the 
VM. however, am unable to restart now. please help!


Job failed due to exception Unable to create a deployment for 
VM[User|i-2-192-VM]

here is the logs: http://pastebin.com/raw.php?i=6RjTSduU


-Motty

Re: CoreOS/Docker - a new blog series

[ilya musayev]

Phil,

Please create twitter links and i will re-tweet.

Regards
ilya
On 2/14/15 3:15 PM, Phillip Kent wrote:

dear all,

I am editing a new series of blog posts on CoreOS and Docker with
CloudStack API, Cloudmonkey and so on. Please have a look at the first
two parts:

http://cloudstore.interoute.com/main/knowledge-centre/blog/coreos-docker-vdc-part1
http://cloudstore.interoute.com/main/knowledge-centre/blog/coreos-docker-vdc-part2

These are written for an end user perspective. We have started *very*
simple (single CoreOS VM with docker CLI) and will be working towards
more complex topics as our own knowledge develops.

We will also be evaluating Red Hat Atomic and Ubuntu Snappy as
container platforms in the next few months.

You can keep in touch with new blog posts by following
https://twitter.com/Interoute or
https://www.facebook.com/pages/Interoute/161759680529086

- Phillip

Re: details parameter of registerTemplate API

[ilya musayev]

Atsushi

Please post this question in Dev CloudStack Mailing List - if you haven't 
already done so.

Regards
ilya

On 2/10/15 10:18 PM, Atsushi Sasaki wrote:

Hi,

I used details parameter of registerTemplate API to set keyboard=jp.

I use following format to pass argument as CLOUDSTACK-4719 says.

details[0].keyboard=jp

https://issues.apache.org/jira/browse/CLOUDSTACK-4719

Most of API parameters that accept map type seems to accept like following
format, although details of registerTemplate can't accept it as expected

detais[0].key=keyboard&details[0].value=jp

Why details parameter of registerTemplate uses different format from most
of the other parameters?

It is hard to use API and make library correctly because we can't check
which format is used in advance.
If possible, I want to use same format in all case.

Atsushi Sasaki

MeetUp SFBay: Docker, Kubernetes, coreOS and Big Data in Apache CloudStack (Hosted at Apple)

[ilya musayev]

Apple is hosting CloudStack SFBay MeetUp on February 24th.

Details here:
http://www.meetup.com/CloudStack-Silicon-Valley-User-Group/events/220330313/

Re: Cloudstack using without virtual Router

[ilya musayev]

CloudStack has a concept of network offering, which is what router VMs 
will use as its "template" or the type of services you would want your 
router vm to have.


Keep in mind, router vm does not have to do the routing, its just one of 
many features.


In your case, you will have to choose either Basic Shared Network Zone 
or Advanced Shared Network Zone (if you have multiple VLANs). This setup 
is mostly used for private clouds who have internal infrastructure well 
established. Unless you are planning to be public cloud provider, shared 
network zone is easiest to use.


In this case, CloudStack will still deploy routervm, but it will only do 
fraction of the services. At the minimal you need to have DHCP service 
and Metadata. Thats all cloudstack will provide for your guest VMs. 
Other than those 2 services, it does not do anything else...


You can then use your physical networks, router, switches, firewalls, etc..

If you can tell us more about what service you are looking to provide, 
we can help with the type of setup you need.


On 2/4/15 3:30 PM, Joerg Brause wrote:

Hi there,

actually we use “Ovirt” and evaluate cloudstack as alternative for our
production.

The cloudstack Server shall be installed in the same network as our real
hardware Servers.

Our completely network ismanaged byCisco router and switches. We need to
know, if it is possible to installthe cloudstack without the Virtual
router and with only one Network or maximum2 networks, we haven't found
a option/ installation possibility for that. The servers areinstalled in
separated buildings. moreover, we would prefer, that the vm network from
the central cisco router receives its IP adresses. Currently we put 3 IP
adress ranges (Admin, Live External and Live Internal) to a run on the
Ovirt / cloudstack servers.


Best regards,

Joerg

Re: Cloudstack using without virtual Router

[ilya musayev]

We are looking into extending oVirt so it works with CloudStack.

Specifically, all operations that are executed, must be proxied through 
CloudStack.


Its all conceptual at this point, but if it does happen - we will write 
the integration and share it with community.



On 2/4/15 3:30 PM, Joerg Brause wrote:

Hi there,

actually we use “Ovirt” and evaluate cloudstack as alternative for our
production.

The cloudstack Server shall be installed in the same network as our real
hardware Servers.

Our completely network ismanaged byCisco router and switches. We need to
know, if it is possible to installthe cloudstack without the Virtual
router and with only one Network or maximum2 networks, we haven't found
a option/ installation possibility for that. The servers areinstalled in
separated buildings. moreover, we would prefer, that the vm network from
the central cisco router receives its IP adresses. Currently we put 3 IP
adress ranges (Admin, Live External and Live Internal) to a run on the
Ovirt / cloudstack servers.


Best regards,

Joerg

Re: Virtual Routers not starting up after host restart

[ilya musayev]

Do you see any stock jobs?

On 2/2/15 10:06 AM, Mohammad Rastgoo wrote:

Hi,

Thanks for reading this.

I have this setup:
server 1: MS + DB
server 2: secondary storage NFS
server 3: kvm - local primary
(all centos 6.6)
net1: isolated network 10.0.0.0/x
net2: shared network (public ip)

Here are the steps I took:

1- stopped all VMs
2- stopped system VMs (not VRs)
3- yum updated glibc + reboot on all servers

Now here is the situation, net2 has remained in setup state and net1 on
allocated.

sys VMs are back on. VRs are at starting and then stopped.

so far, I have deleted VRs and restarted networks + clean up. no luck.

has anyone encountered the same problem? am I missing anything here?

Any help is highly appreciated. Tnx

Re: Docker Support?

[ilya musayev]

Nope, i'm not missing the point, just speaking to folks who run large 
docker implementations for quite sometime and moving away from it into 
LXC world.


Btw, shipping container - implies shipping a tar file with metadata.

On 1/26/15 11:44 AM, Nux! wrote:

Going LXC might be missing the point. I don't think people go Docker because 
they want containers foremost;
they do because  hey want an easy way to ship applications and configurations.
Going LXC will do nothing for these people.

/imho
Lucian

--
Sent from the Delta quadrant using Borg technology!

Nux!
www.nux.ro

- Original Message -

From: "ilya musayev" 
To: users@cloudstack.apache.org
Sent: Monday, 26 January, 2015 18:45:10
Subject: Re: Docker Support?
Dockers networking model is rather complex (to say the least).

LXC would be the way to go, though it does not have as much marketing as
docker does.

Regards
ilya
On 1/26/15 4:51 AM, Osay Osman Yuuni wrote:

Hi all,

Any news on progress with the docker container support for ACS?  I've seen
a few articles on how to install CoreOS on ACS and thence docker as well as
the wish list for docker containers to be supported in ACS like LXC but I
was wondering when this'll become a reality.  Also seen mentioned elsewhere
that Exoscale has docker templates?  Would be nice if this can go to market
sooner.

Cheers

Osay

Re: Docker Support?

[ilya musayev]

Dockers networking model is rather complex (to say the least).

LXC would be the way to go, though it does not have as much marketing as 
docker does.


Regards
ilya
On 1/26/15 4:51 AM, Osay Osman Yuuni wrote:

Hi all,

Any news on progress with the docker container support for ACS?  I've seen
a few articles on how to install CoreOS on ACS and thence docker as well as
the wish list for docker containers to be supported in ACS like LXC but I
was wondering when this'll become a reality.  Also seen mentioned elsewhere
that Exoscale has docker templates?  Would be nice if this can go to market
sooner.

Cheers

Osay

Re: Help with testing Cloudbase-init on Cloudstack Windows VMs

[ilya musayev]

I wish this would have been released earlier..
On 1/20/15 3:56 AM, Nux! wrote:

Hi guys,

It looks like the folk at Cloudbase.it have finished adding Cloudstack support 
in their product.
Let's test this and report any problems

https://www.cloudbase.it/downloads/CloudbaseInitSetup_Beta_x64.msi
https://www.cloudbase.it/downloads/CloudbaseInitSetup_Beta_x86.msi

For those who are not aware, Cloudbase-init is basically cloud-init for Windows 
(and not only, BSD support is also planned etc).
https://github.com/cloudbase/cloudbase-init
http://www.cloudbase.it/cloud-init-for-windows-instances/

Lucian

--
Sent from the Delta quadrant using Borg technology!

Nux!
www.nux.ro

Re: Cancel hung jobs

[ilya musayev]

Here are my notes on cleaning up stuck  VmWorkJobQueue, i use MySQL 
workbench to make changes interactively...


Messages in log file:

(1013,VmWorkJobQueue, 2375) is reaching concurrency limit 1
(1013,VmWorkJobQueue, 2375) is reaching concurrency limit 1
(1433,VmWorkJobQueue, 2470) is reaching concurrency limit 1
(1434,VmWorkJobQueue, 2471) is reaching concurrency limit 1
(1475,VmWorkJobQueue, 2483) is reaching concurrency limit 1
(1477,VmWorkJobQueue, 2484) is reaching concurrency limit 1
(1478,VmWorkJobQueue, 596) is reaching concurrency limit 1
(981,VmWorkJobQueue, 2371) is reaching concurrency limit 1

--


DELETE ALL FROM BELOW - not exact mysql query, i just did select first and then 
deleted rows via mysql workbench.

SELECT * FROM cloud.sync_queue_item where queue_id=981 or queue_id=1478 or 
queue_id=1477 or queue_id=1475 or queue_id=1434 or queue_id=1433 or 
queue_id=1013 ;

SELECT * FROM cloud.sync_queue where id=1433 or id=1434 or id=1475 or id=1477 
or id=1478 or id=981;

On 1/6/15 1:27 AM, Prashant Kumar Mishra wrote:

Restart MS should work . If you don¹t want to restart  clean it manually
from db , it seems because of one unfinished job , other jobs is also
pending .

On 1/6/15, 4:09 AM, "Francois Gaudreault"  wrote:


These are 60min and 1440min for standard jobs and 600sec for vm related
jobs right? I have tasks that are from dec 27 still in there and these
are vm jobs.

FG
On Jan 5, 2015 5:25 PM, "Motty Cruz"  wrote:


Francois,
you can change timeout default settings in "global settings", if you
have
not done so.

Thanks,
Motty
On 01/05/2015 02:09 PM, Francois Gaudreault wrote:


Yes. And also tons of job in the async_job table with status 0.

FG

On 2015-01-05 4:54 PM, ilya musayev wrote:


Do you see something along the lines of below? please provide the
complete error message.

(1434,VmWorkJobQueue, 2471) is reaching concurrency limit 1
(1475,VmWorkJobQueue, 2483) is reaching concurrency limit 1
(1477,VmWorkJobQueue, 2484) is reaching concurrency limit 1
(1478,VmWorkJobQueue, 596) is reaching concurrency limit 1
(981,VmWorkJobQueue, 2371) is reaching concurrency limit 1


On 1/5/15, 1:40 PM, Francois Gaudreault wrote:


Hi folks,

What would be the best way to cancel jobs that are "stuck"? I was
expecting them to timeout, but for some reasons they are not.

Thanks.

Re: Cancel hung jobs

[ilya musayev]

Do you see something along the lines of below? please provide the 
complete error message.


(1434,VmWorkJobQueue, 2471) is reaching concurrency limit 1
(1475,VmWorkJobQueue, 2483) is reaching concurrency limit 1
(1477,VmWorkJobQueue, 2484) is reaching concurrency limit 1
(1478,VmWorkJobQueue, 596) is reaching concurrency limit 1
(981,VmWorkJobQueue, 2371) is reaching concurrency limit 1


On 1/5/15, 1:40 PM, Francois Gaudreault wrote:

Hi folks,

What would be the best way to cancel jobs that are "stuck"? I was 
expecting them to timeout, but for some reasons they are not.


Thanks.

Re: Cloudstack User Interface CSS design

[ilya musayev]

CloudStack is REST Like, you can bolt any interface to it.

There are many freelancers that can help you build it (be it django or 
anything else). Head over to elance.com or similar sites, post a bid for 
a project and you will get what you want. Bolting UI to REST interface 
does not require any knowledge of cloudstack, so its not such a narrow 
specialized field.


On 12/20/14, 3:57 AM, Aldis Gerhards wrote:

Hi.

Does anyone know where is it possible to BUY/ORDER Cloudstack Web 
interface CSS which is more modern and Bootstrap 3.0 compatible.
In my opinion default Cloudstack Web UI is old school allready and 
should be redesigned.


Looking forward to hear from you guys :)

Ar cieņu,

*Aldis Gerhards*
valdes loceklis

GSM: (+371) 27 812 777
Fakss: (+371) 67 387 397
E-pasts: aldis.gerha...@hostnet.lv 
Web:http://www.hostnet.lv 
Twitter:http://www.twitter.com/hostnetlv





*Hostnet Virtuālie serveri (VPS) - Izmēģini VPS par brīvu veselu nedēļu!*
Pakalpojums tiek nodrošināts tikai ar jaudīgiem oriģināliem DELL 
serveriem

Re: ACS 4.4.1 network.throttling.rate - Advance Zone- XenServer 6.2

[ilya musayev]

Ask the question on dev, mention what you've done and ask what to look 
for to confirm the change worked. Perhaps someone else with Xen can help.


Regards
ilya
On 12/18/14, 12:16 PM, Motty Cruz wrote:

hi ilya,

I configured "Global Setting"  set "0" to network.throttling.rate, 
rebuild the VR reboot the machines but network rate still under 20MB. 
I did restarted the management server as well.


I don't know what else to try!

Thanks,
Motty

On 12/18/2014 11:18 AM, ilya musayev wrote:
What i mentioned, confirmed to work on 4.3.1 with VmWare, i havent 
tried on Xen, if that does not help, its probably a bug in 4.4.1 and 
should be filled in JIRA.


On 12/18/14, 11:15 AM, ilya musayev wrote:
There is a global setting in cloudstack named 
"network.throttling.rate" which is set to default 200mb.


We should file RFE to alter this value to "0" or no throttling at 
all instead of default 200.



To address your issues:

You can change the value and restart. In order for this setting to 
take effect, you may have to either

migrate VMs to this vswitch/portgroup
stop and start VM which will recreate and bind vms to new portgroup 
with no throttling
update the portgroup with 200 limit to 0, whenever the VM on this 
portgroup stops and start it will migrate to new portgroup with no 
throttle.


Regards
ilya

On 12/18/14, 7:38 AM, Motty Cruz wrote:

Hi Peter,
We do not set QoS limitation on the interface, I made sure there 
are not setup by default. it's dragging me crazy this issue.


-Motty
On 12/16/2014 03:48 PM, Erdősi Péter wrote:

2014.12.17. 0:38 keltezéssel, Motty Cruz írta:
I'm still having issues with network throughput, it does not go 
over 200MB. am I doing something wrong? I rebuilt VR, reboot VMs 
but does not seem to change throughput. I remember having this 
issue in KVM cluster but was able to fix it. current cluster is 
XenServer 6.2 all updates installed. 
If you open the XenCenter, and check the interface, do you see QoS 
limitation on it?
What happend, if you switch it off on a running vm (and restart 
networking on a VM itself, cause may be loose the nic for a moment)


Regards:
 Peter

Re: ACS 4.4.1 network.throttling.rate - Advance Zone- XenServer 6.2

[ilya musayev]

What i mentioned, confirmed to work on 4.3.1 with VmWare, i havent tried 
on Xen, if that does not help, its probably a bug in 4.4.1 and should be 
filled in JIRA.


On 12/18/14, 11:15 AM, ilya musayev wrote:
There is a global setting in cloudstack named 
"network.throttling.rate" which is set to default 200mb.


We should file RFE to alter this value to "0" or no throttling at all 
instead of default 200.



To address your issues:

You can change the value and restart. In order for this setting to 
take effect, you may have to either

migrate VMs to this vswitch/portgroup
stop and start VM which will recreate and bind vms to new portgroup 
with no throttling
update the portgroup with 200 limit to 0, whenever the VM on this 
portgroup stops and start it will migrate to new portgroup with no 
throttle.


Regards
ilya

On 12/18/14, 7:38 AM, Motty Cruz wrote:

Hi Peter,
We do not set QoS limitation on the interface, I made sure there are 
not setup by default. it's dragging me crazy this issue.


-Motty
On 12/16/2014 03:48 PM, Erdősi Péter wrote:

2014.12.17. 0:38 keltezéssel, Motty Cruz írta:
I'm still having issues with network throughput, it does not go 
over 200MB. am I doing something wrong? I rebuilt VR, reboot VMs 
but does not seem to change throughput. I remember having this 
issue in KVM cluster but was able to fix it. current cluster is 
XenServer 6.2 all updates installed. 
If you open the XenCenter, and check the interface, do you see QoS 
limitation on it?
What happend, if you switch it off on a running vm (and restart 
networking on a VM itself, cause may be loose the nic for a moment)


Regards:
 Peter

Re: ACS 4.4.1 network.throttling.rate - Advance Zone- XenServer 6.2

[ilya musayev]

There is a global setting in cloudstack named "network.throttling.rate" 
which is set to default 200mb.


We should file RFE to alter this value to "0" or no throttling at all 
instead of default 200.



To address your issues:

You can change the value and restart. In order for this setting to take 
effect, you may have to either

migrate VMs to this vswitch/portgroup
stop and start VM which will recreate and bind vms to new portgroup with 
no throttling
update the portgroup with 200 limit to 0, whenever the VM on this 
portgroup stops and start it will migrate to new portgroup with no throttle.


Regards
ilya

On 12/18/14, 7:38 AM, Motty Cruz wrote:

Hi Peter,
We do not set QoS limitation on the interface, I made sure there are 
not setup by default. it's dragging me crazy this issue.


-Motty
On 12/16/2014 03:48 PM, Erdősi Péter wrote:

2014.12.17. 0:38 keltezéssel, Motty Cruz írta:
I'm still having issues with network throughput, it does not go over 
200MB. am I doing something wrong? I rebuilt VR, reboot VMs but does 
not seem to change throughput. I remember having this issue in KVM 
cluster but was able to fix it. current cluster is XenServer 6.2 all 
updates installed. 
If you open the XenCenter, and check the interface, do you see QoS 
limitation on it?
What happend, if you switch it off on a running vm (and restart 
networking on a VM itself, cause may be loose the nic for a moment)


Regards:
 Peter

Re: Quota Usage

[ilya musayev]

Do you mean whats being used or what is allocated?

On 12/12/14, 2:21 AM, Jochim, Ingo wrote:

Is there a way (in ACS 4.2) to find out the current quota usage of a project?

Thanks,
Ingo

Re: 4.3.1 API issue with importing LDAP users

[ilya musayev]

Hi Ian,

This is probably better suited for Dev list, Ian Duffy has done alot of 
work on LDAP and CloudStack, he is cc'd to this thread. Perhaps he can 
shed some light.


Regards
ilya

On 12/5/14, 4:40 PM, Ian Forde wrote:

I’ve got a bash script performing an API call (in my case, via cloudmonkey) as 
follows:

cloudmonkey api listLdapUsers listtype=new display=default 
filter=username,domain

(note that we’re using Active Directory)

There’s at least one user in AD defined with a capital letter in front.  Example:  
“Bjones" rather than "bjones".  Now given that we have a user in CS named 
bjones, Bjones shouldn’t show up in the output from the above command, but it does.

Is this supposed to happen or is the listLdapUsers supposed to perform a 
case-insensitive match against currently-defined Cloudstack user accounts?

Thanks,
   -Ian

Re: Any more CloudMonkey improvements you want to see?

[ilya musayev]

Rohit,

Thanks, for response,

i'll give marvin a shot.

Regards
ilya

On 12/5/14, 1:42 AM, Rohit Yadav wrote:

Hi Ilya,


On 05-Dec-2014, at 2:23 pm, ilya musayev  wrote:

Here is the use case i have. End user needs to setup new cloudstack instance 
with zones, secondary and primary stores, templates, global settings, etc... he 
knows most of the configs will be similar to another env he has with slight 
differences.
If there would be a way to dump this setup in its entirety, modify few configs 
that are global/zone/cluster/host/network specific and use it as a template to 
deploy other envs.

Sound like a configuration management tool you want. On a similar use case you 
may find Paul’s ansible module useful that uses cloudmonkey to deploy zone etc. 
with a specific configuration (zones, storage, template, global settings etc). 
I find ansible pleasant to work with and does not take a lot of time to learn 
it or use it.

Personally to follow the unix philosophy I don’t want cloudmonkey to do many 
things. For such kind of use-cases that people have suggested before, I was 
thinking of refactoring cloudmonkey in such a way that they could write their 
own plugins for cloudmonkey (much like say nose), maybe for 5.4.0.

I’m working on a test/CI tool to automate testing and deployment which you may 
find more useful, it’s going to be tool like cloudmonkey. I’ll keep you posted 
as soon as it can start working for me, I think you may find it interesting. 
The main issue for me is right now is that I started writing it in Go and while 
it’s great, it not as friendly as Python can be.

Right now, tools/marvin has a deployDatacenter script in it that accepts a 
datacenter config json file and deploys a datacenter using that.  Maybe you can 
try that? Though it does not have the import and export/deploy kind of feature 
you’re looking for.

For example, this is what I use for doing local smoke tests: (there are other 
config files in setup/dev)
python tools/marvin/marvin/deployDataCenter.py -i setup/dev/advanced.cfg

Regards,
Rohit Yadav
Software Architect, ShapeBlue
M. +91 88 262 30892 | rohit.ya...@shapeblue.com
Blog: bhaisaab.org | Twitter: @_bhaisaab

Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
CloudStack Software 
Engineering<http://shapeblue.com/cloudstack-software-engineering/>
CloudStack Infrastructure 
Support<http://shapeblue.com/cloudstack-infrastructure-support/>
CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>

This email and any attachments to it may be confidential and are intended solely 
for the use of the individual to whom it is addressed. Any views or opinions 
expressed are solely those of the author and do not necessarily represent those of 
Shape Blue Ltd or related companies. If you are not the intended recipient of this 
email, you must neither take any action based upon its contents, nor copy or show 
it to anyone. Please contact the sender if you believe you have received this email 
in error. Shape Blue Ltd is a company incorporated in England & Wales. 
ShapeBlue Services India LLP is a company incorporated in India and is operated 
under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company 
incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue 
SA Pty Ltd is a company registered by The Republic of South Africa and is traded 
under license from Shape Blue Ltd. ShapeBlue is a registered trademark.

Re: Any more CloudMonkey improvements you want to see?

[ilya musayev]

Hi Rohit,

Thanks for the response, please see comments inline
On 12/5/14, 12:08 AM, Rohit Yadav wrote:

Hi Ilya,


On 05-Dec-2014, at 4:00 am, ilya musayev  wrote:

1) When executing cloudmonkey in batch mode, it would be nice to provide exit 
codes - but this may not be something easily done due to how cloudstack 
responds.

The latest CloudMonkey 5.3.0 returns non-zero exit code when a CloudStack API 
fails.

Need to try this out to see on 5.3.0 if it maybe sufficient.


It would be great to discuss if there are any specific error code it should 
return based on the failed API, as I don’t know which ones to use. If I know 
that, I should be able to easily implement it.

On shell (not as interpreter) it prints without any color and outputs errors on 
stderr. Errors are more verbose now that include any cs error code and HTTP 
error code with the returned json. Any discussions on this on what/how we can 
improve this or any patch contributions would be great.


2) One other major useful feature would be, dump all configs from one CS host 
as json, import configs into another. This way configuration of new CS hosts 
becomes really easy.

By config, do you mean global settings? I want to keep the tool simply but I’m 
thinking of refactoring CloudMonkey’s code so people can write plugins for it 
that could control it’s behaviour, color/themes, output styles etc.
Here is the use case i have. End user needs to setup new cloudstack 
instance with zones, secondary and primary stores, templates, global 
settings, etc... he knows most of the configs will be similar to another 
env he has with slight differences.
If there would be a way to dump this setup in its entirety, modify few 
configs that are global/zone/cluster/host/network specific and use it as 
a template to deploy other envs.


I tend to setup new environments  quite frequently and i wrote a wrapper 
around cloudmonkey that does configuration by reading a config file. 
However, config export and import would be great. The export piece can 
be broken down to Gobal Settings, Zone, Storage and Network - each of 
these could be a separate file or 1 large file with delineation


This woulf definitely help with CI i'm going to undertake soon.

Thanks.
ilya


Regards,
Rohit Yadav
Software Architect, ShapeBlue
M. +91 88 262 30892 | rohit.ya...@shapeblue.com
Blog: bhaisaab.org | Twitter: @_bhaisaab



Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
CloudStack Software 
Engineering<http://shapeblue.com/cloudstack-software-engineering/>
CloudStack Infrastructure 
Support<http://shapeblue.com/cloudstack-infrastructure-support/>
CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>

This email and any attachments to it may be confidential and are intended solely 
for the use of the individual to whom it is addressed. Any views or opinions 
expressed are solely those of the author and do not necessarily represent those of 
Shape Blue Ltd or related companies. If you are not the intended recipient of this 
email, you must neither take any action based upon its contents, nor copy or show 
it to anyone. Please contact the sender if you believe you have received this email 
in error. Shape Blue Ltd is a company incorporated in England & Wales. 
ShapeBlue Services India LLP is a company incorporated in India and is operated 
under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company 
incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue 
SA Pty Ltd is a company registered by The Republic of South Africa and is traded 
under license from Shape Blue Ltd. ShapeBlue is a registered trademark.

Re: Copy template

[ilya musayev]

I've seen many of these before, usually relates to end user 
configuration. As Ali pointed out,


"secstorage.allowed.internal.sites"


If that does not help after you define your subnet and restart MS, then 
its port/firewall related.


You can view your templates table to lookup the internal location of 
template to be exported and test from each SSVM via curl or wget.


Regards,
ilya

On 12/4/14, 9:26 AM, Alireza Eskandari wrote:

Maybe you should play with "secstorage.allowed.internal.sites" configuration
   From: Fedi Ben Ali 
  To: users@cloudstack.apache.org
  Sent: Thursday, December 4, 2014 7:35 PM
  Subject: Copy template

Hello,


I'm trying to copy template from one zone to one other but cloudstack
,keeps shwing an error message connexion refused.

Is there any special configuration that allow the internal downloads in
cloudstack ?

Best Regards.


   

Re: CloudStack and Cisco APIC integration

[ilya musayev]

Bill,

CloudStack provides pluggable framework - which in theory should 
accomplish what you are doing.


In some cases, it may need to be part of the core, this question is 
better suited for DEV mailing list. There are many integrations in SDN 
space that are coming along and have already been commited to upstream 
master branch, you can them as point of reference if you were to design 
something similar.


Regards
ilya

One other industry trend that may happen in the near future - project 
OpenDaylight

On 12/4/14, 11:57 AM, Bill Wade wrote:

I’ll preface this with, “this is an End user question”.. I’m working with a 
private cloud provider who is looking to use CloudStack for their compute and 
storage orchestration and use Cisco APIC with the Nexus 9k switches for the 
network provisioning.  I’m new to the “SDN/NFV” space and looking around I 
don't see support for Cisco APIC with CloudStack.  Any one have experience with 
these two working together?  Can CloudStack step aside and let APIC provision 
the network?  I'm seeing the potential for provisioning conflicts here.

Thanks,
Bill

Re: Any more CloudMonkey improvements you want to see?

[ilya musayev]

Rohit,

1) When executing cloudmonkey in batch mode, it would be nice to provide 
exit codes - but this may not be something easily done due to how 
cloudstack responds.


2) One other major useful feature would be, dump all configs from one CS 
host as json, import configs into another. This way configuration of new 
CS hosts becomes really easy.


Thanks for making this awesome tool even better

Regards
ilya

On 12/4/14, 3:45 AM, Rohit Yadav wrote:

Hi all,

We want to work on the next release of CloudMonkey do you have any
issues that we should fix, or any new feature you want? Thanks.

--
Regards,
Rohit Yadav
Software Architect, ShapeBlue
M. +91 8826230892 | rohit.ya...@shapeblue.com
Blog: bhaisaab.org | Twitter: @_bhaisaab

Find out more about ShapeBlue and our range of CloudStack related 
services


IaaS Cloud Design & 
Build

CSForge – rapid IaaS deployment framework
CloudStack Consulting
CloudStack Software 
Engineering
CloudStack Infrastructure 
Support
CloudStack Bootcamp Training 
Courses


This email and any attachments to it may be confidential and are 
intended solely for the use of the individual to whom it is addressed. 
Any views or opinions expressed are solely those of the author and do 
not necessarily represent those of Shape Blue Ltd or related 
companies. If you are not the intended recipient of this email, you 
must neither take any action based upon its contents, nor copy or show 
it to anyone. Please contact the sender if you believe you have 
received this email in error. Shape Blue Ltd is a company incorporated 
in England & Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue 
Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in 
Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA 
Pty Ltd is a company registered by The Republic of South Africa and is 
traded under license from Shape Blue Ltd. ShapeBlue is a registered 
trademark.

Re: firewall for vmware

[ilya musayev]

Since its "shared", it is assumed you will be handling this portion on 
your own.




On 11/24/14, 12:05 AM, Alireza Eskandari wrote:

Hi friends,Is there any solution to provide firewall (or something like security 
groups)for VMs on vmware in a "guest shared network"?Thanks

Re: Fwd: users Digest of: get.18005

[ilya musayev]

Do you recall what release of ACS had this functional? Or is this 
something you trying now and it fails?


Please open a jira issue here 
https://issues.apache.org/jira/browse/CLOUDSTACK


Mark this issue as major in Jira, post this issue on dev list with 
reference to jira issue id.



On 10/22/14, 5:17 AM, cs user wrote:

Apologies, new member of the list having problems replying to an existing
message! :-)

We're having the same issues as France. Xenserver, 6.01 latest hotfixes,
cloudstack 4.3 and 4.4. Snapshot of volume on local disk, to be transferred
to S3. When the xenhost attemps the PUT request, the snapshot is no longer
present and so the request fails. Snapshots of volumes stored on Primary
storage work fine and are uploaded to the S3 backed secondary storage as
expected.

Also tried upgrading the hosts to Xenserver 6.2, however it still has the
same issue. On another environment with cloudstack 4.3, with Xenserver 6.01
(no recent xen hotfixes and no S3 backed secondary storage), local
snapshots work fine.

We see this in the management server logs:

(I have removed references to any hosts from the logs)

WARN  [c.c.h.x.r.CitrixResourceBase] (DirectAgent-269:ctx-18eb6dbd) Task

failed! Task record: uuid:
54c09e4f-cf52-4bc2-7e3f-e3743a63ff92
nameLabel: Async.host.call_plugin
  nameDescription:
allowedOperations: []
currentOperations: {}
  created: Tue Oct 21 14:18:50 BST 2014
 finished: Tue Oct 21 14:18:49 BST 2014
   status: failure
   residentOn: com.xensource.xenapi.Host@1dd85be5
 progress: 1.0
 type: 
   result:
errorInfo: [XENAPI_PLUGIN_FAILURE, getSnapshotSize,
CommandException, 2]
  otherConfig: {}
subtaskOf: com.xensource.xenapi.Task@aaf13f6f
 subtasks: []
WARN  [c.c.h.x.r.CitrixResourceBase] (DirectAgent-269:ctx-18eb6dbd)
callHostPlugin failed for cmd: getSnapshotSize with args snapshotUuid:
b8b3b99a-66b3-461f-b5db-53ad0adec391, isISCSI: true, pri
maryStorageSRUuid: 8649181d-bf39-40b9-4e88-9e1800f8a2bc,  due to Task
failed! Task record: uuid:
54c09e4f-cf52-4bc2-7e3f-e3743a63ff92
nameLabel: Async.host.call_plugin
  nameDescription:
allowedOperations: []
currentOperations: {}
  created: Tue Oct 21 14:18:50 BST 2014
 finished: Tue Oct 21 14:18:49 BST 2014
   status: failure
   residentOn: com.xensource.xenapi.Host@1dd85be5
 progress: 1.0
 type: 
   result:
errorInfo: [XENAPI_PLUGIN_FAILURE, getSnapshotSize,
CommandException, 2]
  otherConfig: {}
subtaskOf: com.xensource.xenapi.Task@aaf13f6f
 subtasks: []
Task failed! Task record: uuid:
54c09e4f-cf52-4bc2-7e3f-e3743a63ff92
nameLabel: Async.host.call_plugin
  nameDescription:
allowedOperations: []
currentOperations: {}
  created: Tue Oct 21 14:18:50 BST 2014
 finished: Tue Oct 21 14:18:49 BST 2014
   status: failure
   residentOn: com.xensource.xenapi.Host@1dd85be5
 progress: 1.0
 type: 
   result:
errorInfo: [XENAPI_PLUGIN_FAILURE, getSnapshotSize,
CommandException, 2]
  otherConfig: {}
subtaskOf: com.xensource.xenapi.Task@aaf13f6f
 subtasks: []
 at
com.cloud.hypervisor.xen.resource.CitrixResourceBase.checkForSuccess(CitrixResourceBase.java:3293)



On the xenserver we see the following in /var/log/cloud/vmops.log

2014-10-20 16:21:59DEBUG [root]  VMOPS enter

  create_secondary_storage_folder 
2014-10-20 16:21:59DEBUG [root] create_secondary_storage_folder, args:
{'newFolder': 'snapshots/2/257', 'remoteMountPath':
'hostname:/CS_TEST_SEC_01'}
2014-10-20 16:21:59DEBUG [root] Successfully mounted
hostname:/CS_TEST_SEC_01 to
/var/run/cloud_mount/0d932145-892f-4960-8153-a30f4132fdc3
2014-10-20 16:21:59DEBUG [root] Successfully unmounted
/var/run/cloud_mount/0d932145-892f-4960-8153-a30f4132fdc3
2014-10-20 16:21:59DEBUG [root]  VMOPS exit
  create_secondary_storage_folder 
2014-10-20 16:22:03DEBUG [root]  VMOPS enter  gethostvmstats 
2014-10-20 16:22:03DEBUG [statsLogger] Calling URL:
http://localhost/rrd_updates?session_id=OpaqueRef:79767c0a-a353-4f9c-cbb4-fba8a124bb83&host=true&cf=AVERAGE&interval=60&start=1413818423
2014-10-20 16:22:03DEBUG [statsLogger] Size of returned XML: 6408
2014-10-20 16:22:03DEBUG [root]  VMOPS exit  gethostvmstats 
2014-10-20 16:22:36DEBUG [root]  VMOPS enter  gethostvmstats 
2014-10-20 16:22:36DEBUG [statsLogger] Calling URL:
http://localhost/rrd_updates?session_id=OpaqueRef:693d7e20-000d-81ee-58e5-10b795e5a330&host=false&cf=AVERAGE&interval=60&start=1413818456
2014-10-20 16:22:36DEBUG [statsLogger] Size of returned XML: 6408
20

Re: Cloudstack jobs

[ilya musayev]

Octavian,

My personal opinion, I dont believe there would be an issue if you post 
on dev and users list. You can also try linkedin and cloudstack meetup 
groups.


Regards
ilya


On 10/21/14, 7:58 AM, Octavian Popescu wrote:

Hello,

I was wondering if there's any specific mailing list for job postings related to 
Cloudstack - architects, developers etc. I had a look at the official 
list and there doesn't seem to 
be any, which is a pity really given the talent in this community.

Thanks,
Octavian

Re: HTTP Status 404 - just upgraded from ACS 4.4.0 to ACS 4.4.1

[ilya musayev]

Motty,

The error you see about not being able to connect to a host on port 9090 
is normal when the management server is starting. There must be another 
error or warning somewhere.


Please try the steps below to shrink the log file to manageable size and 
upload the file to some file sharing site if paste bin restricts you.


service cloudstack-management stop
cat /dev/null > /var/log/cloudstack/management/management-server.log
service cloudstack-management start

wait 10 minutes
upload the whole file or contents of it to google drive or something 
similar.


What is your umask is set to?

Regards
ilya
On 10/8/14, 1:04 PM, motty cruz wrote:

Hello ilya,
I was not able to post the entire log file is too big,

here is the error msg I see at 6:21 am.
http://pastebin.com/raw.php?i=dWxDmR91


Thanks,
Motty
On Wed, Oct 8, 2014 at 12:34 PM, ilya musayev 
wrote:


Management server log is missing ERROR statements in what you've posted.
Please include the full log file.

On 10/8/14, 12:23 PM, motty cruz wrote:


I am looking in the logs but I can't see to find exactly the error causing
this issue.
I still getting this error:
HTTP Status 404 -
--

*type* Status report

*message*

*description* *The requested resource () is not available.*
--
Apache Tomcat/6.0.24

On Wed, Oct 8, 2014 at 12:09 PM, Andrei Mikhailovsky 
wrote:

  I've had a similar issue when upgrading, but I can't remember exactly how

I solved it. I think everything should be in the logs, it was pretty
straightforward and quick as far as I remember.

Andrei

P.S. to revert back you simply stop acs and usage server, restore your
database from backups and install the previous acs version. If you've
updated any clients, make sure you revert them back as well.

- Original Message -

  From: "motty cruz" 

To: users@cloudstack.apache.org
Sent: Wednesday, 8 October, 2014 6:34:29 PM
Subject: Re: HTTP Status 404 - just upgraded from ACS 4.4.0 to ACS
4.4.1
Thanks Erik,
here is the output of netstat -anlp
http://pastebin.com/raw.php?i=CJn9i9ci
ps aux
http://pastebin.com/raw.php?i=uSDJJUDH
management-server.log
http://pastebin.com/raw.php?i=sSs63jRi
Thanks for your support
Motty
On Wed, Oct 8, 2014 at 10:00 AM, Erik Weber 
wrote:


Post the log on pastebin, also post the output of

netstat -anlp
ps aux

Erik
8. okt. 2014 18:30 skrev "motty cruz" 
følgende:

  Hi Erik,

I did as you suggested :
[root@blaze home]# pkill java
[root@blaze home]# service cloudstack-management status
cloudstack-management dead but pid file exists
The pid file locates at /var/run/cloudstack-management.pid and
lock file


at


/var/lock/subsys/cloudstack-management.
Starting cloudstack-management will take care of them or you can
manually clean up.
[root@blaze home]# service cloudstack-management stop
Stopping cloudstack-management: [ OK ]
[root@blaze home]# service cloudstack-management start
Starting cloudstack-management: [ OK ]
[root@blaze home]# service cloudstack-management status
cloudstack-management (pid 3853) is running...
[root@blaze home]# service cloudstack-management status
cloudstack-management (pid 3853) is running...
[root@blaze home]#

I can't attached the management-server.log apache.org complained
about


it.


On Wed, Oct 8, 2014 at 9:07 AM, Erik Weber 
wrote:

  You shouldnt start tomcat, cloudstack will do that for you.

Shutdown tomcat and kill any acs related java processes. Then
you start
cloudstack-management service and post the logs if it fails

Erii
8. okt. 2014 15:53 skrev "motty cruz" 
følgende:

  I restarted tomcat6 /etc/init.d/tomcat6 restart now I'm

getting a


blank

page no errors

any ideas?

On Wed, Oct 8, 2014 at 6:34 AM, motty cruz



wrote:
Hello,

I just upgrade Cloudstack from 4.4.0 to 4.4.1, now I'm
getting the
following error:
HTTP Status 404 -
--

*type* Status report

*message*

*description* *The requested resource () is not available.*
--
Apache Tomcat/6.0.24

Thanks for your support,
Motty



--
Thanks for your support,
Motty



--
Thanks for your support,
Motty

  --

Thanks for your support,
Motty

Re: HTTP Status 404 - just upgraded from ACS 4.4.0 to ACS 4.4.1

[ilya musayev]

Management server log is missing ERROR statements in what you've posted. 
Please include the full log file.


On 10/8/14, 12:23 PM, motty cruz wrote:

I am looking in the logs but I can't see to find exactly the error causing
this issue.
I still getting this error:
HTTP Status 404 -
--

*type* Status report

*message*

*description* *The requested resource () is not available.*
--
Apache Tomcat/6.0.24

On Wed, Oct 8, 2014 at 12:09 PM, Andrei Mikhailovsky 
wrote:


I've had a similar issue when upgrading, but I can't remember exactly how
I solved it. I think everything should be in the logs, it was pretty
straightforward and quick as far as I remember.

Andrei

P.S. to revert back you simply stop acs and usage server, restore your
database from backups and install the previous acs version. If you've
updated any clients, make sure you revert them back as well.

- Original Message -


From: "motty cruz" 
To: users@cloudstack.apache.org
Sent: Wednesday, 8 October, 2014 6:34:29 PM
Subject: Re: HTTP Status 404 - just upgraded from ACS 4.4.0 to ACS
4.4.1
Thanks Erik,
here is the output of netstat -anlp
http://pastebin.com/raw.php?i=CJn9i9ci
ps aux
http://pastebin.com/raw.php?i=uSDJJUDH
management-server.log
http://pastebin.com/raw.php?i=sSs63jRi
Thanks for your support
Motty
On Wed, Oct 8, 2014 at 10:00 AM, Erik Weber 
wrote:

Post the log on pastebin, also post the output of

netstat -anlp
ps aux

Erik
8. okt. 2014 18:30 skrev "motty cruz" 
følgende:


Hi Erik,

I did as you suggested :
[root@blaze home]# pkill java
[root@blaze home]# service cloudstack-management status
cloudstack-management dead but pid file exists
The pid file locates at /var/run/cloudstack-management.pid and
lock file

at

/var/lock/subsys/cloudstack-management.
Starting cloudstack-management will take care of them or you can
manually clean up.
[root@blaze home]# service cloudstack-management stop
Stopping cloudstack-management: [ OK ]
[root@blaze home]# service cloudstack-management start
Starting cloudstack-management: [ OK ]
[root@blaze home]# service cloudstack-management status
cloudstack-management (pid 3853) is running...
[root@blaze home]# service cloudstack-management status
cloudstack-management (pid 3853) is running...
[root@blaze home]#

I can't attached the management-server.log apache.org complained
about

it.

On Wed, Oct 8, 2014 at 9:07 AM, Erik Weber 
wrote:


You shouldnt start tomcat, cloudstack will do that for you.

Shutdown tomcat and kill any acs related java processes. Then
you start
cloudstack-management service and post the logs if it fails

Erii
8. okt. 2014 15:53 skrev "motty cruz" 
følgende:


I restarted tomcat6 /etc/init.d/tomcat6 restart now I'm
getting a

blank

page no errors

any ideas?

On Wed, Oct 8, 2014 at 6:34 AM, motty cruz


wrote:

Hello,
I just upgrade Cloudstack from 4.4.0 to 4.4.1, now I'm
getting the
following error:
HTTP Status 404 -
--

*type* Status report

*message*

*description* *The requested resource () is not available.*
--
Apache Tomcat/6.0.24

Thanks for your support,
Motty




--
Thanks for your support,
Motty




--
Thanks for your support,
Motty


--
Thanks for your support,
Motty

Re: which version is more stable one to deploy ACS in production:

[ilya musayev]

I run 4.3.1 and my environments are very large. I plan to stay on it for 
a while.


Depending on the size if you go into 100 hypervisors, you may want to 
tweak java heap.


On 10/6/14, 1:11 AM, AnilKumar Lakineni wrote:

Hi All,

Good Morning,

I want to deploy ACS for production. So can anybody suggest  me which version 
should I take into production with more advanced features.

Looking forward for your valuable suggestions.


Thank you,
Anil.

Re: CentOS 7 support

[ilya musayev]

ACS is java dependent - not kernel, if you can get all packages aligned 
properly using Java 7, technically it should work.

On 10/6/14, 6:57 AM, Adrian Lewis wrote:

As far as I can tell, we're not going to see Centos 7 support for the
management server on any 4.3 or 4.4 branch but the 4.5 branch should have
it in already. Can't comment on compute hosts however.

I'd love to hear if anyone knows otherwise though, especially about
'backporting' the functionality to 4.3 or 4.4.

Adrian

-Original Message-
From: Ron Wheeler [mailto:rwhee...@artifact-software.com]
Sent: 06 October 2014 14:11
To: users@cloudstack.apache.org
Subject: CentOS 7 support

What is the plan for CentOS 7 support?

Ron

Re: Cloudstack 4.3.0, Setup VPN but can not connect

[ilya musayev]

I was under impression 4.3.1 contained a fix for OSX vpn client issue... 
but i could be wrong.


Please check the release notes for 4.3.1

Regards
ilya
On 10/3/14, 11:22 AM, Aldis Gerhards wrote:

I am using MAC OS Maverics, trying to setup standard VPN for L2TP.
Laptop is behind NAT, but PPTP to another host is working.

Do you think this is VPN CLIENT issue?

Ar cieņu,

*Aldis Gerhards*
valdes loceklis

GSM: (+371) 27 812 777
Fakss: (+371) 67 387 397
E-pasts: aldis.gerha...@hostnet.lv 
Web:http://www.hostnet.lv 
Twitter:http://www.twitter.com/hostnetlv





*Hostnet Virtuālie serveri (VPS) - Izmēģini VPS par brīvu veselu nedēļu!*
Pakalpojums tiek nodrošināts tikai ar jaudīgiem oriģināliem DELL 
serveriem


On 03 Oct 2014, at 21:20, Chiradeep Vittal 
mailto:chiradeep.vit...@citrix.com>> wrote:


This is remote access VPN from a laptop (I.e., PPTP/L2TP/IPSEC). 
Ports are opened.

Is your laptop behind NAT? What OS (version?)

From: Aldis Gerhards mailto:al...@hostnet.lv>>
Reply-To: "users@cloudstack.apache.org 
" >

Date: Friday, October 3, 2014 at 8:28 AM
To: "users@cloudstack.apache.org 
" >

Subject: Cloudstack 4.3.0, Setup VPN but can not connect

Hi.

Anybody can tell why we can not connect to VPN. We just getting TIMED 
OUT and thats it.
It seems that some firewall on cloudstack should be open. Maybe we 
need to open additional ports in FIREWALL so it works.


Any help is appreciated!


Ar cie?u,

*Aldis Gerhards*
valdes loceklis

GSM: (+371) 27 812 777
Fakss: (+371) 67 387 397
E-pasts: aldis.gerha...@hostnet.lv 
Web:http://www.hostnet.lv 
Twitter:http://www.twitter.com/hostnetlv





*Hostnet Virtu?lie serveri (VPS) - Izm??ini VPS par br?vu veselu ned??u!*
Pakalpojums tiek nodrošin?ts tikai ar jaud?giem ori?in?liem DELL 
serveriem

Re: Can't launch VMs

[ilya musayev]

Carlos,

VLAN tagging is one of the main reasons why you want to use advanced 
zone. Thats the difference between basic and advanced zones.


Regards
ilya


On 10/2/14, 10:04 AM, Carlos Reátegui wrote:

I don't see anywhere in the basic network wizard where I can add a vlan tag. I 
see it in the advanced network wizard.

Do you know where in the DB I can add the tag to get my system back online? Or 
can you point me to the jira.

Thank you
Carlos




On Oct 2, 2014, at 8:30 AM, Daan Hoogland  wrote:

The add zone wizard provides a field during physical network creation. Not
sure if that answers your question. Not in case you are using the api of
course.


On Thu, Oct 2, 2014 at 3:46 PM, Carlos Reátegui  wrote:




On Oct 2, 2014, at 12:57 AM, Daan Hoogland 

wrote:

On Thu, Oct 2, 2014 at 12:29 AM, Carlos Reátegui 
wrote:


Daan,
Any chance you got to look at this?  I am still confused why for a basic
network with no vlans the code is expecting a uri for a vlan.
thanks

​
It is a known issue, can you do your setup with specifying a vlan? I
suspect this being the issue. It won't use the vlan but it needs a value.

Where do I do that?


Needs fixing but I think it will work with this work around. I am not

sure

what the most solid fix would be and that would be more a discussion for
dev@...

You could think of inserting a default value when doing basic networking

or

a check on networking type when creating the router/instances. Both seem
quirky, though.

regards,
--
Daan



--
Daan

Re: Customizing GUI

[ilya musayev]

Easiest way is to find the image you like to change on your server and 
replace it with identically sized image - but your own.


For example, using any browser you can right click on the image and get 
the properties of it, or use inspect elements feature of chrome.


Goto your linux host, i assume you are running redhat based linux os.
Execute "updatedb" - assuming its installed.
Execute "locate image-i-want-to-replace.png"

On 9/27/14, 6:04 AM, José Egas López wrote:

Hi all! How can I customize CS 4.3.1 GUI?
I want to mount a few images on it, like on the login page and on the 
main menu...

Thanks for your help.

Re: Few Questions

[ilya musayev]

I'm not much into hosting jargon, but VPS if i'm not mistaken, means 
jailed linux env, i.e. lxc, docker container or chroot'ed environment 
that appears like a dedicated virtual server but shares resources and 
common drivers with its host.


Dedicated virtual server implies fully virtualized server - where 
everything down to the bios is emulated.


The "Cloud" is just a hype word marketing folks would like to apply, it 
has way too many meanings and unrealistic expectations - depends who you 
ask - to each, his own.


http://en.wikipedia.org/wiki/Cloud_computing


On 9/26/14, 1:19 PM, Talk Jesus wrote:

Hi everyone,

  


I'd like to set up a new cloud cluster using CS platform. I do have a few
questions though if you don't mind.

  


1.   Marketing "cloud hosting", "cloud vps" or "cloud dedicated servers"
is essentially the same thing correct, except the typical CPU/disk
allowance? Is that correct?

2.   Is there such a general difference between a cloud vps or cloud
dedicated here? My understanding is, there isn't but want clarification. For
example, if I have a few old rackmount servers, can I throw this into the
cloud cluster? If so, how is it that the cloud would use CPU/RAM from one
box and the customer data on a separate storage box? This confuses me.

  


For initial hardware, I have the following in mind. Please tell me if this
looks reasonable to offer cloud hosting, cloud vps. I'm going off the
small-scale deployment sample

  


If I understand correctly, there are generally 3 boxes (aside core
router/switches)

1.   Management console that has CS installed

2.   Storage server

3.   CPU/RAM server

  


Is this correct? I won't be using VMWARE either but would like to offer
typical shared hosting with cPanel, reseller hosting with cPanel/WHM, VPS
options (Xen, KVM, OpenVZ) and dedicated servers if viable with CS.

  


My initial intended deployment:

  


CS Management Server

-  Quad Core Xeon, 8GB RAM, RAID SSD drives for redundancy (approx.
128GB)

-  Centos 7 64bit (if this isn't supported yet, 6.5v)

Storage Server

-  Document says NFS, but is FreeNAS storage server ok?

-  2x Quad Core Xeon, 16GB RAM, RAID 10 drives (preferably 5 + 5 or
maybe just 2 + 2 to start)

-  should a storage server require SSD for optimal performance or is
this overkill?

Computing Nodes

-  I assume this is where all the CPU/Memory comes from? If so,

-  32GB RAM

-  2x Hexacore Xeons w/ Turbo

-  anything else?

  


Sorry for the long list. Just want to make sure I have a full understanding
before tackling this setup. Thanks.

  

  

  

Re: Adding OVA or OVF VMs to CS 4.3.1

[ilya musayev]

Only OVA is supported - as its a single file VS 3 files you get with OVF.

On 9/24/14, 10:09 AM, José Egas López wrote:
Hi, I have exported an OVA and also an OVF template from an existing 
VM from vSphere.

The templates have the following types of file:
OVA --> templateName.ova
OVF-->  templateName.mf; templateName.ovf; templateName.vmdk

I want to deploy a VM in CS from one of those templates.
I'm not sure about how CS 4.3.1 is supporting this file formats.
So the question is, how can I add my template into CS templates?

Re: ACS 4.3.1 disable realhostip.com or SSL

[ilya musayev]

You should be able to use CSR to sign with CA directly, you would need a 
wildcard cert with conforming hostname - should be in the instructions.


Regards
ilya
On 9/24/14, 6:40 AM, France wrote:

I went down the route with custom DNS service (already working) and custom 
certificate, because it feels safer than rolling out my RPM packages.

So, the instructions 
(https://cwiki.apache.org/confluence/display/CLOUDSTACK/Procedure+to+Replace+realhostip.com+with+Your+Own+Domain+Name#ProceduretoReplacerealhostip.comwithYourOwnDomainName-HowtogeneratemycustomrootCAandcertificate?)
 point me to creating an intermediate certificate, which i do not think is 
required.

If I am my own CA, why should i create an intermediate certificate and sign 
with that to complicate things? I guess i could sign my CSR with CA directly. 
Can’t I?

Then just use the GUI and no API calls, to add the certificate, the key and 
domain info. As long as i keep secstorage.encrypt.copy to false, all shoud 
work. Right?

Regards,
F.

On 20 Sep 2014, at 21:17, Amogh Vasekar  wrote:


ConsoleProxyInfo and ConsoleProxyManagerImpl.assignProxy has the relevant
code to generate the URL for accessing console.
The ConsoleProxyServlet handles the requests, and might be a good starting
point if you wish to change the code.

Amogh

On 9/20/14 12:01 PM, "France"  wrote:


Hi Amogh,

thank you for your suggestions and instructions on disabling.

We will not run a wildcard DNS resolver on certain subdomain as required
for this option.
Once ACS supports single domain for console proxy access, we shall enable
https once again with our signed/bought certificate.

In the mean time, we either have to move to http from https making access
to whole admin interface insecure or hack the code to display a link to
console instead of iframe.
I would rather go for the latter option. Does anyone who is following
this, know where is the code for that iframe link?

Thank you.

F.

On 20 Sep 2014, at 20:33, Amogh Vasekar  wrote:


Hi,

I believe this is by design for SSL - a user would see a HTTPS site
thinking everything is secure and encrypted, only to realize later that
some part is in fact insecure. Hence, instead of trying to circumvent
the
security mechanism, you can try the steps at :

https://cwiki.apache.org/confluence/display/CLOUDSTACK/Procedure+to+Repla
ce

+realhostip.com+with+Your+Own+Domain+Name#ProceduretoReplacerealhostip.co
mw
ithYourOwnDomainName-HowtogeneratemycustomrootCAandcertificate?

This would help create your own certificate chain. The downside being
your
users would need to add the custom root CA in the browser (a practice
followed by many companies for internal network), or simply accept the
security warning the first time they access your domain.
Please note that this would still need a publicly resolvable domain (or
add the mappings directly in /etc/hosts if it is more convenient)

Thanks,
Amogh

On 9/20/14 11:22 AM, "France"  wrote:


It worked for us. Well kind of.

The problem is now, that we have https for default admin interface,
while
console opens as iframe to http content and browsers such as firefox
will
not load content, because it is not on https.
They call it: "Mixed Content Blocking Enabled²:

https://blog.mozilla.org/tanvi/2013/04/10/mixed-content-blocking-enabled
-i
n-firefox-23/

Do you have any recommendations what to do in order to get around this?

We will not buy a wildcard certificate, because it is to expensive for
us.

Regards,
F.

On 20 Sep 2014, at 15:21, France  wrote:


I will just empty these two fields in global config:

secstorage.ssl.cert.domain
consoleproxy.url.domain

restart CS and restart the console proxy..

Š and hope for the best. :-)

If you do not hear from me on this, then this worked and others can do
it too.

Regards,
F.


On 20 Sep 2014, at 15:16, Aldis Gerhards  wrote:


We got the same problem. It seemed like a bug :) we downgraded back
to
4.3.0 because pf this issue.

Sent from my iPhone


On 2014. gada 20. sept., at 15:39, France 
wrote:

Hi guys,

how do we disable realhostip.com service with its certificates on
ACS
4.3.1, to get consoleproxy working without ties to realhostip.com
service?
We are happy with HTTP only for now.

Regards,
F.

Re: Zone already associated with a VMware datacenter

[ilya musayev]

The tag is not easily seen and i was able to remove it from vmware 
windows client and not web ui.


Screenshot below:
http://screencast.com/t/hwVet86sJv


On 9/23/14, 4:16 PM, José Egas López wrote:
I removed all before I destroyed my setup. Ok I'll check that on 
vCenter, thank you Nitin!

Yes of course, how can I file a bug for reporting this?

*
Regards,
José

*

El 23/09/2014 17:59, Nitin Mehta escribió:
Can you please check tags on the dc in vcenter ? Can you clear that 
out ?

Can you also file a bug for this - seems like its not removing the
metadata when you destroyed your setup (I am hoping you removed the 4.4
zone from CS)

On 23/09/14 3:54 PM, "José Egas López"  wrote:


Hi all!
I just installed again CS 4.3.1 (I was using 4.4.0; I destroyed the
installation of CS 4.4.0 I did before), but when I try to add the first
cluster, the following error comes out:

Zone 1 is already associated with a VMware datacenter. Only 1 VMware DC
can be associated with a zone.

I tried changing the name of de VM DC but it shows the same error. How
can I detach my current VM DC to add to CS?

*Regards,
José

*

Re: User Deleted Recover templates and isos

[ilya musayev]

Assuming the data still resides (you need to check you secondary store), 
you can alter the "removed" field for that record and it will bring it 
back in the UI.


Review:
SELECT * FROM cloud.vm_template; -> alter removed field to "null"
SELECT * FROM cloud.template_store_ref; -> local_path for location of 
the template/iso and alter destroyed field to 0


On 9/19/14, 12:15 AM, Ivan Rodriguez wrote:

Hi CloudStack Users,

Is there any chance to UNdelete an user and recover all the previous ISOS
and templates ?

Cheers

Re: ACS 4.2.1 KVM and ACS 4.4 XenServer 6.2 - same vlan network on both clusters

[ilya musayev]

Any particular reason why you need to be on 4.4? I'd suggest you wait 
for at least 4.4.1 to come out.


Regards
ilya
On 9/19/14, 9:41 AM, motty cruz wrote:

Hello,
I have two Cloudstack clusters, I would like to migrate from ACS 4.2.1 to
ACS 4.4 Xenserver (seem to be stable then KVM). I would like to create
network with same vlan on both cluster to be able to create instances in
the same network.

my question is, can I create network and edit the vlan once network is
created?

Thanks,
Motty

Re: [VMWare] Deploy a new datacenter using Marvin

[ilya musayev]

Would like to hear the solution as well.

Regards
On 9/17/14, 6:05 AM, Nicolas Lamirault wrote:

Hi,
i would like to deploy a new datacenter into a fresh installation of
Cloudstack using Marvin *deploydatacenter.py* tool.
Where i can find any documentation for the json format ? Specially for
the VMWare cluster.
Regards.

--
Nicolas Lamirault

Re: Unable to start a VM due to insufficient capacity

[ilya musayev]

I've seen this before and had similar issues.

Instead of re-installing or dropping DB, you can delete all job_ids that 
are stuck.


For example, this is what i would see in my logs.

(1013,VmWorkJobQueue, 2375) is reaching concurrency limit 1
(1013,VmWorkJobQueue, 2375) is reaching concurrency limit 1
(1433,VmWorkJobQueue, 2470) is reaching concurrency limit 1
(1434,VmWorkJobQueue, 2471) is reaching concurrency limit 1
(1475,VmWorkJobQueue, 2483) is reaching concurrency limit 1
(1477,VmWorkJobQueue, 2484) is reaching concurrency limit 1
(1478,VmWorkJobQueue, 596) is reaching concurrency limit 1
(981,VmWorkJobQueue, 2371) is reaching concurrency limit 1

DELETE ALL FROM BELOW:
SELECT * FROM cloud.sync_queue_item where queue_id=981 or queue_id=1478 
or queue_id=1477 or queue_id=1475 or queue_id=1434 or queue_id=1433 or 
queue_id=1013 ;
SELECT * FROM cloud.sync_queue where id=1433 or id=1434 or id=1475 or 
id=1477 or id=1478 or id=981;


While i did SELECT statement, you can alter to DELETE.

Regards
ilya

On 9/16/14, 6:31 PM, Matthew Midgett wrote:

Ugo, I am having an issue just like you. I can deploy the default centos
template but if I try to deploy a iso it looks like its failing in the
network area. I've been reading your emails to Geoff and I have restarted
the network with a clean and that didn't fix my problem. I also restarted
the management servers during this process. I don't know what happed but
ssvm and console quit working. I've spent all day deleting the whole thing
and setting it back up again. Just to find that it's not working.

Now I just saw this in the logs

Cannot delete or update a parent row: a foreign key constraint fails
(`cloud`.`async_job_join_map`, CONSTRAINT
`fk_async_job_join_map__join_job_id` FOREIGN KEY (`join_job_id`) REFERENCES
`async_job` (`id`))

I am running a 2 node haproxy with virtual ip in front of a galera sql
cluster.

I dropped the DB, gave the cloud user more permissions. Deleted everything
and restarted and it's doing this all over again. I am running xenserver 6.2
and acs4.4. I even tried 4.3 again and it started doing the same thing.



-Original Message-
From: Ugo Vasi [mailto:ugo.v...@procne.it]
Sent: Tuesday, September 16, 2014 5:36 AM
To: users@cloudstack.apache.org
Subject: Re: Unable to start a VM due to insufficient capacity

Hi Geoff,
I restarted the network and now I can create new VM without errors.

Now, how can I prevent this issue?




Il 11/09/2014 09:28, Geoff Higginbottom ha scritto:

Hi Ugo,

Did restarting the network with cleanup option resolve your issue last

time, if yes have you tried the same on this network?

Regards

Geoff Higginbottom
CTO / Cloud Architect

D: +44 20 3603 0542 | S: +44 20 3603
0540 | M: +447968161581

geoff.higginbot...@shapeblue.com | www.shapeblue.com |
Twitter:@cloudstackguru

ShapeBlue Ltd, 53 Chandos Place, Covent Garden, London, WC2N
4HS


On 11 Sep 2014, at 08:17, "Ugo Vasi"

mailto:ugo.v...@procne.it>> wrote:

Hi Geoff,
I still have the problem creating new VMs but in another isolated network.

The problem seems to be the same:

2014-09-11 08:55:27,048 DEBUG [c.c.v.VirtualMachineManagerImpl]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM is being created in
podId: 1
2014-09-11 08:55:27,050 DEBUG [o.a.c.e.o.NetworkOrchestrator]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Network id=212 is already
implemented
2014-09-11 08:55:27,118 DEBUG [c.c.n.NetworkModelImpl]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is
not supported in the network id=212
2014-09-11 08:55:27,122 DEBUG [o.a.c.e.o.NetworkOrchestrator]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Changing active number of
nics for network id=212 on 1
2014-09-11 08:55:27,174 DEBUG [o.a.c.e.o.NetworkOrchestrator]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Asking VirtualRouter to
prepare for Nic[116-86-8429f13f-7c3b-4b8a-aea3-9b8e9a3f4c03-10.1.1.19]
2014-09-11 08:55:27,181 DEBUG
[c.c.n.r.VirtualNetworkApplianceManagerImpl]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Lock is acquired for
network id 212 as a part of router startup in
Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Po
ol(Id))] :
Dest[Zone(1)-Pod(1)-Cluster(1)-Host(7)-Storage(Volume(98|ROOT-->Pool(6
))]
2014-09-11 08:55:27,183 DEBUG
[c.c.n.r.VirtualNetworkApplianceManagerImpl]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Lock is released for
network id 212 as a part of router startup in
Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Po
ol(Id))] :
Dest[Zone(1)-Pod(1)-Cluster(1)-Host(7)-Storage(Volume(98|ROOT-->Pool(6
))]
2014-09-11 08:55:27,189 DEBUG [c.c.n.NetworkModelImpl]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is
not supported in the network id=212
2014-09-11 08:55:27,198 DEBUG [c.c.n.NetworkModelImpl]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is
not supported in the network id=212
2014-09-11 08

Re: Upgrade to 4.3.1

[ilya musayev]

Mārtiņš

If you dont get a response here, please post on dev. I'll try this out 
shortly in my env, what version did you upgrade from?


Regards
ilya
On 9/16/14, 6:07 AM, Mārtiņš Jakubovičs wrote:

Hello,

In CentOS 6.5 today I discovered that is available update for CS 4.3. 
I installed it but after management service restart " 
consoleproxy.url.domain" value stopped to work. When I launch console 
proxy, it connect to ".realhostip.com" domain in a way to connect my 
real domain. When I clean this value, console proxy connects to IP. 
After entering any other value it connects to ".realhostip.com" 
anyway. How I can solve this?


Thanks.

Re: DRaaS based on ACS

[ilya musayev]

Adrian,

If i understand the task correctly, you are trying to have replica sets 
across datacenters with ACS functional.


I can think of a solution that does not require heavy investment.

1) you replicate the VM disk content across to datacenter X
2) you replicate db content from cloudstack, you can just fetch the 
content from ACS via APIs and re-load the content into secondary ACS.


Alena from Citrix explained how she did it @ CCNA14 in Denver.

3) needless to say, you IP between datacenters will change, so VMs 
should know how to handle that change


regards
ilya

On 9/10/14, 7:10 AM, Adrian Lewis wrote:

Hi All,



We’re currently looking into the possibility of creating a DR as a service
offering for our customers based on ACS. I’m assuming that trying to create
a fully open source solution is not feasible and am looking to evaluate
Vision Solutions’ Double-Take Cloud Protection and Recovery product. I’m
wondering if anyone knows of any other solutions that would work nicely
with ACS (i.e. client self-service, handling the import of a VM into ACS,
WAN ‘optimised’ communications etc).



 From what I can tell, the main problem with most commercial solutions is
that they assume that they have direct control of the hypervisors,
bypassing ACS completely, and as such would result in creating a VM that
ACS would then not be able to see or therefore manage. They also seem to
assume that there’s a private network between the source and target systems
which can be an issue with multi-tenancy and overlapping IPs between
tenants. I’m initially looking for Xenserver support as well which seems to
be the ugly duckling when it comes to backup and replication – most of the
commercial solutions concentrate on VMware and then Hyper-V.



Does anyone have any experience with either the Double-Take or any other
solutions that they’d care to share? Anyone know of any yet-to-be-released
solutions that might fit the bill?



Many thanks,



Adrian

Re: Strange UI 8080/client/

[ilya musayev]

Try running Chrome Incognito mode to see if its some weirdness with 
jquery. i have had that issue.


On 9/9/14, 10:24 AM, Rohit Yadav wrote:

Hi,

On 09-Sep-2014, at 12:41 pm, Piers  wrote:

One of the key things to me as a user is having dependencies managed by yum/rpm 
which means that when I follow the documented CentOS install I end up with 4.4

I apologise for not being helpful but as a new user there is much to learn and 
if I (or others) encounter undocumented experiences then we are blind to our 
understanding of the software being is grounded or not.

Thanks for taking the time to respond.

Happy to help.

Don’t run tomcat6. Make sure you don’t have both tomcat6 and 
cloudstack-management running, in which case just stop tomcat6 and restart 
management server.

Regards,
Rohit Yadav
Software Architect, ShapeBlue
M. +41 779015219 | rohit.ya...@shapeblue.com
Blog: bhaisaab.org | Twitter: @_bhaisaab



Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build
CSForge – rapid IaaS deployment framework
CloudStack Consulting
CloudStack Infrastructure 
Support
CloudStack Bootcamp Training Courses

This email and any attachments to it may be confidential and are intended solely 
for the use of the individual to whom it is addressed. Any views or opinions 
expressed are solely those of the author and do not necessarily represent those of 
Shape Blue Ltd or related companies. If you are not the intended recipient of this 
email, you must neither take any action based upon its contents, nor copy or show 
it to anyone. Please contact the sender if you believe you have received this email 
in error. Shape Blue Ltd is a company incorporated in England & Wales. 
ShapeBlue Services India LLP is a company incorporated in India and is operated 
under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company 
incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue 
SA Pty Ltd is a company registered by The Republic of South Africa and is traded 
under license from Shape Blue Ltd. ShapeBlue is a registered trademark.

Re: Cloudstack on the front page of Slashdot

[ilya musayev]

This is great, i wish they posted the complete interview! They cut David 
off on the best part of "who uses cloudstack".


On 9/4/14, 2:12 PM, David Bierce wrote:

Looks like it was at LinuxCon a few weeks ago.

http://news.slashdot.org/story/14/09/04/1627233/slashdot-talks-with-david-nalley-about-apache-cloudstack-video

Re: API Response Formats: XML and JSON

[ilya musayev]

You can also try running cloudmonkey and "set display json" - this way 
it prints all the output in json format.


Regards
ilya
On 8/30/14, 12:39 PM, Erik Weber wrote:

On Sat, Aug 30, 2014 at 9:22 PM, Dean Kamali  wrote:


Hey everyone,

According to docs, CloudStack supports two formats as the response to
an API call. The default response is XML. If you would like the
response to be in JSON, add &response=json to the Command String.

I'm using CS 4.4 and when making an API call, I get response in XML
which is okay, however everytime I attempt to add &response=json to an
API call, I get error 401.
{

-
listvirtualmachinesresponse: {

uuidList: [ ]
errorcode: 401
errortext: "unable to verify user credentials and/or request signature"

}



Did you recalculate the signature?

Re: Unable to start a VM due to insufficient capacity

[ilya musayev]

grep ctx-d1e72afb /var/log/cloudstack/management-server.log


Read through to see what happens, or post here...

On 9/1/14, 9:23 AM, abhisek basu wrote:

You may want to review entire flow for job-27, which is related to this 
deployment failure. There are multiple possibilities for this  insufficient 
capacity error.

Sent from my iPhone


On 1 Sep 2014, at 6:49 pm, "Giri Prasad"  wrote:

Hello,

I have installed cs 4.3 on Ubuntu 14.04 LTS.


Created the usual infra, registered a couple of ISO's, and tried to created a 
instance using the ISO, via the gui. Comes out with some error. Any ideas on 
how to fix this?

Thanks & Regards,
Giri
2014-09-01 17:21:26,551 DEBUG [c.c.a.ApiServlet] (catalina-exec-6:ctx-703486f7 ctx-ee65bd67) 
===END===  XXX.XXX.XXX.5 -- GET  
command=queryAsyncJobResult&jobId=1b7d53c6-256a-4721-b69c-d68c1f6d7d42&response=json&sessionkey=e6F89zbOUS4dR2%2FmrkznQBxeQ%2BM%3D&_=1409572286355
2014-09-01 17:21:26,733 ERROR [c.c.a.ApiAsyncJobDispatcher] 
(Job-Executor-6:ctx-d1e72afb) Unexpected exception while executing 
org.apache.cloudstack.api.command.user.vm.DeployVMCmd
com.cloud.utils.exception.CloudRuntimeException: Unable to start a VM due to 
insufficient capacity
at 
com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:605)
at 
org.apache.cloudstack.engine.cloud.entity.api.VMEntityManagerImpl.deployVirtualMachine(VMEntityManagerImpl.java:237)
at 
org.apache.cloudstack.engine.cloud.entity.api.VirtualMachineEntityImpl.deploy(VirtualMachineEntityImpl.java:207)
at 
com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3581)
at 
com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3161)
at 
com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3147)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:622)
at 
org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
at 
org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
at 
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
at 
com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.java:50)
at 
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
at 
org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
at 
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
at 
org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
at com.sun.proxy.$Proxy169.startVirtualMachine(Unknown Source)
at 
org.apache.cloudstack.api.command.user.vm.DeployVMCmd.execute(DeployVMCmd.java:443)
at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:161)
at 
com.cloud.api.ApiAsyncJobDispatcher.runJobInContext(ApiAsyncJobDispatcher.java:109)
at com.cloud.api.ApiAsyncJobDispatcher$1.run(ApiAsyncJobDispatcher.java:66)
at 
org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at 
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at 
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:63)
at 
org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:509)
at 
org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
at 
org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at 
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at 
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at 
org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:701)
Caused by: com.cloud.exception.InsufficientServerCapacityException: Unable to 
crea

Re: Questions regarding the template error message

[ilya musayev]

https://git-wip-us.apache.org/repos/asf?p=cloudstack.git&a=search&h=HEAD&st=grep&s=has+not+been+completely+downloaded+to

On 9/2/14, 7:11 PM, Vibranze Teh wrote:

Dear Lists,



I have a customer asking about an error message thrown in CS management
server and he would like to know answer to the following questions.



a) What places the source code processing to output the error message
exists?
b) And what are the conditions for outputting the error message?

Example of the Log Output:


*2014-08-06 15:36:18,434 WARN
[rest.impl.CloudStackRestApiResponseErrorHandler] (catalina-exec-7:null) CS
errorcode=530 2014-08-06 15:36:18,434 WARN
[rest.impl.CloudStackRestApiResponseErrorHandler] (catalina-exec-7:null) CS
errortext=Template stg-celloy2-vape01-20140731 has not been completely
downloaded to zone 7*



I found the following snippet related to the error above.






















*protected DiskProfile createDiskCharacteristics(VolumeVO volume,
VMTemplateVO template, DataCenterVO dc, DiskOfferingVO diskOffering) { if
(volume.getVolumeType() == Type.ROOT && Storage.ImageFormat.ISO !=
template.getFormat()) { SearchCriteria sc =
HostTemplateStatesSearch.create(); sc.setParameters("id",
template.getId()); sc.setParameters("state",
com.cloud.storage.VMTemplateStorageResourceAssoc.Status.DOWNLOADED);
sc.setJoinParameters("host", "dcId", dc.getId()); List
sss = _vmTemplateHostDao.search(sc, null); if (sss.size() == 0) { throw new
CloudRuntimeException("Template " + template.getName() + " has not been
completely downloaded to zone " + dc.getId()); } VMTemplateHostVO ss =
sss.get(0); return new DiskProfile(volume.getId(), volume.getVolumeType(),
volume.getName(), diskOffering.getId(), ss.getSize(),
diskOffering.getTagsArray(), diskOffering.getUseLocalStorage(),
diskOffering.isRecreatable(), Storage.ImageFormat.ISO !=
template.getFormat() ? template.getId() : null); } else { return new
DiskProfile(volume.getId(), volume.getVolumeType(), volume.getName(),
diskOffering.getId(), diskOffering.getDiskSize(),
diskOffering.getTagsArray(), diskOffering.getUseLocalStorage(),
diskOffering.isRecreatable(), null); } }*



and have the following questions:



1. May I know what is ‘sss’ as in ‘*if (sss.size() == 0)*’? My guess is
it’s something related to secondary storage status and because of the
status is not equal to 0 then it will throw the message of ‘Template X has
not been completely downloaded to zone Y’, mean that it’s still copying and
not 100% completed.

2. And the condition of outputting the error message IMO is when they
are trying to create an instance using that particular template.

Kindly comment if I am wrong.

Thanks.

5.

Re: Management Server won't connect after cluster shutdown and restart

[ilya musayev]

Can you tell us more please.

In my rather large environments, I may need to do several restarts for 
cloudstack to come up properly.


Otherwise it complains that SSVM and CPVM are not ready to launch in Zone X.

Thanks
ilya
On 8/30/14, 5:29 AM, Ian Duffy wrote:

Hi All,

Thank you very much for the help.

Ended up solving the issue. There was an invalid value in our configuration
table which seemed to prevent a lot of DAOs from being autowired.




On 29 August 2014 21:16, Paul Angus  wrote:


Hi Ian,

I've seen this kind of behaviour before with KVM hosts reconnecting.

There’s a select …. WITH UPDATE; query on the op_ha_work table which locks
the table, stopping other hosts updating their status. If there are a lot
of entries in there they all lock each other out. Deleting the entries
fixed the problem, but you have to deal with hosts and vms being up/down
yourself.

So check the op_ha_work table for lots of entries which can lock up the
database. If you can check the database for the queries that it's handling
- that would be best.

Also check that the management server and MySQL DB is tuned for the load
that being thrown at it.
(http://support.citrix.com/article/CTX132020)
Remember if you have other services such as Nagios or puppet/chef directly
reading the DB, that adds to the number of connections into the mysql db -
I have seen the management server starved of mysql connections when a lot
of hosts are brought back online.


Regards

Paul Angus
Cloud Architect
S: +44 20 3603 0540 | M: +447711418784 | T: CloudyAngus
paul.an...@shapeblue.com

-Original Message-
From: create...@gmail.com [mailto:create...@gmail.com] On Behalf Of
Carlos Reategui
Sent: 29 August 2014 20:55
To: users@cloudstack.apache.org
Subject: Re: Management Server won't connect after cluster shutdown and
restart

Hi Ian,

So the root of the problem was that the machines where not started up in
the correct order.

My plan had been to stop all VMs from CS, then stop CS, then shutdown the
VM hosts.  On the other end the hosts needed to be brought up first and
once they are ok then bring up the CS machine and make sure everything was
in the same state it thought things were when it was shutdown.
  Unfortunately CS came up before everything else was the way it expected
it to be and I did not realize that at the time.

To resolve I went back to my CS db backup from right after I shut it down
the MS, made sure the VM hosts were all as expected and then started the MS.






On Fri, Aug 29, 2014 at 8:02 AM, Ian Duffy  wrote:


Hi carlos,

Did you ever find a fix for this?

I'm seeing a same issue on 4.1.1 with Vmware ESXi.


On 29 October 2013 04:54, Carlos Reategui  wrote:


Update.  I cleared out the async_job table and also reset the system
vms

it

thought where in starting mode from my previous attempts by setting
them

to

Stopped from starting.  I also re-set the XS pool master to be the
one XS thinks it is.

Now when I start the CS MS here are the logs leading up to the first
exception about the Unable to reach the pool:

2013-10-28 21:27:11,040 DEBUG [cloud.alert.ClusterAlertAdapter]
(Cluster-Notification-1:null) Management server node 172.30.45.2 is
up, send alert

2013-10-28 21:27:11,045 WARN  [cloud.cluster.ClusterManagerImpl]
(Cluster-Notification-1:null) Notifying management server join event

took 9

ms

2013-10-28 21:27:23,236 DEBUG [cloud.server.StatsCollector]
(StatsCollector-2:null) HostStatsCollector is running...

2013-10-28 21:27:23,243 DEBUG [cloud.server.StatsCollector]
(StatsCollector-3:null) VmStatsCollector is running...

2013-10-28 21:27:23,247 DEBUG [cloud.server.StatsCollector]
(StatsCollector-1:null) StorageCollector is running...

2013-10-28 21:27:23,255 DEBUG [cloud.server.StatsCollector]
(StatsCollector-1:null) There is no secondary storage VM for
secondary storage host nfs://172.30.45.2/store/secondary

2013-10-28 21:27:23,273 DEBUG [agent.manager.ClusteredAgentAttache]
(StatsCollector-2:null) Seq 1-201916421: Forwarding null to

233845174730255

2013-10-28 21:27:23,274 DEBUG [agent.manager.ClusteredAgentAttache]
(AgentManager-Handler-9:null) Seq 1-201916421: Routing from

233845174730253

2013-10-28 21:27:23,275 DEBUG [agent.manager.ClusteredAgentAttache]
(AgentManager-Handler-9:null) Seq 1-201916421: Link is closed

2013-10-28 21:27:23,275 DEBUG
[agent.manager.ClusteredAgentManagerImpl]
(AgentManager-Handler-9:null) Seq 1-201916421: MgmtId 233845174730253:

Req:

Resource [Host:1] is unreachable: Host 1: Link is c

losed

2013-10-28 21:27:23,275 DEBUG
[agent.manager.ClusteredAgentManagerImpl]
(AgentManager-Handler-9:null) Seq 1--1: MgmtId 233845174730253: Req:
Routing to peer

2013-10-28 21:27:23,277 DEBUG
[agent.manager.ClusteredAgentManagerImpl]
(AgentManager-Handler-11:null) Seq 1--1: MgmtId 233845174730253: Req:
Cancel request received

2013-10-28 21:27:23,277 DEBUG [agent.manager.AgentAttache]
(AgentManager-Handler-11:null) Seq 1-201916421: Cancelling.

2013-10-28 21:27:23,277 DEBUG [agent

Re: Recovering from failed install - [SOLVED]

[ilya musayev]

Thanks for posting back your solution.

On 8/27/14, 3:14 PM, Piers wrote:

For the benefit of others:

I have been installing, wiping and reinstalling ACS for a couple of 
days now.


I get the impression that an initial install created network 
configurations that were incompatible with re-installation. An 
indicator of this was the output line in


cloudstack-setup-managment

# I dont use 169.254.0.1
Detected local IP address as 169.254.0.1, will use as cluster 
management server node IP[ OK ]


# X.X.X.X is my real IP
Detected local IP address as X.X.X.X, will use as cluster management 
server node IP[ OK ]



The only way things worked was removing the network settings by 
commenting out the bridge line in ifcfg-eth0 and manually deleting the 
bridges:


[root@vhost2 images]# brctl show
bridge namebridge idSTP enabledinterfaces
cloud08000.no
cloudbr08000.003048fc6bb4noeth0
virbr08000.yes


[root@vhost2 images]# brctl delbr cloud0
[root@vhost2 images]# brctl delbr cloudbr0
[root@vhost2 images]# brctl show


bridge namebridge idSTP enabledinterfaces
virbr08000.yes


[root@vhost2 images]# service network restart

I know have a working web UI and the SSVM nodes started and all looks 
good.


My advice to anyone having trouble is:

- Make sure you wipe everything before starting
- set keepcache=1 in yum.conf  (so you dont keep downloading the same 
packages over and over)
- down load the image using wget and us the -f option to decompress it 
/usr/share/cloudstack-common/scripts/storage/secondary/cloud-install-sys-tmplt

- purge the SQL databases
- check and remove the network interfaces - NOTE: I use two NIC's so 
that if I kill the public IP I can connect from the next server in the 
rack


Hopefully this helps some else / feel free to correct or criticise 
anything I have said in error


Cheers

Piers

Re: ACS in a VMware environment

[ilya musayev]

Xerex

I've just rebuild cloudstack. I had no issues with this build. no 404s.

http://download.cloudsand.com/cloudsand/rhel/6/x86_64/cloudstack-4.3.0.1-08282014.rpm.tgz

Regards
ilya
On 8/27/14, 2:31 PM, Xerex Bueno wrote:
> Ilya,
>
> I have installed from the packages you provided.  However I am running
> into a 404 error when I try and access the Web UI.  Have you experienced
> this issue?
>
>
>
>
>
> On 8/20/14, 10:23 AM, "Xerex Bueno"  wrote:
>
>> Thanks for the info and the link.  I will give it a shot.
>>
>>
>>
>>
>>
>> On 8/19/14, 3:46 PM, "ilya musayev"  wrote:
>>
>>> Xerex,
>>>
>>> Dont use forward branch, you need to use 4.3 under "heads".
>>>
>>> example: git checkout remotes/origin/4.3
>>>
>>> 16 servers is rather small. I've just completed a rebuild of 4.3.0.1
>> >from source (includes noredist packages).
>>> http://download.cloudsand.com/cloudsand/rhel/6/x86_64/cloudstack-4.3.0.1-
>>> 0
>>> 8192014.rpm.tgz
>>>
>>> There are few patches that help with vmware connection pool/threads,
>>> they haven't been committed yet by Citrix dev.
>>>
>>> I have many smaller environments and i would not see any issues there
>>> without the mentioned fix. However, in larger environments where
>>> hypervisor count goes into hundreds, this issue will be more prominent.
>>>
>>> Regards
>>> ilya
>>>
>>>
>>>
>>>
>>>
>>>
>>> On 8/18/14, 7:36 PM, Xerex Bueno wrote:
>>>> It is going to start with a max of 16 servers and I don¹t see it
>>>> utilizing
>>>> more then four servers to start with.  As for the 4.3.1 source code, is
>>>> that under Github 4.3.0 forward?  Also do I still need to compile it
>>>> with
>>>> -NoRedist and the vmware .jar files?
>>>>
>>>>
>>>>
>>>>
>>>> On 8/18/14, 3:27 PM, "ilya musayev" 
>>>> wrote:
>>>>
>>>>> Xerex
>>>>>
>>>>> You want the latest 4.3.0.1 (aka 4.3.1), build it from source. There
>>>>> are
>>>>> few patches that haven't been committed upstream yet, but they address
>>>>> a
>>>>> specific issue witnessed only on large vmware envs.
>>>>>
>>>>> Depending on how large is your environment, you may want to tweak the
>>>>> java heap size and additional settings limit.conf
>>>>>
>>>>> What size of env do you have in mind?
>>>>>
>>>>> Regards
>>>>> ilya
>>>>>
>>>>> On 8/18/14, 9:40 AM, Xerex Bueno wrote:
>>>>>> My question for the group is I want to deploy a very stable version
>>>>>> of
>>>>>> ACS into an environment running Vmware with standard vSwitches.  What
>>>>>> version would you recommend?
>>>>>>
>>>>>> 
>>>>>>
>>>>>> This document is PROPRIETARY and CONFIDENTIAL and may not be
>>>>>> duplicated, redistributed, or displayed to any other party without
>>>>>> the
>>>>>> expressed written permission of LPS Integration, Inc. If you are not
>>>>>> the
>>>>>> intended recipient and have received this email in error, please
>>>>>> destroy
>>>>>> the email and contact the LPS Integration Security Officer at
>>>>>> 866-577-2902 (Phone), 615-349-9009 (Fax) or 230 Great Circle Rd.
>>>>>> Suite
>>>>>> 218 Nashville, TN 37228 (US Mail)
>>>>>>
>>>>>>
>>>> 
>>>>
>>>> This document is PROPRIETARY and CONFIDENTIAL and may not be
>>>> duplicated, redistributed, or displayed to any other party without the
>>>> expressed written permission of LPS Integration, Inc. If you are not the
>>>> intended recipient and have received this email in error, please destroy
>>>> the email and contact the LPS Integration Security Officer at
>>>> 866-577-2902 (Phone), 615-349-9009 (Fax) or 230 Great Circle Rd. Suite
>>>> 218 Nashville, TN 37228 (US Mail)
>>>>
>>
>> 
>>
>> This document is PROPRIETARY and CONFIDENTIAL and may not be duplicated,
>> redistributed, or displayed to any other party without the expressed
>> written permission of LPS Integration, Inc. If you are not the intended
>> recipient and have received this email in error, please destroy the email
>> and contact the LPS Integration Security Officer at 866-577-2902 (Phone),
>> 615-349-9009 (Fax) or 230 Great Circle Rd. Suite 218 Nashville, TN 37228
>> (US Mail)
>>
>
> 
>
> This document is PROPRIETARY and CONFIDENTIAL and may not be duplicated, 
> redistributed, or displayed to any other party without the expressed written 
> permission of LPS Integration, Inc. If you are not the intended recipient and 
> have received this email in error, please destroy the email and contact the 
> LPS Integration Security Officer at 866-577-2902 (Phone), 615-349-9009 (Fax) 
> or 230 Great Circle Rd. Suite 218 Nashville, TN 37228 (US Mail)
>

Re: 404 Web Interface Not Showing -- 404 or blank screen

[ilya musayev]

Did you also do cloudstack-setup-database?

You dont need to start tomcat.

i assume you used a proper url to access cloudstack which is 
http://my-mgmt-ip:8080/client



On 8/26/14, 6:32 PM, Piers wrote:

On White screen:

2014-08-27 10:46:26,552 INFO [o.a.c.s.l.CloudStackExtendedLifeCycle] 
(main:null) Running system integrity checker 
org.apache.cloudstack.utils.identity.ManagementServerNode@60472888



Try again and get 404

HTTP Status 404 -

type Status report

message

description The requested resource () is not available.
Apache Tomcat/6.0.24

[root@host2 ~]# /etc/init.d/cloudstack-agent stop
Stopping Cloud Agent:
[root@host2 ~]# /etc/init.d/cloudstack-management stop
Stopping cloudstack-management:[  OK ]
[root@host2 ~]# cloudstack-setup-management
Starting to configure CloudStack Management Server:
Configure sudoers ... [OK]
Configure Firewall ...[OK]
Configure CloudStack Management Server ...[OK]
CloudStack Management Server setup is Done!
[root@host2 ~]# cloudstack-setup-agent
Welcome to the CloudStack Agent Setup:
Please input the Management Server Hostname/IP-Address:[x.x.x.x]
Please input the Zone Id:[1]
Please input the Pod Id:[1]
Please input the Cluster Id:[1]
Please choose which network used to create VM:[cloudbr0]
Starting to configure your system:
Configure Cgroup ...  [OK]
Configure SElinux ... [OK]
Configure Network ... [OK]
Configure Libvirt ... [OK]
Configure Firewall ...[OK]
Configure Nfs ... [OK]
Configure cloudAgent ...  [OK]
CloudStack Agent setup is done!
[root@host2 ~]# /etc/init.d/cloudstack-management start
Starting cloudstack-management:[  OK ]
[root@host2 ~]# /etc/init.d/cloudstack-agent start
Starting Cloud Agent:
[root@host2 ~]# service tomcat6 stop
Stopping tomcat6:  [  OK ]
[root@host2 ~]# service tomcat6 start
Starting tomcat6:  [  OK ]


2014-08-27 10:58:26,347 DEBUG [o.a.c.s.l.r.RegistryLifecycle] 
(main:null) Registered com.cloud.server.ManagementServerImpl@4ce38314
2014-08-27 10:58:26,486 INFO [o.a.c.s.l.CloudStackExtendedLifeCycle] 
(main:null) Running system integrity checker 
com.cloud.upgrade.DatabaseIntegrityChecker@63186b51
2014-08-27 10:58:26,487 INFO  [c.c.u.DatabaseIntegrityChecker] 
(main:null) Grabbing lock to check for database integrity.
2014-08-27 10:58:26,488 INFO  [c.c.u.DatabaseIntegrityChecker] 
(main:null) Performing database integrity check
2014-08-27 10:58:26,491 DEBUG [c.c.u.DatabaseIntegrityChecker] 
(main:null) No duplicate hosts with the same local storage found in 
database
2014-08-27 10:58:26,495 DEBUG [c.c.u.d.VersionDaoImpl] (main:null) 
Checking to see if the database is at a version before it was the 
version table is created
2014-08-27 10:58:26,498 INFO [o.a.c.s.l.CloudStackExtendedLifeCycle] 
(main:null) Running system integrity checker 
org.apache.cloudstack.utils.identity.ManagementServerNode@227c9c43
2014-08-27 10:58:31,241 INFO  [c.c.u.c.ComponentContext] (main:null) 
Configuring 
com.cloud.bridge.persist.dao.CloudStackAccountDaoImpl_EnhancerByCloudStack_4db1ab80
2014-08-27 10:58:31,245 INFO  [c.c.u.c.ComponentContext] (main:null) 
Configuring 
com.cloud.bridge.persist.dao.OfferingDaoImpl_EnhancerByCloudStack_e2bc1ada
2014-08-27 10:58:31,245 INFO  [c.c.u.c.ComponentContext] (main:null) 
Configuring 
com.cloud.bridge.persist.dao.SMetaDaoImpl_EnhancerByCloudStack_ff630ad2
2014-08-27 10:58:31,245 INFO  [c.c.u.c.ComponentContext] (main:null) 
Configuring 
com.cloud.bridge.persist.dao.UserCredentialsDaoImpl_EnhancerByCloudStack_a064d5f1
2014-08-27 10:58:31,245 INFO  [c.c.u.c.ComponentContext] (main:null) 
Configuring 
com.cloud.bridge.persist.dao.MultipartMetaDaoImpl_EnhancerByCloudStack_e6cb8d91
2014-08-27 10:58:31,246 INFO  [c.c.u.c.ComponentContext] (main:null) 
Configuring 
com.cloud.bridge.persist.dao.CloudStackConfigurationDaoImpl_EnhancerByCloudStack_e971daf
2014-08-27 10:58:31,246 INFO  [c.c.u.c.ComponentContext] (main:null) 
Configuring 
com.cloud.bridge.persist.dao.BucketPolicyDaoImpl_EnhancerByCloudStack_66318774
2014-08-27 10:58:31,246 INFO  [c.c.u.c.ComponentContext] (main:null) 
Configuring 
com.cloud.bridge.persist.dao.SObjectItemDaoImpl_EnhancerByCloudStack_4a443f3d
2014-08-27 10:58:31,246 INFO  [c.c.u.c.ComponentContext] (main:null) 
Configuring 
com.cloud.bridge.persist.dao.MHostMountDaoImpl_EnhancerByCloudStack_9f47734c
2014-08-27 10:58:31,246 INFO  [c.c.u.c.ComponentContext] (main:null) 
Configuring 
com.cloud.bridge.persist.dao.MHostDaoImpl_EnhancerByCloudStack_112f958d
2014-08-27 10:58:31,247 INFO  [c.c.u.c.ComponentContext] (main:null) 
Configuring 
com.cloud.bridge.persist.dao.MultiPartUploadsDaoImpl_EnhancerByCloudStack_cca43aba
2014-08-27 10:58:31,247 INFO  [c.c.u.c.ComponentContext] (main:null) 
Configuring 
com.cloud.bridge.persist.dao.SBucketDaoImpl_EnhancerByCloudStack_9de07785
2014-08-27 10:58:3

Re: cloud.keystore

[ilya musayev]

Michael

Thanks for sharing.

Regards
ilya
On 8/25/14, 8:22 PM, Michael Phillips wrote:

In case anyone runs into the issue of cloud.keystore not being created on install on cloudstack, you can do the 
following. Stop cloudstack, run the following command keytool -genkey -keystore 
/etc/cloudstack/management/cloudmanagementserver.keystore -storepass vmops.com -keypass vmops.com -keyalg RSA -validity 
3650 -dname cn="CloudstackUser",ou="Your Server FQDN",o="Your Server 
FQDN",c="Unknown", then restart cloudstack.
According to the developers this issue will be fixed in 4.5 

Re: CloudStack MS wont start post db outage

[ilya musayev]

Nope, thats not the case :(
On 8/25/14, 3:16 PM, Carlos Reátegui wrote:

Here’s a shot in the dark….
Any chance there are duplicate entries in the mshost table for your MS?

On Aug 25, 2014, at 1:50 PM, ilya musayev  wrote:


I'm experiencing an issue with bringing up one of 2 management hosts due to db 
outage.

Sample layout:
Host A - had running MS
Host B - MS was down due to maintenance
Host C - dedicated database host

The database outage occurred on host C and cloudstack ms gracefully stopped it 
self. As a result, i'm not able to bring up the Host A, but i could start MS on 
Host B.

IIRC, there was something cloudstack was doing to replay the uncommitted 
transactions or possible kept some cached files that prevent Host A from 
starting.

Would anyone know where it may be and what can be purged from the Host A to 
bring it up?

Thanks
ilya

CloudStack MS wont start post db outage

[ilya musayev]

I'm experiencing an issue with bringing up one of 2 management hosts due 
to db outage.


Sample layout:
Host A - had running MS
Host B - MS was down due to maintenance
Host C - dedicated database host

The database outage occurred on host C and cloudstack ms gracefully 
stopped it self. As a result, i'm not able to bring up the Host A, but i 
could start MS on Host B.


IIRC, there was something cloudstack was doing to replay the uncommitted 
transactions or possible kept some cached files that prevent Host A from 
starting.


Would anyone know where it may be and what can be purged from the Host A 
to bring it up?


Thanks
ilya

Re: acs 4.4 and GUI madness

[ilya musayev]

Andrei

4.4 has some quirks, unless you have a specific reason, i'd suggest you 
remain in 4.3 until 4.4.1 is out.


In the meantime, please log this issue and include a screenshot of what 
you are seeing - so it can get addressed in the next release.


Thanks
ilya

On 8/25/14, 1:30 PM, Andrei Mikhailovsky wrote:

Hello guys,

I've had a few issues with the acs 4.4 GUI and I am wondering if anyone else is 
noticing it as well? It seems like things are all over the place and do not fit 
in their pre-defined areas. Things like Dashboard is messed up and firewall 
rules are practically unusable. I am noticing it throughout the application. I 
am using Chrome, but Firefox is having the same issues.

Did something go wrong during the update?

Andrei

Re: CS 4.4: openvswitch network service providers (plugins)

[ilya musayev]

Vadim

I know this response is not helpful, but please kindly log this issue 
under https://issues.apache.org/jira/browse/CLOUDSTACK/


Thanks
ilya

On 8/25/14, 6:47 AM, Vadim Kimlaychuk wrote:

Hello all,

 I am using OpenVswitch to configure birdges and want to enable 
plugin for it.  At CS 4.4 there are 2 plugins with the same name: one is „Ovs“ 
the other is „OVS“.  When I try to enable „OVS“ - it does nothing and 
management server log is empty. When I try to enable „Ovs“ it shows error:

Api Discovery plugin was unable to find an api by that name or process any apis

Is there any prerequisites to enabe this plug-in ?  Or is this a bug, because 
at  CS4.3 I didn’t have any problems activating Ovs.

Thanks,

Vadim Kimlaychuk

Re: Problem in running marvin

[ilya musayev]

Sandeep

This question is better suited for developers mailing list - in case you 
don't get a response here.


Regards
ilya
On 8/22/14, 8:16 AM, sandeep khandekar wrote:

Dear cloudstackers,

I am trying to run the following command

http://docs.cloudstack.apache.org/en/master/developer_guide.html#installing-from-source


under section using simulator
* mvn -Pdeveloper,marvin.setup
-Dmarvin.config=/home/cloudstack/cloudstack/setup/dev/basic.cfg -pl
:cloud-marvin integration-test*

I get the following error
Traceback (most recent call last):
   File "deployAndRun.py", line 24, in 
 from marvinInit import MarvinInit
   File "/home/cloudstack/cloudstack/tools/marvin/marvin/marvinInit.py",
line 28, in 
 from marvin import configGenerator
*ImportError: No module named marvin*
[INFO]

[INFO] BUILD FAILURE
[INFO]

[INFO] Total time: 9.677s
[INFO] Finished at: Fri Aug 22 20:42:50 IST 2014
[INFO] Final Memory: 30M/306M
[INFO]

[ERROR] Failed to execute goal
org.codehaus.mojo:exec-maven-plugin:1.2.1:exec (pre-integration-test) on
project cloud-marvin: Command execution failed. Process exited with an
error: 1 (Exit value: 1) -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions,
please read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException

Thankyou.

Re: The server refused the connection

[ilya musayev]

Not certain what hypervisors you are using or what version of ACS you 
have installed, but in general, here is the flow and things you need to 
check:


1) When you launch a console session to guest VM through cloudstack UI, 
the call goes out to Console Proxy VM over port 3922 with private key 
(try connecting to this port from Management Server (aka MS) to Console 
Proxy VM (aka CPVM)
2) CPVM responds to cloudstack on port 8250 - make this works, you can 
connect to console proxy vm over 3922 (ssh session) and telnet or netcat 
to MS on 8250
3) The call from CPVM goes out to your hypervisor which tries to 
establish a VNC session, typically ports are 5900+ (this behavior varies 
for different hypervisors but start with 5900+ or 59000+) If you have a 
firewall blocking this communicaton, you should see a time_wait 
connection when you run "netstat -antup" on CPVM
4) If VNC is established in step "3", the response comes back to your 
browser over SSL "443" unless you dont have ssl enabled, then it would 
be 80.


Troubleshooting

1) make sure that console proxy vm is deployed and functional, you can 
see it under system vms tab.
2) you can try rebooting to see if it helps - or you can try to identify 
the root cause by doing following - read on..



Establish 4 SSH connections, 2 to MS and 2 to CPVM
For MS,
1) In first terminal run "watch 'netstat -antup' " - look for any 
time_wait or other unsuccessful connection issues
2) In second terminal run "tail -f 
/var/log/cloudstack/management/management-server.log", look for any 
ERRORs, make sure to read 10-20 lines above the error to understand what 
the problem is


For CPVM
1) In first terminal run "watch 'netstat -antup' " - look for any 
time_wait or other unsuccessful connection issues
2) 2) In second terminal run "tail -f /var/log/cloud/cloud.out" or "tail 
-f /var/log/cloud.out", look for any ERRORs, make sure to read 10-20 
lines above the error to understand what the problem is


If its not apparent then, post the logs to some site and share the link 
with time as to when you executed the command. Make sure to include your 
ACS version, Hypervisors type, network setup, anything else you feel 
should be mentioned.


Regards
ilya


On 8/22/14, 3:52 AM, sandeep khandekar wrote:

Dear Cloudstackers,

After logging into cloudstack UI as admin, from a local computer.
when I try to  open the console, it shows connection refused. Unable to
open any of the (centos,system vm,ubuntu) consoles from remote machines.
 From Local machine(mangement server) didnt tried as centos got installed in
non-gui mode.

How to solve these problem?

Does any one knows the doc links for such issues.