Re: CloudStack Collab in Brazil

[Tim Mackey]

Gabriel,

I'm happy to help review proposals if required.

-tim

On Wed, Dec 19, 2018 at 12:35 PM Gabriel Beims Bräscher <
gabrasc...@gmail.com> wrote:

> Hi Rafael,
>
> I am available to help, count on me!
> I have one question. Can anyone (one that is not a PMC/Committer) help to
> review presentations?
>
> The divisions for the CFP looks good, adding security aspects as Ricardo
> Makino proposed is also interesting.
>
> Regards,
> Gabriel.
>
> Em qua, 19 de dez de 2018 às 11:12, Cristian Latapiat 
> escreveu:
>
> > Hi Rafael ,
> >
> > I am, therefore, available to collaborate and to help you in everything
> > that may be necessary.
> >
> > Regards,
> >
> > Cristian
> >
> > Em seg, 17 de dez de 2018 às 18:49, Rafael Weingärtner <
> > rafaelweingart...@gmail.com> escreveu:
> >
> > > Hey guys,
> > >
> > > Have you guys had time to read through this e-mail? Are there
> volunteers
> > to
> > > help us make CCC happen in Brazil? We need to provide them the topics
> of
> > > tracks that we will be participating until 21/12/2018.
> > >
> > > On Thu, Dec 13, 2018 at 7:11 PM Rafael Weingärtner <
> > > rafaelweingart...@gmail.com> wrote:
> > >
> > > > Hello CloudStackers,
> > > >
> > > > I had a few meetings with the TDC folks, and we seem to be moving on.
> > > They
> > > > have a slightly different organization than ApacheCon though.
> > Therefore,
> > > we
> > > > were asked to provide them with some “track topics” that fit in the
> > area
> > > of
> > > > Cloud Computing. Then, we could direct presentations to one of these
> > > > tracks. The idea is that the international tracks (the ones that will
> > be
> > > in
> > > > English) will not be parallelized to enable the audience to attend
> all
> > of
> > > > them (this means, one for each day). Also, the tracks will receive
> > > > presentations from other people that are not in our bubble, and this
> is
> > > > great (at least I found this awesome), because different people with
> > > > different backgrounds would come together on the same track, which in
> > > turn
> > > > means, people that might not know ACS would have the opportunity not
> > just
> > > > to meet the solution, but also the people behind it.
> > > >
> > > > So, this is what I have in mind:
> > > >
> > > >- Cloud computing (area/topic)
> > > >   - cloud orchestration -- this would be the track where topics
> > > >   regarding features, and cloud orchestration systems (e.g.
> > > CloudStack)
> > > >   design and structure would be presented
> > > >   - DevOps -- track for presentations that address the day-to-day
> > of
> > > >   CloudStack (or OpenStack) developers and the daily life of
> > > operators with
> > > >   tasks such as debugging and troubleshooting
> > > >   - tests -- track for discussing the Q&A process and testing
> > methods
> > > >   for clouds
> > > >   - cloud open source ecosystem -- track focusing on the cloud
> > > >   ecosystem, where people can address things relating the job
> > market,
> > > >   business opportunities, and the management process of highly
> > > heterogeneous
> > > >   and distributed communities in OpenSource (such as CloudStack)
> > > >
> > > >
> > > > What do you guys think of these divisions for the CFP?
> > > > Also, we might need help to review and select presentation proposals.
> > > > Would some of you guys be willing to help on this process?
> > > >
> > > > And last, but not least, it would be awesome if companies linked to
> ACS
> > > > are interested to be the sponsors of tracks or the event. They have
> > sent
> > > me
> > > > the brochure and sponsorship prospects from 2018 so we can get to
> know
> > > > better the conference [1]. The attendance report and prospectus are
> in
> > > > English, and for instance, in 2018 the TDC event in Florianopolis
> > (where
> > > we
> > > > are proposing to have CCC in 2019) received about 4000 people. The
> > > > sponsorship prospectus for 2019 events is being prepared, and I guess
> > if
> > > > there are interested parties on this, you can reach them directly, or
> > if
> > > > you have some problems to do that, I can help you guys as well.
> > > >
> > > > [1]
> > > >
> > >
> >
> https://www.dropbox.com/sh/53ujp2usf402dlj/AAA1a2jZPddGcAT8ZosRiGCAa?dl=0
> > > >
> > > > On Wed, Oct 24, 2018 at 8:16 PM Tutkowski, Mike <
> > > mike.tutkow...@netapp.com>
> > > > wrote:
> > > >
> > > >> Thanks, Rafael!
> > > >>
> > > >> The dates work for me.
> > > >>
> > > >> Get Outlook for iOS
> > > >> 
> > > >> From: Rafael Weingärtner 
> > > >> Sent: Wednesday, October 24, 2018 5:02:14 PM
> > > >> To: users
> > > >> Cc: dev
> > > >> Subject: Re: CloudStack Collab in Brazil
> > > >>
> > > >> NetApp Security WARNING: This is an external email. Do not click
> links
> > > or
> > > >> open attachments unless you recognize the sender and know the
> content
> > is
> > > >> safe.
> > > >>
> > > >>
> > > >>
> > > >>
> 

Re: CloudStack Collab in Brazil

[Tim Mackey]

oceed with proposing the topics as follows.
> > > >
> > > >- Cloud computing (area/topic)
> > > >   - cloud orchestration -- this would be the track where topics
> > > >   regarding features, and cloud orchestration systems (e.g.
> > > CloudStack)
> > > >   design and structure would be presented
> > > >   - DevOps -- track for presentations that address the day-to-day
> > of
> > > >   CloudStack (or OpenStack) developers and the daily life of
> > > operators with
> > > >   tasks such as debugging and troubleshooting
> > > >   - tests -- track for discussing the Q&A process and testing
> > methods
> > > >   for clouds
> > > >   - cloud open source ecosystem -- track focusing on the cloud
> > > >   ecosystem, where people can address things relating the job
> > market,
> > > >   business opportunities, and the management process of highly
> > > heterogeneous
> > > >   and distributed communities in OpenSource (such as CloudStack)
> > > >   - cloud security – track for discussing and presenting security
> > > >   aspects in cloud computing; privacy issues (GDPR), DDoS and
> QoS,
> > > and so on.
> > > >
> > > >
> > > > Again, thank you very much for your inputs. I will now proceed to
> > propose
> > > > the tracks, and then I will get back to you guys to define a date to
> > set
> > > a
> > > > call, so we can discuss this further with TDC’s tracks coordinators
> > > >
> > > >
> > > > On Wed, Dec 19, 2018 at 4:27 PM Marco Sinhoreli <
> > > > marco.sinhor...@shapeblue.com> wrote:
> > > >
> > > >> I am available to help since I am in Brazil and I have in local
> > > community
> > > >> many ACS users that want to talk in CCC.
> > > >>
> > > >> Also, Makino and Cristian are involved a long time with CloudStack
> and
> > > >> they can help us to have a great event!
> > > >>
> > > >> Best regards,
> > > >>
> > > >> Marco Sinhoreli
> > > >> Latam Technical Director
> > > >> marco.sinhor...@shapeblue.com
> > > >> mobile: +55 21 98276 3636
> > > >>
> > > >> Av. Brigadeiro Faria Lima, 3144 - 2º andar – Jardim
> > > >> Paulistano, São Paulo, SP, Brasil, 01451-000
> > > >> Phone: + 55 11 3568-2877
> > > >> http://www.shapeblue.com/ | twitter: @shapeblue
> > > >>
> > > >> Em 19/12/2018 15:55, "Tim Mackey"  escreveu:
> > > >>
> > > >> Gabriel,
> > > >>
> > > >> I'm happy to help review proposals if required.
> > > >>
> > > >> -tim
> > > >>
> > > >> On Wed, Dec 19, 2018 at 12:35 PM Gabriel Beims Bräscher <
> > > >> gabrasc...@gmail.com> wrote:
> > > >>
> > > >> > Hi Rafael,
> > > >> >
> > > >> > I am available to help, count on me!
> > > >> > I have one question. Can anyone (one that is not a
> > PMC/Committer)
> > > >> help to
> > > >> > review presentations?
> > > >> >
> > > >> > The divisions for the CFP looks good, adding security aspects
> as
> > > >> Ricardo
> > > >> > Makino proposed is also interesting.
> > > >> >
> > > >> > Regards,
> > > >> > Gabriel.
> > > >> >
> > > >> > Em qua, 19 de dez de 2018 às 11:12, Cristian Latapiat <
> > > >> latap...@gmail.com>
> > > >> > escreveu:
> > > >> >
> > > >> > > Hi Rafael ,
> > > >> > >
> > > >> > > I am, therefore, available to collaborate and to help you in
> > > >> everything
> > > >> > > that may be necessary.
> > > >> > >
> > > >> > > Regards,
> > > >> > >
> > > >> > > Cristian
> > > >> > >
> > > >> > > Em seg, 17 de dez de 2018 às 18:49, Rafael Weingärtner <
> > > >> > > raf

[DISCUSS] XCP usage with CloudStack

[Tim Mackey]

A little bit ago there was a thread started on the dev list about XCP and
CloudStack.  I've had a bit of a think about this if you're using XCP I
would like to understand better how XCP, and by extension the XAPI
toolstack when *not* part of XenServer, is deployed in your environments.
If XCP/XAPI users can answer these three questions, it would help in
understanding how to best handle XCP moving forward.

1. What OS/version are you using for dom0 and with what hypervisor version?

2. How did you deploy XCP (from pre-compiled ISO, built from source,
package source i.e yum/apt-get, xenserver-core packages, something else)

3. How are you handling updates to the XCP/Xen/XAPI components,
particularly those of a security nature?

While the XAPI toolstack as part of XenServer receives significant
development and QA attention, the same can't be said for legacy XCP and
pure XAPI.  There are also assumptions made for XenServer which aren't
always valid in a legacy XCP or general XAPI installation.  What I'm trying
to figure out is if we need to address any issues, and if so what the
impact might be.

Thanks

-tim

Re: [DISCUSS] XCP usage with CloudStack

[Tim Mackey]

Thanks Rafael.

I'll check to see what the maintenance status is for xcp-xapi with Debian
when I get back to the office on Monday.  I do recall there being issues
raised last summer.

One of the reasons the question I've asked is so important has to do with
CloudStack assumptions in a XenServer environment.  For example, it doesn't
directly issue xe commands, but uses both the Java and Python xapi
bindings, and has a number of supporting scripts which assume package
versions which match those of specific XenServer releases.

btw, by way of disclosure, I'm the XenServer community manager and have
acquired a pretty decent level of expertise with things Xen, XCP, XAPI and
XenServer since joining the team in 2008.  Here's a google search for me:
https://www.google.com/webhp?sourceid=chrome-instant&ion=1&espv=2&ie=UTF-8#q=tim%20mackey%20xenserver


Oh, and I'm grinning as I write this since I suspect some colleagues will
kid me over you educating me.  No harm, and no offense.  I guess I'm not as
well known as I thought ;)

-tim



On Fri, Apr 17, 2015 at 5:21 PM, Rafael Weingartner <
rafaelweingart...@gmail.com> wrote:

> UPDATE:
> you can find more on Xenserver and XCP here:
> http://pt.slideshare.net/xen_com_mgr/xpus13-pavlicek
>
> On Fri, Apr 17, 2015 at 4:12 PM, Rafael Weingartner <
> rafaelweingart...@gmail.com> wrote:
>
> > Dear Tim Mackey,
> >
> > I have a production environment using XCP (XAPI). As far as I know, the
> > difference between the use of XAPI and Xenserver is that Xenserver is an
> OS
> > bundled altogether with a version of Xen hypervisor, XAPI and some
> > management tools. While, XAPI is just the API used to consolidate
> workloads
> > and interact with the Xen hypervisor hosts.
> >
> > At the end, Xenserver environments are using the Xen hypervisor and XAPI
> > toolstack. The difference is that it comes pre-built with an OS
> (CentOS?).
> >
> > When Cloudstack sends some command to start or stop a VM, it will send
> > something like “xe vm-start uuid=” or “xe vm-shutdown
> uuid=”,
> > these are XAPI commands. Therefore, even if you are using Xenserver
> > environments, those are the commands that are going to be used; hence,
> > Xenserver encapsulates the XAPI and Xen hypervisor.
> >
> > To my knowledge, now that Xenserver was open by Citrix, there should not
> > be any difference on capabilities between the XAPI that we get from here:
> > http://www.xenproject.org/developers/teams/xapi.html
> >
> > And the one that we get when we install the Xenserver directly.
> >
> >
> >
> > Now answering your questions:
> >
> > 1. What OS/version are you using for dom0 and with what hypervisor
> version?
> >
> > We are using Debian 7.4.0, we first tried Ubuntu server, but it was not
> > stable enough for a production environments. The Ubuntu had some bugs and
> > missing dependencies that had to be worked around.
> >
> > 2. How did you deploy XCP (from pre-compiled ISO, built from source,
> > package source i.e yum/apt-get, xenserver-core packages, something else)
> >
> > We installed the XCP (XAPI) using the apt repository.
> > We first installed the xen hypervisor:
> >
> > # apt-get install xen-hypervisor-amd64
> >
> > then the XAPI packages:
> >
> > # apt-get install xcp-xapi
> >
> > Of course, is not as simple as just running those commands, we also had
> to
> > configure the networking and tuned the xen hypervisor, XAPI, storage and
> > etc.
> >
> >
> > 3. How are you handling updates to the XCP/Xen/XAPI components,
> > particularly those of a security nature?
> >
> > If any patch is created and we find that it has to be applied in our
> > environment, we first look if it is already in apt-get repository, if it
> is
> > there, we just upgrade that package. If the upgrade is not in the
> official
> > repository, we get and apply it manually.
> >
> >
> > I am curious, what are the assumptions you make for Xenserver
> environments?
> >
> > On Fri, Apr 17, 2015 at 11:23 AM, Tim Mackey  wrote:
> >
> >> A little bit ago there was a thread started on the dev list about XCP
> and
> >> CloudStack.  I've had a bit of a think about this if you're using XCP I
> >> would like to understand better how XCP, and by extension the XAPI
> >> toolstack when *not* part of XenServer, is deployed in your
> environments.
> >> If XCP/XAPI users can answer these three questions, it would help in
> >> understanding how to best handle XCP moving forward.
> >>
> 

RE: XenServer 6.5 - Security Groups

[Tim Mackey]

Geoff, was this a fresh install of both XenServer and CloudStack, or was
there any post install steps or upgrades?  I'm thinking of setting this up
and tracing things tomorrow.  Might be good to get your logs to compare
against what I see.
On Apr 20, 2015 3:24 PM, "Geoff Higginbottom" <
geoff.higginbot...@shapeblue.com> wrote:

> FYI we have just re-deployed the environment using ACS 4.4.3 and XenServer
> 6.2 and now it is all working as expected.
>
> We now need to work out if the problem is with ACS 4.5.1 or XenServer 6.5
>
> Regards
>
> Geoff Higginbottom
>
> D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581
>
> geoff.higginbot...@shapeblue.com
>
> -Original Message-
> From: Geoff Higginbottom [mailto:geoff.higginbot...@shapeblue.com]
> Sent: 20 April 2015 17:52
> To: users@cloudstack.apache.org
> Subject: RE: XenServer 6.5 - Security Groups
>
> Many thank Somesh
>
> Regards
>
> Geoff Higginbottom
>
> D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581
>
> geoff.higginbot...@shapeblue.com
>
> -Original Message-
> From: Somesh Naidu [mailto:somesh.na...@citrix.com]
> Sent: 20 April 2015 15:55
> To: users@cloudstack.apache.org
> Subject: RE: XenServer 6.5 - Security Groups
>
> I am running 4.5.0. I probably don't use my lab setup that often to
> encounter these inconsistencies. I will look for any XS hotfixes that have
> fixes around this area and let you know if I find one.
>
> Somesh
> CloudPlatform Escalations
> Citrix Systems, Inc.
>
> -Original Message-
> From: Geoff Higginbottom [mailto:geoff.higginbot...@shapeblue.com]
> Sent: Monday, April 20, 2015 10:42 AM
> To: users@cloudstack.apache.org
> Subject: RE: XenServer 6.5 - Security Groups
>
> We are currently testing a 4.5.1 CloudStack deployment with XenServer 6.5
> and the Security Groups are very temperamental.
>
> Sometimes they allow traffic, sometimes they block it.  Lots of errors in
> the cloud.log file on the XenServer saying failed to update iptables etc
>
> Regards
>
> Geoff Higginbottom
>
> D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581
>
> geoff.higginbot...@shapeblue.com
>
> -Original Message-
> From: Somesh Naidu [mailto:somesh.na...@citrix.com]
> Sent: 20 April 2015 15:38
> To: users@cloudstack.apache.org
> Subject: RE: XenServer 6.5 - Security Groups
>
> I am running that in my lab and haven't encountered any issues. But note I
> may not be covering a whole lot of use cases.
>
> Any specific issues that you are facing?
>
> Somesh
> CloudPlatform Escalations
> Citrix Systems, Inc.
>
> From: Geoff Higginbottom [mailto:geoff.higginbot...@shapeblue.com]
> Sent: Monday, April 20, 2015 10:12 AM
> To: users@cloudstack.apache.org
> Subject: XenServer 6.5 - Security Groups
>
> Hi,
>
> Is anyone using XenServer 6.5 with a Basic Zone with Security Groups, and
> if so, are you experiencing any problems?
>
> Regards
>
> Geoff Higginbottom
> CTO / Cloud Architect
>
> [Description: Mail Logo Bottom Align]
>
> D: +44 20 3603 0542 | S: +44 20 3603 0540 +442036030540> | M: +447968161581
>
> geoff.higginbot...@shapeblue.com
> |
> http://secure-web.cisco.com/1_m6FCDbSUBvddH6wuttV8bB9VyxT7_ZrQdTyy8rP6zdZKcxYpIktkHNIjZklPdlONoacLb2wS34ty66n-dfvn7WNlvJGXbkgF-rfzXJIBVgkyV1bWAuhg1ncLBIz0-ryRfTsoRfwGBsEIt25u879S1c92XJ8aaph3rzYIY6Uiu8jaw0-PbMR0566HUKmboL-/http%3A%2F%2Fwww.shapeblue.com
>  secure-web.cisco.com/1wlSAn7D75G6NWQjnyhpieSqjDnAwYRwKZrJ72dxbEczCABPjXADRKyn6yB7bVLg9qX8BOLiQhHMSkV1rTaJ3hvk6hQ4ZzHbyevQP48d5wh6D6YO3kcvr3rOn_PWYrsvxVV9sr6C6aGf_HdUQ3FT_1PNOgdKuZ9jugNdc1URHALWNa7pbbFucbfGdvls3-lSD/http%3A%2F%2Fwww.shapeblue.com%2F>
> | Twitter:@cloudstackguru
>
> ShapeBlue Ltd, 53 Chandos Place, Covent Garden, London, WC2N 4HS
>
> Find out more about ShapeBlue and our range of CloudStack related services
>
> IaaS Cloud Design & Build<
> http://secure-web.cisco.com/1ELd3cItcRBs-I31ofdP3jOF-t5vDpGEXoTGIusThWjIMyrHdvguDFWxEKII1DpOPXKDDDImob8MuTMkIOh0DfliYEz52VWpOigayNR-6cF6Dzf3dkzh0mUtqxQCELej15kwPVIay8Hnyq2qDPsk3GX6lbS2hLeHonsKEDnq9dfG4l6UNA09F9JEETtHIJ3cr/http%3A%2F%2Fshapeblue.com%2Fiaas-cloud-design-and-build%2F%2F
> >
> CSForge - rapid IaaS deployment framework<
> http://secure-web.cisco.com/1ODcR5OFg2RiGzgEwRUsJ_RHtEXWdR_wS6Gwj38jVhLMjWOi6nRP7iqtV0pbpZbKCWDhQ2YQjAVHPQ-GeIUUTEYSbL-dWm_tWuRNFl2m7wZQERQGY8kKwe5zxpG62bne2dQ_I9ezxt1376h_8tUsX-_cJH00m2tY_m1MBRt0jYviBewtgYbRYA3_YSuGJyf0b/http%3A%2F%2Fshapeblue.com%2Fcsforge%2F
> >
> CloudStack Consulting<
> http://secure-web.cisco.com/1cHy5w5vKDJaJg7SS2Vl9lgoBUd5-Ctdx-nSQIOSgAYOtsNFyI-p1B9xnYhDSzCkQrlPCu_1rcLbxKXcOmmKgV5lQrnuILkwNUCH1-HNmOqOxlRrPN0BK0-SBrw_fPqMQcqv6qDCSmVfFLIQ0SKY7o7FxndebfXimroPuUgzPxG644IFgFtJ1l4VyPra9xahV/http%3A%2F%2Fshapeblue.com%2Fcloudstack-consultancy%2F
> >
> CloudStack Software Engineering<
> http://secure-web.cisco.com/16oTFNuacBSBoCrEA-Y3fa-IkXuZ_6jOtLjLL5uvIDYECRH4C2TkWaCdSGEDG7Yosw_kIt0VuO1RF_X8xuKyAOAlLo7EzlT137BUjUZDBCCVDpn2ciRQsV76hRJ

Re: XenServer 6.5 - Security Groups

[Tim Mackey]

Geoff,

I just went through the changelog for ipset, and its a pretty safe bet
that's where the problems are.  In XenServer 6.2, ipset is version 4.5
while XenServer 6.5 uses ipset version 6.11.  With version 5, upstream did
a major rewrite of ipset.  iptables also changed, but it's not as dramatic.
I'm going to try and build with Rohit's change and test tonight or tomorrow.

-tim

On Tue, Apr 21, 2015 at 2:41 AM, Abhinandan Prateek <
abhinandan.prat...@shapeblue.com> wrote:

> The security groups are working but with errors. All the recommended
> settings are in place.
>
> In the log files there are many delete failures like:
>
> Failed to delete rule log file /var/run/cloud/i-2-4-VM.ip
> 10.51.212.24-cloud.log:2015-04-17 11:45:08DEBUG [root] Ignoring
> failure to delete rules for vm i-2-4-VM
> 10.51.212.24-cloud.log:2015-04-17 11:45:08DEBUG [root] Ignoring
> failure to delete rules for vm i-2-4-VM
> 10.51.212.24-cloud.log:2015-04-17 11:45:09DEBUG [root] Ignoring
> failure to delete ebtables chain for vm i-2-4-VM
> 10.51.212.24-cloud.log:2015-04-17 11:45:09DEBUG [root] Creating ipset
> chain  i-2-4-VM
> 10.51.212.24-cloud.log:2015-04-17 11:45:09DEBUG [root] Writing log to
> /var/run/cloud/i-2-4-VM.log
> 10.51.212.24-cloud.log:2015-04-17 11:45:09DEBUG [root] Programmed
> default rules for vm i-2-4-VM
> 10.51.212.24-cloud.log:2015-04-17 11:45:09DEBUG [root] No change in
> default info set of vm i-2-4-VM
> 10.51.212.24-cloud.log:2015-04-17 11:45:09DEBUG [root] Seqno increased
> from -1 to 17: reprogamming ingress rules for vm i-2-4-VM
> 10.51.212.24-cloud.log:2015-04-17 11:45:09DEBUG [root] Programming
> network rules for vm  i-2-4-VM seqno=17 numrules=3
> signature=fd07c7713376d8906fb71eb8328224ca guestIp=10.170.20.61, update
> iptables, reason=seqno_change_or_sig_change
> 10.51.212.24-cloud.log:2015-04-17 11:45:09DEBUG [root] ['iptables',
> '-I', 'i-2-4-VM', '-p', 'icmp', '--icmp-type', 'any', '-j', 'ACCEPT']
> 10.51.212.24-cloud.log:2015-04-17 11:45:09DEBUG [root] ipset chain
> already existsi-2-4-VM_tcp_22_22
>
>
> Looks like due to delete failure the subsequent rule change fails to apply
> ?
>
> -abhi
>
> > On 21-Apr-2015, at 9:56 am, Koushik Das  wrote:
> >
> > What is the output of "cat /etc/sysctl.conf"? Update it as per
> http://cloudstack-installation.readthedocs.org/en/latest/hypervisor/xenserver.html.
> If there was an upgrade from XS 6.2 to XS 6.5, then changes to sysctl.conf
> is not persisted.
> >
> >
> > On 21-Apr-2015, at 6:24 AM, Tim Mackey  wrote:
> >
> >> Geoff, was this a fresh install of both XenServer and CloudStack, or was
> >> there any post install steps or upgrades?  I'm thinking of setting this
> up
> >> and tracing things tomorrow.  Might be good to get your logs to compare
> >> against what I see.
> >> On Apr 20, 2015 3:24 PM, "Geoff Higginbottom" <
> >> geoff.higginbot...@shapeblue.com> wrote:
> >>
> >>> FYI we have just re-deployed the environment using ACS 4.4.3 and
> XenServer
> >>> 6.2 and now it is all working as expected.
> >>>
> >>> We now need to work out if the problem is with ACS 4.5.1 or XenServer
> 6.5
> >>>
> >>> Regards
> >>>
> >>> Geoff Higginbottom
> >>>
> >>> D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581
> >>>
> >>> geoff.higginbot...@shapeblue.com
> >>>
> >>> -Original Message-
> >>> From: Geoff Higginbottom [mailto:geoff.higginbot...@shapeblue.com]
> >>> Sent: 20 April 2015 17:52
> >>> To: users@cloudstack.apache.org
> >>> Subject: RE: XenServer 6.5 - Security Groups
> >>>
> >>> Many thank Somesh
> >>>
> >>> Regards
> >>>
> >>> Geoff Higginbottom
> >>>
> >>> D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581
> >>>
> >>> geoff.higginbot...@shapeblue.com
> >>>
> >>> -Original Message-
> >>> From: Somesh Naidu [mailto:somesh.na...@citrix.com]
> >>> Sent: 20 April 2015 15:55
> >>> To: users@cloudstack.apache.org
> >>> Subject: RE: XenServer 6.5 - Security Groups
> >>>
> >>> I am running 4.5.0. I probably don't use my lab setup that often to
> >>> encounter these inconsistencies. I will look for any XS hotfixes that
> have
> >>> fixes around

Re: CloudStack & vCenter Operations outside of CloudStack

[Tim Mackey]

Based on my experience with 4.2 and vSphere 5, CloudStack picks up vm
migrations done from vCenter within the same cluster.  I never tried across
cluster, but wouldn't expect it to work.If the datastore was defined in
CloudStack as zone wide.
On Apr 25, 2015 9:27 AM, "Timothy Lothering" 
wrote:

>  Hi,
>
>
>
> Just a quick question,
>
>
>
> Can we perform some operations in vCenter without needing to do it via
> ACS? Typically, we are looking at migrating all our VM Instances from an
> old VMware Cluster to a new one, this would entail both VM and Storage to
> new infrastructure.
>
>
>
> The reason for asking this is that in ACS we need to detach data disks and
> then migrate the VM, which can be time consuming. I was hoping that if we
> do the migration in vCenter that ACS would pick up the changes. Please
> advise if this is safe.
>
>
>
> We are running version 4.3
>
>
>
> Regards,
>
>
>[image: www.datacentrix.co.za]   *Timothy
> Lothering*
> Solutions Architect
> Managed Services   T: +27877415535
> F: +27877415100
> C: +27824904099
> E: tlother...@datacentrix.co.za
> *www.datacentrix.co.za *
> *Serious about performance,*  *passionate about value*
>
>
>
> 
> --
> *Disclaimer*
> Everything in this e-mail and any attachments relating to the official
> business of Datacentrix Holdings Ltd. and its subsidiaries ('Datacentrix')
> is proprietary to Datacentrix. It is confidential, legally privileged and
> protected by law. Datacentrix does not own and endorse any other content.
> Views and opinions are those of the sender unless clearly stated as being
> that of Datacentrix. The person addressed in the e-mail is the sole
> authorised recipient. Please notify the sender immediately if it has
> unintentionally reached you and do not read, disclose or use the content in
> any way. Datacentrix cannot assure that the integrity of this communication
> has been maintained nor that it is free of errors, virus, interception or
> interference.
>  --
>
>

Re: Rogue / stale snapshots with XenServer

[Tim Mackey]

If the automatic SR scan isn't happening, garbage collection also won't
happen.  This is something I ran into very recently in another project.  To
check if the auto-scan is disabled, issue the following command:

xe sr-list uuid=[your uuid] params=all

look at the "other-config" and see if there is an "auto-scan: false"
entry.  If so, then auto-scan isn't going to run.  To kick it off manually,
issue the following command:

xe sr-scan uuid=[your uuid]

Depending upon how much stuff is in there, it could take some time (read
hours).  If there are still things left kicking around after this is all
done, look in the SMlog for exceptions and see what they have to say.

-tim

On Tue, May 5, 2015 at 4:23 PM, Erik Weber  wrote:

> Cleanup is enabled.
>
> No errors in SMlog,
> this is the output of vhd-util scan: http://pastebin.com/amBdJSSG
>
> --
> Erik
>
> On Tue, May 5, 2015 at 10:10 PM, Somesh Naidu 
> wrote:
>
> > No, that is not the expectation unless you have storage cleanup disabled
> > (storage.cleanup.enabled).
> >
> > "quite some stale snapshots " - that sounds like leftovers from failed CS
> > snapshot operation and/or failing SR scan on XS due to some corrupt VHDs
> > interrupting XS GC. Can you check for errors in SMlog on XS relating to
> GC
> > on the particular SR?
> >
> > Somesh
> > CloudPlatform Escalations
> > Citrix Systems, Inc.
> >
> > -Original Message-
> > From: Erik Weber [mailto:terbol...@gmail.com]
> > Sent: Tuesday, May 05, 2015 3:38 PM
> > To: users@cloudstack.apache.org
> > Subject: Rogue / stale snapshots with XenServer
> >
> > I seem to have quite some stale snapshots on my primary storage, of both
> > deleted vms, volumes and snapshots from ACS.
> > I'm using FC with PreSetup on XenServer 6.5, with latest RC of ACS 4.5.1
> >
> > Is it expected to do manual cleanup on the SR?
> >
> > --
> >
> > Erik
> >
>

Re: Rogue / stale snapshots with XenServer

[Tim Mackey]

Erik,

>From the log, it looks like the garbage collection is running fine from a
XenServer perspective.  There are no exceptions.  If you search the log for
"trees" you'll see each run and can trace the pid.  Do you see any orphaned
vdis (i.e. ones which no longer have a reference in CloudStack->Storage)
listed from within XenCenter?  If so, you can delete those.  Any you no
longer need from CloudStack should be deleted from within the CloudStack UI
at which point I'd expect XenServer storage garbage collection to clean
anything up which needs to be cleaned.

You also asked about knowing when the task is done.  That's a little bit
hard to do since GC is a lazy task.  What I do is look in the SMlog for the
pid and then grep tail to see when it's completed.

-tim

On Wed, May 6, 2015 at 2:17 AM, Erik Weber  wrote:

> It has now run for about 10 hours, and although it could be unfinished yet,
> I'm not overly confident that it'll help.
>
> As of yet, there's not a single byte freed.
>
> Here's the output of a minute of SMlog: http://pastebin.com/hPH7YuQU
>
> --
> Erik
>
> On Tue, May 5, 2015 at 11:05 PM, Erik Weber  wrote:
>
> > You're right Tim,
> >
> > auto-scan is false.
> > I've triggered a sr-scan now. Is there any way to notice if it has
> > completed or not?
> >
> > Here's other-config and sm-config if relevant:
> > other-config (MRW): trim_last_triggered: 1430856300.47; auto-scan: false
> > sm-config (MRO): allocation: thick; use_vhd: true; last-coalesce-error:
> > 1430305998; multipathable: true
> >
> > --
> > Erik
> >
> >
> > On Tue, May 5, 2015 at 10:57 PM, Tim Mackey  wrote:
> >
> >> If the automatic SR scan isn't happening, garbage collection also won't
> >> happen.  This is something I ran into very recently in another project.
> >> To
> >> check if the auto-scan is disabled, issue the following command:
> >>
> >> xe sr-list uuid=[your uuid] params=all
> >>
> >> look at the "other-config" and see if there is an "auto-scan: false"
> >> entry.  If so, then auto-scan isn't going to run.  To kick it off
> >> manually,
> >> issue the following command:
> >>
> >> xe sr-scan uuid=[your uuid]
> >>
> >> Depending upon how much stuff is in there, it could take some time (read
> >> hours).  If there are still things left kicking around after this is all
> >> done, look in the SMlog for exceptions and see what they have to say.
> >>
> >> -tim
> >>
> >> On Tue, May 5, 2015 at 4:23 PM, Erik Weber  wrote:
> >>
> >> > Cleanup is enabled.
> >> >
> >> > No errors in SMlog,
> >> > this is the output of vhd-util scan: http://pastebin.com/amBdJSSG
> >> >
> >> > --
> >> > Erik
> >> >
> >> > On Tue, May 5, 2015 at 10:10 PM, Somesh Naidu <
> somesh.na...@citrix.com>
> >> > wrote:
> >> >
> >> > > No, that is not the expectation unless you have storage cleanup
> >> disabled
> >> > > (storage.cleanup.enabled).
> >> > >
> >> > > "quite some stale snapshots " - that sounds like leftovers from
> >> failed CS
> >> > > snapshot operation and/or failing SR scan on XS due to some corrupt
> >> VHDs
> >> > > interrupting XS GC. Can you check for errors in SMlog on XS relating
> >> to
> >> > GC
> >> > > on the particular SR?
> >> > >
> >> > > Somesh
> >> > > CloudPlatform Escalations
> >> > > Citrix Systems, Inc.
> >> > >
> >> > > -Original Message-
> >> > > From: Erik Weber [mailto:terbol...@gmail.com]
> >> > > Sent: Tuesday, May 05, 2015 3:38 PM
> >> > > To: users@cloudstack.apache.org
> >> > > Subject: Rogue / stale snapshots with XenServer
> >> > >
> >> > > I seem to have quite some stale snapshots on my primary storage, of
> >> both
> >> > > deleted vms, volumes and snapshots from ACS.
> >> > > I'm using FC with PreSetup on XenServer 6.5, with latest RC of ACS
> >> 4.5.1
> >> > >
> >> > > Is it expected to do manual cleanup on the SR?
> >> > >
> >> > > --
> >> > >
> >> > > Erik
> >> > >
> >> >
> >>
> >
> >
>

Re: Access root disk after botched upgrade

[Tim Mackey]

If that process didn't work, here's another (using XenCenter)

1. Stop the original VM (the one you want to fix).  Note it's VM name and
find it in your XenServer resource pool.
2. Create a new VM within CS and start it. Note the VM name and find it
within your XenServer resource pool
3. On the original VM, give the root disk a readily identifiable
description (it'll help in this process)
4. Detach the root disk from the original VM
5. Find the original root disk and attach it to your second VM and note the
device id assigned to it
6. Login to the second VM and mount the original root disk
7. Fix grub
8. Unmount the original root disk
9. Detach original root disk from the second VM
10. Reattach the original root disk to the original VM
11. Start the original VM.

At this point everything should be working (provided grub was the issue).

While I've given the process using XenCenter, it can be done with CLI.
It's just a bit harder to keep track of the correct uuids using the CLI.
Note that in all of this, if you need to move VMs from one host to another,
that's fine, just make certain they are back on their original hosts when
you're done lest CS get confused.

-tim

On Sun, Jun 21, 2015 at 7:14 AM, Stephan Seitz <
s.se...@secretresearchfacility.com> wrote:

> Hi,
>
> on XenServer I'ld expect your SR containing *.vhd files. You could use
> the cli "xe" command to determine which file is attached. Maybe this
> info can also be seen in the gui.
>
> Here's a short walkthrough, how to access vhd files:
> http://wiki.xen.org/wiki/Mounting_a_.vhd_disk_image_using_blktap/tapdisk
>
> If your vhd file contains partitions, you could do a
> kpartx -a /dev/xen/
> to get
> /dev/mapper/blktap0p[0n]
>
> Depending on your guest OS, e.g. If there's LVM or dm-crypt etc...
> inside the following steps vary.
>
> Just use standard linux tools to mount / pvscan / cryptsetup / ...
> the /dev/mapper/blktap... partitions.
>
> With additional bind-mounts of /sys, /proc, /run, /dev, /dev/pts you
> should be able to chroot into the filesystem and perform the necessary
> tasks.
>
> Just as a note: Be careful, to do this only exclusively, say with the
> respective VMs powered-off. Also, double check to umount / pvchange
> -n / ... every layer you've built. Also kpartx -d the partitions and
> unmap the blktap before trying to boot the VM.
>
> Good luck!
>
> - Stephan
>
>
> Am Sonntag, den 21.06.2015, 12:43 +0200 schrieb France:
> > Hi,
> >
> > after upgrading Ubuntu Linux, the system does not boot, probably because
> of wrong grub config format:
> > (   errorInfo: [Traceback (most recent call last):,   File
> "/usr/bin/pygrub", line 808, in ?, fs = fsimage.open(file,
> part_offs[0], bootfsoptions), IndexError: list index out of range, ])
> >
> > How can I get access to disk of this VM, to fix the grub file by hand
> and try to restart it?
> > I have CS 4.3 on XS 6.0.2 with ISCSI disk for virtual instances.
> >
> > Tnx.
> > France.
>
>

Re: nfs storage issue on xenserver

[Tim Mackey]

It would be good to get the version of both CloudStack and XenServer
involved, as well as any hotfixes.  What you've described sounds very
similar to an issue I understood to have been fixed quite some time ago.

-tim

On Sun, Jul 12, 2015 at 5:37 PM, Prashant s  wrote:

> this issue is resolved,
>
> i moved the directory one level up ..now every thing works great !
> i wonder how the SR directory got renamed 
>
> thanks
> prashant
>
>
>
> On Sun, Jul 12, 2015 at 11:45 AM, Prashant s  wrote:
>
> > Greetings !
> >
> > need help with the NFS storage on xenserver .. ...
> >
> > there was a network outage , Few of my xenservers rebooted, after the
> > reboot .. now
> >
> > looks like i have storage mount path issue , i have duplicate sub folder
> > inside  sr-uuid directory.
> >
> > *all my vhd files are inside /var/run/sr-mount/$sr-name/$sr-uuid/
> > directory. *
> >
> > *i think the default path to the vhd files are - *
> > */var/run/sr-mount/$sr-name/*
> >
> >
> > *questions 1 ) i dont know how the **
> /var/run/sr-mount/$sr-name/$sr-uuid/
> > directory got created ? and how to fix it  *
> >
> > *i can copy all the vhd files one level up. ... *
> >
> >
> >
> > sr-uui is  *43144902-6d85-6122-b4ac-cf35ca5a57e1*
> > *sr-name is **dc1xsv-c3u28*
> >
> > # cd  */var/run/sr-mount/43144902-6d85-6122-b4ac-cf35ca5a57e1 *
> > # 43144902-6d85-6122-b4ac-cf35ca5a57e1]# ls
> > # *43144902-6d85-6122-b4ac-cf35ca5a57e1 *
> > # 43144902-6d85-6122-b4ac-cf35ca5a57e1]#
> >
> > *all my vhd files are inside /var/run/sr-mount/$sr-name/$sr-uuid/*
> >
> >
> >
> >
> > [root@dc1xsv-c3u28n1 43144902-6d85-6122-b4ac-cf35ca5a57e1]# pwd
> > */var/run/sr-mount/43144902-6d85-6122-b4ac-cf35ca5a57e1*
> > [root@dc1xsv-c3u28n1 43144902-6d85-6122-b4ac-cf35ca5a57e1]# ls
> > *43144902-6d85-6122-b4ac-cf35ca5a57e1*
> > [root@dc1xsv-c3u28n1 43144902-6d85-6122-b4ac-cf35ca5a57e1]#
> >
> > [iadm@dc1csf-az2-01 43144902-6d85-6122-b4ac-cf35ca5a57e1]$ *pwd*
> >
> >
> >
> */data/cloud/dc1/az3/primary/dc1xsv-c3u28/43144902-6d85-6122-b4ac-cf35ca5a57e1*
> >
> > [iadm@dc1csf-az2-01 43144902-6d85-6122-b4ac-cf35ca5a57e1]$
> >
> >
> > [iadm@dc1csf-az2-01 43144902-6d85-6122-b4ac-cf35ca5a57e1]$ ls -l
> >
> > total 394755964
> >
> > -rw-r--r--. 1 root root   46592 Aug 22  2014
> > 02906cb7-696c-4cfb-a93e-6a4451184c6f.vhd
> >
> > -rw-r--r--. 1 root root   15360 Nov  3  2014
> > 0298fac4-02d1-41b6-94c5-ceeed536af5b.vhd
> >
> > -rw-r--r--. 1 root root  2805178880 Jun 22 09:46
> > 030e2d71-199b-41da-9307-bbf6e7957cf2.vhd
> >
> > -rw-r--r--. 1 root root  3330691584 Dec 12  2014
> > 038a323a-40e3-4d91-b95d-a47e051e8b3a.vhd
> >
> > -rw-r--r--. 1 root root   334144000 Jun 17 13:51
> > 03fab1dd-3721-455b-a823-61b6571e85bd.vhd
> >
> > -rw-r--r--. 1 root root  3619192832 Jul 12 05:23
> > 05640f30-9a25-4083-ba7c-1d36f447596f.vhd
> >
> > -rw-r--r--. 1 root root  215552 Apr 16 08:35
> > 05f2239e-d29c-4f1f-8593-51a3625a9058.vhd
> >
> > -rw-r--r--. 1 root root   46592 Aug 22  2014
> > 06360c7c-039b-4262-90a1-dbabb1149dac.vhd
> >
> > -rw-r--r--. 1 root root   46592 Mar 23 21:00
> > 0b4b8ac1-7c7a-4373-978d-6fe879261f32.vhd
> >
> > -rw-r--r--. 1 root root   46592 Jun 19 14:59
> > 0b6cb8d3-75a4-4778-8af0-c82da126b416.vhd
> >
> > -rw-r--r--. 1 root root  1940717568 Aug 22  2014
> > 0ff05e27-0d99-4bd7-8657-bb99117fdb2d.vhd
> >
> > -rw-r--r--. 1 root root   998522880 Jul 12 05:24
> > 1077a06a-4226-4dd8-a7e3-a8a3fd99970f.vhd
> >
> > -rw-r--r--. 1 root root   14848 Jun 17 11:53
> > 133576aa-5fea-4329-8454-84818ba77ecc.vhd
> >
> > -rw-r--r--. 1 root root   46592 Jul 28  2014
> > 1626f5c6-132d-4158-b973-6f2ee2cedb84.vhd
> >
> > -rw-r--r--. 1 root root  5971788288 Aug 22  2014
> > 1649b714-c288-4cec-a2f4-8377d3bb0be4.vhd
> >
> > -rw-r--r--. 1 root root  4414734848 May 27 16:14
> > 16e21e32-d3f4-4204-9541-860d14b914a3.vhd
> >
> > -rw-r--r--. 1 root root   682909696 Jul 12 05:33
> > 17d54a5d-f999-46be-9e4c-c2bc4a6eb43c.vhd
> >
> > -rw-r--r--. 1 root root  214016 Aug 22  2014
> > 19590f24-60b1-4b39-8b87-c41ff3f4c5b0.vhd
> >
> > -rw-r--r--. 1 root root   15360 Jun 18 14:13
> > 19d3c57b-45bd-4b8b-84f3-b0c82b8f1a65.vhd
> >
> > -rw-r--r--. 1 root root 15831232512 Jul 12 05:23
> > 1b4917df-a7a0-4cc7-ba1c-d9a32731004f.vhd
> >
> > -rw-r--r--. 1 root root   626671616 Jul 12 05:24
> > 1b7211df-555f-4a52-b67e-4565e8f6c7b2.vhd
> >
> > -rw-r--r--. 1 root root   46592 Apr 16 08:35
> > 1ee3f56d-276a-42f8-bcde-e67ce4916b18.vhd
> >
> > -rw-r--r--. 1 root root  8264253952 Dec  8  2014
> > 216008dd-c5b3-45c5-b31d-94c97d30da66.vhd
> >
> > -rw-r--r--. 1 root root   241656320 Jun 17 13:51
> > 23723337-fdcd-47f2-8a0f-0070b6c5d952.vh
> >
> >
>

Missing guest default gateway

[Tim Mackey]

I feel this is something I should just know, but it's escaping me.  For
some reason the virtual router for a guest network I've defined isn't
setting the default gateway via DHCP.  This is CloudStack 4.4 with
XenServer 6.2 and it's an isolated network.

This is what ip route shows after restart:
[root@piwigo122 ~]# ip route
192.168.1.0/24 dev eth0  proto kernel  scope link  src 192.168.1.131
169.254.0.0/16 dev eth0  scope link  metric 1002

If I add the default route in via "ip route add default via 192.168.1.1"
everything now works as expected.

The network was created using the
"DefaultIsolatedNetworkOfferingWithSourceNatService".

I do have egress rules in place, so it's only the lack of default route
which is causing me a problem.

-tim

Re: Missing guest default gateway

[Tim Mackey]

On Wed, Jul 15, 2015 at 4:14 PM, Erik Weber  wrote:

> On Wed, Jul 15, 2015 at 9:54 PM, Tim Mackey  wrote:
>
> > I feel this is something I should just know, but it's escaping me.  For
> > some reason the virtual router for a guest network I've defined isn't
> > setting the default gateway via DHCP.  This is CloudStack 4.4 with
> > XenServer 6.2 and it's an isolated network.
> >
> > This is what ip route shows after restart:
> > [root@piwigo122 ~]# ip route
> > 192.168.1.0/24 dev eth0  proto kernel  scope link  src 192.168.1.131
> > 169.254.0.0/16 dev eth0  scope link  metric 1002
> >
> > If I add the default route in via "ip route add default via 192.168.1.1"
> > everything now works as expected.
> >
> > The network was created using the
> > "DefaultIsolatedNetworkOfferingWithSourceNatService".
> >
> > I do have egress rules in place, so it's only the lack of default route
> > which is causing me a problem.
> >
>
>
> You wouldn't happen to have changed nics on the vm after deployment? Ie.
> deployed with "network1", realized it was wrong, added "network2", sat
> "network2" detfault, removed "network1"?
>
Nothing like that happened.  It's a newly created instance with a single
NIC.

>
> In those scenarios I have seen that the rules on the VR for not sending
> default gw on the additional nic is not cleared after it has been set as
> default.
>
> In that case, clear it manually (/etc/dhcphosts.txt, /etc/dhcpopts.txt or
> something like that on the VR), or recreate the VR.
>
I do see an entry in dhcphosts.txt, but don't know what it should look like
to know if it's broken.

>
> If that is not the case I don't know what's wrong, you could possibly
> tcpdump the dhcp traffic on the vm to see if it receive the information.
> That way atleast you can narrow down to troubleshooting either the VM or
> the VR.
>
Since this is a template from a running system, I'll start with the VM
tomorrow.  Could very easily be cruft in there.

Thanks

>
> --
> Erik
>

Re: Missing guest default gateway

[Tim Mackey]

In case anyone runs into such a scenario in the future, here's what this
turned out to be.  In /etc/sysconfig/network the GATEWAY from the source VM
was still present.  Removing that allowed DHCP to set the default route
properly.

-tim

On Wed, Jul 15, 2015 at 4:26 PM, Tim Mackey  wrote:

>
>
> On Wed, Jul 15, 2015 at 4:14 PM, Erik Weber  wrote:
>
>> On Wed, Jul 15, 2015 at 9:54 PM, Tim Mackey  wrote:
>>
>> > I feel this is something I should just know, but it's escaping me.  For
>> > some reason the virtual router for a guest network I've defined isn't
>> > setting the default gateway via DHCP.  This is CloudStack 4.4 with
>> > XenServer 6.2 and it's an isolated network.
>> >
>> > This is what ip route shows after restart:
>> > [root@piwigo122 ~]# ip route
>> > 192.168.1.0/24 dev eth0  proto kernel  scope link  src 192.168.1.131
>> > 169.254.0.0/16 dev eth0  scope link  metric 1002
>> >
>> > If I add the default route in via "ip route add default via 192.168.1.1"
>> > everything now works as expected.
>> >
>> > The network was created using the
>> > "DefaultIsolatedNetworkOfferingWithSourceNatService".
>> >
>> > I do have egress rules in place, so it's only the lack of default route
>> > which is causing me a problem.
>> >
>>
>>
>> You wouldn't happen to have changed nics on the vm after deployment? Ie.
>> deployed with "network1", realized it was wrong, added "network2", sat
>> "network2" detfault, removed "network1"?
>>
> Nothing like that happened.  It's a newly created instance with a single
> NIC.
>
>>
>> In those scenarios I have seen that the rules on the VR for not sending
>> default gw on the additional nic is not cleared after it has been set as
>> default.
>>
>> In that case, clear it manually (/etc/dhcphosts.txt, /etc/dhcpopts.txt or
>> something like that on the VR), or recreate the VR.
>>
> I do see an entry in dhcphosts.txt, but don't know what it should look
> like to know if it's broken.
>
>>
>> If that is not the case I don't know what's wrong, you could possibly
>> tcpdump the dhcp traffic on the vm to see if it receive the information.
>> That way atleast you can narrow down to troubleshooting either the VM or
>> the VR.
>>
> Since this is a template from a running system, I'll start with the VM
> tomorrow.  Could very easily be cruft in there.
>
> Thanks
>
>>
>> --
>> Erik
>>
>
>

Re: Packer and CloudStack

[Tim Mackey]

Hany,

Take a look at this: https://github.com/xenserverarmy/packer.  I updated it
last week for the changes in Packer 0.8.6, and have tested it with
XenServer 6.2 and 6.5.  Here are the things you might want to know which
I've not updated in the README.MD:

- There are two builders, xenserver-iso and xenserver-vm.  xenserver-iso
creates an artifact from an ISO (requires a XenServer ISO SR and will
automatically download the ISO if not present).  xenserver-vm creates an
artifact from a pre-existing VM which could be running.  Both builders
assume an NFS SR is present (by-product of a limitation in an earlier
implementation).  I plan on removing that requirement next week.
- Any provisioners you wish to define will work, provided they use the SSH
communicator.  I'm still working on the WinRM communicator
- There is a cloudstack-xenserver post-processor which will upload the VHD
artifact to your CloudStack instance.  It only requires API access.  If the
CloudStack instance is remote, tell the post-processor to compress,
otherwise leave it uncompressed (faster)

If you run into problems or have questions, just ask, and I do accept pull
requests.  Since this is your first time with this project, I'm very
interested in any "first use" problems such that the README can be updated.

-tim

On Thu, Sep 10, 2015 at 8:30 AM, Hany Fahim  wrote:

> Hi Folks,
>
> I’m currently looking into adopting Packer  to build
> images for CloudStack easily. I’ve been looking in packer-cloudstack
>  plugin, but
> unfortunately there have been some backwards incompatible changes made to
> Packer that prevents this plugin from working. We do not have direct access
> to the CloudStack installation we’re working with, and only have the API
> available to us.
>
> I’d like to ask the community if anyone else has got Packer to work in some
> form with CloudStack? At the very least, we’re looking for a way for Packer
> to produce VHD images that can be imported into CloudStack manually.
>
> Any help would be appreciated.
> ​
>
> 
> Hany Fahim
> VM Farms
> http://vmfarms.com
> h...@vmfarms.com
> 1-866-278-0021 x700
> Twitter: @vmfarms
>

Re: Packer and CloudStack

[Tim Mackey]

Hany,

It does require a XenServer host, call it a "build host", but that host can
be anywhere including local to you (actually preferable).  The "build host"
also doesn't have to even remotely match the capabilities of the hosts in
the CloudStack instance, including things like storage and networking.

The idea is that you create your VM locally to your specifications, and
then upload it into whatever XenServer backed CloudStack instance you're
using.  If you happen to know what you want and can define it in a
kickstart file, then go with xenserver-iso and let it do all the heavy
lifting.  If you might need to tweak on stuff, create the VM within
XenServer and do the tweaking, then when you're happy use xenserver-vm to
do all the heavy lifting.  There is also an intermediate stage which uses
both paths, but that doesn't sound like it would work for you.

I'm happy to walk you through this in a bit more detail, either here on the
list or if you want something a bit more interactive, I'm @xenserverarmy on
Twitter

-tim

On Thu, Sep 10, 2015 at 11:02 AM, Hany Fahim  wrote:

> Thanks for the quick reply Tim!
>
> I actually stumbled on this project during my research. If my understanding
> is correct, this requires access to an XenServer host. I unfortunately only
> have access to the CloudStack API and not the underlying XenServer
> hypervisor. Is it possible to use this tool without access to the
> XenServer?
>
>
> 
> Hany Fahim
> VM Farms
> http://vmfarms.com
> h...@vmfarms.com
> 1-866-278-0021 x700
> Twitter: @vmfarms
>
> On Thu, Sep 10, 2015 at 10:58 AM, Tim Mackey  wrote:
>
> > Hany,
> >
> > Take a look at this: https://github.com/xenserverarmy/packer.  I updated
> > it
> > last week for the changes in Packer 0.8.6, and have tested it with
> > XenServer 6.2 and 6.5.  Here are the things you might want to know which
> > I've not updated in the README.MD:
> >
> > - There are two builders, xenserver-iso and xenserver-vm.  xenserver-iso
> > creates an artifact from an ISO (requires a XenServer ISO SR and will
> > automatically download the ISO if not present).  xenserver-vm creates an
> > artifact from a pre-existing VM which could be running.  Both builders
> > assume an NFS SR is present (by-product of a limitation in an earlier
> > implementation).  I plan on removing that requirement next week.
> > - Any provisioners you wish to define will work, provided they use the
> SSH
> > communicator.  I'm still working on the WinRM communicator
> > - There is a cloudstack-xenserver post-processor which will upload the
> VHD
> > artifact to your CloudStack instance.  It only requires API access.  If
> the
> > CloudStack instance is remote, tell the post-processor to compress,
> > otherwise leave it uncompressed (faster)
> >
> > If you run into problems or have questions, just ask, and I do accept
> pull
> > requests.  Since this is your first time with this project, I'm very
> > interested in any "first use" problems such that the README can be
> updated.
> >
> > -tim
> >
> > On Thu, Sep 10, 2015 at 8:30 AM, Hany Fahim  wrote:
> >
> > > Hi Folks,
> > >
> > > I’m currently looking into adopting Packer <https://packer.io/> to
> build
> > > images for CloudStack easily. I’ve been looking in packer-cloudstack
> > > <https://github.com/schubergphilis/packer-cloudstack> plugin, but
> > > unfortunately there have been some backwards incompatible changes made
> to
> > > Packer that prevents this plugin from working. We do not have direct
> > access
> > > to the CloudStack installation we’re working with, and only have the
> API
> > > available to us.
> > >
> > > I’d like to ask the community if anyone else has got Packer to work in
> > some
> > > form with CloudStack? At the very least, we’re looking for a way for
> > Packer
> > > to produce VHD images that can be imported into CloudStack manually.
> > >
> > > Any help would be appreciated.
> > > ​
> > >
> > > 
> > > Hany Fahim
> > > VM Farms
> > > http://vmfarms.com
> > > h...@vmfarms.com
> > > 1-866-278-0021 x700
> > > Twitter: @vmfarms
> > >
> >
>

Re: Re[4]: GRE Isolation Performance

[Tim Mackey]

David,

Cross host private network (CHPN) performance in XenServer will be slower
than VXLAN because traffic in the GRE tunnel is encrypted.  At the time
CHPN was implemented in 2010, VXLAN wasn't as well established as it is
today, and we had a requirement of the communication being private.  There
were internal performance docs at the time which showed dom0 CPU usage
maxed out with something like 100 tunnels from a host, so I'm not the least
bit surprised with your observations.

In looking at the support for VXLAN in XenServer, I'm of the opinion there
isn't anything which would prevent the existing CS VXLAN implementation for
KVM from being expanded to include XenServer.  I however lack the
infrastructure to test this theory.

-tim

On Sun, Nov 15, 2015 at 4:22 PM, David Amorín 
wrote:

> Hi Remi,
> I really apprecciate your comments.
>
>
> If i have understood correctly, it is possible to use OVS with STT tunnels
> over CS. Is that correct?
>
>
> David
>
>
> -Mensaje original-
> > De: "Remi Bergsma" 
> > A: users@cloudstack.apache.org
> > Fecha: 05/11/2015 09:52
> > Asunto: Re: Re[2]: GRE Isolation Performance
> >
> > Hi David,
> >
> > STT support was added to mainstream OVS only a few months ago, last
> summer. Before that you had to patch it in.
> >
> > To be honest, in 2012 when we started using this, STT was the only
> option that could use the offloading of the nic. Today, VXLAN also is able
> to do that. For new deployments, that is the way forward as it is widely
> adopted and supported.
> >
> > I never tried VXLAN without a controller, but it is worth investigating.
> For sure Nicira and Nuage support it.
> >
> > We might consider dropping GRE support, but that's more of a subject for
> the dev list. If you have stats/performance details to share, that might
> help showing it is not a real option any more for production deployments.
> >
> > Regards, Remi
> >
> > Sent from my iPhone
> >
> > > On 05 Nov 2015, at 08:19, David Amorín 
> wrote:
> > >
> > > It looks VXLAN and STT are currently the best options. If OVS has
> support for STT tunnels, why CS doesn't support this configuration?
> > >
> > > David
> > >
> > >
> > > -Mensaje original-
> > >> De: "Remi Bergsma" 
> > >> A: users@cloudstack.apache.org
> > >> Fecha: 04/11/2015 20:29
> > >> Asunto: Re: GRE Isolation Performance
> > >>
> > >> Hi David,
> > >>
> > >> I haven’t used GRE myself, but I do know that performance wise you
> need something that offloads to the nic, as with vlan tagging (instead of
> having the cpu do all the work). Did you consider VXLAN? That has nic
> offloading support in most nics these days. We are using STT (also does
> offloading) with Nicira and it is very fast. If I had to build again, I’d
> investigate VXLAN.
> > >>
> > >>
> > >>
> > >> Regards,
> > >> Remi
> > >>
> > >>
> > >>> On 04/11/15 12:31, "David Amorín" 
> wrote:
> > >>>
> > >>> Hi all,
> > >>> We are working in an environment with CS 4.5.2 / XenServer 6.5 with
> multiple zones (Spain and Netherlands) using GRE Isolation and we have some
> concerns that we would like to share with you. Basically, we make a CPU
> benchmark between VLAN isolation and GRE isolation and the results show us
> that the consumption of CPU with GRE isolation is too much compared with
> VLAN isolation.
> > >>>
> > >>>
> > >>> Can anyone share with us the experience working with GRE isolation?
> > >>>
> > >>>
> > >>> We are not sure if this configuration in production will be safe,
> scalable and with an acceptable level of performance.
> > >>>
> > >>>
> > >>> Thanks,
> > >>>
> > >>>
> > >>> David
> > >
>
>

Re: Failed detecting local storage on XenServer 6.6 slave host

[Tim Mackey]

Stavros,

Have you enabled local storage within CloudStack (
http://xmodulo.com/how-to-use-local-storage-for-cloudstack-vms.html)?  If
so, its possible local storage implies a CloudStack cluster with only one
host (i.e. you need to break the XenServer pool into independent hosts with
each being in a CloudStack cluster).  I'd need to dig fairly deep in the
code to confirm that theory.

To your question about XenServer Dundee (what you're seeing as 6.6.90),
since it hasn't yet been released by Citrix the visual artifacts (wrong
version number) are to be expected.  Having just checked the database code,
it doesn't look like the work has yet been done to even provide
experimental support for Dundee.  If you would like to remedy that, I think
the community would welcome your contributions, and I could help mentor in
the effort.  Just let me know.

-tim

On Fri, Dec 4, 2015 at 5:37 AM, Stavros Konstantaras 
wrote:

> Hi everyone,
>
> At my organisation we tried to build a tiny cluster (1 head, 2 compute
> nodes) with CloudStack 4.6 and XenServer 6.6.90 for experimental reasons.
> As we use local storage for deploying VMs, we discovered that Cloudstack is
> not able to recognise the local storage pool of the slave compute node.
>
> We tried reversing the master node (make the slave compute node ->
> poolmaster and the poolmaster -> slave) but the result was the same. We
> tried Cloudstack 4.5.2 and again problem didn’t solve. We checked the
> database of the poolmaster and it was totally updated and able to detect
> the local storage of the slave node. On Cloudstack-management interface,
> the XenServer 6.6 hosts appear as XenServer 6.5 hosts. In the meanwhile, we
> are totally able to deploy VMs in poolmaster and make use of the local
> storage.
>
> Did any of you face this issue and if yes, did you manage to solve it? I
> suspect that there are some changes in the API of Xenserver 6.6 which CS
> does not support currently.
>
> Best Regards
> Stavros
>
> 
> Stavros Konstantaras
> Science faculty Research IT support (FEIOG)
> University of Amsterdam, Science Park 904, 1098 XH
>
> Fingerprint: E5E5 9B19 D1CD 88CD 4763  3465 A8DC 7C92 330F D59A
>
>

Re: cloudstack UI through accelerator/cache/proxy

[Tim Mackey]

I too use NetScaler and I actually found compression to have more of an
impact than caching. Caching probably didn't help as much due to the jQuery
stuff.
On Dec 10, 2015 8:30 PM, "Nux!"  wrote:

> Hi,
>
> I've been running something like this without issues using mr Kinsella's
> instructions for a good while now.
> http://theresnomon.co/2014/improving-cloudstack-ui-performance/
>
> I've seen visible improvements in performance, at least with the version
> we have in production (4.4).
>
> HTH
> Lucian
>
> --
> Sent from the Delta quadrant using Borg technology!
>
> Nux!
> www.nux.ro
>
> - Original Message -
> > From: "Giles Sirett" 
> > To: users@cloudstack.apache.org
> > Sent: Thursday, 10 December, 2015 11:06:01
> > Subject: cloudstack UI through accelerator/cache/proxy
>
> > I’m trying to get a basic understanding on how much  the performance of
> the ACS
> > UI would improve if it was run through some form of accelerator/reverse
> > proxy/cache (i.e. something like a netscaler)
> >
> > Scenario is a management server that is a long way (physically)  from
> the users,
> > therefore latency is causing UI delays. Idea would be to put an
> accelerator
> > close to the users so it can cache the static pieces of the ACS UI
> >
> > We will be doing some testing on this, but wanted to know from the
> outset  if
> > anybody has a gut feel for how well the ACS UI may behave when run
> through a
> > setup like this
> >
> >
> >
> >
> >
> > Kind Regards
> > Giles
> >
> > Giles Sirett
> > CEO
> >
> > [cid:image003.png@01D104EF.CE276C40]
> >
> > D: +44 20 3603 0541 | S: +44 20 3603 0540 | M: +44 796 111 2055
> >
> > giles.sir...@shapeblue.com |
> > www.shapeblue.com |
> > Twitter:@shapeBlue
> >
> >
> > Find out more about ShapeBlue and our range of CloudStack related
> services
> >
> > IaaS Cloud Design & Build<
> http://shapeblue.com/iaas-cloud-design-and-build//>
> > CSForge – rapid IaaS deployment framework
> > CloudStack Consulting
> > CloudStack Software
> > Engineering
> > CloudStack Infrastructure
> > Support
> > CloudStack Bootcamp Training Courses<
> http://shapeblue.com/cloudstack-training/>
> >
> > This email and any attachments to it may be confidential and are
> intended solely
> > for the use of the individual to whom it is addressed. Any views or
> opinions
> > expressed are solely those of the author and do not necessarily
> represent those
> > of Shape Blue Ltd or related companies. If you are not the intended
> recipient
> > of this email, you must neither take any action based upon its contents,
> nor
> > copy or show it to anyone. Please contact the sender if you believe you
> have
> > received this email in error. Shape Blue Ltd is a company incorporated in
> > England & Wales. ShapeBlue Services India LLP is a company incorporated
> in
> > India and is operated under license from Shape Blue Ltd. Shape Blue
> Brasil
> > Consultoria Ltda is a company incorporated in Brasil and is operated
> under
> > license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company
> registered by
> > The Republic of South Africa and is traded under license from Shape Blue
> Ltd.
> > ShapeBlue is a registered trademark.
>

Re: Do primary and secondary storage must be served by different servers ?

[Tim Mackey]

What that statement means is if you explicitly define a dedicated storage
network (aka for primary storage), then that storage network can't be
pingable from the management network.  This is no different than if you
define a storage management network in XenServer directly.

Where things get a bit more complicated is with Secondary Storage which
uses a VM as a proxy to the storage.  That VM is known as SSVM, and some
details on how to debug it can be found here:
https://cwiki.apache.org/confluence/display/CLOUDSTACK/SSVM,+templates,+Secondary+storage+troubleshooting

The net of this is that primary and secondary can definitely be on the same
file.  Things can get more complicated if you need different storage for
primary and secondary, or multipath, and for XenServer the CloudStack
storage option you might also want to look into is called PreSetup.

-tim

On Fri, Oct 3, 2014 at 2:44 PM, Yiping Zhang  wrote:

> I need some clarifications regarding primary and secondary storage devices.
>
> From following document,
> http://cloudstack-installation.readthedocs.org/en/latest/hypervisor/xenserver.html
>
> In section "Separate Storage Network for XenServer (Optional)”, it states,
> I quote:
>
> For the separate storage network to work correctly, it must be the only
> interface that can ping the primary storage device’s IP address. For
> example, if eth0 is the management network NIC, ping -I eth0  storage device IP> must fail. In all deployments, secondary storage devices
> must be pingable from the management network NIC or bond. If a secondary
> storage device has been placed on the storage network, it must also be
> pingable via the storage network NIC or bond on the hosts as well.
>
> In my case, since both primary and secondary storage are from the same
> NetApp filer, just two different volumes,  so those two sentences
> highlighted red above can’t possibly be true at the same time !  As it is
> now,  I can ping my filer from storage bond, as well as from management
> bond on xen hypervisor.
>
> Does this mean my primary and secondary storage volumes can not be served
> by the same filer ?
>
> Thanks for your help in advance.
>
> Yiping
>

Re: Enquiry on Citrix XenServer Installation for Cloudstack

[Tim Mackey]

There's nothing CloudStack specific in that requirement. All that means is
you need to have a valid XenServer pool. For some versions, that means
homogeneous, for some it means maskable.  What XenServer version are you
running?
On Oct 27, 2014 9:10 PM, "In Huishan"  wrote:

> Dear All,
>
> I read from the Cloudstack Installation Guide, that one of system
> requirements for XenServer hosts was:
>
> *All hosts within a cluster must be homogeneous. The CPUs must be of the
> same type, count, and feature flags.*
>
> However, if our hosts in XenServer pool are heterogeneous. Can we will use
> Xenserver as the hypervisor to run virtual machines in cloudstack? Just
> for your information, I am using Cloudstack version 4.4.1, is the system
> requirements still applicable to the new version?
>
> Look forward to all replies.
>
> Thanks
>
> Regards,
> Miss In
>

Re: Live migration failed

[Tim Mackey]

Before going too far down the CloudStack debugging path, I'd confirm that
you can migrate natively. If XenServer won't let you, CloudStack won't
force it.
On Oct 28, 2014 6:03 AM, "Garith Dugmore"  wrote:

> Hi GopalaKrishnan.S,
>
> Thanks for the speedy reply. Interesting that you mention capacity as I
> had a problem before this error where there wasn't enough RAM on the
> destination host. I've installed more RAM and additionally downsized the
> instance and that specific error has disappeared. To answer your other
> questions - yes, the instance's status is "running" and the 2 xen hosts are
> in the same cluster with shared primary storage (NFS).
>
> I should also mention the ISO "OS Type" is set as "Other Ubuntu (64bit)".
> I'm going to try "Other PV (64bit)" now to see if that makes a difference.
>
> - Original Message -
> > From: "GopalaKrishnan" 
> > To: users@cloudstack.apache.org
> > Sent: Tuesday, October 28, 2014 2:47:03 PM
> > Subject: Re: Live migration failed
> >
> > Hi Garith,
> >
> > Please make sure you have used the same cluster host to migrate your VM.
> > Also make sure VMs should be running status while migration process. VMs
> > should be used only shared primary storage.
> >
> > Also check your distination host have enough capacity.
> >
> > Thank You.
> > GopalaKrishnan.S
> > Cloud Consultant - Fogpanel
> >
> >
> >
> > - Original Message -
> > From: "Garith Dugmore" 
> > To: 
> > Sent: Tuesday, October 28, 2014 5:57 PM
> > Subject: Live migration failed
> >
> >
> > > Hello,
> > >
> > > My installation is coming along slowly. I now have ACS 4.4.1 on
> centos6.4
> > > and two xen 6.2 hosts connected and up and running.
> > >
> > > I've installed an instance using an ubuntu 14.04 iso image and when
> > > attempting a live migration I get an error:
> > >
> > > Job failed due to exception Unable to migrate due to Catch Exception
> > > com.cloud.utils.exception.CloudRuntimeException: Migration failed due
> to
> > > com.cloud.utils.exception.CloudRuntimeException: Unable to migrate
> > > VM(i-2-10-VM) from host(a225ecbc-192d-4e3c-bc86-ec9f7b8acfea) due to
> Task
> > > failed! Task record: uuid: c9d45535-fbeb-0d28-0cc0-1667dabb430f
> nameLabel:
> > > Async.VM.pool_migrate nameDescription: allowedOperations: []
> > > currentOperations: {} created: Tue Oct 28 14:05:58 SAST 2014 finished:
> Tue
> > > Oct 28 14:05:58 SAST 2014 status: failure residentOn:
> > > com.xensource.xenapi.Host@a725d84b progress: 1.0 type:  result:
> > > errorInfo: [VM_MISSING_PV_DRIVERS,
> > > OpaqueRef:59aba8f5-86c4-1c64-2887-5bf69d0a2e00] otherConfig: {}
> subtaskOf:
> > > com.xensource.xenapi.Task@aaf13f6f subtasks: []
> > >
> > > After some reading up on VM_MISSING_PV_DRIVERS I installed "xen-tools"
> on
> > > the ubuntu guest and rebooted. After the reboot the migration still was
> > > unhappy and gave the same error above.
> > >
> > > I also installed the whole xen hypervisor following this guide ->
> > > https://help.ubuntu.com/community/XenProposed#Installing_Xen but also
> no
> > > luck after a reboot.
> > >
> > > I'm not sure what to try next? Any ideas?
> > >
> > > All logs entries before, after and including the error are posted here
> ->
> > > http://pastebin.com/0L08nEFQ
> > >
> > > Cheers,
> > > --
> > >
> > > Garith Dugmore
> > > South African Astronomical Observatory
> > > and Southern African Large Telescope
> >
> >
> > ---
> > This email is free from viruses and malware because avast! Antivirus
> > protection is active.
> > http://www.avast.com
> >
> >
> > !DSPAM:544f8ff116021951155018!
> >
> >
> >
>
> --
>
> Garith Dugmore
> Senior System Administrator
> South African Astronomical Observatory
> and Southern African Large Telescope
>
> SAAO Telephone: +27 21 447 0025
> Direct Line: +27 21 460 6296
> Ext: 4004
> SAAO Website: http://www.saao.ac.za
> SALT Website: http://www.salt.ac.za
> Jabber: gar_i...@jabber.co.za
> MSN: gari...@hotmail.com
> Skype: garith5512
> Gtalk: gari...@gmail.com
>
>

Re: Wasting Time !

[Tim Mackey]

>From my perspective there are two issues being raised in this thread.

1. The original poster didn't actually ask a question, and despite requests
for more information, nothing which would allow us to help was
forthcoming.  We can't fix that which we don't know to be broken, and as
we're all learning and building our respective experience can't hope to
mirror that of anyone else.

2. CloudStack is like every piece of software I've ever worked with; it has
a learning curve.  Cloud in general forces you to rethink your paradigms,
and for me building my first CloudStack cloud took six weeks of unlearning
what I thought "best practice".  Not everything I had to "unlearn" was
CloudStack; some was just bad thinking called "best practice".  There's
lots of information out there, but a learning curve definitely exists, and
even today years after that first experience I continue to learn new things
about CloudStack.

To Mohammad, I offer this suggestion.  You've engaged with this community,
but specifics are lacking.  It isn't reasonable for the community to offer
assistance without knowing what is troubling you.  Expectations are an
important part of that, and we don't know what yours were, only that you're
unhappy.

Sandeep has raised specific issues, and I hope they were captured in Jira (
https://issues.apache.org/jira/browse/CLOUDSTACK).  If they weren't then
there is a very real possibility they won't be addressed until someone
either reports it, or decides to directly fix it.  I know I'm guilty of not
putting Jira reports in, and I suspect I'm not alone.  We all have the
power to complain, but we also have the power to help fix an issue by
taking a few extra minutes to just report the issue, and reporting on a
mailing list doesn't count.

Sorry for getting on my soap box, but I figured this thread had a good
chance of showing up in some index in the future and that I had an
opportunity to give a bit of guidance.  Hopefully I've not overstepped.

-tim

On Mon, Nov 17, 2014 at 9:27 AM, sandeep khandekar <
cloudstack.sand...@gmail.com> wrote:

> I agree with him, it wastes time, but at the same time you are gaining
> knowledge.
>
> If the documentation was done, he would not have faced this many problems.
>
> Single node setup:
> You never told why on restart/shutdown, you loose your secondary
> storage(NFS). - May be we need to disable swap. Still I dont know the
> answer.
>
> Multi-node setup
> Why I cant view my instance. Everything was installed properly, I connected
> to management server, logged in, Ubuntu instance was successfully setup,
> but I was unable to view it. It showed an error, I forgot the error. why?
>
> Devloper cloudstack
> Problems with devcloud in devlopment environment.
> devcloud2 never works - then why you mention in your books, links and docs,
> why dont you refer to devcloud4 in which many changes are done daily.
> Sometimes user gets broken devcloud4, and they get freaked out.
>
> Its not as simple as Vagrant up and vagrant halt.
>
> Sorry I learnt a lot, but we should agree with him, as a starter it took 9
> months still the job is unfinished. Stopped it, because I freaked out, and
> I am taking rest, will be back soon.
>
> Dont think it is waste of time speaking, many people are not speaking
> because, they are thinking, in future they may not get the answers for
> their queries.
>
> Cloudstack we love it, but we dont know how to work with it, we are
> learining, and we will be masters soon.
>
> Many people help us here on this group. That is the biggest achievement of
> these group, but you dont reveal the real recipe because you may loose
> bussiness.
>
> This are my views and I dont mean to hurt anyone in anyway.
>
> On Mon, Nov 17, 2014 at 5:38 PM, Francois Gaudreault <
> fgaudrea...@cloudops.com> wrote:
>
> > One thing I agree for sure, the thread title is right, that discussion is
> > starting to be a waste of time :) (although very entertaining)
> >
> > FG
> >
> >
> > On 2014-11-17 4:36 AM, sebgoa wrote:
> >
> >> On Nov 15, 2014, at 8:00 PM, Mohammad Mahdi Raja 
> >> wrote:
> >>
> >>  Thanks for your answers,
> >>>
> >>> I installed different version on different infrastructure during the
> >>> time. It is somehow much more unstable that other competitors. Many
> >>> non-documented issues and many unpredictable problems. I know that we
> are
> >>> all here to help each others to feel good about it, but I think we are
> >>> wasting our times on solving issues instead of doing business !
> >>>
> >>> Any one disagrees ?
> >>>
> >>>  Yes, I do, I 100% disagree.
> >>
> >> Just buy my book and you will be enlightened:
> >>
> >> http://shop.oreilly.com/product/0636920034377.do
> >>
> >> Ps: slighlty sarcastic answer :) enjoy
> >>
> >>
> >>  On Mon, Nov 10, 2014 12:33  PM, Osay Osman Yuuni 
> >>> wrote:
> >>>
>  Hi Mohammed,
>  I'd be interested to know why you think Cloudstack is waiting our
>  time?  Do
>  you have any specific issues that need addressing that yo

Re: software iSCSI (debian wheezy) on Xen 6.2 + CS 4.3

[Tim Mackey]

Peter,

I'm going to recommend you to look at the various blog posts by Felipe
Franciosi on xenserver.org  (
http://xenserver.org/blog/blogger/listings/franciozzy.html).  He is one of
the performance engineers on the team, and has some pretty deep
understanding of why things behave the way they do.  There have also been a
number of storage performance threads on xs-devel at xenserver.org covering
results obtained with Creedence.  While some of the observations on't apply
to your situation, it will be a good starting point.

-tim

On Wed, Dec 3, 2014 at 7:02 PM, Erdősi Péter  wrote:

> Hi,
>
> I faced with a strange problem, when configured iscsi storage one of my
> VM-s.
> The Vm has 2 dedicated vif (which is connected to 10GB/s NICs), and i
> successfully logged in to iSCSI with them.
> When I started some dd write test, it's going with 200-230MB/s (on whole
> 100GB size, and the VM has 4G mem, so it was not cacheing)
> After that, I started read test (simple copy from multipathed block device
> to /dev/null) and the read speed is around 30MB/s.
>
> I know, it's not exactly a CS question, but may somebody faced this kind
> of problem too.
>
> (cause the LUN is 48TB, I cannot add it to CS as primary storage, or if I
> do it, I need to add the whole 48T in ~2TB chunks... However if i connect
> iSCSI to Xen, the read and write speed is normal...)
>
> Thanks,
>  Peter
>

Re: Cloudstack User Interface CSS design

[Tim Mackey]

Aldis,

While I don't know if organizations are out there with replacement UIs you
can buy, I do know that the UI is rather customizable.

If you're just looking for some reskinning of what we have, there is the UI
CSS:  http://www.slideshare.net/cloudstack/cloudstack-ui-customization

If you want to see something more advanced look at what SunGuard presented
earlier this year:
http://events.linuxfoundation.org/sites/events/files/slides/CCNA14.pdf for
inspiration.

Of course, since the UI really doesn't do much more than provide an
interface over the API, you're free to implement whatever you want and make
appropriate API calls based on your unique needs:
http://cloudstack.apache.org/docs/api/

Lastly, if you're a UI developer/designer, we welcome the contributions
from everyone, so you could always make a proposal to the development list
for UI changes.  (
https://cwiki.apache.org/confluence/display/CLOUDSTACK/Development+101)

-tim

On Sat, Dec 20, 2014 at 6:57 AM, Aldis Gerhards  wrote:
>
> Hi.
>
> Does anyone know where is it possible to BUY/ORDER Cloudstack Web
> interface CSS which is more modern and Bootstrap 3.0 compatible.
> In my opinion default Cloudstack Web UI is old school allready and should
> be redesigned.
>
> Looking forward to hear from you guys :)
>
> Ar cieņu,
>
> *Aldis Gerhards*
> valdes loceklis
>
> GSM:(+371) 27 812 777
> Fakss:  (+371) 67 387 397
> E-pasts:  aldis.gerha...@hostnet.lv
> Web: http://www.hostnet.lv
> Twitter: http://www.twitter.com/hostnetlv
>
>
>
>
>
> *Hostnet Virtuālie serveri (VPS) - Izmēģini VPS par brīvu veselu nedēļu!*
> Pakalpojums tiek nodrošināts tikai ar jaudīgiem oriģināliem DELL serveriem
>
>

Re: Physical network design options - which crime to comit

[Tim Mackey]

I don't think anyone questioned the hypervisor. For XenServer, that answer
could sway the design
On Dec 27, 2014 6:26 PM, "Andrija Panic"  wrote:

> Thx Tejas will consider doing so.
> Cheers
>
> Sent from Google Nexus 4
> On Dec 27, 2014 4:34 PM, "Tejas Sheth"  wrote:
>
> > Hi,
> >
> >  it would be batter to seprage primary and secondary traffic with seprate
> > VLANs. If you are using latest CNA adepter then you can seprate traffic
> by
> > deviding physical 10G nics with seprate vNICs
> >
> >   1) vNIC 1 : 6G for primary storage
> >2) vNIC 2: 2G for secondary storage
> >3) vNIC 3: 2G Guset VM traffic
> >
> >  this will be hardcoded to CNA adapter on hardware level and hypervisor
> > will view as physical NICs so no need to worry about impact on primary
> > storage traffic.
> >
> > Thanks,
> > Tejas
> >
> > On Sat, Dec 27, 2014 at 4:28 AM, Andrija Panic 
> > wrote:
> >
> > > On storage nodes - yes definitively will do it.
> > >
> > > One finall advice/opinion please...?
> > >
> > > On compute nodes, since one 10G will be shared by both primary and
> > > secondary traffic - would you separate that on 2 different VLANs and
> then
> > > implement some QoS i.e. guarantie 8Gb/s for primary traffic vlan, or
> i.e.
> > > limit sec.storage vlan to i.e. 2Gb/s. Or just simply let them compete
> for
> > > the traffic? In afraid secondary traffic my influence or completely
> > > overweight primary traffic if no QoS implemented...
> > >
> > > Sorry for borring you with details.
> > >
> > > Thanks
> > >
> > > Sent from Google Nexus 4
> > > On Dec 26, 2014 11:51 PM, "Somesh Naidu" 
> > wrote:
> > >
> > > > Actually, I would highly consider nic bonding for storage network if
> > > > possible.
> > > >
> > > > -Original Message-
> > > > From: Andrija Panic [mailto:andrija.pa...@gmail.com]
> > > > Sent: Friday, December 26, 2014 4:42 PM
> > > > To: d...@cloudstack.apache.org
> > > > Cc: users@cloudstack.apache.org
> > > > Subject: RE: Physical network design options - which crime to comit
> > > >
> > > > Thanks Somesh, first option also seems most logical to me.
> > > >
> > > > I guess you wouldn't consider doing nic bonding and then vlans with
> > some
> > > > QoS based on vlans on switch level?
> > > >
> > > > Thx again
> > > >
> > > > Sent from Google Nexus 4
> > > > On Dec 26, 2014 9:48 PM, "Somesh Naidu" 
> > wrote:
> > > >
> > > > > I generally prefer to keep the storage traffic separate. Reason is
> > that
> > > > > storage performance (provision templates to primary, snapshots,
> copy
> > > > > templates, etc) significantly impact end user experience. In
> > addition,
> > > it
> > > > > also helps isolate network issues when troubleshooting.
> > > > >
> > > > > So I'd go for one of the following in that order:
> > > > > Case I
> > > > > 1G = mgmt network (only mgmt)
> > > > > 10G = Primary and Secondary storage traffic
> > > > > 10G = Guest and Public traffic
> > > > >
> > > > > Case II
> > > > > 10G = Primary and Secondary storage traffic
> > > > > 10G = mgmt network, Guest and Public traffic
> > > > >
> > > > > Case III
> > > > > 10G = mgmt network, Primary and Secondary storage traffic
> > > > > 10G = Guest and Public traffic
> > > > >
> > > > > -Original Message-
> > > > > From: Andrija Panic [mailto:andrija.pa...@gmail.com]
> > > > > Sent: Friday, December 26, 2014 10:06 AM
> > > > > To: users@cloudstack.apache.org; d...@cloudstack.apache.org
> > > > > Subject: Physical network design options - which crime to comit
> > > > >
> > > > > Hi folks,
> > > > >
> > > > > I'm designing some stuff - and wondering which crime to commit - I
> > > have 2
> > > > > posible scenarios in my head
> > > > > I have folowing NICs available on compute nodes:
> > > > > 1 x 1G NIC
> > > > > 2 x 10G NIC
> > > > >
> > > > > I was wondering which approach would be better, as I', thinking
> > about 2
> > > > > possible sollutions at the moment, maybe 3.
> > > > >
> > > > > *First scenario:*
> > > > >
> > > > > 1G = mgmt network (only mgmt)
> > > > > 10G = Primary and Secondary storage traffic
> > > > > 10G = Guest and Public traffic
> > > > >
> > > > >
> > > > > *Second scenario*
> > > > >
> > > > > 1G = not used at all
> > > > > 10G = mgmt,primary,secondary storage
> > > > > 10G = Guest and Public
> > > > >
> > > > >
> > > > > And possibly a 3rd scenario:
> > > > >
> > > > > 1G = not used at all
> > > > > 10G = mgmt+primary storage
> > > > > 10G = secondary storage, guest,public network
> > > > >
> > > > >
> > > > > I could continue here with different scenarios - but I'm wondering
> if
> > > 1G
> > > > > dedicated for mgmt would make sense - I know it is "better" to have
> > it
> > > > > dedicated if possible, but folowing "KISS" and knowing it's
> extremely
> > > > light
> > > > > weight traffic - I was thinkin puting everything on 2 x 10G
> > interfaces.
> > > > >
> > > > > Any opinions are most welcome.
> > > > > Thanks,
> > > > >
> > > > >
> > > > > --
> > > > >
> > > > > Andrija Panić
> > > > >
> > > >
> 

Re: Using Xen Server and KVM together

[Tim Mackey]

Tilak,

You can definately do this.  Take a look at my multiple hypervisor preso
for 4.4 for some tips:
http://www.slideshare.net/TimMackey/hypervisor-selection-in-apache-cloudstack-44

XenServer does need Intel VT, and that's a good thing all around.

-tim

On Sat, Jan 17, 2015 at 5:08 AM, Tilak Raj Singh  wrote:

> Hi..
>
> I have been using cloudstack using KVM for some time and would now like to
> add a new cluster with Xenserver Hosts..
> I wished to know is that possible for a single cloudstack management server
> to handle both Xen and KVM? If yes can anybody tell me how to proceed to do
> the same?
> Its because the templates for system VM for Xen are different than that of
> KVM and I read that adding support for Xen has to be done before setting up
> the Management Server. I would not like any changes to my current
> cloudstack management server as currently some VMs are running on it.
>
> Also I wished to know is Intel VT necessary to be enabled for Xen too like
> it is for KVM. I browsed a few links and they said that Xen can also work
> without Intel VT enabled from the BIOS given extensive GUI based processing
> is not required on the VMs. So does Cloudstack accept Xen Hosts with Intel
> VT enabled?
>
> Regards
>

Re: Cloudstack + XenServer 6.2 + NetApp in production

[Tim Mackey]

Yiping,

The specific problem covered by that note was solved a long time ago.
Timeouts can be caused by a number of things, and if the entire NetApp
cluster went offline, the XenServer host would be impacted.  Since you are
experiencing a host reboot when this happens, I suspect you have XenServer
HA enabled with the heartbeat on the same NetApp cluster.  In that case, HA
would detect the storage failure and fence the XenServer host.

The solution here would be to understand why your NetApp cluster failed
during scheduled maintenance. Something in your configuration has created a
single point of failure. If you've enabled HA, I also would like to
understand why you've chosen to do that.  Going slightly commercial for a
second, I would also advise you to look into a commercial support contract
for your production XenServer hosts. That team is going to be able to go
deeper, and much quicker, when production issues arise than this list.
NetApp and XenServer is used in a very large number of deployments, so if
there is something wrong they'll be more likely to know. For example, there
could be a set of XenServer or OnTap patches to help sort this out.

-tim

On Fri, Feb 13, 2015 at 7:36 PM, Yiping Zhang  wrote:

> Hi, all:
>
> I am wondering if any one is running their CloudStack in production
> deployments with  XenServer 6.2 + NetApp clusters ?
>
> Recently, in our non production deployment (rhel 6.6 + CS 4.3.0 +
> XenServer 6.2 cluster + NetApp cluster), all our XenServer rebooted
> automatically because of NFS timeout, when our NetApp cluster failover
> happened during a scheduled filer maintenance. My google search turned up
> this Citrix hot fix: http://support.citrix.com/article/CTX135623 for
> XenServer 6.0.2, and this post about XenServer 6.2:
> http://www.gossamer-threads.com/lists/xen/devel/320020 .
>
> Obviously the problem still exists for XenServer 6.2 and we are very
> concerned about going to production deployment based on this technology
> stack.
>
> If anyone has a similar setup, please share your experiences.
>
> Thanks,
>
> Yiping
>
>
>

Re: Cloudstack + XenServer 6.2 + NetApp in production

[Tim Mackey]

Here's a KB which covers how to change the *XenServer* HA setting (not the
CloudStack one): http://support.citrix.com/article/CTX139166.  It would be
good to check /var/log/xha.log to see if any issues were logged there.
Also note that with HA you want always have your hosts NTP sync'd.  With
the default timeout being 30 seconds, I'd start by verifying from your
NetApp admins how long the head was actually offline.  I'd also look into
any network config issues (assuming you've bonded your storage network).

-tim

On Sun, Feb 15, 2015 at 4:28 PM, Adriano Paterlini  wrote:

> Yiping,
>
> We do have a production environment with similar configuration, you can
> check some parameters and logs.
>
> First of all, xenserver nfs timeout will occur every time nfs server takes
> more than 13.3 (40.0/3.0) seconds to answer read or write nfs calls, this
> is defined as SOFTMOUNT_TIMEOUT at /opt/xensource/sm/nfs.py. There are some
> xenserver forum discussions about changing this parameter, my conclusion
> that its not recommended, the consequence would be virtual machines going
> into ready only mode, unless vm parameters are also modified, linux
> defaults usually are 30 seconds. NFS timeouts are shown at
> /var/log/kern.log.
>
> However, the timeout itself does not cause host reboot, the reboot is
> probably due to cloudstack HA storage fence, just as Tim mentioned, storage
> fence is enforced at the script  /opt/cloud/bin/xenheartbeat.sh, you can
> check for the log entries to confirm if it was the case. If its is really
> the case you case adjust the cloudstack global settings parameters
> xenserver.heartbeat.interval and xenserver.heartbeat.timeout to accommodate
> planned maintenance and even automatic storage side HA, you should check
> with Netapp for recommend values for your environment, takeover/giveback
> delays may vary according to controller version and even current controller
> load, Netapp documentation mention 180 seconds as maximum delay. Also check
> if script is running correctly #ps -aux | grep heartbeat, it should take 3
> parameters, if not you may be affected by
> https://issues.apache.org/jira/browse/CLOUDSTACK-7184.
>
> Hope the comments help your decision.
>
>
> Regards,
> Adriano
>
>
> On Sun, Feb 15, 2015 at 12:38 PM,  wrote:
>
> > FYI
> >
> > Sent from my iPhone
> >
> > Begin forwarded message:
> >
> > *From:* Yiping Zhang 
> > *Date:* February 15, 2015 at 2:00:05 AM GMT-2
> > *To:* "users@cloudstack.apache.org" 
> > *Subject:* *Re: Cloudstack + XenServer 6.2 + NetApp in production*
> > *Reply-To:* 
> >
> > Tim,
> >
> > Thanks, for the reply.
> >
> > In our case, the NetApp cluster as a whole did not fail.  The NetApp
> > cluster failover was happening because Operations team was performing a
> > scheduled maintenance, this is normal behavior. To best of my knowledge,
> > NetApp head failover should take anywhere 10-15 seconds.
> >
> > As you guessed correctly, our XenServer resource pool does have HA
> > enabled, and HA shared SR is indeed on the same NetApp cluster as the
> > primary storage SR.  Though I am not sure if enabling xen pool HA is the
> > cause of xenserver¹s  rebooting under this particular scenario.
> >
> > I am not sure if I understand your statement that "In that case, HA would
> > detect the storage failure and fence the XenServer host².  Can you
> > elaborate a little more on this statement?
> >
> > Thanks again,
> >
> > Yiping
> >
> >
> > On 2/14/15, 6:26 AM, "Tim Mackey"  wrote:
> >
> > Yiping,
> >
> >
> > The specific problem covered by that note was solved a long time ago.
> >
> > Timeouts can be caused by a number of things, and if the entire NetApp
> >
> > cluster went offline, the XenServer host would be impacted.  Since you
> are
> >
> > experiencing a host reboot when this happens, I suspect you have
> XenServer
> >
> > HA enabled with the heartbeat on the same NetApp cluster.  In that case,
> >
> > HA
> >
> > would detect the storage failure and fence the XenServer host.
> >
> >
> > The solution here would be to understand why your NetApp cluster failed
> >
> > during scheduled maintenance. Something in your configuration has created
> >
> > a
> >
> > single point of failure. If you've enabled HA, I also would like to
> >
> > understand why you've chosen to do that.  Going slightly commercial for a
> >
> > second, I would also advise you to look into a commercial support
> contract
> >

Re: XenServer (VM_HVM_REQUIRED) - RAW image converted to VHD

[Tim Mackey]

CentOS 7 needs to be HVM for XenServer.  If you created the VM on XenServer
6.5, then when you register it with CloudStack you'll want to set the
"requireshvm" flag when you import.  With CentOS 6, assuming you built it
from the CentOS 6 template, it could be PV or HVM.  I've installed directly
from ISO in 6.5 both CentOS 6 and 7 with no need to modify the kernel.
This is all background information which might guide you a solution.

Looking at your specific comments; since you're starting with a RAW image,
and following that blog post, you're probably starting with an HVM image
(which also explains why things work on KVM).  What I'd do is bypass
CloudStack (remove a moving part) and try and import that VHD directly into
XenServer and see what happens.  Once it comes in, in the CLI issue a 'xe
vm-list params=all uuid=' where  is the uuid of your freshly
imported VM.  Look at the various _boot_ params and see if HVM or PV
options are set.  If HVM_boot_order is set, then you need HVM.  Of course,
if it doesn't import properly, or can't start, that'll be the first thing
to test.

This will confirm both that your VHD is legit, but also if the CloudStack
HVM message is also legit.  If it's legit, you're next challenge will be to
determine why CloudStack thinks you don't have it.  To solve that you'll
need to provide more details on how XenServer was installed, and the
version of CloudStack.

-tim

On Tue, Mar 24, 2015 at 4:50 PM, Leandro Mendes 
wrote:

> I've created the vhd from scratch and registered it through cloudstack API.
>
> Thanks.
>
> On Tue, Mar 24, 2015 at 6:08 AM, Vadim Kimlaychuk <
> vadim.kimlayc...@elion.ee
> > wrote:
>
> > Hi, Leanardo
> >
> > How did you register VHD at XenServer? using import or creating
> VM
> > from template?
> >
> > Vadim.
> >
> > -Original Message-
> > From: Leandro Mendes [mailto:theflock...@gmail.com]
> > Sent: Monday, March 23, 2015 9:05 PM
> > To: users@cloudstack.apache.org
> > Subject: XenServer (VM_HVM_REQUIRED) - RAW image converted to VHD
> >
> > Hi guys,
> >
> > I've created a raw image and installed CentOS 7 (or even 6) into it but
> > cannot boot it inside XenServer 6.5 after convert it to VHD as described
> > here (
> > http://blogs.citrix.com/2012/10/04/convert-a-raw-image-to-xenserver-vhd/
> ).
> >
> > When starting, i get the error VM_HVM_REQUIRED. The guest kernel has Xen
> > enabled.
> >
> > If i convert it to QCOW2, i can boot the same image at my KVM cluster.
> >
> > Do you guys have any problem like this?
> >
> > Thanks.
> >
>

Re: VHD-UTIL ACS 4.5

[Tim Mackey]

It all depends on what version of XenServer you are using.  With XenServer
6.5, you shouldn't need to replace vhd-util any longer.  With earlier
versions, you've the correct replacement.

btw, the 4.5 docs are:
http://docs.cloudstack.apache.org/projects/cloudstack-installation/en/latest/

-tim

On Tue, Mar 31, 2015 at 3:22 PM, Nikolas Wostor  wrote:

> Hi all,
>
> I perform a new installation of ACS 4.5 (shapeblue repo) following the
> documentation of "
>
> http://docs.cloudstack.apache.org/projects/cloudstack-installation/en/4.4/installation.html
> ",
> because 4.5 documentation don't exist.
>
> Do you know another link to oficial documentation?
>
> At moment I download the vhd-util of 4.4 link "
> http://download.cloud.com.s3.amazonaws.com/tools/vhd-util";, any problem
> use
> that?
>
> Thank you all!
>
> Nikolas Wostor
>

Re: XenServer cluster size

[Tim Mackey]

Yiping,

Here's the detailed answer 

>From the XenServer perspective, there are a number of factors which go into
how various configuration limits are arrived at. Most of the time, they
aren't hard limits (for example I know of users with more than 16 hosts in
a pool). What the XenServer team do is for a given metric they determine
the point at which overall scalability is reduced to a target threshold.
That then becomes the "configuration limit" for a given release, and we
retest with every version.

In the case of the "hosts per pool" limit, we need to ensure that all
operations we have can be performed without impairment with a given number
of hosts in a pool. We've kept the same maximum number of hosts in a pool
for a very long time (close to ten years so far), and that's a direct
reflection of how much we've increased individual host scalability.

>From a CloudStack perspective, there have been a number of serious scale
limits which have pushed XenServer. Hundreds of VLANs is one example that
Ahmad cites, but its also a case of the number of VMs and needing to manage
all those VM objects.  iirc, the eight host recommendation came from some
large deployment requirements. If you don't have a need for 100s of VLANs
per pool, or aren't running 100s of VMs per host, you likely will be able
to get more than eight hosts per pool.

>From an operations perspective, I would look closely at your pool size and
ask the question of why you want to such a large pool.  I'd argue having
two pools of five hosts is more efficient in CloudStack than a single pool
of ten hosts, plus if something should happen to one pool, the remaining
pool will continue to be available.  CloudStack is very efficient at
managing resource pools, so many of the reasons traditional server admins
cite for wanting large pool sizes aren't as relevant in CloudStack.

Of particular note is how you scale. With a ten host pool size, that's your
scalability block size, so as you grow you'll want to increase capacity in
chunks of ten hosts. With a smaller pool size, you'd be able to add
capacity in much smaller chunks.

-tim

On Tue, Mar 8, 2016 at 5:24 PM, Ahmad Emneina  wrote:

> IIRC, its just a recommendation. I think it stemmed from performance
> impact, due to numerous VLAN's present, in environments with lots of
> tenants.
>
> On Tue, Mar 8, 2016 at 2:10 PM, Yiping Zhang  wrote:
>
> > Hi, all:
> >
> > The CloudStack doc recommends that for XenServer, do not put more than 8
> > hosts in a cluster, while the Citrix XenServer doc says that XenServer
> 6.5
> > can natively support 16 hosts in a cluster (resource pool).
> >
> > I am wondering why CloudStack is recommending a smaller cluster size than
> > that XenServer can natively support?  If I create a cluster with 10
> > XenServers, what could go wrong for me ?  Has any one tried with CS
> cluster
> > with >8 XenServer hosts ?
> >
> > My environment is CS 4.5.1 (soon to be upgraded to 4.8.0) on RHEL 6.7 and
> > XenServer 6.5, using NetApp volumes for both primary and secondary
> storages.
> >
> > Yiping
> >
>

Re: XenServer cluster size

[Tim Mackey]

In that case, Yiping, I would *definitely* recommend putting those servers
into at least two pools. The processors used in Gen8 and Gen9 servers can
not currently be joined into the same pool, and you actually need to be
very sensitive to the processor steppings. Dundee should fix that, but no
current version of CloudStack supports Dundee (and neither does Citrix at
the moment).

-tim

On Wed, Mar 9, 2016 at 12:38 PM, Yiping Zhang  wrote:

> Hi, Tim:
>
> Thanks for very detailed reply.
>
> These are Gen8 HP blades and all my new servers will be Gen9.  That’s why
> I’d like to combine them into one maxed out cluster.  I have only two guest
> VLAN’s and roughly 400 VM instances for this 10 hosts cluster.  So I think
> performance wise I should be OK.
>
> Yiping
>
>
>
> On 3/8/16, 4:28 PM, "Tim Mackey"  wrote:
>
> >Yiping,
> >
> >Here's the detailed answer 
> >
> >From the XenServer perspective, there are a number of factors which go
> into
> >how various configuration limits are arrived at. Most of the time, they
> >aren't hard limits (for example I know of users with more than 16 hosts in
> >a pool). What the XenServer team do is for a given metric they determine
> >the point at which overall scalability is reduced to a target threshold.
> >That then becomes the "configuration limit" for a given release, and we
> >retest with every version.
> >
> >In the case of the "hosts per pool" limit, we need to ensure that all
> >operations we have can be performed without impairment with a given number
> >of hosts in a pool. We've kept the same maximum number of hosts in a pool
> >for a very long time (close to ten years so far), and that's a direct
> >reflection of how much we've increased individual host scalability.
> >
> >From a CloudStack perspective, there have been a number of serious scale
> >limits which have pushed XenServer. Hundreds of VLANs is one example that
> >Ahmad cites, but its also a case of the number of VMs and needing to
> manage
> >all those VM objects.  iirc, the eight host recommendation came from some
> >large deployment requirements. If you don't have a need for 100s of VLANs
> >per pool, or aren't running 100s of VMs per host, you likely will be able
> >to get more than eight hosts per pool.
> >
> >From an operations perspective, I would look closely at your pool size and
> >ask the question of why you want to such a large pool.  I'd argue having
> >two pools of five hosts is more efficient in CloudStack than a single pool
> >of ten hosts, plus if something should happen to one pool, the remaining
> >pool will continue to be available.  CloudStack is very efficient at
> >managing resource pools, so many of the reasons traditional server admins
> >cite for wanting large pool sizes aren't as relevant in CloudStack.
> >
> >Of particular note is how you scale. With a ten host pool size, that's
> your
> >scalability block size, so as you grow you'll want to increase capacity in
> >chunks of ten hosts. With a smaller pool size, you'd be able to add
> >capacity in much smaller chunks.
> >
> >-tim
> >
> >On Tue, Mar 8, 2016 at 5:24 PM, Ahmad Emneina  wrote:
> >
> >> IIRC, its just a recommendation. I think it stemmed from performance
> >> impact, due to numerous VLAN's present, in environments with lots of
> >> tenants.
> >>
> >> On Tue, Mar 8, 2016 at 2:10 PM, Yiping Zhang 
> wrote:
> >>
> >> > Hi, all:
> >> >
> >> > The CloudStack doc recommends that for XenServer, do not put more
> than 8
> >> > hosts in a cluster, while the Citrix XenServer doc says that XenServer
> >> 6.5
> >> > can natively support 16 hosts in a cluster (resource pool).
> >> >
> >> > I am wondering why CloudStack is recommending a smaller cluster size
> than
> >> > that XenServer can natively support?  If I create a cluster with 10
> >> > XenServers, what could go wrong for me ?  Has any one tried with CS
> >> cluster
> >> > with >8 XenServer hosts ?
> >> >
> >> > My environment is CS 4.5.1 (soon to be upgraded to 4.8.0) on RHEL 6.7
> and
> >> > XenServer 6.5, using NetApp volumes for both primary and secondary
> >> storages.
> >> >
> >> > Yiping
> >> >
> >>
>

Re: Unable to add *.iso templates on clean installation (4.8.0)

[Tim Mackey]

Welcome, Carlos.

There are a few possibilities, but the first thing to know is that
catalina.out isn't the log you should be looking at. Take a look here for
some tips on troubleshooting:
http://docs.cloudstack.apache.org/projects/cloudstack-administration/en/4.8/troubleshooting.html.
The one thing you'll note is management-server.log is rather verbose, so
it's not a bad idea to have it running through tail while performing
whatever task isn't cooperating.

In terms of possibilities for what's going on, you should know that
registering it via the UI adds it to the database, but there is a
background task which actually copies the ISO contents, and that could be
erroring out. I don't have the UI in front of me, but if you click on the
ISO name, you'll see an icon for details in the zone. Click on that and you
can see the status. Under normal conditions, it'll show "x%" while
downloading, and "Ready" when done. "Error" obviously means something went
wrong, and the management server log will be your friend.

One thing to note is that if you're using a private address for your
upload, then you need to set the global properties for
"secstorage.allowed.internal.sites" to the CIDR which encompasses the HTTP
server. This change will require the management server to be restarted, but
is easily the 80% case if your secondary storage is correct.

btw, once you get this sorted out for ISOs, you'll have also sorted it out
for templates.

-tim

On Wed, Apr 13, 2016 at 8:55 PM, Carlos Miranda Molina (Mstaaravin) <
mstaara...@gmail.com> wrote:

> Hello everyone!
>
> I have a clean installation of the last Cloudstack version in a single
> server, all works fine (installation process)
>
> When I try to add/register ISO the process on admin finish ok, but in my
> catalina.out i saw this:
>
> INFO  [o.a.c.s.d.l.CloudStackImageStoreLifeCycleImpl]
> (catalina-exec-22:ctx-4f830014 ctx-b5de287f) (logid:7ced2224) Trying to add
> a new data store at nfs://cloud01/secondary to data center 1
>
> And of course the *.iso wan't added.
>
> An df -h on my single server show me this:
>
> [root@cloud01 ~]# mount
> /dev/vda1 on / type ext4 (rw)
> proc on /proc type proc (rw)
> sysfs on /sys type sysfs (rw)
> devpts on /dev/pts type devpts (rw,gid=5,mode=620)
> tmpfs on /dev/shm type tmpfs (rw)
> none on /proc/sys/fs/binfmt_misc type binfmt_misc (rw)
> sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw)
> nfsd on /proc/fs/nfsd type nfsd (rw)
> cloud01:/primary on /mnt/85d75932-3c49-371c-8680-ce1c8fb2e216 type nfs
> (rw,noac,actimeo=0,vers=4,addr=172.16.251.51,clientaddr=172.16.251.51)
>
> Any suggestion...?
>
> Regards
>
> --
> "La Voluntad es el único motor de nuestros logros"
> http://blog.ngen.com.ar/
>

Re: Unable to add *.iso templates on clean installation (4.8.0)

[Tim Mackey]

Umm, a thought. Has the secondary storage VM started (view on
infrastructure tab). If not, you'll want to debug that first. Here's some
debugging tips for SSVM:
https://cwiki.apache.org/confluence/display/CLOUDSTACK/SSVM,+templates,+Secondary+storage+troubleshooting

On Wed, Apr 13, 2016 at 10:20 PM, Rafael Weingärtner <
rafaelweingart...@gmail.com> wrote:

> I did not understand? you did mounted the NFS folder on the MS?
>
> I did not understand the link between the used that is used to run the MS
> and the point regarding the SSVM.
>
> The MS sends the command to download the ISO to the MS, that I am almost
> sure. Haven't you checked the SSVM? Have you checked if the SSVM can solve
> that "cloud01" server name you used?
>
> What DNS server are you using? I mean the DNS server you fill out when
> deploying the environment
>
>
>
> On Wed, Apr 13, 2016 at 11:12 PM, Carlos Miranda Molina (Mstaaravin) <
> mstaara...@gmail.com> wrote:
>
> > Thanks for yout time Rafael, my answers between lines...
> >
> >
> > On Wed, Apr 13, 2016 at 10:47 PM, Rafael Weingärtner <
> > rafaelweingart...@gmail.com> wrote:
> >
> > > Well, I saw your other email with the error.
> > >
> > > Did you try to mount the secondary storage at the MS?
> > >
> > I try now:
> >
> > cloud01:/primary on /mnt/85d75932-3c49-371c-8680-ce1c8fb2e216 type nfs
> > (rw,noac,actimeo=0,vers=4,addr=172.16.251.51,clientaddr=172.16.251.51)
> > cloud01:/secondary on /mnt/5862742d-b25b-35fd-a35b-0a96655f4ebd type nfs
> > (rw,noac,actimeo=0,vers=4,addr=172.16.251.51,clientaddr=172.16.251.51)
> >
> > I restart management and try again, with the same result :\
> >
> >
> >
> > >
> > >
> > > If I am not wrong, the Secondary storage VM is the one that mounts the
> > > storage and downloads the ISOs and VHDs. Have you tried to access it,
> and
> > > check its connectivity? Did you set the Google's DNS as your primary
> DNS
> > > servers? If so, it would not possible to resolve that name you are
> using
> > > for your storage server.
> > >
> > Good idea, but all works fine, because management run with cloud user:
> >
> > [root@cloud01 ~]# su cloud -c 'nslookup mirrors.kernel.org'
> > Server: 172.16.251.1
> > Address:172.16.251.1#53
> >
> > Non-authoritative answer:
> > mirrors.kernel.org  canonical name = mirrors.us.kernel.org.
> > Name:   mirrors.us.kernel.org
> > Address: 198.145.20.143
> > Name:   mirrors.us.kernel.org
> > Address: 149.20.37.36
> >
> >
> > thanks
> > --
> > "La Voluntad es el único motor de nuestros logros"
> > http://blog.ngen.com.ar/
> >
>
>
>
> --
> Rafael Weingärtner
>

Re: SOLVED Re: Unable to add *.iso templates on clean installation (4.8.0)

[Tim Mackey]

Excellent news, and thanks for closing the loop on this.

-tim

On Thu, Apr 14, 2016 at 4:29 PM, Carlos Miranda Molina (Mstaaravin) <
mstaara...@gmail.com> wrote:

> Hi!
>
> Well.. Today I continue with my troubleshooting
>
> The problem basically was this:
>
> I use a hostname as a NFS server: cloud01, but because I use google dns as
> a external/internal my ssvm can't solve that host to IP so.
>
> I have 2 choices...
>
> 1. edit DNS servers and change to my local LAN DNS and add cloud01 to my
> specific IP, I think I can edit over cloudmonkey
> 2. Because I'm using a VM with nesting virtualization, I rollback to
> installed cloudstack only and restart configuration process, and now I use
> IP instead hostnames.
>
> Now, my cloudtstack installation works with templates (login to ssvm and
> /secondary is mounted) so works!
>
> Thanks for help guys.  :D
>
>
>
> On Wed, Apr 13, 2016 at 11:30 PM, Tim Mackey  wrote:
>
> > Umm, a thought. Has the secondary storage VM started (view on
> > infrastructure tab). If not, you'll want to debug that first. Here's some
> > debugging tips for SSVM:
> >
> >
> https://cwiki.apache.org/confluence/display/CLOUDSTACK/SSVM,+templates,+Secondary+storage+troubleshooting
> >
>
>
>
>
> --
> "La Voluntad es el único motor de nuestros logros"
> http://blog.ngen.com.ar/
>

Re: XenServer nested on XenServer

[Tim Mackey]

Maruko-san,

Since nested XenServer isn't officially supported by Citrix, it's entirely
possible that some aspect of the nesting which CloudStack requires is
missing/broken.

As Paul indicated, knowing more about your configuration is crucial. First
and foremost, you'll need to be running on the latest XenServer 6.5 (SP1
with all patches).  Normally, I'd recommend XenServer 7, but iirc support
in CloudStack is missing. The second thing will be to confirm that you can
create a PV enabled VM in the nested configuration (e.g. centOS 6.x) using
stock XenServer/XenCenter. If you can create and launch this VM, then
that's a good sign. Since you're stating that the VR started, I think
you're in good shape here, but wanted to ensure I give a complete triage.

Assuming the problem is localized to the VR, there are a couple of
possibilities, and I'd first start by removing nested XenServer from the
equation. Far too often my VR problems have been with the VR itself or
physical network and not the hypervisor. For example, is the VR being
created in the nested XenServer environment, or the root one? What is the
network relationship between host networking (physical network and root
XenServer) and the nested network?

-tim

On Mon, Jun 13, 2016 at 9:26 AM, Remi Bergsma 
wrote:

> I kinda like shameless self-plugs although I fail to see how this one
> answers the question asked?
>
> On 13/06/16 14:09, "Paul Angus"  wrote:
>
> >Hi Maruko San
> >
> >We'd need to see the details of your networking.
> >We've created Trillian   github.com/shapeblue/Trillian - it's based on
> ESXi and uses CloudStack to orchestrate everything.
> >
> >
> >
> >Kind regards,
> >
> >Paul Angus
> >
> >paul.an...@shapeblue.com
> >www.shapeblue.com
> >53 Chandos Place, Covent Garden, London  WC2N 4HSUK
> >@shapeblue
> >
> >
> >
> >-Original Message-
> >From: 丸子良太 / MARUKO，RYOTA [mailto:ryota.maruko...@hitachi-solutions.com]
> >Sent: 13 June 2016 07:53
> >To: users@cloudstack.apache.org
> >Subject: XenServer nested on XenServer
> >
> >Hi
> >
> >I tried to create XenServer nested on XenServer for CloudStack.
> >It is success to create XenServer nested on XenServer, And CloudStack
> Manager create the system VMs.
> >
> >But VR could not access the user VMs.
> >
> >Please tell me about the problem.
> >
> >Regards
> >
>
>

Re: XenServer nested on XenServer

[Tim Mackey]

Maruko-san,

The problem is that you're using advanced networking. Advanced networking
requires the physical switch to have its switch ports trunked. When you run
a nested XenServer, that physical switch becomes the *virtual* switch of
the XenServer. While I believe it is possible to configure the virtual
switch to allow a given virtual switch port to run in a trunked mode, the
XenServer api isn't coded to allow for this.

What this means is that in order to make your configuration function,
you're going to need to determine a number of things (XenServer vif and pif
ports), and then directly configure the ovs (open virtual switch) to allow
trunked operations for your VLANs. Complicating matters is that you'll need
to do this both on every host in the pool, but also at each server restart.
The latter is due to the vif port on the ovs being different as each VM
boots, and a reboot will change that port (even though the vif remains the
same).

I *think* MAC forwarding will work properly, so I'd suggest trying to use
basic networking.

btw, what I outlined for the advanced networking is very much "unsupported
by Citrix" at this time

-tim

On Wed, Jun 15, 2016 at 7:58 AM, Paul Angus 
wrote:

> Hi Ryota,
>
> A lot here depends on the 'outside' XenServer's openvswiches ability to
> pass traffic to a MAC that it can't see. And with the trunking of VLANs
> The first test I would do is migrate the UserVM to XenServer01-002. If
> they can communicate then your issue is with the outer networking.
>
> Tim and Remi may know more about bending XenServer networking to your
> will, but from my general experience:
>
> You many well need to configure your outer XenServer (XenServer01) to use
> promiscuous mode on any interfaces which the nested XenServers use.
> http://support.citrix.com/article/CTX121729
> and
> you'll need to ensure that tagged VLANs are passed through the guest
> interfaces on the parent XenServer (XenServer01) as XenServer01-002 will
> tag traffic with VLAN x,y,z (guest VLAN) which needs to be retained and
> passed to XenServer01-003 - I don't know how to do that for a XenServer...:(
>
> there is also an experimental setting for nested XenServers:
>
> https://justus.berlin/2015/07/nested-virtualization-in-citrix-xenserver-6-5-sp1/
>
>
>
>
> Kind regards,
>
> Paul Angus
>
> paul.an...@shapeblue.com
> www.shapeblue.com
> 53 Chandos Place, Covent Garden, London  WC2N 4HSUK
> @shapeblue
>
>
>
> -Original Message-
> From: 丸子良太 / MARUKO，RYOTA [mailto:ryota.maruko...@hitachi-solutions.com]
> Sent: 15 June 2016 09:57
> To: users@cloudstack.apache.org
> Subject: RE: XenServer nested on XenServer
>
> Dear Paul&Remi&Tim
>
> My networking is as follows.
>
> The zone is Advanced mode.
> I made 3 XenServers as XenServer01-001/002/003 on XenServer01.
> And I could add the 3 hosts to CloudStack.
> SSVM and CPVM started in XenServer01-001.
> So, I could deploy UserVM in XenServer01-002 and VR(DHCP) in
> XenServer01-003.
>
> 
> ManagementServer(172.168.100.110)
> |
> |
> (PhysicalNetwork)
> |
> |
> XenServer01(172.168.100.100)
>   
>XenServer01-001(172.168.100.101)  <--SSVM/CPVM
>XenServer01-002(172.168.100.102)  <--VR(DHCP)
>XenServer01-003(172.168.100.103)  <--UserVM
>   
> 
>
>
> But, it could not access between the UserVM and the VR.
> I wander if VLAN is not granted because of the nested XenServer.
>
> ~~
> VR -OK-> XenServer01-002 -OK-> XenServer01 -NG??-> XenServer01-003 -->
> UserVM ~~
>
> Regards
>
>
>
> >-Original Message-
> >From: 丸子良太 / MARUKO，RYOTA
> >[mailto:ryota.maruko...@hitachi-solutions.com]
> >Sent: Tuesday, June 14, 2016 5:42 PM
> >To: users@cloudstack.apache.org
> >Subject: RE: XenServer nested on XenServer
> >
> >Hi, Paul&Remi&Tim
> >
> >Thank you for your e-mail.
> >And I will write the details of my networking.
> >
> >Please wait for my e-mail.
> >(English is too difficult for me(^^))
> >
> >Regards
> >
> >
> >>-Original Message-
> >>From: Remi Bergsma [mailto:rberg...@schubergphilis.com]
> >>Sent: Tuesday, June 14, 2016 4:27 PM
> >>To: users@cloudstack.apache.org
> >>Subject: Re: XenServer nested on XenServer
> >>
> >>Hi Paul,
> >>
> >>I don’t get it but that’s probably me :-) Never mind.
> >>
> >>Regards,
> >>Remi
> >>
> >>On 13/06/16 16:00, "Paul Angus"  wrote:
> >>
> >>>Remi,
> >>>
> >>>I think asking for the details for Maruko San's networking in order
> >>>to give him (hopefully) useful specific help covered
> >>that part.
> >>>
> >>>Haters gonna hate.
> >>>Paul Angus
> >>>
> >>>paul.an...@shapeblue.com
> >>>www.shapeblue.com
> >>>53 Chandos Place, Covent Garden, London  WC2N 4HSUK @shapeblue
> >>>
> >>>
> >>>
> >>>-Original Message-
> >>>From: Remi Bergsma [mailto:rberg...@schubergphilis.com]
> >>>Sent: 13 June 2016 14:26
> >>>To: users@cloudstack.apache.org

Re: Re: XenServer nested on XenServer

[Tim Mackey]

Maruko-san,

My expectation is even with KVM you'd experience similar problems. Assuming
KVM will virtualize XenServer (not something I'm aware of it being a
working configuration), you'd still have the networking problems to
address. Paul can confirm, but to the best of my knowledge, the only
hypervisor with a virtual switch which properly supports trunking is
vSphere Enterprise Plus (and may require Cisco Nexus 1000v). I am aware of
people nesting XenServer in vSphere for training purposes, but the
performance is low (iirc nested vSphere emulates some of the hypervisor
calls rather than using pure hardware).

-tim

On Wed, Jun 15, 2016 at 10:37 PM, 丸子良太 / MARUKO，RYOTA <
ryota.maruko...@hitachi-solutions.com> wrote:

> Dear Paul, Tim
>
> Thank you for your answer.
>
> It can run on the "NO" nested XenServer with some physical server and
> physical switch.
> My goal was to build an easy test environment,
> And to be prepared in fewer resources
> (1 phisical Management Server and some hypervisor on 1 phisical
> hypervisor).
>
> So take the time I think I will give up
> Last question!!
> Will I be able to construct "XenServer nested on KVM"???
>
> Regards
>
>
> >-Original Message-
> >From: Tim Mackey [mailto:tmac...@gmail.com]
> >Sent: Wednesday, June 15, 2016 10:39 PM
> >To: users@cloudstack.apache.org
> >Subject: [!]Re: XenServer nested on XenServer
> >
> >Maruko-san,
> >
> >The problem is that you're using advanced networking. Advanced networking
> >requires the physical switch to have its switch ports trunked. When you
> run
> >a nested XenServer, that physical switch becomes the *virtual* switch of
> >the XenServer. While I believe it is possible to configure the virtual
> >switch to allow a given virtual switch port to run in a trunked mode, the
> >XenServer api isn't coded to allow for this.
> >
> >What this means is that in order to make your configuration function,
> >you're going to need to determine a number of things (XenServer vif and
> pif
> >ports), and then directly configure the ovs (open virtual switch) to allow
> >trunked operations for your VLANs. Complicating matters is that you'll
> need
> >to do this both on every host in the pool, but also at each server
> restart.
> >The latter is due to the vif port on the ovs being different as each VM
> >boots, and a reboot will change that port (even though the vif remains the
> >same).
> >
> >I *think* MAC forwarding will work properly, so I'd suggest trying to use
> >basic networking.
> >
> >btw, what I outlined for the advanced networking is very much "unsupported
> >by Citrix" at this time
> >
> >-tim
> >
> >On Wed, Jun 15, 2016 at 7:58 AM, Paul Angus 
> >wrote:
> >
> >> Hi Ryota,
> >>
> >> A lot here depends on the 'outside' XenServer's openvswiches ability to
> >> pass traffic to a MAC that it can't see. And with the trunking of VLANs
> >> The first test I would do is migrate the UserVM to XenServer01-002. If
> >> they can communicate then your issue is with the outer networking.
> >>
> >> Tim and Remi may know more about bending XenServer networking to your
> >> will, but from my general experience:
> >>
> >> You many well need to configure your outer XenServer (XenServer01) to
> use
> >> promiscuous mode on any interfaces which the nested XenServers use.
> >> http://support.citrix.com/article/CTX121729
> >> and
> >> you'll need to ensure that tagged VLANs are passed through the guest
> >> interfaces on the parent XenServer (XenServer01) as XenServer01-002 will
> >> tag traffic with VLAN x,y,z (guest VLAN) which needs to be retained and
> >> passed to XenServer01-003 - I don't know how to do that for a
> XenServer...:(
> >>
> >> there is also an experimental setting for nested XenServers:
> >>
> >>
> https://justus.berlin/2015/07/nested-virtualization-in-citrix-xenserver-6-5-sp1/
> >>
> >>
> >>
> >>
> >> Kind regards,
> >>
> >> Paul Angus
> >>
> >> paul.an...@shapeblue.com
> >> www.shapeblue.com
> >> 53 Chandos Place, Covent Garden, London  WC2N 4HSUK
> >> @shapeblue
> >>
> >>
> >>
> >> -Original Message-
> >> From: 丸子良太 / MARUKO，RYOTA [mailto:ryota.maruko...@hitachi-solutions.com
> ]
> >> Sent: 15 June 2016 09:57
> >> To: users@cloudstack.apache.org
> >> Subjec

Re: Opportunity to contribute in Apache CloudStack

[Tim Mackey]

Jainesh, and by extension all members of TheAtom, welcome to the CloudStack
project. You'll want to join the development list (d...@cloudstack.apache.org),
and look at the contributing section here:
https://github.com/apache/cloudstack and here:
https://cloudstack.apache.org/developers.html.

A proposal was put to the dev list for the 2016-2017 roadmap earlier this
week (
http://mail-archives.apache.org/mod_mbox/cloudstack-dev/201607.mbox/%3cc10c1a0c-4d57-4fb4-8812-b20aa1ea8...@shapeblue.com%3E
). That would probably be an excellent starting point to see the direction
of the project overall. As with most projects, its probably best to start
small and fix a few issues before starting in on something substantial.

For something more substantial, and depending upon your skill set, there
has been an open proposal to bring pure Xen in as fully supported
hypervisor. Knowing a bit of what's involved there, it might fit well with
your time frame, plus I know there are some who would welcome that work. I
also have a smaller project in the security space which might be
interesting, but haven't made the proposal to the list yet. In all cases,
the hope would be that you'd continue to be involved with the project upon
project completion.

(cross posted to dev@ to keep me honest - suspect further discussion should
occur on dev@ and not users@ )

-tim




On Wed, Jul 6, 2016 at 6:05 AM, Jainesh Patel  wrote:

> Hello,
>
> We are a group of students that are currently pursuing our undergraduate
> degree in Computer Science from Pune Insititute of Computer
> Technology(PICT), Maharashtra, India. We will be graduating in June 2017
> and are currently in our final year. For our B.E project, we have selected
> the domain as Cloud Computing and would be very interesting in working with
> open source cloud computing software, which is where we stumbled upon
> Apache CloudStack.
>
> It will be a great learning opportunity for us to work with Apache
> CloudStack and in turn work with you. We would appreciate if you could
> steer us towards the direction of choosing the right topic and working
> towards culminating a project in the same, which would be helpful for the
> community.
>
> Following are the few details which include information about us, which
> would help you in making an informed decision:
>
> 1) Group Name- TheAtom
>
> 2) Group Members:
> Shubham Mulay ( shubhammu...@gmail.com )
> Faizaan Shaikh ( faizaanshai...@gmail.com )
> Jainesh Patel ( jainesh...@gmail.com )
>
> 3) We have two mentors working with us, who will be guiding throughout the
> process,
> Dhruvesh Rathore ( dhruves...@hotmail.com )
> Prerit Auti ( prerita...@gmail.com )
>
> 4) Development time : 6 to 7 months from Aug '16 to Feb '17.
>
> We would love to hear from you about any ideas that you see fit for us to
> pursue and which are feasible in the specified time frame. Hoping to hear
> from you soon, and thanking you in anticipation.
>
> Regards,
> TheAtom
>

Re: Managed Storage

[Tim Mackey]

Jeff,

Here's the way I look at things when XenServer is the hypervisor, and this
is primary storage specific.

NFS
- NFS mount is created outside of XenServer, and within CS you create
primary storage using that mount. You then effectively bind that primary
storage to a XenServer cluster forming what XenServer refers to as an "NFS
SR". If you look at the configuration from a XenServer perspective, there
is an SR which has a uuid matching that of the CS primary storage.

iSCSI
- If you're using single path without CHAP, then this is very similar to
the NFS case, except that you start with a pre-existing LUN and end up with
an iSCSI SR instead of an NFS one.
- If you're using multi-path or require CHAP, then you setup the iSCSI SR
using the XenServer methods (CLI, API, XenCenter), and tell CS about this
storage using the "PreSetup" option. This gives a bit more flexibility on
the storage backend at the expense of storage being a blackbox to CS

HBA/Fiber
- This is always configured using the "PreSetup" name as CS has no concept
of WWID/WWN.

Storage direct plugin
- This is the SolidFire/NetApp case where those arrays have a special
understanding of CloudStack and expose additional configuration options.

Local storage
- Unless explicitly configured for use with CS, this is unused. Any
existing local storage on a XenServer host when the host is added to
CloudStack will be lost.

In the case of everything *except* PreSetup, I think of managed storage
being one where CloudStack actually configures the host for the storage,
and may optionally configure the storage for CloudStack. In other words, if
I can just consume some storage provided by a storage admin, and other than
configuration within CloudStack it "just works", then that's managed.

-tim





On Wed, Aug 3, 2016 at 8:09 AM, Jeff Hair  wrote:

> So essentially, CS is categorizing managed storage as something it needs to
> make a series of API calls etc to in order to set up and configure it?
> Whereas unmanaged is something it expects you to provide settings for when
> adding, and expects you to have set it up yourself prior to adding?
>
> *Jeff Hair*
> Technical Lead and Software Developer
>
> Tel: (+354) 415 0200
> j...@greenqloud.com
> www.greenqloud.com
>
> On Wed, Aug 3, 2016 at 11:39 AM, Erik Weber  wrote:
>
> > My understanding is that managed storage are managed by a cloudstack
> > plugin, e.g. where cloudstack does something on the actual storage
> > (provision a lun or something), whilst unmanaged is managed outside of
> > cloudstack (for instance by you).
> > An example of a manged storage is Solidfire, an example of unmanaged is
> > Your local NFS server where you manually exported a mountpoint.
> >
> > Hope that clears it up :-)
> >
> > --
> > Erik
> >
> > On Wed, Aug 3, 2016 at 12:33 PM, Jeff Hair  wrote:
> >
> > > Hi,
> > >
> > > Is there anywhere in the mailing list, documentation, etc about what
> > > exactly "managed storage" means? Or can someone explain the difference
> > > between managed and unmanaged? The API docs say that it means whether
> or
> > > not the storage is "managed by CloudStack." This isn't very detailed
> > > information though. I've scoured the docs via Google but I don't see
> > > anything really about it.
> > >
> > > Thanks,
> > >
> > > Jeff
> > >
> >
>

Re: New Initial HW Setup

[Tim Mackey]

Good morning.

I think it's probably best to take a step back and define a couple of
things.


1. The management server is really a highly efficient cluster manager. It
runs external to the compute nodes.
2. A compute node contains CPU and RAM, has a network fabric, and may have
local storage. Compute nodes can be clustered based on the native
capabilities of the chosen hypervisor (e.g. XenServer uses the XAPI cluster
manager with its rules, while KVM is a collection hosts).
3. A compute node can be bare metal, but those rules are very different.

I used to present a hypervisor matrix, and here's my most recent deck:
http://www.slideshare.net/TimMackey/selecting-the-correct-hypervisor-for-cloudstack-45.
Much of whats in there will be relevant to you at this point.

Looking at your specific questions:

 - " *how does the primary management server hosting the CS panel, utilize
processing power from external additional NODES*". First you will configure
the management server with knowledge of the compute node. The management
server then understands the capacity of the compute node, and from there
you can do stuff like provision VMs. For example, if you've a template
which has a compute offering with 2vCPUs, 8GB RAM and two vNICs, that's how
the management server will setup the VM which will be based on the template
the user chooses.

- "*sell equivalent of **standalone dedicated servers, how would that work*".
If the goal is to provide an equivalent of a bare metal virtual server,
then things are much more involved from the user perspective (e.g. you need
to start with a predefined ISO). If the goal is to provide a VPS from a set
of predefined OS types, then that's easier - just upload a template for
each one. The user then selects which template they want and it gets
provisioned.

- "*If I'm guaranteeing 500GB SSD storage, 4 CPU Cores and **32GB RAM
he/she would have no way of knowing if it's cloud based or **standalone, am
I right or wrong*". It depends upon what you're guaranteeing. Within the
guest it would be easy to tell if you've 4 cores, 32 GB RAM and 500GB disk.
What would be hard to tell is if the vCPUs are dedicated or overloads, and
if the disk was SSD. As a user, I honestly care less about SSD than IOPs,
and there are ways to tell that.

btw, everywhere I mention "user selects" that could be a workflow you kick
off on behalf of the user. It's entirely possible to provide only guest VM
access via SSH if you don't want users to have access to the CloudStack
management console.

Hope this helps some, and if I've misspoken something, I'm certain others
will set me right!

-tim


On Tue, Sep 27, 2016 at 8:27 AM, NOC  wrote:

> Hello,
>
>
>
> Looking to start up a virtualized setup using CloudStack and would like
> some
> feedback / advice as I do some researching.
>
>
>
> For starting off, was looking to do a single NODE instead of separate NODES
> for CPU/RAM, Storage.
>
>
>
> Example:
>
>
>
> Dell R815
>
> 4 x Opteron 16-Core CPUs
>
> 256GB RAM
>
> 6 x 2TB SSD Drives
>
> Perc H700 RAID
>
> Centos 7 64 bit
>
>
>
> Wouldn't that be sufficient enough to get going and just add more, similar
> nodes down the road seamlessly for additional processing power and RAM?
>
>
>
> One of my main confusion is how does the primary management server hosting
> the CS panel, utilize processing power from external additional NODES? I
> cannot understand how this happens and would appreciate some explanation.
>
>
>
> From my understanding, CS basically creates the equivalent of virtual
> servers (VPS). So in essence, scaling up or down you can offer cloud
> hosting
> (ie like shared hosting) and virtual servers. But, to sell equivalent of
> standalone dedicated servers, how would that work? You cannot offer the
> client KVM/IPMI, yet how does one prove if the server is virtualized or
> not,
> on the client side? If I'm guaranteeing 500GB SSD storage, 4 CPU Cores and
> 32GB RAM he/she would have no way of knowing if it's cloud based or
> standalone, am I right or wrong?
>
>
>
> Thanks in advance for the tips.
>
>
>
>

Re: New Initial HW Setup

[Tim Mackey]

On Tue, Sep 27, 2016 at 12:34 PM, NOC  wrote:

> Thanks for the feedback!
>
> Ok so management server is just a standalone server (no fancy specs
> generally speaking) for the CS control panel itself.
>

Yes. I've run smallish installations with a single management server
running in a VM. If the management server goes down, everything keeps
going; you've just lost the UI/API for the duration of the outage.

>
> Compute NODE: CPU, RAM, Local Storage. That's my goal, using KVM as a
> platform. So essentially, I can do this for example:
>
> Compute NODE Specs:
>
> Dell R815
> 4 x Opteron 16-Core CPUs
> 256GB RAM
> 6 x 2TB SSD Drives
> Perc H700 RAID
> KVM Platform (offering Linux & Windows templates)
>
> I can say, down the road add the above similar NODES into the cluster,
> seamlessly via the CS management panel. Just like that, correct? Nothing
> else fancy involved?
>
You've one thing to decide - do you want to cluster those hosts (main
benefit being shared storage and network config), or run as single host
clusters. It's really up to you, but I'd advise you to keep the cluster
size/capacity consistent between clusters. e.g. If you decide to put three
hosts in a cluster, always scale in three host chunks. btw, you'll want to
enable local storage as a global config option on the management server. If
you don't do this, the system assumes shared storage and you won't be able
to start any VMs (including the system ones).

>
> Regarding selling them like VPS, I'm assuming the option to provide the
> end user/customer a full list of available templates for them to install
> and reinstall at their disposal can be done easily? Say we wanted 10 Linux
> OS flavors to offer and 2 Windows. We can set this up in advance and grant
> the user the ability via some predefined package per se?
>
Yup, but double check the Windows licensing before offering them up. iirc,
there's nastiness in there about how licenses are counted. You also will
want to ensure any Windows images start from a sysprep state otherwise
they'll have the same sids and weird things'll happen on the network.

>
> We currently use SolusVM for virtualization (VPS plans). So, generally
> speaking, I'm not sure I see much of a difference overall between this and
> CS? Please correct me if I'm wrong. Because as it stands now, SolusVM works
> in generally the same exact way.
>
I'm not familiar with SolusVM, so can't comment on comparisons.

>
> -Original Message-
> From: Tim Mackey [mailto:tmac...@gmail.com]
> Sent: Tuesday, September 27, 2016 9:59 AM
> To: users@cloudstack.apache.org
> Subject: Re: New Initial HW Setup
>
> Good morning.
>
> I think it's probably best to take a step back and define a couple of
> things.
>
>
> 1. The management server is really a highly efficient cluster manager. It
> runs external to the compute nodes.
> 2. A compute node contains CPU and RAM, has a network fabric, and may have
> local storage. Compute nodes can be clustered based on the native
> capabilities of the chosen hypervisor (e.g. XenServer uses the XAPI cluster
> manager with its rules, while KVM is a collection hosts).
> 3. A compute node can be bare metal, but those rules are very different.
>
> I used to present a hypervisor matrix, and here's my most recent deck:
> http://www.slideshare.net/TimMackey/selecting-the-correct-hypervisor-for-
> cloudstack-45.
> Much of whats in there will be relevant to you at this point.
>
> Looking at your specific questions:
>
>  - " *how does the primary management server hosting the CS panel, utilize
> processing power from external additional NODES*". First you will configure
> the management server with knowledge of the compute node. The management
> server then understands the capacity of the compute node, and from there
> you can do stuff like provision VMs. For example, if you've a template
> which has a compute offering with 2vCPUs, 8GB RAM and two vNICs, that's how
> the management server will setup the VM which will be based on the template
> the user chooses.
>
> - "*sell equivalent of **standalone dedicated servers, how would that
> work*".
> If the goal is to provide an equivalent of a bare metal virtual server,
> then things are much more involved from the user perspective (e.g. you need
> to start with a predefined ISO). If the goal is to provide a VPS from a set
> of predefined OS types, then that's easier - just upload a template for
> each one. The user then selects which template they want and it gets
> provisioned.
>
> - "*If I'm guaranteeing 500GB SSD storage, 4 CPU Cores and **32GB RAM
> he/she would have no w

Re: New Initial HW Setup

[Tim Mackey]

On Tue, Sep 27, 2016 at 1:45 PM, NOC  wrote:

> > You've one thing to decide - do you want to cluster those hosts (main
> benefit being shared storage and network config), or run as single host
> clusters.
>
> To make sure we're on the same page and I'm understanding you right, the
> "hosts" you're referring I assume are the NODES in the cluster. Clustering
> them you said shares the storage, but what about CPU/RAM? I assume it would
> share those too? As for network config, what do you mean by sharing network
> config?
>

Sorry, when I say hosts, that's the same as what you're calling nodes. When
I'm talking about shared storage, I'm referring to a SAN or NAS device. You
haven't indicated you have that, so there is less value in having multiple
hosts per cluster for you. btw, if you're thinking of "cluster" in the
sense of oVirt, that's not how CloudStack works. Your entire cloud becomes
a pool of CPU/RAM (with obvious requirements that you can't run a VM on
multiple hosts at the same time). e.g. if I have ten hosts, each with 24
cores and 256GB RAM, I'll have a cloud capable of hosting 240 vCPUs and
2.5TB RAM with no overcommit. VMs can live anywhere in there (providing
sufficient capacity exists).

The topic of primary storage (where the VMs actually run), is important in
this discussion. In your case you've said you're wanting to run using local
storage which translates to running using local primary storage. You could
run with shared storage as well (shared primary storage), and were that an
option for you, CloudStack would manage the storage for you at the cluster
level. CloudStack will also manage the VM networks at the cluster level,
which could give some efficiencies with some network topologies.

btw, since you're wanting a VPS like experience, you'll probably want to
read the docs on both "dedicated service offerings" [1] and VPC networks
[2].


> Is there any general advantage to running them as single host nodes?
>

So there is one thing I need to keep in mind, and that's your usage of KVM.
To a large extent, CloudStack clustering was designed with XenServer and
vSphere in mind, and then applied to KVM because the construct existed.
There is nothing wrong with your desire to have a single host with local
storage in a cluster with local storage when KVM is the hypervisor.
CloudStack will take care of a really decent chunk of the heavy lifting to
make it all work.




> Thanks again for your assistance.
>

[1]
http://docs.cloudstack.apache.org/projects/cloudstack-administration/en/4.8/service_offerings.html

[2]
http://docs.cloudstack.apache.org/projects/cloudstack-administration/en/4.8/service_offerings.html

>
> -Original Message-
> From: Tim Mackey [mailto:tmac...@gmail.com]
> Sent: Tuesday, September 27, 2016 1:26 PM
> To: users@cloudstack.apache.org
> Subject: Re: New Initial HW Setup
>
> On Tue, Sep 27, 2016 at 12:34 PM, NOC  wrote:
>
> > Thanks for the feedback!
> >
> > Ok so management server is just a standalone server (no fancy specs
> > generally speaking) for the CS control panel itself.
> >
>
> Yes. I've run smallish installations with a single management server
> running in a VM. If the management server goes down, everything keeps
> going; you've just lost the UI/API for the duration of the outage.
>
> >
> > Compute NODE: CPU, RAM, Local Storage. That's my goal, using KVM as a
> > platform. So essentially, I can do this for example:
> >
> > Compute NODE Specs:
> >
> > Dell R815
> > 4 x Opteron 16-Core CPUs
> > 256GB RAM
> > 6 x 2TB SSD Drives
> > Perc H700 RAID
> > KVM Platform (offering Linux & Windows templates)
> >
> > I can say, down the road add the above similar NODES into the cluster,
> > seamlessly via the CS management panel. Just like that, correct?
> > Nothing else fancy involved?
> >
> You've one thing to decide - do you want to cluster those hosts (main
> benefit being shared storage and network config), or run as single host
> clusters. It's really up to you, but I'd advise you to keep the cluster
> size/capacity consistent between clusters. e.g. If you decide to put three
> hosts in a cluster, always scale in three host chunks. btw, you'll want to
> enable local storage as a global config option on the management server. If
> you don't do this, the system assumes shared storage and you won't be able
> to start any VMs (including the system ones).
>
> >
> > Regarding selling them like VPS, I'm assuming the option to provide
> > the end user/customer a full list of available templates for them to
> > install and reinsta

Re: Now that Oracle is collecting for the use of Java, should we worry?

[Tim Mackey]

Would be good to have a reference too. The only thing I'm aware of which
might impact us relates to any redistributed elements[1]. It would be a
question for the dev list to know if this does indeed impact the project.

-tim

[1] http://blog.takipi.com/running-java-on-docker-youre-breaking-the-law/


On Sun, Dec 25, 2016 at 8:01 PM, Rafael Weingärtner <
rafaelweingart...@gmail.com> wrote:

> Could you share with us the reference? So we can have a bit more
> information to discuss it.
>
> I believe what they charge is for consulting, and not for the use of Java
> language per se.
>
>
> On Sun, Dec 25, 2016 at 10:57 PM, Felipe Arturo Polanco <
> felipeapola...@gmail.com> wrote:
>
> > Hello,
> >
> > I read in the news Oracle is collecting from companies using Java
> libraries
> > in commercial uses, since Cloudstack uses Java for its operations, should
> > we worry about it?
> >
>
>
>
> --
> Rafael Weingärtner
>

Re: Now that Oracle is collecting for the use of Java, should we worry?

[Tim Mackey]

On Sun, Dec 25, 2016 at 8:23 PM, Rafael Weingärtner <
rafaelweingart...@gmail.com> wrote:

> I think the point here is that we do not redistribute Oracle Java JDK. We
> use the Java programming language to write a program (the Apache
> CloudStack). When we distribute the ACS' binaries, e.g. a closed version,
> we are also not redistributing the Java, what we do is distributing a
> binary that is compiled with a Java JDK.
>

For the management server, I believe that to be correct. The system VMs may
not be so clean, and that's more my concern here. I'm happy to have that
concern unfounded. This is a topic we're working through at $dayjob, so
front of mind for me right now.


> Of course, we cannot forget the licenses for library binaries that we are
> redistributing with ACS' versions; but, this is not the same as
> redistributing Oracle Java JRE/JDK. And as far as I know we manage this
> properly.
>
> On Sun, Dec 25, 2016 at 11:13 PM, Tim Mackey  wrote:
>
> > Would be good to have a reference too. The only thing I'm aware of which
> > might impact us relates to any redistributed elements[1]. It would be a
> > question for the dev list to know if this does indeed impact the project.
> >
> > -tim
> >
> > [1] http://blog.takipi.com/running-java-on-docker-youre-
> breaking-the-law/
> >
> >
> > On Sun, Dec 25, 2016 at 8:01 PM, Rafael Weingärtner <
> > rafaelweingart...@gmail.com> wrote:
> >
> > > Could you share with us the reference? So we can have a bit more
> > > information to discuss it.
> > >
> > > I believe what they charge is for consulting, and not for the use of
> Java
> > > language per se.
> > >
> > >
> > > On Sun, Dec 25, 2016 at 10:57 PM, Felipe Arturo Polanco <
> > > felipeapola...@gmail.com> wrote:
> > >
> > > > Hello,
> > > >
> > > > I read in the news Oracle is collecting from companies using Java
> > > libraries
> > > > in commercial uses, since Cloudstack uses Java for its operations,
> > should
> > > > we worry about it?
> > > >
> > >
> > >
> > >
> > > --
> > > Rafael Weingärtner
> > >
> >
>
>
>
> --
> Rafael Weingärtner
>

Re: Ubuntu 16.04, Openvswitch networking issue

[Tim Mackey]

In order to use OVS, you need both the virtual switch and the control
plane. Those messages largely boil down to "We can't find an appropriate
control plane for your chosen network topology and hypervisor." This then
raises the questions of which control plane are you attempting to use, and
which hypervisor. Here's a deck[1] I prepared for CloudStack 4.5 which
outlines the impact of hypervisor choices. Slide 15 is most relevant to
your problem. If you have a supported control plane, then its likely
misconfigured and CloudStack doesn't know how to talk to it. Newer
CloudStack versions will vary of course, but the principles are the same,
plus you didn't mention your version ;).

[1]
https://www.slideshare.net/TimMackey/selecting-the-correct-hypervisor-for-cloudstack-45

-tim

On Fri, Feb 17, 2017 at 9:36 AM, Engelmann Florian <
florian.engelm...@everyware.ch> wrote:

> Hi,
>
> another error I am able to solve:
>
> 2017-02-17 15:24:36,097 DEBUG [c.c.a.ApiServlet] 
> (catalina-exec-26:ctx-30020483)
> (logid:d303f8ef) ===START===  192.168.252.76 -- GET  command=createNetwork&
> response=json&zoneId=e683eeaa-92c9-4651-91b9-165939f9000c&
> name=net-kvm008&displayText=net-kvm008&networkOf
> 2017-02-17 15:24:36,135 DEBUG [c.c.n.g.BigSwitchBcfGuestNetworkGuru]
> (catalina-exec-26:ctx-30020483 ctx-430b6ae1) (logid:d303f8ef) Refusing to
> design this network, the physical isolation type is not BCF_SEGMENT
> 2017-02-17 15:24:36,136 DEBUG [o.a.c.n.c.m.ContrailGuru]
> (catalina-exec-26:ctx-30020483 ctx-430b6ae1) (logid:d303f8ef) Refusing to
> design this network
> 2017-02-17 15:24:36,137 DEBUG [c.c.a.m.DirectAgentAttache]
> (DirectAgent-144:ctx-b2cdad73) (logid:eb129204) Seq
> 179-6955246674520311671: Response Received:
> 2017-02-17 15:24:36,137 DEBUG [c.c.a.t.Request] 
> (StatsCollector-5:ctx-4298a591)
> (logid:eb129204) Seq 179-6955246674520311671: Received:  { Ans: , MgmtId:
> 345049101620, via: 179(ewcstack-vh003-test), Ver: v1, Flags: 10, {
> GetStorageStatsAnswer } }
> 2017-02-17 15:24:36,137 DEBUG [c.c.n.g.MidoNetGuestNetworkGuru]
> (catalina-exec-26:ctx-30020483 ctx-430b6ae1) (logid:d303f8ef) design called
> 2017-02-17 15:24:36,138 DEBUG [c.c.h.o.r.Ovm3HypervisorGuru]
> (StatsCollector-5:ctx-4298a591) (logid:eb129204)
> getCommandHostDelegation: class com.cloud.agent.api.GetStorageStatsCommand
> 2017-02-17 15:24:36,138 DEBUG [c.c.h.XenServerGuru] 
> (StatsCollector-5:ctx-4298a591)
> (logid:eb129204) getCommandHostDelegation: class com.cloud.agent.api.
> GetStorageStatsCommand
> 2017-02-17 15:24:36,139 DEBUG [c.c.n.g.MidoNetGuestNetworkGuru]
> (catalina-exec-26:ctx-30020483 ctx-430b6ae1) (logid:d303f8ef) Refusing to
> design this network, the physical isolation type is not MIDO
> 2017-02-17 15:24:36,139 DEBUG [c.c.a.m.DirectAgentAttache]
> (DirectAgent-72:ctx-656a03ae) (logid:dd7ada9e) Seq 217-8596245788743434945:
> Executing request
> 2017-02-17 15:24:36,141 DEBUG [c.c.n.g.NiciraNvpGuestNetworkGuru]
> (catalina-exec-26:ctx-30020483 ctx-430b6ae1) (logid:d303f8ef) Refusing to
> design this network
> 2017-02-17 15:24:36,142 DEBUG [o.a.c.n.o.OpendaylightGuestNetworkGuru]
> (catalina-exec-26:ctx-30020483 ctx-430b6ae1) (logid:d303f8ef) Refusing to
> design this network
> 2017-02-17 15:24:36,144 DEBUG [c.c.n.g.OvsGuestNetworkGuru]
> (catalina-exec-26:ctx-30020483 ctx-430b6ae1) (logid:d303f8ef) Refusing to
> design this network
> 2017-02-17 15:24:36,163 DEBUG [o.a.c.n.g.SspGuestNetworkGuru]
> (catalina-exec-26:ctx-30020483 ctx-430b6ae1) (logid:d303f8ef) SSP not
> configured to be active
> 2017-02-17 15:24:36,164 DEBUG [c.c.n.g.BrocadeVcsGuestNetworkGuru]
> (catalina-exec-26:ctx-30020483 ctx-430b6ae1) (logid:d303f8ef) Refusing to
> design this network
> 2017-02-17 15:24:36,165 DEBUG [c.c.n.g.NuageVspGuestNetworkGuru]
> (catalina-exec-26:ctx-30020483 ctx-430b6ae1) (logid:d303f8ef) Refusing to
> design network using network offering 54 on physical network 200
> 2017-02-17 15:24:36,166 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> (catalina-exec-26:ctx-30020483 ctx-430b6ae1) (logid:d303f8ef) Releasing
> lock for Acct[3426fb73-70ad-47d9-9c5d-355f34891438-fen]
> 2017-02-17 15:24:36,188 DEBUG [c.c.a.ApiServlet]
> (catalina-exec-26:ctx-30020483 ctx-430b6ae1) (logid:d303f8ef) ===END===
> 192.168.252.76 -- GET  command=createNetwork&
> response=json&zoneId=e683eeaa-92c9-4651-91b9-165939f9000c&
> name=net-kvm008&displayText=net-kvm00
>
>
> We do not use BigSwitch or anything like this, just plain Openvswitch with
> Ubuntu 16.04. Any idea whats going on?
>
> All the best,
> Florian
>
> EveryWare AG
> Florian Engelmann
> Systems Engineer
> Zurlindenstrasse 52a
> CH-8003 Zürich
>
> T  +41 44 466 60 00
> F  +41 44 466 60 10
>
> florian.engelm...@everyware.ch
> www.everyware.ch

Re: Ubuntu 16.04, Openvswitch networking issue

[Tim Mackey]

Importantly, if you're in a multi-hypervisor setup, you need to account for
what'll happen when all clusters of a hypervisor type go down. In your
case, if the KVM cluster goes down and you've pinned the systems VMs to the
KVM cluster, then CloudStack won't be able to restart them on either
XenServer cluster. The net result of this will be an outage which may be
difficult to recover from.

Trust me, that was one of the first outages I needed to attend to when I
started with CloudStack a few years ago. At the time I was running clusters
of vSphere, XenServer and KVM managed by the same management server, and
there was a bug where the system VMs could get stuck on a hypervisor. That
bug is long since fixed, but highlighted that in multi-hypervisor you need
to plan for the outages of a given hypervisor type in addition to planning
for the "normal" outages.

-ti

On Mon, Feb 20, 2017 at 11:48 AM, Rafael Weingärtner <
rafaelweingart...@gmail.com> wrote:

> [UPDATE]
>
> According to this method
> "com.cloud.resource.ResourceManagerImpl.getAvailableHypervisor(long)", if
> you do not configure the “system.vm.default.hypervisor” parameter, the
> hypervisor selected for system VMs is random (among the ones available).
>
> On Mon, Feb 20, 2017 at 11:37 AM, Rafael Weingärtner <
> rafaelweingart...@gmail.com> wrote:
>
> > Hi Engelmann,
> > I still quite not understand your problem yet. I see that you have three
> > different clusters; one KVM, One XenServer 6.5 and one 7.0. You want to
> use
> > the KVM as the hypervisor to host your system VMs, right?
> >
> > Have you configured the parameter “system.vm.default.hypervisor”?
> >
> > On Mon, Feb 20, 2017 at 11:25 AM, Engelmann Florian <
> > florian.engelm...@everyware.ch> wrote:
> >
> >> Hi Rafael,
> >>
> >> We do use the following setup (Test environment currently):
> >>
> >> ACS 4.9.2
> >> 1x Xenserver 6.5 Cluster (3 nodes)
> >> 1x Xenserver 7.0 Cluster (1 node)
> >> 1x Ubuntu 16.04 KVM Cluster (3 nodes)
> >>
> >> Networking = Advanced Zone VPC and Virtual Router
> >>
> >> I noticed the error Message was just informational an not the real
> >> problem. The problem we got is:
> >>
> >> [...]
> >> Allocating the VR with id=4185 in datacenter
> >> com.cloud.dc.DataCenterVO$$EnhancerByCGLIB$$caa6c375@2 with the
> >> hypervisor type XenServer
> >> [...]
> >> Cluster: 6 has HyperVisorType that does not match the VM, skipping this
> >> cluster
> >> [...]
> >>
> >> We tried to force ACS to use the KVM systemVM template but for some
> >> reason ACS refuses to use that System offering.
> >>
> >> Hosts:
> >> Nameewcstack-vh023-test
> >> Host Tags="kvm"
> >>
> >> Primary storage:
> >> Name: ewcstack-vh023-test,Local Storage: Storage Tags="vol-local-kvm"
> >>
> >> System offering:
> >> Name  custom-local-sm-kvm
> >> Storage Tags="vol-local-kvm"
> >> Host Tags="kvm"
> >>
> >> Network offering:
> >> Namecustom local kvm
> >> System offering="custom-local-sm-kvm"
> >>
> >> Disk offering:
> >> Namecustom local kvm
> >> Storage Tags="vol-local-kvm"
> >>
> >>
> >> Creating a Instance with a network offering "custom-local-sm-kvm"
> doesn't
> >> stop ACS from using a XenServer systemVM template. Why?
> >>
> >> All the best,
> >> Florian
> >>
> >>
> >> 
> >> From: Rafael Weingärtner 
> >> Sent: Friday, February 17, 2017 4:08 PM
> >> To: users@cloudstack.apache.org
> >> Subject: Re: Ubuntu 16.04, Openvswitch networking issue
> >>
> >> I think we may need more information. ACS version, network deployment
> >> type,
> >> and hypervisors?
> >>
> >> On Fri, Feb 17, 2017 at 10:02 AM, Engelmann Florian <
> >> florian.engelm...@everyware.ch> wrote:
> >>
> >> > Hi,
> >> >
> >> > sorry I ment "I am NOT able to solve"
> >> >
> >> > 
> >> > From: Engelmann Florian 
> >> > Sent: Friday, February 17, 2017 3:36 PM
> >> > To: users@cloudstack.apache.org
> >> > Subject: Ubuntu 16.04, Openvswitch networking issue
> >> >
> >> > Hi,
> >> >
> >> > another error I am able to solve:
> >> >
> >> > 2017-02-17 15:24:36,097 DEBUG [c.c.a.ApiServlet]
> (catalina-exec-26:ctx-
> >> > 30020483) (logid:d303f8ef) ===START===  192.168.252.76 -- GET
> >> > command=createNetwork&response=json&zoneId=e683eeaa-
> >> > 92c9-4651-91b9-165939f9000c&name=net-kvm008&displayText=
> >> > net-kvm008&networkOf
> >> > 2017-02-17 15:24:36,135 DEBUG [c.c.n.g.BigSwitchBcfGuestNetworkGuru]
> >> > (catalina-exec-26:ctx-30020483 <3002-0483> ctx-430b6ae1)
> >> (logid:d303f8ef) Refusing to
> >> > design this network, the physical isolation type is not BCF_SEGMENT
> >> > 2017-02-17 15:24:36,136 DEBUG [o.a.c.n.c.m.ContrailGuru]
> >> > (catalina-exec-26:ctx-30020483 <3002-0483> ctx-430b6ae1)
> >> (logid:d303f8ef) Refusing to
> >> > design this network
> >> > 2017-02-17 15:24:36,137 DEBUG [c.c.a.m.DirectAgentAttache]
> >> > (DirectAgent-144:ctx-b2cdad73) (logid:eb129204) Seq
> >> > 179-6955246674520311671: Response Received:
> >> > 2017-02-17 

Re: Welcoming Wido as the new ACS VP

[Tim Mackey]

Thanks Will for all the great work this past year, and looking forward to
seeing Wido's contributions increasing. Congrats Wido.

-tim

On Fri, Mar 17, 2017 at 9:28 AM, Rubens Malheiro 
wrote:

> Hey Stevens thanks for stable work
>
> Hollander welcome a new challenge! Good Luck!
>
> See you in Miami!! I like a beer!
>
> WIN/WIN
> CLOUDSTACK
>
>
> 2017-03-17 7:20 GMT-03:00 Giles Sirett :
>
> > Will - many thanks for your hard work over the past 12 months.
> >
> > Congrats Wido.
> >
> >
> > Kind regards
> > Giles
> >
> > giles.sir...@shapeblue.com
> > www.shapeblue.com
> > 53 Chandos Place, Covent Garden, London  WC2N 4HSUK
> > @shapeblue
> >
> >
> >
> >
> > -Original Message-
> > From: Daan Hoogland [mailto:daan.hoogl...@shapeblue.com]
> > Sent: 17 March 2017 08:13
> > To: d...@cloudstack.apache.org; users@cloudstack.apache.org
> > Subject: Re: Welcoming Wido as the new ACS VP
> >
> > Thanks to both of you great Ws. Have a good retirement Will! Good luck in
> > your new capacity Wido!
> >
> > On 17/03/17 08:32, "Paul Angus"  wrote:
> >
> > Thanks Will for all the great work. And congratulations Wido - good
> > luck.
> >
> >
> >
> > Kind regards,
> >
> > Paul Angus
> >
> > paul.an...@shapeblue.com
> > www.shapeblue.com
> > 53 Chandos Place, Covent Garden, London  WC2N 4HSUK
> > @shapeblue
> >
> >
> >
> >
> > -Original Message-
> > From: Raja Pullela [mailto:raja.pull...@accelerite.com]
> > Sent: 17 March 2017 02:59
> > To: d...@cloudstack.apache.org; users@cloudstack.apache.org
> > Subject: Re: Welcoming Wido as the new ACS VP
> >
> > Thank you Will for all the great work!
> >
> > cheers!
> > Raja Pullela
> > Engineering Team,
> > Accelerite, 2055 Laurelwood Road,
> > Santa Clara, CA, 95054
> >
> > On 3/16/17, 10:30 PM, "Will Stevens"  wrote:
> >
> > Hello Everyone,
> > It has been a pleasure working with you as the ACS VP over the past
> > year.
> > I would like to say Thank You to everyone who has supported me in
> this
> > role and have supported the project as a whole.
> >
> > It is my pleasure to announce that Wido den Hollander has been voted
> > in to replace me as the Apache Cloudstack VP in our annual VP rotation.
> > Wido has a long history with the project and we are happy welcome him
> into
> > this new role.
> >
> > Be sure to join us at CCC in Miami [1] so we can initiate him
> > correctly over many beers.  :)
> >
> > Cheers,
> >
> > *Will Stevens*
> >
> > ​[1] http://us.cloudstackcollab.org/​
> >
> >
> >
> >
> >
> > DISCLAIMER
> > ==
> > This e-mail may contain privileged and confidential information which
> > is the property of Accelerite, a Persistent Systems business. It is
> > intended only for the use of the individual or entity to which it is
> > addressed. If you are not the intended recipient, you are not authorized
> to
> > read, retain, copy, print, distribute or use this message. If you have
> > received this communication in error, please notify the sender and delete
> > all copies of this message. Accelerite, a Persistent Systems business
> does
> > not accept any liability for virus infected mails.
> >
> >
> >
> > daan.hoogl...@shapeblue.com
> > www.shapeblue.com
> > 53 Chandos Place, Covent Garden, London  WC2N 4HSUK @shapeblue
> >
> >
> >
> >
>

Re: Cloudstack with PCI compliance

[Tim Mackey]

The real problem is in defining what is "in-scope" and "out-of-scope", and
avoiding "mixed-mode".  This document (
https://www.pcisecuritystandards.org/documents/Virtualization_InfoSupp_v2.pdf)
provides a pretty good read of the suggested rules of the road for
virtualization, but I'm not aware of a similar doc covering cloud.  Things
like network typologies can mess stuff up quite quickly, and its probably
best to involve the customer's PCI QSA in the design.  A couple months back
I was asked to comment on a pure XenServer environment for mixed-mode
operations and the customer accepted solution required both VLANs and OVS
policy definition to secure cardholder data and meet the QSA goals.  Read
that as "it's quite complicated and prone to opinions rather than hard
standards"

-tim


On Thu, Apr 24, 2014 at 8:34 AM, Sebastien Goasguen wrote:

>
> On Apr 22, 2014, at 5:52 AM, Uwe Kastens  wrote:
>
> > Hi there,
> >
> >
> > That would be interesting for me as well
> >
> > Kind Regards
> >
> > Uwe
> >
> >
> >
> > 2014-04-21 19:31 GMT+02:00 Upendra Moturi  >:
> >
> >> Hello Team,
> >>
> >> Has anyone worked on making cloudstack PCI compliant.
> >> Can you please point me some documentation.
> >>
>
> Haven't worked on it and over my head, but that's a big question. I
> actually asked a friend on twitter :)
> The answer was interesting "CloudStack can facilitate PCI compliance but
> not *be* PCI compliant"
>
> -sebastien
>
>

Re: ESXi & KVM Hypervisors in the same CloudStack zone

[Tim Mackey]

The only issues I've run into are that you can only have one vCenter
Datacenter per zone, and that if you're separating the guest and public
traffic on different NICs that you take care to ensure the respective
vSphere and KVM network labels are correct.  If you need this last part and
don't do it, you're going to have difficulty communicating between VMs
running on the different hypervisors.

-tim


On Fri, May 2, 2014 at 2:04 PM, Willard Rathjen  wrote:

> It’s not an issue. You need to bring them in as different clusters. Any
> templates will need to be create for each hypervisor type, but other than
> that, it will work well.
>
> Willard Rathjen
> Cloud Systems Engineer
>
> Office +1.800.735.7104 | Direct +1.515.612.7813
> willard.rath...@appcore.com | www.appcore.com
>
> --
> The information in this message is intended for the named recipients only.
> It may contain information that is privileged, confidential or otherwise
> protected from disclosure. If you are not the intended recipient, you are
> hereby notified that any disclosure, copying, distribution, or the taking
> of any action in reliance on the contents of this message is strictly
> prohibited. If you have received this e-mail in error, do not print it or
> disseminate it or its contents. In such event, please notify the sender by
> return e-mail and delete the e-mail file immediately thereafter. Thank you.
>
>
>
> On May 2, 2014, at 12:44 PM, Jeff Barnett  wrote:
>
> > I was thinking of giving Cloudstack a try; I wanted to know if you could
> use ESXi and KVM host in the same CloudStack zone, and what that looks like.
>
>

Re: XenServer 6.2 and ACS XenServer Support Package

[Tim Mackey]

Andrei,

Those commands are still required for use in a CloudStack basic zone.  If
you are using an advanced zone, then the default XenServer backend of ovs
is correct.

-tim


On Tue, May 20, 2014 at 5:29 PM, Andrei Mikhailovsky wrote:

> Hi guys,
>
> I am looking at the installation guide for XenServer hypervisor and got a
> question about this section:
>
>
> http://docs.cloudstack.apache.org/projects/cloudstack-installation/en/latest/hypervisor/xenserver.html#install-cloudstack-xenserver-support-package-csp
>
> It states that the CSP functionality is already present in XenServer 6.1.
> I assume it is also present in XenServer 6.2.
>
> The question is do I still need to run the following commands as shown in
> the guide as Optional:
>
>
>
> xe-switch-network-backend bridge
>
> net.bridge.bridge-nf-call-iptables = 1
> net.bridge.bridge-nf-call-ip6tables = 0
> net.bridge.bridge-nf-call-arptables = 1
>
> $ sysctl -p /etc/sysctl.conf
>
>
> Would I still be able to use the XenServer hypervisor with default
> settings?
>
> Thanks
>
> Andrei
>
>
>
>
>

Re: XenServer + New Guest Network = unable to create vm

[Tim Mackey]

Andrei,

When I created a cloud with XenServer, vSphere and KVM, I didn't need
create any new service offerings, nor did I need to tag them.  Template
compatibility should take care of that automatically.  What you haven't
said is if you uploaded the XenServer system VM template or not.  Since you
already have a KVM installation, your system VMs are currently KVM based,
but the router you need for the XenServer environment needs to be a
XenServer system VM.  Additionally, in a multi-hypervisor environment, if a
system VM needs to restart it could restart on any host, so you'll again
need to have both KVM and XenServer system VM templates or force the system
VM to be on a specific hypervisor type in the config variables.

The error in your log which did catch my eye is that you appear to be using
MidoNet and that's KVM only.  MidoKura isn't something I've had an
opportunity to work with, so I'm not certain what might be required to
connect a MidoNet to a normal network.

If the XenServer hosts aren't in a separate zone, you might want to look
into putting them there.  afaik that should at least remove Mido from the
mix.

-tim



On Wed, Jun 11, 2014 at 11:40 AM, Andrei Mikhailovsky 
wrote:

> Hello guys,
>
> Was wondering if someone could help me with a strange issue that I am
> having with XenServer 6.2 and ACS 4.2.1.
>
> I've recently added a new XenServer 6.2 cluster to my existing ACS + KVM
> setup.I've created a new system and disk offerings using tag "xenserver".
> I've also added this tag to the xenserver host and the nfs primary storage.
> I have verified that the setup works by successfully creating and staring
> several vms which are connected to an existing ACS guest network that I
> have setup for testing. All test vms are being created and started and I
> can successfully login to them.
>
> Having said this, I am, however, unable to create any guest vms on the
> XenServer if I choose to create a new guest network from the Add Instance
> wizard. The guest vm is created with status Error and the management server
> logs show the error that I am pasting at the end of this email. From what I
> can see, the new network is created with status Allocated and I can see it
> under the Network section. I do not, however, see a virtual router
> corresponding to that network.
>
> From the management server log I can see the following, which looks very
> odd and completely untrue (as I can successfully create a number of vms
> using the same system and disk offering using a pre-created guest network.
> I've double checked that the XenServer host has the tag "xenserver"):
>
> 2014-06-11 16:16:25,312 DEBUG [allocator.impl.FirstFitAllocator]
> (Job-Executor-76:job-5195 = [ 10d345f9-2fb2-42ef-850f-4919512d63db ]
> FirstFitRoutingAllocator) Looking for hosts having tag specified on
> SvcOffering:xenserver
> 2014-06-11 16:16:25,314 DEBUG [allocator.impl.FirstFitAllocator]
> (Job-Executor-76:job-5195 = [ 10d345f9-2fb2-42ef-850f-4919512d63db ]
> FirstFitRoutingAllocator) Hosts with tag 'xenserver' are:[]
>
>
> Any idea what is going on?
>
> Management Server Log:
>
> 2014-06-11 16:16:24,962 DEBUG [cloud.api.ApiServlet]
> (catalina-exec-6:null) ===START=== 192.168.169.91 -- GET
> command=createNetwork&response=json&se
>
> ssionkey=6q8QippP1uE3Jd%2BWL8FuA9xcTfM%3D&networkOfferingId=87e090cb-a134-4d77-b664-ef3858a52f3c&name=XenServer-Network-Test-3&displayText=XenServer-N
> etwork-Test-3&zoneId=b8c25216-4c2d-4d01-87d8-3673c0ba9780&_=1402499785135
> 2014-06-11 16:16:25,015 DEBUG [network.guru.NiciraNvpGuestNetworkGuru]
> (catalina-exec-6:null) Refusing to design this network
> 2014-06-11 16:16:25,015 DEBUG [network.guru.MidoNetGuestNetworkGuru]
> (catalina-exec-6:null) design called
> 2014-06-11 16:16:25,016 DEBUG [network.guru.MidoNetGuestNetworkGuru]
> (catalina-exec-6:null) Refusing to design this network, the physical
> isolation ty
> pe is not MIDO
> 2014-06-11 16:16:25,017 DEBUG [network.guru.SspGuestNetworkGuru]
> (catalina-exec-6:null) SSP not configured to be active
> 2014-06-11 16:16:25,017 DEBUG [cloud.network.NetworkManagerImpl]
> (catalina-exec-6:null) Releasing lock for
> Acct[06eedc2c-65f2-11e3-9bd1-d8d38559b2d0-a
> dmin]
> 2014-06-11 16:16:25,039 DEBUG [cloud.api.ApiServlet]
> (catalina-exec-6:null) ===END=== 192.168.169.91 -- GET
> command=createNetwork&response=json&sess
>
> ionkey=6q8QippP1uE3Jd%2BWL8FuA9xcTfM%3D&networkOfferingId=87e090cb-a134-4d77-b664-ef3858a52f3c&name=XenServer-Network-Test-3&displayText=XenServer-Net
> work-Test-3&zoneId=b8c25216-4c2d-4d01-87d8-3673c0ba9780&_=1402499785135
> 2014-06-11 16:16:25,133 DEBUG [cloud.api.ApiServlet]
> (catalina-exec-7:null) ===START=== 192.168.169.91 -- GET
> command=deployVirtualMachine&zoneId=b8c25216-4c2d-4d01-87d8-3673c0ba9780&templateId=677c5335-7224-4ce7-b5e9-da70e89a6f99&hypervisor=KVM&serviceOfferingId=62f076eb-fbae-485d-aa78-e7e4c9717346&diskOfferingId=cbc5779b-7de3-4f6b-90d0-304029f59364&size=10&networkIds=48c669d0-0e41-40b3-be7d-b6078ff98cff

Re: ScaleIO experience?

[Tim Mackey]

Cees,

Unfortunately I'm not personally aware of anyone using ScaleIO with
XenServer, but it is on the HCL for XenServer versions 6.1 and prior (
http://hcl.xensource.com/ProductDetails.aspx?ProductType=Storage&ProductName=ScaleIO%20vSAN).
 The core CloudStack question would be how CloudStack sees this storage,
and my guess would be as local storage.  If you enable local storage for
CloudStack, does it see ScaleIO as primary storage?

-tim


On Mon, Jun 16, 2014 at 3:38 AM, Cees Doets 
wrote:

> Does anybody have experience with the combination ScaleIO, CloudStack and
> Xensever?
>
> Kind regards,
>
> Cees Doets
> datacenter services
>
>
>
> DATACENTER Services B.V.
>
>
>
> Address:
>
> Fokkerstraat 7
> 3833 LD Leusden
> the Netherlands
>
>
>
>
> Phone:
>
> +31 (0) 33 - 434 50 22
>
> Fax:
>
> +31 (0) 33 - 434 50 25
>
> Internet:
>
> www.datacenterservices.nl
>
>
>
>
> I T  F L E X  A B I L I T Y
>
> MANAGED SERVICES I SECURED DATACENTER
>
>
>
> DATACENTER Services B.V. is part of CSN Groep.
>
>
> Disclaimer: This e-mail message is only for the use of the addressee. CSN
> Groep B.V. and the related business units cannot give any guarantee in
> relation to the accuracy and/or completeness of the information in this
> e-mail message and can therefore not accept liability. CSN Groep B.V. and
> the related business units cannot be hold responsible for direct or
> indirect damage as a result of using this e-mail message and/or its content.
>
>
>

Re: Xenserver 6.2 SP1 Hotfix 4

[Tim Mackey]

Len,

6.2 SP1 rolls up all previous hotfixes, plus adds a few of its own.  I'd
expect if you attempted to install HF004, that it would error out with a
message about being already applied.

-tim


On Tue, Jun 17, 2014 at 8:39 AM, Len Bellemore <
len.bellem...@controlcircle.com> wrote:

> Hi Guys,
>
> I've recently upgraded to XenServer 6.2 with CS 4.3.
>
> I've also applied XenServer 6.2 SP1.   Do I need to apply Hotfix 4 as well?
>
> I read that it has some enhancements for CS built into the hotfix, but the
> release notes also state that I need to set up a dedicated SR for High
> Availability, which seems a bit odd.
>
> Do I need the hotfix?  If so, do I really need to set up a dedicated HA SR?
>
> Cheers
> Len
>
> 
> IMPORTANT NOTICE. This electronic message contains information from
> Control Circle Ltd, which may be privileged or confidential. The
> information is intended for use only by the individual(s) or entity named
> above. If you are not the intended recipient, be aware that any disclosure,
> copying, distribution or use of the contents of this information is
> strictly prohibited. If you have received this electronic message in error,
> please notify me by telephone or email (to the number or email address
> above) immediately. Activity and use of the ControlCircle e-mail system is
> monitored to secure its effective operation and for other lawful business
> purposes. Communications using this system will also be monitored and may
> be recorded to secure effective operation and for other lawful business
> purposes
>

Re: Realhostip.com Migration

[Tim Mackey]

Rich,

I followed the Citrix KB article referenced here (
https://cwiki.apache.org/confluence/display/CLOUDSTACK/Realhost+IP+changes)
with 4.2 and it worked fine for me using SSL.  Just remember to get a
wildcard SSL cert, and be careful pasting it into the CloudStack UI.

-tim


On Tue, Jun 17, 2014 at 12:18 PM, Richard Chatterton <
richard.chatter...@contegix.com> wrote:

> Folks,
>
> I was just reading through my backlog of messages and I see that the
> Realhostip.com service has been extended to September 30th. Hurray!
>
> I also see the following in the message where that was announced:
>
> > While testing Realhostip fixes additional product issues were found
> which are tracked in following three defects CLOUDSTACK-6499 [1],
> CLOUDSTACK-6599 [2], CLOUDSTACK-6824 [3] . These defects are fixed in 4.4
> and master branch. Please verify in your setups. If you are on older
> version of CloudStack do plan on upgrading to 4.4 . Additional details on
> fixes are available in JIRA.  Updated wiki with steps will be published
> shortly.
>
> Is it strictly necessary to upgrade CloudStack to 4.4 before migrating
> away from realhostip.com? Has anyone successfully migrated away from it
> on an older version of CloudStack?
>
> Best,
> Rich Chatterton
>

Re: Cloudstack/Xenserver/GPU support

[Tim Mackey]

Correct.  6.2 SP1 is a different resource within CloudStack, so if you're
on 6.2 or prior GPU pass-through isn't available.

-tim


On Wed, Jun 18, 2014 at 2:30 AM, Devdeep Singh 
wrote:

> Sanjay can correct me if I am wrong, but looks like a different resource
> gets loaded for XenServer 6.2 and XenServer 6.2 SP1. So if you are using
> 6.2 , cloudstack will not query the host for GPU details.
>
> Regards,
> Devdeep
>
> > -Original Message-
> > From: Vijay Ramadoss [mailto:vramad...@nvidia.com]
> > Sent: Wednesday, June 18, 2014 11:03 AM
> > To: users@cloudstack.apache.org
> > Subject: RE: Cloudstack/Xenserver/GPU support
> >
> > The problem is that my host doesn’t show the gpu through cloudstack. Just
> > using Xenserver direct passthrough, everything works. Just doesn’t work
> > through cloudstack.
> >
> > Regards,
> > Vijay R
> >
> >
> > -Original Message-
> > From: Devdeep Singh [mailto:devdeep.si...@citrix.com]
> > Sent: Tuesday, June 17, 2014 10:24 PM
> > To: users@cloudstack.apache.org
> > Subject: RE: Cloudstack/Xenserver/GPU support
> >
> > From the FS [1], under Interoperability and compatibility, it is
> supported for
> > 6.2 SP1 and later.
> >
> > [1]
> > https://cwiki.apache.org/confluence/display/CLOUDSTACK/GPU+and+vGPU
> > +support+for+CloudStack+Guest+VMs
> >
> > Regards,
> > Devdeep
> >
> > > -Original Message-
> > > From: Vijay Ramadoss [mailto:vramad...@nvidia.com]
> > > Sent: Wednesday, June 18, 2014 10:31 AM
> > > To: users@cloudstack.apache.org
> > > Subject: RE: Cloudstack/Xenserver/GPU support
> > >
> > > I am using Xenserver 6.2.
> > >
> > > Regards,
> > > Vijay R
> > >
> > >
> > > -Original Message-
> > > From: Devdeep Singh [mailto:devdeep.si...@citrix.com]
> > > Sent: Tuesday, June 17, 2014 9:49 PM
> > > To: users@cloudstack.apache.org
> > > Subject: RE: Cloudstack/Xenserver/GPU support
> > >
> > > Just to confirm, are you using XenServer 6.2 or XenServer 6.2 SP1?
> > >
> > > Regards,
> > > Devdeep
> > >
> > > > -Original Message-
> > > > From: Vijay Ramadoss [mailto:vramad...@nvidia.com]
> > > > Sent: Wednesday, June 18, 2014 10:01 AM
> > > > To: users@cloudstack.apache.org
> > > > Subject: Re: Cloudstack/Xenserver/GPU support
> > > >
> > > > Note that I am using 4.4 dev builds for this so it does have GPU
> > > > support. So in service offerings I do see GPU options but just
> doesn't
> > work.
> > > >
> > > > Regards
> > > > Vijay R
> > > >
> > > > On Jun 17, 2014 9:27 PM, Shanker Balan 
> > > > wrote:
> > > > Hi Vijay,
> > > >
> > > > Comments inline:
> > > >
> > > > On 17-Jun-2014, at 9:28 pm, Vijay Ramadoss 
> > > wrote:
> > > >
> > > > > Hi - I have setup a cloudstack management server and managing two
> > > > xenserver 6.2 based hosts with NVIDIA GRID k2 gpus on them. I added
> > > > the host to the pod/cluster but cloudstack is not detecting the gpu
> > > > on it and showing it.  How do I make gpu be available so that
> > > > cloudstack could use it ? I created a service offering for gpu but I
> > > > am not able to associate an instance with that service offering and
> > > > it fails as cloudstack cant see the gpu. Please help.
> > > >
> > > > The last time I had a requirement to enable passthru of devices to
> > > > the VMs, CloudStack didnt have support for this. While the XenServer
> > > > itself can do passthru, CloudStack service offerings could not be
> > > > taught to expose these to the VMs created via CloudStack.
> > > >
> > > > In short, someone will need to add this feature to ACS. The
> > > > developer list might be a better place to ask this question.
> > > >
> > > > Regards.
> > > >
> > > > --
> > > > @shankerbalan
> > > >
> > > > M: +91 98860 60539 | O: +91 (80) 67935867
> > > > shanker.ba...@shapeblue.com
> > > > | www.shapeblue.com |
> > > Twitter:@shapeblue
> > > > ShapeBlue Services India LLP, 22nd floor, Unit 2201A, World Trade
> > > > Centre, Bangalore - 560 055
> > > >
> > > > Find out more about ShapeBlue and our range of CloudStack related
> > > > services
> > > >
> > > > IaaS Cloud Design &
> > > > Build > > > build//>
> > > > CSForge – rapid IaaS deployment
> > > > framework
> > > > CloudStack Consulting
> > > > CloudStack Infrastructure Support > > > infrastructure-support/>
> > > > CloudStack Bootcamp Training
> > > > Courses > > > training/>
> > > >
> > > > This email and any attachments to it may be confidential and are
> > > > intended solely for the use of the individual to whom it is
> addressed.
> > > > Any views or opinions expressed are solely those of the author and
> > > > do not necessarily represent those of Shape Blue Ltd or related
> > > > companies. If you are not the intended recipient of this email, you
> > > > must neither take any action based upon its contents, nor c

Re: Xenserver 6.2 SP1 Hotfix 4

[Tim Mackey]

Len,

That release note was written from the perspective of a XenServer feature
set which includes an HA capability.  CloudStack doesn't use the native
XenServer HA capability, and if you're using CloudStack you shouldn't
enable the native XenServer HA environment lest it conflicts with the
CloudStack HA service offering.  Net of this, shared storage is required
for native XenServer HA, but CloudStack has its own method.

-tim


On Thu, Jun 19, 2014 at 5:26 AM, Len Bellemore <
len.bellem...@controlcircle.com> wrote:

> Cheers Tim.
>
> I mean Hotfix 4 for SP1.  http://support.citrix.com/article/CTX140417
>
> Len
>
> -----Original Message-
> From: Tim Mackey [mailto:tmac...@gmail.com]
> Sent: 17 June 2014 15:48
> To: users@cloudstack.apache.org
> Subject: Re: Xenserver 6.2 SP1 Hotfix 4
>
> Len,
>
> 6.2 SP1 rolls up all previous hotfixes, plus adds a few of its own.  I'd
> expect if you attempted to install HF004, that it would error out with a
> message about being already applied.
>
> -tim
>
>
> On Tue, Jun 17, 2014 at 8:39 AM, Len Bellemore <
> len.bellem...@controlcircle.com> wrote:
>
> > Hi Guys,
> >
> > I've recently upgraded to XenServer 6.2 with CS 4.3.
> >
> > I've also applied XenServer 6.2 SP1.   Do I need to apply Hotfix 4 as
> well?
> >
> > I read that it has some enhancements for CS built into the hotfix, but
> > the release notes also state that I need to set up a dedicated SR for
> > High Availability, which seems a bit odd.
> >
> > Do I need the hotfix?  If so, do I really need to set up a dedicated HA
> SR?
> >
> > Cheers
> > Len
> >
> > 
> > IMPORTANT NOTICE. This electronic message contains information from
> > Control Circle Ltd, which may be privileged or confidential. The
> > information is intended for use only by the individual(s) or entity
> > named above. If you are not the intended recipient, be aware that any
> > disclosure, copying, distribution or use of the contents of this
> > information is strictly prohibited. If you have received this
> > electronic message in error, please notify me by telephone or email
> > (to the number or email address
> > above) immediately. Activity and use of the ControlCircle e-mail
> > system is monitored to secure its effective operation and for other
> > lawful business purposes. Communications using this system will also
> > be monitored and may be recorded to secure effective operation and for
> > other lawful business purposes
> >
>
> 
> IMPORTANT NOTICE. This electronic message contains information from
> Control Circle Ltd, which may be privileged or confidential. The
> information is intended for use only by the individual(s) or entity named
> above. If you are not the intended recipient, be aware that any disclosure,
> copying, distribution or use of the contents of this information is
> strictly prohibited. If you have received this electronic message in error,
> please notify me by telephone or email (to the number or email address
> above) immediately. Activity and use of the ControlCircle e-mail system is
> monitored to secure its effective operation and for other lawful business
> purposes. Communications using this system will also be monitored and may
> be recorded to secure effective operation and for other lawful business
> purposes
>

Re: Cloudstack-4.3 xenserver-6.2 equallogic SAN

[Tim Mackey]

Ian,

A couple of quick questions:

- Is this going to be NFS or iSCSI (I've used EQL with iSCSI)?
- Do you require a separate storage network on XenServer to access the EQL,
or is it accessible from the same network as the management server?
- Is you EQL on the XenServer HCL, including the firmware?  HCL is at
hcl.xensource.com

That last point may not seem significant, but I've seen issues where a
firmware update gets in the way.

-tim


On Mon, Jun 23, 2014 at 12:56 PM, Ian Marshall  wrote:

> Thanks Carlos
>
> I have read these but a little unsure of the specific order of deployment
> configuration if using xenserver. I was intending to setup KVM hosts, but
> after spending about 6 weeks trying to get Openstack deployed, I want to be
> 100% sure how to deploy C;loudstack before I pull the plug on Openstack -
> which has turned out to be a nightmare to deploy.
>
> As mentioned in my replay to Dean, I am looking for corrext steps to deploy
> Cloudstack with xenserver, so any pointers outside of the ionline
> documentation would be appreciated.
>
> regards
> Ian
>
>
>
> Regards
> Ian
>
>
> On 23 June 2014 17:15, Carlos Reátegui  wrote:
>
> > Hi Ian,
> > I used XenCenter to setup my network on the first host and then added the
> > others to the cluster within XenCenter.  When you add the primary host to
> > CloudStack all hosts will get added.
> >
> > If you follow the install instructions on the site (
> >
> http://docs.cloudstack.apache.org/projects/cloudstack-installation/en/latest/
> )
> > you should be ok.
> >
> > I think the main thing that usually trips up folks is the vhd-util step.
> >  Make sure that the one you download per the instructions ends up on the
> > hosts in the /opt/xensource/bin directory.  In the past there were
> problems
> > with the script that added the hosts not copying it from the management
> > server.  Please note that this vhd-util is a different version than the
> one
> > that comes with XenServer and you should leave that one alone.
> >
> > cheers,
> > -Carlos
> >
> > On Jun 23, 2014, at 8:45 AM, Dean Kamali  wrote:
> >
> > > You could ​export shares via NFS and add your shares as primary or
> > > secondary storage to your CS accordingly, you may export your shares
> > > via ISCSI volumes as well.
> > >
> > > There is not specific guide for Dell EQLX.
> > >
> > > cheers
> > >
> > > Dean
> > > ​
> > >
> > >
> > > On Mon, Jun 23, 2014 at 3:01 AM, Ian Marshall 
> > wrote:
> > >
> > >> Hi Everyone
> > >>
> > >> Does anyone have a guide to help a new user setup a cloudstack with
> > >> xenserver and equallogic SAN?
> > >>
> > >> I've read the guides on the cloudstack site and found a link to the
> Dell
> > >> guide for integrating EQLX to xenserver but unsure if this is correct
> > for
> > >> cloudstack setup. Also not sure what should/can be configured using
> the
> > xen
> > >> centre admin once cloudstack is implemented.
> > >>
> > >> Regards
> > >> Ian
> >
> >
>

Re: Cloudstack-4.3 xenserver-6.2 equallogic SAN

[Tim Mackey]

Sounds good.  For this installation, you'll want to first setup the storage
network within XenServer as a separate management network.  I recommend
also using an MTU of 9000 (precise value will depend on the switches, and
don't forget to test that packets aren't fragmenting or you'll have
horrible performance/won't work).  If you're plan is to multipath (as
opposed to LACP bond), then also set that up in XenServer directly, but do
be aware that CloudStack won't natively work with multipath.  That's the
PreSetup you might have seen, and is also how I've had to deal with things
in my environment even without multipath, so currently my best practice.

In CloudStack, the concept of a storage network is one where all the
elements related to storage are on their own dedicated network.  For how
I've had to set things up, this wasn't always the case so I avoided the
CloudStack storage network concept and chose to manage my storage directly.

When you define primary storage in CloudStack, you can have CloudStack
directly manage it (iSCSI, NFS and Local for XenServer), or with XenServer
you can tell CloudStack that it just exists.  That's what I've typically
had to do for a variety of reasons related to my local environment.  In
that model, you precreate your SR and give it a name, then when you define
the primary storage for a cluster, you supply that name and choose PreSetup
as the storage type.  One caveat is that the name needs to be unique within
the Zone, so if you attempt to add a new primary storage and it fails,
check the name for duplicates.

-tim


On Mon, Jun 23, 2014 at 1:25 PM, Ian Marshall  wrote:

> Hi Tim
>
> I was hoping to utilise iscsi. The SAN is a PS4110X which is on the hcl
> list. Just need to check firmware.
>
> Otherwise would have to setup as NSF. Plan is to use separate storage
> network as switches and network cards are 10gbe ( 4 in each server + 4
> 1gbe) so plenty.
>
> I cant setup a storage node. Was wanting to use xenserver to speed up
> deployment as we use that setup in present infrastructure. FYI this
> cloudstack deployment is on new hardware and not using any existing.
>
> Regards
> Ian
>
> > On 23 Jun 2014, at 18:12, Tim Mackey  wrote:
> >
> > Ian,
> >
> > A couple of quick questions:
> >
> > - Is this going to be NFS or iSCSI (I've used EQL with iSCSI)?
> > - Do you require a separate storage network on XenServer to access the
> EQL,
> > or is it accessible from the same network as the management server?
> > - Is you EQL on the XenServer HCL, including the firmware?  HCL is at
> > hcl.xensource.com
> >
> > That last point may not seem significant, but I've seen issues where a
> > firmware update gets in the way.
> >
> > -tim
> >
> >
> >> On Mon, Jun 23, 2014 at 12:56 PM, Ian Marshall 
> wrote:
> >>
> >> Thanks Carlos
> >>
> >> I have read these but a little unsure of the specific order of
> deployment
> >> configuration if using xenserver. I was intending to setup KVM hosts,
> but
> >> after spending about 6 weeks trying to get Openstack deployed, I want
> to be
> >> 100% sure how to deploy C;loudstack before I pull the plug on Openstack
> -
> >> which has turned out to be a nightmare to deploy.
> >>
> >> As mentioned in my replay to Dean, I am looking for corrext steps to
> deploy
> >> Cloudstack with xenserver, so any pointers outside of the ionline
> >> documentation would be appreciated.
> >>
> >> regards
> >> Ian
> >>
> >>
> >>
> >> Regards
> >> Ian
> >>
> >>
> >>> On 23 June 2014 17:15, Carlos Reátegui  wrote:
> >>>
> >>> Hi Ian,
> >>> I used XenCenter to setup my network on the first host and then added
> the
> >>> others to the cluster within XenCenter.  When you add the primary host
> to
> >>> CloudStack all hosts will get added.
> >>>
> >>> If you follow the install instructions on the site (
> >>
> http://docs.cloudstack.apache.org/projects/cloudstack-installation/en/latest/
> >> )
> >>> you should be ok.
> >>>
> >>> I think the main thing that usually trips up folks is the vhd-util
> step.
> >>> Make sure that the one you download per the instructions ends up on the
> >>> hosts in the /opt/xensource/bin directory.  In the past there were
> >> problems
> >>> with the script that added the hosts not copying it from the management
> >>> server.  Please note that this vhd-util is a different versi

Re: xenserver gpu passthrough

[Tim Mackey]

John, the official HCL for GPU passthrough is here:
http://hcl.xensource.com/GPUPass-throughDeviceList.aspx.

That being said, the list represents the combination of GPU card and server
which was tested either by Citrix or the vendor and found to work reliably.
 Some of the considerations included the ability install the card (risers
and the like), as well as power the card (some servers simply can't supply
the power), and available cooling (most card run pretty hot).  The HCL is
by no means exhaustive of what can work, and I've seen situations where a
vendor such as Dell is offering a GPU server configuration which isn't on
the list.  Typically that just means the vendor either didn't send us the
data, or we're a bit behind on getting it posted.  Since you don't see
R210s offering a GPU option that probably means Dell doesn't feel
installation of a GPU in those servers is viable.  Since they are smaller
than the R420s, that more than likely is a case of space, cooling and power
consumption.

-tim




On Thu, Jul 24, 2014 at 7:35 AM, John Muckley  wrote:

> Hi guys,
>
> Can anyone tell me or point me in the direction of a hardware compatabiliy
> list of servers that support GPU passthrough with xenserver 6.2?
> It seems to be available on Dell R420’s and Dell R620’s, but is missing
> from the R210’s and I wondered if there is a definitive list anywhere.
>
> Thanks
>
> John
> 
>
> This is an e-mail from Databax Ltd (Company No.04085248). The contents of
> this e-mail are confidential. Databax Ltd does not accept responsibility
> for the accuracy or completeness of the contents of this e-mail as it has
> been transmitted over a public network.  If you receive this e-mail in
> error please accept our apology. If this is the case we would be obliged if
> you would contact the sender and then delete this e-mail. This e-mail
> and/or any replies to it, and any attachments may be intercepted, copied or
> monitored by Databax Ltd for the purpose of monitoring or keeping record of
> its business and for the purposes set out in the Telecommunications (Lawful
> Business Practices) (Interception of Communications) Regulations 2000. All
> statements made in this e-mail are subject to contract. The contents are
> not to be regarded as a contractual offer or acceptance. The sender is not
> authorised to bind Databax Ltd. The views expressed in this e-mail are
> those of the sender and not necessarily those of  Databax Ltd.
> Feel free to visit the Databax web site at www.databax.com<
> http://www.databax.com/>  to find out about our range of products and
> services, and for the latest Databax news and information.
>
> <
>
> >Please consider the environment before printing this email.
>

Re: Guest networks not created on all Xen hosts in a pool leading to migration failure

[Tim Mackey]

I'm assuming you're doing the migration from either the XenServer command
line, or from XenCenter.  If you do the VM migration from within
CloudStack, CloudStack will create the VLAN on the target and everything
will work as you expect.  Here's the doc page:
https://cloudstack.apache.org/docs/en-US/Apache_CloudStack/4.2.0/html/Admin_Guide/manual-live-migration.html

A word of caution about managing XenServer "objects" outside of CloudStack.
 CloudStack considers itself the "owner" of the objects, so if you make
changes to them from outside of CloudStack, its very likely CloudStack
won't know about those changes and you could run into problems.

-tim


On Mon, Sep 8, 2014 at 6:35 AM, Pentium100  wrote:

> Hello,
>
> If I create a new network and start a couple of instances connected to it
> and the instances all start in one host, then the network (vlan) is not
> assigned on the rest of the hosts in the pool. This would not be a problem,
> except that trying to migrate such a VM to another host results in a
> failure because the network is not seen from the destination host.
>
> If I start enough instances so that both hosts have at least one running,
> then migration succeeds (unless it fails for some other unknown reason).
>
> Is this a known bug or some configuration problem and how to fix it?
>
> Cloudstack version 4.4.0, XenServer version 6.2.0
>

Review of Collab hypervisor presentation

[Tim Mackey]

Good evening everyone.  I'm presenting at Collab this week on hypervisor
selection in CloudStack.  While I've been running CloudStack since the
pre-Apache days, my experience is obviously limited to what I've personally
implemented.  Since I want to keep this session factual and avoid any bias,
I'm hoping that some of you on this list can review my deck for errors and
omissions.

Here's a link to a PDF of my deck, and thanks to anyone who takes the time
to see if I've made any errors.

https://citrix.sharefile.com/d/s8e4036e1da04c748

-tim

Re: Multiple Hypervisor in a zone - SystemVM

[Tim Mackey]

In my experience, letting system vms float between hypervisor led to
problems.  I force mine to one hypervisor using the parameter you found.
Iirc, the valid values are identical to the hypervisor types listed under
global config-> hypervisor settings, and for me was XenServer
On Nov 23, 2013 9:37 AM, "Abu Bashiri"  wrote:

> Hey all,
>
>
>
> my secstorage is currently seeded with the KVM SystemVMTemplate.
>
>
>
> Lets assume I want to use XCP as well, what is the right way to make sure
> the system VM can also run on XCP?
>
>
>
> Can I just upload the XCP SystemVM Template in the GUI?
>
>
>
> I also found the global parameter System.VM.default.hypervisor but there
> are
> no valid values specified. Does anyone not what are valid values? KVM? XCP?
>
>
>
> Thx!
>
>

Re: XenServer 6.2 SP1

[Tim Mackey]

Technically speaking, SP1 is only a rollup of hotfixes with the addition of
vGPU functionality and support for Windows 8.1 and Server 2012 R2.  It's
not a release per se.  Here's the readme:
http://support.citrix.com/article/CTX139788.  As a result, I'd expect
support to be mostly based on for the included hotfixes, since that's
probably what most of us care more about.

As to the question of sticking with 6.1 or 6.2, unless there is a
functional reason for sticking with 6.1, and you've fully patched it; I'd
recommend going to 6.2. Partly that's based on the EOM for 6.1 being only
nine months away:
http://www.citrix.com/support/product-lifecycle/product-matrix.html

-tim


On Wed, Jan 1, 2014 at 12:49 PM, Francois Gaudreault <
fgaudrea...@cloudops.com> wrote:

> Ok. Will 4.2.1 be tested against SP1 then? Is it "safer" to stick on XS
> 6.1 for now?
>
> FG
>
>
> On 1/1/2014, 12:19 PM, Chandan Purushothama wrote:
>
>> Hello Francois,
>>
>> As far as I know, XenServer 6.2 GA is a different from XenServer 6.2 SP1.
>> I know that 4.2 Supports XenServer 6.2 GA. But I don't think 4.2 officially
>> supports XenServer 6.2 SP1. It might work, but I don't think it is tested
>> with 4.2,
>>
>> Thank you,
>> Chandan.
>>
>> -Original Message-
>> From: Francois Gaudreault [mailto:fgaudrea...@cloudops.com]
>> Sent: Wednesday, January 01, 2014 8:16 AM
>> To: users@cloudstack.apache.org
>> Subject: Re: XenServer 6.2 SP1
>>
>> Interesting. I'm glad I asked beforehand :P
>>
>> Thanks Prashant (and Shanker) :)
>>
>> On 1/1/2014, 11:11 AM, Shanker Balan wrote:
>>
>>> On 01-Jan-2014, at 9:32 pm, Prashant Sreedharan <
>>> prashant.sreedha...@citrix.com> wrote:
>>>
>>>  Hi Francois,

 XenServer 6.2 is supported only for fresh install of CloudPlatform 4.2.
 However, XS 6.2 is fully supported from 4.2.1.

>>> Hmm, that explains why I ran into issues after upgrading my
>>> environment to SP1. I recreated the Zone and its been working well so
>>> far.
>>>
>>>  For your reference please find the compatibility matrix below:

 http://support.citrix.com/cms/kc/cloud-troubleshooting/cloudplatform-
 compat
 ibility-matrix/

>>> Thanks.
>>>
>>>
>>> --
>>> @shankerbalan
>>>
>>> M: +91 98860 60539 | O: +91 (80) 67935867 shanker.ba...@shapeblue.com
>>> | www.shapeblue.com | Twitter:@shapeblue ShapeBlue Services India LLP,
>>> 22nd floor, Unit 2201A, World Trade Centre, Bangalore - 560 055
>>>
>>> Need Enterprise Grade Support for Apache CloudStack?
>>> Our CloudStack Infrastructure Support>> cloudstack-infrastructure-support/> offers the best 24/7 SLA for
>>> CloudStack Environments.
>>>
>>> Apache CloudStack Bootcamp training courses
>>>
>>> **NEW!** CloudStack 4.2
>>> training
>>> 08/09 January 2014, London
>>> 13-17 January 2014, GLOBAL. Instructor led,
>>> On-line
>>> 20-24 January 2014, GLOBAL. Instructor led,
>>> On-line
>>>
>>> This email and any attachments to it may be confidential and are
>>> intended solely for the use of the individual to whom it is addressed. Any
>>> views or opinions expressed are solely those of the author and do not
>>> necessarily represent those of Shape Blue Ltd or related companies. If you
>>> are not the intended recipient of this email, you must neither take any
>>> action based upon its contents, nor copy or show it to anyone. Please
>>> contact the sender if you believe you have received this email in error.
>>> Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue
>>> Services India LLP is a company incorporated in India and is operated under
>>> license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a
>>> company incorporated in Brasil and is operated under license from Shape
>>> Blue Ltd. ShapeBlue is a registered trademark.
>>>
>>>
>>>
>> --
>> Francois Gaudreault
>> Architecte de Solution Cloud | Cloud Solutions Architect
>> fgaudrea...@cloudops.com
>> 514-629-6775
>> - - -
>> CloudOps
>> 420 rue Guy
>> Montréal QC  H3J 1S6
>> www.cloudops.com
>> @CloudOps_
>>
>>
>>
>>
>
> --
> Francois Gaudreault
> Architecte de Solution Cloud | Cloud Solutions Architect
> fgaudrea...@cloudops.com
> 514-629-6775
> - - -
> CloudOps
> 420 rue Guy
> Montréal QC  H3J 1S6
> www.cloudops.com
> @CloudOps_
>
>

Re: CloudStack 4.2 | Xen Server 6.2

[Tim Mackey]

Maurice, the XenServer cloud supplemental pack is only required with older
versions of XenServer. The functionality in that pack is part of XenServer
6.2 which works fine with CloudStack 4.2.
On Feb 4, 2014 7:37 PM, "Maurice Lawler"  wrote:

> Is Xen Server 6.2 supported by Cloudstack 4.2 ? If so, I am not finding a
> supp pack listed here: http://cloudstack.apache.org/
> docs/en-US/Apache_CloudStack/4.2.0/html/Installation_Guide/
> citrix-xenserver-installation.html#system-requirements-xenserver-hosts
>
> I saw some chatter about it being supported by 4.2 -- but that's where my
> trail ended.
>
> Thanks,
> Maurice
>

Re: Software licensing in the cloud

[Tim Mackey]

If you want to host Windows VMs you should really look into the Microsoft
Service Provider License Agreement (SPLA) program:
http://www.microsoft.com/hosting/en/us/licensing/splabenefits.aspx  From
the FAQ : "Microsoft SPLA is the only Microsoft Volume Licensing program
that allows Microsoft products to be used for commercial hosting."  If
you're hosting for internal users (e.g. devs) then existing licenses *may*
work, but I'd consult with your local Microsoft rep to be certain.

iirc there are other options available, but the reporting requirements can
be painful.

-tim


On Tue, Feb 11, 2014 at 9:10 AM, Ricardo Makino wrote:

> Ok understood, thanks for the help!
>
> Regards,
>
> --
> Ricardo Makino
>
>
> On Tue, Feb 11, 2014 at 11:49 AM, Sean Hamilton  >wrote:
>
> > No, the license is per processor on a physical host. We use VMware, but
> > license each host for the instances. No Hyper-V here (just yet).
> >
> >
> > On 11 February 2014 13:47, Ricardo Makino 
> wrote:
> >
> > > Ok it's a good idea, but I don't need to run Windows Server as host
> > (a.k.a
> > > hypervisor), right?
> > >
> > > Regards,
> > >
> > > --
> > > Ricardo Makino
> > >
> > >
> > > On Tue, Feb 11, 2014 at 11:35 AM, Sean Hamilton <
> s...@seanhamilton.co.uk
> > > >wrote:
> > >
> > > > From memory, licensing your compute hosts as "Microsoft Datacenter
> > > Edition"
> > > > then you can run unlimited Windows instances on that host.
> > > > If you're worried about having to license every host in your cloud,
> you
> > > > could look at host tags and see if you can ensure instances built
> with
> > > > Windows Templates are on a certain subset of hosts.
> > > >
> > > > Hope this helps.
> > > > Sean
> > > >
> > > >
> > > > On 11 February 2014 12:30, Ricardo Makino 
> > > wrote:
> > > >
> > > > > Hi Everyone,
> > > > >
> > > > > I have a doubt about what kind of software licensing you use to
> > provide
> > > > > Microsoft instances in a IaaS environment, such like windows server
> > > > > instances.
> > > > >
> > > > > Regards,
> > > > > --
> > > > > Ricardo Makino
> > > > >
> > > >
> > >
> >
>

Re: Limit CPU flags exposed to the VM

[Tim Mackey]

Here's a good article describing how everything behind CPU masking works:
http://support.citrix.com/article/CTX127059.  One key item to note is you
might need to do something in your BIOS to enable the feature.  Don't worry
about the age of the article; everything's still relevant.

(btw Citrix support site appears to be having a problem right now, so if
you google for CTX127059 and look at the cached version)

-tim


On Mon, Feb 24, 2014 at 12:07 PM, Nux!  wrote:

> On 24.02.2014 16:13, Geoff Higginbottom wrote:
>
>> What version of XenServer are you using?
>>
>> 6.2 supports Heterogeneous Resource Pools, so this should allow some
>> flexibility, but older versions do not.
>>
>> http://www.xenserver.org/overview-xenserver-open-
>> source-virtualization/open-source-virtualization-features.html
>>
>
> Thanks Geoff, that might be something useful! I'm on 6.2SP1.
>
>
> Lucian
>
> --
> Sent from the Delta quadrant using Borg technology!
>
> Nux!
> www.nux.ro
>

Re: Customise XenServer ISO?

[Tim Mackey]

I've not tried this, but it looks like this should work for you with
modifications for a fresh ISO.
http://maufderheiden.wordpress.com/2013/05/13/slipstream-supplemental-packs-and-install-xenserver-6-1-from-usb-drive/

I'm going to add this topic to my list of guides for xenserver.org.

Please let me know if this helps, and if you run into any issues.

-tim


On Tue, Mar 4, 2014 at 5:40 PM, Nux!  wrote:

> Hi,
>
> Anyone knows if it's possible to customise the XenServer ISO installer?
> Need to add some newer LSI and Intel NIC drivers and I can't seem to find
> any documentation on this.
>
> Lucian
>
> --
> Sent from the Delta quadrant using Borg technology!
>
> Nux!
> www.nux.ro
>

Re: Customise XenServer ISO?

[Tim Mackey]

That took a bit of digging.  Again, I've tried neither, but there are two
other options:

1. Modify XS-REPOSITORY-LIST in the ISO to contain your supplemental packs
(aka drivers) and re-seal it
2. Use an answerfile and add in the line(s): 
ftp://172.16.0.249/ftp/xs62/driver

If you do the answerfile, you can have multiple driver-source lines listed.
 That would be my preferred option.

I don't have any servers which require custom drives, so if this works for
you, I'd love to capture the info and blog it on xenserver.org.

-tim


On Tue, Mar 4, 2014 at 7:13 PM, Nux!  wrote:

> On 05.03.2014 00:02, Tim Mackey wrote:
>
>> I've not tried this, but it looks like this should work for you with
>> modifications for a fresh ISO.
>> http://maufderheiden.wordpress.com/2013/05/13/
>> slipstream-supplemental-packs-and-install-xenserver-6-1-from-usb-drive/
>>
>> I'm going to add this topic to my list of guides for xenserver.org.
>>
>>
> Hello Tim,
>
> Your document says "Drivers are installed after XenServer Base
> Installation and cannot be integrated using this method if needed for the
> Installation itself!" and that's exactly what I need.
> Any other options?
>
>
>
> Lucian
>
> --
> Sent from the Delta quadrant using Borg technology!
>
> Nux!
> www.nux.ro
>

[PROPOSAL] Support pure Xen as a hypervisor

[Tim Mackey]

Historically CloudStack has used Xen and XenServer interchangeably to refer
to any XenAPI based implementation.  With the recent release of Xen Project
4.4 (http://blog.xen.org/index.php/2014/03/10/xen-4-4-released/), and
interest in alternate architectures like ARM, the loose definition of our
Xen support could be confusing.  In this two part effort I propose that
CloudStack 4.4 be cleansed to ensure that all Xen references become
XenServer references, and second that an alternate hypervisor type of
"XenProject" be introduced for pure Xen which could either support libvirt
or  libxl (preference for libvirt given the 4.4 work to improve the
interface and broader support for libvirt in general).

Cross posted to users to for broader comment.

-tim