Re: ovf file parser

[Abhinandan Prateek]

Hi Will,

  We have hit some road blocks. The main issue here is that cloudstack sees the 
VM as a set of disks, while a OVA contains VM definition including instructions 
on pre boot steps, delays and maybe more. So even if we are able to reliably 
get disks from the OVA and orchestrate these with vCenter, we still may end up 
with some non-booting VM. Following is the flow:

1. Split the OVA into disks and iso, assume boot disk.
2. Boot disk is the parent template and rest of the disks and iso are child 
templates, created in cloudstack.
3. Map disk offerings to disks, cloudstack then orchestrates the boot disk and 
additional disks as a venter VM.
4. Attach the ISO.
  
This works with some limitations. The cloudstack VMs exported as OVA work, but 
some of the appliances that I tested it with show errors on vCenter and 
checking the console reveals booting problem. Have you faced similar issues ? 
How do we go about these. I am not sure if you are in a position to share parts 
of the work that might be relevant. We have kept our PR private as it is still 
under works, but if it is useful we can share it. Basically it is based on 
previous similar effort.

Regards,
-abhi




abhinandan.prat...@shapeblue.com 
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue
  
 

On 04/05/17, 3:06 PM, "Abhinandan Prateek"  
wrote:

>
>The template generation related actions are better done on SSVM as they will 
>be dealing/moving with various data/boot disks. Vim(VMWare infrastructure 
>management), works with vCenter context and as such cannot be used inside 
>SSVM. Vim gives a much better validation of OVF as it can make compatibility 
>checks with vCenter. Currently it is part of vmware hypervisor plugin. Due to 
>these dependency I ended parsing and generating OVF using standard dom api.
>Due to the nature of OVF we also ended up making several assumptions. Like the 
>one that says the first disk is the boot disk. The few OVF file that I have 
>seems to work for now. (Other than that the one OVA had second disk as boot 
>disk). Though the OVF file does contain the OS of the VM but weirdly it does 
>not link it to the disk that has it.
>
>
>Regards,
>-abhi
>
>
>
>On 03/05/17, 5:57 PM, "Will Stevens"  wrote:
>
>>Cool. Let me know if you have questions.
>>
>>My instinct is that we probably want to keep the Ova manipulation in the
>>context of vmware since I don't believe it will be used outside that
>>context. Trying to manipulate the ovf files with generic tools may prove to
>>be more complicated to manage going forward as it is almost guaranteed to
>>require some 'hacks' to make it work. If we can avoid those by using the
>>vim jars, it may be worth it. I have not reviewed anything on the vim jars
>>side, so I don't know how good of an option that is.
>>
>>Are there key benefits to not using the vim jars?
>>
>>Cheers,
>>
>>Will
>>
>>On May 3, 2017 3:34 AM, "Abhinandan Prateek" <
>>abhinandan.prat...@shapeblue.com> wrote:
>>
>>> Hi Will,
>>>
>>>I am improving the multiple disk OVA feature. As part of revamp I am
>>> moving out some OVF manipulation code from the vmware hypervisor plugin
>>> context to secondary storage component. The existing code was using vim25
>>> and managed objects to query and rewrite the OVF file. I have rewritten
>>> that, using standard java w3c dom parser.
>>>
>>>The overall flow is mostly similar and as below:
>>> 1. Decompress OVA and read the OVF file. OVF file will give information
>>> about various disks
>>> 3. Create the regular cloudstack template out for the boot disk and
>>> rewrite the OVF file, minus the information about other disks.
>>> 4. For each additional disk create data disk templates and capture the
>>> relationship in db.
>>> 5. This can then be followed by creating the multi-disk cloudstack VM.
>>>
>>> Essentially I am rewriting the original OVF file after removing the File
>>> and Disk information that refers to the other disks.  Given that the the
>>> VMWare is picky, I think it will require some more cleanup and massaging.
>>> Your inputs will definitely help.
>>>
>>> Overall I think the two pieces, the tool that you have and the cloudstack
>>> multi disk OVA functionality can nicely complement each other. Will post my
>>> learning here.
>>>
>>> Thanks and regards,
>>> -abhi
>>>
>>>
>>>
>>>
>>> On 02/05/17, 6:05 PM, "williamstev...@gmail.com on behalf of Will
>>> Stevens" 
>>

Re: ovf file parser

[Abhinandan Prateek]

The template generation related actions are better done on SSVM as they will be 
dealing/moving with various data/boot disks. Vim(VMWare infrastructure 
management), works with vCenter context and as such cannot be used inside SSVM. 
Vim gives a much better validation of OVF as it can make compatibility checks 
with vCenter. Currently it is part of vmware hypervisor plugin. Due to these 
dependency I ended parsing and generating OVF using standard dom api.
Due to the nature of OVF we also ended up making several assumptions. Like the 
one that says the first disk is the boot disk. The few OVF file that I have 
seems to work for now. (Other than that the one OVA had second disk as boot 
disk). Though the OVF file does contain the OS of the VM but weirdly it does 
not link it to the disk that has it.


Regards,
-abhi



On 03/05/17, 5:57 PM, "Will Stevens"  wrote:

>Cool. Let me know if you have questions.
>
>My instinct is that we probably want to keep the Ova manipulation in the
>context of vmware since I don't believe it will be used outside that
>context. Trying to manipulate the ovf files with generic tools may prove to
>be more complicated to manage going forward as it is almost guaranteed to
>require some 'hacks' to make it work. If we can avoid those by using the
>vim jars, it may be worth it. I have not reviewed anything on the vim jars
>side, so I don't know how good of an option that is.
>
>Are there key benefits to not using the vim jars?
>
>Cheers,
>
>Will
>
>On May 3, 2017 3:34 AM, "Abhinandan Prateek" <
>abhinandan.prat...@shapeblue.com> wrote:
>
>> Hi Will,
>>
>>I am improving the multiple disk OVA feature. As part of revamp I am
>> moving out some OVF manipulation code from the vmware hypervisor plugin
>> context to secondary storage component. The existing code was using vim25
>> and managed objects to query and rewrite the OVF file. I have rewritten
>> that, using standard java w3c dom parser.
>>
>>The overall flow is mostly similar and as below:
>> 1. Decompress OVA and read the OVF file. OVF file will give information
>> about various disks
>> 3. Create the regular cloudstack template out for the boot disk and
>> rewrite the OVF file, minus the information about other disks.
>> 4. For each additional disk create data disk templates and capture the
>> relationship in db.
>> 5. This can then be followed by creating the multi-disk cloudstack VM.
>>
>> Essentially I am rewriting the original OVF file after removing the File
>> and Disk information that refers to the other disks.  Given that the the
>> VMWare is picky, I think it will require some more cleanup and massaging.
>> Your inputs will definitely help.
>>
>> Overall I think the two pieces, the tool that you have and the cloudstack
>> multi disk OVA functionality can nicely complement each other. Will post my
>> learning here.
>>
>> Thanks and regards,
>> -abhi
>>
>>
>>
>>
>> On 02/05/17, 6:05 PM, "williamstev...@gmail.com on behalf of Will
>> Stevens" 
>> wrote:
>>
>> >Hey Abhinandan,
>> >First, can you give us a bit more context regarding what you are doing so
>> >we can highlight potential areas to watch out for?  I have done some OVF
>> >parsing/modification and there are a bunch of gotchas to be aware of.  I
>> >will try to outline some of the ones I found.  I have not tried to use the
>> >vim25.jar, so I can't really help on that front.
>> >
>> >In my use case, I was exporting VMs via the ovftool from a source VMware
>> >environment, and I was migrating them to an ACS managed VMware
>> >environment.  In doing so, I also wanted to support VMs with multiple
>> disks
>> >using a Root volume and multiple Data volumes, as well as change the nic
>> >type (vmxnet3), assign static IPs, etc...  I have not had the time to open
>> >source my migration tool, but it is on my todo list.
>> >
>> >My general flow was:
>> >- Export the VM with ovftool
>> >- Extract the resulting OVA into its parts (OVF, VMDKs, Manifest)
>> >- Duplicate the OVF file, once per VMDK
>> >- Modify a OVF file to be specific for each of the VMDKs (one OVF per
>> VMDK)
>> >- Take each VMDK and the corresponding OVF and recompress them back into
>> an
>> >OVA
>> >- Treat the first OVA as a template and the rest as data disks
>> >
>> >My initial (naive) approach was to just treat the OVF as a well behaved
>> XML
>> >file and use standard XML libs (in my case in Python) to parse and
>>

Re: ovf file parser

[Abhinandan Prateek]

Hi Will,

   I am improving the multiple disk OVA feature. As part of revamp I am moving 
out some OVF manipulation code from the vmware hypervisor plugin context to 
secondary storage component. The existing code was using vim25 and managed 
objects to query and rewrite the OVF file. I have rewritten that, using 
standard java w3c dom parser. 

   The overall flow is mostly similar and as below:
1. Decompress OVA and read the OVF file. OVF file will give information about 
various disks 
3. Create the regular cloudstack template out for the boot disk and rewrite the 
OVF file, minus the information about other disks.
4. For each additional disk create data disk templates and capture the 
relationship in db.
5. This can then be followed by creating the multi-disk cloudstack VM.

Essentially I am rewriting the original OVF file after removing the File and 
Disk information that refers to the other disks.  Given that the the VMWare is 
picky, I think it will require some more cleanup and massaging. Your inputs 
will definitely help.

Overall I think the two pieces, the tool that you have and the cloudstack multi 
disk OVA functionality can nicely complement each other. Will post my learning 
here.

Thanks and regards,
-abhi




On 02/05/17, 6:05 PM, "williamstev...@gmail.com on behalf of Will Stevens" 
 wrote:

>Hey Abhinandan,
>First, can you give us a bit more context regarding what you are doing so
>we can highlight potential areas to watch out for?  I have done some OVF
>parsing/modification and there are a bunch of gotchas to be aware of.  I
>will try to outline some of the ones I found.  I have not tried to use the
>vim25.jar, so I can't really help on that front.
>
>In my use case, I was exporting VMs via the ovftool from a source VMware
>environment, and I was migrating them to an ACS managed VMware
>environment.  In doing so, I also wanted to support VMs with multiple disks
>using a Root volume and multiple Data volumes, as well as change the nic
>type (vmxnet3), assign static IPs, etc...  I have not had the time to open
>source my migration tool, but it is on my todo list.
>
>My general flow was:
>- Export the VM with ovftool
>- Extract the resulting OVA into its parts (OVF, VMDKs, Manifest)
>- Duplicate the OVF file, once per VMDK
>- Modify a OVF file to be specific for each of the VMDKs (one OVF per VMDK)
>- Take each VMDK and the corresponding OVF and recompress them back into an
>OVA
>- Treat the first OVA as a template and the rest as data disks
>
>My initial (naive) approach was to just treat the OVF as a well behaved XML
>file and use standard XML libs (in my case in Python) to parse and
>manipulate the OVF file.  This approach had a few pitfalls which I will
>outline here.
>
>VMware is VERY picky about the format of the OVF file, if the file is not
>perfect, VMware won't import it (or at least the VM won't launch).  There
>were two main items which caused me issues.
>
>a) The  tag MUST have all of the namespace definitions even if
>they are not used in the file.  This is something that most XML parsers are
>confused by.  Most XML parsers will only include the namespaces used in the
>file when the file is saved.  I had to ensure that the resulting OVF files
>had all of the original namespace definitions for the file to import
>correctly.  If I remember correctly, they even had to be in the right
>order.  I did this by changing the resulting file after saving it with the
>XML lib.
>
>b) VMware uses namespaces which actually collide with each other.  For
>example, both the default namespace and the 'ovf' namespace share the same
>URL.  Again, XML libraries don't understand this, so I had to manage that
>manually.  Luckily, the way VMware handles these namespaces is relatively
>consistent, so I was able to find a workaround.  Basically, the default
>namespace will apply to all of the elements, and the 'ovf' namespace will
>be applied only in the attributes.  Because of this I was able to just use
>the 'ovf' namespace and then after exporting the file, I did a find replace
>from '
>Those are the main gotchas which I encountered.
>
>I put the OVA Split function I wrote into a Gist [1] (for now) for your
>reference in case reviewing the code is helpful.  I was under a lot of time
>pressure when building this tool, so I have a bunch of cleanup to do before
>I release it as open source, but I can rush it out and clean it up after
>release if you are solving the same(ish) problem and my code will be useful.
>
>[1] https://gist.github.com/swill/f6b54762ffcce85772535a490a9c8cbe
>
>I hope this is helpful in your case.
>
>Cheers,
>
>*Will STEVENS*
>Lead Developer
>
><https://goo.gl/NYZ8KK>
>
>On Tue, May 2, 2017 at 3:49 A

ovf file parser

[Abhinandan Prateek]

Hello,

I am looking at vim25.jar to put together ovftool like functionality specially 
around parsing and generating OVF files. vim25.jar  is already included as 
non-oss dependency and used by vmware hypervisor plugin. I see that some OVF 
parsing capabilities are present in this jar, but it seems to be tied to host 
connection/context. Can anyone who has used this can tell me if I can use it as 
a standalone OVF manipulation api any pointer to good resource on that will be 
nice.

Regards,
-abhi



abhinandan.prat...@shapeblue.com 
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue
  
 

Re: Import Ova with multiple Disks

[Abhinandan Prateek]

Hi Guys,

  There was some work done by Citrix in 2014 on multi disk OVA that I have 
pulled into a PR here https://github.com/apache/cloudstack/pull/1998.
Though I have created it on 4.9 branch as I thought it will be more stable to 
test. I will move it to 4.10 once it is ready for merge.

  I have tested it and it works with multdisk-OVA files, there is some room for 
further improvement, I have listed down my thoughts there.

Regards,
-abhi




On 10/03/17, 5:19 AM, "Lucas Berri Cristofolini"  
wrote:

>Ah, got it. That makes a lot of sense, actually.
>
>Thanks for the clarification, Will!
>
>On Mar 9, 2017 20:34, "Will Stevens"  wrote:
>
>Damn autocorrect. Las=LTS
>
>On Mar 9, 2017 6:33 PM, "Will Stevens"  wrote:
>
>> Just to set some realistic expectations (as the previous 4.9 release
>> manager) so no one is caught off guard here.
>>
>> The 4.9 release branch is an Las branch, so new features should not be
>> getting merged into that branch.
>>
>> The 4.10 branch is currently between RC1 and RC2, so I doubt we will see
>> it merged in before RC2 as it is not a blocker.
>>
>> I would not expect this feature to be released in a stable branch for a
>> couple months (unless I missed something).
>>
>> That's my two cents. I could be wrong, but I'd I were you I would not
>> expect this feature in the short term.
>>
>> On Mar 9, 2017 6:08 PM, "Lucas Berri Cristofolini" <
>> lucascristofol...@gmail.com> wrote:
>>
>>> Hey Will,
>>>
>>> There is a PR open for it at https://github.com/apache/clou
>>> dstack/pull/1989
>>> to be merged into version 4.9, though it looks like a pretty significant
>>> amount of work and by the time it's ready I imagine we might be looking
>>> into 4.10.
>>>
>>> Not my PR, but seems that disks do get implemented as data volumes.
>>>
>>> On Thu, Mar 9, 2017 at 8:00 PM, Will Stevens 
>>> wrote:
>>>
>>> > Hey Lucas,
>>> > What version is that feature expected to be in?  Is there a PR open for
>>> > it?  Do the additional disks get implemented as data volumes in ACS?
>>> >
>>> > Cheers,
>>> >
>>> > *Will STEVENS*
>>> > Lead Developer
>>> >
>>> > 
>>> >
>>> > On Thu, Mar 9, 2017 at 5:46 PM, Lucas Berri Cristofolini <
>>> > lucascristofol...@gmail.com> wrote:
>>> >
>>> > > Hello Fariaz,
>>> > >
>>> > > As of yet, OVAs with multiple disks are not supported, however
>>> progress
>>> > has
>>> > > been made in the past few days towards supporting them.
>>> > >
>>> > > I'll try and keep you posted when more progress is made.
>>> > >
>>> > >
>>> > >
>>> > > On Thu, Mar 9, 2017 at 7:16 PM, Fariaz Diloo  wrote:
>>> > >
>>> > > > Hi all,
>>> > > >
>>> > > > I was wondering if ova with multiple disks are now supported on
>>> > > cloudstack
>>> > > > ?
>>> > > > most of my clients have vmware vms.
>>> > > >
>>> > > > Best regards
>>> > > >
>>> > > >
>>> > > >
>>> > > > --
>>> > > > Diloo Fariaz
>>> > > > Technical architect
>>> > > >
>>> > >
>>> >
>>>
>>

abhinandan.prat...@shapeblue.com 
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue
  
 

Re: Modern template hosting

[Abhinandan Prateek]

Initial seeding is a manual step and that is not going to change in near 
future. A handy list of official places from where these templates can be 
downloaded won’t harm this part of the installation. Just allow anyone credible 
who follows democratic process to publish their templates with apache’s 
blessings.


Coming to urls hard coded in db, the popular suggestion is to point them to 
mirrors. This looks good but this is going to take some effort that has not 
materialised yet. Once this change is made it will be going in some future 
release like 4.11; the problem still remains for the releases that are already 
out there. In case access to download.cloud.com is dropped at some point we 
will have to document the procedure such that people know how to make these 
stable releases work. That is where the procedure documented here 
https://shankerbalan.net/blog/seed-cloudstack-templates-offline/ should be 
officially adapted with a marketplace to pick up templates of choosing. Maybe 
we can have a pre-setup script to make choices instead of written wiki. Note 
that this will be anyway needed by the older releases.




On 01/03/17, 4:24 PM, "Paul Angus"  wrote:

>-1
>
>We are trying to get MORE people to use CloudStack.  And raising the barrier 
>to entry does nothing to help that.
>
>
>Kind regards,
>
>Paul Angus
>
>paul.an...@shapeblue.com 
>www.shapeblue.com
>53 Chandos Place, Covent Garden, London  WC2N 4HSUK
>@shapeblue
>  
> 
>
>
>-Original Message-
>From: Abhinandan Prateek [mailto:abhinandan.prat...@shapeblue.com] 
>Sent: 01 March 2017 09:39
>To: dev@cloudstack.apache.org
>Subject: Re: Modern template hosting
>
>+1
>
>After seeing this discussion running in circles several times, I think we 
>should at least get started with the simplest option.
>
>
>
>
>On 27/02/17, 11:54 PM, "Chiradeep Vittal"  wrote:
>
>>The alternative foolproof way is to simply not provide the automatic 
>>download.
>>
>>Just document the mirror list URL where the templates can be found. I 
>>don't know why people reject this option.
>>
>>https://shankerbalan.net/blog/seed-cloudstack-templates-offline/
>>
>>On Mon, Feb 27, 2017 at 10:15 AM, Will Stevens 
>>
>>wrote:
>>
>>> OK. Thanks for the heads up.
>>>
>>> On Feb 27, 2017 1:08 PM, "Chiradeep Vittal"  wrote:
>>>
>>> > Sounds workable. The downloader code in the SSVM won't follow 
>>> > redirects I think.
>>> > https://github.com/apache/cloudstack/blob/5511065fc20787619d9cd0444
>>> > a65a3 155fc9c921/core/src/com/cloud/storage/template/
>>> > HttpTemplateDownloader.java#L93
>>> > https://goo.gl/dSi0r5
>>> >  Might need to add
>>> > client.setRedirectStrategy(new LaxRedirectStrategy());
>>> >
>>> > On Mon, Feb 27, 2017 at 9:57 AM, Will Stevens 
>>> > 
>>> > wrote:
>>> >
>>> > > We haven't opened a ticket yet because we don't have a strategy yet.
>>> > >
>>> > > What do you guys think of this:
>>> > > - We setup a new github repo in the 'apache' org which consists 
>>> > > of a
>>> > single
>>> > > file with a list of active/supported mirrors.
>>> > > - I write a small web server, distributed as a binary, which can 
>>> > > be
>>> > hosted
>>> > > by ASF Infra.  This web server will query the current list of 
>>> > > mirrors
>>> and
>>> > > will select one and then do a 302 redirect to that mirror.
>>> > >
>>> > > The act of 'choosing' a mirror could be done in a number of ways.
>>> > > - If we want to define an order, then it could just try from the 
>>> > > top of
>>> > the
>>> > > list and work its way down.  It would curl the target to make 
>>> > > sure it
>>> > gets
>>> > > a 200 and if it does, it would do a 302 redirect.
>>> > > - Or, if we want to distribute the load across the mirrors, we 
>>> > > could
>>> pick
>>> > > from the list randomly.  Again, doing a curl to verify the mirror 
>>> > > is up
>>> > and
>>> > > then doing a redirect.
>>> > > - If we want to get fancy, we could do a reverse IP lookup and 
>>> > > try to
>>> > match
>>> > > the requester with their closest geographical mirror.
>>> > >
>>> > > Thoughts?
&

Re: Modern template hosting

[Abhinandan Prateek]

+1

After seeing this discussion running in circles several times, I think we 
should at least get started with the simplest option.




On 27/02/17, 11:54 PM, "Chiradeep Vittal"  wrote:

>The alternative foolproof way is to simply not provide the automatic
>download.
>
>Just document the mirror list URL where the templates can be found. I don't
>know why people reject this option.
>
>https://shankerbalan.net/blog/seed-cloudstack-templates-offline/
>
>On Mon, Feb 27, 2017 at 10:15 AM, Will Stevens 
>wrote:
>
>> OK. Thanks for the heads up.
>>
>> On Feb 27, 2017 1:08 PM, "Chiradeep Vittal"  wrote:
>>
>> > Sounds workable. The downloader code in the SSVM won't follow redirects I
>> > think.
>> > https://github.com/apache/cloudstack/blob/5511065fc20787619d9cd0444a65a3
>> > 155fc9c921/core/src/com/cloud/storage/template/
>> > HttpTemplateDownloader.java#L93
>> > https://goo.gl/dSi0r5
>> >  Might need to add
>> > client.setRedirectStrategy(new LaxRedirectStrategy());
>> >
>> > On Mon, Feb 27, 2017 at 9:57 AM, Will Stevens 
>> > wrote:
>> >
>> > > We haven't opened a ticket yet because we don't have a strategy yet.
>> > >
>> > > What do you guys think of this:
>> > > - We setup a new github repo in the 'apache' org which consists of a
>> > single
>> > > file with a list of active/supported mirrors.
>> > > - I write a small web server, distributed as a binary, which can be
>> > hosted
>> > > by ASF Infra.  This web server will query the current list of mirrors
>> and
>> > > will select one and then do a 302 redirect to that mirror.
>> > >
>> > > The act of 'choosing' a mirror could be done in a number of ways.
>> > > - If we want to define an order, then it could just try from the top of
>> > the
>> > > list and work its way down.  It would curl the target to make sure it
>> > gets
>> > > a 200 and if it does, it would do a 302 redirect.
>> > > - Or, if we want to distribute the load across the mirrors, we could
>> pick
>> > > from the list randomly.  Again, doing a curl to verify the mirror is up
>> > and
>> > > then doing a redirect.
>> > > - If we want to get fancy, we could do a reverse IP lookup and try to
>> > match
>> > > the requester with their closest geographical mirror.
>> > >
>> > > Thoughts?
>> > >
>> > > *Will STEVENS*
>> > > Lead Developer
>> > >
>> > > 
>> > >
>> > > On Mon, Feb 27, 2017 at 12:46 PM, Chiradeep Vittal <
>> chirade...@gmail.com
>> > >
>> > > wrote:
>> > >
>> > > > What steps are needed to set up a mirror? What does Infra need to do?
>> > Has
>> > > > anybody filed a ticket with Infra?
>> > > >
>> > > > On Sun, Feb 26, 2017 at 10:17 PM, Raja Pullela <
>> > > > raja.pull...@accelerite.com>
>> > > > wrote:
>> > > >
>> > > > > Hi will,
>> > > > >
>> > > > > I believe, we didn’t get to close ‘getting a mirror on Apache’
>> > because
>> > > we
>> > > > > needed someone on the Apache Infra side to close this. BTW,
>> > > > > cloudstack-apt.get.eu (I think Nux manages this?) has all/most of
>> > the
>> > > > > content.  Once we can close on the Apache mirror for hosting the
>> > > > content, I
>> > > > > can help assist getting the content there.
>> > > > >
>> > > > > For now, we have replicated the download.cloud.com content to ‘
>> > > > > s3.download.accelerite.com’.
>> > > > > Also, we are working on a set of steps/procedure to help with this
>> > > > > change.  I will update everyone in about a week’s time on the
>> > details.
>> > > > >
>> > > > > Best,
>> > > > > Raja Pullela
>> > > > > Engineering Team,
>> > > > > Accelerite, 2055 Laurelwood Road,
>> > > > > Santa Clara, CA, 95054
>> > > > >
>> > > > > On 2/24/17, 11:23 PM, "williamstev...@gmail.com on behalf of Will
>> > > > > Stevens" > > wstev...@cloudops.com>
>> > > > > wrote:
>> > > > >
>> > > > > unfortunately the template mirror conversation got caught up in
>> > details
>> > > > and
>> > > > > nobody took the lead on implementing a solution.
>> > > > >
>> > > > > citrix has been pinging me every couple months to say 'dude, we
>> need
>> > to
>> > > > > remove the dependency on download.citrix.com', but i have not had
>> > the
>> > > > > cycles to get in and solve the problem.  the shutdown of that is
>> > > imminent
>> > > > > right now, so we need to solve it asap.
>> > > > >
>> > > > >
>> > > > >
>> > > > > *Will STEVENS*
>> > > > > Lead Developer
>> > > > >
>> > > > > 
>> > > > >
>> > > > > On Fri, Feb 24, 2017 at 12:38 PM, Paul Angus <
>> > paul.an...@shapeblue.com
>> > > >
>> > > > > wrote:
>> > > > >
>> > > > > > Hi Nathan,
>> > > > > >
>> > > > > > Ideally, if you put the template location in (or use a template
>> > > defined
>> > > > > > in)  test_data.py then the actual location can be overridden by
>> > > anyone
>> > > > > > testing.
>> > > > > >
>> > > > > > For Trillian, we've copied all of the templates that people have
>> > > define
>> > > > > to
>> > > > > > a local repo and then replace the URLs in test_data.py to reduce
>> > > > > bandwidth
>> > > > > > use and 

Re: [VOTE] Apache Cloudstack 4.9.2.0 (RC1)

[Abhinandan Prateek]

+1

Tested around vm lifecycle.



-abhi

On 27/12/16, 1:13 PM, "Rohit Yadav"  wrote:

>Hi All,
>
>I've created a 4.9.1.0 release, with the following artifacts up for a vote:
>
>Git Branch and Commit SH:
>https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;a=shortlog;h=refs/heads/4.9.2.0-RC20161227T1309
>Commit: d410612dbc9623d3ff0e96e468cf0a72ef98a765
>
>Source release (checksums and signatures are available at the same
>location):
>https://dist.apache.org/repos/dist/dev/cloudstack/4.9.2.0/
>
>PGP release keys (signed using 0EE3D884):
>https://dist.apache.org/repos/dist/release/cloudstack/KEYS
>
>Vote will be open for 72 hours. For reference,
>
>For sanity in tallying the vote, can PMC members please be sure to indicate
>"(binding)" with their vote?
>
>[ ] +1  approve
>[ ] +0  no opinion
>[ ] -1  disapprove (and reason why)
>
>Regards.

abhinandan.prat...@shapeblue.com 
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue
  
 

Re: patchviasocket seems to be broken with qemu 2.3(+?)

[Abhinandan Prateek]

It could be a timeout as in these tickets: 
https://issues.apache.org/jira/browse/CLOUDSTACK-9503/https://issues.apache.org/jira/browse/CLOUDSTACK-9569
Either you get the patch that increases the timeout OR you can add 
router.aggregation.command.each.timeout=<600>  in agent.properties and restart 
cloudstack-agent


From: Linas Žilinskas mailto:li...@host1plus.com>>
Reply-To: "dev@cloudstack.apache.org" 
mailto:dev@cloudstack.apache.org>>
Date: Thursday, 20 October 2016 at 3:29 PM
To: "dev@cloudstack.apache.org" 
mailto:dev@cloudstack.apache.org>>
Subject: patchviasocket seems to be broken with qemu 2.3(+?)


Hi.

We have made an upgrade to 4.9.

Custom build packages with our own patches, which in my mind (i'm the only one 
patching those) should not affect the issue i'll describe.

I'm not sure whether we didn't notice it before, or it's actually related to 
something in 4.9

Basically our system vm's were unable to be patched via the qemu socket. The 
script simply error'ed out with a timeout while trying to push the data to the 
socket.

Executing it manually (with cmd line from the logs) resulted the same. I even 
tried the old perl variant, which also had same result.

So finally we found out that this issue happens only on our HVs which run qemu 
2.3.0, from the centos 7 special interest virtualization repo. Other ones that 
run qemu 1.5, from official repos, can patch the system vms fine.

So i'm wondering if anyone tested 4.9 with kvm with qemu >= 2.x? Maybe it 
something else special in our setup. e.g. we're running the HVs from a 
preconfigured netboot image (pxe), but all of them, including those with qemu 
1.5, so i have no idea.

Linas Žilinskas
Head of Development
[cid:part1.BFF385E0.BF4C3EA6@host1plus.com]
website facebook 
twitter 
linkedin

Host1Plus is a division of Digital Energy Technologies Ltd.

26 York Street, London W1U 6PZ, United Kingdom



abhinandan.prat...@shapeblue.com 
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue
  
 

Re: [GitHub] cloudstack issue #1807: CLOUDSTACK-9633: Revert addition of `vhd` extention ...

[Abhinandan Prateek]

Syed,

  Any test that is calling is_snapshot_on_nfs from utils.py will fail for Xen 
as it ends up appending an additional “.vhd” to the install_path. There are 
several of them both in smoke and component folder. The reason this is under 
scrutiny is die to marvin test failures.



On 06/12/16, 9:33 AM, "Syed Ahmed"  wrote:

>Yes this will break managed snapshot archives. I want to understand what
>this revert is trying to fix and what tests were failing.
>On Mon, Dec 5, 2016 at 22:38 abhinandanprateek  wrote:
>
>> Github user abhinandanprateek commented on the issue:
>>
>> https://github.com/apache/cloudstack/pull/1807
>>
>> @syed can you look at this 'revert' i guess this is going to be an
>> issue with the managed storage change that has been put in. cc @rhtyd
>>
>>
>> ---
>> If your project is set up for it, you can reply to this email and have your
>> reply appear on GitHub as well. If your project does not have this feature
>> enabled and wishes so, or if the feature is enabled but not working, please
>> contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
>> with INFRA.
>> ---
>>

abhinandan.prat...@shapeblue.com 
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue
  
 

Re: Error adding primary storage from the UI

[Abhinandan Prateek]

Could it be that you created a zone with local storage ?

From: Syed Ahmed mailto:sah...@cloudops.com>>
Reply-To: "dev@cloudstack.apache.org" 
mailto:dev@cloudstack.apache.org>>
Date: Thursday, 10 November 2016 at 4:25 AM
To: "dev@cloudstack.apache.org" 
mailto:dev@cloudstack.apache.org>>
Cc: "Tutkowski, Mike" 
mailto:mike.tutkow...@netapp.com>>
Subject: Error adding primary storage from the UI

Hi All,

I was setting up a new cloudstack installation from source and I ran into a 
weird issue. I cannot seem to be able to add a NFS primary storage from the UI. 
It asks me to provide a URL but that field is reserved only for managed storage.

Anyone else face this issue?



abhinandan.prat...@shapeblue.com 
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue
  
 

Re: [DISCUSS] Replacing the VR

[Abhinandan Prateek]

Cloudrouter looks promising. These have potential to save future engineering 
effort for example on ipv6 routing, OSPF etc.
And the best part is they come with test automation framework.





On 13/09/16, 4:22 PM, "Jayapal Uradi"  wrote:

>Hi,
>
>Instead of replacing the VR in first place we should add VyOS/cloudrouter as 
>provider. Once it is stable, network offerings (on upgrade) can be updated to 
>use it and we can drop the VR if we want at that release onwards.
>
>VR is stabilized over a period of time and some of them are running without 
>issues.  When we replicate the ACS VR features in new solution it takes some 
>to find the missing pieces (hidden bugs).
>
>Thanks,
>Jayapal
>
>> On Sep 13, 2016, at 2:52 PM, Nux! <
>
>> n...@li.nux.ro> wrote:
>> 
>> Hi,
>> 
>> I like the idea.
>> 
>> Cloudrouter looks really promising, I'm not too keen on VyOS (it doesn't 
>> have a proper http api etc).
>> 
>> --
>> Sent from the Delta quadrant using Borg technology!
>> 
>> Nux!
>> www.nux.ro
>> 
>> 
abhinandan.prat...@shapeblue.com 
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue
  
 

- Original Message -
>>> From: "Will Stevens" 
>>> To: dev@cloudstack.apache.org
>>> Sent: Monday, 12 September, 2016 21:20:11
>>> Subject: [DISCUSS] Replacing the VR
>> 
>>> *Disclaimer:* This is a thought experiment and should be treated as such.
>>> Please weigh in with the good and bad of this idea...
>>> 
>>> A couple of us have been discussing the idea of potentially replacing the
>>> ACS VR with the VyOS [1] (Open Source Vyatta VM).  There may be a license
>>> issue because I think it is licensed under GPL, but for the sake of
>>> discussion, let's assume we can overcome any license issues.
>>> 
>>> I have spent some time recently with the VyOS and I have to admit, I was
>>> pretty impressed.  It is simple and intuitive and it gives you a lot more
>>> options for auditing the configuration etc...
>>> 
>>> Items of potential interest:
>>> - Clean up our current VR script spaghetti to a simpler more auditable
>>> configuration workflow.
>>> - Gives a cleaner path for IPv6 support.
>>> - Handles VPN configuration via the same configuration interface.
>>> - Support for OSPF & BGP.
>>> - VPN support through OpenVPN & StrongSwan.
>>> - Easily supports HA (redundant routers) through VRRP.
>>> - VXLAN support.
>>> - Transaction based changes to the VR with rollback on error.
>>> 
>>> Items that could be difficult to solve:
>>> - Userdata password reset workflow and implementation.
>>> - Upgrade process.
>>> 
>>> The VyOS is not the only option if we were to consider this approach.
>>> Another option, which I don't know as well, would be CloudRouter (AGPL
>>> license) [2] which is purely API driven.
>>> 
>>> Anyway, would love to hear your thoughts...
>>> 
>>> Will
>>> 
>>> [1] https://vyos.io/
>>> [2] https://cloudrouter.org/
>
>
>
>
>DISCLAIMER
>==
>This e-mail may contain privileged and confidential information which is the 
>property of Accelerite, a Persistent Systems business. It is intended only for 
>the use of the individual or entity to which it is addressed. If you are not 
>the intended recipient, you are not authorized to read, retain, copy, print, 
>distribute or use this message. If you have received this communication in 
>error, please notify the sender and delete all copies of this message. 
>Accelerite, a Persistent Systems business does not accept any liability for 
>virus infected mails.

Re: Few tables in cloudstack schema use MyISAM engine

[Abhinandan Prateek]

Thanks Erik for correcting.

More precisely, this is in context of migration of mysql db to Galera cluster, 
where there is a limitation with Galera cluster that it supports only InnodDB 
for replication due to its transactional nature.


Regards,
-abhi



On 31/08/16, 12:44 PM, "Erik Weber"  wrote:

>Just nit-picking, but MyISAM allows replication as well.
>
>I'm +1 to the change.
>
>-- 
>Erik
>
>On Wed, Aug 31, 2016 at 5:37 AM, Abhinandan Prateek <
>abhinandan.prat...@shapeblue.com> wrote:
>
>> Thanks, Koushik.
>>
>> Have created a PR to make the engine type consistent for all tables.
>> InnoDB allows for replication, that is all the more reason that we change
>> the engine type of these few tables to InnoDB.
>>
>> Regards,
>> -abhi
>>
>> PR: https://github.com/apache/cloudstack/pull/1667
>>
>>
>> From: Koushik Das > koushik@accelerite.com>>
>> Date: Tuesday, 30 August 2016 at 5:25 PM
>> To: Abhinandan Prateek > abhinandan.prat...@shapeblue.com>>, "dev@cloudstack.apache.org> dev@cloudstack.apache.org>" > dev@cloudstack.apache.org>>
>> Cc: Rajani Karuturi mailto:raj...@apache.org>>, Raja
>> Pullela mailto:raja.pull...@accelerite.com>>
>> Subject: Re: Few tables in cloudstack schema use MyISAM engine
>>
>> I cannot think of any. Most probably in all cases the engine was not
>> explicitly specified and the default got used. As per below default was
>> myisam before mysql 5.5.5.
>> https://dev.mysql.com/doc/refman/5.5/en/storage-engine-setting.html
>>
>> Thanks,
>> Koushik
>> From: Abhinandan Prateek > abhinandan.prat...@shapeblue.com>>
>> Date: Tuesday, 30 August 2016 at 4:23 PM
>> To: "dev@cloudstack.apache.org<mailto:dev@cloudstack.apache.org>" <
>> dev@cloudstack.apache.org<mailto:dev@cloudstack.apache.org>>
>> Cc: Rajani Karuturi mailto:raj...@apache.org>>, Raja
>> Pullela mailto:raja.pull...@accelerite.com>>,
>> Koushik Das mailto:koushik@accelerite.com
>> >>
>> Subject: Few tables in cloudstack schema use MyISAM engine
>>
>> Hi,
>>
>>Was there any specific reason that some tables in cloudstack schema use
>> MyISAM engine.
>> I know of “ quota_account” that I created and put in the diff table type
>> unknowingly. I assume such is the case with other such tables –
>> load_balancer_cert_map, monitoring_services, nic_ip_alias, sslcerts.
>>
>> Filed a ticket here to get this fixed or reason for not fixing it captured.
>>
>> Regards,
>> -abhi
>>
>> abhinandan.prat...@shapeblue.com<mailto:abhinandan.prat...@shapeblue.com>
>> www.shapeblue.com
>> @shapeblue
>>
>>
>>
>>
>> DISCLAIMER == This e-mail may contain privileged and confidential
>> information which is the property of Accelerite, a Persistent Systems
>> business. It is intended only for the use of the individual or entity to
>> which it is addressed. If you are not the intended recipient, you are not
>> authorized to read, retain, copy, print, distribute or use this message. If
>> you have received this communication in error, please notify the sender and
>> delete all copies of this message. Accelerite, a Persistent Systems
>> business does not accept any liability for virus infected mails.
>>
>> abhinandan.prat...@shapeblue.com
>> www.shapeblue.com
>> 53 Chandos Place, Covent Garden, London  WC2N 4HSUK
>> @shapeblue
>>
>>
>>
>>

abhinandan.prat...@shapeblue.com 
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue
  
 

Re: Few tables in cloudstack schema use MyISAM engine

[Abhinandan Prateek]

Thanks, Koushik.

Have created a PR to make the engine type consistent for all tables.
InnoDB allows for replication, that is all the more reason that we change the 
engine type of these few tables to InnoDB.

Regards,
-abhi

PR: https://github.com/apache/cloudstack/pull/1667


From: Koushik Das 
mailto:koushik@accelerite.com>>
Date: Tuesday, 30 August 2016 at 5:25 PM
To: Abhinandan Prateek 
mailto:abhinandan.prat...@shapeblue.com>>, 
"dev@cloudstack.apache.org<mailto:dev@cloudstack.apache.org>" 
mailto:dev@cloudstack.apache.org>>
Cc: Rajani Karuturi mailto:raj...@apache.org>>, Raja Pullela 
mailto:raja.pull...@accelerite.com>>
Subject: Re: Few tables in cloudstack schema use MyISAM engine

I cannot think of any. Most probably in all cases the engine was not explicitly 
specified and the default got used. As per below default was myisam before 
mysql 5.5.5.
https://dev.mysql.com/doc/refman/5.5/en/storage-engine-setting.html

Thanks,
Koushik
From: Abhinandan Prateek 
mailto:abhinandan.prat...@shapeblue.com>>
Date: Tuesday, 30 August 2016 at 4:23 PM
To: "dev@cloudstack.apache.org<mailto:dev@cloudstack.apache.org>" 
mailto:dev@cloudstack.apache.org>>
Cc: Rajani Karuturi mailto:raj...@apache.org>>, Raja Pullela 
mailto:raja.pull...@accelerite.com>>, Koushik Das 
mailto:koushik@accelerite.com>>
Subject: Few tables in cloudstack schema use MyISAM engine

Hi,

   Was there any specific reason that some tables in cloudstack schema use 
MyISAM engine.
I know of “ quota_account” that I created and put in the diff table type 
unknowingly. I assume such is the case with other such tables – 
load_balancer_cert_map, monitoring_services, nic_ip_alias, sslcerts.

Filed a ticket here to get this fixed or reason for not fixing it captured.

Regards,
-abhi

abhinandan.prat...@shapeblue.com<mailto:abhinandan.prat...@shapeblue.com>
www.shapeblue.com
@shapeblue




DISCLAIMER == This e-mail may contain privileged and confidential 
information which is the property of Accelerite, a Persistent Systems business. 
It is intended only for the use of the individual or entity to which it is 
addressed. If you are not the intended recipient, you are not authorized to 
read, retain, copy, print, distribute or use this message. If you have received 
this communication in error, please notify the sender and delete all copies of 
this message. Accelerite, a Persistent Systems business does not accept any 
liability for virus infected mails.

abhinandan.prat...@shapeblue.com 
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue
  
 

Few tables in cloudstack schema use MyISAM engine

[Abhinandan Prateek]

Hi,

   Was there any specific reason that some tables in cloudstack schema use 
MyISAM engine.
I know of “ quota_account” that I created and put in the diff table type 
unknowingly. I assume such is the case with other such tables – 
load_balancer_cert_map, monitoring_services, nic_ip_alias, sslcerts.

Filed a ticket here to get this fixed or reason for not fixing it captured.

Regards,
-abhi

abhinandan.prat...@shapeblue.com 
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue
  
 

[DISCUSS] Marvin optimizations

[Abhinandan Prateek]

Hi,

   Most of us have been running marvin tests in virtual environments and it 
takes days to run all the tests.
I have filed https://issues.apache.org/jira/browse/CLOUDSTACK-9453 to work on 
few enhancements that have the potential to substantially speedup the tests.
I think there are others will have similar thoughts or plans, like in the past 
someone has suggested to include machininna templates along with Centos.

Please, do chime in if you have a suggestion that can be incorporated to 
improve Marvin.

-abhi


abhinandan.prat...@shapeblue.com 
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue
  
 

Re: [VOTE] Apache Cloudstack 4.9.0 RC2

[Abhinandan Prateek]

+1

Did manual testing with a cluster of Xen 6.5 in advanced zone.
Vm life cycle
VM Snapshot, volume snapshots
Volume and Template from snapshots
Migration
Change Password
Change service offering
VPC, multiple tiers, VMs, ACLs

Regards,
-abhi





On 29/07/16, 1:43 AM, "John Burwell"  wrote:

>All,
>
>I vote +1 (binding).  We have tested 4.9.0 RC2 in the following environments:
>
>   • CentOS 6.8 management server + CentOS 6.8 KVM Hosts using NFS primary 
> and secondary storage (would allow us to verify/fix the documented 
> libvirt/qemu versions)
>   • CentOS 6.8 management server + vCenter 5.5u3d + ESXi 5.5u3b using NFS 
> primary and secondary storage
>   • CentOS 6.8 management server + vCenter 6.0u2 + ESXi Express Patch 6 
> using NFS primary and secondary storage
>   • CentOS 6.8 management server + XenServer 6.2 SP1 using NFS primary 
> and secondary storage
>   • CentOS 6.8 management server + XenServer 6.5 SP1 using NFS primary 
> and secondary storage
>
>For each environment, we have run the following tests:
>
>   • All smoke tests
>   • test_accounts.py
>   • test_acl_*.py
>   • test_sharednetwork*.py
>   • test_add_remove_network.py
>   • test_advancedsg_networks.py
>   • test_affinity_groups*.py
>   • test_cpu_domain_limits.py
>   • test_cpu_limits.py
>   • test_cpu_max_limits.py
>   • test_host_maintenance.py
>   • test_memory_limits.py
>   • test_network_offering.py
>   • test_overcommit.py
>   • test_persistent_networks.py
>   • test_ps_domain_limits.py
>   • test_ps_limits.py
>   • test_ps_max_limits.py
>   • test_ps_resize_volume.py
>   • test_ps_resource_limits_volume.py
>   • test_resource_limits.py
>   • test_routers.py
>   • test_security_groups.py
>   • test_shared_networks.py
>   • test_snapshots.py
>   • test_ss_domain_limits.py
>   • test_ss_limits.py
>   • test_ss_max_limits.py
>   • test_templates.py
>   • test_update_vm.py
>   • test_volumes.py
>   • test_vpc.py
>
>During our tests, we found the following issues, but do not see any of them as 
>blockers:
>
>   • As Paul and Boris noted, the 
> test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL in 
> test_vpc_redundant.py fails.  We are uncertain as to whether this failure is 
> caused by a defect, a problem with the test case, or our test environment.
>   • We have seen NPEs in the log every 10 minutes attempting to garbage 
> collect a non-existent XenServer volume previously attached to a VR.  While 
> ugly, it is not leaving unused volumes to consume disk space.
>
>Thanks,
>-John
>
>> 
>john.burw...@shapeblue.com 
>www.shapeblue.com
>53 Chandos Place, Covent Garden, London VA WC2N 4HSUK
>@shapeblue
>  
> 
>
>On Jul 28, 2016, at 12:55 PM, Paul Angus  wrote:
>> 
>> I'm getting a pass on KVM for 
>> /marvin/test/integration/smoke/test_vpc_redundant.py
>> And a FAIL on VMware for the same test, with the same error.
>> 
>> 2016-07-28 04:00:52,133 - CRITICAL - FAILED: 
>> test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL: ['Traceback (most 
>> recent call last):\n', '  File "/usr/lib64/python2.7/unittest/case.py", line 
>> 369, in run\ntestMethod()\n', '  File 
>> "/marvin/test/integration/smoke/test_vpc_redundant.py", line 537, in 
>> test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL\n
>> self.check_routers_state(1)\n', '  File 
>> "/marvin/test/integration/smoke/test_vpc_redundant.py", line 304, in 
>> check_routers_state\nself.query_routers(count, showall)\n', '  File 
>> "/marvin/test/integration/smoke/test_vpc_redundant.py", line 297, in 
>> query_routers\n"Check that %s routers were indeed created" % count)\n', 
>> '  File "/usr/lib64/python2.7/unittest/case.py", line 553, in assertEqual\n  
>>   assertion_func(first, second, msg=msg)\n', '  File 
>> "/usr/lib64/python2.7/unittest/case.py", line 546, in _baseAssertEqual\n
>> raise self.failureException(msg)\n', 'AssertionError: Check that 1 routers 
>> were indeed created\n']
>> 
>> Kind regards,
>> 
>> Paul Angus
>> 
>> paul.an...@shapeblue.com 
>> www.shapeblue.com
>> 53 Chandos Place, Covent Garden, London  WC2N 4HSUK
>> @shapeblue
>> 
>> 
>> 
>> 
>> -Original Message-
>> From: williamstev...@gmail.com [mailto:williamstev...@gmail.com] On Behalf 
>> Of Will Stevens
>> Sent: 28 July 2016 17:24
>> To: dev@cloudstack.apache.org
>> Subject: Re: [VOTE] Apache Cloudstack 4.9.0 RC2
>> 
>> The teardown issue looks to be environmental.  Apparently the network did 
>> not get cleaned up before the network service offering using it was 
>> attempted to be deleted.
>> 
>> I am not sure about the test_vpc_redundent test failure.  I run that test 
>> all the time on KVM and have not been getting that problem.  Do you get the 
>> same thing if you run it again in your environment?
>> 
>> *Will STEVENS*
>> Lead Developer
>> 
>> *CloudOps* *| *Cloud Solutions Experts
>> 420 rue Guy *|* Montreal *

Re: IPv6 Hackathon next week

[Abhinandan Prateek]

On IPv6 support:

Cloudstack has limited IPv6 support already built into it IPv6 Support in 
CloudStack . 
This does not appear to be in use ? And also looks like a superficial add on as 
against a well thought of feature.

IPv6 support is much required and there are efforts to add IPv6 support to 
cloudstack with different approaches. There is an effort to add IPv6 support to 
basic networking here IPv6 in Basic Networking 

 and another one that is trying to add IPv6 support to VPC's networks here IPv6 
in VPC Router 
. 

It is possible that the localised efforts may lead to code duplication and 
other inefficiencies and inelegancies. It is important that we write a common 
set of  network primitives that are IPv6 and IPv4 aware and that can be used 
further to enable IPv6 in various other components and resources managed by 
cloudstack.A start to this effect has been made in this OSPF PR: IPv6 in VPC 
Router 
.
 

As part of this collab, can we get an overall IPv6 strategy in place so that 
the localised efforts have some thing to look upto ? This will mean A] Are the 
external cloudstack dependecies dual stack ? B] Where all dual scheme will be 
required and where it will be on choice, like Can I have a system vm services 
available on both IPV6 and IPV4 or while configuring the zone we just mark it 
as a IPV6 zone, for example. There will be more such questions.  Ready answers 
to such questions will help in moulding the various IPv6 works that are going 
on.



Regards,
-abhi


On 31/05/16, 1:45 AM, "williamstev...@gmail.com on behalf of Will Stevens" 
 wrote:

>I added some more details to the page to make it clearer when the meetings
>are taking place and where to find the mentioned slack channel.
>
>*Will STEVENS*
>Lead Developer
>
>*CloudOps* *| *Cloud Solutions Experts
>420 rue Guy *|* Montreal *|* Quebec *|* H3J 1S6
>w cloudops.com *|* tw @CloudOps_
>
>On Mon, May 30, 2016 at 3:58 PM, Pierre-Luc Dion 
>wrote:
>
>> Wido,  all,
>>
>> I've create a wiki page for the collab, so anyone willing to attend
>> remotely at the round-table on Wedneday 13h30 EST can use the gotomeeting.
>> There is also a GoToMeeting scheduled for Friday for the hackathon, I've
>> put all the detailed on the wiki page:
>>
>>
>> https://cwiki.apache.org/confluence/display/CLOUDSTACK/CloudStack+Collaboration+Conference%3A+Montreal+2016
>>
>> would it make sense to put hackathon topic in that wiki page?
>>
>> feel free to update, change comment that page :-)
>>
>> Cheers,
>>
>>
>> PL
>>
>>
>> On Fri, May 27, 2016 at 7:28 PM, Pierre-Luc Dion 
>> wrote:
>>
>> > That's cool,
>> > we will check how we could conference you in!
>> >
>> >
>> > On Fri, May 27, 2016 at 2:43 PM, Wido den Hollander 
>> > wrote:
>> >
>> >> Hi,
>> >>
>> >> Next week I can't visit the conference in Montreal, but online I'd like
>> >> to dedicate June 2nd and 3rd to work on IPv6:
>> >>
>> >> -
>> >>
>> https://cwiki.apache.org/confluence/display/CLOUDSTACK/IPv6+in+Basic+Networking
>> >> - https://issues.apache.org/jira/browse/CLOUDSTACK-674
>> >>
>> >> John Burwell from ShapeBlue will join, who else?
>> >>
>> >> The stuff is all in my head and at PCextreme we already have some stuff
>> >> running with IPv6 with our own hacky stuff.
>> >>
>> >> A Google Hangouts will probably work best to talk and discuss stuff.
>> >>
>> >> See:
>> >>
>> https://docs.google.com/spreadsheets/d/14U0E1YpgZvsBc88SHVojo-XzOLAKs-WFEkMxXlrAl_o
>> >>
>> >> Wido
>> >>
>> >
>> >
>>

abhinandan.prat...@shapeblue.com 
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue

Re: [DISCUSS] Release Cycle

[Abhinandan Prateek]

Hi John,

Thanks for detailed email on release cadence.
A 2 month release cycle with an LTS release every 6 month is the middle ground.
With CI evolving in terms of participation, coverage quality and test case 
quality we will be looking forward to still better cloudstack releases.

Regards,
-abhi

abhinandan.prat...@shapeblue.com 
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue








On 31/05/16, 4:03 PM, "John Burwell"  wrote:

>All,
>
>Quick correction below: I misquoted the LTS proposal — branches are cut on 1 
>January and 1 _July_ (not June).
>
>I apologize for the mistake,
>-John
>
>> 
>john.burw...@shapeblue.com 
>www.shapeblue.com
>53 Chandos Place, Covent Garden, London VA WC2N 4HSUK
>@shapeblue
>
>
>On May 31, 2016, at 12:28 AM, John Burwell  wrote:
>> 
>> All,
>> 
>> Over the course of the last 6-8 months, we have attempted to release 
>> monthly.  We successfully delivered 4.6, 4,7, and 4,8 using this model.  We 
>> also established a strong set of CM and review principles to improve the 
>> quality of releases [1].  To support users that are unable to upgrade on a 
>> monthly basis, we have proposed adding an LTS release cycle that will 
>> provide an 18 month support window for releases that are cut twice a year 
>> (January and June).  We are on track for two types of releases — regular and 
>> LTS releases.
>> 
>> Reflecting on the monthly release cycle, we spent at least 8 days a month 
>> preparing and voting out releases.  This cadence left an average of 12 days 
>> a month to build features.  In my experience, this cadence impeded efforts 
>> to build larger features or address large architectural issues.  Therefore, 
>> for regular releases, I propose we elongate the release cycle from one (1) 
>> month to two (2) months with the following phases:
>> 
>>* Development: 6 weeks (42 days)
>>* Release Preparation/Test: 1 week (7 days)
>>* RC Voting: 1 week (7 days)
>> 
>> In order to ensure the timeliness of releases and avoid indecision, these 
>> timeframes would be hard limits.  Therefore, the development phase would 
>> close at 6 weeks — no exceptions.  Finally, we would only support the 
>> current and previous regular release.  For example, we would only provide 
>> support for 4.8 and 4.9 releases until 4.10 is released when 4.8 would reach 
>> end of life.  This cycle would continue to use the same release 
>> principles(e.g. master frozen during release preparation/test and RC voting, 
>> 2 LGTM per PR, etc).  I believe this longer cycle would provide a regular, 
>> responsive release cycle and enough development time to build larger 
>> features.
>> 
>> Per the LTS proposal [2], LTS branches would be cut from the most recent 
>> stable release branch as of 1 January and 1 June every year.  Upon creation, 
>> each LTS branch would go through a 6 week stabilization/test process.  
>> Following their initial release, these branches releases receive applicable 
>> blocker, critical, and CVE fixes for 12 months.  Ideally, defect fixes that 
>> apply to both LTS and regular releases will be applied to oldest LTS release 
>> and forward merged.  Additional LTS maintenance releases will occur based on 
>> an as-needed basis — balancing release frequency and stability.
>> 
>> Based on these two release cycles, regular and LTS, the release calendar for 
>> the next twelve (12) months would be as follows:
>> 
>>* LTS 4.9.0_1 (Release Date: 21 August 2016/EOL: 21 April 2018)
>>* Stabilization/Testing: 1 July - 14 August 2016
>>* RC Voting: 14-21 August 2016
>>* 4.10.0 (Release Date: 28 August 2016/EOL: 18 December 2016)
>> * Development: 1 July - 14 August 2016
>> * Testing: 14-21 August 2016
>>* RC Voting: 21-28 August 2016
>>* 4.11.0 (Release Date: 23 October 2016/EOL: 12 February 2017)
>>* Development: 28 August - 9 October 2016
>>* Testing: 9-16 October 2016
>>* RC Voting: 16-23 October 2016
>>* 4.12.0 (Release Date: 18 December 2016/EOL: 2 April 2017)
>>* Development: 23 October - 4 December 2016
>>* Testing: 4-11 December 2016
>>* RC Voting: 11-18 December 2016
>>* 4.13.0 (Release Date: 12 February 2017/EOL: 4 June 2017)
>>* Development: 18 December 2016 - 29 January 2017
>>* Testing: 29 January - 5 February 2017
>> * RC Voting: 5-12 February 2017
>>* LTS 4.12.0_1 (Release Date: 19 February 2017/EOL: 19 October 2018)
>>* Stabilization: 1 January - 12 February 2017
>>* RC Voting: 19 February 2017
>>* 4.14.0 (Release Date: 2 April 2017/EOL: 30 July 2017)
>> * Development: 12 February - 26 March 2017
>>* Testing: 26 March - 2 April 2017
>>* RC Voting: 2-9 April 2017
>>* 4.15.0 (Release Date: 24 April 2017/ EOL: TBD)
>> * Development: 26 March - 22 May 2017
>> * Testing: 22-29 May 2017
>>* RC Voting: 29 May - 4 June 2017
>>* 4.16.0 (Release Date: 30 July 2017/ EOL: TBD)
>> * Deve

Re: IPv6 Hackathon next week

[Abhinandan Prateek]

Hi Guys,

  Can someone update the timings for various events specially where remote 
remote participants are expected.

Thanks and Regards,
-abhi




On 31/05/16, 1:45 AM, "williamstev...@gmail.com on behalf of Will Stevens" 
 wrote:

>I added some more details to the page to make it clearer when the meetings
>are taking place and where to find the mentioned slack channel.
>
>*Will STEVENS*
>Lead Developer
>
>*CloudOps* *| *Cloud Solutions Experts
>420 rue Guy *|* Montreal *|* Quebec *|* H3J 1S6
>w cloudops.com *|* tw @CloudOps_
>
>On Mon, May 30, 2016 at 3:58 PM, Pierre-Luc Dion 
>wrote:
>
>> Wido,  all,
>>
>> I've create a wiki page for the collab, so anyone willing to attend
>> remotely at the round-table on Wedneday 13h30 EST can use the gotomeeting.
>> There is also a GoToMeeting scheduled for Friday for the hackathon, I've
>> put all the detailed on the wiki page:
>>
>>
>> https://cwiki.apache.org/confluence/display/CLOUDSTACK/CloudStack+Collaboration+Conference%3A+Montreal+2016
>>
>> would it make sense to put hackathon topic in that wiki page?
>>
>> feel free to update, change comment that page :-)
>>
>> Cheers,
>>
>>
>> PL
>>
>>
>> On Fri, May 27, 2016 at 7:28 PM, Pierre-Luc Dion 
>> wrote:
>>
>> > That's cool,
>> > we will check how we could conference you in!
>> >
>> >
>> > On Fri, May 27, 2016 at 2:43 PM, Wido den Hollander 
>> > wrote:
>> >
>> >> Hi,
>> >>
>> >> Next week I can't visit the conference in Montreal, but online I'd like
>> >> to dedicate June 2nd and 3rd to work on IPv6:
>> >>
>> >> -
>> >>
>> https://cwiki.apache.org/confluence/display/CLOUDSTACK/IPv6+in+Basic+Networking
>> >> - https://issues.apache.org/jira/browse/CLOUDSTACK-674
>> >>
>> >> John Burwell from ShapeBlue will join, who else?
>> >>
>> >> The stuff is all in my head and at PCextreme we already have some stuff
>> >> running with IPv6 with our own hacky stuff.
>> >>
>> >> A Google Hangouts will probably work best to talk and discuss stuff.
>> >>
>> >> See:
>> >>
>> https://docs.google.com/spreadsheets/d/14U0E1YpgZvsBc88SHVojo-XzOLAKs-WFEkMxXlrAl_o
>> >>
>> >> Wido
>> >>
>> >
>> >
>>

abhinandan.prat...@shapeblue.com 
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue

Re: Number of NICs in VMWare - CS 4.6 bug?

[Abhinandan Prateek]

It seems there is a limit of 8 NICS that Hyper-V will support for user VMS: 
https://technet.microsoft.com/en-us/library/jj680093.aspx

It seems CS-25155 is some internal jira ticket, do you know if the 
summary/extract can be shared ?



On 06/05/16, 8:15 PM, "Octavian Popescu"  wrote:

>Adding a bit to this – it looks like it’s a documented bug, fixed in CS-25155 
>but unfortunately I couldn’t really find much about the fix other than vague 
>references, any ideas how I could track it down?
>
>Thanks,
>Octavian
>
>On 06/05/2016 10:28, "Octavian Popescu" 
>mailto:octavian.pope...@interoute.com>> wrote:
>
>Hello,
>
>There seems to be a bug in CS 4.6 that prevents a VM running on VMWare from 
>booting if it has more than 7 NICs – the NICs can be added just fine until you 
>hit the VMWare limit (10) but on reboot it doesn’t start anymore until you 
>remove them. Do you know if this was fixed in 4.7 or 4.8?
>
>Thanks,
>Octavian
>
>

Regards,

Abhinandan Prateek

abhinandan.prat...@shapeblue.com 
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue

Re: IPv6 progress in Basic Networking

[Abhinandan Prateek]

On 25/04/16, 4:39 PM, "Wido den Hollander"  wrote:



>
>> Op 25 april 2016 om 12:45 schreef Abhinandan Prateek 
>> :
>> 
>> 
>> 
>> At shapeblue we are also working towards enabling ipv6 specially for 
>> advanced networking/ospf.
>> Our approach is more of bottom up where we plan to streamline basic 
>> networking entities and extend them so that they are ipv6 aware. 
>
>Great! Advanced and Basic will indeed overlap much.
>
>Have you read my Wiki page? 
>https://cwiki.apache.org/confluence/display/CLOUDSTACK/IPv6+in+Basic+Networking
>
>My idea is **NOT** to use DHCPv6 (IA_NA), but simply use SLAAC. I found out 
>that DHCPv6 is still badly supported in most Linux distributions and SLAAC 
>works fine.
>
>It is just important that Privacy Extensions are disabled in the Instance. 
>Otherwise it will generate temporary IPv6 addresses.
>
>Since we know the MAC address and the /64 prefix we can *calculate* the 
>address a Instance will take. With that we do not have to store the address in 
>a database.

Doing bit of research on this makes me believe that this is a preferred way of 
getting ipv6 address for the instance. Was wondering why we cannot do the same 
for ipV4, but there I guess we will run into uniqueness issue.

>
>Security Grouping can be configured accordingly.
>
>No need to configure a DHCPv6 server on deployment of an Instance. It really 
>simplifies life. Less code is better :)
>
>> This way we ensure that these entities can then be used by both advanced and 
>> basic networks.
>> Some of that code has already made its way in this PR 
>> https://github.com/apache/cloudstack/pull/1371/commits/2156a039cef38a397d15f6186eb515bef59bd45a
>>  .
>> 
>> This work will have some good overlap, and will be eager to learn and 
>> suggest as the PR progresses.
>
>Looks good. I never work with VPC/Advanced Network, so I wouldn't know.
>
>But inside a VR you would run radvd which will send out Router Advertisements. 
>There is no need for DHCPv6 either since addresses obtain their IPv6 address 
>using SLAAC.
>
>Wido
>
>>  
>> 
>> 
>> 
>> On 20/04/16, 8:54 PM, "Wido den Hollander"  wrote:
>> 
>> >Hi,
>> >
>> >Lately I've been working on IPv6 integration on CloudStack. Not much code 
>> >has
>> >been written (non actually), my work has mainly been getting things 
>> >straight in
>> >my head.
>> >
>> >Honestly, the work has been focused on the use-case at PCextreme Aurora 
>> >Compute:
>> >- Basic Networking
>> >- Single IPv6 address per Instance
>> >- Security Grouping on IPv6
>> >- IPv6 Prefix Delegation
>> >
>> >Most of the things are still described here:
>> >https://cwiki.apache.org/confluence/display/CLOUDSTACK/IPv6+in+Basic+Networking
>> >
>> >What I have working at PCextreme currently is:
>> >- IPv6 using SLAAC
>> >- DHCPv6 Prefix Delegation using ISC Kea
>> >
>> >The Kea configuration I'm using for my test is available on Github:
>> >https://gist.github.com/wido/202b09dd574e016f6e99798036cd
>> >
>> >On my Instance I'm able to get an address and a prefix:
>> >
>> >$ ip -6 addr show dev eth0
>> >
>> >2: eth0:  mtu 1500 qlen 1000
>> >inet6 2a00:f10:305:0:432:b2ff:fe00:479/64 scope global dynamic 
>> >   valid_lft 2591904sec preferred_lft 604704sec
>> >inet6 fe80::432:b2ff:fe00:479/64 scope link 
>> >   valid_lft forever preferred_lft forever
>> >
>> >$ dhclient -6 -P -d -v eth0
>> >
>> >RCV: Reply message on eth0 from fe80::8618:8802:c5f6:6029.
>> >RCV:  X-- IA_PD b2:00:04:79
>> >RCV:  | X-- starts 1461164082
>> >RCV:  | X-- t1 - renew  +1000
>> >RCV:  | X-- t2 - rebind +2000
>> >RCV:  | X-- [Options]
>> >RCV:  | | X-- IAPREFIX 2a00:f10:500::/60
>> >RCV:  | | | X-- Preferred lifetime 86400.
>> >RCV:  | | | X-- Max lifetime 172800.
>> >
>> >This is know *ALL* happening outside the scope of CloudStack, but my next 
>> >steps
>> >are to start writing code.
>> >
>> >For IPv6 there is *NO* need to store addresses in a database. Using the /64
>> >subnet + the MAC address you can calculate the address the Instance will 
>> >obtain
>> >using SLAAC (Stateless address autoconfiguration).
>> >
>> >Looking from the database perspective, using the IPv6 information in the 
>> >'vlan'
>> >and 

Re: IPv6 progress in Basic Networking

[Abhinandan Prateek]

At shapeblue we are also working towards enabling ipv6 specially for advanced 
networking/ospf.
Our approach is more of bottom up where we plan to streamline basic networking 
entities and extend them so that they are ipv6 aware. 
This way we ensure that these entities can then be used by both advanced and 
basic networks.
Some of that code has already made its way in this PR 
https://github.com/apache/cloudstack/pull/1371/commits/2156a039cef38a397d15f6186eb515bef59bd45a
 .

This work will have some good overlap, and will be eager to learn and suggest 
as the PR progresses.
 



On 20/04/16, 8:54 PM, "Wido den Hollander"  wrote:

>Hi,
>
>Lately I've been working on IPv6 integration on CloudStack. Not much code has
>been written (non actually), my work has mainly been getting things straight in
>my head.
>
>Honestly, the work has been focused on the use-case at PCextreme Aurora 
>Compute:
>- Basic Networking
>- Single IPv6 address per Instance
>- Security Grouping on IPv6
>- IPv6 Prefix Delegation
>
>Most of the things are still described here:
>https://cwiki.apache.org/confluence/display/CLOUDSTACK/IPv6+in+Basic+Networking
>
>What I have working at PCextreme currently is:
>- IPv6 using SLAAC
>- DHCPv6 Prefix Delegation using ISC Kea
>
>The Kea configuration I'm using for my test is available on Github:
>https://gist.github.com/wido/202b09dd574e016f6e99798036cd
>
>On my Instance I'm able to get an address and a prefix:
>
>$ ip -6 addr show dev eth0
>
>2: eth0:  mtu 1500 qlen 1000
>inet6 2a00:f10:305:0:432:b2ff:fe00:479/64 scope global dynamic 
>   valid_lft 2591904sec preferred_lft 604704sec
>inet6 fe80::432:b2ff:fe00:479/64 scope link 
>   valid_lft forever preferred_lft forever
>
>$ dhclient -6 -P -d -v eth0
>
>RCV: Reply message on eth0 from fe80::8618:8802:c5f6:6029.
>RCV:  X-- IA_PD b2:00:04:79
>RCV:  | X-- starts 1461164082
>RCV:  | X-- t1 - renew  +1000
>RCV:  | X-- t2 - rebind +2000
>RCV:  | X-- [Options]
>RCV:  | | X-- IAPREFIX 2a00:f10:500::/60
>RCV:  | | | X-- Preferred lifetime 86400.
>RCV:  | | | X-- Max lifetime 172800.
>
>This is know *ALL* happening outside the scope of CloudStack, but my next steps
>are to start writing code.
>
>For IPv6 there is *NO* need to store addresses in a database. Using the /64
>subnet + the MAC address you can calculate the address the Instance will obtain
>using SLAAC (Stateless address autoconfiguration).
>
>Looking from the database perspective, using the IPv6 information in the 'vlan'
>and the 'ip6_cidr' field.
>
>ip6_cidr should *always* be a /64 and from there you can calculate the
>Instance's address.
>
>The 'listNics' API call can calculate the 'ip6address' for the response. Using
>the macaddress and the ip6cidr this can easily be calculated.
>
>The security grouping part is second, the same goes for the Prefix Delegation
>support. Those will require more code. But just the IPv6 address in the 
>response
>is easy to do.
>
>This means that DHCPv6 is *ONLY* needed when Prefix Delegation (IA_PD) is used,
>but otherwise it is just SLAAC. Easy and simple to deploy.
>
>Wido

Regards,

Abhinandan Prateek

abhinandan.prat...@shapeblue.com 
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue

Re: Introduction

[Abhinandan Prateek]

Welcome Rashmi !




On 08/04/16, 10:28 AM, "Rashmi Dixit"  wrote:

>Hello!
>
>I am Rashmi Dixit and have recently joined the CloudPlatform team in 
>Accelerite. I have worked on a hybrid cloud management solution supporting 
>hypervisors such as KVM, Xen, VMware, HyperV and public clouds such as EC2. My 
>areas of interest are User Interface, networking.
>
>I am really looking forward to contributing on CloudStack.
>
>See you around!
>Rashmi
>
>Rashmi Dixit
>Principal Product Engineer | CloudPlatform | www.accelerite.com
>
>
>
>
>DISCLAIMER
>==
>This e-mail may contain privileged and confidential information which is the 
>property of Accelerite, a Persistent Systems business. It is intended only for 
>the use of the individual or entity to which it is addressed. If you are not 
>the intended recipient, you are not authorized to read, retain, copy, print, 
>distribute or use this message. If you have received this communication in 
>error, please notify the sender and delete all copies of this message. 
>Accelerite, a Persistent Systems business does not accept any liability for 
>virus infected mails.

Regards,

Abhinandan Prateek

abhinandan.prat...@shapeblue.com 
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue

Re: Migrating CloudStack content from download.cloud.com

[Abhinandan Prateek]

>> > > >>>> Citrix has been hosting   "download.cloud.com"  for  quite  some
>> > > time  now
>> > > >>>> and  it holds  the  System Templates for all the releases and
>> some
>> > > tools.
>> > > >>>> Going forward,  this  content  needs  to  be  moved  from
>> > > >>>> "download.cloud.com".So, we will be moving  this content  to
>> > > >>>> "cloudstack.accelerite.com".I  will also be  updating  the
>> > > links in the
>> > > >>>> documentation  to reflect
>> > > >
>> > > > Raja, I am going to give this a strong -1
>> > > >
>> > > > We talked about these sorts of things before and it is not
>> appropriate.
>> > > >
>> > > >
>> > > >
>> > > >>>> these  changes and will provide an update  once the  content 
>> > > >>>> move is complete.
>> > > >>>>
>> > > >>>> @Wido, if you could also copy this content to 
>> > > >>>> "cloudstack.apt-get.eu"  that will be great.  I can provide 
>> > > >>>> you
>> the
>> > > details in a separate email.
>> > > >>>
>> > > >>> Super! If you have a rsync source I will set it up.
>> > > >>>
>> > > >
>> > > > @Wido, I think we need to host the sysVM on apt-get.eu and let 
>> > > > that
>> be
>> > > the primary source and links in the docs.
>> > > >
>> > > >
>> > > >>> Wido
>> > > >>>
>> > > >>>>
>> > > >>>> Best,
>> > > >>>> Raja
>> > > >>>> Senior Manager, Product Development, Accelerite, 
>> > > >>>> www.accelerite.com<http://www.accelerite.com>
>> > > >>>>
>> > > >>>>
>> > > >>>>
>> > > >>>>
>> > > >>>> DISCLAIMER
>> > > >>>> ==
>> > > >>>> This e-mail may contain privileged and confidential 
>> > > >>>> information which is the property of Accelerite, a Persistent 
>> > > >>>> Systems
>> business.
>> > > >>>> It is intended only for the use of the individual or entity 
>> > > >>>> to
>> which
>> > > >>>> it is addressed. If you are not the intended recipient, you 
>> > > >>>> are
>> not
>> > > >>>> authorized to read, retain, copy, print, distribute or use 
>> > > >>>> this message. If you have received this communication in 
>> > > >>>> error, please
>> > > notify the sender and delete all copies of this message.
>> > > >>>> Accelerite, a Persistent Systems business does not accept any 
>> > > >>>> liability for virus infected mails.
>> > > >
>> > > >
>> > > >
>> > > >
>> > > > DISCLAIMER
>> > > > ==
>> > > > This e-mail may contain privileged and confidential information 
>> > > > which
>> > is
>> > > the property of Accelerite, a Persistent Systems business. It is
>> intended
>> > > only for the use of the individual or entity to which it is addressed.
>> If
>> > > you are not the intended recipient, you are not authorized to 
>> > > read,
>> > retain,
>> > > copy, print, distribute or use this message. If you have received 
>> > > this communication in error, please notify the sender and delete 
>> > > all copies
>> of
>> > > this message. Accelerite, a Persistent Systems business does not 
>> > > accept
>> > any
>> > > liability for virus infected mails.
>> > >
>> > >
>> >
>>
>>
>> --
>> Ian Rae
>> CEO | PDG
>> c: 514.944.4008
>>
>> CloudOps | Cloud Infrastructure and Networking Solutions 
>> www.cloudops.com | 420 rue Guy | Montreal | Canada | H3J 1S6
>>
>
>
>
>DISCLAIMER
>==
>This e-mail may contain privileged and confidential information which is the 
>property of Accelerite, a Persistent Systems business. It is intended only for 
>the use of the individual or entity to which it is addressed. If you are not 
>the intended recipient, you are not authorized to read, retain, copy, print, 
>distribute or use this message. If you have received this communication in 
>error, please notify the sender and delete all copies of this message. 
>Accelerite, a Persistent Systems business does not accept any liability for 
>virus infected mails.

Regards,

Abhinandan Prateek

abhinandan.prat...@shapeblue.com 
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue

Re: LDAP auth failures

[Abhinandan Prateek]

In 4.5 there is a timeout param that was added ‘ldap.read.timeout’ that 
defaults to 1000,
It should be set to about 6000 and that should resolve the read timeout that 
you guys see.




[ShapeBlue]<http://www.shapeblue.com>
Abhinandan Prateek
Software Architect  ,   ShapeBlue


d:   | s: +44 203 603 0540  |  
m:  +91 970 11 99011

e:  abhinandan.prat...@shapeblue.com | t: 
<mailto:abhinandan.prat...@shapeblue.com%20|%20t:> |  w:  
www.shapeblue.com<http://www.shapeblue.com>

a:  53 Chandos Place, Covent Garden London WC2N 4HS UK


[cid:image631b15.png@e7854a64.46aae3f8]


Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services 
India LLP is a company incorporated in India and is operated under license from 
Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in 
Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd 
is a company registered by The Republic of South Africa and is traded under 
license from Shape Blue Ltd. ShapeBlue is a registered trademark.
This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error.




On 09/03/16, 3:19 AM, "ilya"  wrote:

>I could not get LDAP to work as well in 4.5.x, i could get it to work in 4.3
>
>I also get no stacktrace as to what could be wrong.
>
>
>
>On 3/3/16 4:53 AM, Rene Moser wrote:
>> We are experiencing authentication issues with LDAP since upgrade to 4.5.1.
>>
>> After some time (...), users can not authenticate anymore, however,
>> authentication in other services using ldap works during this time. The
>> issue is only related to cloudstack login it seems.
>>
>> We haven't found the root cause yet, a network setup issue or openldap
>> config issue can not be excluded.
>>
>> Stacktrace:
>>
>> 2016-02-29 10:05:36,375 DEBUG [cloudstack.ldap.LdapContextFactory]
>> (catalina-exec-4:ctx-9ffa7c60) initializing ldap with provider url:
>> ldap://ldap.example.com:389
>> 2016-02-29 10:05:42,382 DEBUG [cloudstack.ldap.LdapManagerImpl]
>> (catalina-exec-4:ctx-9ffa7c60) ldap Exception:
>> javax.naming.NamingException: LDAP response read timed out, timeout
>> used:6000ms.; remaining name 'dc=foo,dc=bar'
>> at com.sun.jndi.ldap.Connection.readReply(Connection.java:485)
>> at com.sun.jndi.ldap.LdapClient.getSearchReply(LdapClient.java:639)
>> at com.sun.jndi.ldap.LdapClient.search(LdapClient.java:562)
>> at com.sun.jndi.ldap.LdapCtx.doSearch(LdapCtx.java:1985)
>> at com.sun.jndi.ldap.LdapCtx.searchAux(LdapCtx.java:1847)
>> at com.sun.jndi.ldap.LdapCtx.c_search(LdapCtx.java:1772)
>> at
>> org.apache.cloudstack.ldap.LdapUserManager.searchUsers(LdapUserManager.java:206)
>> at
>> org.apache.cloudstack.ldap.LdapUserManager.getUser(LdapUserManager.java:122)
>> at
>> org.apache.cloudstack.ldap.LdapManagerImpl.getUser(LdapManagerImpl.java:173)
>> at
>> org.apache.cloudstack.ldap.LdapManagerImpl.canAuthenticate(LdapManagerImpl.java:97)
>> at
>> org.apache.cloudstack.ldap.LdapAuthenticator.authenticate(LdapAuthenticator.java:61)
>> 2016-02-29 10:05:42,383 DEBUG [cloudstack.ldap.LdapManagerImpl]
>> (catalina-exec-4:ctx-9ffa7c60) Exception while doing an LDAP bind for
>> user johndoe
>> org.apache.cloudstack.ldap.NoLdapUserMatchingQueryException: No users
>> matching: No Ldap User found for username: johndoe
>>
>> As I understand there is a username lookup (bind with top reader
>> credentials) to see if a user exists in the ldap. if found a new
>> connection will be etablished for auth. In the above stacktrace it seem
>> that the username lookup fails.
>>
>> Further we see on the ACS management server however, is that LDAP
>> connection are not going to be closed at any time.
>>
>> For _every_ successful auth, the tcp connection remains established forever.
>>
>> In my understanding of
>> http://docs.oracle.com/javase/jndi/tutorial/ldap/connect/config.html
>> these connections will become idle after successful authentication and
>> reused for new authentication.
>>
>> However, the reuse for the auth doesn't seem to work. _Every_ new
>> successful auth of a user _creates_ a new ldap connection. We don't know
>

Re: 4.9 Release Management

[Abhinandan Prateek]

[ShapeBlue]<http://www.shapeblue.com>
Abhinandan Prateek
Software Architect  ,   ShapeBlue


d:   | s: +44 203 603 0540  |  
m:  +91 970 11 99011

e:  abhinandan.prat...@shapeblue.com | t: 
<mailto:abhinandan.prat...@shapeblue.com%20|%20t:> |  w:  
www.shapeblue.com<http://www.shapeblue.com>

a:  53 Chandos Place, Covent Garden London WC2N 4HS UK


[cid:image0d9449.png@84acf60b.4ab55f1a]


Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services 
India LLP is a company incorporated in India and is operated under license from 
Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in 
Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd 
is a company registered by The Republic of South Africa and is traded under 
license from Shape Blue Ltd. ShapeBlue is a registered trademark.
This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error.




On 03/03/16, 9:20 AM, "Koushik Das"  wrote:


>Thanks Will for initiating the discussion on 4.9 release management. As 
>already mentioned, I along with Patrick will be helping out Will with the 
>release process.
>
>Having a reliable CI system is very important going forward. There are 
>discussions already happening in the list related to it. I agree that CI 
>should be the top priority for 4.9 release.
>
>The initial idea is to run the CI manually against each PR and publish the 
>results in github itself. The details of the CI environment, test scenarios 
>and configurations will be published as well. Simulator based tests are 
>already running as part of Travis, if required some more tests scenarios can 
>be added there.

Good to see you taking up CI implementation for cloudstack with others. Do you 
yet have timeline to publish a roadmap or a plan for this effort ?

>
>In the longer run, if more contributors/organizations come up with their own 
>CI environment and help test PRs then it will be even better.
>
>-Koushik
>
>From: Will Stevens 
>Sent: Wednesday, March 2, 2016 10:44 PM
>To: dev@cloudstack.apache.org
>Subject: 4.9 Release Management
>
>Hello Everyone,
>I have mentioned this in other related threads, but I wanted to make an
>official thread on the topic.
>
>I am nominating myself as the release manager for 4.9. Please feel free to
>discuss if you have comments or concerns.
>
>I will not be working alone, I will be assisted by Koushik Das and Patrick
>Dube. I will be running point, but all three of us will be working
>together as a unit for this release.
>
>Our main focus for this release is the integration of hardware Continuous
>Integration (CI) into the PR flow. Koushik and his team will be setting up
>a CI environment which will be used for testing PRs and I will also be
>setting up a CI environment for testing PRs.
>
>The details of the CI integration will be handled publicly, but we will
>likely have to work with a minimum viable implementation initially and move
>forward from there. Here are some of the key aspects of the CI which are
>top of mind for me.
>
>- Standardize a feedback mechanism to post the result of CI runs back to
>the relevant PR. I believe the best way to do this would be to post a
>summary of the CI run in the PR thread on Github. With the existing
>integration, this will then get pushed to the mailing list (since all
>comments on a PR are pushed to the mailing list).
>- Ideally, we will also make the CI logs available for the run. We are
>still working out the details of how we do this, but we will likely be
>pushing the logs to an object store with a cleanup window to remove the
>logs after a set period of time (probably a week). This should give people
>the opportunity to pull the logs if they are interested in the test
>results, but will reduce the need for ever growing storage.
>- In order to parallelize the CI operations, we will not be automatically
>kicking off a CI run for every PR for now. Instead, we will communicate
>between us and each run distinct PRs so we can maximize the utilization of
>our hardware.
>
>Some longer term goals of the CI in my mind are as follows:
>
>- I would like the core CI framework to be easily distributed and
>accessible to anyone who has hardware available. This woul

CSNetFilter.py

[Abhinandan Prateek]

Will anyone know why some rules are being removed by CsNetFilter on VR:

Following is the output from /var/log/cloud.log



2016-02-25 08:00:13,563  CsNetfilter.py get_unseen:129 unseen cmd:  iptables -t 
mangle -D VPN_STATS_eth1 -m mark -o eth1 --mark 0x525

2016-02-25 08:00:13,563  CsHelper.py execute:160 Executing: iptables -t mangle 
-D VPN_STATS_eth1 -m mark -o eth1 --mark 0x525

2016-02-25 08:00:13,568  CsNetfilter.py get_unseen:132 Delete rule -D 
VPN_STATS_eth1 -m mark -o eth1 --mark 0x525 from table mangle

2016-02-25 08:00:13,568  CsNetfilter.py get_unseen:129 unseen cmd:  iptables -t 
mangle -D VPN_STATS_eth1 -i eth1 -m mark --mark 0x524

2016-02-25 08:00:13,569  CsHelper.py execute:160 Executing: iptables -t mangle 
-D VPN_STATS_eth1 -i eth1 -m mark --mark 0x524

2016-02-25 08:00:13,575  CsNetfilter.py get_unseen:132 Delete rule -D 
VPN_STATS_eth1 -i eth1 -m mark --mark 0x524 from table mangle

2016-02-25 08:00:13,576  CsNetfilter.py get_unseen:129 unseen cmd:  iptables -t 
filter -D INPUT -d 224.0.0.0/24 -j ACCEPT

2016-02-25 08:00:13,576  CsHelper.py execute:160 Executing: iptables -t filter 
-D INPUT -d 224.0.0.0/24 -j ACCEPT

-abhi

[ShapeBlue]<http://www.shapeblue.com>
Abhinandan Prateek
Software Architect  ,   ShapeBlue


d:   | s: +44 203 603 0540  |  
m:  +91 970 11 99011

e:  abhinandan.prat...@shapeblue.com | t: 
<mailto:abhinandan.prat...@shapeblue.com%20|%20t:> |  w:  
www.shapeblue.com<http://www.shapeblue.com>

a:  53 Chandos Place, Covent Garden London WC2N 4HS UK


[cid:imagede065f.png@86fb1005.41abd773]


Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services 
India LLP is a company incorporated in India and is operated under license from 
Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in 
Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd 
is a company registered by The Republic of South Africa and is traded under 
license from Shape Blue Ltd. ShapeBlue is a registered trademark.
This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error.




Find out more about ShapeBlue and our range of CloudStack related services:
IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//> | 
CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/> | 
CloudStack Software 
Engineering<http://shapeblue.com/cloudstack-software-engineering/>
CloudStack Infrastructure 
Support<http://shapeblue.com/cloudstack-infrastructure-support/> | CloudStack 
Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>

[DISCUSS: FINDBUG] FW: Build failed in Jenkins: build-master-slowbuild #3120

[Abhinandan Prateek]

The slow build shows lot more findbug errors than when the findbug is run in 
the dev environment.
My guess will be that in dev environment when running findbug on modules, then 
findbug is not able to catch issues created by dependencies.

Can someone who is more familiar with findbug throw some light on these 
differences and also explain, if there is a way that the findings in the 
slowbuild match with the findings in dev environment.

-abhi




[ShapeBlue]<http://www.shapeblue.com>
Abhinandan Prateek
Software Architect  ,   ShapeBlue


d:   | s: +44 203 603 0540  |  
m:  +91 970 11 99011

e:  abhinandan.prat...@shapeblue.com | t: 
<mailto:abhinandan.prat...@shapeblue.com%20|%20t:> |  w:  
www.shapeblue.com<http://www.shapeblue.com>

a:  53 Chandos Place, Covent Garden London WC2N 4HS UK


[cid:imagec04d84.png@042fce82.4cb41aa6]


Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services 
India LLP is a company incorporated in India and is operated under license from 
Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in 
Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd 
is a company registered by The Republic of South Africa and is traded under 
license from Shape Blue Ltd. ShapeBlue is a registered trademark.
This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error.




On 31/01/16, 8:39 PM, "jenk...@cloudstack.org"  wrote:

>See <http://jenkins.buildacloud.org/job/build-master-slowbuild/3120/>
>
>--
>[...truncated 28675 lines...]
>[INFO]
>[INFO] --- findbugs-maven-plugin:3.0.1:findbugs (findbugs) @ cloud-quickcloud 
>---
>[INFO]
>[INFO] <<< findbugs-maven-plugin:3.0.1:check (cloudstack-findbugs) @ 
>cloud-quickcloud <<<
>[INFO]
>[INFO] --- findbugs-maven-plugin:3.0.1:check (cloudstack-findbugs) @ 
>cloud-quickcloud ---
>[INFO]
>[INFO] --- cobertura-maven-plugin:2.6:instrument (default-cli) @ 
>cloud-quickcloud ---
>[WARNING] No files to instrument.
>[INFO] NOT adding cobertura ser file to attached artifacts list.
>[INFO]
>[INFO] --- maven-resources-plugin:2.5:testResources (default-testResources) @ 
>cloud-quickcloud ---
>[debug] execute contextualize
>[INFO] Using 'UTF-8' encoding to copy filtered resources.
>[INFO] skip non existing resourceDirectory 
><http://jenkins.buildacloud.org/job/build-master-slowbuild/ws/quickcloud/src/test/resources>
>[INFO] Copying 3 resources
>[INFO] Copying 3 resources
>[INFO]
>[INFO] --- maven-compiler-plugin:3.2:testCompile (default-testCompile) @ 
>cloud-quickcloud ---
>[INFO] No sources to compile
>[INFO]
>[INFO] --- maven-surefire-plugin:2.18.1:test (default-test) @ cloud-quickcloud 
>---
>[INFO]
>[INFO] <<< cobertura-maven-plugin:2.6:cobertura (default-cli) @ 
>cloud-quickcloud <<<
>[INFO]
>[INFO] --- cobertura-maven-plugin:2.6:cobertura (default-cli) @ 
>cloud-quickcloud ---
>[INFO] 
>[INFO] Reactor Summary:
>[INFO]
>[INFO] Apache CloudStack Developer Tools - Checkstyle Configuration SUCCESS 
>[1.767s]
>[INFO] Apache CloudStack . SUCCESS [2.120s]
>[INFO] Apache CloudStack Maven Conventions Parent  SUCCESS [0.787s]
>[INFO] Apache CloudStack Framework - Managed Context . SUCCESS [19.892s]
>[INFO] Apache CloudStack Utils ... SUCCESS [1:30.818s]
>[INFO] Apache CloudStack Framework ... SUCCESS [0.105s]
>[INFO] Apache CloudStack Framework - Event Notification .. SUCCESS [52.843s]
>[INFO] Apache CloudStack Framework - Configuration ... SUCCESS [29.307s]
>[INFO] Apache CloudStack API . SUCCESS [1:57.229s]
>[INFO] Apache CloudStack Framework - REST  SUCCESS [16.406s]
>[INFO] Apache CloudStack Framework - IPC . SUCCESS [30.823s]
>[INFO] Apache CloudStack Cloud Engine  SUCCESS [0.085s]
>[INFO] Apache CloudStack Cloud Engine API  SUCCESS [28.205s]
>[INFO] Apache CloudStack Framework - Security  SUCCESS [24.381s]
>[INFO] Apache CloudStack Core  SUCCESS [1:22.265s]
>[INFO] Apache CloudStack Agents .

Re: [PROPOSE] Dynamic inter VPC routing

[Abhinandan Prateek]

HI PL,

  I setup two VPCs with multiple tiers and ip as per the existing addressing 
scheme provided by cloudstack. With Quagga on Vrs, setup zebra and ospf conf to 
publish the routes behind the routers. I did have to make iptable rule changes 
to make the LSA from quagga to work. With updated iptables I can see the routes 
and ospf neigbours. The inter VPC traffic still goes out of the router public 
interface.
 For optimization of OSPF traffic we can definitely use a dedicated network, 
and most probably this will be added once the basic quagga implementation is in 
place.

From: Pierre-Luc Dion mailto:pd...@cloudops.com>>
Date: Thursday, 28 January 2016 at 4:24 AM
To: "dev@cloudstack.apache.org<mailto:dev@cloudstack.apache.org>" 
mailto:dev@cloudstack.apache.org>>
Cc: Abhinandan Prateek 
mailto:abhinandan.prat...@shapeblue.com>>
Subject: Re: [PROPOSE] Dynamic inter VPC routing

Hi Abhinandan,

I'm actually looking at how to perform routing between VPC, but in our case we 
still need the public interface of the VPC as it is right now. Improvement such 
as BGP for  various public route would be helpfull. But, when it come to 
internal traffic between VPCs, there is 2 way that I see for now,  IPsec, and 
Private gateway. In both case it does not scale well if you want to 
interconnect let's say 10 VPC's together. Look Like using things like OSPF has 
you are proposing make lot of sense, but do you foresee to publish OSPF traffic 
against a dedicated VLAN into a PrivateGateway instead of the public interface?

I was about to propose a feature spec around this, but I did not had success 
yet in a quick POC, for some reason I had issue having Quagga+OSPF  to work 
between VPC thru the Privage Gateway. probably just an iptable issue.

Looks promising...


On Wed, Jan 20, 2016 at 7:28 AM, Erik Weber 
mailto:terbol...@gmail.com>> wrote:
Thans Abhi, glad to hear :-)

--
Erik


On Wed, Jan 20, 2016 at 1:06 PM, Abhinandan Prateek 
mailto:abhinandan.prat...@shapeblue.com>> 
wrote:
Erik,

Updated the doc to reflect that the CIDR partitioning is not rigid.





[ShapeBlue]<http://www.shapeblue.com>
Abhinandan Prateek
Software Architect  ,   ShapeBlue


d:   | s: +44 203 603 0540|  
m:  +91 970 11 99011

e:  abhinandan.prat...@shapeblue.com | t: 
<mailto:abhinandan.prat...@shapeblue.com%20%7C%20t:>   |  w:  
www.shapeblue.com<http://www.shapeblue.com>

a:  53 Chandos Place, Covent Garden London WC2N 4HS UK


[X]


Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services 
India LLP is a company incorporated in India and is operated under license from 
Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in 
Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd 
is a company registered by The Republic of South Africa and is traded under 
license from Shape Blue Ltd. ShapeBlue is a registered trademark.
This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error.




On 05/01/16, 9:17 PM, "Erik Weber" 
mailto:terbol...@gmail.com>> wrote:

>On Mon, Jan 4, 2016 at 3:10 PM, Abhinandan Prateek <
>abhinandan.prat...@shapeblue.com<mailto:abhinandan.prat...@shapeblue.com>> 
>wrote:
>
>> Hi All,
>>
>> Currently the inter VPC traffic has to go thru the public gateway.
>> This means the traffic has to be nat-ed across public internet via
>> core-routers, which is inefficient in itself. A more efficient approach
>> will be to route the traffic locally.
>>
>> The proposal is to enable quagga- ospf on VPC routers so that the
>> traffic between VPC’s is routed efficiently.
>>
>> The design doc is here:
>> https://cwiki.apache.org/confluence/display/CLOUDSTACK/Dynamically+routed+VPC
>>
>>
>
>Regarding Super-CIDRs it states that a Super-CIDR will be divided into /24
>and /27s, but it is unclear to me if this is hard coded or just an example.
>
>What if a user wants to use /26 as their Tier-network within a /16
>Super-CIDR?
>
>
>--
>Erik
Find out more about ShapeBlue and our range of CloudStack related services:
IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//> | 
CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/

Re: [PROPOSE] Dynamic inter VPC routing

[Abhinandan Prateek]

Erik,

Updated the doc to reflect that the CIDR partitioning is not rigid.





[ShapeBlue]<http://www.shapeblue.com>
Abhinandan Prateek
Software Architect  ,   ShapeBlue


d:   | s: +44 203 603 0540  |  
m:  +91 970 11 99011

e:  abhinandan.prat...@shapeblue.com | t: 
<mailto:abhinandan.prat...@shapeblue.com%20|%20t:> |  w:  
www.shapeblue.com<http://www.shapeblue.com>

a:  53 Chandos Place, Covent Garden London WC2N 4HS UK


[cid:image30a874.png@4d1f2b2d.4285da73]


Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services 
India LLP is a company incorporated in India and is operated under license from 
Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in 
Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd 
is a company registered by The Republic of South Africa and is traded under 
license from Shape Blue Ltd. ShapeBlue is a registered trademark.
This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error.




On 05/01/16, 9:17 PM, "Erik Weber"  wrote:

>On Mon, Jan 4, 2016 at 3:10 PM, Abhinandan Prateek <
>abhinandan.prat...@shapeblue.com> wrote:
>
>> Hi All,
>>
>> Currently the inter VPC traffic has to go thru the public gateway.
>> This means the traffic has to be nat-ed across public internet via
>> core-routers, which is inefficient in itself. A more efficient approach
>> will be to route the traffic locally.
>>
>> The proposal is to enable quagga- ospf on VPC routers so that the
>> traffic between VPC’s is routed efficiently.
>>
>> The design doc is here:
>> https://cwiki.apache.org/confluence/display/CLOUDSTACK/Dynamically+routed+VPC
>>
>>
>
>Regarding Super-CIDRs it states that a Super-CIDR will be divided into /24
>and /27s, but it is unclear to me if this is hard coded or just an example.
>
>What if a user wants to use /26 as their Tier-network within a /16
>Super-CIDR?
>
>
>--
>Erik
Find out more about ShapeBlue and our range of CloudStack related services:
IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//> | 
CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/> | 
CloudStack Software 
Engineering<http://shapeblue.com/cloudstack-software-engineering/>
CloudStack Infrastructure 
Support<http://shapeblue.com/cloudstack-infrastructure-support/> | CloudStack 
Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>

Re: [PROPOSE] Dynamic inter VPC routing

[Abhinandan Prateek]

[ShapeBlue]<http://www.shapeblue.com>
Abhinandan Prateek
Software Architect  ,   ShapeBlue


d:   | s: +44 203 603 0540  |  
m:  +91 970 11 99011

e:  abhinandan.prat...@shapeblue.com | t: 
<mailto:abhinandan.prat...@shapeblue.com%20|%20t:> |  w:  
www.shapeblue.com<http://www.shapeblue.com>

a:  53 Chandos Place, Covent Garden London WC2N 4HS UK


[cid:image556e34.png@8ef18889.4f85c6ff]


Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services 
India LLP is a company incorporated in India and is operated under license from 
Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in 
Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd 
is a company registered by The Republic of South Africa and is traded under 
license from Shape Blue Ltd. ShapeBlue is a registered trademark.
This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error.




On 05/01/16, 9:17 PM, "Erik Weber"  wrote:


>On Mon, Jan 4, 2016 at 3:10 PM, Abhinandan Prateek <
>abhinandan.prat...@shapeblue.com> wrote:
>
>> Hi All,
>>
>> Currently the inter VPC traffic has to go thru the public gateway.
>> This means the traffic has to be nat-ed across public internet via
>> core-routers, which is inefficient in itself. A more efficient approach
>> will be to route the traffic locally.
>>
>> The proposal is to enable quagga- ospf on VPC routers so that the
>> traffic between VPC’s is routed efficiently.
>>
>> The design doc is here:
>> https://cwiki.apache.org/confluence/display/CLOUDSTACK/Dynamically+routed+VPC
>>
>>
>
>Regarding Super-CIDRs it states that a Super-CIDR will be divided into /24
>and /27s, but it is unclear to me if this is hard coded or just an example.
>
>What if a user wants to use /26 as their Tier-network within a /16
>Super-CIDR?

There are several options here:

1. Hardcoded, user does not worry about CIDR selection.
2. Have him pick up the mask, cloudstack allocates the CIDRs.

Yes, the document initially assumed a rigid system of allocation of CIDRs, but 
after internal discussion it was decided that we allow user to pick up the 
masks. It seems you are also pointing in that direction. Will update the doc 
soon.


-abhi
>
Find out more about ShapeBlue and our range of CloudStack related services:
IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//> | 
CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/> | 
CloudStack Software 
Engineering<http://shapeblue.com/cloudstack-software-engineering/>
CloudStack Infrastructure 
Support<http://shapeblue.com/cloudstack-infrastructure-support/> | CloudStack 
Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>

Re: [PROPOSE] Dynamic inter VPC routing

[Abhinandan Prateek]

Jayapal,

  Can you check if you can see the images !

Cheers !




On 05/01/16, 5:15 PM, "Jayapal Reddy Uradi"  
wrote:

>Hi Abhi,
>
>Few images are not loading in the FS. Can you please correct it.
>
>Thanks,
>Jayapal
>
>On 04-Jan-2016, at 7:40 pm, Abhinandan Prateek 
>mailto:abhinandan.prat...@shapeblue.com>> 
>wrote:
>
>Hi All,
>
>Currently the inter VPC traffic has to go thru the public gateway. This 
> means the traffic has to be nat-ed across public internet via core-routers, 
> which is inefficient in itself. A more efficient approach will be to route 
> the traffic locally.
>
>  The proposal is to enable quagga- ospf on VPC routers so that the traffic 
> between VPC’s is routed efficiently.
>
>The design doc is here: 
>https://cwiki.apache.org/confluence/display/CLOUDSTACK/Dynamically+routed+VPC
>
>The jira ticket is here: https://issues.apache.org/jira/browse/CLOUDSTACK-9163
>
>Regards,
>-abhi
>
><http://www.shapeblue.com/>
>Abhinandan Prateek
>Software Architect  ,   ShapeBlue
>
>
>d:   | s: +44 203 603 0540  | 
> m:  +91 970 11 99011
>
>e:  abhinandan.prat...@shapeblue.com | t: 
><mailto:abhinandan.prat...@shapeblue.com%20|%20t:> |  w:  
>www.shapeblue.com<http://www.shapeblue.com/>
>
>a:  53 Chandos Place, Covent Garden London WC2N 4HS UK
>
>
>
>
>
>Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue 
>Services India LLP is a company incorporated in India and is operated under 
>license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company 
>incorporated in Brasil and is operated under license from Shape Blue Ltd. 
>ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa 
>and is traded under license from Shape Blue Ltd. ShapeBlue is a registered 
>trademark.
>This email and any attachments to it may be confidential and are intended 
>solely for the use of the individual to whom it is addressed. Any views or 
>opinions expressed are solely those of the author and do not necessarily 
>represent those of Shape Blue Ltd or related companies. If you are not the 
>intended recipient of this email, you must neither take any action based upon 
>its contents, nor copy or show it to anyone. Please contact the sender if you 
>believe you have received this email in error.
>
>
>
>
>Find out more about ShapeBlue and our range of CloudStack related services:
>IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//> 
>| CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
>CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/> | 
>CloudStack Software 
>Engineering<http://shapeblue.com/cloudstack-software-engineering/>
>CloudStack Infrastructure 
>Support<http://shapeblue.com/cloudstack-infrastructure-support/> | CloudStack 
>Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>
>
Find out more about ShapeBlue and our range of CloudStack related services:
IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//> | 
CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/> | 
CloudStack Software 
Engineering<http://shapeblue.com/cloudstack-software-engineering/>
CloudStack Infrastructure 
Support<http://shapeblue.com/cloudstack-infrastructure-support/> | CloudStack 
Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>

[PROPOSE] Dynamic inter VPC routing

[Abhinandan Prateek]

Hi All,

Currently the inter VPC traffic has to go thru the public gateway. This 
means the traffic has to be nat-ed across public internet via core-routers, 
which is inefficient in itself. A more efficient approach will be to route the 
traffic locally.

  The proposal is to enable quagga- ospf on VPC routers so that the traffic 
between VPC’s is routed efficiently.

The design doc is here: 
https://cwiki.apache.org/confluence/display/CLOUDSTACK/Dynamically+routed+VPC

The jira ticket is here: https://issues.apache.org/jira/browse/CLOUDSTACK-9163

Regards,
-abhi

[ShapeBlue]<http://www.shapeblue.com>
Abhinandan Prateek
Software Architect  ,   ShapeBlue


d:   | s: +44 203 603 0540  |  
m:  +91 970 11 99011

e:  abhinandan.prat...@shapeblue.com | t: 
<mailto:abhinandan.prat...@shapeblue.com%20|%20t:> |  w:  
www.shapeblue.com<http://www.shapeblue.com>

a:  53 Chandos Place, Covent Garden London WC2N 4HS UK


[cid:imagea9a57b.png@c2da3448.4798ece9]


Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services 
India LLP is a company incorporated in India and is operated under license from 
Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in 
Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd 
is a company registered by The Republic of South Africa and is traded under 
license from Shape Blue Ltd. ShapeBlue is a registered trademark.
This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error.




Find out more about ShapeBlue and our range of CloudStack related services:
IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//> | 
CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/> | 
CloudStack Software 
Engineering<http://shapeblue.com/cloudstack-software-engineering/>
CloudStack Infrastructure 
Support<http://shapeblue.com/cloudstack-infrastructure-support/> | CloudStack 
Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>

Re: [Master] Build Failing

[Abhinandan Prateek]

The following PR takes care of quota-framework unit test failure: 
https://github.com/apache/cloudstack/pull/1303

Regards,
-abhi





[ShapeBlue]<http://www.shapeblue.com>
Abhinandan Prateek
Software Architect  ,   ShapeBlue


d:   | s: +44 203 603 0540  |  
m:  +91 970 11 99011

e:  abhinandan.prat...@shapeblue.com | t: 
<mailto:abhinandan.prat...@shapeblue.com%20|%20t:> |  w:  
www.shapeblue.com<http://www.shapeblue.com>

a:  53 Chandos Place, Covent Garden London WC2N 4HS UK


[cid:image05c0ce.png@aa91a828.47a9f6d6]


Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services 
India LLP is a company incorporated in India and is operated under license from 
Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in 
Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd 
is a company registered by The Republic of South Africa and is traded under 
license from Shape Blue Ltd. ShapeBlue is a registered trademark.
This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error.




On 03/01/16, 3:06 PM, "Remi Bergsma"  wrote:

>Hi,
>
>The Jenkins build "Build-master-slowbuild" has been failing since Dec 2. First 
>due to 5 new findbugs issues, and indeed, since 2016 (build #2876) due to the 
>quota unit tests.
>
>@abhi @rohit can you guys fix this asap?
>
>It is also the reason why Jenkins builds of PR #1300 and #1301 are failing 
>(the new ones in 2016).
>
>
>
>I think we need to resolve both issues asap. It looks like PR #1289 resolves 
>the findbugs issues? If so, let’s complete the reviews and tests so we can 
>merge it.
>
>Regards,
>Remi
>
>
>On 03/01/16 06:42, "Mike Tutkowski"  wrote:
>
>>I didn't spend much time trying to debug this...just re-ran the build with
>>-D skipTests=true so I could continue doing what I was doing.
>>
>>Could this possibly have something to do with the new year? I tried to
>>re-run a build from a branch that was not updated and it actually failed at
>>the same quota test (this branch was building fine a few days ago...in
>>2015).
>>
>>On Sat, Jan 2, 2016 at 6:21 PM, Mike Tutkowski >> wrote:
>>
>>> Hi,
>>>
>>> I just updated (SHA = 67b753c11bab236187a0a68d92ca8e49cef1b3fd) and am
>>> seeing the following failure:
>>>
>>> Tests run: 6, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 0.054 sec
>>> <<< FAILURE! - in org.apache.cloudstack.quota.QuotaStatementTest
>>>
>>> testSendStatement(org.apache.cloudstack.quota.QuotaStatementTest) Time
>>> elapsed: 0.011 sec <<< FAILURE!
>>>
>>> org.mockito.exceptions.verification.WantedButNotInvoked:
>>>
>>> Wanted but not invoked:
>>>
>>> alertManager.sendQuotaAlert(
>>>
>>>
>>> org.apache.cloudstack.quota.QuotaAlertManagerImpl$DeferredQuotaEmail@6e9d6ff7
>>>
>>> );
>>>
>>> -> at
>>> org.apache.cloudstack.quota.QuotaStatementTest.testSendStatement(QuotaStatementTest.java:251)
>>>
>>> Actually, there were zero interactions with this mock.
>>>
>>>
>>> at
>>> org.apache.cloudstack.quota.QuotaStatementTest.testSendStatement(QuotaStatementTest.java:251)
>>>
>>>
>>>
>>> Results :
>>>
>>>
>>> Failed tests:
>>>
>>> QuotaStatementTest.testSendStatement:251
>>>
>>> Wanted but not invoked:
>>>
>>> alertManager.sendQuotaAlert(
>>>
>>>
>>> org.apache.cloudstack.quota.QuotaAlertManagerImpl$DeferredQuotaEmail@6e9d6ff7
>>>
>>> );
>>>
>>> -> at
>>> org.apache.cloudstack.quota.QuotaStatementTest.testSendStatement(QuotaStatementTest.java:251)
>>>
>>> Is it possible I'm missing something I should have in my master
>>> environment or is this a general build problem?
>>>
>>> Thanks!
>>> --
>>> *Mike Tutkowski*
>>> *Senior CloudStack Developer, SolidFire Inc.*
>>> e: mike.tutkow...@solidfire.com
>>> o: 303.746.7302
>>> Advancing the way t

Re: Build failed in Jenkins: build-master-slowbuild #2783

[Abhinandan Prateek]

At least one findbug is fixed in this pull request 
https://github.com/apache/cloudstack/pull/1254.
Will look at others.


[ShapeBlue]<http://www.shapeblue.com>
Abhinandan Prateek
Software Architect  ,   ShapeBlue


d:  +44 203 603 0540 | s:   |  
m:  +91 970 11 99011

e:  abhinandan.prat...@shapeblue.com | t: 
<mailto:abhinandan.prat...@shapeblue.com%20|%20t:> |  w:  
www.shapeblue.com<http://www.shapeblue.com>

a:  53 Chandos Place, Covent Garden London WC2N 4HS UK


[cid:image3a31c3.png@183564dc.4ba47160]


Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services 
India LLP is a company incorporated in India and is operated under license from 
Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in 
Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd 
is a company registered by The Republic of South Africa and is traded under 
license from Shape Blue Ltd. ShapeBlue is a registered trademark.
This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error.




From: Daan Hoogland mailto:daan.hoogl...@gmail.com>>
Date: Sunday, 20 December 2015 at 6:46 PM
To: Abhinandan Prateek 
mailto:abhinandan.prat...@shapeblue.com>>, 
Rohit Yadav mailto:rohit.ya...@shapeblue.com>>, 
"sate...@apache.org<mailto:sate...@apache.org>" 
mailto:sate...@apache.org>>
Cc: dev mailto:dev@cloudstack.apache.org>>
Subject: Re: Build failed in Jenkins: build-master-slowbuild #2783

Sateesh, Rohit, Abhi,

Can you guys look  at the 5 new warnings? These are in your contributions.

On Sun, Dec 20, 2015 at 1:09 PM, 
mailto:jenk...@cloudstack.org>> wrote:
See <http://jenkins.buildacloud.org/job/build-master-slowbuild/2783/>

--
[...truncated 28722 lines...]
[INFO]
[INFO] --- findbugs-maven-plugin:3.0.1:findbugs (findbugs) @ cloud-quickcloud 
---
[INFO]
[INFO] <<< findbugs-maven-plugin:3.0.1:check (cloudstack-findbugs) @ 
cloud-quickcloud <<<
[INFO]
[INFO] --- findbugs-maven-plugin:3.0.1:check (cloudstack-findbugs) @ 
cloud-quickcloud ---
[INFO]
[INFO] --- cobertura-maven-plugin:2.6:instrument (default-cli) @ 
cloud-quickcloud ---
[WARNING] No files to instrument.
[INFO] NOT adding cobertura ser file to attached artifacts list.
[INFO]
[INFO] --- maven-resources-plugin:2.5:testResources (default-testResources) @ 
cloud-quickcloud ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory 
<http://jenkins.buildacloud.org/job/build-master-slowbuild/ws/quickcloud/src/test/resources>
[INFO] Copying 3 resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- maven-compiler-plugin:3.2:testCompile (default-testCompile) @ 
cloud-quickcloud ---
[INFO] No sources to compile
[INFO]
[INFO] --- maven-surefire-plugin:2.18.1:test (default-test) @ cloud-quickcloud 
---
[INFO]
[INFO] <<< cobertura-maven-plugin:2.6:cobertura (default-cli) @ 
cloud-quickcloud <<<
[INFO]
[INFO] --- cobertura-maven-plugin:2.6:cobertura (default-cli) @ 
cloud-quickcloud ---
[INFO] 
[INFO] Reactor Summary:
[INFO]
[INFO] Apache CloudStack Developer Tools - Checkstyle Configuration  SUCCESS 
[2.947s]
[INFO] Apache CloudStack . SUCCESS [3.363s]
[INFO] Apache CloudStack Maven Conventions Parent  SUCCESS [1.001s]
[INFO] Apache CloudStack Framework - Managed Context . SUCCESS [18.801s]
[INFO] Apache CloudStack Utils ... SUCCESS [1:30.522s]
[INFO] Apache CloudStack Framework ... SUCCESS [0.139s]
[INFO] Apache CloudStack Framework - Event Notification .. SUCCESS [54.144s]
[INFO] Apache CloudStack Framework - Configuration ... SUCCESS [28.356s]
[INFO] Apache CloudStack API . SUCCESS [1:49.065s]
[INFO] Apache CloudStack Framework - REST  SUCCESS [16.334s]
[INFO] Apache CloudStack Framework - IPC . SUCCESS [30.577s]
[INFO] Apache CloudStack Cloud Engine  SUCCESS [0.141s]
[INFO] Apache CloudStack Cloud Engine API  SUCCESS [27.860s]
[INFO] Apache CloudStack Framework - Security  SUCCESS [24.211s]
[INFO] Apache CloudStack Core  SUCCESS [1:22.930s]
[INFO] Apache CloudStack Agents 

Re: [VOTE] Apache CloudStack 4.7.0

[Abhinandan Prateek]

+0

Created a cluster with 2 Xen 6.5.
Manually tested vm-lifecycle, live migration, snapshots, iso download, VPC s, 
firewall, PF rules, console proxy.

Ran several integration tests.
On quota found one issue, due to parallely running integration tests that were 
adding and removing accounts: 
https://issues.apache.org/jira/browse/CLOUDSTACK-9174

Voting +0 as the release is solid, but wish that the above quota fix and 
CLOUDSTACK-9161 are also included.

Regards,

-abhi




[ShapeBlue]<http://www.shapeblue.com>
Abhinandan Prateek
Software Architect  ,   ShapeBlue


d:  +44 203 603 0540 | s:   |  
m:  +91 970 11 99011

e:  abhinandan.prat...@shapeblue.com | t: 
<mailto:abhinandan.prat...@shapeblue.com%20|%20t:> |  w:  
www.shapeblue.com<http://www.shapeblue.com>

a:  53 Chandos Place, Covent Garden London WC2N 4HS UK


[cid:image80c48b.png@7456ca94.4782da63]


Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services 
India LLP is a company incorporated in India and is operated under license from 
Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in 
Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd 
is a company registered by The Republic of South Africa and is traded under 
license from Shape Blue Ltd. ShapeBlue is a registered trademark.
This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error.




On 14/12/15, 1:57 AM, "Remi Bergsma"  wrote:

>Hi all,
>
>Since our 4.6.0 release (on Nov 13th, exactly 1 month ago), we have merged 
>100+ pull requests [1] with lots of bug fixes, refactoring and of course new 
>features. Time for a new release!
>
>
>I've created a 4.7.0 release candidate, with the following artifacts up for a 
>vote:
>
>Git Branch and Commit SH:
>https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;a=shortlog;h=4.7.0-RC20151213T2109
>
>Commit: 2f26a859a971a9852ed9f6f34fe35e52fe6028a9
>
>Source release (checksums and signatures are available at the same location):
>https://dist.apache.org/repos/dist/dev/cloudstack/4.7.0/
>
>PGP release keys (signed using A47DDC4F):
>https://dist.apache.org/repos/dist/release/cloudstack/KEYS
>
>Vote will be open for at least 72 hours.
>
>For sanity in tallying the vote, can PMC members please be sure to indicate 
>"(binding)" with their vote?
>
>[ ] +1 approve
>[ ] +0 no opinion
>[ ] -1 disapprove (and reason why)
>
>
>[1] git log --pretty=oneline --abbrev-commit origin/4.6..4.7.0-RC20151213T2109 
>| grep "Merge pull request"
>
Find out more about ShapeBlue and our range of CloudStack related services:
IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//> | 
CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/> | 
CloudStack Software 
Engineering<http://shapeblue.com/cloudstack-software-engineering/>
CloudStack Infrastructure 
Support<http://shapeblue.com/cloudstack-infrastructure-support/> | CloudStack 
Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>

Re: BVT report for week of 12/14

[Abhinandan Prateek]

Hi Raja,

- test_quota.py - all the test failing, we should look at the PR that has 
checked in this code.


For testing quota the plugin should be enabled. It is not enabled by default. 
The discussion is currently going on in this PR:

https://github.com/apache/cloudstack/pull/1240#issuecomment-164652898

-abhi





[ShapeBlue]<http://www.shapeblue.com>
Abhinandan Prateek
Software Architect  ,   ShapeBlue


d:  +44 203 603 0540 | s:   |  
m:  +91 970 11 99011

e:  abhinandan.prat...@shapeblue.com | t: 
<mailto:abhinandan.prat...@shapeblue.com%20|%20t:> |  w:  
www.shapeblue.com<http://www.shapeblue.com>

a:  53 Chandos Place, Covent Garden London WC2N 4HS UK


[cid:imageab3322.png@d6adbfad.4388ab0d]


Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services 
India LLP is a company incorporated in India and is operated under license from 
Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in 
Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd 
is a company registered by The Republic of South Africa and is traded under 
license from Shape Blue Ltd. ShapeBlue is a registered trademark.
This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error.




On 15/12/15, 3:15 PM, "Raja Pullela"  wrote:

>Hi,
>
>Here is the BVT report for this week -
>- XS Basic - 97.0% (4.6 RC passrate 96.9%)
>- XS Adv - 79.5% (4.6 RC passrate 93.4%) // went down from 92.7% to 79.5%
>- KVM Basic - 98.6% (4.6 RC passrate - 98.6%)
>- KVM Adv - 79.7% (4.6 RC passrate - 96.3%) // went down from 96.4% to 79.7%
>
>Summary:
>- Breakage in Adv Network cases, the following suites need to be run both Xen 
>and Adv
>- test_quota.py - all the test failing, we should look at the PR that has 
>checked in this code.
>- test_vpc_vpn.py - couple of tests failing
>- test_vpc_redundant.py - couple of test failing
>- test_routers_network_ops.py - 5-6 tests failing
>- test_routers_iptables_default_policy.py -
>- test_privategw_acl.py
>
>Let me know if you have any questions,
>Raja
>
>Following are the failed tests:
>- XS Basic (both the following are test script issues)
>- 
>integration.smoke.test_vm_snapshots.TestSnapshots.test_01_test_vm_volume_snapshot
>- integration.smoke.test_iso.TestISO.test_07_list_default_iso
>
>- KVM Basic (following is a test script issue)
>- integration.smoke.test_iso.TestISO.test_07_list_default_iso //known testcase 
>issue
>
>- XS Adv
>- integration.smoke.test_nic.TestNic.test_01_nic
>- 
>integration.smoke.test_routers_network_ops.TestIsolatedNetworks.test_02_isolate_network_FW_PF_default_routes_egress_false
>- :setup
>- 
>integration.smoke.test_routers_iptables_default_policy.TestRouterIpTablesPolicies.test_02_routervm_iptables_policies
>- 
>integration.smoke.test_routers_iptables_default_policy.TestVPCIpTablesPolicies.test_01_single_VPC_iptables_policies
>- 
>integration.smoke.test_routers_network_ops.TestIsolatedNetworks.test_01_isolate_network_FW_PF_default_routes_egress_true
>- 
>integration.smoke.test_routers_network_ops.TestRedundantIsolateNetworks.test_01_RVR_Network_FW_PF_SSH_default_routes_egress_true
>- 
>integration.smoke.test_routers_network_ops.TestRedundantIsolateNetworks.test_02_RVR_Network_FW_PF_SSH_default_routes_egress_false
>- 
>integration.smoke.test_routers_network_ops.TestRedundantIsolateNetworks.test_03_RVR_Network_check_router_state
>- 
>integration.smoke.test_vpc_redundant.TestVPCRedundancy.test_02_redundant_VPC_default_routes
>- 
>integration.smoke.test_vpc_redundant.TestVPCRedundancy.test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers
>- integration.smoke.test_vpc_router_nics.TestVPCNics.test_02_VPC_default_routes
>- integration.smoke.test_quota.TestQuota.test_01_quota
>- integration.smoke.test_quota.TestQuota.test_02_quota
>- integration.smoke.test_quota.TestQuota.test_03_quota
>- integration.smoke.test_quota.TestQuota.test_04_quota
>- integration.smoke.test_quota.TestQuota.test_05_quota
>- integration.smoke.test_quota.TestQuota.test_06_quota
>- integration.smoke.test_quota.TestQuota.test_07_quota
>- 
>integration.smoke.test_privategw_acl.TestPrivateGwACL.test_02_vpc_privategw_static_routes
>- 
>integration.smoke.test_privategw_acl.TestPri

Re: marvin updates

[Abhinandan Prateek]

AFAIK, Santhosh and Gaurav were the last few looking at Marvin framework.
Though I do not see them active as in real active, but once in a while I see 
them responding to some issue.
If you know there are some issues to be looked into, just cc that to their 
email ids, hopefully they will respond or other community folks may try picking 
it up.

Regards,
Abhinandan Prateek
S: +44 20 3603 0540  | M: +91 97011 99011 

abhinandan.prat...@shapeblue.com






On 01/12/15, 3:45 PM, "Daan Hoogland"  wrote:

>​Is anybody in the community still maintaining Marvin? (I mean the
>framework not the tests)​
>
>--
>Daan
Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
CloudStack Software 
Engineering<http://shapeblue.com/cloudstack-software-engineering/>
CloudStack Infrastructure 
Support<http://shapeblue.com/cloudstack-infrastructure-support/>
CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>

This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England & Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue Ltd. Shape 
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company 
registered by The Republic of South Africa and is traded under license from 
Shape Blue Ltd. ShapeBlue is a registered trademark.

Re: SR_BACKEND_FAILURE_61File SR creation error [opterr=fail to mount FileSR. Errno is 32]

[Abhinandan Prateek]

The error signifies that the creation of file storage repository failed on 
xenserver, check that the nfs can be mounted and is writable.
The log file mentioned by Jayapal will give you further clues to the problem.

Regards,

Abhinandan Prateek

M: +91 9701199011



abhinandan.prat...@shapeblue.com







On 20/11/15, 9:30 AM, "Jayapal Reddy Uradi"  
wrote:

>Hi Prakash,
>
>Can you also check the xenserver logs at /var/log/SMLog when this error is 
>coming.
>
>Thanks,
>Jayapal
>> On 20-Nov-2015, at 9:23 am, B Prakash  wrote:
>>
>> Please can someone help me with this?  I am trying to setup NFS secondary 
>> storage on ACS 4.6 hosted on Ubuntu 14.04 with host XS 6.5.
>>
>>
>> NFS mount and its access is working fine on both the servers, but when I try 
>> to set up a secondary storage, I get this exception;
>>
>>
>> 2015-11-19 13:24:00,841 WARN  [c.c.h.x.r.XenServerStorageProcessor] 
>> (DirectAgent-62:ctx-c53368c0) createFileSR failed! due to the following: 
>> SR_BACKEND_FAILURE_61File SR creation error [opterr=fail to mount FileSR. 
>> Errno is 32]
>> SR_BACKEND_FAILURE_61File SR creation error [opterr=fail to mount FileSR. 
>> Errno is 32]
>> at com.xensource.xenapi.Types.checkResponse(Types.java:2021)
>> at com.xensource.xenapi.Connection.dispatch(Connection.java:395)
>> at 
>> com.cloud.hypervisor.xenserver.resource.XenServerConnectionPool$XenServerConnection.dispatch(XenServerConnectionPool.java:457)
>> at com.xensource.xenapi.PBD.plug(PBD.java:457)
>> at 
>> com.cloud.hypervisor.xenserver.resource.Xenserver625StorageProcessor.createFileSR(Xenserver625StorageProcessor.java:129)
>> at 
>> com.cloud.hypervisor.xenserver.resource.Xenserver625StorageProcessor.createFileSr(Xenserver625StorageProcessor.java:162)
>> at 
>> com.cloud.hypervisor.xenserver.resource.Xenserver625StorageProcessor.copyTemplateToPrimaryStorage(Xenserver625StorageProcessor.java:196)
>> at 
>> com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(StorageSubsystemCommandHandlerBase.java:82)
>> at 
>> com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStorageCommands(StorageSubsystemCommandHandlerBase.java:54)
>> at 
>> com.cloud.hypervisor.xenserver.resource.wrapper.xenbase.CitrixStorageSubSystemCommandWrapper.execute(CitrixStorageSubSystemCommandWrapper.java:36)
>> at 
>> com.cloud.hypervisor.xenserver.resource.wrapper.xenbase.CitrixStorageSubSystemCommandWrapper.execute(CitrixStorageSubSystemCommandWrapper.java:30)
>> at 
>> com.cloud.hypervisor.xenserver.resource.wrapper.xenbase.CitrixRequestWrapper.execute(CitrixRequestWrapper.java:122)
>> at 
>> com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:1676)
>> at 
>> com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:302)
>> at 
>> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
>> at 
>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
>> at 
>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
>> at 
>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
>> at 
>> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
>> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
>> at 
>> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
>> at 
>> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
>> at 
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>> at 
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>> at java.lang.Thread.run(Thread.java:745)
>>
>>
>
Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
CloudStack Software 
Engineering<http://shapeblue.com/cloudstack-software-engineering/>
CloudStack Infrastructure 
Support<http://shapeblue.com/cloudstack-infrastructure-support/>
CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudst

Re: cloudstack UI

[Abhinandan Prateek]

On 17/11/15, 1:49 PM, "Sebastien Goasguen"  wrote:

>
>> On Nov 17, 2015, at 7:24 AM, Abhinandan Prateek 
>>  wrote:
>>
>> Hi,
>>
>>   I am considering  some improvements to cloudstack UI. Like delinking the 
>> quick view with the details page. Such that the details page can contain 
>> listView.
>>
>>  Another change that can make UI more compact and flexible is to have 
>> multiple listViews in a listView i.e. Recursive listViews or just a 
>> complexListView.
>>
>> Any thoughts and comments on complexity, usefulness etc will help.
>>
>
>Abhi, do you know if there is a way to easily decouple the UI code from the 
>core of cloudstack ?
>
>That might be an interesting move.

Although I was currently looking at making the UI widgets more flexible. Coming 
to think about decoupling UI, it might be tricky as UI is tightly coupled with 
cloudstack APIs.
Like marvin tests I think we may have to just have it with cloudstack core, due 
to versioning complications.

Regards,
-abhi
Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
CloudStack Software 
Engineering<http://shapeblue.com/cloudstack-software-engineering/>
CloudStack Infrastructure 
Support<http://shapeblue.com/cloudstack-infrastructure-support/>
CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>

This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England & Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue Ltd. Shape 
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company 
registered by The Republic of South Africa and is traded under license from 
Shape Blue Ltd. ShapeBlue is a registered trademark.

Re: DevCloud deployment

[Abhinandan Prateek]

The wiki below is much more elaborate on cloudstack setup using virtual box, 
and good for anyone wishing to be a cloudstack developer.
http://www.shapeblue.com/virtualbox-test-env/



On 17/11/15, 2:17 PM, "Илья Толстихин"  wrote:

>I copied vhd-util from /usr/bin/ on devcloud to
>scripts/vm/hypervisor/xenserver of cloudstack.
>Nothing changed.
>
>Also I tried to setup with manuals
>https://github.com/apache/cloudstack/blob/master/tools/devcloud4/README.md
>https://github.com/apache/cloudstack/blob/master/tools/devcloud4/advanced/README.md
>
>That gives the same error.
>Do you have any other ideas, what could be the reason?
>
>2015-11-16 17:14 GMT+06:00 Илья Толстихин :
>
>> Thanks.
>>
>> 2015-11-16 10:28 GMT+06:00 Rajani Karuturi :
>>
>>> I find it easier to use devcloud4[1]. It the easiest way for xen6.2
>>> devcloud setup.
>>> The documentation is also good. Just install the required tools/IP configs
>>> mentioned in README [2]. Then, go to the advanced and follow the readme[3]
>>> there for a advanced zone setup.
>>>
>>> [1] https://github.com/apache/cloudstack/tree/master/tools/devcloud4
>>> [2]
>>> https://github.com/apache/cloudstack/blob/master/tools/devcloud4/README.md
>>> [3]
>>>
>>> https://github.com/apache/cloudstack/blob/master/tools/devcloud4/advanced/README.md
>>>
>>> ~Rajani
>>>
>>> On Fri, Nov 13, 2015 at 12:52 PM, Daan Hoogland 
>>> wrote:
>>>
>>> > From your log it seems the host can be reached but doesn't respond s
>>> > expected. First guess :wrong version of vhd-utils?
>>> >
>>> > Sorry for the late reaction. Stuck in traffic
>>> >
>>> > Biligual auto correct use.  Read at your own risico
>>> > Op 12-nov.-2015 10:28 schreef "Илья Толстихин" :
>>> >
>>> > > This is fragment of vmops.log file of MS.
>>> > >
>>> > > 2015-11-12 0:49 GMT+06:00 Daan Hoogland :
>>> > >
>>> > >> Ilya, Can you share the log of your management server? There must be
>>> > some
>>> > >> more info in there. And maybe you can check SRLog on the host To see
>>> if
>>> > >> anything happened there at all.
>>> > >>
>>> > >> On Wed, Nov 11, 2015 at 6:43 PM, Илья Толстихин 
>>> > >> wrote:
>>> > >>
>>> > >> > Yes, this is Xen.
>>> > >> >
>>> > >> > 2015-11-11 22:00 GMT+06:00 Daan Hoogland >> >:
>>> > >> >
>>> > >> > > this is a xen host, right?
>>> > >> > >
>>> > >> > > On Wed, Nov 11, 2015 at 3:43 PM, Илья Толстихин <
>>> inosi...@gmail.com
>>> > >
>>> > >> > > wrote:
>>> > >> > >
>>> > >> > > > On host ssh is up with 22 port only.
>>> > >> > > >
>>> > >> > > > 2015-11-11 20:03 GMT+06:00 Илья Толстихин >> >:
>>> > >> > > >
>>> > >> > > > > Cloudstack 4.6.0
>>> > >> > > > > Yes, I can ssh to host
>>> > >> > > > >
>>> > >> > > > > 2015-11-11 19:41 GMT+06:00 Daan Hoogland <
>>> > daan.hoogl...@gmail.com
>>> > >> >:
>>> > >> > > > >
>>> > >> > > > >> what version of ACS?
>>> > >> > > > >> It sounds like a network issue between ms and host? can you
>>> ssh
>>> > >> from
>>> > >> > > ms
>>> > >> > > > to
>>> > >> > > > >> host on the right port? (i think it was 3922, might be 3022)
>>> > >> > > > >>
>>> > >> > > > >> On Wed, Nov 11, 2015 at 1:42 PM, Илья Толстихин <
>>> > >> inosi...@gmail.com
>>> > >> > >
>>> > >> > > > >> wrote:
>>> > >> > > > >>
>>> > >> > > > >> > Hi all,
>>> > >> > > > >> > Could you please help with the DevCloud deployment.
>>> > >> > > > >> >
>>> > >> > > > >> > I imported devcloud into virtualbox, in settings *enabled
>>> > PAE*
>>> > >> and
>>> > >> > > > >> > created *host-only
>>> > >> > > > >> > network 192.168.56.1/24 *
>>> > >> > > > >> > Devcloud is pinged now.
>>> > >> > > > >> >
>>> > >> > > > >> > I built and run cloudstack on my local machine with
>>> commands
>>> > >> > > > >> > *mvn -Pdeveloper,systemvm clean install*
>>> > >> > > > >> > *mvn -Pdeveloper -pl developer,tools/devcloud -Ddeploydb*
>>> > >> > > > >> > *mvn -pl :cloud-client-ui jetty:run*
>>> > >> > > > >> >
>>> > >> > > > >> >
>>> > >> > > > >> > Then I installed marvin and tried to deploy datacenter
>>> with
>>> > >> > command
>>> > >> > > > >> > *mvn -P developer -pl tools/devcloud -Ddeploysvr*
>>> > >> > > > >> > and got exception
>>> > >> > > > >> >
>>> > >> > > > >> > * Deploy DC Started *
>>> > >> > > > >> > *Exception Occurred :['Traceback (most recent call
>>> > last):\n', '
>>> > >> > > File
>>> > >> > > > >> > "../marvin/marvin/deployDataCenter.py", line 136, in
>>> > addHosts\n
>>> > >> > > > ret =
>>> > >> > > > >> > self.__apiClient.addHost(hostcmd)\n', '  File
>>> > >> > > > >> >
>>> > >> > > > >> >
>>> > >> > > > >>
>>> > >> > > >
>>> > >> > >
>>> > >> >
>>> > >>
>>> >
>>> "/usr/local/lib/python2.7/dist-packages/Marvin-4.6.0_SNAPSHOT-py2.7.egg/marvin/cloudstackAPI/cloudstackAPIClient.py",
>>> > >> > > > >> > line 1572, in addHost\nresponse =
>>> > >> > > > >> > self.connection.marvinRequest(command,
>>> > response_type=response,
>>> > >> > > > >> > method=method)\n', '  File
>>> > >> > > > >> >
>>> > >> > > > >> >
>>> > >> > > > >>
>>> > >> > > >
>>> > >> > >
>>> > >> >
>

cloudstack UI

[Abhinandan Prateek]

Hi,

   I am considering  some improvements to cloudstack UI. Like delinking the 
quick view with the details page. Such that the details page can contain 
listView.

  Another change that can make UI more compact and flexible is to have multiple 
listViews in a listView i.e. Recursive listViews or just a complexListView.

Any thoughts and comments on complexity, usefulness etc will help.

Regards,
-abhi
Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build
CSForge – rapid IaaS deployment framework
CloudStack Consulting
CloudStack Software 
Engineering
CloudStack Infrastructure 
Support
CloudStack Bootcamp Training Courses

This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England & Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue Ltd. Shape 
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company 
registered by The Republic of South Africa and is traded under license from 
Shape Blue Ltd. ShapeBlue is a registered trademark.

Re: new colleagues

[Abhinandan Prateek]

Giles/Daan,

  Good to know that you guys love running.
Hope to join you for a run in Dublin.


> On 01-Oct-2015, at 4:17 pm, Giles Sirett  wrote:
>
> Great to hear that you're staying in the family Daan
>
> And good news that I get a running partner in Dublin (as Sebastien usually 
> doesn't get out of bed for our runs !)
>
>
>
> Regards
>
> Giles
>
> -Original Message-
> From: Daan Hoogland [mailto:daan.hoogl...@gmail.com]
> Sent: 01 October 2015 11:07
> To: dev 
> Subject: new colleagues
>
> Hello fellow stackers,
>
> This to let you know that I just entered the building of Leaseweb, in order 
> to be working there for the next couple of years. You know them via Whei Zou, 
> who will be my close colleague. I had a great time with Schuberg Philis as 
> you might know and am confident the same will happen here. I will continue to 
> use personal email addresses so I want to let you this way that my motivation 
> has changed ever so slightly.
>
> I didn't plan to go to Dublin yet, but as Makesh my new colleague threatened 
> to mention me in his session [1], I will try to be there for damage control.
>
> [1] http://sched.co/44T2
>
> ​hoping to contribute a lot more,​
> --
> Daan
> Find out more about ShapeBlue and our range of CloudStack related services
>
> IaaS Cloud Design & Build
> CSForge – rapid IaaS deployment framework
> CloudStack Consulting
> CloudStack Software 
> Engineering
> CloudStack Infrastructure 
> Support
> CloudStack Bootcamp Training 
> Courses
>
> This email and any attachments to it may be confidential and are intended 
> solely for the use of the individual to whom it is addressed. Any views or 
> opinions expressed are solely those of the author and do not necessarily 
> represent those of Shape Blue Ltd or related companies. If you are not the 
> intended recipient of this email, you must neither take any action based upon 
> its contents, nor copy or show it to anyone. Please contact the sender if you 
> believe you have received this email in error. Shape Blue Ltd is a company 
> incorporated in England & Wales. ShapeBlue Services India LLP is a company 
> incorporated in India and is operated under license from Shape Blue Ltd. 
> Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
> operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company 
> registered by The Republic of South Africa and is traded under license from 
> Shape Blue Ltd. ShapeBlue is a registered trademark.

Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build
CSForge – rapid IaaS deployment framework
CloudStack Consulting
CloudStack Software 
Engineering
CloudStack Infrastructure 
Support
CloudStack Bootcamp Training Courses

This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England & Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue Ltd. Shape 
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company 
registered by The Republic of South Africa and is traded under license from 
Shape Blue Ltd. ShapeBlue is a registered trademark.

Re: new colleagues

[Abhinandan Prateek]

+ Congrats Daan.

> On 01-Oct-2015, at 3:37 pm, Daan Hoogland  wrote:
>
> Hello fellow stackers,
>
> This to let you know that I just entered the building of Leaseweb, in order
> to be working there for the next couple of years. You know them via Whei
> Zou, who will be my close colleague. I had a great time with Schuberg
> Philis as you might know and am confident the same will happen here. I will
> continue to use personal email addresses so I want to let you this way that
> my motivation has changed ever so slightly.
>
> I didn't plan to go to Dublin yet, but as Makesh my new colleague
> threatened to mention me in his session [1], I will try to be there for
> damage control.
>
> [1] http://sched.co/44T2
>
> ​hoping to contribute a lot more,​
> --
> Daan

Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build
CSForge – rapid IaaS deployment framework
CloudStack Consulting
CloudStack Software 
Engineering
CloudStack Infrastructure 
Support
CloudStack Bootcamp Training Courses

This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England & Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue Ltd. Shape 
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company 
registered by The Republic of South Africa and is traded under license from 
Shape Blue Ltd. ShapeBlue is a registered trademark.

Re: VR refactoring, concerns and a way out ?

[Abhinandan Prateek]

 I can understand Citrix concern of some critical scenarios being missed. 
Citrix supports several customers with sometimes weird setups requiring that 
extra step in fixing and making the code that works in all those scenarios.

The current code has been contributed by community, by people who just want to 
see cloudstack become better. The code was contributed as per process and has 
been there for more than 6 months, not including the time that this effort 
took, which is over an year.

Can someone from Citrix consolidate all the VR issues and consolidate those 
under an umbrella ticket. As I can see the importance of those bugs is being 
lost in this chatter. Will request Citrix to take that extra effort in 
identifying the bugs, putting in enough details so that the use cases it breaks 
are understood in the community. Then it is just a number game — how many are 
squashed and how fast by the resilient community.

-abhi


> On 24-Sep-2015, at 9:06 pm, David Nalley  wrote:
>
> Everything else aside, do we really think that this could be backed
> out cleanly? The initial merge should be easy to pull out, but 6
> months of follow on work? There's no way that's coming out cleanly.
>
> --David
>
> On Thu, Sep 24, 2015 at 11:21 AM, Raja Pullela  
> wrote:
>> @wilder, Not sure why you would think it as a nonsense approach? sure, you 
>> realize amount of code churn and blockers we are dealing with when 4.6 is 
>> ready to go out.
>>
>> Agreed, the refactoring happened several months ago and we could have taken 
>> a closer look then-   the recent blockers filed have uncovered areas where 
>> in the implementation didn't exist.  I will post the bug details around this.
>>
>> Obviously, the refactoring changes missed multiple critical test scenarios 
>> and will take substantial time to test/stabilize.
>>
>> The BVTs are coming good for basic zone and Adv zone there are still a 
>> number of failures and it will take us good time to get those fixed.
>>
>> Besides the BVTs, regression tests are in a very bad shape.  Hope to get to 
>> these starting next week.
>>
>> Please see my latest bvt report, I will post in another 2 hrs, waiting for a 
>> new run to complete.
>>
>>> On Sep 24, 2015, at 7:00 PM, sebgoa  wrote:
>>>
>>>
 On Sep 24, 2015, at 3:17 PM, Remi Bergsma  
 wrote:

 Are you serious? You consider to revert a PR that was merged over 6 months 
 ago? And expect it to become more stable?
>>>
>>> I have not followed all the latest development, but if we are talking about 
>>> the VR refactoring, indeed it happened several months back. Reverting it 
>>> now does not seem like a good idea.
>>>
>>> I am probably missed a beat here, but the latest BVT results sent by Raja 
>>> showed XS tests almost at 100%, there were only some issues with KVM.
>>>
 The problem, in MHO, is not that we find bugs that we consider blockers. 
 The problem is we are unable to resolve them effectively because master is 
 unstable. There currently isn’t a single PR that solves it, hence there is 
 no way to test PRs. This is because we have many PRs open and they were 
 all branched off of a master that doesn’t work. I simply can't test 
 proposed PRs.

 This problem occurred about 3 weeks ago, because before that master worked 
 and we could solve issues and merge PRs. I’m not saying it was bug-free, 
 but at least we could work on stabilising it. Most likely, we accepted a 
 “fix” that made things worse. Probably even multiple of them.
>>>
>>> Master seemed stable and PR where being merged towards 4.6 with success (it 
>>> seemed), so indeed if we have issues now of stability, we should identify 
>>> what caused it
>>>
 To get out of this, I think we need to combine a few PRs that make it 
 stable. I’ll have a look today with Wilder and Funs to see if what fixes 
 we need to combine to make it work again. O
 nce we merge it and master actually works again, we can rebase any open PR 
 with current master and work from there.
>>>
>>> Potentially, if you identify the commit or commits that brought the 
>>> instability you could revert to that point and play forward PRs that did 
>>> not render master unstable.
>>>
>>> Thanks for looking into it.
>>>
>>> -seb
>>>
 Regards,
 Remi




> On 24/09/15 14:00, "Ramanath Katru"  wrote:
>
> My vote is for the approach no.1 - to backout completely. Most of VR 
> functionalities are broken and are in a mess to say the least. It 
> definitely will take some time and effort from several folks to get it to 
> a stable state.
>
> Ram Katru
>
>
> -Original Message-
> From: Raja Pullela [mailto:raja.pull...@citrix.com]
> Sent: Thursday, September 24, 2015 2:06 PM
> To: dev@cloudstack.apache.org
> Subject: VR refactoring, concerns and a way out ?
>
> Hi,
>
>
>
> I understand a concern on the VR changes wa

Re: goal failed on cloudstack-service-console-proxy-rdpclient

[Abhinandan Prateek]

Just did a build on 4.5 and did not see any build failure.

> On 19-Sep-2015, at 3:47 am, Josh Harshman  wrote:
>
> Anyone else experience this error when building from source?
>
>
> [ERROR] Failed to execute goal 
> org.apache.maven.plugins:maven-surefire-plugin:2.12:test (default-test) on 
> project cloudstack-service-console-proxy-rdpclient: There are test failures.
> [ERROR]
> [ERROR] Please refer to 
> /home/jharshman/apache-cloudstack-4.5.2-src/services/console-proxy-rdp/rdpconsole/target/surefire-reports
>  for the individual test results.
> [ERROR] -> [Help 1]
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with the -e 
> switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions, please 
> read the following articles:
> [ERROR] [Help 1] 
> http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
> [ERROR]
> [ERROR] After correcting the problems, you can resume the build with the 
> command
> [ERROR]   mvn  -rf :cloudstack-service-console-proxy-rdpclient
>
>
>
>
>
> Josh Harshman
>
> Cloud Engineer
>
>
> Intrinium
> Tel: (509) 465-1234 x5259
> Fax: (866) 565-4578
> Lync / Skype: josh.harsh...@intrinium.com
> Web: http://intrinium.com
>
>
> [Intrinium Long Sig Logo]
>
>
> [Facebook] [Twitter] 
>   [Linkedin] 
>  
>  [Youtube]   [Blog] 
> 
>
> Information Security and Compliance Consulting | Managed IT and Security 
> Services | Cloud Services
>
>
>
>
>
> 
>
> This email and any files transmitted with it are confidential and intended 
> solely for the use of the individual or entity to whom they are addressed. If 
> you have received this email in error please notify the system manager. This 
> message contains confidential information and is intended only for the 
> individual named. If you are not the named addressee you should not 
> disseminate, distribute or copy this e-mail. Please notify the sender 
> immediately by e-mail if you have received this e-mail by mistake and delete 
> this e-mail from your system. If you are not the intended recipient you are 
> notified that disclosing, copying, distributing or taking any action in 
> reliance on the contents of this information is strictly prohibited.

Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build
CSForge – rapid IaaS deployment framework
CloudStack Consulting
CloudStack Software 
Engineering
CloudStack Infrastructure 
Support
CloudStack Bootcamp Training Courses

This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England & Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue Ltd. Shape 
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company 
registered by The Republic of South Africa and is traded under license from 
Shape Blue Ltd. ShapeBlue is a registered trademark.

Re: Recurring snapshot taking full every time

[Abhinandan Prateek]

Looking at the code the plugin that is failing is “vmopsSnapshot”. That will 
mean the snapshot operation is falling possibly due to lack of space.
You have mentioned that you are running out of space. Did you try freeing up 
some space ?


> On 18-Sep-2015, at 12:14 pm, raja sekhar  wrote:
>
> Hi Abhinandan,
>
> I have force reconnect the hosts but no use and i didn't find any error in
> SMlog. please suggest me the error is still
> generating.
>
> Regards,
> Rajasekhar.
>
> On Wed, Sep 16, 2015 at 8:58 AM, Abhinandan Prateek <
> abhinandan.prat...@shapeblue.com> wrote:
>
>> Can you check in the SMlog on the concerned host if you see any error when
>> the plugin is being invoked ?
>>
>>> On 14-Sep-2015, at 5:01 pm, raja sekhar  wrote:
>>>
>>> Hi abhinandan,
>>>
>>> Thanks for your reply.
>>> We are facing the issue only for root volumes in that host. The snapshot
>>> recurring policy for data disks in same host is working fine.
>>> if the host configuration is not properly instrumented the policy for
>> data
>>> disks also fails, but it is working fine.
>>> please suggest us.
>>>
>>> Note: The manual snapshots for root disk is working fine,and it is taking
>>> child when second manual is configured , problem only with root daily
>>> snapshots every day it is taking full instead of taking child snapshots
>>> throwing error "*Failed to get parent snapshot**, due to There was a
>>> failure communicating with the plugin*".
>>>
>>> Regards,
>>> rajasekhar.
>>>
>>> On Mon, Sep 14, 2015 at 4:00 PM, Abhinandan Prateek <
>>> abhinandan.prat...@shapeblue.com> wrote:
>>>
>>>> Looks like the host is not instrumented properly and management server
>> is
>>>> unable to invoke plugin on the host.
>>>> Can you force-reconnect the host that is throwing this error ? That
>> should
>>>> recopy the plugins on to the host.
>>>>
>>>>> On 14-Sep-2015, at 3:15 pm, raja sekhar 
>> wrote:
>>>>>
>>>>> Hi All,
>>>>>
>>>>> I am using CS 4.3.1 and xenserver 6.2
>>>>> I have configured daily recurring snapshot policy for all the root
>>>> volumes.
>>>>> but recent three days onwards it is taking full snapshots and not
>> taking
>>>>> any child snapshots.
>>>>> I have configured snapshot.delta.max to 16.
>>>>> please help me my secondary storage is becoming full.
>>>>>
>>>>> The log file details shows:
>>>>>
>>>>> 2015-09-14 01:03:29,973 DEBUG [c.c.a.m.DirectAgentAttache]
>>>>> (DirectAgent-24:ctx-d68622c5) Seq 4-482873005: Response Received:
>>>>> 2015-09-14 01:03:29,973 DEBUG [c.c.a.m.ClusteredAgentManagerImpl]
>>>>> (DirectAgent-24:ctx-d68622c5) Seq 4-482873005: MgmtId 195780927071877:
>>>>> Resp: Routing to peer
>>>>> 2015-09-14 01:03:32,233 DEBUG [c.c.c.ConsoleProxyManagerImpl]
>>>>> (consoleproxy-1:ctx-b1db30de) Zone 1 is ready to launch console proxy
>>>>> 2015-09-14 01:03:32,334 DEBUG [c.c.s.s.SecondaryStorageManagerImpl]
>>>>> (secstorage-1:ctx-e024d41b) Zone 1 is ready to launch secondary storage
>>>> VM
>>>>> 2015-09-14 01:03:33,934 WARN  [c.c.u.n.Link]
>> (AgentManager-Selector:null)
>>>>> SSL: Fail to find the generated keystore. Loading fail-safe one to
>>>> continue.
>>>>> 2015-09-14 01:03:34,044 DEBUG [c.c.a.t.Request]
>>>>> (AgentManager-Handler-10:null) Seq 1-457572529: Executing:  { Cmd ,
>>>> MgmtId:
>>>>> 108371418365724, via: 1, Ver: v1, Flags: 100011,
>>>>>
>>>>
>> [{"org.apache.cloudstack.storage.command.CreateObjectCommand":{"data":{"org.apache.cloudstack.storage.to.SnapshotObjectTO":{"volume":{"uuid":"bcf7653a-33db-461a-9355-e5d518012679","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"165fb777-4225-326a-bc48-f5b465f9486b","id":1,"poolType":"NetworkFilesystem","host":"172.30.36.51","path":"/vS02304090GCSP_NAS05","port":2049,"url":"NetworkFilesystem://
>>>>>
>>>>
>> 172.30.36.51//vS02304090GCSP_NAS05/?ROLE=Primary&STOREUUID=165fb777-4225-326a-bc48-f5b465f948

Re: Recurring snapshot taking full every time

[Abhinandan Prateek]

Can you check in the SMlog on the concerned host if you see any error when the 
plugin is being invoked ?

> On 14-Sep-2015, at 5:01 pm, raja sekhar  wrote:
>
> Hi abhinandan,
>
> Thanks for your reply.
> We are facing the issue only for root volumes in that host. The snapshot
> recurring policy for data disks in same host is working fine.
> if the host configuration is not properly instrumented the policy for data
> disks also fails, but it is working fine.
> please suggest us.
>
> Note: The manual snapshots for root disk is working fine,and it is taking
> child when second manual is configured , problem only with root daily
> snapshots every day it is taking full instead of taking child snapshots
> throwing error "*Failed to get parent snapshot**, due to There was a
> failure communicating with the plugin*".
>
> Regards,
> rajasekhar.
>
> On Mon, Sep 14, 2015 at 4:00 PM, Abhinandan Prateek <
> abhinandan.prat...@shapeblue.com> wrote:
>
>> Looks like the host is not instrumented properly and management server is
>> unable to invoke plugin on the host.
>> Can you force-reconnect the host that is throwing this error ? That should
>> recopy the plugins on to the host.
>>
>>> On 14-Sep-2015, at 3:15 pm, raja sekhar  wrote:
>>>
>>> Hi All,
>>>
>>> I am using CS 4.3.1 and xenserver 6.2
>>> I have configured daily recurring snapshot policy for all the root
>> volumes.
>>> but recent three days onwards it is taking full snapshots and not taking
>>> any child snapshots.
>>> I have configured snapshot.delta.max to 16.
>>> please help me my secondary storage is becoming full.
>>>
>>> The log file details shows:
>>>
>>> 2015-09-14 01:03:29,973 DEBUG [c.c.a.m.DirectAgentAttache]
>>> (DirectAgent-24:ctx-d68622c5) Seq 4-482873005: Response Received:
>>> 2015-09-14 01:03:29,973 DEBUG [c.c.a.m.ClusteredAgentManagerImpl]
>>> (DirectAgent-24:ctx-d68622c5) Seq 4-482873005: MgmtId 195780927071877:
>>> Resp: Routing to peer
>>> 2015-09-14 01:03:32,233 DEBUG [c.c.c.ConsoleProxyManagerImpl]
>>> (consoleproxy-1:ctx-b1db30de) Zone 1 is ready to launch console proxy
>>> 2015-09-14 01:03:32,334 DEBUG [c.c.s.s.SecondaryStorageManagerImpl]
>>> (secstorage-1:ctx-e024d41b) Zone 1 is ready to launch secondary storage
>> VM
>>> 2015-09-14 01:03:33,934 WARN  [c.c.u.n.Link] (AgentManager-Selector:null)
>>> SSL: Fail to find the generated keystore. Loading fail-safe one to
>> continue.
>>> 2015-09-14 01:03:34,044 DEBUG [c.c.a.t.Request]
>>> (AgentManager-Handler-10:null) Seq 1-457572529: Executing:  { Cmd ,
>> MgmtId:
>>> 108371418365724, via: 1, Ver: v1, Flags: 100011,
>>>
>> [{"org.apache.cloudstack.storage.command.CreateObjectCommand":{"data":{"org.apache.cloudstack.storage.to.SnapshotObjectTO":{"volume":{"uuid":"bcf7653a-33db-461a-9355-e5d518012679","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"165fb777-4225-326a-bc48-f5b465f9486b","id":1,"poolType":"NetworkFilesystem","host":"172.30.36.51","path":"/vS02304090GCSP_NAS05","port":2049,"url":"NetworkFilesystem://
>>>
>> 172.30.36.51//vS02304090GCSP_NAS05/?ROLE=Primary&STOREUUID=165fb777-4225-326a-bc48-f5b465f9486b
>>>
>> "}},"name":"ROOT-189","size":85899345920,"path":"9deefbf6-86e6-4359-acb3-99e1aebcb359","volumeId":696,"vmName":"i-11-189-VM","accountId":11,"format":"VHD","id":696,"deviceId":0,"hypervisorType":"XenServer"},"parentSnapshotPath":"3a6e9e1a-fd95-4530-ae67-03a368b3e2fd","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"165fb777-4225-326a-bc48-f5b465f9486b","id":1,"poolType":"NetworkFilesystem","host":"172.30.36.51","path":"/vS02304090GCSP_NAS05","port":2049,"url":"NetworkFilesystem://
>>>
>> 172.30.36.51//vS02304090GCSP_NAS05/?ROLE=Primary&STOREUUID=165fb777-4225-326a-bc48-f5b465f9486b
>> "}},"vmName":"i-11-189-VM","name":"SAGXD02_ROOT-189_20150914090333","hypervisorType":"XenServer","id":6732,"q

Re: After box restart CS 4.5.2 fails to start

[Abhinandan Prateek]

This looks like a user privilege issue. Can you make sure that you are running 
cloudstack with enough privileges (sudo included).

> On 15-Sep-2015, at 8:24 pm, Keerthiraja SJ  wrote:
>
> Hi All,
>
> Today I installed CS 4.5.2 on CentOS 6.7 and able to start the app
> successfully.
>
> All of a sudden the box reboot then while I started the cloudsatck it fails
> to start where I could see a different issue and ERROR on catalina.out
>
> ERROR
> ==
> INFO  [c.c.s.ConfigurationServerImpl] (main:null) Processing
> updateSSLKeyStore
> INFO  [c.c.s.ConfigurationServerImpl] (main:null) SSL keystore located at
> /etc/cloudstack/management/cloudmanagementserver.keystore
> WARN  [c.c.s.ConfigurationServerImpl] (main:null) Would use fail-safe
> keystore to continue.
> java.io.IOException: Fail to create keystore file!
>at
> com.cloud.server.ConfigurationServerImpl.updateSSLKeystore(ConfigurationServerImpl.java:664)
>at
> com.cloud.server.ConfigurationServerImpl.persistDefaultValues(ConfigurationServerImpl.java:304)
>at
> com.cloud.server.ConfigurationServerImpl.configure(ConfigurationServerImpl.java:166)
>at
> org.apache.cloudstack.spring.lifecycle.CloudStackExtendedLifeCycle$3.with(CloudStackExtendedLifeCycle.java:114)
>at
> org.apache.cloudstack.spring.lifecycle.CloudStackExtendedLifeCycle.with(CloudStackExtendedLifeCycle.java:153)
>at
> org.apache.cloudstack.spring.lifecycle.CloudStackExtendedLifeCycle.configure(CloudStackExtendedLifeCycle.java:110)
>at
> org.apache.cloudstack.spring.lifecycle.CloudStackExtendedLifeCycle.start(CloudStackExtendedLifeCycle.java:56)
>at
> org.springframework.context.support.DefaultLifecycleProcessor.doStart(DefaultLifecycleProcessor.java:167)
>at
> org.springframework.context.support.DefaultLifecycleProcessor.access$200(DefaultLifecycleProcessor.java:51)
>at
> org.springframework.context.support.DefaultLifecycleProcessor$LifecycleGroup.start(DefaultLifecycleProcessor.java:339)
>at
> org.springframework.context.support.DefaultLifecycleProcessor.startBeans(DefaultLifecycleProcessor.java:143)
>at
> org.springframework.context.support.DefaultLifecycleProcessor.onRefresh(DefaultLifecycleProcessor.java:108)
>at
> org.springframework.context.support.AbstractApplicationContext.finishRefresh(AbstractApplicationContext.java:945)
>at
> org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:482)
>at
> org.apache.cloudstack.spring.module.model.impl.DefaultModuleDefinitionSet.loadContext(DefaultModuleDefinitionSet.java:145)
>at
> org.apache.cloudstack.spring.module.model.impl.DefaultModuleDefinitionSet$2.with(DefaultModuleDefinitionSet.java:122)
>at
> org.apache.cloudstack.spring.module.model.impl.DefaultModuleDefinitionSet.withModule(DefaultModuleDefinitionSet.java:245)
>at
> org.apache.cloudstack.spring.module.model.impl.DefaultModuleDefinitionSet.withModule(DefaultModuleDefinitionSet.java:250)
>at
> org.apache.cloudstack.spring.module.model.impl.DefaultModuleDefinitionSet.withModule(DefaultModuleDefinitionSet.java:250)
>at
> org.apache.cloudstack.spring.module.model.impl.DefaultModuleDefinitionSet.withModule(DefaultModuleDefinitionSet.java:233)
>at
> org.apache.cloudstack.spring.module.model.impl.DefaultModuleDefinitionSet.loadContexts(DefaultModuleDefinitionSet.java:117)
>at
> org.apache.cloudstack.spring.module.model.impl.DefaultModuleDefinitionSet.load(DefaultModuleDefinitionSet.java:79)
>at
> org.apache.cloudstack.spring.module.factory.ModuleBasedContextFactory.loadModules(ModuleBasedContextFactory.java:37)
>at
> org.apache.cloudstack.spring.module.factory.CloudStackSpringContext.init(CloudStackSpringContext.java:70)
>at
> org.apache.cloudstack.spring.module.factory.CloudStackSpringContext.(CloudStackSpringContext.java:57)
>at
> org.apache.cloudstack.spring.module.factory.CloudStackSpringContext.(CloudStackSpringContext.java:61)
>at
> org.apache.cloudstack.spring.module.web.CloudStackContextLoaderListener.contextInitialized(CloudStackContextLoaderListener.java:52)
>at
> org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:4210)
>at
> org.apache.catalina.core.StandardContext.start(StandardContext.java:4709)
>at
> org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:791)
>at
> org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:771)
>at org.apache.catalina.core.StandardHost.addChild(StandardHost.java:526)
>at
> org.apache.catalina.startup.HostConfig.deployDirectory(HostConfig.java:1041)
>at
> org.apache.catalina.startup.HostConfig.deployDirectories(HostConfig.java:964)
>at
> org.apache.catalina.startup.HostConfig.deployApps(HostConfig.java:502)
>at org.apache.catalina.startup.HostConfig.start(HostConfig.java:1277)
>at
> org.apache.catalina.startup.HostConfig.lifecycleEvent(HostConfig.java:321)
>at
> org.apache.catalina.util.Lifecycl

Re: Recurring snapshot taking full every time

[Abhinandan Prateek]

Looks like the host is not instrumented properly and management server is 
unable to invoke plugin on the host.
Can you force-reconnect the host that is throwing this error ? That should 
recopy the plugins on to the host.

> On 14-Sep-2015, at 3:15 pm, raja sekhar  wrote:
>
> Hi All,
>
> I am using CS 4.3.1 and xenserver 6.2
> I have configured daily recurring snapshot policy for all the root volumes.
> but recent three days onwards it is taking full snapshots and not taking
> any child snapshots.
> I have configured snapshot.delta.max to 16.
> please help me my secondary storage is becoming full.
>
> The log file details shows:
>
> 2015-09-14 01:03:29,973 DEBUG [c.c.a.m.DirectAgentAttache]
> (DirectAgent-24:ctx-d68622c5) Seq 4-482873005: Response Received:
> 2015-09-14 01:03:29,973 DEBUG [c.c.a.m.ClusteredAgentManagerImpl]
> (DirectAgent-24:ctx-d68622c5) Seq 4-482873005: MgmtId 195780927071877:
> Resp: Routing to peer
> 2015-09-14 01:03:32,233 DEBUG [c.c.c.ConsoleProxyManagerImpl]
> (consoleproxy-1:ctx-b1db30de) Zone 1 is ready to launch console proxy
> 2015-09-14 01:03:32,334 DEBUG [c.c.s.s.SecondaryStorageManagerImpl]
> (secstorage-1:ctx-e024d41b) Zone 1 is ready to launch secondary storage VM
> 2015-09-14 01:03:33,934 WARN  [c.c.u.n.Link] (AgentManager-Selector:null)
> SSL: Fail to find the generated keystore. Loading fail-safe one to continue.
> 2015-09-14 01:03:34,044 DEBUG [c.c.a.t.Request]
> (AgentManager-Handler-10:null) Seq 1-457572529: Executing:  { Cmd , MgmtId:
> 108371418365724, via: 1, Ver: v1, Flags: 100011,
> [{"org.apache.cloudstack.storage.command.CreateObjectCommand":{"data":{"org.apache.cloudstack.storage.to.SnapshotObjectTO":{"volume":{"uuid":"bcf7653a-33db-461a-9355-e5d518012679","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"165fb777-4225-326a-bc48-f5b465f9486b","id":1,"poolType":"NetworkFilesystem","host":"172.30.36.51","path":"/vS02304090GCSP_NAS05","port":2049,"url":"NetworkFilesystem://
> 172.30.36.51//vS02304090GCSP_NAS05/?ROLE=Primary&STOREUUID=165fb777-4225-326a-bc48-f5b465f9486b
> "}},"name":"ROOT-189","size":85899345920,"path":"9deefbf6-86e6-4359-acb3-99e1aebcb359","volumeId":696,"vmName":"i-11-189-VM","accountId":11,"format":"VHD","id":696,"deviceId":0,"hypervisorType":"XenServer"},"parentSnapshotPath":"3a6e9e1a-fd95-4530-ae67-03a368b3e2fd","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"165fb777-4225-326a-bc48-f5b465f9486b","id":1,"poolType":"NetworkFilesystem","host":"172.30.36.51","path":"/vS02304090GCSP_NAS05","port":2049,"url":"NetworkFilesystem://
> 172.30.36.51//vS02304090GCSP_NAS05/?ROLE=Primary&STOREUUID=165fb777-4225-326a-bc48-f5b465f9486b"}},"vmName":"i-11-189-VM","name":"SAGXD02_ROOT-189_20150914090333","hypervisorType":"XenServer","id":6732,"quiescevm":false,"parents":["3a6e9e1a-fd95-4530-ae67-03a368b3e2fd"],"physicalSize":0}},"wait":0}}]
> }
> 2015-09-14 01:03:34,045 DEBUG [c.c.a.m.DirectAgentAttache]
> (DirectAgent-333:ctx-c3e7c331) Seq 1-457572529: Executing request
> 2015-09-14 01:03:35,421 WARN  [c.c.h.x.r.CitrixResourceBase]
> (DirectAgent-333:ctx-c3e7c331) callHostPlugin failed for cmd: getVhdParent
> with args snapshotUuid: 3a6e9e1a-fd95-4530-ae67-03a368b3e2fd, isISCSI:
> false, primaryStorageSRUuid: a6a7f65a-a1d2-83e3-d3b0-f38792863fb6,  due to
> There was a failure communicating with the plugin.
> 2015-09-14 01:03:35,421 DEBUG [c.c.h.x.r.XenServerStorageProcessor]
> (DirectAgent-333:ctx-c3e7c331) Failed to get parent snapshot
> com.cloud.utils.exception.CloudRuntimeException: callHostPlugin failed for
> cmd: getVhdParent with args snapshotUuid:
> 3a6e9e1a-fd95-4530-ae67-03a368b3e2fd, isISCSI: false, primaryStorageSRUuid:
> a6a7f65a-a1d2-83e3-d3b0-f38792863fb6,  due to There was a failure
> communicating with the plugin.
>at
> com.cloud.hypervisor.xen.resource.CitrixResourceBase.callHostPlugin(CitrixResourceBase.java:4239)
>at
> com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.getVhdParent(XenServerStorageProcessor.java:879)
>at
> com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.createSnapshot(XenServerStorageProcessor.java:478)
>at
> com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(StorageSubsystemCommandHandlerBase.java:107)
>at
> com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStorageCommands(StorageSubsystemCommandHandlerBase.java:52)
>at
> com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:609)
> at
> com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:59)
>at
> com.cloud.hypervisor.xen.resource.XenServer610Resource.executeRequest(XenServer610Resource.java:106)
>at
> com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:216)
>at
> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:4

Re: Usage Job failed

[Abhinandan Prateek]

This support article may help:

http://support.citrix.com/article/CTX139043

> On 03-Sep-2015, at 5:16 pm, mvs babu  wrote:
>
> Hi All,
>
>
>
>
> We are getting usage job failed alert in CloudStack UI and found below error 
> message in usage.log,
>
>
>
>
> "ERROR [usage.dao.UsageVMInstanceDaoImpl] (Usage-Job-1:null) error saving 
> usage_network to cloud_usage db
> java.sql.BatchUpdateException: Duplicate entry '2-1-228-144117719' for 
> key 'PRIMARY'"
>
>
>
>
>
> We are using ACS4.3.1. on top of CentOS6.2.
>
>
>
>
> Please help to solve this issue.
>
>
>
>
> Thank you,
> Suneel Mallela

Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build
CSForge – rapid IaaS deployment framework
CloudStack Consulting
CloudStack Software 
Engineering
CloudStack Infrastructure 
Support
CloudStack Bootcamp Training Courses

This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England & Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue Ltd. Shape 
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company 
registered by The Republic of South Africa and is traded under license from 
Shape Blue Ltd. ShapeBlue is a registered trademark.

Re: How does the parameter startdate/enddate of api listEvents() use new time format like 'yyyy-MM-dd HH:mm:ss' ?

[Abhinandan Prateek]

Good catch Santhosh !
I had similar issue passing a space in ‘account name’.

> On 28-Aug-2015, at 2:51 pm, Santhosh Edukulla  
> wrote:
>
> Hi Cao,
>
> Inside "_sort_request" function mentioned at the wiki,  change the below
> line
>
> self.params.append(key + '=' + urllib.quote_plus(args[key]))
>
> to
>
> self.params.append( key + '=' + str.lower(urllib.quote_plus(args[key])).
> *replace(**"+", "%20") *)
>
> The time stamp parameter "2015-08-28 16:20:00" , you are passing has a
> space in it, which gets replaced with "+" through quote_plus logic, so
> replace that "+" with "%20", this is getting passed in calculating
> signature in later function.
>
> Similarly, change it for "_build_post_request" function.
>
> Let us know.
>
> Regards,
> Santhosh
>
> On Fri, Aug 28, 2015 at 6:40 PM,  wrote:
>
>>
>>
>> My scripts is just from cloudstack website
>>
>> https://cwiki.apache.org/confluence/display/CLOUDSTACK/Simple+class+for+making+API+calls%2C+Python
>>
>> and I just do some testing like this:
>>
>> 1. >>> from SignedAPICall import api
>> 2. >>> api.listEvents(listall='true', startdate='2015-08-28')
>> 3. >>> api.listEvents(listall='true', startdate='2015-08-28 16:20:00')
>>
>> Line 2 works fine, line 3 failed with error " 'http error', 401,
>> 'Unauthorized' ".
>>
>> I also do some other tests, they also works fine, like api.listHosts()
>> api.listVirtualMachines().
>>
>> when line 3 failed,  management-server.log said this:
>>
>> 2015-08-28 16:37:53,619 DEBUG [c.c.a.ApiServlet]
>> (catalina-exec-15:ctx-4e587804) ===START===  10.0.1.99 -- GET
>> apiKey=hjZ12EQ4JfFasIHO3RCXBLji-3RbBmdC973utGwCL5388WypVKwtaNsDso-JzVQIZXUVwfaT1vANdDUJs3Vkkg&command=listEvents&listall=true&response=json&startdate=2015-08-28+16%3A20%3A00&signature=r7wa861jYWP4QbNMeEjZZ2wNpIc%3D
>> 2015-08-28 16:37:53,622 INFO  [c.c.a.ApiServer]
>> (catalina-exec-15:ctx-4e587804 ctx-1f6fddbe) User signature:
>> r7wa861jYWP4QbNMeEjZZ2wNpIc= is not equaled to computed signature:
>> 4c8Kmn+cbMZAmfSvSISPkWt9WCQ=
>> 2015-08-28 16:37:53,622 DEBUG [c.c.a.ApiServlet]
>> (catalina-exec-15:ctx-4e587804 ctx-1f6fddbe) ===END===  10.0.1.99 -- GET
>> apiKey=hjZ12EQ4JfFasIHO3RCXBLji-3RbBmdC973utGwCL5388WypVKwtaNsDso-JzVQIZXUVwfaT1vANdDUJs3Vkkg&command=listEvents&listall=true&response=json&startdate=2015-08-28+16%3A20%3A00&signature=r7wa861jYWP4QbNMeEjZZ2wNpIc%3D
>>
>> following for line 2:
>> 2015-08-28 16:37:15,900 DEBUG [c.c.a.ApiServlet]
>> (catalina-exec-13:ctx-f8019189) ===START===  10.0.1.99 -- GET
>> apiKey=hjZ12EQ4JfFasIHO3RCXBLji-3RbBmdC973utGwCL5388WypVKwtaNsDso-JzVQIZXUVwfaT1vANdDUJs3Vkkg&command=listEvents&listall=true&response=json&startdate=2015-08-28&signature=KZZIAOaRduzCJlo0byaN9j4uvro%3D
>> 2015-08-28 16:37:15,939 DEBUG [c.c.a.ApiServlet]
>> (catalina-exec-13:ctx-f8019189 ctx-c42b8c5e ctx-1ebbe226) ===END===
>> 10.0.1.99 -- GET
>> apiKey=hjZ12EQ4JfFasIHO3RCXBLji-3RbBmdC973utGwCL5388WypVKwtaNsDso-JzVQIZXUVwfaT1vANdDUJs3Vkkg&command=listEvents&listall=true&response=json&startdate=2015-08-28&signature=KZZIAOaRduzCJlo0byaN9j4uvro%3D
>>
>>
>>
>> ---
>> Cao Tong
>>
>>
>> On 08/28/2015 02:09 PM, Abhinandan Prateek wrote:
>>
>>> apikey/signature should work and they have same privileges as the
>>> respective user logged in.
>>> Are all the api calls failing or just some ?
>>> Can you share relevant portion of the scripts that you are trying to run ?
>>>
>>> On 28-Aug-2015, at 11:31 am, tony_caot...@163.com wrote:
>>>>
>>>>
>>>> Thanks for all your people's replys.
>>>>
>>>> 1.  Abhinandan,  My ACS manager was not listening on port '8096',
>>>>
>>>> 2.  As Yipeng said, When I call this api from cloudmonkey, it works
>>>> fine, like this
>>>>" cloudmonkey api listEvents listall=true startdate='2015-08-28
>>>> 00:00:00' "
>>>>
>>>>When I call it through my python scripts, I used the
>>>> apikey/signature pair to work,  but it failed.
>>>>I found that how cloudmonkey works,
>>>>first it login with username/password, then call the function with
>>>> this session id.
>>>>
>>>> it seems tha

Re: How does the parameter startdate/enddate of api listEvents() use new time format like 'yyyy-MM-dd HH:mm:ss' ?

[Abhinandan Prateek]

apikey/signature should work and they have same privileges as the respective 
user logged in.
Are all the api calls failing or just some ?
Can you share relevant portion of the scripts that you are trying to run ?

> On 28-Aug-2015, at 11:31 am, tony_caot...@163.com wrote:
>
>
> Thanks for all your people's replys.
>
> 1.  Abhinandan,  My ACS manager was not listening on port '8096',
>
> 2.  As Yipeng said, When I call this api from cloudmonkey, it works fine, 
> like this
>" cloudmonkey api listEvents listall=true startdate='2015-08-28 00:00:00' "
>
>When I call it through my python scripts, I used the apikey/signature pair 
> to work,  but it failed.
>I found that how cloudmonkey works,
>first it login with username/password, then call the function with this 
> session id.
>
> it seems that the apikey/signature pair's privilege is not same with 
> username/password pair's ?
>
>
> @Daan, yes I am a Chinese. I am afraid it's not a preblem about character 
> encodings perhaps.
>
>
> ---
> Cao Tong
>
> On 08/27/2015 08:54 PM, Abhinandan Prateek wrote:
>> Try using the “8096” port for testing/checking APIs.
>>
>> shapeblue.com> wrote:
>>> Yes, as per  
>>> https://cloudstack.apache.org/api/apidocs-4.2/root_admin/listEvents.html
>>>
>>>
>>>> On 24-Aug-2015, at 2:08 pm, tony_caot...@163.com wrote:
>>>>
>>>> Hello Every.
>>>>
>>>> I know this is a very simple question to most of you. but it is really 
>>>> hard for me to continue my work.
>>>>
>>>> So could Anyone spend your three minutes to give me some advice, it will 
>>>> be very usefull to me.
>>>>
>>>> my question is:
>>>>
>>>>   How does the parameter startdate/enddate of api listEvents() use new 
>>>> time format  like '-MM-dd HH:mm:ss' ?
>>>>
>>>>
>>>>>>> Event({'listall':'True', 'startdate':'2015-08-24 00:00:00'})
>>>> http://10.0.1.100:8080/client/api?apiKey=hjZ12EQ4JfFasIHO3RCXBLji-3RbBmdC973utGwCL5388WypVKwtaNsDso-JzVQIZXUVwfaT1vANdDUJs3Vkkg&command=listEvents&listall=True&response=json&startdate=2015-08-24+00%3A00%3A00&signature=z4LQCw7yzGmTK5B7TzAbzl1biXI%3D
>>>> Traceback (most recent call last):
>>>> File "", line 1, in 
>>>> File "SignedAPICall.py", line 67, in Event
>>>>   a = api.listEvents(request)
>>>> File "SignedAPICall.py", line 49, in handlerFunction
>>>>   return self._make_request(name, args[0])
>>>> File "SignedAPICall.py", line 61, in _make_request
>>>>   data = self._http_get(self.value)
>>>> File "SignedAPICall.py", line 54, in _http_get
>>>>   response = urllib.urlopen(url)
>>>> File "/usr/lib64/python2.7/urllib.py", line 87, in urlopen
>>>>   return opener.open(url)
>>>> File "/usr/lib64/python2.7/urllib.py", line 208, in open
>>>>   return getattr(self, name)(url)
>>>> File "/usr/lib64/python2.7/urllib.py", line 359, in open_http
>>>>   return self.http_error(url, fp, errcode, errmsg, headers)
>>>> File "/usr/lib64/python2.7/urllib.py", line 372, in http_error
>>>>   result = method(url, fp, errcode, errmsg, headers)
>>>> File "/usr/lib64/python2.7/urllib.py", line 683, in http_error_401
>>>>   errcode, errmsg, headers)
>>>> File "/usr/lib64/python2.7/urllib.py", line 381, in http_error_default
>>>>   raise IOError, ('http error', errcode, errmsg, headers)
>>>> IOError: ('http error', 401, 'Unauthorized', >>> at 0x7f083da78998>)
>>>>
>>>> ---
>>>> Cao Tong
>>>>
>>>> On 08/19/2015 10:32 AM, tony_caot...@163.com wrote:
>>>>> Hi All:
>>>>>
>>>>>   Does any one have any idea ? Thanks.
>>>>>
>>>>> ---
>>>>> Cao Tong
>>>>>
>>>>> On 08/18/2015 06:04 PM, tony_caot...@163.com wrote:
>>>>>> In ParamProcessWorker::setFieldValue() I found this lins:
>>>>>>
>>>>>>  case DATE:
>>>>>>   // This piece of code is for maintaining backward 
>>>>>> compatibility
>>>>>>   // and support b

Re: How does the parameter startdate/enddate of api listEvents() use new time format like 'yyyy-MM-dd HH:mm:ss' ?

[Abhinandan Prateek]

Try using the “8096” port for testing/checking APIs.

shapeblue.com> wrote:
>
> Yes, as per  
> https://cloudstack.apache.org/api/apidocs-4.2/root_admin/listEvents.html
>
>
>> On 24-Aug-2015, at 2:08 pm, tony_caot...@163.com wrote:
>>
>> Hello Every.
>>
>> I know this is a very simple question to most of you. but it is really hard 
>> for me to continue my work.
>>
>> So could Anyone spend your three minutes to give me some advice, it will be 
>> very usefull to me.
>>
>> my question is:
>>
>>   How does the parameter startdate/enddate of api listEvents() use new time 
>> format  like '-MM-dd HH:mm:ss' ?
>>
>>
> Event({'listall':'True', 'startdate':'2015-08-24 00:00:00'})
>> http://10.0.1.100:8080/client/api?apiKey=hjZ12EQ4JfFasIHO3RCXBLji-3RbBmdC973utGwCL5388WypVKwtaNsDso-JzVQIZXUVwfaT1vANdDUJs3Vkkg&command=listEvents&listall=True&response=json&startdate=2015-08-24+00%3A00%3A00&signature=z4LQCw7yzGmTK5B7TzAbzl1biXI%3D
>> Traceback (most recent call last):
>> File "", line 1, in 
>> File "SignedAPICall.py", line 67, in Event
>>   a = api.listEvents(request)
>> File "SignedAPICall.py", line 49, in handlerFunction
>>   return self._make_request(name, args[0])
>> File "SignedAPICall.py", line 61, in _make_request
>>   data = self._http_get(self.value)
>> File "SignedAPICall.py", line 54, in _http_get
>>   response = urllib.urlopen(url)
>> File "/usr/lib64/python2.7/urllib.py", line 87, in urlopen
>>   return opener.open(url)
>> File "/usr/lib64/python2.7/urllib.py", line 208, in open
>>   return getattr(self, name)(url)
>> File "/usr/lib64/python2.7/urllib.py", line 359, in open_http
>>   return self.http_error(url, fp, errcode, errmsg, headers)
>> File "/usr/lib64/python2.7/urllib.py", line 372, in http_error
>>   result = method(url, fp, errcode, errmsg, headers)
>> File "/usr/lib64/python2.7/urllib.py", line 683, in http_error_401
>>   errcode, errmsg, headers)
>> File "/usr/lib64/python2.7/urllib.py", line 381, in http_error_default
>>   raise IOError, ('http error', errcode, errmsg, headers)
>> IOError: ('http error', 401, 'Unauthorized', > at 0x7f083da78998>)
>>
>> ---
>> Cao Tong
>>
>> On 08/19/2015 10:32 AM, tony_caot...@163.com wrote:
>>>
>>> Hi All:
>>>
>>>   Does any one have any idea ? Thanks.
>>>
>>> ---
>>> Cao Tong
>>>
>>> On 08/18/2015 06:04 PM, tony_caot...@163.com wrote:

 In ParamProcessWorker::setFieldValue() I found this lins:

  case DATE:
   // This piece of code is for maintaining backward 
 compatibility
   // and support both the date formats(Bug 9724)

 Is it related to my problem?  Where can I found the descriptions about 
 BUG9724 ?

 ---
 Cao Tong

 On 08/18/2015 05:54 PM, tony_caot...@163.com wrote:
>
> Hello,
>
> When I use timestamp format startdate="2015-07-31", it works find.
> When I use it like this startdate="2015-07-31 13:00:00".
> It return a error
> IOError: ('http error', 401, 'Unauthorized',  instance at 0x16dca70>)
>
> Could anyone tell me why ?
>
> I have read the code "DefaultLoginAPIAuthenticatorCmd::authenticate()" , 
> but I am still not understand what was happening,
> it seems authenticate failed, but why??
>
> ---
> Cao Tong
>
> On 07/31/2015 07:07 PM, tony_caot...@163.com wrote:
>>
>> Hi,
>>
>>   was this format is enabled in ACS 4.5.1 like /"-MM-dd HH:mm:ss"
>>
>>
>> /I found it in 4.5.0 API doc, but it seems not enabled.
>>
>> http://cloudstack.apache.org/api/apidocs-4.5/user/listEvents.html
>>
> api.listEvents(startdate="2015-07-31 13:00:00")
>> Traceback (most recent call last):
>> File "", line 1, in 
>> File "call.py", line 48, in handlerFunction
>>   return self._make_request(name, kwargs)
>> File "call.py", line 60, in _make_request
>>   data = self._http_get(self.value)
>> File "call.py", line 53, in _http_get
>>   response = urllib.urlopen(url)
>> File "/usr/lib64/python2.7/urllib.py", line 87, in urlopen
>>   return opener.open(url)
>> File "/usr/lib64/python2.7/urllib.py", line 208, in open
>>   return getattr(self, name)(url)
>> File "/usr/lib64/python2.7/urllib.py", line 359, in open_http
>>   return self.http_error(url, fp, errcode, errmsg, headers)
>> File "/usr/lib64/python2.7/urllib.py", line 372, in http_error
>>   result = method(url, fp, errcode, errmsg, headers)
>> File "/usr/lib64/python2.7/urllib.py", line 683, in http_error_401
>>   errcode, errmsg, headers)
>> File "/usr/lib64/python2.7/urllib.py", line 381, in http_error_default
>>   raise IOError, ('http error', errcode, errmsg, headers)
>> IOError: ('http error', 401, 'Unauthorized', > instance at 0x16dca70>)
>
>>
>>
>> my ACS version:
>>
>> [root@cs ~]# rpm -qa |grep cloud
>> cloudstack-management-4.5

Re: How does the parameter startdate/enddate of api listEvents() use new time format like 'yyyy-MM-dd HH:mm:ss' ?

[Abhinandan Prateek]

Yes, as per  
https://cloudstack.apache.org/api/apidocs-4.2/root_admin/listEvents.html


> On 24-Aug-2015, at 2:08 pm, tony_caot...@163.com wrote:
>
> Hello Every.
>
> I know this is a very simple question to most of you. but it is really hard 
> for me to continue my work.
>
> So could Anyone spend your three minutes to give me some advice, it will be 
> very usefull to me.
>
> my question is:
>
>How does the parameter startdate/enddate of api listEvents() use new time 
> format  like '-MM-dd HH:mm:ss' ?
>
>
> >>> Event({'listall':'True', 'startdate':'2015-08-24 00:00:00'})
> http://10.0.1.100:8080/client/api?apiKey=hjZ12EQ4JfFasIHO3RCXBLji-3RbBmdC973utGwCL5388WypVKwtaNsDso-JzVQIZXUVwfaT1vANdDUJs3Vkkg&command=listEvents&listall=True&response=json&startdate=2015-08-24+00%3A00%3A00&signature=z4LQCw7yzGmTK5B7TzAbzl1biXI%3D
> Traceback (most recent call last):
>  File "", line 1, in 
>  File "SignedAPICall.py", line 67, in Event
>a = api.listEvents(request)
>  File "SignedAPICall.py", line 49, in handlerFunction
>return self._make_request(name, args[0])
>  File "SignedAPICall.py", line 61, in _make_request
>data = self._http_get(self.value)
>  File "SignedAPICall.py", line 54, in _http_get
>response = urllib.urlopen(url)
>  File "/usr/lib64/python2.7/urllib.py", line 87, in urlopen
>return opener.open(url)
>  File "/usr/lib64/python2.7/urllib.py", line 208, in open
>return getattr(self, name)(url)
>  File "/usr/lib64/python2.7/urllib.py", line 359, in open_http
>return self.http_error(url, fp, errcode, errmsg, headers)
>  File "/usr/lib64/python2.7/urllib.py", line 372, in http_error
>result = method(url, fp, errcode, errmsg, headers)
>  File "/usr/lib64/python2.7/urllib.py", line 683, in http_error_401
>errcode, errmsg, headers)
>  File "/usr/lib64/python2.7/urllib.py", line 381, in http_error_default
>raise IOError, ('http error', errcode, errmsg, headers)
> IOError: ('http error', 401, 'Unauthorized',  0x7f083da78998>)
>
> ---
> Cao Tong
>
> On 08/19/2015 10:32 AM, tony_caot...@163.com wrote:
>>
>> Hi All:
>>
>>Does any one have any idea ? Thanks.
>>
>> ---
>> Cao Tong
>>
>> On 08/18/2015 06:04 PM, tony_caot...@163.com wrote:
>>>
>>> In ParamProcessWorker::setFieldValue() I found this lins:
>>>
>>>   case DATE:
>>>// This piece of code is for maintaining backward 
>>> compatibility
>>>// and support both the date formats(Bug 9724)
>>>
>>> Is it related to my problem?  Where can I found the descriptions about 
>>> BUG9724 ?
>>>
>>> ---
>>> Cao Tong
>>>
>>> On 08/18/2015 05:54 PM, tony_caot...@163.com wrote:

 Hello,

 When I use timestamp format startdate="2015-07-31", it works find.
 When I use it like this startdate="2015-07-31 13:00:00".
 It return a error
 IOError: ('http error', 401, 'Unauthorized', >>> at 0x16dca70>)

 Could anyone tell me why ?

 I have read the code "DefaultLoginAPIAuthenticatorCmd::authenticate()" , 
 but I am still not understand what was happening,
 it seems authenticate failed, but why??

 ---
 Cao Tong

 On 07/31/2015 07:07 PM, tony_caot...@163.com wrote:
>
> Hi,
>
>was this format is enabled in ACS 4.5.1 like /"-MM-dd HH:mm:ss"
>
>
> /I found it in 4.5.0 API doc, but it seems not enabled.
>
> http://cloudstack.apache.org/api/apidocs-4.5/user/listEvents.html
>
>>>> api.listEvents(startdate="2015-07-31 13:00:00")
> Traceback (most recent call last):
>  File "", line 1, in 
>  File "call.py", line 48, in handlerFunction
>return self._make_request(name, kwargs)
>  File "call.py", line 60, in _make_request
>data = self._http_get(self.value)
>  File "call.py", line 53, in _http_get
>response = urllib.urlopen(url)
>  File "/usr/lib64/python2.7/urllib.py", line 87, in urlopen
>return opener.open(url)
>  File "/usr/lib64/python2.7/urllib.py", line 208, in open
>return getattr(self, name)(url)
>  File "/usr/lib64/python2.7/urllib.py", line 359, in open_http
>return self.http_error(url, fp, errcode, errmsg, headers)
>  File "/usr/lib64/python2.7/urllib.py", line 372, in http_error
>result = method(url, fp, errcode, errmsg, headers)
>  File "/usr/lib64/python2.7/urllib.py", line 683, in http_error_401
>errcode, errmsg, headers)
>  File "/usr/lib64/python2.7/urllib.py", line 381, in http_error_default
>raise IOError, ('http error', errcode, errmsg, headers)
> IOError: ('http error', 401, 'Unauthorized',  instance at 0x16dca70>)
> >>>
>
>
> my ACS version:
>
> [root@cs ~]# rpm -qa |grep cloud
> cloudstack-management-4.5.1-shapeblue0.el6.x86_64
> cloudstack-awsapi-4.5.1-shapeblue0.el6.x86_64
> cloudstack-agent-4.5.1-shapeblue0.el6.x86_64
> cloudstack-common-4.5.1-shapeblue0.el6.x

Re: Problems with first steps of CS plugin development

[Abhinandan Prateek]

The document is bit outdated, you need to do following three things:

1. You need to add the new cmd in ManagementServerImpl.getCommands() or your 
impl of pluggable service as:

2. Then you need to tell spring that the above is a bean and exists "”
This should be in “-context.xml” inside resources folder of your 
plugin.

3. You need to add your command in command.properties.in with proper access 
flag.

-abhi


> On 20-Aug-2015, at 5:47 pm, Giebner, Sascha  
> wrote:
>
> Hello guys,
>
> I'm trying to complete this tutorial for the development of a Cloudstack API 
> plugin:
> https://cwiki.apache.org/confluence/display/CLOUDSTACK/CloudStack+API+Development
>
> I checked out the latest version from the cloudstack master and followed the 
> tutorial to the letter, however when I try to call the API, I always get the 
> following JSON response:
>
> {"errorresponse":{"uuidList":[],"errorcode":432,"cserrorcode":,"errortext":"Unknown
>  API command: getTimeOfDay"}}
>
> I've been digging around in the cloudstack code, unfortunately with no 
> success until now. Everything compiles fine, so I suspect there may be 
> something wrong with the maven configuration. However since this is my first 
> time using maven, I'm a bit overwhelmed.
> Do you have some hints for me?
>
> Thanks and best regards,
> Sascha Giebner
>
> --
> This email was Virus checked by UTM 9. http://www.sophos.com

Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build
CSForge – rapid IaaS deployment framework
CloudStack Consulting
CloudStack Software 
Engineering
CloudStack Infrastructure 
Support
CloudStack Bootcamp Training Courses

This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England & Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue Ltd. Shape 
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company 
registered by The Republic of South Africa and is traded under license from 
Shape Blue Ltd. ShapeBlue is a registered trademark.

Re: marvin

[Abhinandan Prateek]

Thanks Santhosh !

> On 14-Aug-2015, at 8:35 pm, Santhosh Edukulla  
> wrote:
>
> 1, If you have run cloudstack build with required profile, post that go to
> tools/marvin directory and run "python setup.py install", this
> should install marvin on your machine.
>
> 2, If we want to create tar.gz file and copy it on to another machine, just
> run python setup.py sdist, under  tools/marvin, and it will create
> tar.gz file under dist/ directory. Then, you can install through normal pip
> install
>
> Note : Before that, just verify whether all relevant API cmd  files(py
> files) are created under /tools/marvin/marvin/cloudstackAPI/
>
>
> Santhosh
>
> On Fri, Aug 14, 2015 at 11:56 PM, Abhinandan Prateek <
> abhinandan.prat...@shapeblue.com> wrote:
>
>> Getting following errors on building marvin, although the target is
>> successful, there is no tools/marvin/dist/Marvin-*.tar.gz created !:
>>
>> (mvn -P developer -pl :cloud-marvin)
>>
>>
>>
>> [INFO] --- maven-install-plugin:2.3.1:install (default-install) @
>> cloud-marvin ---
>> [INFO] Installing /mnt/hgfs/cloudstack_shapeblue/tools/marvin/pom.xml to
>> /root/.m2/repository/org/apache/cloudstack/cloud-marvin/4.6.0-SNAPSHOT/cloud-marvin-4.6.0-SNAPSHOT.pom
>> [INFO]
>> [INFO] --- exec-maven-plugin:1.2.1:exec (install) @ cloud-marvin ---
>> /usr/local/lib/python2.7/site-packages/setuptools-18.1-py2.7.egg/setuptools/dist.py:294:
>> UserWarning: The version specified ('4.6.0-SNAPSHOT') is an invalid
>> version, this may not work as expected with newer versions of setuptools,
>> pip, and PyPI. Please see PEP 440 for more details.
>> running sdist
>> running egg_info
>> writing requirements to Marvin.egg-info/requires.txt
>> writing Marvin.egg-info/PKG-INFO
>> writing top-level names to Marvin.egg-info/top_level.txt
>> writing dependency_links to Marvin.egg-info/dependency_links.txt
>> writing entry points to Marvin.egg-info/entry_points.txt
>> reading manifest file 'Marvin.egg-info/SOURCES.txt'
>> reading manifest template 'MANIFEST.in'
>> warning: no files found matching '*.txt' under directory 'docs'
>> writing manifest file 'Marvin.egg-info/SOURCES.txt'
>> warning: sdist: standard file not found: should have one of README,
>> README.rst, README.txt
>>
>> running check
>> making hard links in Marvin-4.6.0-SNAPSHOT...
>> hard linking CHANGES.txt -> Marvin-4.6.0-SNAPSHOT
>> error: [Errno 1] Operation not permitted
>> [INFO]
>> 
>> [INFO] BUILD SUCCESS
>> [INFO]
>> 
>> [INFO] Total time: 8.659 s
>> [INFO] Finished at: 2015-08-14T19:22:26+05:30
>> [INFO] Final Memory: 53M/241M
>>
>>
>>
>> Find out more about ShapeBlue and our range of CloudStack related services
>>
>> IaaS Cloud Design & Build<
>> http://shapeblue.com/iaas-cloud-design-and-build//>
>> CSForge - rapid IaaS deployment framework<http://shapeblue.com/csforge/>
>> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
>> CloudStack Software Engineering<
>> http://shapeblue.com/cloudstack-software-engineering/>
>> CloudStack Infrastructure Support<
>> http://shapeblue.com/cloudstack-infrastructure-support/>
>> CloudStack Bootcamp Training Courses<
>> http://shapeblue.com/cloudstack-training/>
>>
>> This email and any attachments to it may be confidential and are intended
>> solely for the use of the individual to whom it is addressed. Any views or
>> opinions expressed are solely those of the author and do not necessarily
>> represent those of Shape Blue Ltd or related companies. If you are not the
>> intended recipient of this email, you must neither take any action based
>> upon its contents, nor copy or show it to anyone. Please contact the sender
>> if you believe you have received this email in error. Shape Blue Ltd is a
>> company incorporated in England & Wales. ShapeBlue Services India LLP is a
>> company incorporated in India and is operated under license from Shape Blue
>> Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil
>> and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is
>> a company registered by The Republic of South Africa and is traded under
>> license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>>

Find out more about ShapeBlue and our range of CloudStack

Re: [GitHub] cloudstack pull request: Quota master

[Abhinandan Prateek]

Kishan,

  With your familiarity with usage, I think it makes sense to review this 
plugin.

Regards,
-abhi

> On 13-Aug-2015, at 6:29 pm, DaanHoogland  wrote:
>
> Github user DaanHoogland commented on the pull request:
>
>https://github.com/apache/cloudstack/pull/689#issuecomment-130661556
>
>@bhaisaab well it looks promising.
>
>
> ---
> If your project is set up for it, you can reply to this email and have your
> reply appear on GitHub as well. If your project does not have this feature
> enabled and wishes so, or if the feature is enabled but not working, please
> contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
> with INFRA.
> ---

Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build
CSForge – rapid IaaS deployment framework
CloudStack Consulting
CloudStack Software 
Engineering
CloudStack Infrastructure 
Support
CloudStack Bootcamp Training Courses

This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England & Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue Ltd. Shape 
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company 
registered by The Republic of South Africa and is traded under license from 
Shape Blue Ltd. ShapeBlue is a registered trademark.

marvin

[Abhinandan Prateek]

Getting following errors on building marvin, although the target is successful, 
there is no tools/marvin/dist/Marvin-*.tar.gz created !:

 (mvn -P developer -pl :cloud-marvin)



[INFO] --- maven-install-plugin:2.3.1:install (default-install) @ cloud-marvin 
---
[INFO] Installing /mnt/hgfs/cloudstack_shapeblue/tools/marvin/pom.xml to 
/root/.m2/repository/org/apache/cloudstack/cloud-marvin/4.6.0-SNAPSHOT/cloud-marvin-4.6.0-SNAPSHOT.pom
[INFO]
[INFO] --- exec-maven-plugin:1.2.1:exec (install) @ cloud-marvin ---
/usr/local/lib/python2.7/site-packages/setuptools-18.1-py2.7.egg/setuptools/dist.py:294:
 UserWarning: The version specified ('4.6.0-SNAPSHOT') is an invalid version, 
this may not work as expected with newer versions of setuptools, pip, and PyPI. 
Please see PEP 440 for more details.
running sdist
running egg_info
writing requirements to Marvin.egg-info/requires.txt
writing Marvin.egg-info/PKG-INFO
writing top-level names to Marvin.egg-info/top_level.txt
writing dependency_links to Marvin.egg-info/dependency_links.txt
writing entry points to Marvin.egg-info/entry_points.txt
reading manifest file 'Marvin.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
warning: no files found matching '*.txt' under directory 'docs'
writing manifest file 'Marvin.egg-info/SOURCES.txt'
warning: sdist: standard file not found: should have one of README, README.rst, 
README.txt

running check
making hard links in Marvin-4.6.0-SNAPSHOT...
hard linking CHANGES.txt -> Marvin-4.6.0-SNAPSHOT
error: [Errno 1] Operation not permitted
[INFO] 
[INFO] BUILD SUCCESS
[INFO] 
[INFO] Total time: 8.659 s
[INFO] Finished at: 2015-08-14T19:22:26+05:30
[INFO] Final Memory: 53M/241M



Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build
CSForge - rapid IaaS deployment framework
CloudStack Consulting
CloudStack Software 
Engineering
CloudStack Infrastructure 
Support
CloudStack Bootcamp Training Courses

This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England & Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue Ltd. Shape 
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company 
registered by The Republic of South Africa and is traded under license from 
Shape Blue Ltd. ShapeBlue is a registered trademark.

Re: [ANNOUNCE] Karen Voung as a new PMC member of CloudStack

[Abhinandan Prateek]

Congrats Karen !

> On 02-Jul-2015, at 11:45 pm, John Burwell  wrote:
>
> All,
>
> The Project Management Committee (PMC) for Apache CloudStack are pleased to 
> announce that Karen Voung (karenv) has accepted our invitation to join the 
> PMC.
>
> Please join me in congratulating her.
>
> On behalf of the Apache CloudStack PMC,
> -John Burwell
>
> ---
> John Burwell (@john_burwell)
> VP of Software Engineering, ShapeBlue
> (571) 403-2411 | +44 20 3603 0542
> http://www.shapeblue.com
>
>
>
> Find out more about ShapeBlue and our range of CloudStack related services
>
> IaaS Cloud Design & Build
> CSForge - rapid IaaS deployment framework
> CloudStack Consulting
> CloudStack Software 
> Engineering
> CloudStack Infrastructure 
> Support
> CloudStack Bootcamp Training 
> Courses
>
> This email and any attachments to it may be confidential and are intended 
> solely for the use of the individual to whom it is addressed. Any views or 
> opinions expressed are solely those of the author and do not necessarily 
> represent those of Shape Blue Ltd or related companies. If you are not the 
> intended recipient of this email, you must neither take any action based upon 
> its contents, nor copy or show it to anyone. Please contact the sender if you 
> believe you have received this email in error. Shape Blue Ltd is a company 
> incorporated in England & Wales. ShapeBlue Services India LLP is a company 
> incorporated in India and is operated under license from Shape Blue Ltd. 
> Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
> operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company 
> registered by The Republic of South Africa and is traded under license from 
> Shape Blue Ltd. ShapeBlue is a registered trademark.

Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build
CSForge – rapid IaaS deployment framework
CloudStack Consulting
CloudStack Software 
Engineering
CloudStack Infrastructure 
Support
CloudStack Bootcamp Training Courses

This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England & Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue Ltd. Shape 
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company 
registered by The Republic of South Africa and is traded under license from 
Shape Blue Ltd. ShapeBlue is a registered trademark.

Re: [PROPOSAL] Quota management service for cloudstack

[Abhinandan Prateek]

> On 02-Jul-2015, at 9:51 am, Koushik Das  wrote:
>
>
> On 01-Jul-2015, at 4:44 PM, Rohit Yadav  wrote:
>
>>
>>> On 01-Jul-2015, at 12:31 pm, Koushik Das  wrote:
>>>
>>> I like the concept of quota. But I am thinking whether this should be a 
>>> core part of CS or developed as a plugin.
>>
>> It will be a separate plugin, not part of the core CS though we may need to 
>> refactor the core to allow configurability of features in the plugin.
>
> Please update the FS with the plugin interface and its interaction with the 
> other components once it is finalized.
>
Updated:

The main quota plugin will be a DB plugin interacting with usage tables mainly 
and usage server. There will be a UI plugin too, to customise, to manage 
quotas, to generate reports and to customise email templates.
A new account state will be introduced to represent that the account has run 
out of the quota. If more granular control is required on resource changing 
APIs then we will need some kind of classification (annotation) to make the 
APIs as resource acquiring, resource releasing or query only. At this point we 
are not planning for such fine grained control but just to mark the account 
state as "no quota credit" if an account runs out of quota and quota service is 
enabled.


>>
>>> Cloud coins example given below may be a plugin, based on which decision to 
>>> allow/disallow operation is made. Another plugin could be to allow/disallow 
>>> operations based on VM count or say the current storage used in bytes. 
>>> There should be flexibility to put in a condition of choice by the 
>>> developer/user. If there are multiple such plugins, an option should be 
>>> provided to decide the ordering of the plugins (similar to the various host 
>>> investigators that are available).
>>
>> Regards,
>> Rohit Yadav
>> Software Architect, ShapeBlue
>> M. +91 88 262 30892 | rohit.ya...@shapeblue.com
>> Blog: bhaisaab.org | Twitter: @_bhaisaab
>>
>>
>>
>> Find out more about ShapeBlue and our range of CloudStack related services
>>
>> IaaS Cloud Design & Build
>> CSForge – rapid IaaS deployment framework
>> CloudStack Consulting
>> CloudStack Software 
>> Engineering
>> CloudStack Infrastructure 
>> Support
>> CloudStack Bootcamp Training 
>> Courses
>>
>> This email and any attachments to it may be confidential and are intended 
>> solely for the use of the individual to whom it is addressed. Any views or 
>> opinions expressed are solely those of the author and do not necessarily 
>> represent those of Shape Blue Ltd or related companies. If you are not the 
>> intended recipient of this email, you must neither take any action based 
>> upon its contents, nor copy or show it to anyone. Please contact the sender 
>> if you believe you have received this email in error. Shape Blue Ltd is a 
>> company incorporated in England & Wales. ShapeBlue Services India LLP is a 
>> company incorporated in India and is operated under license from Shape Blue 
>> Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil 
>> and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a 
>> company registered by The Republic of South Africa and is traded under 
>> license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>

Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build
CSForge – rapid IaaS deployment framework
CloudStack Consulting
CloudStack Software 
Engineering
CloudStack Infrastructure 
Support
CloudStack Bootcamp Training Courses

This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England & Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue Ltd. Shape 
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company 
registered by The Republic of South Afri

Re: Fairly serious system VM template issue.

[Abhinandan Prateek]

Hi Todd,

  This errors pop up once in a while, probably there are some templates that 
are bad. It will be nice to also note the source of the templates so that they 
are fixed or removed.
This is one place from where I pick up the templates to test 
http://packages.shapeblue.com/systemvmtemplate/4.5/

-abhi

> On 03-Jul-2015, at 6:24 pm, Todd Hebert  wrote:
>
> Hello all,
>
> One of my co-workers and I just installed a Cloudstack 4.5 system.   All 
> seemed well until we started trying to import templates from another system 
> we manage.
>
> The SSVM downloads the image, then check it using the "vhd-util" utility from 
> XenServer.
>
> The error generated is "/bin/vhd-util no such file" or something along those 
> lines.   This failure to check the VHD files causes the template imports to 
> fail.
>
> This is apparently is caused by vhd-util being a 32-bit binary, linked to 
> 32-bit libs, and there being no 32-bit libs present on the SSVM image.
>
> Using advice from this article: 
> https://github.com/apache/cloudstack/commit/9d8a62d0ee379bf8b67405944c86f68587245db6
>
> we were able to get the system importing templates alright, but this isn't a 
> permanent fix of the system VM template.. if we ever change our SSVM, we lose 
> the modifications.
>
> I'm loathe to modify the SSVM template in the system myself, as I don't have 
> the facilities to test if this change would break other functions such as 
> VR's etc..
>
> If whomever deals with such things could create a new system VM template that 
> contains the libs, or uses a statically-linked vhd-util executable, and let 
> the list know where to get it & how to replace the existing system VM, that 
> would be grand.
>
> Thanks!   :)
>
>
> Todd Hebert
> Hosting engineer
>
> E: theb...@digiweb.ie
> A: College Business & Technology Park, Blanchardstown, Dublin 15, Ireland
> W: http://www.digiweb.ie/
>
>
>
>

Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build
CSForge – rapid IaaS deployment framework
CloudStack Consulting
CloudStack Software 
Engineering
CloudStack Infrastructure 
Support
CloudStack Bootcamp Training Courses

This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England & Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue Ltd. Shape 
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company 
registered by The Republic of South Africa and is traded under license from 
Shape Blue Ltd. ShapeBlue is a registered trademark.

Re: [PROPOSAL] Quota management service for cloudstack

[Abhinandan Prateek]

> On 01-Jul-2015, at 2:20 pm, sebgoa  wrote:
>
>
> On Jun 26, 2015, at 1:32 PM, Abhinandan Prateek 
>  wrote:
>
>> Team,
>>
>>  Would like to enhance usage server to provide quota management service to 
>> cloudstack.
>> This will provide better control on resource usage; and a common 
>> denomination to measure resource usage.
>> This will be an optional service that can be enabled or disabled as required 
>> by the operator.
>>
>> The detailed discussion is in functional specs here [2]. The corresponding 
>> jira ticket is [1].
>>
>> Please vote so that a decision to include it or not can be taken.
>>
>> [1] https://issues.apache.org/jira/browse/CLOUDSTACK-8592
>> [2] https://cwiki.apache.org/confluence/display/CLOUDSTACK/Quota+Service+-+FS
>>
>
> Can you add this to the roadmap wiki page…
>

Yes, added in the roadmap.

-abhi


Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
CloudStack Software 
Engineering<http://shapeblue.com/cloudstack-software-engineering/>
CloudStack Infrastructure 
Support<http://shapeblue.com/cloudstack-infrastructure-support/>
CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>

This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England & Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue Ltd. Shape 
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company 
registered by The Republic of South Africa and is traded under license from 
Shape Blue Ltd. ShapeBlue is a registered trademark.

[PROPOSAL] Quota management service for cloudstack

[Abhinandan Prateek]

Team,

   Would like to enhance usage server to provide quota management service to 
cloudstack.
This will provide better control on resource usage; and a common denomination 
to measure resource usage.
This will be an optional service that can be enabled or disabled as required by 
the operator.

The detailed discussion is in functional specs here [2]. The corresponding jira 
ticket is [1].

Please vote so that a decision to include it or not can be taken.

[1] https://issues.apache.org/jira/browse/CLOUDSTACK-8592
[2] https://cwiki.apache.org/confluence/display/CLOUDSTACK/Quota+Service+-+FS


Regards,
-abhi
Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build
CSForge - rapid IaaS deployment framework
CloudStack Consulting
CloudStack Software 
Engineering
CloudStack Infrastructure 
Support
CloudStack Bootcamp Training Courses

This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England & Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue Ltd. Shape 
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company 
registered by The Republic of South Africa and is traded under license from 
Shape Blue Ltd. ShapeBlue is a registered trademark.

Re: [ANNOUNCE] New PMC member: Bruno Demion aka Milamber

[Abhinandan Prateek]

Congrats Milamber !

> On 08-Jun-2015, at 4:08 pm, Sebastien Goasguen  wrote:
>
> The Project Management Committee (PMC) for Apache CloudStack is pleased to
> announce that Bruno Demion has accepted our invitation to join the PMC.
>
> Please join me in congratulating him.
>
> On behalf of the Apache CloudStack PMC
> --
> Sebastien

Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build
CSForge – rapid IaaS deployment framework
CloudStack Consulting
CloudStack Software 
Engineering
CloudStack Infrastructure 
Support
CloudStack Bootcamp Training Courses

This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England & Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue Ltd. Shape 
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company 
registered by The Republic of South Africa and is traded under license from 
Shape Blue Ltd. ShapeBlue is a registered trademark.

Re: Travis-ci test cases getting timed out

[Abhinandan Prateek]

They run once in 6 times (or 7 times, it is configurable).
This is to make an average travis run fast, but still be able to run the full 
test once in a while.
I think we should be increasing the number of such additional tests, but 
probably not run them overtime.

On 11-Jun-2015, at 3:04 pm, Rajani Karuturi 
mailto:raj...@apache.org>> wrote:

Hi Abhi,
The last four jobs always complete within secs and doesnt run anyof the tests 
listed for those jobs. If they are not required, can you please remove them?

~Rajani

On Thu, Jun 11, 2015 at 12:10 PM, Abhinandan Prateek 
mailto:abhinandan.prat...@shapeblue.com>> 
wrote:
It appears travis timed out even before hitting any testing.

“"
Installing some python packages:
/home/travis/build.sh: line 108:  2310 Terminated  travis_jigger $! 
$timeout $cmd
install
1262.91s$ ./tools/travis/install.sh
“”

Could be because of a transient issue. If it persists someone who owns the 
infra needs to take a look.

-abhi

> On 11-Jun-2015, at 9:47 am, Jayapal Reddy Uradi 
> mailto:jayapalreddy.ur...@citrix.com>> wrote:
>
> Hi,
>
> There are test case failures due to timeout, below is the message.
> 'Your test run exceeded 50 minutes. '
>
> travis-ci job info.
> https://travis-ci.org/jayapalu/cloudstack/builds/66205220
>
> Can some one look at travis-ci.
>
> Thanks,
> Jayapal

Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
CloudStack Software 
Engineering<http://shapeblue.com/cloudstack-software-engineering/>
CloudStack Infrastructure 
Support<http://shapeblue.com/cloudstack-infrastructure-support/>
CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>

This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England & Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue Ltd. Shape 
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company 
registered by The Republic of South Africa and is traded under license from 
Shape Blue Ltd. ShapeBlue is a registered trademark.


Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
CloudStack Software 
Engineering<http://shapeblue.com/cloudstack-software-engineering/>
CloudStack Infrastructure 
Support<http://shapeblue.com/cloudstack-infrastructure-support/>
CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>

This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England & Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue Ltd. Shape 
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company 
registered by The Republic of South Africa and is traded under license from 
Shape Blue Ltd. ShapeBlue is a registered trademark.

Re: Travis-ci test cases getting timed out

[Abhinandan Prateek]

It appears travis timed out even before hitting any testing.

“"
Installing some python packages:
/home/travis/build.sh: line 108:  2310 Terminated  travis_jigger $! 
$timeout $cmd
install
1262.91s$ ./tools/travis/install.sh
“”

Could be because of a transient issue. If it persists someone who owns the 
infra needs to take a look.

-abhi

> On 11-Jun-2015, at 9:47 am, Jayapal Reddy Uradi 
>  wrote:
>
> Hi,
>
> There are test case failures due to timeout, below is the message.
> 'Your test run exceeded 50 minutes. '
>
> travis-ci job info.
> https://travis-ci.org/jayapalu/cloudstack/builds/66205220
>
> Can some one look at travis-ci.
>
> Thanks,
> Jayapal

Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build
CSForge – rapid IaaS deployment framework
CloudStack Consulting
CloudStack Software 
Engineering
CloudStack Infrastructure 
Support
CloudStack Bootcamp Training Courses

This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England & Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue Ltd. Shape 
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company 
registered by The Republic of South Africa and is traded under license from 
Shape Blue Ltd. ShapeBlue is a registered trademark.

Re: Preparing for 4.6

[Abhinandan Prateek]

> On 18-May-2015, at 2:02 pm, Erik Weber  wrote:
>
> On Mon, May 18, 2015 at 10:26 AM, Rene Moser  wrote:
>
>> Hi
>>
>> On 15.05.2015 11:27, Sebastien Goasguen wrote:
>>> Folks,
>>>
>>> As we prepare to try a new process for 4.6 release it would be nice to
>> start paying attention to master.
>>>
>>> - Good commit messages
>>
>> The question is, what makes a commit message good? Maybe this helps:
>>
>> http://chris.beams.io/posts/git-commit/
>>
>>> - Reference to a JIRA bug
>>
>> Must there be a JIRA bug? I did some commits without jira bugs in the
>> past. But I noticed that those are not "tracked" in the changelog of the
>> new release. So should there be a policy (is there?) that there must be
>> a jira bug for fixes?
>>
>>
> I believe there should be a JIRA bug for most things. JIRA is a good place
> to document why you're doing something, it's also easy to use as a source
> for release notes as you discovered.
> It's also good practice to document bugs/fixes, it's generally easier to
> find JIRA bugs than it is to find commit messages - especially for
> non-developers / newbies.
>
> For major code commits (new features, important fixes, security fixes) I'd
> say it should be a requirement, but I don't know if it already is or not.
>

+1
This was sort of a unwritten rule that any commit should have a Jira id. That 
way it is easier to track across releases and also it is easier to know the 
what the commit is solving/fixing.


>
>>> - Squashing commits ( cc/ wilder :))
>>
>> This really depends. I would not generally prefer squashing commits.
>>
>> The example of
>> https://github.com/apache/cloudstack/commits/master?page=2 is more an
>> example of "bad" commit messages.
>>
>> If you look at the commits, they make sense but the commit message
>> indicates that they cover similar work in different aspects, which they
>> actually don't.
>>
>> But if you look at this example here
>>
>> https://github.com/ansible/ansible-modules-extras/commits/devel?author=gregdek
>> where you can see dozens of similar commits, those should be squashed.
>>
>>
>
> +1 to squashing related commits where it makes sense to do so
> -1 to a general rule of squashing the whole PR
>
> --
> Erik

Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build
CSForge – rapid IaaS deployment framework
CloudStack Consulting
CloudStack Software 
Engineering
CloudStack Infrastructure 
Support
CloudStack Bootcamp Training Courses

This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England & Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue Ltd. Shape 
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company 
registered by The Republic of South Africa and is traded under license from 
Shape Blue Ltd. ShapeBlue is a registered trademark.

Re: API Docs

[Abhinandan Prateek]

> On 14-May-2015, at 12:20 pm, Ian Duffy  wrote:
>
> Folks,
>
> With the amount of emails I seen about API docs not being found etc. I put
> in a quick fix.
>
> I just did a symbolic link between docs/api and api/. I created an
> index.html within api/ that will redirect to api.html accordingly.
>

 Thanks it works !

> No idea if we can modify content folder directly with this
> middleman/new-setup, if anyone is unhappy with the change please revert
> it... I didn't want to see any more users been given 404 pages.
>
> Thanks,
> Ian

Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build
CSForge – rapid IaaS deployment framework
CloudStack Consulting
CloudStack Software 
Engineering
CloudStack Infrastructure 
Support
CloudStack Bootcamp Training Courses

This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England & Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue Ltd. Shape 
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company 
registered by The Republic of South Africa and is traded under license from 
Shape Blue Ltd. ShapeBlue is a registered trademark.

Re: Cloudstack API docs down?

[Abhinandan Prateek]

https://cloudstack.apache.org/docs/api/apidocs-4.5/TOC_User.html

> On 12-May-2015, at 6:23 am, Syed Mushtaq  wrote:
>
> I'm getting a 404 for http://cloudstack.apache.org/docs/api/  Does
> anyone else have the same problem or is it just me?

Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build
CSForge – rapid IaaS deployment framework
CloudStack Consulting
CloudStack Software 
Engineering
CloudStack Infrastructure 
Support
CloudStack Bootcamp Training Courses

This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England & Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue Ltd. Shape 
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company 
registered by The Republic of South Africa and is traded under license from 
Shape Blue Ltd. ShapeBlue is a registered trademark.

Re: [ANNOUNCE] New Committer Marco Sinhoreli

[Abhinandan Prateek]

Congrats Marco !


> On 11-May-2015, at 3:31 pm, Daan Hoogland  wrote:
>
> Welcome Marcus,  keep all those good things coming.
>
> On Mon, 11 May 2015 11:57 Erik Weber  wrote:
>
>> Congratulations Marco!
>>
>>
>> --
>> Erik
>>
>> 2015-05-11 10:50 GMT+02:00 sebgoa :
>>
>>> It seems we forgot to announce that Marco was made a committer, my
>> sincere
>>> apologies
>>> -
>>>
>>> The Project Management Committee (PMC) for Apache CloudStack
>>> has asked Marco Sinhoreli  to become a committer and we are pleased to
>>> announce that he has accepted.
>>>
>>> Marco has done an outstanding job building the CloudStack community in
>>> Brazil.
>>>
>>> Parabéns por um trabalho bem feito e espero que você vai continuar a
>>> apoiar a comunidade da maneira que você tem feito até agora.
>>>
>>> Being a committer allows many contributors to contribute more
>>> autonomously. For developers, it makes it easier to submit changes and
>>> eliminates the need to have contributions reviewed via the patch
>>> submission process. Whether contributions are development-related or
>>> otherwise, it is a recognition of a contributor's participation in the
>>> project and commitment to the project and the Apache Way.
>>>
>>> Please join me in congratulating Marco !
>>>
>>> --Sebastien Goasguen
>>> on behalf of the CloudStack PMC
>>>
>>> 
>>>
>>> O Comité de Gestão do Projeto (PMC) para Apache CloudStack
>>> pediu Marco Sinhoreli para se tornar um committer e temos o prazer de
>>> anunciar que ele aceitou.
>>>
>>> Marco tem feito um trabalho notável construção da comunidade CloudStack
>> no
>>> Brasil.
>>>
>>> Parabéns Por Um Trabalho Bem Feito e espero Que Voce vai continuar 'uma
>>> APOIAR a Comunidade da Maneira Que rápido Você tem Feito Até ágora.
>>>
>>> Sendo um committer permite que muitos colaboradores a contribuir mais
>>> autonomamente. Para os desenvolvedores, torna-se mais fácil de submeter
>> as
>>> alterações e
>>> elimina a necessidade de ter contribuições avaliação via o patch
>>> processo de submissão. Se as contribuições são relacionadas com
>>> desenvolvimento ou
>>> caso contrário, é um reconhecimento da participação de um contribuinte no
>>> projeto e compromisso com o projeto eo Caminho Apache.
>>>
>>> Por favor, se juntar a mim para parabenizar Marco
>>>
>>> --Sebastien Goasguen
>>> em nome da CloudStack PMC
>>>
>>> 
>>>
>>> 项目管理委员会（PMC）为Apache的CloudStack
>>> 已要求马可Sinhoreli变成提交，我们很高兴地
>>> 宣布，他已经接受了。
>>>
>>> 马可已经做了出色的工作在建设社区的CloudStack在巴西。
>>>
>>> 在工作祝贺做得好，希望您能继续支持社区，你目前所做的方式。
>>>
>>> 作为一个提交允许许多贡献者作出更大的贡献
>>> 自主。对于开发人员来说，它可以更容易地提交更改和
>>> 消除了需要具有贡献经由补丁审查
>>> 提交过程。是否捐款是发展相关或
>>> 否则，它是一种认可，在一个贡献者的参与
>>> 项目与承诺项目和Apache的方式。
>>>
>>> 请和我一起祝贺马可
>>>
>>> --Sebastien Goasguen
>>> 代PMC的CloudStack的
>>>
>>> 
>>>
>>> ApacheのCloudStackのためのプロジェクト管理委員会（PMC）
>>> コミッタになるためにマルコSinhoreliに尋ねた、私たちはに満足しているしています
>>> 彼が承認したことを発表しました。
>>>
>>> マルコは、ブラジルのCloudStackのコミュニティを構築する優れた仕事をしています。
>>>
>>> 仕事おめでとうはよくやった、あなたがこれまで行ってきた方法でコミュニティを支援していきます願っています。
>>>
>>> コミッターであることは多くの貢献者が多くを貢献することができます
>>> 自律的。開発者にとっては、それはそれが簡単に変更を提出することになり、
>>> パッチ経由の口コミ貢献を持ってする必要がなくなります
>>> 提出プロセス。貢献は、開発に関連しているかどうか
>>> それ以外の場合は、中の寄稿者の参加の認識があります
>>> プロジェクトとプロジェクトとApacheの道へのコミットメント。
>>>
>>> マルコの祝福の中で私に参加してください
>>>
>>> --Sebastien Goasguen
>>> CloudStackのPMCの代わりに
>>>
>>>
>>

Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build
CSForge – rapid IaaS deployment framework
CloudStack Consulting
CloudStack Software 
Engineering
CloudStack Infrastructure 
Support
CloudStack Bootcamp Training Courses

This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England & Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue Ltd. Shape 
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company 
registered by The Republic of South Africa and is traded under license from 
Shape Blue Ltd. ShapeBlue is a registered trademark.

Re: Coverity Scan : cloudstack project

[Abhinandan Prateek]

While you guys fix it, can you also post the link to wiki or documentation on 
it ?

> On 08-May-2015, at 1:45 pm, Santhosh Edukulla  
> wrote:
>
> Hi Dakshesh,
>
> It seems no change in analysis. Is it like it has not hit the schedule yet
> and so is the reason? Right now, it still reflects march 16, 2015 as last
> analyzed date on scan portal.
>
> Santhosh
>
>
> On Thu, May 7, 2015 at 8:15 AM, Dakshesh Vyas  wrote:
>
>>  Hi,
>>
>> We have re-added the build into the queue with some modification as it
>> got timed out after 5 hours of database commit.
>>
>> Thanks
>>
>> *Dakshesh Vyas* • Marketing Operations / Technical Manager-Coverity Scan
>> dv...@coverity.com 
>> Office: +1 (415) 935 2957
>> www.coverity.com • Twitter: @coverityScan
>> *Coverity* by Synopsys
>>
>>  From: Santhosh Edukulla 
>> Date: Sunday, May 3, 2015 at 11:39 PM
>> To: "dev@cloudstack.apache.org" 
>> Cc: scan-admin 
>> Subject: Coverity Scan : cloudstack project
>>
>>  Team,
>>
>>
>> It seems Coverity Scan service has stopped analysis, since March 16,
>> 2015.  Please check.
>>
>> Regards,
>> Santhosh
>>

Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build
CSForge – rapid IaaS deployment framework
CloudStack Consulting
CloudStack Software 
Engineering
CloudStack Infrastructure 
Support
CloudStack Bootcamp Training Courses

This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England & Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue Ltd. Shape 
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company 
registered by The Republic of South Africa and is traded under license from 
Shape Blue Ltd. ShapeBlue is a registered trademark.

Re: [ANNOUNCE][PROPOSAL] merge of 4.5 code in master

[Abhinandan Prateek]

Daan,

  I was thinking voting will be concluded today ( looks like I confused it with 
GA).
Anyhow it can be done now, in case there are issues they can be merged as and 
when there are relevant commits.


> On 07-May-2015, at 3:50 pm, Daan Hoogland  wrote:
>
> why not before Abhi? as we have an RC we could merge now.
>
>
> Op do 7 mei 2015 om 11:59 schreef Abhinandan Prateek <
> abhinandan.prat...@shapeblue.com>:
>
>> +1
>>
>> Lets merge as soon as we have 4.5 GA.
>>
>>> On 07-May-2015, at 2:47 pm, Daan Hoogland 
>> wrote:
>>>
>>> LS,
>>>
>>> announce part: As we have an rc that did not get any -1 yet I want to
>> merge
>>> 4.5 in master now. It will result in 389 commits being merged without
>>> conflicts detectable by git. That is not an fool proof guarantee of a
>>> working system of course, hence this heads up.
>>>
>>> proposal part: I would like to merge back the last release branch as part
>>> of the release candidate creation script. First as part of the procedure,
>>> later in build_asf.sh.
>>>
>>> +/-1?
>>
>> Find out more about ShapeBlue and our range of CloudStack related services
>>
>> IaaS Cloud Design & Build<
>> http://shapeblue.com/iaas-cloud-design-and-build//>
>> CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
>> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
>> CloudStack Software Engineering<
>> http://shapeblue.com/cloudstack-software-engineering/>
>> CloudStack Infrastructure Support<
>> http://shapeblue.com/cloudstack-infrastructure-support/>
>> CloudStack Bootcamp Training Courses<
>> http://shapeblue.com/cloudstack-training/>
>>
>> This email and any attachments to it may be confidential and are intended
>> solely for the use of the individual to whom it is addressed. Any views or
>> opinions expressed are solely those of the author and do not necessarily
>> represent those of Shape Blue Ltd or related companies. If you are not the
>> intended recipient of this email, you must neither take any action based
>> upon its contents, nor copy or show it to anyone. Please contact the sender
>> if you believe you have received this email in error. Shape Blue Ltd is a
>> company incorporated in England & Wales. ShapeBlue Services India LLP is a
>> company incorporated in India and is operated under license from Shape Blue
>> Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil
>> and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is
>> a company registered by The Republic of South Africa and is traded under
>> license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>>

Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
CloudStack Software 
Engineering<http://shapeblue.com/cloudstack-software-engineering/>
CloudStack Infrastructure 
Support<http://shapeblue.com/cloudstack-infrastructure-support/>
CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>

This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England & Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue Ltd. Shape 
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company 
registered by The Republic of South Africa and is traded under license from 
Shape Blue Ltd. ShapeBlue is a registered trademark.

Re: [ANNOUNCE][PROPOSAL] merge of 4.5 code in master

[Abhinandan Prateek]

+1

Lets merge as soon as we have 4.5 GA.

> On 07-May-2015, at 2:47 pm, Daan Hoogland  wrote:
>
> LS,
>
> announce part: As we have an rc that did not get any -1 yet I want to merge
> 4.5 in master now. It will result in 389 commits being merged without
> conflicts detectable by git. That is not an fool proof guarantee of a
> working system of course, hence this heads up.
>
> proposal part: I would like to merge back the last release branch as part
> of the release candidate creation script. First as part of the procedure,
> later in build_asf.sh.
>
> +/-1?

Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build
CSForge – rapid IaaS deployment framework
CloudStack Consulting
CloudStack Software 
Engineering
CloudStack Infrastructure 
Support
CloudStack Bootcamp Training Courses

This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England & Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue Ltd. Shape 
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company 
registered by The Republic of South Africa and is traded under license from 
Shape Blue Ltd. ShapeBlue is a registered trademark.

Re: [VOTE] Apache Cloudstack 4.5.1

[Abhinandan Prateek]

+1 with following testing:

Manual Testing:

Zone with a cluster of Xenserver 6.5
  VM lifecycle, Recovering a destroyed VM, Reinstall VM
  VM Migration
  Affinity groups - anti affinity
  VM consoles
  VM and volume snapshots
  Template from volume snapshot, Download Template, Vm from template created 
form snapshot, Volume creation from volume snapshot
  Attach volume - throws an exception, preferably should give a proper error on 
UI:https://issues.apache.org/jira/browse/CLOUDSTACK-8448
  Resize volum, Download volume
  Snapshot policies
  Change password
  2 Tier VPC creation, Change password for VPC VMs, Reachability of VMs in the 
same tier, VPC ACL

Automated testing: Ran some 20 regression suites, found one issue: 
https://issues.apache.org/jira/browse/CLOUDSTACK-8437

None of the issues are a blocker.

-abhi


> On 06-May-2015, at 10:15 pm, Rohit Yadav  wrote:
>
> Hi all,
>
> I tested upgrading XS 6.2 from 4.4.2 to 4.5.1 to try to reproduce and test 
> the issue Geoff reported.
>
> The issue Geoff found had to do with systemvmtemplate's requireshvm flag. 
> When we register template for the next ACS version we want to upgrade, if 
> done from UI would add requireshvm=true that sets the hvm flag to 1 (in the 
> vm_instance table, as vms start). If the host is not HVM capable, which in 
> case of Geoff was VirtualBox, systemvm will fail to start/deploy (due to no 
> host found that is HVM).
>
> When we pre-seed systemvmtemplate on secondary storage the HVM tag is set to 
> 0 (false), so it breaks the convention to set it to 1 when 
> registering/upgrading systemvm template. The fix for this is to register the 
> next sytemvm template (systemvm-xenserver-4.5) using something like 
> cloudmonkey will hvm set to false for ACS 4.4.x or below. This UI issue has 
> been fixed in ACS 4.5 so users can deselect the HVM option.
>
> I’ve asked Geoff to test and post his voting on a fresh environment, possibly 
> using VMWare fusion (if doing on laptop) as VBox does not support vmx/amd-v.
>
> Hope this helps and hoping 4.5.1 will be solid.
>
>> On 06-May-2015, at 2:38 pm, Wilder Rodrigues  
>> wrote:
>>
>> Thanks for the heads-up, Geoff.
>>
>> I will start testing an upgrade scenario now.
>>
>> Cheers,
>> Wilder
>>
>>> On 06 May 2015, at 14:28, Geoff Higginbottom 
>>>  wrote:
>>>
>>> For all those of you have voted +1 based on a clean install, if possible 
>>> please test upgrade scenarios including deploying new Isolated networks and 
>>> new VPCs as I have performed three upgrades and all pass the initial 
>>> upgrade, but then fail to add new VRs or new SSVM/CPVMs post upgrade etc
>>>
>>> Regards
>>>
>>> Geoff Higginbottom
>>>
>>> D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581
>>>
>>> geoff.higginbot...@shapeblue.com
>>>
>>> -Original Message-
>>> From: Daan Hoogland [mailto:daan.hoogl...@gmail.com]
>>> Sent: 06 May 2015 13:25
>>> To: dev@cloudstack.apache.org
>>> Subject: Re: [VOTE] Apache Cloudstack 4.5.1
>>>
>>> based on Wilder's testing and my own bringing up a 4.5.1 server in a test 
>>> env i will +1(binding)
>>>
>>> Op wo 6 mei 2015 om 14:23 schreef Geoff Higginbottom <
>>> geoff.higginbot...@shapeblue.com>:
>>>
 Sorry for confusing the voting thread, I was backing Eriks statements
 with a '+1' but was not voting for the release - highlights the
 problem of mixing the threads

 Regards

 Geoff Higginbottom

 D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581

 geoff.higginbot...@shapeblue.com

 -Original Message-
 From: Geoff Higginbottom [mailto:geoff.higginbot...@shapeblue.com]
 Sent: 06 May 2015 10:59
 To: dev@cloudstack.apache.org
 Subject: RE: [VOTE] Apache Cloudstack 4.5.1

 +1

 Regards

 Geoff Higginbottom

 D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581

 geoff.higginbot...@shapeblue.com

 -Original Message-
 From: Erik Weber [mailto:terbol...@gmail.com]
 Sent: 06 May 2015 10:44
 To: dev
 Subject: Re: [VOTE] Apache Cloudstack 4.5.1

 On Wed, May 6, 2015 at 11:18 AM, Vadim Kimlaychuk <
 vadim.kimlayc...@elion.ee
> wrote:

> Geoff,
>
>  Thank you for explaination. Basically the idea behind that was to
> have (for instance) database tier and web-app tier.   Web-apps-tier
 servers
> have to communicate with databases, but databases are closed for
> outside world.
>
 The easiest way is to have 2 NICs at web-tier VMs and route inside VM
> without need to send all the requests to VPC router.


 But you're also breaking the tiering. Your database server is now
 fully accessible from the internet (or wherever you're connected to)
 through the web servers, and not just the database.

 The proper way, imho, is to have a firewall between (ie. the VR), and
 fix the scaling issues instead. That's what you do in the no

Re: Support OVA files with multiple disks for templates: CLOUDSTACK-4757

[Abhinandan Prateek]

Likitha,

  Thanks for updating, I think it is a very useful feature and will ease the 
work of migrating from VMWare setup to a cloudstack setup.

-abhi

> On 07-May-2015, at 9:11 am, Likitha Shetty  wrote:
>
> The feature is code complete and is present in feature branch 
> (https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;a=shortlog;h=refs/heads/multiple-disk-ova
>  ).
>
> But since it has been a while I don’t think it will be an easy merge into 
> master. In any case, I will soon start working on the merge.
>
> Thanks,
> Likitha
>
> -Original Message-
> From: Abhinandan Prateek [mailto:abhinandan.prat...@shapeblue.com]
> Sent: Wednesday, May 6, 2015 12:28 PM
> To: CloudStack Dev
> Cc: Likitha Shetty; Sateesh Chodapuneedi
> Subject: Re: Support OVA files with multiple disks for templates: 
> CLOUDSTACK-4757
>
> Can anyone comment what state this feature is in ?
>
>> On 05-May-2015, at 11:58 am, Abhinandan Prateek 
>>  wrote:
>>
>> The work on support for ova with multiple disk was started last year.
>> Can someone update in what state it is in as the ticket shows that this is 
>> still in progress ?
>>
>> FS: 
>> https://cwiki.apache.org/confluence/display/CLOUDSTACK/Support+OVA+files+containing+multiple+disks
>>  
>> <https://cwiki.apache.org/confluence/display/CLOUDSTACK/Support+OVA+files+containing+multiple+disks>
>>
>> -abhi
>
> Find out more about ShapeBlue and our range of CloudStack related services
>
> IaaS Cloud Design & 
> Build<http://secure-web.cisco.com/18IPXeCxMuL0ZGsCjfo3x7938ovd8trrcZQ3f0WxzmuNeY5ssDccHvBBo_Z2Vu3BvLe8HGArqlk7dQ5Owav1FAi03yijmr9kgDlWeLCe-JPQTOUEA9VH0Q0knXZtDHrOMSIPNocelxhrplz180xrN_Aw_u0QPQDtH9VgrlmlHxM0bvn8NF407Uf1xkQ88GKqd/http%3A%2F%2Fshapeblue.com%2Fiaas-cloud-design-and-build%2F%2F>
> CSForge – rapid IaaS deployment 
> framework<http://secure-web.cisco.com/1z27zdQXT0sqtwzAJRMsmbAvF4jnvvyiDarQcGzEW0L_b80Xh2SRRG0pSPS-gB5DLpmjza3rEULSdHr50euau0C836H0PRZMXhuoueRBM1btsZylOGr3QwPtRV5pSrzfBkiw0NGNJt5aLvxtww8_hr129cE5XVWnbozKsfLim1yVgKYgqGBWaP33PJ7oO7aOR/http%3A%2F%2Fshapeblue.com%2Fcsforge%2F>
> CloudStack 
> Consulting<http://secure-web.cisco.com/1Pqr-yJu7fnoRJVFY5xhjRF8rnDNcT3cpHwUsdl1sU_bAZ8Et_4oaHPdN5KySeak5l9ej2HJjcFKiGBp9-qT89eCPloGedaXLdL4dTDGkpJg5kcymHfWIhwut2P0e-DAhZgJxu35u8Q3K5tYoOaeaveoi4LgpYtGZt2iVtbOEiEPdoP579T39kCA0DAMh8X8d/http%3A%2F%2Fshapeblue.com%2Fcloudstack-consultancy%2F>
> CloudStack Software 
> Engineering<http://secure-web.cisco.com/1cOTTac79V0xUuX8MYnPy2tG5A45XPf06HDXeyZuAWIvG3uAigfNQjz_ZeHkBcWxiHXbUWExKVjwAO8BMs1f2ug1kF4nG0kMXpxzW__Im1D1ZCBFLtM2JmLctCcXKUalUbWhwaOvae8dZxoKjFeVUVKOoGZFBgqfNkG_0paIwnK0MguhWoX6mJu9Sx7D9lN1F/http%3A%2F%2Fshapeblue.com%2Fcloudstack-software-engineering%2F>
> CloudStack Infrastructure 
> Support<http://secure-web.cisco.com/18DkP5kIP2TW2gdWkWCJ4u9ktfsBAyMjnYvSKzsIomqX84q2pE2DpDT6kgEcJjakCgJR7qWg-9VKWhZDxdWbElIQcou2X1BYXJOzm7qy_-ZpMSZ2Z23CFXdaTGVV9uzpM-t19kCM4FO0oj5tGqFufuCI0sWu3p7zEnkxHL0-XhxlJ0aTDdRgVYcw0yvN2agCn/http%3A%2F%2Fshapeblue.com%2Fcloudstack-infrastructure-support%2F>
> CloudStack Bootcamp Training 
> Courses<http://secure-web.cisco.com/1myEW2ul7tEiy7AbKqaFo819HOXbHuU1vyqNuEpaJd-1K269PZHuoG4HobTzoCwjuqdKu89SB6fGoPoWb9VLYP5aEJbdixKIedc6DpoeK8S6efTtgiHw5nBN4WQvO2DSDRN1x2FO4sTI1n4tlag0DaAcUIHHEdtupa1zqmE0fewfLyh3BYbD6wUcFJsSAkxAO/http%3A%2F%2Fshapeblue.com%2Fcloudstack-training%2F>
>
> This email and any attachments to it may be confidential and are intended 
> solely for the use of the individual to whom it is addressed. Any views or 
> opinions expressed are solely those of the author and do not necessarily 
> represent those of Shape Blue Ltd or related companies. If you are not the 
> intended recipient of this email, you must neither take any action based upon 
> its contents, nor copy or show it to anyone. Please contact the sender if you 
> believe you have received this email in error. Shape Blue Ltd is a company 
> incorporated in England & Wales. ShapeBlue Services India LLP is a company 
> incorporated in India and is operated under license from Shape Blue Ltd. 
> Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
> operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company 
> registered by The Republic of South Africa and is traded under license from 
> Shape Blue Ltd. ShapeBlue is a registered trademark.

Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
CloudStack Software 
Engineering<http://

Re: Support OVA files with multiple disks for templates: CLOUDSTACK-4757

[Abhinandan Prateek]

Can anyone comment what state this feature is in ?

> On 05-May-2015, at 11:58 am, Abhinandan Prateek 
>  wrote:
>
> The work on support for ova with multiple disk was started last year.
> Can someone update in what state it is in as the ticket shows that this is 
> still in progress ?
>
> FS: 
> https://cwiki.apache.org/confluence/display/CLOUDSTACK/Support+OVA+files+containing+multiple+disks
>  
> <https://cwiki.apache.org/confluence/display/CLOUDSTACK/Support+OVA+files+containing+multiple+disks>
>
> -abhi

Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
CloudStack Software 
Engineering<http://shapeblue.com/cloudstack-software-engineering/>
CloudStack Infrastructure 
Support<http://shapeblue.com/cloudstack-infrastructure-support/>
CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>

This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England & Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue Ltd. Shape 
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company 
registered by The Republic of South Africa and is traded under license from 
Shape Blue Ltd. ShapeBlue is a registered trademark.

Support OVA files with multiple disks for templates: CLOUDSTACK-4757

[Abhinandan Prateek]

The work on support for ova with multiple disk was started last year. 
Can someone update in what state it is in as the ticket shows that this is 
still in progress ?

FS: 
https://cwiki.apache.org/confluence/display/CLOUDSTACK/Support+OVA+files+containing+multiple+disks
 


-abhi

Re: marvin test cases + travis

[Abhinandan Prateek]

We can control the number of tests that travis runs. It is possible to say run 
more variety of test cases on each 10th run.
This will ensure that 9 out of 10 times travis runs a small sub set of tests. 
We can do this as travis provides the build number in an environment variable. 
If we can trigger the travis automatically at certain time of day then we can 
use that run to run just the regression suite. In that case we can have per 
commit run of smoke and once a day run of regression suite.

Even with this scheme we will need to increase the timeout. So I think it is ok 
to increase the timeout, but to get faster results most of the time, tune 
travis to run only a smaller subset of tests most of the time or for each 
commit.

If we leave out test cases out of travis that it can run, then we will be 
dependant on individuals/companies to do it once in a while and that is not 
automation.

With better control of travis we can have it run unit tests once (recently 
added by Rajani as an optimisation), have it run find bug, regressions say once 
in n runs etc. We should look forward to a highly customisable and useful 
travis instead of working in past limitations.


> On 02-May-2015, at 10:22 am, Raja Pullela  wrote:
>
> -1 for the time...
> since these tests run independently if we can spawn more threads/vms to bring 
> down the run time, that will be good.
> Another thing that can be looked at the run only tests in SMOKE folder.
> BTW, more tests in  "SMOKE"  should be added on a continuous basis.
>
> -Original Message-
> From: Rajani Karuturi [mailto:raj...@apache.org]
> Sent: Friday, May 1, 2015 11:09 PM
> To: dev@cloudstack.apache.org
> Subject: Re: marvin test cases + travis
>
> -1 on increasing the time
> As a reviewer, I would like an immediate response on a pull request. By the 
> time I review the code, if CI gives a +1(or -1) I can close the PR then and 
> there instead of coming back again to merge.
>
> I would suggest running all the jobs under 30 min and increasing the number 
> of parallel jobs as much as possible. we are running 10 jobs now. may be we 
> could increase this to 15(dont know if this is possible)
>
> we should aim to run only the smoke tests and not the entire regression suite 
> always.
>
> Making the jobs run on containers will speed them up. This needs some work on 
> removing the sudo dependency on the jobs (which is required to install some 
> additional packages and marvin).
>
> ~Rajani
>
> On Fri, May 1, 2015 at 8:25 AM, Abhinandan Prateek < 
> abhinandan.prat...@shapeblue.com> wrote:
>
>> +1 for increased timeouts.
>>
>> At the moment we get less than 24 commits per day on master. Only a
>> couple on other branches per day.
>> We can increase the timeout to upto 70 minutes or more. Will try to
>> ensure that in general a single run does not take more than an hour.
>>
>> A timeout window slightly higher will ensure that we do not see
>> timeout failures.
>>
>>> On 30-Apr-2015, at 11:25 pm, Daan Hoogland 
>> wrote:
>>>
>>> Travis is starting to indue the, 'oh,  a timeout again' - blindness
>>> in
>> me.
>>> Let's put a safe time on it.  A result should mean something and
>>> those
>> time
>>> out are like the (decreasing) abundance of Jenkins failures.
>>>
>>> So +1 for increasing the time
>>>
>>> On Thu, 30 Apr 2015 18:46 Ian Duffy  wrote:
>>>
>>>>> Do we need to ask for an increase in run time?
>>>>
>>>> From my experience I wouldn't say its required however *it would be
>>>> very nice*.
>>>> At the moment what we do is create new parallel jobs and balance
>>>> the tests across them so each job is under 50mins.
>>>>
>>>> Anywho, just my 2c, see what others say/think.
>>>>
>>>> On 30 April 2015 at 17:34, David Nalley  wrote:
>>>>> Do we need to ask for an increase in run time?
>>>>> 50 minutes is the OSS default, but the ASF is a paying customer
>>>>> and we can ask for longer timeouts.
>>>>>
>>>>> --David
>>>>>
>>>>> On Thu, Apr 30, 2015 at 10:06 AM, Abhinandan Prateek
>>>>>  wrote:
>>>>>> One of the run did timeout. Will balance the runs.
>>>>>>
>>>>>>> On 30-Apr-2015, at 5:59 pm, Abhinandan Prateek <
>>>> abhinandan.prat...@shapeblue.com> wrote:
>>>>>>>
>>>>>>> Yes, thanks for checking. I was worried that now some of them
>>>>>>> may
>>>> start timin

Re: marvin test cases + travis

[Abhinandan Prateek]

I think it is a choice between fast response Vs more accurate response. I will 
rather wait for additional 20 minutes to get a better response.
With the commit rate we have that should not overload the system.
Yes we should definitely look for quality and coverage of the tests picked then 
the number.

> On 01-May-2015, at 11:09 pm, Rajani Karuturi  wrote:
>
> -1 on increasing the time
> As a reviewer, I would like an immediate response on a pull request. By the
> time I review the code, if CI gives a +1(or -1) I can close the PR then and
> there instead of coming back again to merge.
>
> I would suggest running all the jobs under 30 min and increasing the number
> of parallel jobs as much as possible. we are running 10 jobs now. may be we
> could increase this to 15(dont know if this is possible)
>
> we should aim to run only the smoke tests and not the entire regression
> suite always.
>
> Making the jobs run on containers will speed them up. This needs some work
> on removing the sudo dependency on the jobs (which is required to install
> some additional packages and marvin).
>
> ~Rajani
>
> On Fri, May 1, 2015 at 8:25 AM, Abhinandan Prateek <
> abhinandan.prat...@shapeblue.com> wrote:
>
>> +1 for increased timeouts.
>>
>> At the moment we get less than 24 commits per day on master. Only a couple
>> on other branches per day.
>> We can increase the timeout to upto 70 minutes or more. Will try to ensure
>> that in general a single run does not take more than an hour.
>>
>> A timeout window slightly higher will ensure that we do not see timeout
>> failures.
>>
>>> On 30-Apr-2015, at 11:25 pm, Daan Hoogland 
>> wrote:
>>>
>>> Travis is starting to indue the, 'oh,  a timeout again' - blindness in
>> me.
>>> Let's put a safe time on it.  A result should mean something and those
>> time
>>> out are like the (decreasing) abundance of Jenkins failures.
>>>
>>> So +1 for increasing the time
>>>
>>> On Thu, 30 Apr 2015 18:46 Ian Duffy  wrote:
>>>
>>>>> Do we need to ask for an increase in run time?
>>>>
>>>> From my experience I wouldn't say its required however *it would be very
>>>> nice*.
>>>> At the moment what we do is create new parallel jobs and balance the
>>>> tests across them so each job is under 50mins.
>>>>
>>>> Anywho, just my 2c, see what others say/think.
>>>>
>>>> On 30 April 2015 at 17:34, David Nalley  wrote:
>>>>> Do we need to ask for an increase in run time?
>>>>> 50 minutes is the OSS default, but the ASF is a paying customer and we
>>>>> can ask for longer timeouts.
>>>>>
>>>>> --David
>>>>>
>>>>> On Thu, Apr 30, 2015 at 10:06 AM, Abhinandan Prateek
>>>>>  wrote:
>>>>>> One of the run did timeout. Will balance the runs.
>>>>>>
>>>>>>> On 30-Apr-2015, at 5:59 pm, Abhinandan Prateek <
>>>> abhinandan.prat...@shapeblue.com> wrote:
>>>>>>>
>>>>>>> Yes, thanks for checking. I was worried that now some of them may
>>>> start timing out.
>>>>>>> I have another 10 suites tested, will add them once everything seems
>>>> fine.
>>>>>>>
>>>>>>> -abhi
>>>>>>>
>>>>>>>
>>>>>>>> On 30-Apr-2015, at 5:32 pm, Rajani Karuturi 
>>>> wrote:
>>>>>>>>
>>>>>>>> after correcting the test file path, its working fine
>>>>>>>>
>>>>>>>> https://travis-ci.org/karuturi/cloudstack/jobs/60681263
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> ~Rajani
>>>>>>>>
>>>>>>>> On Thu, Apr 30, 2015 at 4:51 PM, Rajani Karuturi >>
>>>> wrote:
>>>>>>>>
>>>>>>>>> I think its due to this commit
>>>>>>>>>
>>>>>>>>>
>>>>
>> https://github.com/apache/cloudstack/commit/b941480e0df0bfa3377e797126b96cf9b3fbee77
>>>>>>>>>
>>>>>>>>> Here, test file name is changed from testname to
>>>> [smoke,component]/testname
>>>>>>>>>
>>>>>>>>> But, while running each test file in the for loop, it p

Re: [4.5.1] cloudstack HA

[Abhinandan Prateek]

Ok did more investigation into the code, I am adding my comments to the pull 
request.

> On 01-May-2015, at 2:21 pm, Abhinandan Prateek 
>  wrote:
>
>
>  The commit to 4.5 - b222386bcb777bbdc2504e01fa60c0ded466c96d,  has the 
> potential to interfere with cloudstack HA.
> The way HA is implemented, “null” is a valid return value from an 
> investigator. The valid values are Up, Down or null.
>
> https://cwiki.apache.org/confluence/display/CLOUDSTACK/High+Availability+Developer's+Guide
>
> The other values may not be handled by HA impl., please check.
>
> -abhi
>
> Find out more about ShapeBlue and our range of CloudStack related services
>
> IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
> CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
> CloudStack Software 
> Engineering<http://shapeblue.com/cloudstack-software-engineering/>
> CloudStack Infrastructure 
> Support<http://shapeblue.com/cloudstack-infrastructure-support/>
> CloudStack Bootcamp Training 
> Courses<http://shapeblue.com/cloudstack-training/>
>
> This email and any attachments to it may be confidential and are intended 
> solely for the use of the individual to whom it is addressed. Any views or 
> opinions expressed are solely those of the author and do not necessarily 
> represent those of Shape Blue Ltd or related companies. If you are not the 
> intended recipient of this email, you must neither take any action based upon 
> its contents, nor copy or show it to anyone. Please contact the sender if you 
> believe you have received this email in error. Shape Blue Ltd is a company 
> incorporated in England & Wales. ShapeBlue Services India LLP is a company 
> incorporated in India and is operated under license from Shape Blue Ltd. 
> Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
> operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company 
> registered by The Republic of South Africa and is traded under license from 
> Shape Blue Ltd. ShapeBlue is a registered trademark.

Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
CloudStack Software 
Engineering<http://shapeblue.com/cloudstack-software-engineering/>
CloudStack Infrastructure 
Support<http://shapeblue.com/cloudstack-infrastructure-support/>
CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>

This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England & Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue Ltd. Shape 
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company 
registered by The Republic of South Africa and is traded under license from 
Shape Blue Ltd. ShapeBlue is a registered trademark.

[4.5.1] cloudstack HA

[Abhinandan Prateek]

  The commit to 4.5 - b222386bcb777bbdc2504e01fa60c0ded466c96d,  has the 
potential to interfere with cloudstack HA.
The way HA is implemented, “null” is a valid return value from an investigator. 
The valid values are Up, Down or null.

https://cwiki.apache.org/confluence/display/CLOUDSTACK/High+Availability+Developer's+Guide

The other values may not be handled by HA impl., please check.

-abhi

Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build
CSForge – rapid IaaS deployment framework
CloudStack Consulting
CloudStack Software 
Engineering
CloudStack Infrastructure 
Support
CloudStack Bootcamp Training Courses

This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England & Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue Ltd. Shape 
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company 
registered by The Republic of South Africa and is traded under license from 
Shape Blue Ltd. ShapeBlue is a registered trademark.

Re: [ANNOUNCE] New committer: Remi Bergsma

[Abhinandan Prateek]

Congrats Remi, welcome to the team !

-abhi

> On 01-May-2015, at 12:37 pm, sebgoa  wrote:
>
> Well done,
>
>
> On May 1, 2015, at 9:04 AM, Rajani Karuturi  wrote:
>
>> congratulations Remi :)
>>
>> ~Rajani
>>
>> On Fri, May 1, 2015 at 12:15 PM, Daan Hoogland 
>> wrote:
>>
>>> The Project Management Committee (PMC) for Apache CloudStack
>>> has asked Remi Bergsma to become a committer and we are pleased to
>>> announce that he has accepted.
>>>
>>> Remi has reported and helped in investigating and solving many bugs. He has
>>> given talks on managing clouds on several occasions.
>>>
>>> Being a committer allows many contributors to contribute more
>>> autonomously. For developers, it makes it easier to submit changes and
>>> eliminates the need to have contributions reviewed via the patch
>>> submission process. Whether contributions are development-related or
>>> otherwise, it is a recognition of a contributor's participation in the
>>> project and commitment to the project and the Apache Way.
>>>
>>> Please join me in congratulating Remi
>>>
>>> --Daan Hoogland
>>> on behalf of the CloudStack PMC
>>>
>

Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build
CSForge – rapid IaaS deployment framework
CloudStack Consulting
CloudStack Software 
Engineering
CloudStack Infrastructure 
Support
CloudStack Bootcamp Training Courses

This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England & Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue Ltd. Shape 
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company 
registered by The Republic of South Africa and is traded under license from 
Shape Blue Ltd. ShapeBlue is a registered trademark.

Re: marvin test cases + travis

[Abhinandan Prateek]

+1 for increased timeouts.

At the moment we get less than 24 commits per day on master. Only a couple on 
other branches per day.
We can increase the timeout to upto 70 minutes or more. Will try to ensure that 
in general a single run does not take more than an hour.

A timeout window slightly higher will ensure that we do not see timeout 
failures.

> On 30-Apr-2015, at 11:25 pm, Daan Hoogland  wrote:
>
> Travis is starting to indue the, 'oh,  a timeout again' - blindness in me.
> Let's put a safe time on it.  A result should mean something and those time
> out are like the (decreasing) abundance of Jenkins failures.
>
> So +1 for increasing the time
>
> On Thu, 30 Apr 2015 18:46 Ian Duffy  wrote:
>
>>> Do we need to ask for an increase in run time?
>>
>> From my experience I wouldn't say its required however *it would be very
>> nice*.
>> At the moment what we do is create new parallel jobs and balance the
>> tests across them so each job is under 50mins.
>>
>> Anywho, just my 2c, see what others say/think.
>>
>> On 30 April 2015 at 17:34, David Nalley  wrote:
>>> Do we need to ask for an increase in run time?
>>> 50 minutes is the OSS default, but the ASF is a paying customer and we
>>> can ask for longer timeouts.
>>>
>>> --David
>>>
>>> On Thu, Apr 30, 2015 at 10:06 AM, Abhinandan Prateek
>>>  wrote:
>>>> One of the run did timeout. Will balance the runs.
>>>>
>>>>> On 30-Apr-2015, at 5:59 pm, Abhinandan Prateek <
>> abhinandan.prat...@shapeblue.com> wrote:
>>>>>
>>>>> Yes, thanks for checking. I was worried that now some of them may
>> start timing out.
>>>>> I have another 10 suites tested, will add them once everything seems
>> fine.
>>>>>
>>>>> -abhi
>>>>>
>>>>>
>>>>>> On 30-Apr-2015, at 5:32 pm, Rajani Karuturi 
>> wrote:
>>>>>>
>>>>>> after correcting the test file path, its working fine
>>>>>>
>>>>>> https://travis-ci.org/karuturi/cloudstack/jobs/60681263
>>>>>>
>>>>>>
>>>>>>
>>>>>> ~Rajani
>>>>>>
>>>>>> On Thu, Apr 30, 2015 at 4:51 PM, Rajani Karuturi 
>> wrote:
>>>>>>
>>>>>>> I think its due to this commit
>>>>>>>
>>>>>>>
>> https://github.com/apache/cloudstack/commit/b941480e0df0bfa3377e797126b96cf9b3fbee77
>>>>>>>
>>>>>>> Here, test file name is changed from testname to
>> [smoke,component]/testname
>>>>>>>
>>>>>>> But, while running each test file in the for loop, it prepends the
>> name
>>>>>>> with smoke and hence, it cant find the file and none of the tests in
>> the
>>>>>>> file are run
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> ~Rajani
>>>>>>>
>>>>>>> On Thu, Apr 30, 2015 at 4:37 PM, Abhinandan Prateek <
>>>>>>> abhinandan.prat...@shapeblue.com> wrote:
>>>>>>>
>>>>>>>> It is possible, I will check.
>>>>>>>>
>>>>>>>>> On 30-Apr-2015, at 3:43 pm, Rajani Karuturi 
>> wrote:
>>>>>>>>>
>>>>>>>>> Hey Abhi,
>>>>>>>>>
>>>>>>>>> In the recent travis runs, its not printing the test case in
>> output (
>>>>>>>>> https://travis-ci.org/apache/cloudstack/jobs/60634577#L5443)
>>>>>>>>>
>>>>>>>>> It used to print the test case name and status (
>>>>>>>>> https://travis-ci.org/apache/cloudstack/jobs/59958134#L4205)
>>>>>>>>>
>>>>>>>>> Do you think it can be due to any recent changes?
>>>>>>>>>
>>>>>>>>> ~Rajani
>>>>>>>>>
>>>>>>>>> On Thu, Apr 30, 2015 at 10:32 AM, Abhinandan Prateek <
>>>>>>>>> abhinandan.prat...@shapeblue.com> wrote:
>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> There are more than 10 additional suites that can still be
>> included
>>>>>>>> to
>>

Re: [DISCUSS] 4.6 release management

[Abhinandan Prateek]

Guys,

  Do I see a QACloud in works, something in line with devcloud but with a 
bigger collection of Hypervisors + marvin ?
If we can bundle these Hypervisors and QA automation then effectively we can 
have many more people join our QA effort.

> On 29-Apr-2015, at 9:24 pm, Rohit Yadav  wrote:
>
> Hi Remi,
>
> Thanks. Sure we can work together on this, I guess you would be running 
> KVM/XenServer on KVM. Ping me if you need help on running ESX 5.x on KVM as 
> it requires a patched qemu system binary (prebuilt debs here 
> http://people.apache.org/~bhaisaab/qemu). If these nested hosts are managed 
> by CloudStack itself instead of virsh or virt-viewer, then use ACS 4.5 or 
> master.
>
>> On 29-Apr-2015, at 5:21 pm, Remi Bergsma  wrote:
>>
>> Hi Rohit,
>>
>> Nice work!
>>
>> I agree we need an environment that does run on something else than the 
>> local machine, as we need more horse power. We worked on something similar, 
>> where we have a cluster of KVM controlled by CloudStack in our Employee 
>> Cloud and spin large VMs running CentOS 7.1 (we use 32 or 64GB ram). In this 
>> big VM we run KVM again and spin up all infrastructure, ranging from 
>> hypervisors, SDN controllers, database hosts, storage appliances, etc. The 
>> big benefit is that networking is easy, as it is all in one box. Also, 
>> everybody uses the same prefixes. Using a L2 VPN we connect the workstations 
>> to the dev/test environment. All VMs can be controlled using virt-manager 
>> (like you also showed) and it is actually CloudStack running inside 
>> CloudStack. Deploying this VM has been automated and we’re now working on 
>> automating different scenario’s. They can also be used as Jenkins build 
>> slaves, for example. It is work in progress.
>>
>> Long story short: Let's work together on this :-)
>>
>> Regards,
>> Remi
>>
>>
>>> On 28 Apr 2015, at 21:07, Rohit Yadav  wrote:
>>>
>>> Hi Ilya,
>>>
>>> In short - to run ESX and other hypervisors (Xen, KVM, OVM3, HyperV etc) on 
>>> KVM you need to;
>>>
>>> - use patched qemu (tested to work on both Ubuntu 14.04 and 15.04 x64, I’m 
>>> waiting for Fedora 22 to test it on F22 as well), you may install the 
>>> pre-built debs or build/install qemu from source using the patch from here: 
>>> people.apache.org/~bhaisaab/qemu
>>> - use ACS using latest 4.5 branch and deploy a basic zone (without SG) to 
>>> provision hypervisor hosts as user vms
>>> - in agent.properties (on your kvm host), enable guest.cpu.features=vmx and 
>>> guest.cpu.mode=host-passthrough
>>> - when deploying ESX 5.x on vm (or installing using an ISO) deploy 
>>> virtualmachine with details nicAdapter=vmxnet3, for other hypervisors 
>>> (including ESX 6.0) E1000, the default nic adapter, works
>>>
>>> IMO this is a better approach as it does not depend on ESX or VMWare fusion 
>>> that requires special hardware (vCenter/Windows etc or OSX/Apple machine) 
>>> and are difficult to automate. Working with KVM host, since is a Linux 
>>> machine, would be more familiar to sysadmins and certainly a pleasure to 
>>> scale and work with because one can avoid management tools (such as 
>>> XenCenter or vCenter).
>>>
>>> (I’m still working on the "CloudStack Developer Kit” {CDK} so it’s not in a 
>>> state to be released yet, will avoid publishing a faulty tool now. Instead 
>>> of the DevCloud approach which promotes everything on one machine, the CDK 
>>> I’m trying to build focuses on developer productivity, reproducibility and 
>>> scalability of a QA lab, it recommends at least one companion hardware with 
>>> a developer’s workstation/laptop which can be a small-form-factor server 
>>> like a mini PC or NUC with at least 16GB RAM and 4 cores i7 with Intel VT. 
>>> Hope to share it soon.)
>>>
 On 28-Apr-2015, at 7:17 pm, ilya  wrote:

 Rohit

 Any headway on ESX 5.5? I've done this many times before using cloudstack 
 and esx, but i was using esx as parent hypervisor.

 The challenge for me was being able to automatically deploy and configure 
 the vSphere + ESXi env. I managed to get the whole flow working with bash 
 script, puppet, VMA and while it works its not pretty. The challenge was 
 the networking bit.

 Last but not least, consider using cloudstack to test cloudstack. i.e. 
 master env, would use cloudstack projects and spinup smaller envs with 
 KVM, Xen and VmWare bound to each project.

 Regards
 ilya

 On 4/24/15 7:53 AM, Rohit Yadav wrote:
> Daan,
>
>> On 24-Apr-2015, at 3:53 pm, Daan Hoogland  
>> wrote:
>>
>> Rohit, the issues you mention are not as painful if we release in a
>> two week schedule as the period of creating a fix to seeing it in a
>> release will be shorter. Some releases will be broken for some people,
>> I don't think we can prevent this. The target we are aiming for is to
>> big to cover it completely.
> I agree with you, but I think there are pros and co

Re: marvin test cases + travis

[Abhinandan Prateek]

One of the run did timeout. Will balance the runs.

> On 30-Apr-2015, at 5:59 pm, Abhinandan Prateek 
>  wrote:
>
> Yes, thanks for checking. I was worried that now some of them may start 
> timing out.
> I have another 10 suites tested, will add them once everything seems fine.
>
> -abhi
>
>
>> On 30-Apr-2015, at 5:32 pm, Rajani Karuturi  wrote:
>>
>> after correcting the test file path, its working fine
>>
>> https://travis-ci.org/karuturi/cloudstack/jobs/60681263
>>
>>
>>
>> ~Rajani
>>
>> On Thu, Apr 30, 2015 at 4:51 PM, Rajani Karuturi  wrote:
>>
>>> I think its due to this commit
>>>
>>> https://github.com/apache/cloudstack/commit/b941480e0df0bfa3377e797126b96cf9b3fbee77
>>>
>>> Here, test file name is changed from testname to [smoke,component]/testname
>>>
>>> But, while running each test file in the for loop, it prepends the name
>>> with smoke and hence, it cant find the file and none of the tests in the
>>> file are run
>>>
>>>
>>>
>>> ~Rajani
>>>
>>> On Thu, Apr 30, 2015 at 4:37 PM, Abhinandan Prateek <
>>> abhinandan.prat...@shapeblue.com> wrote:
>>>
>>>> It is possible, I will check.
>>>>
>>>>> On 30-Apr-2015, at 3:43 pm, Rajani Karuturi  wrote:
>>>>>
>>>>> Hey Abhi,
>>>>>
>>>>> In the recent travis runs, its not printing the test case in output (
>>>>> https://travis-ci.org/apache/cloudstack/jobs/60634577#L5443)
>>>>>
>>>>> It used to print the test case name and status (
>>>>> https://travis-ci.org/apache/cloudstack/jobs/59958134#L4205)
>>>>>
>>>>> Do you think it can be due to any recent changes?
>>>>>
>>>>> ~Rajani
>>>>>
>>>>> On Thu, Apr 30, 2015 at 10:32 AM, Abhinandan Prateek <
>>>>> abhinandan.prat...@shapeblue.com> wrote:
>>>>>
>>>>>>
>>>>>>  There are more than 10 additional suites that can still be included
>>>> to
>>>>>> the travis-CI.
>>>>>> Since the current set runs comfortably I will go ahead and add more. If
>>>>>> the system gets overloaded, then we can balance the kind of test
>>>> suites and
>>>>>> amount of test suits that run comfortably on travis.
>>>>>>
>>>>>> -abhi
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> Find out more about ShapeBlue and our range of CloudStack related
>>>> services
>>>>>>
>>>>>> IaaS Cloud Design & Build<
>>>>>> http://shapeblue.com/iaas-cloud-design-and-build//>
>>>>>> CSForge – rapid IaaS deployment framework<
>>>> http://shapeblue.com/csforge/>
>>>>>> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
>>>>>> CloudStack Software Engineering<
>>>>>> http://shapeblue.com/cloudstack-software-engineering/>
>>>>>> CloudStack Infrastructure Support<
>>>>>> http://shapeblue.com/cloudstack-infrastructure-support/>
>>>>>> CloudStack Bootcamp Training Courses<
>>>>>> http://shapeblue.com/cloudstack-training/>
>>>>>>
>>>>>> This email and any attachments to it may be confidential and are
>>>> intended
>>>>>> solely for the use of the individual to whom it is addressed. Any
>>>> views or
>>>>>> opinions expressed are solely those of the author and do not
>>>> necessarily
>>>>>> represent those of Shape Blue Ltd or related companies. If you are not
>>>> the
>>>>>> intended recipient of this email, you must neither take any action
>>>> based
>>>>>> upon its contents, nor copy or show it to anyone. Please contact the
>>>> sender
>>>>>> if you believe you have received this email in error. Shape Blue Ltd
>>>> is a
>>>>>> company incorporated in England & Wales. ShapeBlue Services India LLP
>>>> is a
>>>>>> company incorporated in India and is operated under license from Shape
>>>> Blue
>>>>>> Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in
>>>> Brasil
>>>>&

Re: marvin test cases + travis

[Abhinandan Prateek]

Yes, thanks for checking. I was worried that now some of them may start timing 
out.
I have another 10 suites tested, will add them once everything seems fine.

-abhi


> On 30-Apr-2015, at 5:32 pm, Rajani Karuturi  wrote:
>
> after correcting the test file path, its working fine
>
> https://travis-ci.org/karuturi/cloudstack/jobs/60681263
>
>
>
> ~Rajani
>
> On Thu, Apr 30, 2015 at 4:51 PM, Rajani Karuturi  wrote:
>
>> I think its due to this commit
>>
>> https://github.com/apache/cloudstack/commit/b941480e0df0bfa3377e797126b96cf9b3fbee77
>>
>> Here, test file name is changed from testname to [smoke,component]/testname
>>
>> But, while running each test file in the for loop, it prepends the name
>> with smoke and hence, it cant find the file and none of the tests in the
>> file are run
>>
>>
>>
>> ~Rajani
>>
>> On Thu, Apr 30, 2015 at 4:37 PM, Abhinandan Prateek <
>> abhinandan.prat...@shapeblue.com> wrote:
>>
>>> It is possible, I will check.
>>>
>>>> On 30-Apr-2015, at 3:43 pm, Rajani Karuturi  wrote:
>>>>
>>>> Hey Abhi,
>>>>
>>>> In the recent travis runs, its not printing the test case in output (
>>>> https://travis-ci.org/apache/cloudstack/jobs/60634577#L5443)
>>>>
>>>> It used to print the test case name and status (
>>>> https://travis-ci.org/apache/cloudstack/jobs/59958134#L4205)
>>>>
>>>> Do you think it can be due to any recent changes?
>>>>
>>>> ~Rajani
>>>>
>>>> On Thu, Apr 30, 2015 at 10:32 AM, Abhinandan Prateek <
>>>> abhinandan.prat...@shapeblue.com> wrote:
>>>>
>>>>>
>>>>>   There are more than 10 additional suites that can still be included
>>> to
>>>>> the travis-CI.
>>>>> Since the current set runs comfortably I will go ahead and add more. If
>>>>> the system gets overloaded, then we can balance the kind of test
>>> suites and
>>>>> amount of test suits that run comfortably on travis.
>>>>>
>>>>> -abhi
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> Find out more about ShapeBlue and our range of CloudStack related
>>> services
>>>>>
>>>>> IaaS Cloud Design & Build<
>>>>> http://shapeblue.com/iaas-cloud-design-and-build//>
>>>>> CSForge – rapid IaaS deployment framework<
>>> http://shapeblue.com/csforge/>
>>>>> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
>>>>> CloudStack Software Engineering<
>>>>> http://shapeblue.com/cloudstack-software-engineering/>
>>>>> CloudStack Infrastructure Support<
>>>>> http://shapeblue.com/cloudstack-infrastructure-support/>
>>>>> CloudStack Bootcamp Training Courses<
>>>>> http://shapeblue.com/cloudstack-training/>
>>>>>
>>>>> This email and any attachments to it may be confidential and are
>>> intended
>>>>> solely for the use of the individual to whom it is addressed. Any
>>> views or
>>>>> opinions expressed are solely those of the author and do not
>>> necessarily
>>>>> represent those of Shape Blue Ltd or related companies. If you are not
>>> the
>>>>> intended recipient of this email, you must neither take any action
>>> based
>>>>> upon its contents, nor copy or show it to anyone. Please contact the
>>> sender
>>>>> if you believe you have received this email in error. Shape Blue Ltd
>>> is a
>>>>> company incorporated in England & Wales. ShapeBlue Services India LLP
>>> is a
>>>>> company incorporated in India and is operated under license from Shape
>>> Blue
>>>>> Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in
>>> Brasil
>>>>> and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty
>>> Ltd is
>>>>> a company registered by The Republic of South Africa and is traded
>>> under
>>>>> license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>>>>>
>>>
>>> Find out more about ShapeBlue and our range of CloudStack related services
>>>
>>> IaaS Cloud Design & Build<
>>> http://shapeblue.com/iaas-cloud-design-and-build//>
&

Re: marvin test cases + travis

[Abhinandan Prateek]

It is possible, I will check.

> On 30-Apr-2015, at 3:43 pm, Rajani Karuturi  wrote:
>
> Hey Abhi,
>
> In the recent travis runs, its not printing the test case in output (
> https://travis-ci.org/apache/cloudstack/jobs/60634577#L5443)
>
> It used to print the test case name and status (
> https://travis-ci.org/apache/cloudstack/jobs/59958134#L4205)
>
> Do you think it can be due to any recent changes?
>
> ~Rajani
>
> On Thu, Apr 30, 2015 at 10:32 AM, Abhinandan Prateek <
> abhinandan.prat...@shapeblue.com> wrote:
>
>>
>>There are more than 10 additional suites that can still be included to
>> the travis-CI.
>> Since the current set runs comfortably I will go ahead and add more. If
>> the system gets overloaded, then we can balance the kind of test suites and
>> amount of test suits that run comfortably on travis.
>>
>> -abhi
>>
>>
>>
>>
>> Find out more about ShapeBlue and our range of CloudStack related services
>>
>> IaaS Cloud Design & Build<
>> http://shapeblue.com/iaas-cloud-design-and-build//>
>> CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
>> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
>> CloudStack Software Engineering<
>> http://shapeblue.com/cloudstack-software-engineering/>
>> CloudStack Infrastructure Support<
>> http://shapeblue.com/cloudstack-infrastructure-support/>
>> CloudStack Bootcamp Training Courses<
>> http://shapeblue.com/cloudstack-training/>
>>
>> This email and any attachments to it may be confidential and are intended
>> solely for the use of the individual to whom it is addressed. Any views or
>> opinions expressed are solely those of the author and do not necessarily
>> represent those of Shape Blue Ltd or related companies. If you are not the
>> intended recipient of this email, you must neither take any action based
>> upon its contents, nor copy or show it to anyone. Please contact the sender
>> if you believe you have received this email in error. Shape Blue Ltd is a
>> company incorporated in England & Wales. ShapeBlue Services India LLP is a
>> company incorporated in India and is operated under license from Shape Blue
>> Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil
>> and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is
>> a company registered by The Republic of South Africa and is traded under
>> license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>>

Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
CloudStack Software 
Engineering<http://shapeblue.com/cloudstack-software-engineering/>
CloudStack Infrastructure 
Support<http://shapeblue.com/cloudstack-infrastructure-support/>
CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>

This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England & Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue Ltd. Shape 
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company 
registered by The Republic of South Africa and is traded under license from 
Shape Blue Ltd. ShapeBlue is a registered trademark.

Re: minor issues seen in travis.yml

[Abhinandan Prateek]

> On 30-Apr-2015, at 2:46 pm, Rohit Yadav  wrote:
>
> On a second look I did not find the issues you shared on 4.5 or master? Did 
> not find the first issue, the second one has two tests: 
> component/test_acl_isolatednetwork_delete component/test_acl_isolatednetwork  
> (both are different with the same prefix).

I fixed it.

>
>> On 30-Apr-2015, at 6:12 am, Raja Pullela  wrote:
>>
>> Hi,
>>
>> I saw couple of issue in travis.yml -
>>
>> -  3rd line:  "smoke/smoke/test_reset_vm_on_reboot" - it should be 
>> "smoke/test_reset_vm_on_reboot"
>>
>> -  7th line: component/test_acl_isolatednetwork - is listed twice
>> will be creating a ticket but wanted to inform ahead.
>
> Regards,
> Rohit Yadav
> Software Architect, ShapeBlue
> M. +91 88 262 30892 | rohit.ya...@shapeblue.com
> Blog: bhaisaab.org | Twitter: @_bhaisaab
>
>
>
> Find out more about ShapeBlue and our range of CloudStack related services
>
> IaaS Cloud Design & Build
> CSForge – rapid IaaS deployment framework
> CloudStack Consulting
> CloudStack Software 
> Engineering
> CloudStack Infrastructure 
> Support
> CloudStack Bootcamp Training 
> Courses
>
> This email and any attachments to it may be confidential and are intended 
> solely for the use of the individual to whom it is addressed. Any views or 
> opinions expressed are solely those of the author and do not necessarily 
> represent those of Shape Blue Ltd or related companies. If you are not the 
> intended recipient of this email, you must neither take any action based upon 
> its contents, nor copy or show it to anyone. Please contact the sender if you 
> believe you have received this email in error. Shape Blue Ltd is a company 
> incorporated in England & Wales. ShapeBlue Services India LLP is a company 
> incorporated in India and is operated under license from Shape Blue Ltd. 
> Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
> operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company 
> registered by The Republic of South Africa and is traded under license from 
> Shape Blue Ltd. ShapeBlue is a registered trademark.

Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build
CSForge – rapid IaaS deployment framework
CloudStack Consulting
CloudStack Software 
Engineering
CloudStack Infrastructure 
Support
CloudStack Bootcamp Training Courses

This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England & Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue Ltd. Shape 
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company 
registered by The Republic of South Africa and is traded under license from 
Shape Blue Ltd. ShapeBlue is a registered trademark.

Re: marvin test cases + travis

[Abhinandan Prateek]

> On 30-Apr-2015, at 12:05 pm, Rajani Karuturi  wrote:
>
> Hi Abhi,
> Can we also add findbugs check in travis?
>

Let me check the status of findbug, if all the issues are resolved then we can 
make it part of CI.
If not we can make it part of build, and generate and publish the findbug 
reports so that people can fix the issues.

> ~Rajani
>
> On Thu, Apr 30, 2015 at 10:32 AM, Abhinandan Prateek <
> abhinandan.prat...@shapeblue.com> wrote:
>
>>
>>There are more than 10 additional suites that can still be included to
>> the travis-CI.
>> Since the current set runs comfortably I will go ahead and add more. If
>> the system gets overloaded, then we can balance the kind of test suites and
>> amount of test suits that run comfortably on travis.
>>
>> -abhi
>>
>>
>>
>>
>> Find out more about ShapeBlue and our range of CloudStack related services
>>
>> IaaS Cloud Design & Build<
>> http://shapeblue.com/iaas-cloud-design-and-build//>
>> CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
>> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
>> CloudStack Software Engineering<
>> http://shapeblue.com/cloudstack-software-engineering/>
>> CloudStack Infrastructure Support<
>> http://shapeblue.com/cloudstack-infrastructure-support/>
>> CloudStack Bootcamp Training Courses<
>> http://shapeblue.com/cloudstack-training/>
>>
>> This email and any attachments to it may be confidential and are intended
>> solely for the use of the individual to whom it is addressed. Any views or
>> opinions expressed are solely those of the author and do not necessarily
>> represent those of Shape Blue Ltd or related companies. If you are not the
>> intended recipient of this email, you must neither take any action based
>> upon its contents, nor copy or show it to anyone. Please contact the sender
>> if you believe you have received this email in error. Shape Blue Ltd is a
>> company incorporated in England & Wales. ShapeBlue Services India LLP is a
>> company incorporated in India and is operated under license from Shape Blue
>> Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil
>> and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is
>> a company registered by The Republic of South Africa and is traded under
>> license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>>

Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
CloudStack Software 
Engineering<http://shapeblue.com/cloudstack-software-engineering/>
CloudStack Infrastructure 
Support<http://shapeblue.com/cloudstack-infrastructure-support/>
CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>

This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England & Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue Ltd. Shape 
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company 
registered by The Republic of South Africa and is traded under license from 
Shape Blue Ltd. ShapeBlue is a registered trademark.

Re: [DISCUSS] State of 4.5 and testing in local environments

[Abhinandan Prateek]

Yes, lot of sanity testing can be accomplished by the automated test suites 
that we already have.

There are still lot of tests that can be run using the travis-CI, (need to see 
how many more without loading the travis system). Some of the companies 
including Shapeblue are already running most or all of the test cases.  This 
means that the latest branches  (4.5, 4.6) already have a level of sanity.

At this stage we should define the amount of coverage that automation provides 
and also look at the areas where automation is failing, and work towards 
covering it.  We need this as we continue to find issues that are not covered 
by automation.

I agree that while releasing if issues are found then we fix them and also 
write tests so that these do not reoccur.

-abhi

> On 30-Apr-2015, at 7:42 am, David Nalley  wrote:
>
> The problem is really two fold.
> Cutting an RC isn't terribly time consuming, once you've done it a
> dozen times or so, it goes by pretty quickly.
>
> The problem is the time it takes to do any material testing; and that
> we don't have a way of telling what the status of a candidate is
> without doing lots of manual testing. We've had multiple cases of
> having enough binding votes for 4.5.x candidates only for someone to
> find problems. This leads me (and this could just be my perspective)
> to let an RC sit for a while - get folks to test it. My experience as
> a person voting is that rapid churn of RCs leads me to not even
> attempt to setup a testing environment, much less do any testing. I
> found that by the time I could get around to testing an RC vote had
> been cancelled and it had been rerolled, sometimes twice.
>
> I've said this before, and I'll toss it out again. I think we have to
> start 'trusting' the automated tests. We find lots of problems
> manually, but we don't improve the testing situation for those blocker
> issues that stopped us from releasing. I'm of the opinion we should
> release quickly, very quickly. But if we have to spend a week just
> looking for bugs, that will never fly. So - let the standard be
> automated tests - and if there's a problem, we create an automated
> test for it, and solve in a week or two. That will force us to live
> and die by automated tests.
>
> --David
>
> On Wed, Apr 29, 2015 at 9:45 AM, Rohit Yadav  
> wrote:
>> Hi Wilder - Thanks we’ll need all the ammo we have :) I’ve already done my 
>> testings wrt XS 6.2/6.5 and KVM qemu 2.0/2.1/2.2 so will test KVM 1.5 and 
>> VMware 5.5.
>>
>> Hi Daan - makes sense, we’re “so" late with 4.5.1 that we need to focus on 
>> 4.6.0 to avoid delaying it. I’ve asked David regarding co-piloting the next 
>> 4.5.1 RC since he could be busy and I want to help with lifting some 
>> weights. I’m planning to do basic tests with VMware today, publish new 
>> systemvmtemplates tomorrow (I’m already done with KVM and Xen) and plan to 
>> cut a 4.5.1 RC on Monday and if we don’t hit any blocker or regressions ACS 
>> 4.5.1 should be released by the end of next week.
>>
>>> On 29-Apr-2015, at 2:49 pm, Wilder Rodrigues 
>>>  wrote:
>>>
>>> Hi Rohit,
>>>
>>> I will join you in testing 4.5 form next week - just have to finish some 
>>> stuff.
>>>
>>> My environments will be:
>>>
>>> * Xen 6.2/6.5
>>> * KVM (qemu 1.5.3 and 2.1)
>>>
>>> Let’s rock!
>>>
>>> Cheers,
>>> Wilder
>>>
>>> On 28 Apr 2015, at 18:33, Rohit Yadav  wrote:
>>>
 Hi all,

 ### 4.5 Release Effort

 I’ve been exhaustively testing ACS 4.5 wrt Xen 6.2, Xen 6.5, KVM (qemu 
 2.0, 2.3) and I feel we’re pretty good but we need testing efforts and I 
 want to help drive efforts to releasing ACS 4.5.1 -- if you’ve any issues 
 that you would like to get fixed that are either regressions or blockers 
 can you please share on this thread? If we don’t find any blockers or 
 regressions let us invest in ACS 4.5 testing and release it soon. For 
 other minor issues we can always fix them and release 4.5.2 etc if and 
 when needed in future.

 Regarding my 4.5 testing - I’ve tested basic vm life cycle operations 
 (deploy, start, stop, destroy/expunge, migrate to another host, migrate to 
 another storage pool, deploy using iso) for all cases and found no issues;

 KVM with basic zone (with/without security groups, SG blockers were found 
 and fixed)
 KVM with Adv zone (with/without security groups, both isolated network and 
 VPC worked, networking issues were found and fixed)
 XenServer 6.2 with basic and adv zones (with/without security groups, no 
 SG issues found)
 XenServer 6.5 with basic and adv zones (with/without security groups, SG 
 blockers found and fixed)

 I found one issue that could be a blocker (if it’s not a hardware/env 
 issue) -- when using security groups in advance zone with a dedicated vlan 
 id (say vlan://500), I was unable to access the VMs (CPVM, SSVM, VR or 
 user vms) though all normal vm_life cycles see

marvin test cases + travis

[Abhinandan Prateek]

There are more than 10 additional suites that can still be included to the 
travis-CI.
Since the current set runs comfortably I will go ahead and add more. If the 
system gets overloaded, then we can balance the kind of test suites and amount 
of test suits that run comfortably on travis.

-abhi




Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build
CSForge – rapid IaaS deployment framework
CloudStack Consulting
CloudStack Software 
Engineering
CloudStack Infrastructure 
Support
CloudStack Bootcamp Training Courses

This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England & Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue Ltd. Shape 
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company 
registered by The Republic of South Africa and is traded under license from 
Shape Blue Ltd. ShapeBlue is a registered trademark.

Re: minor issues seen in travis.yml

[Abhinandan Prateek]

Filed the ticket https://issues.apache.org/jira/browse/CLOUDSTACK-8429

Fixing it and including some more tests.

-abhi

> On 30-Apr-2015, at 9:42 am, Raja Pullela  wrote:
>
> Hi,
>
> I saw couple of issue in travis.yml -
>
> -  3rd line:  "smoke/smoke/test_reset_vm_on_reboot" - it should be 
> "smoke/test_reset_vm_on_reboot"
>
> -  7th line: component/test_acl_isolatednetwork - is listed twice
> will be creating a ticket but wanted to inform ahead.
>
> best,
> Raja

Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build
CSForge – rapid IaaS deployment framework
CloudStack Consulting
CloudStack Software 
Engineering
CloudStack Infrastructure 
Support
CloudStack Bootcamp Training Courses

This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England & Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue Ltd. Shape 
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company 
registered by The Republic of South Africa and is traded under license from 
Shape Blue Ltd. ShapeBlue is a registered trademark.

Re: [4.6] Trouble with virtual router

[Abhinandan Prateek]

Had similar problem where SSVM and CPVM came up but not the VR.
In my case I traced it to systemvm.iso not getting updated on XenServer, due to 
the old host-tag.
On deleting the host tag the MS was able to copy the systemvm.iso to Xen and 
things were fine after that.

-abhi


> On 28-Apr-2015, at 10:15 am, Mike Tutkowski  
> wrote:
>
> Hi,
>
> Tonight I tried to re-create a cloud from scratch and made use of the
> following system template:
>
> http://jenkins.buildacloud.org/job/build-systemvm64-master/lastSuccessfulBuild/artifact/tools/appliance/dist/systemvm64template-master-4.6.0-xen.vhd.bz2
>
> My SSVM and CPVM get IP addresses and seem to behave OK; however, my VR
> never gets into the Running state. It gets to a point and then is restarted
> (this happens a couple times). Eventually CS gives up on it.
>
> I only have two XenServer 6.2 hosts in this environment. The system VMs are
> running on local storage.
>
> Thoughts on this?
>
> Thanks!
>
> --
> *Mike Tutkowski*
> *Senior CloudStack Developer, SolidFire Inc.*
> e: mike.tutkow...@solidfire.com
> o: 303.746.7302
> Advancing the way the world uses the cloud
> *™*

Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build
CSForge – rapid IaaS deployment framework
CloudStack Consulting
CloudStack Software 
Engineering
CloudStack Infrastructure 
Support
CloudStack Bootcamp Training Courses

This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England & Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue Ltd. Shape 
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company 
registered by The Republic of South Africa and is traded under license from 
Shape Blue Ltd. ShapeBlue is a registered trademark.

Re: [marvin tests] interpreting results

[Abhinandan Prateek]

Hi Gaurav,

  Your réponse will definitely help us in focusing in  the right direction.

Thanks a lot !
-abhi



> On 24-Apr-2015, at 7:11 pm, Gaurav Aradhye  wrote:
>
> Abhi, went through the logs. The tests which have FAILED have failed because 
> product behavior is not as expected in the test.
> Tests with Exception seem have issue in test code.
>
> Regards,
> Gaurav Aradhye
>
> On Apr 24, 2015, at 4:47 PM, Abhinandan Prateek 
>  wrote:
>
>> Attaching the logs. This is with latest 4.5 branch.
>>
>>
>> Find out more about ShapeBlue and our range of CloudStack related services
>>
>> IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
>> CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
>> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
>> CloudStack Software 
>> Engineering<http://shapeblue.com/cloudstack-software-engineering/>
>> CloudStack Infrastructure 
>> Support<http://shapeblue.com/cloudstack-infrastructure-support/>
>> CloudStack Bootcamp Training 
>> Courses<http://shapeblue.com/cloudstack-training/>
>>
>> This email and any attachments to it may be confidential and are intended 
>> solely for the use of the individual to whom it is addressed. Any views or 
>> opinions expressed are solely those of the author and do not necessarily 
>> represent those of Shape Blue Ltd or related companies. If you are not the 
>> intended recipient of this email, you must neither take any action based 
>> upon its contents, nor copy or show it to anyone. Please contact the sender 
>> if you believe you have received this email in error. Shape Blue Ltd is a 
>> company incorporated in England & Wales. ShapeBlue Services India LLP is a 
>> company incorporated in India and is operated under license from Shape Blue 
>> Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil 
>> and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a 
>> company registered by The Republic of South Africa and is traded under 
>> license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>> 
>>
>> Regards,
>> -abhi
>>
>>
>>> On 24-Apr-2015, at 4:21 pm, Gaurav Aradhye  
>>> wrote:
>>>
>>> Hi Abhi,
>>>
>>> FAILED indicates it’s an assertion error. Even if the test case is 
>>> expecting a failure, it must have been written in such a way that when an 
>>> operation fails, test case passes.
>>> Here it indicates that operation which should have failed has succeeded, 
>>> might be a product issue.
>>>
>>> Exception indicates there is an unexpected exception in the code, other 
>>> than assertions.
>>>
>>> Can you please share the detailed logs from failed_plus_exceptions.txt file 
>>> in the log folder?
>>>
>>> Regards,
>>> Gaurav Aradhye
>>>
>>> On Apr 24, 2015, at 4:04 PM, Abhinandan Prateek 
>>>  wrote:
>>>
>>>>
>>>> Have been trying to run some marvin test cases. Need to know how to 
>>>> interpret the result.
>>>>
>>>> On running test cases I see several success and failure messages. Lets 
>>>> take example of each from output of
>>>> /root/cloudstack/test/integration/component/test_acl_isolatednetwork.py on 
>>>> ACS 4.5, taking a sample from output:
>>>>
>>>> === TestName: test_02_createNetwork_admin_foruserinsamedomain | Status : 
>>>> SUCCESS ===
>>>>
>>>> ***The above says the test case is successful, basically the functionality 
>>>> works.
>>>>
>>>> === TestName: test_09_createNetwork_user_foruserinsamedomain | Status : 
>>>> FAILED ===
>>>>
>>>> ***From the code it appears that the test is expected to fail, this also 
>>>> means the test case is successful.
>>>>
>>>> === TestName: test_12_deployvm_admin_foruserinsamedomain | Status : 
>>>> EXCEPTION ===
>>>>
>>>> I assume this means the test case did not execute successfully ? If it 
>>>> is on a fresh environment will that mean something is wrong with the test 
>>>> itself ?
>>>>
>>>> Can someone share some gyan on above ?
>>>>
>>>> -abhi
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
&

[marvin tests] interpreting results

[Abhinandan Prateek]

Have been trying to run some marvin test cases. Need to know how to interpret 
the result.

On running test cases I see several success and failure messages. Lets take 
example of each from output of
/root/cloudstack/test/integration/component/test_acl_isolatednetwork.py on ACS 
4.5, taking a sample from output:

=== TestName: test_02_createNetwork_admin_foruserinsamedomain | Status : 
SUCCESS ===

***The above says the test case is successful, basically the functionality 
works.

=== TestName: test_09_createNetwork_user_foruserinsamedomain | Status : FAILED 
===

***From the code it appears that the test is expected to fail, this also means 
the test case is successful.

=== TestName: test_12_deployvm_admin_foruserinsamedomain | Status : EXCEPTION 
===

I assume this means the test case did not execute successfully ? If it is 
on a fresh environment will that mean something is wrong with the test itself ?

Can someone share some gyan on above ?

-abhi










Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build
CSForge – rapid IaaS deployment framework
CloudStack Consulting
CloudStack Software 
Engineering
CloudStack Infrastructure 
Support
CloudStack Bootcamp Training Courses

This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England & Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue Ltd. Shape 
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company 
registered by The Republic of South Africa and is traded under license from 
Shape Blue Ltd. ShapeBlue is a registered trademark.

Re: Next ACS release?

[Abhinandan Prateek]

A smaller release cycle benefits individual companies running their own cloud. 
Basically they are looking for the next versions that have features that they 
need or are incrementally moving to new releases smoothly as they know what 
they need, the test environment and deployment is with them and can quickly 
figure out if a release is worth moving to or not.

Companies providing services need to worry about all the versions out there 
that their customers are using. In general with many versions around you need 
to support and patch more and more versions as time goes on. The QA needs to be 
more extensive here as the real deployment is somewhere else. More releases in 
use create bigger overhead.

The release timelines suggested are from 2 weeks to 6 months !   We can target 
for a smaller release cycle but I don’t think we are there yet to have a two 
week release cycle.
For a smaller release cycle the RM needs to ensure that very specific code gets 
in. The test coverage is measured and is good so that it almost eliminates the 
possibility of regression.
To decrease release cycle companies should collaborate more on QA, like they 
can divide the QA work and also share the QA automation results.

Some of this is already happening like the infra that SBP, Daan and others have 
put in place, I accept my ignorance of some of these things that are already 
there.

We can target for a major release very six month and can have incremental 
fortnightly releases with control on patches and fixes that get in.

-abhi


> On 23-Apr-2015, at 3:26 pm, Ian Southam  wrote:
>
> At SBP, we are working on two environments for testing.  Primarily focussed 
> on Xen and KVM with Nicira and without Nicira.
>
> One will focus more on building and extending the current integration tests 
> and making sure they are running on real hardware in real life situations.  
> The other we are planning to be more “chaos monkey” in operation.  So 
> genuinely testing how the system reacts to hypervisors crashing.  Loss of 
> network connectivity, VR failures/failovers and so on.
>
> I know other people in the community are doing similar things.  By having 
> enough such systems that together have a high coverage of all the various 
> configuration and hardware combinations out there, we should be able to 
> really get to a much shorter delivery cycle with quite high levels of 
> confidence about quality.
>
> We are not there yet but, I am absolutely convinced that aiming for a 2 week 
> release cycle is the way to go.
>
> —
> Grts!
> Ian
>
>> On 23 Apr 2015, at 10:38, Abhinandan Prateek 
>>  wrote:
>>
>> On automated QA front following is available:
>>
>> 1. Before pushing in a feature a dev can run simulator based tests that will 
>> basically test various functionality that does not depend on the type of 
>> Hypervisor.
>> (https://cwiki.apache.org/confluence/display/CLOUDSTACK/Validating+check-ins+for+your+local+changes%2C+using+Simulator.)
>> The test suite are located in testing/integration/smoke folder.
>> The travis system runs most of the test in this folder.
>>
>>
>> 2. Then there are tests that will require real hardware to run most of these 
>> are in testing/integration/component.
>>
>>
>> Basically there are two kind of test cases not strictly classified as per 
>> above directory structure - Ones that have required_hardware set as “false” 
>> and “others” that have this as “true”.
>> The one with required_hardware is false can run on simulator but for the 
>> others you need a real Hypervisor based environment.
>>
>> I have been able to run a lot of tests both with hardware and simulator. The 
>> problem I faced is scattered documentation. Missing description of a model 
>> deployment; say for a particular Hypervisor that will allow a dev to run the 
>> provisioning tests.
>>
>> In all there is a huge scope for improvement.
>>
>>
>> -abhi
>>
>>
>>> On 23-Apr-2015, at 1:02 am, Remi Bergsma  wrote:
>>>
>>> Hi,
>>>
>>> The '2 week cycle' was intended as something to work towards, like a
>>> mission. The nice thing is that it immediately shows that we cannot achieve
>>> such a thing if we keep our current method of (semi)manual testing, as you
>>> said. Totally agree.
>>>
>>> That's why we need to improve on our automated functional testing. And that
>>> will of course take time and effort. As I don't currently have a clear
>>> overview of what is already available, I'll try to get that first and work
>>> from there. I spoke to several people recently and most seem to do testing
>>> on their own way (wit

Re: Next ACS release?

[Abhinandan Prateek]

On automated QA front following is available:

1. Before pushing in a feature a dev can run simulator based tests that will 
basically test various functionality that does not depend on the type of 
Hypervisor.
(https://cwiki.apache.org/confluence/display/CLOUDSTACK/Validating+check-ins+for+your+local+changes%2C+using+Simulator.)
The test suite are located in testing/integration/smoke folder.
The travis system runs most of the test in this folder.


2. Then there are tests that will require real hardware to run most of these 
are in testing/integration/component.


Basically there are two kind of test cases not strictly classified as per above 
directory structure - Ones that have required_hardware set as “false” and 
“others” that have this as “true”.
The one with required_hardware is false can run on simulator but for the others 
you need a real Hypervisor based environment.

I have been able to run a lot of tests both with hardware and simulator. The 
problem I faced is scattered documentation. Missing description of a model 
deployment; say for a particular Hypervisor that will allow a dev to run the 
provisioning tests.

In all there is a huge scope for improvement.


-abhi


> On 23-Apr-2015, at 1:02 am, Remi Bergsma  wrote:
>
> Hi,
>
> The '2 week cycle' was intended as something to work towards, like a
> mission. The nice thing is that it immediately shows that we cannot achieve
> such a thing if we keep our current method of (semi)manual testing, as you
> said. Totally agree.
>
> That's why we need to improve on our automated functional testing. And that
> will of course take time and effort. As I don't currently have a clear
> overview of what is already available, I'll try to get that first and work
> from there. I spoke to several people recently and most seem to do testing
> on their own way (with sometimes cool automatic stuff going on!). It'd be
> interesting to bring that together and share.
> I think improving this is important, so I'll try to spend as much time on
> this as possible.
>
> However, the tread started with comments on 4.5. Let's try to get it stable
> and deliver 4.5.1. What is still to be done here? Can we share the load
> somehow to fasten it?
>
> Regards,
> Remi
>
> 2015-04-22 20:13 GMT+02:00 Paul Angus :
>
>> I fully support the idea of a stable master with an automated CD process
>> to protect against regressions.
>>
>> However, we obviously don't currently have fantastic integration
>> testing otherwise we wouldn't have relied on 'people' to pick up the
>> release blockers recently.  A 2 week release cycle IMHO is way too frequent
>> to expect 'people' to be carrying out integration testing.
>>
>> Maybe 1 month is a workable compromise until the integration testing is of
>> a coverage and standard that can give real confidence.
>>
>>
>>
>> I'm also going to compile a list of people who vote "+1 - it works on my
>> laptop" and devise a Guinness related punishment for any of them that show
>> up at the CloudStack day in Dublin.
>>
>> Regards
>>
>> Paul Angus
>> Cloud Architect
>> S: +44 20 3603 0540 | M: +447711418784 | T: CloudyAngus
>> paul.an...@shapeblue.com
>>
>> -Original Message-
>> From: Remi Bergsma [mailto:r...@remi.nl]
>> Sent: 22 April 2015 10:25
>> To: dev@cloudstack.apache.org
>> Subject: Re: Next ACS release?
>>
>> I'd be happy to help here as well. Last week in Austin, we also discussed
>> this topic a couple of times. I do agree shorter release cycles are better.
>>
>> In my opinion, the first thing to improve is the minor releases in both the
>> 4.4 and 4.5 branches. If we speed those up to let's say once every 2-weeks
>> we will be able to do the next minor release with less effort and users can
>> choose to either wait to start using 4.5 or start now and upgrade when the
>> next minor release is available. This would have helped in getting 4.5 out
>> on time and quickly fixing issues after the initial release. Also, it will
>> save time which we can invest in getting the next release out on time, etc.
>>
>> The common thing here is we need more automated testing, preferably
>> functional testing in addition to unit testing. There might also be other
>> steps that we do manually now that can be automated. I'll try to understand
>> the current process first and then come up with a proposal to improve which
>> we can discuss.
>>
>> Regards,
>> Remi
>>
>> 2015-04-22 10:56 GMT+02:00 Erik Weber :
>>
>>> On Wed, Apr 22, 2015 at 10:46 AM, Daan Hoogland
>>> 
>>> wrote:
>>>
 On Wed, Apr 22, 2015 at 10:29 AM, Erik Weber 
>>> wrote:
> On Wed, Apr 22, 2015 at 9:49 AM, Stephen Turner <
 stephen.tur...@citrix.com>
> wrote:
>
>> I have to admit I'm a bit sceptical because when we did have a
 four-month
>> release cycle, we never seemed to manage to meet it. Personally I
>>> think
>> six-monthly might be easier.
>>
>> Having said that, part of the problem was the long close-down
>> period
 where
>> we 

Re: Primary Storage algorithm - when having more primary storages

[Abhinandan Prateek]

Following algorithms are used to select storage pool:

random, userconcentratedpod_random: RANDOM
userdispersing: Select on basis of least no of volumes
firstfitleastconsumed: Select on basis of remaining capacity

These values can be set for “vm.allocation.algorithm” global config variable.

-abhi

> On 20-Apr-2015, at 8:17 pm, Andrija Panic  wrote:
>
> Sorry for my ignorance - meaing completely random (except the scope ?)
>
> On 20 April 2015 at 16:01, Wei ZHOU  wrote:
>
>> /etc/cloudstack/management/componentContext.xml
>>
>>  > class="com.cloud.utils.component.AdapterList">
>>
>>  
>>  
>>  
>>  
>>  
>>
>>  
>>
>>
>> 2015-04-20 15:44 GMT+02:00 Andrija Panic :
>>
>>> Hi people,
>>>
>>> just wondering - if I have 3 primary storages (3 x NFS boxes) - what is
>> the
>>> volume alocation algoritm - is it compelte random, or is it like 1
>> client's
>>> volume goes always to 1 storage...
>>>
>>> Any info appreciated !
>>>
>>> Thanks,
>>>
>>> --
>>>
>>> Andrija Panić
>>>
>>
>
>
>
> --
>
> Andrija Panić

Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build
CSForge – rapid IaaS deployment framework
CloudStack Consulting
CloudStack Software 
Engineering
CloudStack Infrastructure 
Support
CloudStack Bootcamp Training Courses

This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England & Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue Ltd. Shape 
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company 
registered by The Republic of South Africa and is traded under license from 
Shape Blue Ltd. ShapeBlue is a registered trademark.