Review Request: CLOUDSTACK-2274 : The detail view doesn't recover from loading status when trying to delete a zone with physical network on it

2013-04-30 Thread Isaac Chiang

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10860/
---

Review request for cloudstack and Pranav Saxena.


Description
---

According to CS' fronend logic, there is a general error handling function in 
cloudStack.js line 95. Hense this is a common issue for detail view when a 
request failed from server.
This patch try not to against current UI logic and provide a statusCode 
callback to capture failed request. The added callback will remove loading div 
from detailView.
This patch is a suggested solution to the issue.

Thanks


This addresses bug CLOUDSTACK-2274.


Diffs
-

  ui/scripts/system.js 7aa0566 

Diff: https://reviews.apache.org/r/10860/diff/


Testing
---

Test from UI and work well


Thanks,

Isaac Chiang



Re: Review Request: Add docs for MidoNet networking plugin [CLOUDSTACK-996]

2013-04-30 Thread Jessica Tomechak

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10136/#review19943
---



docs/en-US/plugin-midonet-preparations.xml


Believe the DTD requires a  tag within each entry tag. Like 
Setting Name. The same comment applies throughout 
the doc here.


- Jessica Tomechak


On April 30, 2013, 5:22 a.m., Dave Cahill wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/10136/
> ---
> 
> (Updated April 30, 2013, 5:22 a.m.)
> 
> 
> Review request for cloudstack and Radhika PC.
> 
> 
> Description
> ---
> 
> Adding docs for MidoNet networking plugin [CLOUDSTACK-996]
> 
> Plugin itself is awaiting review / commit here:
> [PATCH 1] https://reviews.apache.org/r/9897/
> [PATCH 2] https://reviews.apache.org/r/9898/
> 
> 
> This addresses bug CLOUDSTACK-996.
> 
> 
> Diffs
> -
> 
>   docs/en-US/MidoNet_Plugin_Guide.ent PRE-CREATION 
>   docs/en-US/MidoNet_Plugin_Guide.xml PRE-CREATION 
>   docs/en-US/plugin-midonet-about.xml PRE-CREATION 
>   docs/en-US/plugin-midonet-features.xml PRE-CREATION 
>   docs/en-US/plugin-midonet-introduction.xml PRE-CREATION 
>   docs/en-US/plugin-midonet-preparations.xml PRE-CREATION 
>   docs/en-US/plugin-midonet-provider.xml PRE-CREATION 
>   docs/en-US/plugin-midonet-revisions.xml PRE-CREATION 
>   docs/en-US/plugin-midonet-ui.xml PRE-CREATION 
>   docs/en-US/plugin-midonet-usage.xml PRE-CREATION 
>   docs/publican-plugin-midonet.cfg PRE-CREATION 
> 
> Diff: https://reviews.apache.org/r/10136/diff/
> 
> 
> Testing
> ---
> 
> Built docs.
> 
> 
> Thanks,
> 
> Dave Cahill
> 
>



[ACS42]Clarifications regarding VM Scaleup

2013-04-30 Thread Sailaja Mada
Hi,


1)  When I tried scaleVirtualMachine API  to scale to Medium offering from 
small I get the response as Sync request.

But Its calling an query AsyncJob with undefined as the jobId after sclaeup. 
Why ?

API log :

2013-04-30 13:17:31,569 INFO  [cloud.api.ApiServer] (ApiServer-7:null) 
(userId=1 accountId=1 sessionId=null) /10.144.6.19 -- GET 
/client/api?command=scaleVirtualMachine&id=b9d56c44-0a6c-41b8-a5f8-c3f1542246e6&serviceofferingid=65bf6f1f-ebfc-40bc-9737-300e6610cb8e
 HTTP/1.1 200 b9d56c44-0a6c-41b8-a5f8-c3f1542246e6b9d56c44-0a6c-41b8-a5f8-c3f1542246e6admin86400326-acf2-11e2-a799-ca27ffbee488ROOT2013-04-29T17:08:09+0530Runningfalseee01867c-cc53-4e7f-a653-3b2a63c7deeaAdvzone1Advanced0cd6f14c-ad57-4592-bc7d-6b0f68ca9647xen13.cloud.com98c3760f-7005-418e-b9c0-8b90ed7f2caatemplate1template1false65bf6f1f-ebfc-40bc-9737-300e6610cb8eMedium
 
Instance1100010240%3286cdb39c-acf2-11e2-a799-ca27ffbee4880ROOTf853fe77-45dc-45bc-8303-b3d3010a8c3a43561921-e0a5-43b1-9f55-ea6cd090ed3fadminnw1255.255.255.010.1.1.110.1.1.249vlan://810vlan://810GuestIsolatedtrue02:00:5f:f2:00:03XenServeri-2-17-VM0
 200 1803

2013-04-30 13:17:32,908 INFO  [cloud.api.ApiServer] (catalina-exec-22:null) 
(userId=2 accountId=2 sessionId=A584DF11563A8692B47D558847532CE0) 10.144.6.19 
-- GET 
command=queryAsyncJobResult&jobId=undefined&response=json&sessionkey=RRz%2F6uNDd72XHbIsFqSXFeRpuLw%3D&_=1367308143698
 431 Unable to execute API command queryasyncjobresult due to invalid value. 
Invalid parameter jobid value=undefined due to incorrect long value format, or 
entity does not exist or due to incorrect parameter annotation for the field in 
api cmd class.


2)  After scaleup, resource usage of domain/account are not getting updated 
 - I will create the bug for this.

Thanks,
Sailaja.M




Re: Review Request: Add docs for MidoNet networking plugin [CLOUDSTACK-996]

2013-04-30 Thread Dave Cahill


> On April 30, 2013, 8:01 a.m., Jessica Tomechak wrote:
> > docs/en-US/plugin-midonet-preparations.xml, line 40
> > 
> >
> > Believe the DTD requires a  tag within each entry tag. Like 
> > Setting Name. The same comment applies 
> > throughout the doc here.

Wouldn't Publican fail to build on DTD errors?

Running this command successfully builds the doc for me:
publican build --config=publican-plugin-midonet.cfg --langs=en-US --format=pdf


- Dave


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10136/#review19943
---


On April 30, 2013, 5:22 a.m., Dave Cahill wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/10136/
> ---
> 
> (Updated April 30, 2013, 5:22 a.m.)
> 
> 
> Review request for cloudstack and Radhika PC.
> 
> 
> Description
> ---
> 
> Adding docs for MidoNet networking plugin [CLOUDSTACK-996]
> 
> Plugin itself is awaiting review / commit here:
> [PATCH 1] https://reviews.apache.org/r/9897/
> [PATCH 2] https://reviews.apache.org/r/9898/
> 
> 
> This addresses bug CLOUDSTACK-996.
> 
> 
> Diffs
> -
> 
>   docs/en-US/MidoNet_Plugin_Guide.ent PRE-CREATION 
>   docs/en-US/MidoNet_Plugin_Guide.xml PRE-CREATION 
>   docs/en-US/plugin-midonet-about.xml PRE-CREATION 
>   docs/en-US/plugin-midonet-features.xml PRE-CREATION 
>   docs/en-US/plugin-midonet-introduction.xml PRE-CREATION 
>   docs/en-US/plugin-midonet-preparations.xml PRE-CREATION 
>   docs/en-US/plugin-midonet-provider.xml PRE-CREATION 
>   docs/en-US/plugin-midonet-revisions.xml PRE-CREATION 
>   docs/en-US/plugin-midonet-ui.xml PRE-CREATION 
>   docs/en-US/plugin-midonet-usage.xml PRE-CREATION 
>   docs/publican-plugin-midonet.cfg PRE-CREATION 
> 
> Diff: https://reviews.apache.org/r/10136/diff/
> 
> 
> Testing
> ---
> 
> Built docs.
> 
> 
> Thanks,
> 
> Dave Cahill
> 
>



Re: Review Request: Add docs for MidoNet networking plugin [CLOUDSTACK-996]

2013-04-30 Thread Dave Cahill


> On April 30, 2013, 8:01 a.m., Jessica Tomechak wrote:
> > docs/en-US/plugin-midonet-preparations.xml, line 40
> > 
> >
> > Believe the DTD requires a  tag within each entry tag. Like 
> > Setting Name. The same comment applies 
> > throughout the doc here.
> 
> Dave Cahill wrote:
> Wouldn't Publican fail to build on DTD errors?
> 
> Running this command successfully builds the doc for me:
> publican build --config=publican-plugin-midonet.cfg --langs=en-US 
> --format=pdf

The DocBook  site also shows this as an example of a legal entry (no para):
3.1415927

ref: http://www.docbook.org/tdg/en/html/entry.html


- Dave


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10136/#review19943
---


On April 30, 2013, 5:22 a.m., Dave Cahill wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/10136/
> ---
> 
> (Updated April 30, 2013, 5:22 a.m.)
> 
> 
> Review request for cloudstack and Radhika PC.
> 
> 
> Description
> ---
> 
> Adding docs for MidoNet networking plugin [CLOUDSTACK-996]
> 
> Plugin itself is awaiting review / commit here:
> [PATCH 1] https://reviews.apache.org/r/9897/
> [PATCH 2] https://reviews.apache.org/r/9898/
> 
> 
> This addresses bug CLOUDSTACK-996.
> 
> 
> Diffs
> -
> 
>   docs/en-US/MidoNet_Plugin_Guide.ent PRE-CREATION 
>   docs/en-US/MidoNet_Plugin_Guide.xml PRE-CREATION 
>   docs/en-US/plugin-midonet-about.xml PRE-CREATION 
>   docs/en-US/plugin-midonet-features.xml PRE-CREATION 
>   docs/en-US/plugin-midonet-introduction.xml PRE-CREATION 
>   docs/en-US/plugin-midonet-preparations.xml PRE-CREATION 
>   docs/en-US/plugin-midonet-provider.xml PRE-CREATION 
>   docs/en-US/plugin-midonet-revisions.xml PRE-CREATION 
>   docs/en-US/plugin-midonet-ui.xml PRE-CREATION 
>   docs/en-US/plugin-midonet-usage.xml PRE-CREATION 
>   docs/publican-plugin-midonet.cfg PRE-CREATION 
> 
> Diff: https://reviews.apache.org/r/10136/diff/
> 
> 
> Testing
> ---
> 
> Built docs.
> 
> 
> Thanks,
> 
> Dave Cahill
> 
>



Re: Review Request: CLOUDSTACK-1748: IP Reservation results in reserving the broadcast IP of the network as well

2013-04-30 Thread Saksham Srivastava


> On April 18, 2013, 5:18 p.m., Sateesh Chodapuneedi wrote:
> >

Since we are not creating subnets for guest CIDR, there is no need for a 
separate broadcast IP.
The guest Broadcast will be same as the Network Broadcast.

Currently this is the behaviour :

CIDR 10.1.1.0/26
Network CIDR 10.1.1.0/24
Reserved Range : 10.1.1.63-10.1.1.254

CIDR 10.1.1.224/27
Network CIDR 10.1.1.0/24
Reserved Range : 10.1.1.1-10.1.1.224

CIDR 10.1.1.32/27
Network CIDR 10.1.1.0/24
Reserved Range : 10.1.1.1-10.1.1.32 , 10.1.1.63-10.1.1.254

Since broadcast is an assignable IP so it should be a part of Reserved range. 
Closing the request.


- Saksham


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10078/#review19395
---


On March 22, 2013, 10:04 a.m., Saksham Srivastava wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/10078/
> ---
> 
> (Updated March 22, 2013, 10:04 a.m.)
> 
> 
> Review request for cloudstack, Murali Reddy and Sateesh Chodapuneedi.
> 
> 
> Description
> ---
> 
> While reserving IPs, broadcast IPs of guestvmcidr is also getting reserved.
> 
> 
> Diffs
> -
> 
>   server/src/com/cloud/api/ApiResponseHelper.java 663139d 
> 
> Diff: https://reviews.apache.org/r/10078/diff/
> 
> 
> Testing
> ---
> 
> CIDR : 10.1.1.0/26 (10.1.1.1-10.1.1.62, Broadcast: 10.1.1.63)
> Network CIDR: 10.1.1.0/24 (10.1.1.1-10.1.1.254, Broadcast: 10.1.1.255)
> Reserved Range: 10.1.1.64-10.1.1.254
> 
> 
> Thanks,
> 
> Saksham Srivastava
> 
>



Re: [DOCS] Rebuilding Docs this weekend + adding draft docs

2013-04-30 Thread Jessica Tomechak
On Fri, Apr 26, 2013 at 9:11 AM, Chip Childers wrote:

> On Fri, Apr 26, 2013 at 11:15:42AM -0400, Sebastien Goasguen wrote:
> >
> > On Apr 26, 2013, at 9:12 AM, Joe Brockmeier  wrote:
> >
> > > Hey all,
> > >
> > > FYI - I'm planning on re-building the docs this weekend with Publican
> > > 3.x and adding the docs for 4.1.0 and 4.2.0 (master) as "draft" docs. I
> > > think we should start putting up the docs from master in draft form so
> > > folks have an easier time getting to them while testing, etc.
>

By this I assume you mean putting them up on the site,
http://cloudstack.apache.org/docs/, is that correct?

btw, I don't think I have permissions on the infrastructure, so I can't
help with uploading new doc  versions. I am happy to let others handle the
task, as that has worked just fine so far. But if you do want to add an
extra backup resource in case another person is ever needed, I'd be happy
to have an account and some how-to instructions.

Cheers and thanks as always for all you do on docs,
Jessica T.


> > >
> > > Thoughts, comments, flames?
> >
> > Just a request to build in every available language…even if translation
> is partial.
> > This will encourage translators to finish :)
>
> +1
>
> >
> > >
> > > Best,
> > >
> > > jzb
> > > --
> > > Joe Brockmeier
> > > j...@zonker.net
> > > Twitter: @jzb
> > > http://www.dissociatedpress.net/
> >
> >
>


Re: [MERGE] CS-2163

2013-04-30 Thread Nitin Mehta
Prasanna - Thanks for your question. The reasons for not using createTags
are as follows :-

- tags functionality is for grouping resources than adding meta
information and is allowed to all users. What I am proposing is for the
admin
to have better control over the first class objects in CS. This ability
should be with admin only.
- Also list* (* == volume, vm etc.) APIs can list the tags for the enduser
and mixing tags with the meta information wouldn't go well as they
are admin only. I don't want to mix the meta information with the resource
response because they are not the attributes of the resource, we should
try to get to this model in future.
(Like we don't want to add stats to vm response )
- Lets not use something just because they seem similar, because they both
might evolve in a different way in future.

Hope you agree. Let me know your thoughts on this.

Thanks,
-Nitin

On 30/04/13 11:06 AM, "Prasanna Santhanam"  wrote:

>On Mon, Apr 29, 2013 at 04:01:27AM +, Nitin Mehta wrote:
>> I would like to merge the feature which will add the ability in CS so
>>that the user can have better control over first class objects in CS
>> 
>> - The feature can be found in the branch cs-2163 and has been rebased
>>with master.
>> - Jira ticket: https://issues.apache.org/jira/browse/CLOUDSTACK-2163
>> - The FS can be found @
>>https://cwiki.apache.org/confluence/display/CLOUDSTACK/Ability+to+have+be
>>tter+control+over+first+class+objects+in+CS
>> - I have added the unit tests and marvin tests as well.
>> - I ran the RAT check as well with no failures.
>
>Why not just use resource tags to convey this meta-information? All it
>would mean for the third-party subscriber would be to get this from
>the event bus as you mentioned.
>
>createTags  & resourceType = VM/Disk/Snapshot etc & key=k, value=v?
>
>-- 
>Prasanna.,
>
>
>Powered by BigRock.com



Re: [DOCS][TRANSLATIONS] Upate

2013-04-30 Thread Isaac Chiang
Hi Sebastien:

We're hosting a blog for CloudStack in Taiwan. I've write an article for
sharing the translation experience with Transifex. Hope it does help :)

http://www.cloudstack-tw.org/2013/04/translation-with-transifex.html

Let me know if I have to fix some wording, I'm really not good at this.

Thanks & best regards

Isaac


On Mon, Apr 29, 2013 at 4:30 PM, Sebastien Goasguen wrote:

>
> On Apr 28, 2013, at 8:33 AM, Isaac Chiang  wrote:
>
> > Hi all:
> >The Glossary function on Transifex is quite awesome. I captured
> > some screenshots for it.
> >
> > http://i.imgur.com/WPOcVsI.png
> >
> > The link above is the Glossary page on Transifex, we can add new term
> here.
> >
> > We need to determine this term is a noun, verb or something else (There
> is
> > a combo box for it ) and corresponding translation. We can also add some
> > comment of it (Avoid misunderstanding if you're co-working with someone).
> >
> > When you are translating on the page(link below), and if you select the
> the
> > "Glossary" tab, the glossary tab window will show the added terms
> > associated to the sentence you are translating as a hint.
> >
> > http://i.imgur.com/GqD07pn.png
> >
> > The function can avoid inconsistent problem and better started in the
> > beginning of translation. I am too late for discovering this function. So
> > the zh_TW's document got lots of inconsistent translation problem. And
> I'm
> > now rebuilding the dictionary  :(
> >
> > For your information and happy translating! :D
> >
>
> Thanks a lot Isaac, it would be great if you could write a blog about this.
>
> > Regards
> >
> > Isaac
> >
> >
> >
> >
> >
> >
> > On Wed, Apr 24, 2013 at 4:20 PM, Sebastien Goasguen  >wrote:
> >
> >>
> >> On Apr 24, 2013, at 4:18 AM, Isaac Chiang 
> wrote:
> >>
> >>> I Get it :)  I'll investigate this function deeper to see how it can
> help
> >>> us.
> >>
> >> Terrific, I was hoping you would say that :)
> >>
> >>>
> >>> Many thanks.
> >>>
> >>> Isaac
> >>>
> >>>
> >>> On Wed, Apr 24, 2013 at 4:11 PM, Sebastien Goasguen  >>> wrote:
> >>>
> 
>  On Apr 24, 2013, at 3:58 AM, Isaac Chiang 
> >> wrote:
> 
> > Hi Sebastien:
> >
> >  Thanks!! I see the "View glossary" button just right at the
> > upper right corner of the table in this page:
> >
> > https://www.transifex.com/projects/p/ACS_DOCS/
> >
> > After entering the glossary page, I am able to select language for
>  glossary
> > and add new term.
> >
> > So I'm wondering if this glossary table will be appended to the
> >> document
>  or
> > it just provide the hint
> >
> > when we're translating?
> 
>  We are not using it:
> 
>  http://help.transifex.com/features/glossary.html
> 
>  However we could to insure consistency of the translations between
>  translators of the same language.
> 
> 
> >
> > Regards
> >
> >
> > Isaac
> >
> >
> >
> >
> > On Wed, Apr 24, 2013 at 3:21 PM, Sebastien Goasguen <
> run...@gmail.com
> > wrote:
> >
> >>
> >> On Apr 23, 2013, at 10:17 PM, Isaac Chiang 
>  wrote:
> >>
> >>> Hi all:
> >>>I have a few questions and looking for help. After the documents
> >>> have been translated, can I use Transifex to review these
> documents?
> >> Cause
> >>> I noticed that some of the terminology aren't consistent during the
> >>> translation and the language sources are too large for me to
> handling
>  the
> >>> review process. So I'm wondering if it is possible for a normal
> user
> >> in
> >>> Transifex to mark the sentence as reviewed and prevent from
> reviewing
>  it
> >>> twice?
> >>
> >> Isaac, considering you translated 95% of the documentation in zh-TW
> I
>  made
> >> you a maintainer of the ACS_DOCS
> >> You should be able to review your own translations, string by
> string.
> >>>
> >>> Another question is about the glossary, is it part of translation
>  program
> >>> or a assistant mechanism to support translation?
> >>
> >> Don't know, I have never looked at the glossary. Where do you see
> it ?
> >>
> >>>
> >>> Thanks & best regards
> >>>
> >>> Isaac
> >>>
> >>>
> >>> On Tue, Apr 23, 2013 at 9:50 PM, Gavin Lee 
>  wrote:
> >>>
>  Following Milamber's guide , below process I used for
>  4.1.xmessage.properties on zh_CN:
>  1. git pull for the latest messages_zh_CN.properties
>  2. native2ascii -reverse messages_zh_CN.properties
>  /tmp/zh_CN.properties.native -encoding utf8
>  3. copy to the CloudStack_UI transifex project:
>  cp/tmp/zh_CN.properties.native /
>  txprj/acsui/translations/CloudStack_UI.41xmessageproperties
>  4. tx push -l zh_CN -r CloudStack_UI.41xmessageproperties -t
>  5. Do translation on transifex, there are some untrans

Re: [DOCS] Rebuilding Docs this weekend + adding draft docs

2013-04-30 Thread Jessica Tomechak
On Tue, Apr 30, 2013 at 1:56 AM, Jessica Tomechak <
jessica.tomec...@gmail.com> wrote:

>
>
> On Fri, Apr 26, 2013 at 9:11 AM, Chip Childers 
> wrote:
>
>> On Fri, Apr 26, 2013 at 11:15:42AM -0400, Sebastien Goasguen wrote:
>> >
>> > On Apr 26, 2013, at 9:12 AM, Joe Brockmeier  wrote:
>> >
>> > > Hey all,
>> > >
>> > > FYI - I'm planning on re-building the docs this weekend with Publican
>> > > 3.x and adding the docs for 4.1.0 and 4.2.0 (master) as "draft" docs.
>> I
>> > > think we should start putting up the docs from master in draft form so
>> > > folks have an easier time getting to them while testing, etc.
>>
>
> By this I assume you mean putting them up on the site,
> http://cloudstack.apache.org/docs/, is that correct?
>
> btw, I don't think I have permissions on the infrastructure, so I can't
> help with uploading new doc  versions. I am happy to let others handle the
> task, as that has worked just fine so far. But if you do want to add an
> extra backup resource in case another person is ever needed, I'd be happy
> to have an account and some how-to instructions.
>

Ah, I now see the how-to instructions:
https://cwiki.apache.org/CLOUDSTACK/releasing-docs.html


>
> Cheers and thanks as always for all you do on docs,
> Jessica T.
>
>
>>  > >
>> > > Thoughts, comments, flames?
>> >
>> > Just a request to build in every available language…even if translation
>> is partial.
>> > This will encourage translators to finish :)
>>
>> +1
>>
>> >
>> > >
>> > > Best,
>> > >
>> > > jzb
>> > > --
>> > > Joe Brockmeier
>> > > j...@zonker.net
>> > > Twitter: @jzb
>> > > http://www.dissociatedpress.net/
>> >
>> >
>>
>
>


Re: Update on 4.1 blockers ?

2013-04-30 Thread nicolas.lamirault

Hi,
i merge this patch https://reviews.apache.org/r/10802/ in the 4.1 code.
i try another upgrade. I put a comment on the issue

https://issues.apache.org/jira/browse/CLOUDSTACK-2194#comment-13645407

Le 29/04/2013 22:18, Chip Childers a écrit :

On Mon, Apr 29, 2013 at 08:56:11AM -0400, Sebastien Goasguen wrote:

HI Nicolas,

Any updates on:

CLOUDSTACK-528 and CLOUDSTACK-2194

I see that you opened

CLOUDSTACK-2207

We are waiting on your feedback to enter into a vote for 4.1.

-Sebastien



Nicolas,

I'd really love to get you to confirm the fixes for the three bugs noted
above, but am going to move forward with starting another release VOTE
tomorrow morning either way (unless I hear that things are still broken).
If you are able to take the time to re-test today or tomorrow (I believe
you are in the EU), it would be very appreciated...  and if you are still
having problems please do let us know! The sooner the better, since cutting
a release takes some effort.

Thanks again for the diligent bug reports and testing!

-chip





--
Nicolas Lamirault

_

Ce message et ses pieces jointes peuvent contenir des informations 
confidentielles ou privilegiees et ne doivent donc
pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce 
message par erreur, veuillez le signaler
a l'expediteur et le detruire ainsi que les pieces jointes. Les messages 
electroniques etant susceptibles d'alteration,
France Telecom - Orange decline toute responsabilite si ce message a ete 
altere, deforme ou falsifie. Merci.

This message and its attachments may contain confidential or privileged 
information that may be protected by law;
they should not be distributed, used or copied without authorisation.
If you have received this email in error, please notify the sender and delete 
this message and its attachments.
As emails may be altered, France Telecom - Orange is not liable for messages 
that have been modified, changed or falsified.
Thank you.



[GSoC][Proposal] Integration project to deploy and use Mesos on a CloudStack based cloud

2013-04-30 Thread Dharmesh Kakadia
Hi,

I am Dharmesh Kakdia and interested in project "Integration project to
deploy and use Mesos on a CloudStack based cloud" (
https://issues.apache.org/jira/browse/CLOUDSTACK-1784)

I am working on proposal and want to get feedback. Please provide
suggestions :)

*

Abstract:

The project aims to bring cloudformation[1] like service to cloudstack. One
of the prime use-case is cluster computing frameworks on cloudstack. A
cloudformation service will give users and administrators of cloudstack
ability to manage and control a set of resources easily. The cloudformation
will allow booting and configuring a set of VMs and form a cluster. Simple
example would be LAMP stack. More complex clusters such as mesos or hadoop
cluster requires a little more advanced configuration. There is already
some work done by Chiradeep Vittal at this front [5] using route and
sinatra. In this project, I will implement cloudformation service and
demonstrate how to run mesos cluster using it.

Mesos:

Mesos is a resource management platform for clusters [2]. It aims to
increase resource utilization of clusters by sharing cluster resources
among multiple processing frameworks(like MapReduce, MPI, Graph Processing)
or multiple instances of same framework. It provides efficient resource
isolation through use of containers. Uses zookeeper for state maintenance
and fault tolerance.

What can run on mesos ?

Spark: A cluster computing framework based on the Resilient Distributed
Datasets (RDDs) abstraction. RDD is more generalized than MapReduce and can
support iterative and interactive computation while retaining fault
tolerance, scalability, data locality etc.

Hadoop: Hadoop is fault tolerant and scalable distributed computing
framework based on MapReduce abstraction.

Begel: A graph processing framework based on pregel.

and other frameworks like MPI, Hypertable.

How to deploy mesos

Mesos provides cluster installation scripts [7] for cluster deployment.
There are also scripts available to deploy a cluster on Amazon EC2 [8].

Deliverables:

1. Cloudformation service implementation on cloudstack.

2. Integration of cloudformation with cloudmonkey, CLI tool.

2. Proof of concept of running mesos on top of cloudstack using the service.

3. Related documentation.

Architecture and Tools:

The high level architecture I propose is as follows:

  It includes following components:

1. CloudFormation ReST server:

This acts as a point of contact to and exposes CloudFormation functionality
as ReST service. This can be accessed directly or through cloudmonkey. I
will add those functionalities in cloudmonkey. I plan to use dropwizard [3]
to start with. Later may be the API server can be merged with management
server. I plan to use mysql for storing details of clusters.

2. Provisioning:

Provisioning module is responsible for handling the booting process of the
VMs through cloudstack. This uses the cloudstack APIs for launching VMs. I
plan to use preconfigured templates/images with required dependencies
installed, which will make cluster creation process much faster even for
large clusters. Error handling is very important part of this module. For
example, what you do if few VMs fail to boot in cluster ?

3. Configuration:

This module deals with configuring the VMs to form a cluster. This can be
done via manual scripts/code or via configuration management tools like
chef. I plan to use workflow automation tools like rundeck [4].

In general, I want to use tools around java as much as possible as
cloudstack is mostly in java. This will make the project easier to maintain
and develop.

Why ReST ?

I believe decoupling provided by the ReST architecture makes it easy to
extend in future.  Say for example, if one wants to extend the
cloudformation service to include features like auto-scaling of clusters
based on some user criteria (rule-based/monitoring etc).

 Services:

1. POST : create a cluster

   -

  accepts : cluster configuration json
  -

  produces : clusterId

 2. GET : get the current status of request

   -

  accepts : clusterId
  -

  produces : json describing current status if the cluster.

3. DELETE : remove a cluster

   -

  accepts : clusterId
  -

  produces : result (sucess/failure)

 4. UPDATE : adding a node to a cluster

   -

  accepts : cluster configuration json and clusterId
  -

  produces : result (sucess/failure)


Timeline:

1-1.5 week : project design. Architecture, tools selection, API design.

1-1.5 week : getting familiar with cloudstack codebase and architecture
details.

1-1.5 week : getting familiar with mesos internals.

1-1.5 week : setting up the dev environment

2-3 week : build provisioning and configuration module

Midterm evaluation: provisioning module, configuration module

1-2 week : develope ReST server

2-3 week : test and integrate

About me:

I am MS by Research student at International Institute of Information
Technology Hyderabad (IIIT-H), Hy

Re: Review Request: CLOUDSTACK-2087: Destroying the instance is not decrementing the primary storage usage [Resource Count table - No of volumes is not got decremented]

2013-04-30 Thread Sanjay Tripathi

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10725/
---

(Updated April 30, 2013, 10:15 a.m.)


Review request for cloudstack, Devdeep Singh, Nitin Mehta, Sateesh 
Chodapuneedi, and Min Chen.


Changes
---

updated Patch after resolving the conflicts with latest code.


Description
---

CLOUDSTACK-2087: Destroying the instance is not decrementing the primary 
storage usage [Resource Count table - No of volumes is not got decremented] 


This addresses bug CLOUDSTACK-2087.


Diffs (updated)
-

  server/src/com/cloud/resourcelimit/ResourceLimitManagerImpl.java e8805ae 
  server/src/com/cloud/vm/VirtualMachineManagerImpl.java b0d6378 

Diff: https://reviews.apache.org/r/10725/diff/


Testing
---

Tests:
1. Deploy an instance from a user account.
2. Check the updated resource count (primary storage and volume).
3. Destroy the same instance.
4. Verify the decremented resource count from the account detailView.  


Thanks,

Sanjay Tripathi



Re: [DOCS][TRANSLATIONS] Upate

2013-04-30 Thread Sebastien Goasguen

On Apr 30, 2013, at 5:26 AM, Isaac Chiang  wrote:

> Hi Sebastien:
> 
> We're hosting a blog for CloudStack in Taiwan. I've write an article for
> sharing the translation experience with Transifex. Hope it does help :)
> 
> http://www.cloudstack-tw.org/2013/04/translation-with-transifex.html
> 
> Let me know if I have to fix some wording, I'm really not good at this.
> 

Isaac, that's perfect. I just tweeted it

thanks

> Thanks & best regards
> 
> Isaac
> 
> 
> On Mon, Apr 29, 2013 at 4:30 PM, Sebastien Goasguen wrote:
> 
>> 
>> On Apr 28, 2013, at 8:33 AM, Isaac Chiang  wrote:
>> 
>>> Hi all:
>>>   The Glossary function on Transifex is quite awesome. I captured
>>> some screenshots for it.
>>> 
>>> http://i.imgur.com/WPOcVsI.png
>>> 
>>> The link above is the Glossary page on Transifex, we can add new term
>> here.
>>> 
>>> We need to determine this term is a noun, verb or something else (There
>> is
>>> a combo box for it ) and corresponding translation. We can also add some
>>> comment of it (Avoid misunderstanding if you're co-working with someone).
>>> 
>>> When you are translating on the page(link below), and if you select the
>> the
>>> "Glossary" tab, the glossary tab window will show the added terms
>>> associated to the sentence you are translating as a hint.
>>> 
>>> http://i.imgur.com/GqD07pn.png
>>> 
>>> The function can avoid inconsistent problem and better started in the
>>> beginning of translation. I am too late for discovering this function. So
>>> the zh_TW's document got lots of inconsistent translation problem. And
>> I'm
>>> now rebuilding the dictionary  :(
>>> 
>>> For your information and happy translating! :D
>>> 
>> 
>> Thanks a lot Isaac, it would be great if you could write a blog about this.
>> 
>>> Regards
>>> 
>>> Isaac
>>> 
>>> 
>>> 
>>> 
>>> 
>>> 
>>> On Wed, Apr 24, 2013 at 4:20 PM, Sebastien Goasguen >> wrote:
>>> 
 
 On Apr 24, 2013, at 4:18 AM, Isaac Chiang 
>> wrote:
 
> I Get it :)  I'll investigate this function deeper to see how it can
>> help
> us.
 
 Terrific, I was hoping you would say that :)
 
> 
> Many thanks.
> 
> Isaac
> 
> 
> On Wed, Apr 24, 2013 at 4:11 PM, Sebastien Goasguen  wrote:
> 
>> 
>> On Apr 24, 2013, at 3:58 AM, Isaac Chiang 
 wrote:
>> 
>>> Hi Sebastien:
>>> 
>>> Thanks!! I see the "View glossary" button just right at the
>>> upper right corner of the table in this page:
>>> 
>>> https://www.transifex.com/projects/p/ACS_DOCS/
>>> 
>>> After entering the glossary page, I am able to select language for
>> glossary
>>> and add new term.
>>> 
>>> So I'm wondering if this glossary table will be appended to the
 document
>> or
>>> it just provide the hint
>>> 
>>> when we're translating?
>> 
>> We are not using it:
>> 
>> http://help.transifex.com/features/glossary.html
>> 
>> However we could to insure consistency of the translations between
>> translators of the same language.
>> 
>> 
>>> 
>>> Regards
>>> 
>>> 
>>> Isaac
>>> 
>>> 
>>> 
>>> 
>>> On Wed, Apr 24, 2013 at 3:21 PM, Sebastien Goasguen <
>> run...@gmail.com
>>> wrote:
>>> 
 
 On Apr 23, 2013, at 10:17 PM, Isaac Chiang 
>> wrote:
 
> Hi all:
>   I have a few questions and looking for help. After the documents
> have been translated, can I use Transifex to review these
>> documents?
 Cause
> I noticed that some of the terminology aren't consistent during the
> translation and the language sources are too large for me to
>> handling
>> the
> review process. So I'm wondering if it is possible for a normal
>> user
 in
> Transifex to mark the sentence as reviewed and prevent from
>> reviewing
>> it
> twice?
 
 Isaac, considering you translated 95% of the documentation in zh-TW
>> I
>> made
 you a maintainer of the ACS_DOCS
 You should be able to review your own translations, string by
>> string.
> 
> Another question is about the glossary, is it part of translation
>> program
> or a assistant mechanism to support translation?
 
 Don't know, I have never looked at the glossary. Where do you see
>> it ?
 
> 
> Thanks & best regards
> 
> Isaac
> 
> 
> On Tue, Apr 23, 2013 at 9:50 PM, Gavin Lee 
>> wrote:
> 
>> Following Milamber's guide , below process I used for
>> 4.1.xmessage.properties on zh_CN:
>> 1. git pull for the latest messages_zh_CN.properties
>> 2. native2ascii -reverse messages_zh_CN.properties
>> /tmp/zh_CN.properties.native -encoding utf8
>> 3. copy to the CloudStack_UI transifex project:
>> cp/tmp/zh_CN.properties.nati

Review Request: CLOUDSTACK-702: Tests for Multiple IP Ranges

2013-04-30 Thread sanjeev n

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10861/
---

Review request for cloudstack, Prasanna Santhanam and SrikanteswaraRao Talluri.


Description
---

CLOUDSTACK-702: Tests for Multiple IP Ranges

1. Deleting IP Range from the existing CIDR.


This addresses bug CLOUDSTACK-702.


Diffs
-

  test/integration/component/test_multiple_ip_ranges.py 489e7ca 

Diff: https://reviews.apache.org/r/10861/diff/


Testing
---

Tested with fixed IP addresses since code has not been implemented(To make sure 
no syntax errors).


Thanks,

sanjeev n



[GSoC] Discussion on "Create a cloud in a box using devcloud"

2013-04-30 Thread Pulkit Singhal
Hi everyone,

I'm interested in the project "Create a cloud in a box using DevCloud".

I'm a MS student at IIIT-Hyderabad. I've good experience with Python, Bash,
openstack, Xen/KVM and automation(chef/puppet).

As per my discussion with Sebastien, my understanding is that the project
aims to extend devcloud to provision multiple instances of devcloud
appliances for simulating more realistic production environments.

While installing devcloud, I realized that for setting up more complex
environments with multiple hosts and clusters, the procedure is too manual.
So, for this project we certainly need a command line utility to automate
installation and configurations.

I’m a little uncertain about ‘simulating production environments’. I see
this happening in two ways.


*1.* Developers still use their development system to host complete cloud.
Of course, in this case it would be multiple virtual box instances running
devcloud and a management server running on the host itself. For this
scenario, the command line utility can automate the setup. .e.g

*$ devcloud --deploy management-server# deploy management server on
local system
$ devcloud --deploy host -n 2 --provider=virtualbox# deploy two
hosts on virtualbox
*


The utility will download the updated source from git and install the
management server. The hosts will be provisioned through the devcloud
virtual box appliance or KVM image.


*2. *Developers have a set of physical machines where they plan to host
cloudstack. In this case, hosts won’t be running on virtualbox/kvm, but
physical machines. A deployment scenario here would look like.


*$* devcloud --deploy mangement_server -H 10.0.0.3 -u root -p pass
*$* devcloud --deploy host -H 10.0.0.4,10.0.0.5 -u root -p pass2
--hypervisor=xen


Here, the utility will log into the specified machines and configure them
accordingly . No virtual appliance
will be involved.

I kindly request you to share your views regarding my approach and your
expectations for this project.

Thanks and Regards,
Pulkit Singhal


Re: [GSoC][Proposal] Integration project to deploy and use Mesos on a CloudStack based cloud

2013-04-30 Thread Sebastien Goasguen
Dharmesh, see in-line

On Apr 30, 2013, at 5:34 AM, Dharmesh Kakadia  wrote:

> Hi,
> 
> I am Dharmesh Kakdia and interested in project "Integration project to
> deploy and use Mesos on a CloudStack based cloud" (
> https://issues.apache.org/jira/browse/CLOUDSTACK-1784)
> 
> I am working on proposal and want to get feedback. Please provide
> suggestions :)
> 
> *
> 
> Abstract:
> 
> The project aims to bring cloudformation[1] like service to cloudstack. One
> of the prime use-case is cluster computing frameworks on cloudstack. A
> cloudformation service will give users and administrators of cloudstack
> ability to manage and control a set of resources easily. The cloudformation
> will allow booting and configuring a set of VMs and form a cluster. Simple
> example would be LAMP stack. More complex clusters such as mesos or hadoop
> cluster requires a little more advanced configuration. There is already
> some work done by Chiradeep Vittal at this front [5] using route and

it's using ruote: http://ruote.rubyforge.org

> sinatra. In this project, I will implement cloudformation service and
> demonstrate how to run mesos cluster using it.

You will create cloud formation templates that describe a mesos cluster

> 
> Mesos:
> 
> Mesos is a resource management platform for clusters [2]. It aims to
> increase resource utilization of clusters by sharing cluster resources
> among multiple processing frameworks(like MapReduce, MPI, Graph Processing)
> or multiple instances of same framework. It provides efficient resource
> isolation through use of containers. Uses zookeeper for state maintenance
> and fault tolerance.
> 
> What can run on mesos ?
> 
> Spark: A cluster computing framework based on the Resilient Distributed
> Datasets (RDDs) abstraction. RDD is more generalized than MapReduce and can
> support iterative and interactive computation while retaining fault
> tolerance, scalability, data locality etc.
> 
> Hadoop: Hadoop is fault tolerant and scalable distributed computing
> framework based on MapReduce abstraction.
> 
> Begel: A graph processing framework based on pregel.
> 
> and other frameworks like MPI, Hypertable.
> 
> How to deploy mesos
> 
> Mesos provides cluster installation scripts [7] for cluster deployment.
> There are also scripts available to deploy a cluster on Amazon EC2 [8].

It would be nice to see if these scripts can be used as is with the CloudStack 
EC2 service.

> 
> Deliverables:
> 
> 1. Cloudformation service implementation on cloudstack.
> 
> 2. Integration of cloudformation with cloudmonkey, CLI tool.

2. is a little confusing. I believe that what Chiradeep prototype runs on the 
client side. What is needed is a server side implementation.
That way we could use existing cloudformation cli tools to talk to it.
I don't understand where cloudmonkey comes into play. CloudMonkey is a cli for 
the CloudStack API. Unless you plan to integrate the cloudformation API 
directly in the cloudstack source code, the integration you propose is not 
clear to me.


> 
> 2. Proof of concept of running mesos on top of cloudstack using the service.
> 
> 3. Related documentation.
> 
> Architecture and Tools:
> 
> The high level architecture I propose is as follows:
> 
>  It includes following components:
> 
> 1. CloudFormation ReST server:
> 
> This acts as a point of contact to and exposes CloudFormation functionality
> as ReST service.

I believe CloudFormation is really a Query API.

> This can be accessed directly or through cloudmonkey. I
> will add those functionalities in cloudmonkey. I plan to use dropwizard [3]
> to start with. Later may be the API server can be merged with management
> server. I plan to use mysql for storing details of clusters.

At first, you could do a prototype that is decoupled from CloudStack. You need 
to clarify the integration with CloudMonkey.

> 
> 2. Provisioning:
> 
> Provisioning module is responsible for handling the booting process of the
> VMs through cloudstack. This uses the cloudstack APIs for launching VMs. I
> plan to use preconfigured templates/images with required dependencies
> installed, which will make cluster creation process much faster even for
> large clusters. Error handling is very important part of this module. For
> example, what you do if few VMs fail to boot in cluster ?
> 
> 3. Configuration:
> 
> This module deals with configuring the VMs to form a cluster. This can be
> done via manual scripts/code or via configuration management tools like
> chef. I plan to use workflow automation tools like rundeck [4].

knife-cloudstack provides chef/cloudstack provisioning. You may want to have a 
look at this.
I would prefer seeing chef or puppet recipes for Mesos (they probably already 
exist), rather than rundeck.
However if you do want to use rundeck, check the Apache incubator project: 
Provisionr , I know they use it to provision Hadoop.

> 
> In general, I want to use tools around java as much as possible as
> cloudstack is mostly in java

[EVENTS] Linux Tag Berlin May 22-25

2013-04-30 Thread Sebastien Goasguen
Hi, [BCC users@]

I managed to get an Apache CloudStack booth at Linux Tag Berlin, May 22-25.

I need help to man the booth and talk about CloudStack. If you are interested 
please let me know asap so that I request an exhibitor badge for you.

thanks,

-Sebastien

Re: Update on 4.1 blockers ?

2013-04-30 Thread Sebastien Goasguen
Nicolas also added a new comment:

"Same bug with another component.
Before database upgrade process, CS try to read configuration for the ApiServer 
initialization. And all entries which have category=hidden aren't encrypted.
It is possible to force DatabaseUpgrade process to be the first component to be 
called ?"

Can someone look at it ?

-sebastien

On Apr 30, 2013, at 5:31 AM, nicolas.lamira...@orange.com wrote:

> Hi,
> i merge this patch https://reviews.apache.org/r/10802/ in the 4.1 code.
> i try another upgrade. I put a comment on the issue
> 
> https://issues.apache.org/jira/browse/CLOUDSTACK-2194#comment-13645407
> 
> Le 29/04/2013 22:18, Chip Childers a écrit :
>> On Mon, Apr 29, 2013 at 08:56:11AM -0400, Sebastien Goasguen wrote:
>>> HI Nicolas,
>>> 
>>> Any updates on:
>>> 
>>> CLOUDSTACK-528 and CLOUDSTACK-2194
>>> 
>>> I see that you opened
>>> 
>>> CLOUDSTACK-2207
>>> 
>>> We are waiting on your feedback to enter into a vote for 4.1.
>>> 
>>> -Sebastien
>>> 
>> 
>> Nicolas,
>> 
>> I'd really love to get you to confirm the fixes for the three bugs noted
>> above, but am going to move forward with starting another release VOTE
>> tomorrow morning either way (unless I hear that things are still broken).
>> If you are able to take the time to re-test today or tomorrow (I believe
>> you are in the EU), it would be very appreciated...  and if you are still
>> having problems please do let us know! The sooner the better, since cutting
>> a release takes some effort.
>> 
>> Thanks again for the diligent bug reports and testing!
>> 
>> -chip
>> 
>> 
> 
> 
> -- 
> Nicolas Lamirault
> 
> _
> 
> Ce message et ses pieces jointes peuvent contenir des informations 
> confidentielles ou privilegiees et ne doivent donc
> pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu 
> ce message par erreur, veuillez le signaler
> a l'expediteur et le detruire ainsi que les pieces jointes. Les messages 
> electroniques etant susceptibles d'alteration,
> France Telecom - Orange decline toute responsabilite si ce message a ete 
> altere, deforme ou falsifie. Merci.
> 
> This message and its attachments may contain confidential or privileged 
> information that may be protected by law;
> they should not be distributed, used or copied without authorisation.
> If you have received this email in error, please notify the sender and delete 
> this message and its attachments.
> As emails may be altered, France Telecom - Orange is not liable for messages 
> that have been modified, changed or falsified.
> Thank you.
> 



VM with wrong Service Offering avec host went into maintenance mode ?

2013-04-30 Thread Fraysse Guillaume
Hi to the list,

A customer notified us that one of its VM is wrongly displayed in CS.
This VM shows up using a service offering of 1 vCPU and 1 GB of RAM
when it is a 4vCPU and 8GB VM in vCenter, which is confirmed in the OS
itself.

Context :
- CloudStack 2.2.13
- VMware ESXi 5.0
- VM is a "classic" Debian 6, same template is used for hundreds of VM

Looking back at CloudStack logs, I only saw that line (I anonymised
some of the data) :
2013-03-06 09:44:46,058 DEBUG [agent.transport.Request]
(HA-Worker-4:work-6557) Seq 4-1829307871: Executing: { Cmd , MgmtId:
345051320510, via: 4, Ver: v1, Flags: 100111,
[{"PrepareForMigrationCommand":{"vm":{"id":377,"name":"i-56-377-VM","bootloader":"HVM","type":"User","cpus":1,"speed":1000,"minRam":1073741824,"maxRam":1073741824,"arch":"x86_64","os":"Debian
GNU/Linux 
6(64-bit)","bootArgs":"","rebootOnCrash":false,"enableHA":false,"limitCpuUse":false,"vncPassword":"4f2dd6c2f15ef53f","params":{"nic_adapter":"E1000"},"disks":[{"id":486,"name":"ROOT-377","mountPoint":"/primarystorage","path":"ROOT-377","size":9663676416,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"d9ddfc82-c3a8-311f-b8c6-57b765af0630","deviceId":0},{"id":487,"name":"DATA-377","mountPoint":"/primarystorage","path":"90d3411ce87049b68863a53f88ce976b","size":53687091200,"type":"DATADISK","storagePoolType":"NetworkFilesystem","storagePoolUuid":"d9ddfc82-c3a8-311f-b8c6-57b765af0630","deviceId":1}],"nics":[{"deviceId":0,"networkRateMbps":200,"defaultNic":true,"ip":"10.200.64.6","netmask":"255.255.255.192","gateway":"10.200.64.1","mac":"06:4b:94:00:16:1b","dns1":"10.200.193.1","dns2":"10.94.53.3","broadcastType":"Vlan","type":"Guest","broadcastUri":"vlan://3052","isolationUri":"vlan://3052","isSecurityGroupEnabled":false,"tags":[]},{"deviceId":1,"networkRateMbps":200,"defaultNic":false,"ip":"10.200.132.208","netmask":"255.255.255.128","gateway":"10.200.132.193","mac":"06:2c:8e:00:16:36","dns1":"10.200.193.1","dns2":"10.94.53.3","broadcastType":"Vlan","type":"Guest","broadcastUri":"vlan://3053","isolationUri":"vlan://3053","isSecurityGroupEnabled":false,"tags":[]},{"deviceId":2,"networkRateMbps":200,"defaultNic":false,"ip":"10.200.0.6","netmask":"255.255.255.192","gateway":"10.200.0.1","mac":"06:76:3a:00:16:00","dns1":"10.200.193.1","dns2":"10.94.53.3","broadcastType":"Vlan","type":"Guest","broadcastUri":"vlan://3051","isolationUri":"vlan://3051","isSecurityGroupEnabled":false,"tags":[]}]},"wait":0}}]
}

There was no change of Service Offering of this VM, and even if there
was one we weren't aware of, it is consistant as the VM would have
been rebooted and would have show up consistantly in VMware and
CloudStack.

The above log seems to date to a maintenance operation where we put
one of the host maintenance mode.

Has anyone experienced this before ? I haven't found a bug like this
in Jira or in the list.

Best regards,
Guillaume


Review Request: CLOUDSTACK-741 global granular parameters and CLOUDSTACK-2036 router template Id

2013-04-30 Thread Harikrishna Patnala

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10862/
---

Review request for cloudstack, Abhinandan Prateek and Nitin Mehta.


Description
---

CLOUDSTACK-741: Granular Global Parameters Added parameters
 to cluster level
 cluster.storage.allocated.capacity.notificationthreshold
 cluster.storage.capacity.notificationthreshold

CLOUDSTACK-2036
global parameter for Router Template ID functionality added
We use 5 parameters to set the router template name for each hypervisor

Moved cpu.overprovisioning.factor and mem.overprovisioning.factor to be able to 
update/list using update/list configuration API at cluster level


This addresses bugs CLOUDSTACK-2036 and CLOUDSTACK-741.


Diffs
-

  server/src/com/cloud/alert/AlertManagerImpl.java 6839d44 
  server/src/com/cloud/configuration/Config.java af6adcf 
  server/src/com/cloud/configuration/ConfigurationManagerImpl.java 068a586 
  server/src/com/cloud/dc/ClusterDetailsDaoImpl.java 4c85918 
  server/src/com/cloud/network/router/VirtualNetworkApplianceManagerImpl.java 
4c7bc75 
  server/src/com/cloud/storage/dao/VMTemplateDao.java 3f1fe93 
  server/src/com/cloud/storage/dao/VMTemplateDaoImpl.java 3b37f24 
  test/integration/smoke/test_global_settings.py ec18cea 

Diff: https://reviews.apache.org/r/10862/diff/


Testing
---

Tested locally


Thanks,

Harikrishna Patnala



Renaming updateVMAffinityGroup -> updateAffinityGroup

2013-04-30 Thread Prasanna Santhanam
Hi Prachi, 

Sorry for bringing this up so late -

Since the feature is not yet released and the API not out in the wild
I thought perhaps the name updateVmAffinityGroup makes more sense as
updateAffinityGroup. This will make it conform with the rest of the
APIs associated with AffinityGroups(create/delete/list). Just makes it
easier to identify the resource the API is acting upon and more
intuitive.

Does the update API do something different that warrants the odd
naming?

Thanks,

-- 
Prasanna.,


Powered by BigRock.com



Re: [DOCS] Rebuilding Docs this weekend + adding draft docs

2013-04-30 Thread Chip Childers
On Tue, Apr 30, 2013 at 01:56:01AM -0700, Jessica Tomechak wrote:
> By this I assume you mean putting them up on the site,
> http://cloudstack.apache.org/docs/, is that correct?

Yes
 
> btw, I don't think I have permissions on the infrastructure, so I can't
> help with uploading new doc  versions.

All committers have the correct permissions


Re: Review Request: When associating an IP to a VPC allow admin's to specify what IP they want to associate. (CLOUDSTACK-1942)

2013-04-30 Thread Marcus Sorensen

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10423/#review19951
---


The crickets have it.

This patch doesn't apply cleanly. If you could update it I'll apply it to 
master.

Thanks!

- Marcus Sorensen


On April 12, 2013, 4:12 p.m., Ryan Dietrich wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/10423/
> ---
> 
> (Updated April 12, 2013, 4:12 p.m.)
> 
> 
> Review request for cloudstack, Prasanna Santhanam, Chiradeep Vittal, and 
> Marcus Sorensen.
> 
> 
> Description
> ---
> 
> https://issues.apache.org/jira/browse/CLOUDSTACK-1942
> 
> This patch will allow you to specify an IP when associating an IP to a VPC.
> 
> 
> Diffs
> -
> 
>   api/src/com/cloud/network/NetworkService.java ab6d7bf 
>   
> api/src/org/apache/cloudstack/api/command/user/address/AssociateIPAddrCmd.java
>  406f782 
>   server/src/com/cloud/network/NetworkManager.java 4af716c 
>   server/src/com/cloud/network/NetworkManagerImpl.java a97f2ce 
>   server/src/com/cloud/network/NetworkServiceImpl.java 4eb620c 
>   server/test/com/cloud/network/MockNetworkManagerImpl.java 18eae08 
>   server/test/com/cloud/vpc/MockNetworkManagerImpl.java bd4fd67 
> 
> Diff: https://reviews.apache.org/r/10423/diff/
> 
> 
> Testing
> ---
> 
> Manually tested using master branch, as well as 4.1.  Tested manually using 
> "ipid" as well as leaving it off resulting in existing functionality.
> 
> Also, ran new marvin test.  This probably could have been incorporated into 
> the the existing test_network.py file, but half of those tests were failing 
> on my system.
> 
> 
> Thanks,
> 
> Ryan Dietrich
> 
>



Re: Review Request: Fix NPE in the planner, in the case that pool ID cannot be looked up in database when deploying a VM

2013-04-30 Thread Chip Childers

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10842/#review19952
---

Ship it!


committed

commit 75832c893b342c905d692e893a46af3dfd838943
Author: Marcus Sorensen 
Date:   Tue Apr 30 15:19:30 2013 +0100

CLOUDSTACK-2281: Fix NPE in the planner, in the case that pool ID cannot be 
looked up in database when deploying a VM

This fixes a null pointer if selected pool on which to deploy is unable
to be looked up via id. Used the same coding style found in the original
code (large if/else block).

If this is accepted, I'll fix master too. This patch doesn't apply
cleanly, but the code is very similar.

Testing:

Fixed broken system, tested against devcloud to ensure that it didn't
break a stock/fresh install (advanced zone with 3 storage pools).
Restarted VMs to ensure that the planner still functioned that way as
well.

- Chip Childers


On April 29, 2013, 10:01 p.m., Marcus Sorensen wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/10842/
> ---
> 
> (Updated April 29, 2013, 10:01 p.m.)
> 
> 
> Review request for cloudstack, Chip Childers, Prachi Damle, and edison su.
> 
> 
> Description
> ---
> 
> This fixes a null pointer if selected pool on which to deploy is unable to be 
> looked up via id. Used the same coding style found in the original code 
> (large if/else block).
> 
> If this is accepted, I'll fix master too. This patch doesn't apply cleanly, 
> but the code is very similar.
> 
> 
> This addresses bug CLOUDSTACK-2281.
> 
> 
> Diffs
> -
> 
>   server/src/com/cloud/deploy/FirstFitPlanner.java 31fc43c 
> 
> Diff: https://reviews.apache.org/r/10842/diff/
> 
> 
> Testing
> ---
> 
> Fixed broken system, tested against devcloud to ensure that it didn't break a 
> stock/fresh install (advanced zone with 3 storage pools). Restarted VMs to 
> ensure that the planner still functioned that way as well.
> 
> 
> Thanks,
> 
> Marcus Sorensen
> 
>



Re: [MERGE] CS-2163

2013-04-30 Thread Prasanna Santhanam
On Tue, Apr 30, 2013 at 09:25:40AM +, Nitin Mehta wrote:
> Prasanna - Thanks for your question. The reasons for not using createTags
> are as follows :-
> 
> - tags functionality is for grouping resources than adding meta
> information and is allowed to all users. What I am proposing is for the
> admin
The FS of tags [1] states the same objectives: 

""" Tag is the first class object in the cloudStack """

The resource tags is based on AWS tags that carry meta-information for
users to do nifty things [2] like managing billing, filtering, external
services etc. In the AWS case it is up to the user to determine what
she does with a tag.

> to have better control over the first class objects in CS. This ability
> should be with admin only.
Why only admin? Like I pointed, I as a user could decide to fire APIs
that do the same failure/backup implementation across my regions if my
provider hasn't enabled any service as you describe in your use case.

> - Also list* (* == volume, vm etc.) APIs can list the tags for the enduser
> and mixing tags with the meta information wouldn't go well as they
> are admin only. I don't want to mix the meta information with the resource
> response because they are not the attributes of the resource, we should
> try to get to this model in future.
That's a scope/access control issue of the API. As an admin I could
reserve a set of tags for myself to use that my users are forbidden to
create. AWS reserves the 'aws' tag.

> (Like we don't want to add stats to vm response )
> - Lets not use something just because they seem similar, because they both
> might evolve in a different way in future.

I'm just trying to understand if the existence of tags was overlooked
before developing this feature. To me it sounds like one can enhance
the existing APIs than have to introduce new ones that can be
potentially confusing. 

[1] https://cwiki.apache.org/confluence/x/PYnlAQ
[2] http://s.apache.org/v4

-- 
Prasanna.,


Powered by BigRock.com



Re: Review Request: When associating an IP to a VPC allow admin's to specify what IP they want to associate. (CLOUDSTACK-1942)

2013-04-30 Thread Prasanna
Sorry - I never got to this in time. +1 to merge and I'll take a look
at the marvin test post-merge.

On Tue, Apr 30, 2013 at 02:48:23PM -, Marcus Sorensen wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/10423/#review19951
> ---
> 
> 
> The crickets have it.
> 
> This patch doesn't apply cleanly. If you could update it I'll apply it to 
> master.
> 
> Thanks!
> 
> - Marcus Sorensen
> 
> 
> On April 12, 2013, 4:12 p.m., Ryan Dietrich wrote:
> > 
> > ---
> > This is an automatically generated e-mail. To reply, visit:
> > https://reviews.apache.org/r/10423/
> > ---
> > 
> > (Updated April 12, 2013, 4:12 p.m.)
> > 
> > 
> > Review request for cloudstack, Prasanna Santhanam, Chiradeep Vittal, and 
> > Marcus Sorensen.
> > 
> > 
> > Description
> > ---
> > 
> > https://issues.apache.org/jira/browse/CLOUDSTACK-1942
> > 
> > This patch will allow you to specify an IP when associating an IP to a VPC.
> > 
> > 
> > Diffs
> > -
> > 
> >   api/src/com/cloud/network/NetworkService.java ab6d7bf 
> >   
> > api/src/org/apache/cloudstack/api/command/user/address/AssociateIPAddrCmd.java
> >  406f782 
> >   server/src/com/cloud/network/NetworkManager.java 4af716c 
> >   server/src/com/cloud/network/NetworkManagerImpl.java a97f2ce 
> >   server/src/com/cloud/network/NetworkServiceImpl.java 4eb620c 
> >   server/test/com/cloud/network/MockNetworkManagerImpl.java 18eae08 
> >   server/test/com/cloud/vpc/MockNetworkManagerImpl.java bd4fd67 
> > 
> > Diff: https://reviews.apache.org/r/10423/diff/
> > 
> > 
> > Testing
> > ---
> > 
> > Manually tested using master branch, as well as 4.1.  Tested manually using 
> > "ipid" as well as leaving it off resulting in existing functionality.
> > 
> > Also, ran new marvin test.  This probably could have been incorporated into 
> > the the existing test_network.py file, but half of those tests were failing 
> > on my system.
> > 
> > 
> > Thanks,
> > 
> > Ryan Dietrich
> > 
> >
> 

-- 
Prasanna.,


Re: [MERGE] CS-2163

2013-04-30 Thread Prasanna Santhanam
Also - tags supports many more resources in CloudStack already as
compared to the resources you are adding for meta-information. All the
more reason to enhance existing APIs?

On Tue, Apr 30, 2013 at 08:21:39PM +0530, Prasanna Santhanam wrote:
> On Tue, Apr 30, 2013 at 09:25:40AM +, Nitin Mehta wrote:
> > Prasanna - Thanks for your question. The reasons for not using createTags
> > are as follows :-
> > 
> > - tags functionality is for grouping resources than adding meta
> > information and is allowed to all users. What I am proposing is for the
> > admin
> The FS of tags [1] states the same objectives: 
> 
> """ Tag is the first class object in the cloudStack """
> 
> The resource tags is based on AWS tags that carry meta-information for
> users to do nifty things [2] like managing billing, filtering, external
> services etc. In the AWS case it is up to the user to determine what
> she does with a tag.
> 
> > to have better control over the first class objects in CS. This ability
> > should be with admin only.
> Why only admin? Like I pointed, I as a user could decide to fire APIs
> that do the same failure/backup implementation across my regions if my
> provider hasn't enabled any service as you describe in your use case.
> 
> > - Also list* (* == volume, vm etc.) APIs can list the tags for the enduser
> > and mixing tags with the meta information wouldn't go well as they
> > are admin only. I don't want to mix the meta information with the resource
> > response because they are not the attributes of the resource, we should
> > try to get to this model in future.
> That's a scope/access control issue of the API. As an admin I could
> reserve a set of tags for myself to use that my users are forbidden to
> create. AWS reserves the 'aws' tag.
> 
> > (Like we don't want to add stats to vm response )
> > - Lets not use something just because they seem similar, because they both
> > might evolve in a different way in future.
> 
> I'm just trying to understand if the existence of tags was overlooked
> before developing this feature. To me it sounds like one can enhance
> the existing APIs than have to introduce new ones that can be
> potentially confusing. 
> 
> [1] https://cwiki.apache.org/confluence/x/PYnlAQ
> [2] http://s.apache.org/v4
> 
> -- 
> Prasanna.,
> 
> 
> Powered by BigRock.com

-- 
Prasanna.,


Powered by BigRock.com



Re: [MERGE] CS-2163

2013-04-30 Thread Min Chen
+1 to Prasanna's argument. Tags provide more flexibility and extensibility
than adding column to existing db schema. What happens if later on we want
to add finer control to these resources not specific to end user? Adding
another column?  
Also, I haven't seen your answer to my questions in this thread.

-min

On 4/30/13 7:58 AM, "Prasanna Santhanam"  wrote:

>Also - tags supports many more resources in CloudStack already as
>compared to the resources you are adding for meta-information. All the
>more reason to enhance existing APIs?
>
>On Tue, Apr 30, 2013 at 08:21:39PM +0530, Prasanna Santhanam wrote:
>> On Tue, Apr 30, 2013 at 09:25:40AM +, Nitin Mehta wrote:
>> > Prasanna - Thanks for your question. The reasons for not using
>>createTags
>> > are as follows :-
>> > 
>> > - tags functionality is for grouping resources than adding meta
>> > information and is allowed to all users. What I am proposing is for
>>the
>> > admin
>> The FS of tags [1] states the same objectives:
>> 
>> """ Tag is the first class object in the cloudStack """
>> 
>> The resource tags is based on AWS tags that carry meta-information for
>> users to do nifty things [2] like managing billing, filtering, external
>> services etc. In the AWS case it is up to the user to determine what
>> she does with a tag.
>> 
>> > to have better control over the first class objects in CS. This
>>ability
>> > should be with admin only.
>> Why only admin? Like I pointed, I as a user could decide to fire APIs
>> that do the same failure/backup implementation across my regions if my
>> provider hasn't enabled any service as you describe in your use case.
>> 
>> > - Also list* (* == volume, vm etc.) APIs can list the tags for the
>>enduser
>> > and mixing tags with the meta information wouldn't go well as they
>> > are admin only. I don't want to mix the meta information with the
>>resource
>> > response because they are not the attributes of the resource, we
>>should
>> > try to get to this model in future.
>> That's a scope/access control issue of the API. As an admin I could
>> reserve a set of tags for myself to use that my users are forbidden to
>> create. AWS reserves the 'aws' tag.
>> 
>> > (Like we don't want to add stats to vm response )
>> > - Lets not use something just because they seem similar, because they
>>both
>> > might evolve in a different way in future.
>> 
>> I'm just trying to understand if the existence of tags was overlooked
>> before developing this feature. To me it sounds like one can enhance
>> the existing APIs than have to introduce new ones that can be
>> potentially confusing.
>> 
>> [1] https://cwiki.apache.org/confluence/x/PYnlAQ
>> [2] http://s.apache.org/v4
>> 
>> -- 
>> Prasanna.,
>> 
>> 
>> Powered by BigRock.com
>
>-- 
>Prasanna.,
>
>
>Powered by BigRock.com
>



Re: [MERGE] CS-2163

2013-04-30 Thread Nitin Mehta
Min - Thanks for your questions. I have updated the FS with the list Apis.
I also updated the FS with the DB view changes.
This was already done while submitting the merge request.Thanks for
pointing this out.

Thanks,
-Nitin

On 29/04/13 11:07 PM, "Min Chen"  wrote:

>Nitin,
>
>   I have several questions after reading your FS:
>1. The API to be modified should also include some list APIs to control
>which resources to be displayed to the end user based on your new flag,
>right? You didn't mention such APIs in your FS, so I am asking for
>clarification.
>2. If answer to #1 is true, then you may need to modify new DB views
>introduced in 4.1 to reflect that flag as well so that you can filter
>resources for end user.
>   Thanks
>   -min
>
>On 4/28/13 9:01 PM, "Nitin Mehta"  wrote:
>
>>I would like to merge the feature which will add the ability in CS so
>>that the user can have better control over first class objects in CS
>>
>>- The feature can be found in the branch cs-2163 and has been rebased
>>with master.
>>- Jira ticket: https://issues.apache.org/jira/browse/CLOUDSTACK-2163
>>- The FS can be found @
>>https://cwiki.apache.org/confluence/display/CLOUDSTACK/Ability+to+have+be
>>t
>>ter+control+over+first+class+objects+in+CS
>>- I have added the unit tests and marvin tests as well.
>>- I ran the RAT check as well with no failures.
>>
>>Thanks,
>>Nitin
>



Why was this reverted?

2013-04-30 Thread Alex Huang
Hi Prasanna,

I come back from vacation and find that a special configuration I put into the 
pom.xml to avoid eclipse and maven build to conflict with each other has been 
reverted.  I checked the commit comments and there's nothing in the comments 
why this is reverted.  Please let me know why it is reverted.

The commit is 8e917b1ad3c0d3076b0c6425ea3318a6d6dd5c25.

It reverted the eclipse profile and the cs.target.dir configuration.

Thanks.

--Alex


New Committer: Clayton Weise

2013-04-30 Thread Chip Childers
The Project Management Committee (PMC) for Apache CloudStack
has asked Clayton Weise to become a committer and we are pleased to 
announce that he has accepted.

Clayton is exceptionally active on the #cloudstack IRC channel, helping
users with all sorts of questions and support topics.  He's also been
active on the user list in a similar capacity.

Being a committer allows many contributors to contribute more
autonomously. For developers, it makes it easier to submit changes and
eliminates the need to have contributions reviewed via the patch
submission process. Whether contributions are development-related or
otherwise, it is a recognition of a contributor's participation in the
project and commitment to the project and the Apache Way.

Please join me in congratulating Clayton!

--Chip Childers
on behalf of the CloudStack PMC


RE: New Committer: Clayton Weise

2013-04-30 Thread Kelcey Damage (BT)
It's about time! Lol.

Now I have an official partner in crime

>-Original Message-
>From: Chip Childers [mailto:chip.child...@sungard.com]
>Sent: Tuesday, April 30, 2013 9:53 AM
>To: dev@cloudstack.apache.org
>Cc: cwe...@iswest.net
>Subject: New Committer: Clayton Weise
>
>The Project Management Committee (PMC) for Apache CloudStack has asked
>Clayton Weise to become a committer and we are pleased to announce that he
>has accepted.
>
>Clayton is exceptionally active on the #cloudstack IRC channel, helping
users
>with all sorts of questions and support topics.  He's also been active on
the user
>list in a similar capacity.
>
>Being a committer allows many contributors to contribute more autonomously.
>For developers, it makes it easier to submit changes and eliminates the
need to
>have contributions reviewed via the patch submission process. Whether
>contributions are development-related or otherwise, it is a recognition of
a
>contributor's participation in the project and commitment to the project
and
>the Apache Way.
>
>Please join me in congratulating Clayton!
>
>--Chip Childers
>on behalf of the CloudStack PMC



Re: New Committer: Clayton Weise

2013-04-30 Thread Ahmad Emneina
Congrats Clayton!


On Tue, Apr 30, 2013 at 9:53 AM, Chip Childers wrote:

> The Project Management Committee (PMC) for Apache CloudStack
> has asked Clayton Weise to become a committer and we are pleased to
> announce that he has accepted.
>
> Clayton is exceptionally active on the #cloudstack IRC channel, helping
> users with all sorts of questions and support topics.  He's also been
> active on the user list in a similar capacity.
>
> Being a committer allows many contributors to contribute more
> autonomously. For developers, it makes it easier to submit changes and
> eliminates the need to have contributions reviewed via the patch
> submission process. Whether contributions are development-related or
> otherwise, it is a recognition of a contributor's participation in the
> project and commitment to the project and the Apache Way.
>
> Please join me in congratulating Clayton!
>
> --Chip Childers
> on behalf of the CloudStack PMC
>


Re: Update on 4.1 blockers ?

2013-04-30 Thread Kelven Yang
I'll pick up this one

Kelven

On 4/30/13 5:53 AM, "Sebastien Goasguen"  wrote:

>Nicolas also added a new comment:
>
>"Same bug with another component.
>Before database upgrade process, CS try to read configuration for the
>ApiServer initialization. And all entries which have category=hidden
>aren't encrypted.
>It is possible to force DatabaseUpgrade process to be the first component
>to be called ?"
>
>Can someone look at it ?
>
>-sebastien
>
>On Apr 30, 2013, at 5:31 AM, nicolas.lamira...@orange.com wrote:
>
>> Hi,
>> i merge this patch https://reviews.apache.org/r/10802/ in the 4.1 code.
>> i try another upgrade. I put a comment on the issue
>> 
>> https://issues.apache.org/jira/browse/CLOUDSTACK-2194#comment-13645407
>> 
>> Le 29/04/2013 22:18, Chip Childers a écrit :
>>> On Mon, Apr 29, 2013 at 08:56:11AM -0400, Sebastien Goasguen wrote:
 HI Nicolas,
 
 Any updates on:
 
 CLOUDSTACK-528 and CLOUDSTACK-2194
 
 I see that you opened
 
 CLOUDSTACK-2207
 
 We are waiting on your feedback to enter into a vote for 4.1.
 
 -Sebastien
 
>>> 
>>> Nicolas,
>>> 
>>> I'd really love to get you to confirm the fixes for the three bugs
>>>noted
>>> above, but am going to move forward with starting another release VOTE
>>> tomorrow morning either way (unless I hear that things are still
>>>broken).
>>> If you are able to take the time to re-test today or tomorrow (I
>>>believe
>>> you are in the EU), it would be very appreciated...  and if you are
>>>still
>>> having problems please do let us know! The sooner the better, since
>>>cutting
>>> a release takes some effort.
>>> 
>>> Thanks again for the diligent bug reports and testing!
>>> 
>>> -chip
>>> 
>>> 
>> 
>> 
>> -- 
>> Nicolas Lamirault
>> 
>> 
>>_
>>
>> 
>> Ce message et ses pieces jointes peuvent contenir des informations
>>confidentielles ou privilegiees et ne doivent donc
>> pas etre diffuses, exploites ou copies sans autorisation. Si vous avez
>>recu ce message par erreur, veuillez le signaler
>> a l'expediteur et le detruire ainsi que les pieces jointes. Les
>>messages electroniques etant susceptibles d'alteration,
>> France Telecom - Orange decline toute responsabilite si ce message a
>>ete altere, deforme ou falsifie. Merci.
>> 
>> This message and its attachments may contain confidential or privileged
>>information that may be protected by law;
>> they should not be distributed, used or copied without authorisation.
>> If you have received this email in error, please notify the sender and
>>delete this message and its attachments.
>> As emails may be altered, France Telecom - Orange is not liable for
>>messages that have been modified, changed or falsified.
>> Thank you.
>> 
>



Re: New Committer: Clayton Weise

2013-04-30 Thread Alena Prokharchyk
Clayton, congratulations!

On 4/30/13 9:53 AM, "Chip Childers"  wrote:

>The Project Management Committee (PMC) for Apache CloudStack
>has asked Clayton Weise to become a committer and we are pleased to
>announce that he has accepted.
>
>Clayton is exceptionally active on the #cloudstack IRC channel, helping
>users with all sorts of questions and support topics.  He's also been
>active on the user list in a similar capacity.
>
>Being a committer allows many contributors to contribute more
>autonomously. For developers, it makes it easier to submit changes and
>eliminates the need to have contributions reviewed via the patch
>submission process. Whether contributions are development-related or
>otherwise, it is a recognition of a contributor's participation in the
>project and commitment to the project and the Apache Way.
>
>Please join me in congratulating Clayton!
>
>--Chip Childers
>on behalf of the CloudStack PMC
>




Re: Update on 4.1 blockers ?

2013-04-30 Thread Chip Childers
On Tue, Apr 30, 2013 at 09:58:17AM -0700, Kelven Yang wrote:
> I'll pick up this one
> 
> Kelven

Thanks Kelven!

-chip


RE: Renaming updateVMAffinityGroup -> updateAffinityGroup

2013-04-30 Thread Prachi Damle
Hi Prasanna,

The API is to update a VirtualMachine's affinity group associations - it's not 
really an update operation on an affinity group - hence the odd naming. The 
resource the API is acting on is a VM.
Please suggest any other name that seems meaningful and fits the conventions...

-Prachi 

-Original Message-
From: Prasanna Santhanam [mailto:t...@apache.org] 
Sent: Tuesday, April 30, 2013 7:25 AM
To: CloudStack Dev
Cc: Prachi Damle
Subject: Renaming updateVMAffinityGroup -> updateAffinityGroup

Hi Prachi, 

Sorry for bringing this up so late -

Since the feature is not yet released and the API not out in the wild I thought 
perhaps the name updateVmAffinityGroup makes more sense as updateAffinityGroup. 
This will make it conform with the rest of the APIs associated with 
AffinityGroups(create/delete/list). Just makes it easier to identify the 
resource the API is acting upon and more intuitive.

Does the update API do something different that warrants the odd naming?

Thanks,

--
Prasanna.,


Powered by BigRock.com



Review Request: CLOUDSTACK-2194 fix ApiServer intialization sequence

2013-04-30 Thread Kelven Yang

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10864/
---

Review request for cloudstack and Chip Childers.


Description
---

Initialize ApiServer component in a proper time


This addresses bug CLOUDSTACK-2194.


Diffs
-

  server/src/com/cloud/api/ApiServer.java 4c1cf2d 

Diff: https://reviews.apache.org/r/10864/diff/


Testing
---

Manually tested, since I don't have a upgrade environment to verify, just 
tested that this won't introduce regression and verified through intialization 
logs


Thanks,

Kelven Yang



Re: Review Request: CLOUDSTACK-2194 fix ApiServer intialization sequence

2013-04-30 Thread ASF Subversion and Git Services

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10864/#review19965
---


Commit c2457b52889928afa906b3f634c4fd54f879b878 in branch refs/heads/4.1 from 
Chip Childers 
[ https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;h=c2457b5 ]

CLOUDSTACK-2194: Fix ApiServer component initialization sequence


- ASF Subversion and Git Services


On April 30, 2013, 5:38 p.m., Kelven Yang wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/10864/
> ---
> 
> (Updated April 30, 2013, 5:38 p.m.)
> 
> 
> Review request for cloudstack and Chip Childers.
> 
> 
> Description
> ---
> 
> Initialize ApiServer component in a proper time
> 
> 
> This addresses bug CLOUDSTACK-2194.
> 
> 
> Diffs
> -
> 
>   server/src/com/cloud/api/ApiServer.java 4c1cf2d 
> 
> Diff: https://reviews.apache.org/r/10864/diff/
> 
> 
> Testing
> ---
> 
> Manually tested, since I don't have a upgrade environment to verify, just 
> tested that this won't introduce regression and verified through 
> intialization logs
> 
> 
> Thanks,
> 
> Kelven Yang
> 
>



Re: Review Request: CLOUDSTACK-2194 fix ApiServer intialization sequence

2013-04-30 Thread Chip Childers

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10864/#review19966
---

Ship it!


Ship It!

- Chip Childers


On April 30, 2013, 5:38 p.m., Kelven Yang wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/10864/
> ---
> 
> (Updated April 30, 2013, 5:38 p.m.)
> 
> 
> Review request for cloudstack and Chip Childers.
> 
> 
> Description
> ---
> 
> Initialize ApiServer component in a proper time
> 
> 
> This addresses bug CLOUDSTACK-2194.
> 
> 
> Diffs
> -
> 
>   server/src/com/cloud/api/ApiServer.java 4c1cf2d 
> 
> Diff: https://reviews.apache.org/r/10864/diff/
> 
> 
> Testing
> ---
> 
> Manually tested, since I don't have a upgrade environment to verify, just 
> tested that this won't introduce regression and verified through 
> intialization logs
> 
> 
> Thanks,
> 
> Kelven Yang
> 
>



Re: Update on 4.1 blockers ?

2013-04-30 Thread Chip Childers
On Tue, Apr 30, 2013 at 09:58:17AM -0700, Kelven Yang wrote:
> I'll pick up this one
> 
> Kelven

Your patch was pushed to the 4.1 branch Kelven.

Let's see if we get a positive re-test result!

-chip


Re: Review Request: Selenium Headless configuration using PhantomJS

2013-04-30 Thread Parth Jagirdar

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10846/
---

(Updated April 30, 2013, 5:56 p.m.)


Review request for cloudstack, David Nalley, Chip Childers, and edison su.


Changes
---

Removed password from build/replace.properties


Description
---

Selenium Headless configuration using PhantomJS.

Fixed Readme Typos, and added an extra field for PhantomJS and How to configure 
Management Server IP.


This addresses bug Cloudstack-2282.


Diffs (updated)
-

  framework/ipc/src/org/apache/cloudstack/framework/messagebus/MessageBus.java 
4aa007d 
  
framework/ipc/src/org/apache/cloudstack/framework/messagebus/MessageBusBase.java
 5b7af4d 
  framework/ipc/test/org/apache/cloudstack/messagebus/TestMessageBus.java 
PRE-CREATION 
  framework/ipc/test/resources/MessageBusTestContext.xml PRE-CREATION 

Diff: https://reviews.apache.org/r/10846/diff/


Testing
---

NA.


Thanks,

Parth Jagirdar



RE: [DISCUSS] UI automation using Python/Selenium

2013-04-30 Thread Parth Jagirdar
We need to come up with a naming scheme. And what elements to include.

Any suggestions for that?


Thanks,
.. Parth


-Original Message-
From: Edison Su [mailto:edison...@citrix.com] 
Sent: Monday, April 29, 2013 7:45 PM
To: dev@cloudstack.apache.org; Chip Childers
Subject: RE: [DISCUSS] UI automation using Python/Selenium

+1 on the unique names/Id, it's a life saver. The following code to find out UI 
element is unmaintainable:
instances_table_xpath = 
"/html/body/div/div/div[2]/div[2]/div[2]/div/div[2]/div[2]/table/tbody/tr/td/span"


> -Original Message-
> From: Parth Jagirdar [mailto:parth.jagir...@citrix.com]
> Sent: Monday, April 29, 2013 7:17 PM
> To: dev@cloudstack.apache.org; Chip Childers
> Subject: Re: [DISCUSS] UI automation using Python/Selenium
> 
> Bringing this back on tableŠ
> 
> As we have discussed this in past, That we need to have ID's/Names for 
> UI elements.
> 
> The challenge is to come up with a standard naming scheme to 
> accomplish this task.
> How many unique names?
> 
> 
> 1)
> 
> Can we just get away with associating ID's with basic elements (and 
> often accessed elements)?
> 
>  say for example :
> - Dashboard/Network/Instances and almost every icon on Dashboard screen.
> (Almost Always clicked multiple times in each test case, often in 
> middle of a test case for a clean start)
> - VM operations icons. Start Stop etc etcŠ
> - Template operations etc etc. ( this can be a long list so need help 
> to think of a way we can limit this)
> 
> - Some other valuable objects are Tables containing data VM's, 
> Networks all is listed in tables on UI::
> 
>  Following snippet is almost always used to find the VM we created in 
> our tests.
> 
> We actually traverse through the table to find our VM with a string match.
> 
> Now if we can have a name for this table column (say Instances_table) ..
> Life will be much simpler.
> 
> Such tables are used frequently on UI.
> 
> 
> linkclass = None
> linkclass =
> driver.find_elements_by_xpath(Global_Locators.instances_table_xpath) # 
> This returns a list of all VM names in tables
> 
> for link in linkclass:
> 
>   if link.text == "Auto-VM": # We will search for our VM in this table
>   print "found VM in table ..  checking status..." + '\n' + '\n'
>   link.click()
> 
>   status =
> driver.find_element_by_xpath(Global_Locators.state_xpath).text
> ## get the status of our VM
> 
>   if status == "Running" : # then click and do something ...
> 
> 
> 
> 
> In shortŠ Any suggestions?
> 
> 
> 1) Standard procedure to, name elements or associate ID's to them. (A 
> Page on wiki and a standard that committers/reviewers can enforce so 
> we can ensure that new features and bug fixes both comply with it)
> 
> 2) Identifying which elements to start with. (inputs needed to define 
> that fine line)
> 
> 
> .. Parth
> 
> 
> 
> On 2/14/13 10:38 AM, "Pranav Saxena"  wrote:
> 
> >[CHIP]
> >I'd assume that we would want to open bugs on key elements that 
> >should actually have an ID, to make the test suite a bit more robust 
> >(less prone to issues as the UI is tweaked over time
> >
> >We are having discussion about this and should be able to get the 
> >relevant changes done in sometime (associating ID's with the UI
> >elements) so that UI automation could be done in a more sturdy way .
> >
> >Regards,
> >Pranav
> >
> >-Original Message-
> >From: Parth Jagirdar [mailto:parth.jagir...@citrix.com]
> >Sent: Friday, February 15, 2013 12:00 AM
> >To: Chip Childers; cloudstack-...@incubator.apache.org
> >Subject: RE: [DISCUSS] UI automation using Python/Selenium
> >
> >Hi Chip,
> >
> >
> >For following::
> >
> >
> >[CHIP]
> >In your design doc, you mention that Main.py will be the executable file.
> > Either it needs to support flags to trigger different suites, or it 
> >can simply be exploded into multiple "main" files that drive the 
> >correct suite.
> >
> >[PARTH]
> >Yes, Main .py is the executable.
> >We import other modules
> >Each class in each module is a test case.
> >And then we serialize them into main.
> >
> >
> >[CHIP]
> >As for element locators, you're right about the difficulty in the 
> >current page DOM.  XPath seems to be the only reasonable way for now.
> >
> >[PARTH]
> >Xpath is least reliable. ID and Name tops the reliability. But for 
> >now no choice.
> >However I have created a global file which looks like
> >
> ># Selects Templates from drop down
> >template_xpath =
> >"/html/body/div/div/div[2]/div[2]/div[2]/div/div[2]/div/div/div/selec
> >t/
> >opt
> >ion[1]"
> >
> ># Selects ISO from drop down
> >iso_xpath =
> >"/html/body/div/div/div[2]/div[2]/div[2]/div/div[2]/div/div/div/selec
> >t/
> >opt
> >ion[2]"
> >
> ># Add Template
> >AddTemplate_xpath = "//div[3]/span"
> >
> >We are essentially using these variables across all the classes and 
> >modules. So in event of script failure we look at the element 
> >location (using xpath finder) and match it with our global file. If 
> >

Re: Review Request: Volume snapshot enhancements for vmware

2013-04-30 Thread Fang Wang


> On April 30, 2013, 5:42 a.m., Prasanna Santhanam wrote:
> > This can be discarded in favour of the new patch?

This patch needs to be in first, before the newer patch. . the newer patch 
contains only the changed files. this patch has the 4 new files.  These four 
new files are not included in the newer patch


- Fang


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10815/#review19941
---


On April 27, 2013, 5:28 a.m., Fang Wang wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/10815/
> ---
> 
> (Updated April 27, 2013, 5:28 a.m.)
> 
> 
> Review request for cloudstack and Kelven Yang.
> 
> 
> Description
> ---
> 
> Reduce the ova file copy and generation time during volume and snapshot 
> creation, copy, and other internal
> commands;
> When use import/export the template and the volume, ova file is created for 
> this outbound service. 
> 
> 
> This addresses bugs CLOUDSTACK-671, enhancements, for, snapshot, vmware, and 
> volume.
> 
> 
> Diffs
> -
> 
>   api/src/com/cloud/agent/api/storage/CreateVolumeOVAAnswer.java PRE-CREATION 
>   api/src/com/cloud/agent/api/storage/CreateVolumeOVACommand.java 
> PRE-CREATION 
>   api/src/com/cloud/agent/api/storage/PrepareOVAPackingAnswer.java 
> PRE-CREATION 
>   api/src/com/cloud/agent/api/storage/PrepareOVAPackingCommand.java 
> PRE-CREATION 
> 
> Diff: https://reviews.apache.org/r/10815/diff/
> 
> 
> Testing
> ---
> 
> Tested the snapshot creation; volume creation, copy, donwload; template 
> creation, download,delete, and related commands. 
> 
> 
> Thanks,
> 
> Fang Wang
> 
>



Re: SSVM network throttling

2013-04-30 Thread Alena Prokharchyk
Hi Jeronimo,

The throttling rate for SSVM can either be taken from the system
network offering (for Control/Public/Storage traffic types); or if its set
to NULL on the network offering, it gets taken from the global config. By
default, on the system network offerings the rate is set to 0 - unlimited.

Can you check what value for parameter "networkRateMbps" was sent to the
backend with StartCommand for SSVM? Here is the grep you can use as an
example:

grep StartCommand vmops.log  | grep s-1-VM | grep networkRateMbps

-1 in the StartCommand means unlimited.

-Alena.

On 4/30/13 11:07 AM, "Jeronimo Garcia"  wrote:

>Hi List.
>
>Is there any setting that might be affecting the network speed on the
>SSVM?
>
>I'm using the default network offering for SSVM and these are my global
>settings:
>
>vm.network.throttling.rate = 0
>network.throttling.rate = 0
>
>
>the 5.5-nogui template times out due to this:
>root@s-3-VM:~# wget
>http://download.cloud.com/releases/2.2.0/eec2209b-9875-3c8d-92be-c001bd8a0
>faf.qcow2.bz2
>--2013-04-30 17:07:09--
>http://download.cloud.com/releases/2.2.0/eec2209b-9875-3c8d-92be-c001bd8a0
>faf.qcow2.bz2
>Resolving download.cloud.com... 72.21.194.23
>Connecting to download.cloud.com|72.21.194.23|:80... connected.
>HTTP request sent, awaiting response... 200 OK
>Length: 472312242 (450M) [application/x-bzip2]
>Saving to: ³eec2209b-9875-3c8d-92be-c001bd8a0faf.qcow2.bz2²
>
> 0% [
> ] 2,215353B/s  eta* 22d 15h *
>*
>*
>that's 22days to download the template.
>
>I'm using Ubuntu 12.10 .
>
>Thanks
>




Re: Review Request: CLOUDSTACK-2194 fix ApiServer intialization sequence

2013-04-30 Thread ASF Subversion and Git Services

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10864/#review19972
---


Commit ce7dc70b1dd8c86b3e2de223eb0f09e23172d1a0 in branch refs/heads/master 
from Kelven Yang 
[ https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;h=ce7dc70 ]

CLOUDSTACK-2194: Fix ApiServer component initialization sequence


- ASF Subversion and Git Services


On April 30, 2013, 5:38 p.m., Kelven Yang wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/10864/
> ---
> 
> (Updated April 30, 2013, 5:38 p.m.)
> 
> 
> Review request for cloudstack and Chip Childers.
> 
> 
> Description
> ---
> 
> Initialize ApiServer component in a proper time
> 
> 
> This addresses bug CLOUDSTACK-2194.
> 
> 
> Diffs
> -
> 
>   server/src/com/cloud/api/ApiServer.java 4c1cf2d 
> 
> Diff: https://reviews.apache.org/r/10864/diff/
> 
> 
> Testing
> ---
> 
> Manually tested, since I don't have a upgrade environment to verify, just 
> tested that this won't introduce regression and verified through 
> intialization logs
> 
> 
> Thanks,
> 
> Kelven Yang
> 
>



Re: Update on 4.1 blockers ?

2013-04-30 Thread Kelven Yang
Chip,

Thanks

Kelven

On 4/30/13 10:54 AM, "Chip Childers"  wrote:

>On Tue, Apr 30, 2013 at 09:58:17AM -0700, Kelven Yang wrote:
>> I'll pick up this one
>> 
>> Kelven
>
>Your patch was pushed to the 4.1 branch Kelven.
>
>Let's see if we get a positive re-test result!
>
>-chip



Re: SSVM network throttling

2013-04-30 Thread Jeronimo Garcia
Hi there.
Thanks for your help

is vmops.log in the SSVM or in the host running SSVM , i can't seem to find
the file.

Thanks


On Tue, Apr 30, 2013 at 1:18 PM, Alena Prokharchyk <
alena.prokharc...@citrix.com> wrote:

> Hi Jeronimo,
>
> The throttling rate for SSVM can either be taken from the system
> network offering (for Control/Public/Storage traffic types); or if its set
> to NULL on the network offering, it gets taken from the global config. By
> default, on the system network offerings the rate is set to 0 - unlimited.
>
> Can you check what value for parameter "networkRateMbps" was sent to the
> backend with StartCommand for SSVM? Here is the grep you can use as an
> example:
>
> grep StartCommand vmops.log  | grep s-1-VM | grep networkRateMbps
>
> -1 in the StartCommand means unlimited.
>
> -Alena.
>
> On 4/30/13 11:07 AM, "Jeronimo Garcia"  wrote:
>
> >Hi List.
> >
> >Is there any setting that might be affecting the network speed on the
> >SSVM?
> >
> >I'm using the default network offering for SSVM and these are my global
> >settings:
> >
> >vm.network.throttling.rate = 0
> >network.throttling.rate = 0
> >
> >
> >the 5.5-nogui template times out due to this:
> >root@s-3-VM:~# wget
> >
> http://download.cloud.com/releases/2.2.0/eec2209b-9875-3c8d-92be-c001bd8a0
> >faf.qcow2.bz2
> >--2013-04-30 17:07:09--
> >
> http://download.cloud.com/releases/2.2.0/eec2209b-9875-3c8d-92be-c001bd8a0
> >faf.qcow2.bz2
> >Resolving download.cloud.com... 72.21.194.23
> >Connecting to download.cloud.com|72.21.194.23|:80... connected.
> >HTTP request sent, awaiting response... 200 OK
> >Length: 472312242 (450M) [application/x-bzip2]
> >Saving to: ³eec2209b-9875-3c8d-92be-c001bd8a0faf.qcow2.bz2²
> >
> > 0% [
> > ] 2,215353B/s  eta* 22d 15h *
> >*
> >*
> >that's 22days to download the template.
> >
> >I'm using Ubuntu 12.10 .
> >
> >Thanks
> >
>
>
>


Re: SSVM network throttling

2013-04-30 Thread Alena Prokharchyk
Sorry, read it from the management server log file.

On 4/30/13 11:29 AM, "Jeronimo Garcia"  wrote:

>Hi there.
>Thanks for your help
>
>is vmops.log in the SSVM or in the host running SSVM , i can't seem to
>find
>the file.
>
>Thanks
>
>
>On Tue, Apr 30, 2013 at 1:18 PM, Alena Prokharchyk <
>alena.prokharc...@citrix.com> wrote:
>
>> Hi Jeronimo,
>>
>> The throttling rate for SSVM can either be taken from the system
>> network offering (for Control/Public/Storage traffic types); or if its
>>set
>> to NULL on the network offering, it gets taken from the global config.
>>By
>> default, on the system network offerings the rate is set to 0 -
>>unlimited.
>>
>> Can you check what value for parameter "networkRateMbps" was sent to the
>> backend with StartCommand for SSVM? Here is the grep you can use as an
>> example:
>>
>> grep StartCommand vmops.log  | grep s-1-VM | grep networkRateMbps
>>
>> -1 in the StartCommand means unlimited.
>>
>> -Alena.
>>
>> On 4/30/13 11:07 AM, "Jeronimo Garcia"  wrote:
>>
>> >Hi List.
>> >
>> >Is there any setting that might be affecting the network speed on the
>> >SSVM?
>> >
>> >I'm using the default network offering for SSVM and these are my global
>> >settings:
>> >
>> >vm.network.throttling.rate = 0
>> >network.throttling.rate = 0
>> >
>> >
>> >the 5.5-nogui template times out due to this:
>> >root@s-3-VM:~# wget
>> >
>> 
>>http://download.cloud.com/releases/2.2.0/eec2209b-9875-3c8d-92be-c001bd8a
>>0
>> >faf.qcow2.bz2
>> >--2013-04-30 17:07:09--
>> >
>> 
>>http://download.cloud.com/releases/2.2.0/eec2209b-9875-3c8d-92be-c001bd8a
>>0
>> >faf.qcow2.bz2
>> >Resolving download.cloud.com... 72.21.194.23
>> >Connecting to download.cloud.com|72.21.194.23|:80... connected.
>> >HTTP request sent, awaiting response... 200 OK
>> >Length: 472312242 (450M) [application/x-bzip2]
>> >Saving to: ³eec2209b-9875-3c8d-92be-c001bd8a0faf.qcow2.bz2²
>> >
>> > 0% [
>> > ] 2,215353B/s  eta* 22d 15h *
>> >*
>> >*
>> >that's 22days to download the template.
>> >
>> >I'm using Ubuntu 12.10 .
>> >
>> >Thanks
>> >
>>
>>
>>
>




Re: SSVM network throttling

2013-04-30 Thread Jeronimo Garcia
"networkRateMbps":-1, ... it is unlimited.

We don't know what could be causing this ... scp transfers seem faster than
anything else..


On Tue, Apr 30, 2013 at 1:31 PM, Alena Prokharchyk <
alena.prokharc...@citrix.com> wrote:

> Sorry, read it from the management server log file.
>
> On 4/30/13 11:29 AM, "Jeronimo Garcia"  wrote:
>
> >Hi there.
> >Thanks for your help
> >
> >is vmops.log in the SSVM or in the host running SSVM , i can't seem to
> >find
> >the file.
> >
> >Thanks
> >
> >
> >On Tue, Apr 30, 2013 at 1:18 PM, Alena Prokharchyk <
> >alena.prokharc...@citrix.com> wrote:
> >
> >> Hi Jeronimo,
> >>
> >> The throttling rate for SSVM can either be taken from the system
> >> network offering (for Control/Public/Storage traffic types); or if its
> >>set
> >> to NULL on the network offering, it gets taken from the global config.
> >>By
> >> default, on the system network offerings the rate is set to 0 -
> >>unlimited.
> >>
> >> Can you check what value for parameter "networkRateMbps" was sent to the
> >> backend with StartCommand for SSVM? Here is the grep you can use as an
> >> example:
> >>
> >> grep StartCommand vmops.log  | grep s-1-VM | grep networkRateMbps
> >>
> >> -1 in the StartCommand means unlimited.
> >>
> >> -Alena.
> >>
> >> On 4/30/13 11:07 AM, "Jeronimo Garcia"  wrote:
> >>
> >> >Hi List.
> >> >
> >> >Is there any setting that might be affecting the network speed on the
> >> >SSVM?
> >> >
> >> >I'm using the default network offering for SSVM and these are my global
> >> >settings:
> >> >
> >> >vm.network.throttling.rate = 0
> >> >network.throttling.rate = 0
> >> >
> >> >
> >> >the 5.5-nogui template times out due to this:
> >> >root@s-3-VM:~# wget
> >> >
> >>
> >>
> http://download.cloud.com/releases/2.2.0/eec2209b-9875-3c8d-92be-c001bd8a
> >>0
> >> >faf.qcow2.bz2
> >> >--2013-04-30 17:07:09--
> >> >
> >>
> >>
> http://download.cloud.com/releases/2.2.0/eec2209b-9875-3c8d-92be-c001bd8a
> >>0
> >> >faf.qcow2.bz2
> >> >Resolving download.cloud.com... 72.21.194.23
> >> >Connecting to download.cloud.com|72.21.194.23|:80... connected.
> >> >HTTP request sent, awaiting response... 200 OK
> >> >Length: 472312242 (450M) [application/x-bzip2]
> >> >Saving to: ³eec2209b-9875-3c8d-92be-c001bd8a0faf.qcow2.bz2²
> >> >
> >> > 0% [
> >> > ] 2,215353B/s  eta* 22d 15h *
> >> >*
> >> >*
> >> >that's 22days to download the template.
> >> >
> >> >I'm using Ubuntu 12.10 .
> >> >
> >> >Thanks
> >> >
> >>
> >>
> >>
> >
>
>
>


RE: [MERGE] Add/remove NICs UI support

2013-04-30 Thread Brian Federle
This is now ready in master.

Thanks, Brian

-Original Message-
From: Chip Childers [mailto:chip.child...@sungard.com] 
Sent: Monday, April 29, 2013 9:55 AM
To: dev@cloudstack.apache.org
Cc: Sonny Chhen; Animesh Chaturvedi
Subject: Re: [MERGE] Add/remove NICs UI support

On Fri, Apr 26, 2013 at 03:37:19PM -0700, Brian Federle wrote:
> Hi all,
> 
> 
> 
> I would like to merge the UI support for 'add/remove network on VM' to master.
> 
> 
> 
> JIRA ticket: https://issues.apache.org/jira/browse/CLOUDSTACK-1855
> 
> FS: 
> https://cwiki.apache.org/confluence/display/CLOUDSTACK/Add+Remove+Netw
> orks+to+VMs
> 
> Branch: ui-add-remove-nics
> 
> Unit tests: No new unit tests (UI only)
> 
> Discussion information: Please see feature discussion @ 
> https://issues.apache.org/jira/browse/CLOUDSTACK-645

+1

BTW - We don't actually need the RAT report, just an indication that you 
confirmed licensing compliance (something like "RAT Checked out OK and no new 
dependencies introduced"


Re: [GSoC] Discussion on "Create a cloud in a box using devcloud"

2013-04-30 Thread Rohit Yadav
On Tue, Apr 30, 2013 at 5:29 PM, Pulkit Singhal wrote:

> Hi everyone,
>
> I'm interested in the project "Create a cloud in a box using DevCloud".
>
> I'm a MS student at IIIT-Hyderabad. I've good experience with Python, Bash,
> openstack, Xen/KVM and automation(chef/puppet).
>
> As per my discussion with Sebastien, my understanding is that the project
> aims to extend devcloud to provision multiple instances of devcloud
> appliances for simulating more realistic production environments.
>
> While installing devcloud, I realized that for setting up more complex
> environments with multiple hosts and clusters, the procedure is too manual.
> So, for this project we certainly need a command line utility to automate
> installation and configurations.
>
> I’m a little uncertain about ‘simulating production environments’. I see
> this happening in two ways.
>
>
> *1.* Developers still use their development system to host complete cloud.
> Of course, in this case it would be multiple virtual box instances running
> devcloud and a management server running on the host itself. For this
> scenario, the command line utility can automate the setup. .e.g
>
> *$ devcloud --deploy management-server# deploy management server on
> local system
> $ devcloud --deploy host -n 2 --provider=virtualbox# deploy two
> hosts on virtualbox
> *
>
>
> The utility will download the updated source from git and install the
> management server. The hosts will be provisioned through the devcloud
> virtual box appliance or KVM image.
>

In most cases it's tricky to run more than one DevCloud VMs, but the idea
was kind of already implemented using veewee+vagrant in tools/devcloud/src.
The way was to build DevCloud using veewee (have puppet do s/w setups) and
use vagrant to spin as many boxes one wants.

Getting a virtual host to substitute for a real one is not a problem now,
it was solved with DevCloud. With DevCloud2 we solved the problem of
development, networking (earlier we just had port forwarding). The problem
we need to solve in DevCloud now are; networking, make it work for advance
zone/networking deployments and have multiple of them run consuming less
resources. DevCloud-KVM is much better in that case, we can do both
basic/adv-networking deployments.

*2. *Developers have a set of physical machines where they plan to host
> cloudstack. In this case, hosts won’t be running on virtualbox/kvm, but
> physical machines. A deployment scenario here would look like.
>
>
> *$* devcloud --deploy mangement_server -H 10.0.0.3 -u root -p pass
> *$* devcloud --deploy host -H 10.0.0.4,10.0.0.5 -u root -p pass2
> --hypervisor=xen
>

Nice idea, but it's already solved sort of :) Developers who enjoy the
privilege of such a lab setup would generally deploy the management server
and mysql on their system, use a IDE or debugger to debug the management
server on their machines while the host, agents, storage and other
subsystems are in their infra lab. They are also quite used to deploying
management server using marvin's deployDataCenter.py in
tools/marvin/marvin/ which can accept a json cfg which has these values. I
know people awesomesauce developers using puppet/cobbler and other tools to
setup and run integration tests against real automated hosts (kvm, xen etc.)

Sebastien mentioned on the list about the uncertainty of slots for students
for CloudStack, so keep thinking about how you can solve the existing
issues, work on your GSoC application, hangout on the IRC ask users and
developers what the real problems are and solve 'em; Just want to encourage
your opensource development interests, you're welcome to throw in ideas,
digest any criticism and hack with the community -- with or without GSoC.

Cheers.



> Here, the utility will log into the specified machines and configure them
> accordingly . No virtual appliance
> will be involved.
>
> I kindly request you to share your views regarding my approach and your
> expectations for this project.
>
> Thanks and Regards,
> Pulkit Singhal
>


Re: SSVM network throttling

2013-04-30 Thread Jeronimo Garcia
Alena , one question more ... is there an specific SSVM that i should
download if I'm using ubuntu 12.10 as host?

Thanks


On Tue, Apr 30, 2013 at 1:36 PM, Jeronimo Garcia wrote:

> "networkRateMbps":-1, ... it is unlimited.
>
> We don't know what could be causing this ... scp transfers seem faster
> than anything else..
>
>
> On Tue, Apr 30, 2013 at 1:31 PM, Alena Prokharchyk <
> alena.prokharc...@citrix.com> wrote:
>
>> Sorry, read it from the management server log file.
>>
>> On 4/30/13 11:29 AM, "Jeronimo Garcia"  wrote:
>>
>> >Hi there.
>> >Thanks for your help
>> >
>> >is vmops.log in the SSVM or in the host running SSVM , i can't seem to
>> >find
>> >the file.
>> >
>> >Thanks
>> >
>> >
>> >On Tue, Apr 30, 2013 at 1:18 PM, Alena Prokharchyk <
>> >alena.prokharc...@citrix.com> wrote:
>> >
>> >> Hi Jeronimo,
>> >>
>> >> The throttling rate for SSVM can either be taken from the system
>> >> network offering (for Control/Public/Storage traffic types); or if its
>> >>set
>> >> to NULL on the network offering, it gets taken from the global config.
>> >>By
>> >> default, on the system network offerings the rate is set to 0 -
>> >>unlimited.
>> >>
>> >> Can you check what value for parameter "networkRateMbps" was sent to
>> the
>> >> backend with StartCommand for SSVM? Here is the grep you can use as an
>> >> example:
>> >>
>> >> grep StartCommand vmops.log  | grep s-1-VM | grep networkRateMbps
>> >>
>> >> -1 in the StartCommand means unlimited.
>> >>
>> >> -Alena.
>> >>
>> >> On 4/30/13 11:07 AM, "Jeronimo Garcia"  wrote:
>> >>
>> >> >Hi List.
>> >> >
>> >> >Is there any setting that might be affecting the network speed on the
>> >> >SSVM?
>> >> >
>> >> >I'm using the default network offering for SSVM and these are my
>> global
>> >> >settings:
>> >> >
>> >> >vm.network.throttling.rate = 0
>> >> >network.throttling.rate = 0
>> >> >
>> >> >
>> >> >the 5.5-nogui template times out due to this:
>> >> >root@s-3-VM:~# wget
>> >> >
>> >>
>> >>
>> http://download.cloud.com/releases/2.2.0/eec2209b-9875-3c8d-92be-c001bd8a
>> >>0
>> >> >faf.qcow2.bz2
>> >> >--2013-04-30 17:07:09--
>> >> >
>> >>
>> >>
>> http://download.cloud.com/releases/2.2.0/eec2209b-9875-3c8d-92be-c001bd8a
>> >>0
>> >> >faf.qcow2.bz2
>> >> >Resolving download.cloud.com... 72.21.194.23
>> >> >Connecting to download.cloud.com|72.21.194.23|:80... connected.
>> >> >HTTP request sent, awaiting response... 200 OK
>> >> >Length: 472312242 (450M) [application/x-bzip2]
>> >> >Saving to: ³eec2209b-9875-3c8d-92be-c001bd8a0faf.qcow2.bz2²
>> >> >
>> >> > 0% [
>> >> > ] 2,215353B/s  eta* 22d 15h *
>> >> >*
>> >> >*
>> >> >that's 22days to download the template.
>> >> >
>> >> >I'm using Ubuntu 12.10 .
>> >> >
>> >> >Thanks
>> >> >
>> >>
>> >>
>> >>
>> >
>>
>>
>>
>


Re: New Committer: Clayton Weise

2013-04-30 Thread Sebastien Goasguen
Well done Clayton,

On Apr 30, 2013, at 12:59 PM, Alena Prokharchyk  
wrote:

> Clayton, congratulations!
> 
> On 4/30/13 9:53 AM, "Chip Childers"  wrote:
> 
>> The Project Management Committee (PMC) for Apache CloudStack
>> has asked Clayton Weise to become a committer and we are pleased to
>> announce that he has accepted.
>> 
>> Clayton is exceptionally active on the #cloudstack IRC channel, helping
>> users with all sorts of questions and support topics.  He's also been
>> active on the user list in a similar capacity.
>> 
>> Being a committer allows many contributors to contribute more
>> autonomously. For developers, it makes it easier to submit changes and
>> eliminates the need to have contributions reviewed via the patch
>> submission process. Whether contributions are development-related or
>> otherwise, it is a recognition of a contributor's participation in the
>> project and commitment to the project and the Apache Way.
>> 
>> Please join me in congratulating Clayton!
>> 
>> --Chip Childers
>> on behalf of the CloudStack PMC
>> 
> 
> 



Re: SSVM network throttling

2013-04-30 Thread Alena Prokharchyk
There is one generic KVM system template that you should use; nothing
specific to Ubuntu.

-Alena.

On 4/30/13 12:31 PM, "Jeronimo Garcia"  wrote:

>Alena , one question more ... is there an specific SSVM that i should
>download if I'm using ubuntu 12.10 as host?
>
>Thanks
>
>
>On Tue, Apr 30, 2013 at 1:36 PM, Jeronimo Garcia
>wrote:
>
>> "networkRateMbps":-1, ... it is unlimited.
>>
>> We don't know what could be causing this ... scp transfers seem faster
>> than anything else..
>>
>>
>> On Tue, Apr 30, 2013 at 1:31 PM, Alena Prokharchyk <
>> alena.prokharc...@citrix.com> wrote:
>>
>>> Sorry, read it from the management server log file.
>>>
>>> On 4/30/13 11:29 AM, "Jeronimo Garcia"  wrote:
>>>
>>> >Hi there.
>>> >Thanks for your help
>>> >
>>> >is vmops.log in the SSVM or in the host running SSVM , i can't seem to
>>> >find
>>> >the file.
>>> >
>>> >Thanks
>>> >
>>> >
>>> >On Tue, Apr 30, 2013 at 1:18 PM, Alena Prokharchyk <
>>> >alena.prokharc...@citrix.com> wrote:
>>> >
>>> >> Hi Jeronimo,
>>> >>
>>> >> The throttling rate for SSVM can either be taken from the system
>>> >> network offering (for Control/Public/Storage traffic types); or if
>>>its
>>> >>set
>>> >> to NULL on the network offering, it gets taken from the global
>>>config.
>>> >>By
>>> >> default, on the system network offerings the rate is set to 0 -
>>> >>unlimited.
>>> >>
>>> >> Can you check what value for parameter "networkRateMbps" was sent to
>>> the
>>> >> backend with StartCommand for SSVM? Here is the grep you can use as
>>>an
>>> >> example:
>>> >>
>>> >> grep StartCommand vmops.log  | grep s-1-VM | grep networkRateMbps
>>> >>
>>> >> -1 in the StartCommand means unlimited.
>>> >>
>>> >> -Alena.
>>> >>
>>> >> On 4/30/13 11:07 AM, "Jeronimo Garcia"  wrote:
>>> >>
>>> >> >Hi List.
>>> >> >
>>> >> >Is there any setting that might be affecting the network speed on
>>>the
>>> >> >SSVM?
>>> >> >
>>> >> >I'm using the default network offering for SSVM and these are my
>>> global
>>> >> >settings:
>>> >> >
>>> >> >vm.network.throttling.rate = 0
>>> >> >network.throttling.rate = 0
>>> >> >
>>> >> >
>>> >> >the 5.5-nogui template times out due to this:
>>> >> >root@s-3-VM:~# wget
>>> >> >
>>> >>
>>> >>
>>> 
>>>http://download.cloud.com/releases/2.2.0/eec2209b-9875-3c8d-92be-c001bd8
>>>a
>>> >>0
>>> >> >faf.qcow2.bz2
>>> >> >--2013-04-30 17:07:09--
>>> >> >
>>> >>
>>> >>
>>> 
>>>http://download.cloud.com/releases/2.2.0/eec2209b-9875-3c8d-92be-c001bd8
>>>a
>>> >>0
>>> >> >faf.qcow2.bz2
>>> >> >Resolving download.cloud.com... 72.21.194.23
>>> >> >Connecting to download.cloud.com|72.21.194.23|:80... connected.
>>> >> >HTTP request sent, awaiting response... 200 OK
>>> >> >Length: 472312242 (450M) [application/x-bzip2]
>>> >> >Saving to: ³eec2209b-9875-3c8d-92be-c001bd8a0faf.qcow2.bz2²
>>> >> >
>>> >> > 0% [
>>> >> > ] 2,215353B/s  eta* 22d 15h *
>>> >> >*
>>> >> >*
>>> >> >that's 22days to download the template.
>>> >> >
>>> >> >I'm using Ubuntu 12.10 .
>>> >> >
>>> >> >Thanks
>>> >> >
>>> >>
>>> >>
>>> >>
>>> >
>>>
>>>
>>>
>>
>




RE: New Committer: Clayton Weise

2013-04-30 Thread Animesh Chaturvedi
Congratulations Clayton

> -Original Message-
> From: Chip Childers [mailto:chip.child...@sungard.com]
> Sent: Tuesday, April 30, 2013 9:53 AM
> To: dev@cloudstack.apache.org
> Cc: cwe...@iswest.net
> Subject: New Committer: Clayton Weise
> 
> The Project Management Committee (PMC) for Apache CloudStack has
> asked Clayton Weise to become a committer and we are pleased to
> announce that he has accepted.
> 
> Clayton is exceptionally active on the #cloudstack IRC channel, helping users
> with all sorts of questions and support topics.  He's also been active on the
> user list in a similar capacity.
> 
> Being a committer allows many contributors to contribute more
> autonomously. For developers, it makes it easier to submit changes and
> eliminates the need to have contributions reviewed via the patch submission
> process. Whether contributions are development-related or otherwise, it is a
> recognition of a contributor's participation in the project and commitment to
> the project and the Apache Way.
> 
> Please join me in congratulating Clayton!
> 
> --Chip Childers
> on behalf of the CloudStack PMC


RE: [Docs] Questions on baremetal feature (CLOUDSTACK-774)

2013-04-30 Thread Frank Zhang


From: Jessica Tomechak [mailto:jessica.tomec...@gmail.com]
Sent: Monday, April 29, 2013 10:02 PM
To: dev@cloudstack.apache.org; Frank Zhang
Subject: [Docs] Questions on baremetal feature (CLOUDSTACK-774)

I was finishing up a doc draft for this feature today, and generated the 
following technical questions. If any expert on this list can provide more 
information, it's much appreciated.

1.  In one of the example API calls to addBaremetalHost that I have seen, 
it's issued at the Management Server command line, not through the browser. I 
assume this is not significant - just an alternative way to issue an API call. 
Is that correct?

You are right. API can be issued through browser anyway. The example showing on 
command line is just an alternative

2.  The same example I saw didn't have the &apiKey and &signature, which 
are ordinarily required. Is this an oversight, or are they not required in this 
case?

Api issued on command line is not required with security stuff, that's the 
reason we use command line

3.  Please confirm that the Juniper SRX firewall can be used in zones that 
have basic networking? Some earlier docs state it's only for advanced zones.

I suggest removing this part.

4.  I have noted that with the kickstart feature, the file server where the 
image and kickstart file are stored has to be an NFS server, not any other 
type. Correct?

Yes, for now we use NFS only
Thanks,
Jessica T.


Re: [GSoC][Proposal] Integration project to deploy and use Mesos on a CloudStack based cloud

2013-04-30 Thread Chiradeep Vittal


On 4/30/13 5:01 AM, "Sebastien Goasguen"  wrote:

>Dharmesh, see in-line
>
>On Apr 30, 2013, at 5:34 AM, Dharmesh Kakadia  wrote:
>
>> Hi,
>> 
>> I am Dharmesh Kakdia and interested in project "Integration project to
>> deploy and use Mesos on a CloudStack based cloud" (
>> https://issues.apache.org/jira/browse/CLOUDSTACK-1784)
>> 
>> I am working on proposal and want to get feedback. Please provide
>> suggestions :)
>> 
>> *
>> 
>> Abstract:
>> 
>> The project aims to bring cloudformation[1] like service to cloudstack.
>>One
>> of the prime use-case is cluster computing frameworks on cloudstack. A
>> cloudformation service will give users and administrators of cloudstack
>> ability to manage and control a set of resources easily. The
>>cloudformation
>> will allow booting and configuring a set of VMs and form a cluster.
>>Simple
>> example would be LAMP stack. More complex clusters such as mesos or
>>hadoop
>> cluster requires a little more advanced configuration. There is already
>> some work done by Chiradeep Vittal at this front [5] using route and
>
>it's using ruote: http://ruote.rubyforge.org
>
>> sinatra. In this project, I will implement cloudformation service and
>> demonstrate how to run mesos cluster using it.
>
>You will create cloud formation templates that describe a mesos cluster
>
>> 
>> Mesos:
>> 
>> Mesos is a resource management platform for clusters [2]. It aims to
>> increase resource utilization of clusters by sharing cluster resources
>> among multiple processing frameworks(like MapReduce, MPI, Graph
>>Processing)
>> or multiple instances of same framework. It provides efficient resource
>> isolation through use of containers. Uses zookeeper for state
>>maintenance
>> and fault tolerance.
>> 
>> What can run on mesos ?
>> 
>> Spark: A cluster computing framework based on the Resilient Distributed
>> Datasets (RDDs) abstraction. RDD is more generalized than MapReduce and
>>can
>> support iterative and interactive computation while retaining fault
>> tolerance, scalability, data locality etc.
>> 
>> Hadoop: Hadoop is fault tolerant and scalable distributed computing
>> framework based on MapReduce abstraction.
>> 
>> Begel: A graph processing framework based on pregel.
>> 
>> and other frameworks like MPI, Hypertable.
>> 
>> How to deploy mesos
>> 
>> Mesos provides cluster installation scripts [7] for cluster deployment.
>> There are also scripts available to deploy a cluster on Amazon EC2 [8].
>
>It would be nice to see if these scripts can be used as is with the
>CloudStack EC2 service.
>
>> 
>> Deliverables:
>> 
>> 1. Cloudformation service implementation on cloudstack.
>> 
>> 2. Integration of cloudformation with cloudmonkey, CLI tool.
>
>2. is a little confusing. I believe that what Chiradeep prototype runs on
>the client side. What is needed is a server side implementation.
>That way we could use existing cloudformation cli tools to talk to it.
>I don't understand where cloudmonkey comes into play. CloudMonkey is a
>cli for the CloudStack API. Unless you plan to integrate the
>cloudformation API directly in the cloudstack source code, the
>integration you propose is not clear to me.
>

Sebastien is correct. I intend to put in the query API server around the
core of stack mate soon (as soon as I'm done helping on the internal
loadbalancer). This will be written in Ruby.




Re: SSVM network throttling

2013-04-30 Thread Jeronimo Garcia
Apparently it might be an issue with the BL460C g6 we're using ... it could
be firmware .

I'll update.


On Tue, Apr 30, 2013 at 3:02 PM, Alena Prokharchyk <
alena.prokharc...@citrix.com> wrote:

> There is one generic KVM system template that you should use; nothing
> specific to Ubuntu.
>
> -Alena.
>
> On 4/30/13 12:31 PM, "Jeronimo Garcia"  wrote:
>
> >Alena , one question more ... is there an specific SSVM that i should
> >download if I'm using ubuntu 12.10 as host?
> >
> >Thanks
> >
> >
> >On Tue, Apr 30, 2013 at 1:36 PM, Jeronimo Garcia
> >wrote:
> >
> >> "networkRateMbps":-1, ... it is unlimited.
> >>
> >> We don't know what could be causing this ... scp transfers seem faster
> >> than anything else..
> >>
> >>
> >> On Tue, Apr 30, 2013 at 1:31 PM, Alena Prokharchyk <
> >> alena.prokharc...@citrix.com> wrote:
> >>
> >>> Sorry, read it from the management server log file.
> >>>
> >>> On 4/30/13 11:29 AM, "Jeronimo Garcia"  wrote:
> >>>
> >>> >Hi there.
> >>> >Thanks for your help
> >>> >
> >>> >is vmops.log in the SSVM or in the host running SSVM , i can't seem to
> >>> >find
> >>> >the file.
> >>> >
> >>> >Thanks
> >>> >
> >>> >
> >>> >On Tue, Apr 30, 2013 at 1:18 PM, Alena Prokharchyk <
> >>> >alena.prokharc...@citrix.com> wrote:
> >>> >
> >>> >> Hi Jeronimo,
> >>> >>
> >>> >> The throttling rate for SSVM can either be taken from the system
> >>> >> network offering (for Control/Public/Storage traffic types); or if
> >>>its
> >>> >>set
> >>> >> to NULL on the network offering, it gets taken from the global
> >>>config.
> >>> >>By
> >>> >> default, on the system network offerings the rate is set to 0 -
> >>> >>unlimited.
> >>> >>
> >>> >> Can you check what value for parameter "networkRateMbps" was sent to
> >>> the
> >>> >> backend with StartCommand for SSVM? Here is the grep you can use as
> >>>an
> >>> >> example:
> >>> >>
> >>> >> grep StartCommand vmops.log  | grep s-1-VM | grep networkRateMbps
> >>> >>
> >>> >> -1 in the StartCommand means unlimited.
> >>> >>
> >>> >> -Alena.
> >>> >>
> >>> >> On 4/30/13 11:07 AM, "Jeronimo Garcia" 
> wrote:
> >>> >>
> >>> >> >Hi List.
> >>> >> >
> >>> >> >Is there any setting that might be affecting the network speed on
> >>>the
> >>> >> >SSVM?
> >>> >> >
> >>> >> >I'm using the default network offering for SSVM and these are my
> >>> global
> >>> >> >settings:
> >>> >> >
> >>> >> >vm.network.throttling.rate = 0
> >>> >> >network.throttling.rate = 0
> >>> >> >
> >>> >> >
> >>> >> >the 5.5-nogui template times out due to this:
> >>> >> >root@s-3-VM:~# wget
> >>> >> >
> >>> >>
> >>> >>
> >>>
> >>>
> http://download.cloud.com/releases/2.2.0/eec2209b-9875-3c8d-92be-c001bd8
> >>>a
> >>> >>0
> >>> >> >faf.qcow2.bz2
> >>> >> >--2013-04-30 17:07:09--
> >>> >> >
> >>> >>
> >>> >>
> >>>
> >>>
> http://download.cloud.com/releases/2.2.0/eec2209b-9875-3c8d-92be-c001bd8
> >>>a
> >>> >>0
> >>> >> >faf.qcow2.bz2
> >>> >> >Resolving download.cloud.com... 72.21.194.23
> >>> >> >Connecting to download.cloud.com|72.21.194.23|:80... connected.
> >>> >> >HTTP request sent, awaiting response... 200 OK
> >>> >> >Length: 472312242 (450M) [application/x-bzip2]
> >>> >> >Saving to: ³eec2209b-9875-3c8d-92be-c001bd8a0faf.qcow2.bz2²
> >>> >> >
> >>> >> > 0% [
> >>> >> > ] 2,215353B/s  eta* 22d 15h *
> >>> >> >*
> >>> >> >*
> >>> >> >that's 22days to download the template.
> >>> >> >
> >>> >> >I'm using Ubuntu 12.10 .
> >>> >> >
> >>> >> >Thanks
> >>> >> >
> >>> >>
> >>> >>
> >>> >>
> >>> >
> >>>
> >>>
> >>>
> >>
> >
>
>
>


Re: [Docs] Questions on baremetal feature (CLOUDSTACK-774)

2013-04-30 Thread Jessica Tomechak
On Tue, Apr 30, 2013 at 1:46 PM, Frank Zhang  wrote:

> ** **
>
> ** **
>
> *From:* Jessica Tomechak [mailto:jessica.tomec...@gmail.com]
> *Sent:* Monday, April 29, 2013 10:02 PM
> *To:* dev@cloudstack.apache.org; Frank Zhang
> *Subject:* [Docs] Questions on baremetal feature (CLOUDSTACK-774)
>
> ** **
>
> I was finishing up a doc draft for this feature today, and generated the
> following technical questions. If any expert on this list can provide more
> information, it's much appreciated.
>
> **1.  **In one of the example API calls to addBaremetalHost that I
> have seen, it's issued at the Management Server command line, not through
> the browser. I assume this is not significant – just an alternative way to
> issue an API call. Is that correct?
>
> You are right. API can be issued through browser anyway. The example
> showing on command line is just an alternative 
>
> **2.  **The same example I saw didn't have the &apiKey and
> &signature, which are ordinarily required. Is this an oversight, or are
> they not required in this case?
>
> Api issued on command line is not required with security stuff, that’s the
> reason we use command line
>
> **3.  **Please confirm that the Juniper SRX firewall can be used in
> zones that have basic networking? Some earlier docs state it's only for
> advanced zones.
>
> I suggest removing this part. 
>
> **4.  **I have noted that with the kickstart feature, the file server
> where the image and kickstart file are stored has to be an NFS server, not
> any other type. Correct?
>
> Yes, for now we use NFS only
>
> Thanks,
>
> Jessica T.
>

Awesome, thank you, Frank!

Jessica T.


Re: New Committer: Clayton Weise

2013-04-30 Thread Chiradeep Vittal
Good show. 

On 4/30/13 1:29 PM, "Animesh Chaturvedi" 
wrote:

>Congratulations Clayton
>
>> -Original Message-
>> From: Chip Childers [mailto:chip.child...@sungard.com]
>> Sent: Tuesday, April 30, 2013 9:53 AM
>> To: dev@cloudstack.apache.org
>> Cc: cwe...@iswest.net
>> Subject: New Committer: Clayton Weise
>> 
>> The Project Management Committee (PMC) for Apache CloudStack has
>> asked Clayton Weise to become a committer and we are pleased to
>> announce that he has accepted.
>> 
>> Clayton is exceptionally active on the #cloudstack IRC channel, helping
>>users
>> with all sorts of questions and support topics.  He's also been active
>>on the
>> user list in a similar capacity.
>> 
>> Being a committer allows many contributors to contribute more
>> autonomously. For developers, it makes it easier to submit changes and
>> eliminates the need to have contributions reviewed via the patch
>>submission
>> process. Whether contributions are development-related or otherwise, it
>>is a
>> recognition of a contributor's participation in the project and
>>commitment to
>> the project and the Apache Way.
>> 
>> Please join me in congratulating Clayton!
>> 
>> --Chip Childers
>> on behalf of the CloudStack PMC



Virtual Router: DHCP and 2-second DNS outages

2013-04-30 Thread Dennis Lawler
Every time a new VM is started up, there is a 2 second outage in DNS
services that can cause problems in guest VMs that use the router VM for
DNS.

 

For Cloudstack configurations using both DHCP and DNS services on the router
VM (both implemented with dnsmasq), there is currently a 2 second DNS
service outage every time a new VM is instantiated

 

The source of this outage is in edithosts.sh, which uses "service dnsmasq
restart" to pick up the freshly added DNS and DHCP entries.

Restarting the dnsmasq service triggers a sleep for 2 seconds after killing
dnsmasq before starting it back up again.

 

An obvious solution would be to replace "service dnsmasq restart" with "kill
-s 1 $pid" (SIGHUP) so that dnsmasq reads the new DHCP entries without
restarting, as in dnsmasq_edithosts.sh (external dhcp).

 

Unfortunately, this solution is flawed because dnsmasq SIGHUP handling does
not expire in-memory DHCP leases in dnsmasq and all leases are infinite by
default.

Thus, this will only work if the guest VM performs a DHCP release on
shutdown, which cannot always be guaranteed.

 

A few possible solutions off the top of my head:

1.   Separate DNS and DHCP services.  While DHCP services still
experience an outage during VM,  DNS will not necessarily be impacted if
implemented correctly.

2.   Use SIGHUP with dnsmasq and implement a removeDhcpEntry interface
for network appliances to force a DHCP release whenever a NIC / IP is
deallocated.  This can use dhcp_release to simulate a DHCP release on the
router VM.
Catch: dhcp_release is not available for Debian 6.0.  The System VM needs to
be updated to at least Debian 7.0, or the dnsmasq-tools .deb from 7.0 would
need to be included in the System VM image.

3.   Change DHCP to have a shorter lease, track de-allocation of IPs
separately from VM destruction.  
Catch: This may cause occasional IP pool exhaustion depending on allocation
of the guest IP range and the rate of VM destruction / instantiation in the
network.

 

Thoughts?



Network Resource Certificate Management

2013-04-30 Thread Soheil Eizadi
Hi,
What is the deployment model for how the SSL Certificate for a Network
Resource that is managed by CloudStack will get into the CloudStack
KeyStore? For Dev/Test I can ignore the Certificate for now but would like
to know how this will work for a real deployment.

Are there CloudStack APIs to copy the certificate to the Keystore?

My only exposure to the Keystore is the warning I get when I run the
application at startup:
>> WARN  [utils.script.Script] (Timer-2:) Timed out: sudo keytool -genkey
>>...

Thanks,
-Soheil



Re: Virtual Router: DHCP and 2-second DNS outages

2013-04-30 Thread Chiradeep Vittal


On 4/30/13 3:26 PM, "Dennis Lawler"  wrote:

>Every time a new VM is started up, there is a 2 second outage in DNS
>services that can cause problems in guest VMs that use the router VM for
>DNS.
>
> 
>
>For Cloudstack configurations using both DHCP and DNS services on the
>router
>VM (both implemented with dnsmasq), there is currently a 2 second DNS
>service outage every time a new VM is instantiated
>
> 
>
>The source of this outage is in edithosts.sh, which uses "service dnsmasq
>restart" to pick up the freshly added DNS and DHCP entries.
>
>Restarting the dnsmasq service triggers a sleep for 2 seconds after
>killing
>dnsmasq before starting it back up again.
>
> 
>
>An obvious solution would be to replace "service dnsmasq restart" with
>"kill
>-s 1 $pid" (SIGHUP) so that dnsmasq reads the new DHCP entries without
>restarting, as in dnsmasq_edithosts.sh (external dhcp).
> 
>
>Unfortunately, this solution is flawed because dnsmasq SIGHUP handling
>does
>not expire in-memory DHCP leases in dnsmasq and all leases are infinite by
>default.

Aha! That's why SIGHUP didn't work consistently. This has been bugging me
for a long time.

>Thus, this will only work if the guest VM performs a DHCP release on
>shutdown, which cannot always be guaranteed.
>
> 
>
>A few possible solutions off the top of my head:
>
>1.   Separate DNS and DHCP services.  While DHCP services still
>experience an outage during VM,  DNS will not necessarily be impacted if
>implemented correctly.
>
>2.   Use SIGHUP with dnsmasq and implement a removeDhcpEntry interface
>for network appliances to force a DHCP release whenever a NIC / IP is
>deallocated.  This can use dhcp_release to simulate a DHCP release on the
>router VM.
>Catch: dhcp_release is not available for Debian 6.0.  The System VM needs
>to
>be updated to at least Debian 7.0, or the dnsmasq-tools .deb from 7.0
>would
>need to be included in the System VM image.

There is going to be a new system vm based on 7.0 for the upcoming
release. This should work with earlier releases as well.
https://cwiki.apache.org/confluence/x/UlHVAQ

>
>3.   Change DHCP to have a shorter lease, track de-allocation of IPs
>separately from VM destruction.
>Catch: This may cause occasional IP pool exhaustion depending on
>allocation
>of the guest IP range and the rate of VM destruction / instantiation in
>the
>network.
>
> 
>
>Thoughts?
>



RE: New Committer: Clayton Weise

2013-04-30 Thread Clayton Weise
You know what this mean.  Now I no longer have an excuse as to why the 
documentation we've put on the wiki can't be added to the official 
documentation for CS :)

-Original Message-
From: Kelcey Damage (BT) [mailto:kel...@backbonetechnology.com] 
Sent: Tuesday, April 30, 2013 9:55 AM
To: dev@cloudstack.apache.org
Subject: RE: New Committer: Clayton Weise

It's about time! Lol.

Now I have an official partner in crime

>-Original Message-
>From: Chip Childers [mailto:chip.child...@sungard.com]
>Sent: Tuesday, April 30, 2013 9:53 AM
>To: dev@cloudstack.apache.org
>Cc: cwe...@iswest.net
>Subject: New Committer: Clayton Weise
>
>The Project Management Committee (PMC) for Apache CloudStack has asked
>Clayton Weise to become a committer and we are pleased to announce that he
>has accepted.
>
>Clayton is exceptionally active on the #cloudstack IRC channel, helping
users
>with all sorts of questions and support topics.  He's also been active on
the user
>list in a similar capacity.
>
>Being a committer allows many contributors to contribute more autonomously.
>For developers, it makes it easier to submit changes and eliminates the
need to
>have contributions reviewed via the patch submission process. Whether
>contributions are development-related or otherwise, it is a recognition of
a
>contributor's participation in the project and commitment to the project
and
>the Apache Way.
>
>Please join me in congratulating Clayton!
>
>--Chip Childers
>on behalf of the CloudStack PMC



RE: New Committer: Clayton Weise

2013-04-30 Thread Kelcey Damage (BT)
Oh snap, you opened that can of worms... I had worked hard to sweep it under
the rug lol



>-Original Message-
>From: Clayton Weise [mailto:cwe...@iswest.net]
>Sent: Tuesday, April 30, 2013 5:06 PM
>To: dev@cloudstack.apache.org
>Subject: RE: New Committer: Clayton Weise
>
>You know what this mean.  Now I no longer have an excuse as to why the
>documentation we've put on the wiki can't be added to the official
>documentation for CS :)
>
>-Original Message-
>From: Kelcey Damage (BT) [mailto:kel...@backbonetechnology.com]
>Sent: Tuesday, April 30, 2013 9:55 AM
>To: dev@cloudstack.apache.org
>Subject: RE: New Committer: Clayton Weise
>
>It's about time! Lol.
>
>Now I have an official partner in crime
>
>>-Original Message-
>>From: Chip Childers [mailto:chip.child...@sungard.com]
>>Sent: Tuesday, April 30, 2013 9:53 AM
>>To: dev@cloudstack.apache.org
>>Cc: cwe...@iswest.net
>>Subject: New Committer: Clayton Weise
>>
>>The Project Management Committee (PMC) for Apache CloudStack has asked
>>Clayton Weise to become a committer and we are pleased to announce that
>>he has accepted.
>>
>>Clayton is exceptionally active on the #cloudstack IRC channel, helping
>users
>>with all sorts of questions and support topics.  He's also been active
>>on
>the user
>>list in a similar capacity.
>>
>>Being a committer allows many contributors to contribute more
>autonomously.
>>For developers, it makes it easier to submit changes and eliminates the
>need to
>>have contributions reviewed via the patch submission process. Whether
>>contributions are development-related or otherwise, it is a recognition
>>of
>a
>>contributor's participation in the project and commitment to the
>>project
>and
>>the Apache Way.
>>
>>Please join me in congratulating Clayton!
>>
>>--Chip Childers
>>on behalf of the CloudStack PMC




Re: SSVM network throttling

2013-04-30 Thread Ove Ewerlid

On 04/30/2013 10:59 PM, Jeronimo Garcia wrote:

Apparently it might be an issue with the BL460C g6 we're using ... it could
be firmware .

I'll update.


I've seen odd "throttling" style issues originate from hardware 
acceleration in the host network cards for TCP connections. if you have 
receive offload enabled, try to disable. check the manual page of 
ethtool, the -k/-K options.


/Ove




On Tue, Apr 30, 2013 at 3:02 PM, Alena Prokharchyk <
alena.prokharc...@citrix.com> wrote:


There is one generic KVM system template that you should use; nothing
specific to Ubuntu.

-Alena.

On 4/30/13 12:31 PM, "Jeronimo Garcia"  wrote:


Alena , one question more ... is there an specific SSVM that i should
download if I'm using ubuntu 12.10 as host?

Thanks


On Tue, Apr 30, 2013 at 1:36 PM, Jeronimo Garcia
wrote:


"networkRateMbps":-1, ... it is unlimited.

We don't know what could be causing this ... scp transfers seem faster
than anything else..


On Tue, Apr 30, 2013 at 1:31 PM, Alena Prokharchyk <
alena.prokharc...@citrix.com> wrote:


Sorry, read it from the management server log file.

On 4/30/13 11:29 AM, "Jeronimo Garcia"  wrote:


Hi there.
Thanks for your help

is vmops.log in the SSVM or in the host running SSVM , i can't seem to
find
the file.

Thanks


On Tue, Apr 30, 2013 at 1:18 PM, Alena Prokharchyk <
alena.prokharc...@citrix.com> wrote:


Hi Jeronimo,

The throttling rate for SSVM can either be taken from the system
network offering (for Control/Public/Storage traffic types); or if

its

set
to NULL on the network offering, it gets taken from the global

config.

By
default, on the system network offerings the rate is set to 0 -
unlimited.

Can you check what value for parameter "networkRateMbps" was sent to

the

backend with StartCommand for SSVM? Here is the grep you can use as

an

example:

grep StartCommand vmops.log  | grep s-1-VM | grep networkRateMbps

-1 in the StartCommand means unlimited.

-Alena.

On 4/30/13 11:07 AM, "Jeronimo Garcia" 

wrote:



Hi List.

Is there any setting that might be affecting the network speed on

the

SSVM?

I'm using the default network offering for SSVM and these are my

global

settings:

vm.network.throttling.rate = 0
network.throttling.rate = 0


the 5.5-nogui template times out due to this:
root@s-3-VM:~# wget








http://download.cloud.com/releases/2.2.0/eec2209b-9875-3c8d-92be-c001bd8

a

0

faf.qcow2.bz2
--2013-04-30 17:07:09--








http://download.cloud.com/releases/2.2.0/eec2209b-9875-3c8d-92be-c001bd8

a

0

faf.qcow2.bz2
Resolving download.cloud.com... 72.21.194.23
Connecting to download.cloud.com|72.21.194.23|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 472312242 (450M) [application/x-bzip2]
Saving to: ³eec2209b-9875-3c8d-92be-c001bd8a0faf.qcow2.bz2²

0% [
 ] 2,215353B/s  eta* 22d 15h *
*
*
that's 22days to download the template.

I'm using Ubuntu 12.10 .

Thanks
























--
Ove Everlid
System Administrator / Architect / SDN & Linux hacker
Mobile: +46706662363
Office: +4618656913 (note EMEA Time Zone)


RE: New Committer: Clayton Weise

2013-04-30 Thread Musayev, Ilya
Congrats Clayton!

-Original Message-
From: Clayton Weise [mailto:cwe...@iswest.net] 
Sent: Tuesday, April 30, 2013 8:06 PM
To: dev@cloudstack.apache.org
Subject: RE: New Committer: Clayton Weise

You know what this mean.  Now I no longer have an excuse as to why the 
documentation we've put on the wiki can't be added to the official 
documentation for CS :)

-Original Message-
From: Kelcey Damage (BT) [mailto:kel...@backbonetechnology.com]
Sent: Tuesday, April 30, 2013 9:55 AM
To: dev@cloudstack.apache.org
Subject: RE: New Committer: Clayton Weise

It's about time! Lol.

Now I have an official partner in crime

>-Original Message-
>From: Chip Childers [mailto:chip.child...@sungard.com]
>Sent: Tuesday, April 30, 2013 9:53 AM
>To: dev@cloudstack.apache.org
>Cc: cwe...@iswest.net
>Subject: New Committer: Clayton Weise
>
>The Project Management Committee (PMC) for Apache CloudStack has asked 
>Clayton Weise to become a committer and we are pleased to announce that 
>he has accepted.
>
>Clayton is exceptionally active on the #cloudstack IRC channel, helping
users
>with all sorts of questions and support topics.  He's also been active 
>on
the user
>list in a similar capacity.
>
>Being a committer allows many contributors to contribute more autonomously.
>For developers, it makes it easier to submit changes and eliminates the
need to
>have contributions reviewed via the patch submission process. Whether 
>contributions are development-related or otherwise, it is a recognition 
>of
a
>contributor's participation in the project and commitment to the 
>project
and
>the Apache Way.
>
>Please join me in congratulating Clayton!
>
>--Chip Childers
>on behalf of the CloudStack PMC





Re: New Committer: Clayton Weise

2013-04-30 Thread Go Chiba
Congrats Clayton!


On Wed, May 1, 2013 at 9:05 AM, Clayton Weise  wrote:

> You know what this mean.  Now I no longer have an excuse as to why the
> documentation we've put on the wiki can't be added to the official
> documentation for CS :)
>
> -Original Message-
> From: Kelcey Damage (BT) [mailto:kel...@backbonetechnology.com]
> Sent: Tuesday, April 30, 2013 9:55 AM
> To: dev@cloudstack.apache.org
> Subject: RE: New Committer: Clayton Weise
>
> It's about time! Lol.
>
> Now I have an official partner in crime
>
> >-Original Message-
> >From: Chip Childers [mailto:chip.child...@sungard.com]
> >Sent: Tuesday, April 30, 2013 9:53 AM
> >To: dev@cloudstack.apache.org
> >Cc: cwe...@iswest.net
> >Subject: New Committer: Clayton Weise
> >
> >The Project Management Committee (PMC) for Apache CloudStack has asked
> >Clayton Weise to become a committer and we are pleased to announce that he
> >has accepted.
> >
> >Clayton is exceptionally active on the #cloudstack IRC channel, helping
> users
> >with all sorts of questions and support topics.  He's also been active on
> the user
> >list in a similar capacity.
> >
> >Being a committer allows many contributors to contribute more
> autonomously.
> >For developers, it makes it easier to submit changes and eliminates the
> need to
> >have contributions reviewed via the patch submission process. Whether
> >contributions are development-related or otherwise, it is a recognition of
> a
> >contributor's participation in the project and commitment to the project
> and
> >the Apache Way.
> >
> >Please join me in congratulating Clayton!
> >
> >--Chip Childers
> >on behalf of the CloudStack PMC
>
>


-- 
千葉 豪  Go Chiba
E-mail:go.ch...@gmail.com


Re: New Committer: Clayton Weise

2013-04-30 Thread Isaac Chiang
Congratulations :)


On Wed, May 1, 2013 at 10:59 AM, Go Chiba  wrote:

> Congrats Clayton!
>
>
> On Wed, May 1, 2013 at 9:05 AM, Clayton Weise  wrote:
>
> > You know what this mean.  Now I no longer have an excuse as to why the
> > documentation we've put on the wiki can't be added to the official
> > documentation for CS :)
> >
> > -Original Message-
> > From: Kelcey Damage (BT) [mailto:kel...@backbonetechnology.com]
> > Sent: Tuesday, April 30, 2013 9:55 AM
> > To: dev@cloudstack.apache.org
> > Subject: RE: New Committer: Clayton Weise
> >
> > It's about time! Lol.
> >
> > Now I have an official partner in crime
> >
> > >-Original Message-
> > >From: Chip Childers [mailto:chip.child...@sungard.com]
> > >Sent: Tuesday, April 30, 2013 9:53 AM
> > >To: dev@cloudstack.apache.org
> > >Cc: cwe...@iswest.net
> > >Subject: New Committer: Clayton Weise
> > >
> > >The Project Management Committee (PMC) for Apache CloudStack has asked
> > >Clayton Weise to become a committer and we are pleased to announce that
> he
> > >has accepted.
> > >
> > >Clayton is exceptionally active on the #cloudstack IRC channel, helping
> > users
> > >with all sorts of questions and support topics.  He's also been active
> on
> > the user
> > >list in a similar capacity.
> > >
> > >Being a committer allows many contributors to contribute more
> > autonomously.
> > >For developers, it makes it easier to submit changes and eliminates the
> > need to
> > >have contributions reviewed via the patch submission process. Whether
> > >contributions are development-related or otherwise, it is a recognition
> of
> > a
> > >contributor's participation in the project and commitment to the project
> > and
> > >the Apache Way.
> > >
> > >Please join me in congratulating Clayton!
> > >
> > >--Chip Childers
> > >on behalf of the CloudStack PMC
> >
> >
>
>
> --
> 千葉 豪  Go Chiba
> E-mail:go.ch...@gmail.com
>


Re: Why was this reverted?

2013-04-30 Thread Prasanna Santhanam
Hi Alex,

I looked back to understand why I made that change and it seems like
a side-effect that came from when I merged the simulator branch. Not
just your checkin, I seem to have overwritten some of the changes to
the pom that I made post-graduation. I've reverted my checkin now and
checked the commits between 3/1-3/20 to ensure there were no other side
effects.

Thanks for catching it. Since I wasn't using eclipse I didn't see the
problem it may have caused.

commit bb63d713ce1e6b45f5affb7bb105295b486a2eff
Author: Prasanna Santhanam 
Date:   Wed May 1 08:59:22 2013 +0530

Revert "removing unused commented dependencies"

This reverts commit 8e917b1ad3c0d3076b0c6425ea3318a6d6dd5c25.
Fixing the eclipse setting issue caused by excluding .
This also fixes the incubation -> graduation links in the various poms.

Conflicts:
pom.xml


On Tue, Apr 30, 2013 at 09:38:02AM -0700, Alex Huang wrote:
> Hi Prasanna,
> 
> I come back from vacation and find that a special configuration I put into 
> the pom.xml to avoid eclipse and maven build to conflict with each other has 
> been reverted.  I checked the commit comments and there's nothing in the 
> comments why this is reverted.  Please let me know why it is reverted.
> 
> The commit is 8e917b1ad3c0d3076b0c6425ea3318a6d6dd5c25.
> 
> It reverted the eclipse profile and the cs.target.dir configuration.
> 
> Thanks.
> 
> --Alex

-- 
Prasanna.,


Powered by BigRock.com



Re: New Committer: Clayton Weise

2013-04-30 Thread Prasanna Santhanam
On Tue, Apr 30, 2013 at 12:53:24PM -0400, Chip Childers wrote:
> The Project Management Committee (PMC) for Apache CloudStack
> has asked Clayton Weise to become a committer and we are pleased to 
> announce that he has accepted.
> 
> Clayton is exceptionally active on the #cloudstack IRC channel, helping
> users with all sorts of questions and support topics.  He's also been
> active on the user list in a similar capacity.
> 
> Being a committer allows many contributors to contribute more
> autonomously. For developers, it makes it easier to submit changes and
> eliminates the need to have contributions reviewed via the patch
> submission process. Whether contributions are development-related or
> otherwise, it is a recognition of a contributor's participation in the
> project and commitment to the project and the Apache Way.
> 
> Please join me in congratulating Clayton!
> 
> --Chip Childers
> on behalf of the CloudStack PMC

Congratulations Clayton!

-- 
Prasanna.,


Powered by BigRock.com



Re: Renaming updateVMAffinityGroup -> updateAffinityGroup

2013-04-30 Thread Prasanna Santhanam
On Tue, Apr 30, 2013 at 10:31:46AM -0700, Prachi Damle wrote:
> Hi Prasanna,
> 
> The API is to update a VirtualMachine's affinity group associations
> - it's not really an update operation on an affinity group - hence
> the odd naming. The resource the API is acting on is a VM.

> Please suggest any other name that seems meaningful and fits the
> conventions...

Yes I imagined it would be something to do with the VM. But
deleteAffinityGroup&vmid= then got me wondering. If it is
'updateVmAffinity' then it should be 'deleteVmAffinity' as well? Or does
the delete also remove the affinity group after dissociating the group
from the VM? I think not - because the affinity group could be
associated with multiple VMs?
:wq

-- 
Prasanna.,


Powered by BigRock.com



Re: Virtual Router: DHCP and 2-second DNS outages

2013-04-30 Thread Marcus Sorensen
that's strange, because the dnsmasq man page explicitly calls out the
SIGHUP as a way to reconfigure DHCP hosts entries from a --dhcp-hostsfile
parameter. Or are these not the same thing?


On Tue, Apr 30, 2013 at 5:52 PM, Chiradeep Vittal <
chiradeep.vit...@citrix.com> wrote:

>
>
> On 4/30/13 3:26 PM, "Dennis Lawler"  wrote:
>
> >Every time a new VM is started up, there is a 2 second outage in DNS
> >services that can cause problems in guest VMs that use the router VM for
> >DNS.
> >
> >
> >
> >For Cloudstack configurations using both DHCP and DNS services on the
> >router
> >VM (both implemented with dnsmasq), there is currently a 2 second DNS
> >service outage every time a new VM is instantiated
> >
> >
> >
> >The source of this outage is in edithosts.sh, which uses "service dnsmasq
> >restart" to pick up the freshly added DNS and DHCP entries.
> >
> >Restarting the dnsmasq service triggers a sleep for 2 seconds after
> >killing
> >dnsmasq before starting it back up again.
> >
> >
> >
> >An obvious solution would be to replace "service dnsmasq restart" with
> >"kill
> >-s 1 $pid" (SIGHUP) so that dnsmasq reads the new DHCP entries without
> >restarting, as in dnsmasq_edithosts.sh (external dhcp).
> >
> >
> >Unfortunately, this solution is flawed because dnsmasq SIGHUP handling
> >does
> >not expire in-memory DHCP leases in dnsmasq and all leases are infinite by
> >default.
>
> Aha! That's why SIGHUP didn't work consistently. This has been bugging me
> for a long time.
>
> >Thus, this will only work if the guest VM performs a DHCP release on
> >shutdown, which cannot always be guaranteed.
> >
> >
> >
> >A few possible solutions off the top of my head:
> >
> >1.   Separate DNS and DHCP services.  While DHCP services still
> >experience an outage during VM,  DNS will not necessarily be impacted if
> >implemented correctly.
> >
> >2.   Use SIGHUP with dnsmasq and implement a removeDhcpEntry interface
> >for network appliances to force a DHCP release whenever a NIC / IP is
> >deallocated.  This can use dhcp_release to simulate a DHCP release on the
> >router VM.
> >Catch: dhcp_release is not available for Debian 6.0.  The System VM needs
> >to
> >be updated to at least Debian 7.0, or the dnsmasq-tools .deb from 7.0
> >would
> >need to be included in the System VM image.
>
> There is going to be a new system vm based on 7.0 for the upcoming
> release. This should work with earlier releases as well.
> https://cwiki.apache.org/confluence/x/UlHVAQ
>
> >
> >3.   Change DHCP to have a shorter lease, track de-allocation of IPs
> >separately from VM destruction.
> >Catch: This may cause occasional IP pool exhaustion depending on
> >allocation
> >of the guest IP range and the rate of VM destruction / instantiation in
> >the
> >network.
> >
> >
> >
> >Thoughts?
> >
>
>


Re: Review Request: CLOUDSTACK-741 global granular parameters and CLOUDSTACK-2036 router template Id

2013-04-30 Thread Abhinandan Prateek

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10862/#review19991
---

Ship it!


Ship It!

- Abhinandan Prateek


On April 30, 2013, 1:42 p.m., Harikrishna Patnala wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/10862/
> ---
> 
> (Updated April 30, 2013, 1:42 p.m.)
> 
> 
> Review request for cloudstack, Abhinandan Prateek and Nitin Mehta.
> 
> 
> Description
> ---
> 
> CLOUDSTACK-741: Granular Global Parameters Added parameters
>  to cluster level
>  cluster.storage.allocated.capacity.notificationthreshold
>  cluster.storage.capacity.notificationthreshold
> 
> CLOUDSTACK-2036
> global parameter for Router Template ID functionality added
> We use 5 parameters to set the router template name for each hypervisor
> 
> Moved cpu.overprovisioning.factor and mem.overprovisioning.factor to be able 
> to update/list using update/list configuration API at cluster level
> 
> 
> This addresses bugs CLOUDSTACK-2036 and CLOUDSTACK-741.
> 
> 
> Diffs
> -
> 
>   server/src/com/cloud/alert/AlertManagerImpl.java 6839d44 
>   server/src/com/cloud/configuration/Config.java af6adcf 
>   server/src/com/cloud/configuration/ConfigurationManagerImpl.java 068a586 
>   server/src/com/cloud/dc/ClusterDetailsDaoImpl.java 4c85918 
>   server/src/com/cloud/network/router/VirtualNetworkApplianceManagerImpl.java 
> 4c7bc75 
>   server/src/com/cloud/storage/dao/VMTemplateDao.java 3f1fe93 
>   server/src/com/cloud/storage/dao/VMTemplateDaoImpl.java 3b37f24 
>   test/integration/smoke/test_global_settings.py ec18cea 
> 
> Diff: https://reviews.apache.org/r/10862/diff/
> 
> 
> Testing
> ---
> 
> Tested locally
> 
> 
> Thanks,
> 
> Harikrishna Patnala
> 
>



Re: Review Request: CLOUDSTACK-741 global granular parameters and CLOUDSTACK-2036 router template Id

2013-04-30 Thread Nitin Mehta

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10862/#review19990
---

Ship it!



server/src/com/cloud/configuration/Config.java


Name is not unique.  Its a TO DO item.
Please create a bug to make it unique if you are going down this path.



server/src/com/cloud/dc/ClusterDetailsDaoImpl.java


Can you please create a bug to fix this in future ?


- Nitin Mehta


On April 30, 2013, 1:42 p.m., Harikrishna Patnala wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/10862/
> ---
> 
> (Updated April 30, 2013, 1:42 p.m.)
> 
> 
> Review request for cloudstack, Abhinandan Prateek and Nitin Mehta.
> 
> 
> Description
> ---
> 
> CLOUDSTACK-741: Granular Global Parameters Added parameters
>  to cluster level
>  cluster.storage.allocated.capacity.notificationthreshold
>  cluster.storage.capacity.notificationthreshold
> 
> CLOUDSTACK-2036
> global parameter for Router Template ID functionality added
> We use 5 parameters to set the router template name for each hypervisor
> 
> Moved cpu.overprovisioning.factor and mem.overprovisioning.factor to be able 
> to update/list using update/list configuration API at cluster level
> 
> 
> This addresses bugs CLOUDSTACK-2036 and CLOUDSTACK-741.
> 
> 
> Diffs
> -
> 
>   server/src/com/cloud/alert/AlertManagerImpl.java 6839d44 
>   server/src/com/cloud/configuration/Config.java af6adcf 
>   server/src/com/cloud/configuration/ConfigurationManagerImpl.java 068a586 
>   server/src/com/cloud/dc/ClusterDetailsDaoImpl.java 4c85918 
>   server/src/com/cloud/network/router/VirtualNetworkApplianceManagerImpl.java 
> 4c7bc75 
>   server/src/com/cloud/storage/dao/VMTemplateDao.java 3f1fe93 
>   server/src/com/cloud/storage/dao/VMTemplateDaoImpl.java 3b37f24 
>   test/integration/smoke/test_global_settings.py ec18cea 
> 
> Diff: https://reviews.apache.org/r/10862/diff/
> 
> 
> Testing
> ---
> 
> Tested locally
> 
> 
> Thanks,
> 
> Harikrishna Patnala
> 
>



Re: Review Request: CLOUDSTACK-741 global granular parameters and CLOUDSTACK-2036 router template Id

2013-04-30 Thread Abhinandan Prateek


> On May 1, 2013, 6:21 a.m., Abhinandan Prateek wrote:
> > Ship It!

Waiting for nitin's review.


- Abhinandan


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10862/#review19991
---


On April 30, 2013, 1:42 p.m., Harikrishna Patnala wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/10862/
> ---
> 
> (Updated April 30, 2013, 1:42 p.m.)
> 
> 
> Review request for cloudstack, Abhinandan Prateek and Nitin Mehta.
> 
> 
> Description
> ---
> 
> CLOUDSTACK-741: Granular Global Parameters Added parameters
>  to cluster level
>  cluster.storage.allocated.capacity.notificationthreshold
>  cluster.storage.capacity.notificationthreshold
> 
> CLOUDSTACK-2036
> global parameter for Router Template ID functionality added
> We use 5 parameters to set the router template name for each hypervisor
> 
> Moved cpu.overprovisioning.factor and mem.overprovisioning.factor to be able 
> to update/list using update/list configuration API at cluster level
> 
> 
> This addresses bugs CLOUDSTACK-2036 and CLOUDSTACK-741.
> 
> 
> Diffs
> -
> 
>   server/src/com/cloud/alert/AlertManagerImpl.java 6839d44 
>   server/src/com/cloud/configuration/Config.java af6adcf 
>   server/src/com/cloud/configuration/ConfigurationManagerImpl.java 068a586 
>   server/src/com/cloud/dc/ClusterDetailsDaoImpl.java 4c85918 
>   server/src/com/cloud/network/router/VirtualNetworkApplianceManagerImpl.java 
> 4c7bc75 
>   server/src/com/cloud/storage/dao/VMTemplateDao.java 3f1fe93 
>   server/src/com/cloud/storage/dao/VMTemplateDaoImpl.java 3b37f24 
>   test/integration/smoke/test_global_settings.py ec18cea 
> 
> Diff: https://reviews.apache.org/r/10862/diff/
> 
> 
> Testing
> ---
> 
> Tested locally
> 
> 
> Thanks,
> 
> Harikrishna Patnala
> 
>



Re: Review Request: CLOUDSTACK-741 global granular parameters and CLOUDSTACK-2036 router template Id

2013-04-30 Thread ASF Subversion and Git Services

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10862/#review19993
---


Commit 10b6c1c6c8f8c2ec49145a901fb083e7f362f3a1 in branch refs/heads/master 
from Abhinandan Prateek 
[ https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;h=10b6c1c ]

CLOUDSTACK-741: Granular Global Parameters Added parameters to cluster level 
cluster.storage.allocated.capacity.notificationthreshold 
cluster.storage.capacity.notificationthreshold

CLOUDSTACK-2036
global parameter for Router Template ID functionality added
We use 5 parameters to set the router template name for each hypervisor

Moved cpu.overprovisioning.factor and mem.overprovisioning.factor to be able to 
update/list using update/list configuration API at cluster level.

Signed-off-by: Abhinandan Prateek 


- ASF Subversion and Git Services


On April 30, 2013, 1:42 p.m., Harikrishna Patnala wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/10862/
> ---
> 
> (Updated April 30, 2013, 1:42 p.m.)
> 
> 
> Review request for cloudstack, Abhinandan Prateek and Nitin Mehta.
> 
> 
> Description
> ---
> 
> CLOUDSTACK-741: Granular Global Parameters Added parameters
>  to cluster level
>  cluster.storage.allocated.capacity.notificationthreshold
>  cluster.storage.capacity.notificationthreshold
> 
> CLOUDSTACK-2036
> global parameter for Router Template ID functionality added
> We use 5 parameters to set the router template name for each hypervisor
> 
> Moved cpu.overprovisioning.factor and mem.overprovisioning.factor to be able 
> to update/list using update/list configuration API at cluster level
> 
> 
> This addresses bugs CLOUDSTACK-2036 and CLOUDSTACK-741.
> 
> 
> Diffs
> -
> 
>   server/src/com/cloud/alert/AlertManagerImpl.java 6839d44 
>   server/src/com/cloud/configuration/Config.java af6adcf 
>   server/src/com/cloud/configuration/ConfigurationManagerImpl.java 068a586 
>   server/src/com/cloud/dc/ClusterDetailsDaoImpl.java 4c85918 
>   server/src/com/cloud/network/router/VirtualNetworkApplianceManagerImpl.java 
> 4c7bc75 
>   server/src/com/cloud/storage/dao/VMTemplateDao.java 3f1fe93 
>   server/src/com/cloud/storage/dao/VMTemplateDaoImpl.java 3b37f24 
>   test/integration/smoke/test_global_settings.py ec18cea 
> 
> Diff: https://reviews.apache.org/r/10862/diff/
> 
> 
> Testing
> ---
> 
> Tested locally
> 
> 
> Thanks,
> 
> Harikrishna Patnala
> 
>



Re: Review Request: CLOUDSTACK-741: Granular Global Parameters

2013-04-30 Thread ASF Subversion and Git Services

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10548/#review19994
---


Commit 10b6c1c6c8f8c2ec49145a901fb083e7f362f3a1 in branch refs/heads/master 
from Abhinandan Prateek 
[ https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;h=10b6c1c ]

CLOUDSTACK-741: Granular Global Parameters Added parameters to cluster level 
cluster.storage.allocated.capacity.notificationthreshold 
cluster.storage.capacity.notificationthreshold

CLOUDSTACK-2036
global parameter for Router Template ID functionality added
We use 5 parameters to set the router template name for each hypervisor

Moved cpu.overprovisioning.factor and mem.overprovisioning.factor to be able to 
update/list using update/list configuration API at cluster level.

Signed-off-by: Abhinandan Prateek 


- ASF Subversion and Git Services


On April 19, 2013, 4:07 a.m., Harikrishna Patnala wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/10548/
> ---
> 
> (Updated April 19, 2013, 4:07 a.m.)
> 
> 
> Review request for cloudstack, Abhinandan Prateek, Kishan Kavala, and Nitin 
> Mehta.
> 
> 
> Description
> ---
> 
> CLOUDSTACK-741: Granular Global Parameters
> 
> Modified UpdateConfiguration API and ListConfiguration API by adding 
> additional parameter scope and resource id (zone/cluster/pool/account).
> Scope decides the parameter which level we can update the value and id is the 
> corresponding id based on the scope.
> This scope is defined in the config.java file where we are creating groups 
> for each level(zone/cluster/pool/account).
> Currently submitted the patch for the zone level parameter use.external.dns.
> 
> Included unit tests and marvin tests.
> 
> 
> This addresses bug CLOUDSTACK-741.
> 
> 
> Diffs
> -
> 
>   api/src/org/apache/cloudstack/api/command/admin/config/ListCfgsByCmd.java 
> aabfd4a 
>   api/src/org/apache/cloudstack/api/command/admin/config/UpdateCfgCmd.java 
> ffeb586 
>   api/src/org/apache/cloudstack/api/response/ConfigurationResponse.java 
> 95b8af2 
>   api/test/org/apache/cloudstack/api/command/test/ListCfgCmdTest.java 
> PRE-CREATION 
>   api/test/org/apache/cloudstack/api/command/test/UpdateCfgCmdTest.java 
> PRE-CREATION 
>   
> engine/api/src/org/apache/cloudstack/storage/datastore/db/StoragePoolDetailsDao.java
>  be71670 
>   server/src/com/cloud/configuration/Config.java 2993966 
>   server/src/com/cloud/configuration/ConfigurationManager.java afaf0d6 
>   server/src/com/cloud/configuration/ConfigurationManagerImpl.java 4fc2db7 
>   server/src/com/cloud/configuration/dao/ConfigurationDao.java c86c024 
>   server/src/com/cloud/network/router/VirtualNetworkApplianceManagerImpl.java 
> ab91059 
>   server/src/com/cloud/server/ConfigurationServer.java f441b1f 
>   server/src/com/cloud/server/ConfigurationServerImpl.java c4da1ab 
>   server/src/com/cloud/server/ManagementServerImpl.java 98f789a 
>   server/src/com/cloud/storage/dao/StoragePoolDetailsDaoImpl.java 0d797ed 
>   server/test/com/cloud/vpc/MockConfigurationManagerImpl.java 9443815 
>   test/integration/smoke/test_UpdateCfg.py PRE-CREATION 
> 
> Diff: https://reviews.apache.org/r/10548/diff/
> 
> 
> Testing
> ---
> 
> Tested locally
> - tested the modified UpdateConfiguration API and ListConfiguration API by 
> providing the zone scope and zone id
> - tested the modified parameter to take the updated value at zone level(after 
> updation).
> 
> 
> Thanks,
> 
> Harikrishna Patnala
> 
>



Re: Review Request: Source NAT on private gateway feature

2013-04-30 Thread Abhinandan Prateek

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10833/#review19995
---


In general looks good. Will wait for a review from Murali or Chiradeep.

- Abhinandan Prateek


On April 29, 2013, 6:57 a.m., Jayapal Reddy wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/10833/
> ---
> 
> (Updated April 29, 2013, 6:57 a.m.)
> 
> 
> Review request for cloudstack, Abhinandan Prateek, Murali Reddy, and 
> Chiradeep Vittal.
> 
> 
> Description
> ---
> 
> Source NAT on private gateway feature
> 
> 
> This addresses bug CLOUDSTACK-1828.
> 
> 
> Diffs
> -
> 
>   api/src/com/cloud/network/NetworkService.java 6c9bebc 
>   api/src/com/cloud/network/vpc/PrivateIp.java 857fc22 
>   api/src/com/cloud/network/vpc/VpcGateway.java 1756616 
>   api/src/com/cloud/network/vpc/VpcService.java 07ce89b 
>   
> api/src/org/apache/cloudstack/api/command/admin/vpc/CreatePrivateGatewayCmd.java
>  9fd736f 
>   api/src/org/apache/cloudstack/api/response/PrivateGatewayResponse.java 
> 4123477 
>   
> core/src/com/cloud/agent/resource/virtualnetwork/VirtualRoutingResource.java 
> 7148e07 
>   patches/systemvm/debian/config/opt/cloud/bin/vpc_privateGateway.sh a09d8f7 
>   
> plugins/hypervisors/kvm/src/com/cloud/hypervisor/kvm/resource/LibvirtComputingResource.java
>  0064edf 
>   
> plugins/hypervisors/vmware/src/com/cloud/hypervisor/vmware/resource/VmwareResource.java
>  99ad1ca 
>   
> plugins/hypervisors/xen/src/com/cloud/hypervisor/xen/resource/CitrixResourceBase.java
>  46ae35a 
>   server/src/com/cloud/api/ApiResponseHelper.java 6090ff0 
>   server/src/com/cloud/network/NetworkServiceImpl.java 2dcb47d 
>   
> server/src/com/cloud/network/router/VpcVirtualNetworkApplianceManagerImpl.java
>  bdfac06 
>   server/src/com/cloud/network/vpc/PrivateGatewayProfile.java 2595a6a 
>   server/src/com/cloud/network/vpc/PrivateIpAddress.java 826bea2 
>   server/src/com/cloud/network/vpc/PrivateIpVO.java e6616ae 
>   server/src/com/cloud/network/vpc/VpcGatewayVO.java 718e4df 
>   server/src/com/cloud/network/vpc/VpcManagerImpl.java 224a680 
>   server/test/com/cloud/network/MockNetworkManagerImpl.java e9987bd 
>   server/test/com/cloud/vpc/MockNetworkManagerImpl.java 9b18358 
>   server/test/com/cloud/vpc/MockVpcManagerImpl.java 0f26928 
>   setup/db/db/schema-410to420.sql 78444fd 
> 
> Diff: https://reviews.apache.org/r/10833/diff/
> 
> 
> Testing
> ---
> 
> 1. created the private gateway with source nat enable.
> 2. created private gateway with with source nat disable.
> 3. NAT rules for private gateway interface are configured correctly on VR.
> 
> 
> Thanks,
> 
> Jayapal Reddy
> 
>



Re: Review Request: CLOUDSTACK-2180: restoreVirtualMachine returns no password if the template is password enabled

2013-04-30 Thread Abhinandan Prateek

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10772/#review19996
---

Ship it!


Ship It!

- Abhinandan Prateek


On April 25, 2013, 9:05 a.m., Harikrishna Patnala wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/10772/
> ---
> 
> (Updated April 25, 2013, 9:05 a.m.)
> 
> 
> Review request for cloudstack, Abhinandan Prateek, Koushik Das, and Wei Zhou.
> 
> 
> Description
> ---
> 
> CLOUDSTACK-2180: restoreVirtualMachine returns no password
>  if the template is password enabled
> 
> New password is generated as part of restore vm(passwd enabled template) and 
> send new password on VR
> 
> 
> This addresses bug CLOUDSTACK-2180.
> 
> 
> Diffs
> -
> 
>   api/src/com/cloud/vm/UserVmService.java 7e89cd3 
>   server/src/com/cloud/vm/UserVmManagerImpl.java ebc5757 
>   server/test/com/cloud/vm/MockUserVmManagerImpl.java d886fd8 
>   server/test/com/cloud/vm/UserVmManagerTest.java e5e2ff2 
> 
> Diff: https://reviews.apache.org/r/10772/diff/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Harikrishna Patnala
> 
>