Re: CloudStack UI login hang

2013-05-01 Thread Nguyen Anh Tu
Finally I saw the issue. I deployed RabbitMQ server and had stuck from it.
Events was blocked when pushed to RabbitMQ. So I need to change
some threshold params to discard the blocking.

Thanks :-)


2013/5/2 Pranav Saxena 

> Could you upload a screenshot of the same somewhere and share it ? Also ,
> if possible could you check the Firebug logs for UI specific errors if any ?
>
> Thanks,
> Pranav
>
> -Original Message-
> From: Nguyen Anh Tu [mailto:ng.t...@gmail.com]
> Sent: Thursday, May 02, 2013 8:06 AM
> To: dev@cloudstack.apache.org
> Subject: CloudStack UI login hang
>
> Hi guy,
>
> I got a strange problem when login UI (account: admin/password). The UI
> hang. It can't login. But the log show that login is successful. Here is:
>
> 2013-05-02 09:31:55,954 INFO  [utils.component.ComponentContext]
> (Timer-2:null) Starting
> com.cloud.network.element.ElasticLoadBalancerElement
> 2013-05-02 09:31:55,954 INFO  [utils.component.ComponentContext]
> (Timer-2:null) Starting com.cloud.network.element.BigSwitchVnsElement
> 2013-05-02 09:31:55,954 INFO  [utils.component.ComponentContext]
> (Timer-2:null) Starting com.cloud.network.guru.NiciraNvpGuestNetworkGuru
> 2013-05-02 09:31:55,954 INFO  [utils.component.ComponentContext]
> (Timer-2:null) Starting com.cloud.server.ManagementServerImpl
> 2013-05-02 09:31:55,954 INFO  [cloud.server.ManagementServerImpl]
> (Timer-2:null) Startup CloudStack management server...
> 2013-05-02 09:31:56,238 DEBUG [cloud.cluster.ClusterManagerImpl]
> (Cluster-Notification-1:null) Notify management server node join to
> listeners.
> 2013-05-02 09:31:56,239 DEBUG [cloud.cluster.ClusterManagerImpl]
> (Cluster-Notification-1:null) Joining node, IP: 127.0.0.1, msid:
> 158515241344302
> 2013-05-02 09:31:56,240 DEBUG [cloud.alert.ClusterAlertAdapter]
> (Cluster-Notification-1:null) Receive cluster alert, EventArgs:
> com.cloud.cluster.ClusterNodeJoinEventArgs
> 2013-05-02 09:31:56,240 DEBUG [cloud.alert.ClusterAlertAdapter]
> (Cluster-Notification-1:null) Handle cluster node join alert, joined node:
> 127.0.0.1, msidL: 158515241344302
> 2013-05-02 09:31:56,240 DEBUG [cloud.alert.ClusterAlertAdapter]
> (Cluster-Notification-1:null) Management server node 127.0.0.1 is up, send
> alert
> 2013-05-02 09:32:01,929 INFO
> [factory.annotation.AutowiredAnnotationBeanPostProcessor]
> (1202242095@qtp-1264647577-2:null) JSR-330 'javax.inject.Inject'
> annotation found and supported for autowiri$
> 2013-05-02 09:32:01,934 DEBUG [cloud.api.ApiServlet]
> (1202242095@qtp-1264647577-2:null) ===START===  127.0.0.1 -- GET
> _=1367461921927
> 2013-05-02 09:32:01,941 DEBUG [cloud.api.ApiServlet]
> (1202242095@qtp-1264647577-2:null) ===END===  127.0.0.1 -- GET
> _=1367461921927
> 2013-05-02 09:32:01,954 DEBUG [cloud.api.ApiServlet]
> (1202242095@qtp-1264647577-2:null) ===START===  127.0.0.1 -- GET
> command=listCapabilities&response=json&sessionkey=xdgYF5AzX9gHPSiOP4VSYcvf16s$
> 2013-05-02 09:32:01,956 DEBUG [cloud.api.ApiServer]
> (1202242095@qtp-1264647577-2:null) Expired session, missing signature, or
> missing apiKey -- ignoring request. Signature: null, apiKey: null
> 2013-05-02 09:32:01,958 DEBUG [cloud.api.ApiServlet]
> (1202242095@qtp-1264647577-2:null) ===END===  127.0.0.1 -- GET
> command=listCapabilities&response=json&sessionkey=xdgYF5AzX9gHPSiOP4VSYcvf16s%3$
> 2013-05-02 09:32:06,448 INFO  [cloud.server.StatsCollector]
> (StatsCollector-1:null) HostStatsCollector is running...
> 2013-05-02 09:32:06,448 INFO  [cloud.server.StatsCollector]
> (StatsCollector-2:null) VmStatsCollector is running...
> 2013-05-02 09:32:06,449 INFO  [cloud.server.StatsCollector]
> (StatsCollector-3:null) StorageCollector is running...
> 2013-05-02 09:32:06,450 INFO  [cloud.server.StatsCollector]
> (StatsCollector-4:null) MonitorCollector is running...
> 2013-05-02 09:32:06,451 INFO  [cloud.server.StatsCollector]
> (StatsCollector-5:null) Auto Scale Out/In monitor is running...
> 2013-05-02 09:32:10,454 DEBUG [cloud.api.ApiServlet]
> (1473245675@qtp-1264647577-7:null) ===START===  127.0.0.1 -- GET
> _=1367461930451
> 2013-05-02 09:32:10,457 DEBUG [cloud.api.ApiServlet]
> (1473245675@qtp-1264647577-7:null) ===END===  127.0.0.1 -- GET
> _=1367461930451
> 2013-05-02 09:32:10,470 DEBUG [cloud.api.ApiServlet]
> (1473245675@qtp-1264647577-7:null) ===START===  127.0.0.1 -- GET
> command=listCapabilities&response=json&sessionkey=xdgYF5AzX9gHPSiOP4VSYcvf16s$
> 2013-05-02 09:32:10,471 DEBUG [cloud.api.ApiServer]
> (1473245675@qtp-1264647577-7:null) Expired session, missing signature, or
> missing apiKey -- ignoring request. Signature: null, apiKey: null
> 2013-05-02 09:32:10,472 DEBUG [cloud.api.ApiServlet]
> (1473245675@qtp-1264647577-7:null) ===END===  127.0.0.1 -- GET
> command=listCapabilities&response=json&sessionkey=xdgYF5AzX9gHPSiOP4VSYcvf16s%3$
> 2013-05-02 09:32:15,744 DEBUG [cloud.api.ApiServlet]
> (1178768260@qtp-1264647577-3:null) ===START===  127.0.0.1 -- POST  null
> 2013-05-02 09:32:15,799 DEBUG [cloud.user.Acc

[DOC][Review Request] EIP Documentation Enhancements

2013-05-01 Thread Radhika Puthiyetath
Hi,

I have updated the EIP documentation with appropriate illustration and 
description for clarity.

Please review the changes and provide your comments at 
https://issues.apache.org/jira/browse/CLOUDSTACK-2301.

Thanks
-Radhika


Re: Review Request: Release old DHCP entries

2013-05-01 Thread Dennis Lawler


> On May 1, 2013, 10:05 p.m., Chiradeep Vittal wrote:
> > patches/systemvm/debian/config/root/edithosts.sh, line 104
> > 
> >
> > Please check for the existence of 'dhcp_release' binary. You will have 
> > folks upgrading from 4.1 and expecting their 'old' system vms to work until 
> > they finish upgrading to the new system vm.

That's right, my apologies.
I didn't think about that until after Marcus posted his proposed changes to the 
mailing list, so I incorporated them with a few minor changes.


- Dennis


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10884/#review20031
---


On May 2, 2013, 5:38 a.m., Dennis Lawler wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/10884/
> ---
> 
> (Updated May 2, 2013, 5:38 a.m.)
> 
> 
> Review request for cloudstack.
> 
> 
> Description
> ---
> 
> Release old DHCP entries when adding new entries. 
> 
> Add dnsmasq-utils to System VM template.
> 
> 
> This addresses bug CLOUDSTACK-2299.
> 
> 
> Diffs
> -
> 
>   patches/systemvm/debian/config/root/edithosts.sh 1f98fbf 
>   scripts/network/exdhcp/dnsmasq_edithosts.sh 05285d9 
>   tools/appliance/definitions/systemvmtemplate/postinstall.sh ae8f1ad 
>   tools/appliance/definitions/systemvmtemplate64/postinstall.sh ae8f1ad 
> 
> Diff: https://reviews.apache.org/r/10884/diff/
> 
> 
> Testing
> ---
> 
> Tested in staging VM destroyed and re-instantiated with same IP.
> Did not test adding dnsmasq-utils to system VM build (yet).
> 
> 
> Thanks,
> 
> Dennis Lawler
> 
>



Re: Review Request: Release old DHCP entries

2013-05-01 Thread Dennis Lawler


> On May 1, 2013, 8:36 p.m., Marcus Sorensen wrote:
> > patches/systemvm/debian/config/root/edithosts.sh, line 103
> > 
> >
> > shouldn't this be $ipv4?, and if it fails to find the mac in the leases 
> > file, will it kill the whole script?

That's right - bad typo.
If it fails to find the MAC in the leases file (the usual case), dhcp_release 
does not get enough args and fails.
It shouldn't kill the whole script, or at least it hasn't in testing.


- Dennis


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10884/#review20025
---


On May 2, 2013, 5:38 a.m., Dennis Lawler wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/10884/
> ---
> 
> (Updated May 2, 2013, 5:38 a.m.)
> 
> 
> Review request for cloudstack.
> 
> 
> Description
> ---
> 
> Release old DHCP entries when adding new entries. 
> 
> Add dnsmasq-utils to System VM template.
> 
> 
> This addresses bug CLOUDSTACK-2299.
> 
> 
> Diffs
> -
> 
>   patches/systemvm/debian/config/root/edithosts.sh 1f98fbf 
>   scripts/network/exdhcp/dnsmasq_edithosts.sh 05285d9 
>   tools/appliance/definitions/systemvmtemplate/postinstall.sh ae8f1ad 
>   tools/appliance/definitions/systemvmtemplate64/postinstall.sh ae8f1ad 
> 
> Diff: https://reviews.apache.org/r/10884/diff/
> 
> 
> Testing
> ---
> 
> Tested in staging VM destroyed and re-instantiated with same IP.
> Did not test adding dnsmasq-utils to system VM build (yet).
> 
> 
> Thanks,
> 
> Dennis Lawler
> 
>



Re: Review Request: CLOUDSTACK-1851 [AWS Style Health Checks] Health Check monitor not getting created on Netscaler device in Basic zone setup.

2013-05-01 Thread Murali Reddy

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10572/#review20057
---

Ship it!


commit 16865014a05ab04bb608a8122a7229b2b0ae3421
Author: Rajesh Battala 
Date:   Wed Apr 17 18:22:30 2013 +0530

- Murali Reddy


On April 17, 2013, 1:20 p.m., Rajesh Battala wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/10572/
> ---
> 
> (Updated April 17, 2013, 1:20 p.m.)
> 
> 
> Review request for cloudstack, Murali Reddy, Vijay Venkatachalam, and Ram 
> Ganesh.
> 
> 
> Description
> ---
> 
> Fixed the issue
> 1.While creating the LB rule, healthcheck policies were not sent, so they are 
> not getting created. Fixed the issue by including them in TO constructor.
> 2. Fetching the status of healthchecks created in basic zone.
> 
> 
> This addresses bug CLOUDSTACK-1851.
> 
> 
> Diffs
> -
> 
>   
> plugins/network-elements/netscaler/src/com/cloud/network/element/NetscalerElement.java
>  2bbdb04 
> 
> Diff: https://reviews.apache.org/r/10572/diff/
> 
> 
> Testing
> ---
> 
> Created basiczone setup with Netscaler.
> 
> 1. Verified creation/deletion of healthchecks on LB rules
> 2. Verified creation of healthchecks with different param values.
> 3. Verified the Healthcheck manager is updating the status of the services in 
> the lb vm map table.
> 4. Verified deletion of healthchecks, resetting the status of services to null
> 5. Deletion of healthcheck will do clean up of healthcheck entires in 
> cloudstack db and in Netscaler resource.
> 
> 
> Thanks,
> 
> Rajesh Battala
> 
>



Re: Review Request: CLOUDSTACK-1851 [AWS Style Health Checks] Health Check monitor not getting created on Netscaler device in Basic zone setup.

2013-05-01 Thread ASF Subversion and Git Services

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10572/#review20056
---


Commit 16865014a05ab04bb608a8122a7229b2b0ae3421 in branch refs/heads/master 
from Murali Reddy 
[ https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;h=1686501 ]

CLOUDSTACK-1851 Health Check monitor not getting created on Netscaler device in 
Basic zone setup.


- ASF Subversion and Git Services


On April 17, 2013, 1:20 p.m., Rajesh Battala wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/10572/
> ---
> 
> (Updated April 17, 2013, 1:20 p.m.)
> 
> 
> Review request for cloudstack, Murali Reddy, Vijay Venkatachalam, and Ram 
> Ganesh.
> 
> 
> Description
> ---
> 
> Fixed the issue
> 1.While creating the LB rule, healthcheck policies were not sent, so they are 
> not getting created. Fixed the issue by including them in TO constructor.
> 2. Fetching the status of healthchecks created in basic zone.
> 
> 
> This addresses bug CLOUDSTACK-1851.
> 
> 
> Diffs
> -
> 
>   
> plugins/network-elements/netscaler/src/com/cloud/network/element/NetscalerElement.java
>  2bbdb04 
> 
> Diff: https://reviews.apache.org/r/10572/diff/
> 
> 
> Testing
> ---
> 
> Created basiczone setup with Netscaler.
> 
> 1. Verified creation/deletion of healthchecks on LB rules
> 2. Verified creation of healthchecks with different param values.
> 3. Verified the Healthcheck manager is updating the status of the services in 
> the lb vm map table.
> 4. Verified deletion of healthchecks, resetting the status of services to null
> 5. Deletion of healthcheck will do clean up of healthcheck entires in 
> cloudstack db and in Netscaler resource.
> 
> 
> Thanks,
> 
> Rajesh Battala
> 
>



Re: Review Request: CLOUDSTACK-957: Localization -- Add UK keyboard support

2013-05-01 Thread Devdeep Singh

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10836/#review20055
---


I don't understand this code completely and I may not be the right person to 
review these changes. Can someone else from the community look at this changes?

- Devdeep Singh


On April 29, 2013, 9:09 a.m., Sanjay Tripathi wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/10836/
> ---
> 
> (Updated April 29, 2013, 9:09 a.m.)
> 
> 
> Review request for cloudstack, Devdeep Singh, Fang Wang, and Animesh 
> Chaturvedi.
> 
> 
> Description
> ---
> 
> CLOUDSTACK-957: Localization -- Add UK keyboard support.
> 
> - Added the support of UK keyboard by:
>  - Initialising the UK keyboard from the existing US keyboard mapping.
>  - Adding/Overriding the special keys support of UK keys which differ 
> from US keyboard.
> - Also moved the JP keys initialisation to ajaxkeys.js file.
> 
> 
> This addresses bug CLOUDSTACK-957.
> 
> 
> Diffs
> -
> 
>   services/console-proxy/server/css/ajaxviewer.css 5ea552b 
>   services/console-proxy/server/js/ajaxkeys.js 2ecf5b5 
>   services/console-proxy/server/js/ajaxviewer.js e95615d 
>   
> services/console-proxy/server/src/com/cloud/consoleproxy/ConsoleProxyClientBase.java
>  289bdab 
> 
> Diff: https://reviews.apache.org/r/10836/diff/
> 
> 
> Testing
> ---
> 
> Tests:
> 
> 1) Setup CS environment and deploy a VM (Windows7 preferred, as I have tested 
> on this).
> 2) Go to VM detailView and open VM console view.
> 3) Change input method for keyboard to UK language.
> 4) Go to top of console-window and click on "keyboard" option to select UK 
> language.
> 5) Start using UK keyboard (Make sure the input method of client keyboard is 
> UK (from where the user is pressing the keys)).
> 
> Tested on my local CloudStack setup by following above mentioned steps.
> 
> 
> Thanks,
> 
> Sanjay Tripathi
> 
>



Re: Review Request: CLOUDSTACK-2087: Destroying the instance is not decrementing the primary storage usage [Resource Count table - No of volumes is not got decremented]

2013-05-01 Thread Devdeep Singh

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10725/#review20053
---

Ship it!


Ship It!

- Devdeep Singh


On April 30, 2013, 10:15 a.m., Sanjay Tripathi wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/10725/
> ---
> 
> (Updated April 30, 2013, 10:15 a.m.)
> 
> 
> Review request for cloudstack, Devdeep Singh, Nitin Mehta, Sateesh 
> Chodapuneedi, and Min Chen.
> 
> 
> Description
> ---
> 
> CLOUDSTACK-2087: Destroying the instance is not decrementing the primary 
> storage usage [Resource Count table - No of volumes is not got decremented] 
> 
> 
> This addresses bug CLOUDSTACK-2087.
> 
> 
> Diffs
> -
> 
>   server/src/com/cloud/resourcelimit/ResourceLimitManagerImpl.java e8805ae 
>   server/src/com/cloud/vm/VirtualMachineManagerImpl.java b0d6378 
> 
> Diff: https://reviews.apache.org/r/10725/diff/
> 
> 
> Testing
> ---
> 
> Tests:
> 1. Deploy an instance from a user account.
> 2. Check the updated resource count (primary storage and volume).
> 3. Destroy the same instance.
> 4. Verify the decremented resource count from the account detailView.  
> 
> 
> Thanks,
> 
> Sanjay Tripathi
> 
>



Re: Review Request: Release old DHCP entries

2013-05-01 Thread Dennis Lawler

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10884/
---

(Updated May 2, 2013, 5:38 a.m.)


Review request for cloudstack.


Changes
---

Incorporated proposed changes from Marcus Sorensen, but used "command -v" to 
determine existence of dhcp_release.

Fixed $ipv4 usage in patch.

Fixed exdhcp dnsmasq update to reflect correct args.


Description
---

Release old DHCP entries when adding new entries. 

Add dnsmasq-utils to System VM template.


This addresses bug CLOUDSTACK-2299.


Diffs (updated)
-

  patches/systemvm/debian/config/root/edithosts.sh 1f98fbf 
  scripts/network/exdhcp/dnsmasq_edithosts.sh 05285d9 
  tools/appliance/definitions/systemvmtemplate/postinstall.sh ae8f1ad 
  tools/appliance/definitions/systemvmtemplate64/postinstall.sh ae8f1ad 

Diff: https://reviews.apache.org/r/10884/diff/


Testing
---

Tested in staging VM destroyed and re-instantiated with same IP.
Did not test adding dnsmasq-utils to system VM build (yet).


Thanks,

Dennis Lawler



RE: [MERGE] Dedicate guest vlan ranges to account

2013-05-01 Thread Likitha Shetty
Thanks for taking a look Hugo.
I will update the branch with the fixes.

Thanks,
Likitha

>-Original Message-
>From: Hugo Trippaers [mailto:htrippa...@schubergphilis.com]
>Sent: Wednesday, May 01, 2013 5:07 PM
>To: dev@cloudstack.apache.org
>Subject: RE: [MERGE] Dedicate guest vlan ranges to account
>
>Likitha,
>
>Couple of remarks on the merge request:
>
>I think the calls you added to the system should fail with an informative error
>message if the physical network does not have the isolation type VLAN, as your
>code is only usable in networks with VLAN style isolation.
>
>Can you double check your formatting and line endings of the new files? For
>example DedicateGuestVlanRangeCmd.java seems to have windows style line
>endings.
>
> I also noticed some files with changed permissions (from 644 to 755) (in one
>case without any changes in the file itself).  Can you fix that? Permissions 
>should
>be 644 for java code.
>
>Cheers,
>
>Hugo
>
>> -Original Message-
>> From: Likitha Shetty [mailto:likitha.she...@citrix.com]
>> Sent: Wednesday, May 01, 2013 12:39 PM
>> To: dev@cloudstack.apache.org
>> Subject: [MERGE] Dedicate guest vlan ranges to account
>>
>> Hi all,
>>
>> I would like to merge the feature Dedicate Guest VLAN range to master.
>>
>> Jira ticket - https://issues.apache.org/jira/browse/CLOUDSTACK-704
>> FS - https://cwiki.apache.org/confluence/display/CLOUDSTACK/FS-
>> +Dedicate+Guest+VLANs+per+tenant
>> Branch - dedicate-guest-vlan-ranges_2 (was developed in branch
>> dedicate-
>> guest-vlan-ranges) Unit tests -  Unit tests for the new API's can be
>> found at
>> server/test/com/cloud/network/DedicateGuestVlanRangesTest.java
>> Integration tests - Python tests can be found be found at
>> test/integration/smoke/test_guest_vlan_range.py
>> Rebased the branch with master - Commit id:
>> 807ad0a39ab272a4af2de3156b0b367570acccea
>> RAT - RAT build is successful and no new dependencies introduced
>>
>> Thanks,
>> Likitha


Re: Review Request: fix bug CLOUDSTACK-2160: add a huge size guest network will cause out of memory

2013-05-01 Thread ASF Subversion and Git Services

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10750/#review20049
---


Commit f1c794de1bb913002b5316992e331700a1f822b5 in branch refs/heads/master 
from Mice Xia 
[ https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;h=f1c794d ]

CLOUDSTACK-2160: fix bug add a huge size guest network will cause out of memory

Signed-off-by: Mice Xia 


- ASF Subversion and Git Services


On April 24, 2013, 4:20 a.m., Hongtu Zang wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/10750/
> ---
> 
> (Updated April 24, 2013, 4:20 a.m.)
> 
> 
> Review request for cloudstack, Likitha Shetty, Prasanna Santhanam, and mice 
> xia.
> 
> 
> Description
> ---
> 
> fix bug CLOUDSTACK-2160: add a huge size guest network will cause out of 
> memory
> 
> modify NetUtils.java getAllIpsFromCidr, it will returns no more than 255 
> unused ips.
> 
> 
> This addresses bug CLOUDSTACK-2160.
> 
> 
> Diffs
> -
> 
>   server/src/com/cloud/network/NetworkModelImpl.java c5930d9 
>   server/src/com/cloud/network/NetworkServiceImpl.java ac2ac45 
>   utils/src/com/cloud/utils/net/NetUtils.java 5988dd5 
> 
> Diff: https://reviews.apache.org/r/10750/diff/
> 
> 
> Testing
> ---
> 
> create a new network with netmask 255.0.0.0 and it won't cause out of memory
> 
> 
> Thanks,
> 
> Hongtu Zang
> 
>



Re: Review Request: fix bug CLOUDSTACK-2160: add a huge size guest network will cause out of memory

2013-05-01 Thread mice xia

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10750/#review20048
---

Ship it!


Ship It!

- mice xia


On April 24, 2013, 4:20 a.m., Hongtu Zang wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/10750/
> ---
> 
> (Updated April 24, 2013, 4:20 a.m.)
> 
> 
> Review request for cloudstack, Likitha Shetty, Prasanna Santhanam, and mice 
> xia.
> 
> 
> Description
> ---
> 
> fix bug CLOUDSTACK-2160: add a huge size guest network will cause out of 
> memory
> 
> modify NetUtils.java getAllIpsFromCidr, it will returns no more than 255 
> unused ips.
> 
> 
> This addresses bug CLOUDSTACK-2160.
> 
> 
> Diffs
> -
> 
>   server/src/com/cloud/network/NetworkModelImpl.java c5930d9 
>   server/src/com/cloud/network/NetworkServiceImpl.java ac2ac45 
>   utils/src/com/cloud/utils/net/NetUtils.java 5988dd5 
> 
> Diff: https://reviews.apache.org/r/10750/diff/
> 
> 
> Testing
> ---
> 
> create a new network with netmask 255.0.0.0 and it won't cause out of memory
> 
> 
> Thanks,
> 
> Hongtu Zang
> 
>



RE: CloudStack UI login hang

2013-05-01 Thread Pranav Saxena
Could you upload a screenshot of the same somewhere and share it ? Also , if 
possible could you check the Firebug logs for UI specific errors if any ?

Thanks,
Pranav

-Original Message-
From: Nguyen Anh Tu [mailto:ng.t...@gmail.com] 
Sent: Thursday, May 02, 2013 8:06 AM
To: dev@cloudstack.apache.org
Subject: CloudStack UI login hang

Hi guy,

I got a strange problem when login UI (account: admin/password). The UI hang. 
It can't login. But the log show that login is successful. Here is:

2013-05-02 09:31:55,954 INFO  [utils.component.ComponentContext]
(Timer-2:null) Starting com.cloud.network.element.ElasticLoadBalancerElement
2013-05-02 09:31:55,954 INFO  [utils.component.ComponentContext]
(Timer-2:null) Starting com.cloud.network.element.BigSwitchVnsElement
2013-05-02 09:31:55,954 INFO  [utils.component.ComponentContext]
(Timer-2:null) Starting com.cloud.network.guru.NiciraNvpGuestNetworkGuru
2013-05-02 09:31:55,954 INFO  [utils.component.ComponentContext]
(Timer-2:null) Starting com.cloud.server.ManagementServerImpl
2013-05-02 09:31:55,954 INFO  [cloud.server.ManagementServerImpl]
(Timer-2:null) Startup CloudStack management server...
2013-05-02 09:31:56,238 DEBUG [cloud.cluster.ClusterManagerImpl]
(Cluster-Notification-1:null) Notify management server node join to listeners.
2013-05-02 09:31:56,239 DEBUG [cloud.cluster.ClusterManagerImpl]
(Cluster-Notification-1:null) Joining node, IP: 127.0.0.1, msid:
158515241344302
2013-05-02 09:31:56,240 DEBUG [cloud.alert.ClusterAlertAdapter]
(Cluster-Notification-1:null) Receive cluster alert, EventArgs:
com.cloud.cluster.ClusterNodeJoinEventArgs
2013-05-02 09:31:56,240 DEBUG [cloud.alert.ClusterAlertAdapter]
(Cluster-Notification-1:null) Handle cluster node join alert, joined node:
127.0.0.1, msidL: 158515241344302
2013-05-02 09:31:56,240 DEBUG [cloud.alert.ClusterAlertAdapter]
(Cluster-Notification-1:null) Management server node 127.0.0.1 is up, send alert
2013-05-02 09:32:01,929 INFO
[factory.annotation.AutowiredAnnotationBeanPostProcessor]
(1202242095@qtp-1264647577-2:null) JSR-330 'javax.inject.Inject' annotation 
found and supported for autowiri$
2013-05-02 09:32:01,934 DEBUG [cloud.api.ApiServlet]
(1202242095@qtp-1264647577-2:null) ===START===  127.0.0.1 -- GET
_=1367461921927
2013-05-02 09:32:01,941 DEBUG [cloud.api.ApiServlet]
(1202242095@qtp-1264647577-2:null) ===END===  127.0.0.1 -- GET
_=1367461921927
2013-05-02 09:32:01,954 DEBUG [cloud.api.ApiServlet]
(1202242095@qtp-1264647577-2:null) ===START===  127.0.0.1 -- GET 
command=listCapabilities&response=json&sessionkey=xdgYF5AzX9gHPSiOP4VSYcvf16s$
2013-05-02 09:32:01,956 DEBUG [cloud.api.ApiServer]
(1202242095@qtp-1264647577-2:null) Expired session, missing signature, or 
missing apiKey -- ignoring request. Signature: null, apiKey: null
2013-05-02 09:32:01,958 DEBUG [cloud.api.ApiServlet]
(1202242095@qtp-1264647577-2:null) ===END===  127.0.0.1 -- GET 
command=listCapabilities&response=json&sessionkey=xdgYF5AzX9gHPSiOP4VSYcvf16s%3$
2013-05-02 09:32:06,448 INFO  [cloud.server.StatsCollector]
(StatsCollector-1:null) HostStatsCollector is running...
2013-05-02 09:32:06,448 INFO  [cloud.server.StatsCollector]
(StatsCollector-2:null) VmStatsCollector is running...
2013-05-02 09:32:06,449 INFO  [cloud.server.StatsCollector]
(StatsCollector-3:null) StorageCollector is running...
2013-05-02 09:32:06,450 INFO  [cloud.server.StatsCollector]
(StatsCollector-4:null) MonitorCollector is running...
2013-05-02 09:32:06,451 INFO  [cloud.server.StatsCollector]
(StatsCollector-5:null) Auto Scale Out/In monitor is running...
2013-05-02 09:32:10,454 DEBUG [cloud.api.ApiServlet]
(1473245675@qtp-1264647577-7:null) ===START===  127.0.0.1 -- GET
_=1367461930451
2013-05-02 09:32:10,457 DEBUG [cloud.api.ApiServlet]
(1473245675@qtp-1264647577-7:null) ===END===  127.0.0.1 -- GET
_=1367461930451
2013-05-02 09:32:10,470 DEBUG [cloud.api.ApiServlet]
(1473245675@qtp-1264647577-7:null) ===START===  127.0.0.1 -- GET 
command=listCapabilities&response=json&sessionkey=xdgYF5AzX9gHPSiOP4VSYcvf16s$
2013-05-02 09:32:10,471 DEBUG [cloud.api.ApiServer]
(1473245675@qtp-1264647577-7:null) Expired session, missing signature, or 
missing apiKey -- ignoring request. Signature: null, apiKey: null
2013-05-02 09:32:10,472 DEBUG [cloud.api.ApiServlet]
(1473245675@qtp-1264647577-7:null) ===END===  127.0.0.1 -- GET 
command=listCapabilities&response=json&sessionkey=xdgYF5AzX9gHPSiOP4VSYcvf16s%3$
2013-05-02 09:32:15,744 DEBUG [cloud.api.ApiServlet]
(1178768260@qtp-1264647577-3:null) ===START===  127.0.0.1 -- POST  null
2013-05-02 09:32:15,799 DEBUG [cloud.user.AccountManagerImpl]
(1178768260@qtp-1264647577-3:null) Attempting to log in user: admin in domain 1
2013-05-02 09:32:15,799 DEBUG [server.auth.MD5UserAuthenticator]
(1178768260@qtp-1264647577-3:null) Retrieving user: admin
2013-05-02 09:32:15,809 DEBUG [cloud.user.AccountManagerImpl] *
(1178768260@qtp-1264647577-3:null) User: admin in domain 1 has successfully 
logged in*

I don't know why.

Re: jclouds code

2013-05-01 Thread Mike Tutkowski
Yeah, that information is part of the Compute Offering.

So, when you kick off a VM in CloudStack, you have to specify the ID of the
Compute Offering you are using.


On Wed, May 1, 2013 at 5:42 PM, Seif Eddine Jemli  wrote:

> i couldn't see the parameters of the VM in the method, for example the CPU
> and the RAM for each VM to deploy.
> does it exist in the method parameters?
>
>
>
> 2013/5/2 Mike Tutkowski 
>
>> Hi,
>>
>> Yes, the code to deploy a VM should be related to a method called
>> getDeployVirtualMachineCommand.  This will build up the command you want to
>> send to the executeCloudStackCommand method.
>>
>> If you want it to run on XenServer, you will of course need to make sure
>> you have a XenServer host added into CloudStack.  In the cluster this host
>> resides, you'll need Primary Storage with a Storage Tag that you define.
>>
>> If you reference this Storage Tag from a Compute Offering that you
>> execute, the VM should be placed on the Primary Storage that's being used
>> by your XenServer host.
>>
>> I will CC the CloudStack e-mail list so other people can feel free to
>> chime in with suggestions.
>>
>> The reason I sent my code directly to you was because the CloudStack
>> e-mail list will filter attachments out.
>>
>> Having the entire group in on the conversation might be useful regarding
>> comments they might make.
>>
>> Talk to you later!
>>
>>
>> On Wed, May 1, 2013 at 5:15 PM, Seif Eddine Jemli <
>> seifeddineje...@gmail.com> wrote:
>>
>>> thanks Mike.
>>>
>>> I am a beginner. i am doing this for a school project (i am a computer
>>> science student, i graduate the next year)
>>> does this code contain part that enable me to deploy virtual machines on
>>> xenserver hosts?
>>>
>>>
>>>
>>>
>>> 2013/5/2 Mike Tutkowski 
>>>
 Here you go.

 So, just a couple of things to note:

 This little program demos how to issue CloudStack API commands, but it
 also demos how to interact with XenServer and ESX as well as my company's
 SAN (SolidFire).  Of course just ignore what is not of interest to you. :)
  You will most likely find the executeCloudStackCommand method to be of
 interest.

 The name of the program (CreateVolume) is completely legacy as this
 program does a lot more than create a volume on our SAN these days. :)

 You'll see a lot of code is commented out.  I tend to comment code out
 and in within this program depending on what I want test with it.

 Let me know if you have any questions.


 On Wed, May 1, 2013 at 4:14 PM, Seif Eddine Jemli <
 seifeddineje...@gmail.com> wrote:

> thanks a lot .
>
>
> 2013/5/1 Mike Tutkowski 
>
>> Hi,
>>
>> No problem.
>>
>> At the moment, I do not have access to the file from where I'm
>> located, but I should be able to send it to you within a few hours.
>>
>> Talk to you later,
>>
>>
>> On Wed, May 1, 2013 at 4:07 PM, Seif Eddine Jemli <
>> seifeddineje...@gmail.com> wrote:
>>
>>> Hi Mike,
>>>
>>> thanks for you reply on the mailing list.
>>>
>>> i do have interest in your code.
>>>
>>> can you please send it to me to use it as a tuto?
>>>
>>> thanks in advance
>>>
>>
>>
>>
>> --
>> *Mike Tutkowski*
>>  *Senior CloudStack Developer, SolidFire Inc.*
>> e: mike.tutkow...@solidfire.com
>> o: 303.746.7302
>> Advancing the way the world uses the 
>> cloud
>> *™*
>>
>
>


 --
 *Mike Tutkowski*
 *Senior CloudStack Developer, SolidFire Inc.*
 e: mike.tutkow...@solidfire.com
 o: 303.746.7302
 Advancing the way the world uses the 
 cloud
 *™*

>>>
>>>
>>
>>
>> --
>> *Mike Tutkowski*
>> *Senior CloudStack Developer, SolidFire Inc.*
>> e: mike.tutkow...@solidfire.com
>> o: 303.746.7302
>> Advancing the way the world uses the 
>> cloud
>> *™*
>>
>
>


-- 
*Mike Tutkowski*
*Senior CloudStack Developer, SolidFire Inc.*
e: mike.tutkow...@solidfire.com
o: 303.746.7302
Advancing the way the world uses the
cloud
*™*


CloudStack UI login hang

2013-05-01 Thread Nguyen Anh Tu
Hi guy,

I got a strange problem when login UI (account: admin/password). The UI
hang. It can't login. But the log show that login is successful. Here is:

2013-05-02 09:31:55,954 INFO  [utils.component.ComponentContext]
(Timer-2:null) Starting com.cloud.network.element.ElasticLoadBalancerElement
2013-05-02 09:31:55,954 INFO  [utils.component.ComponentContext]
(Timer-2:null) Starting com.cloud.network.element.BigSwitchVnsElement
2013-05-02 09:31:55,954 INFO  [utils.component.ComponentContext]
(Timer-2:null) Starting com.cloud.network.guru.NiciraNvpGuestNetworkGuru
2013-05-02 09:31:55,954 INFO  [utils.component.ComponentContext]
(Timer-2:null) Starting com.cloud.server.ManagementServerImpl
2013-05-02 09:31:55,954 INFO  [cloud.server.ManagementServerImpl]
(Timer-2:null) Startup CloudStack management server...
2013-05-02 09:31:56,238 DEBUG [cloud.cluster.ClusterManagerImpl]
(Cluster-Notification-1:null) Notify management server node join to
listeners.
2013-05-02 09:31:56,239 DEBUG [cloud.cluster.ClusterManagerImpl]
(Cluster-Notification-1:null) Joining node, IP: 127.0.0.1, msid:
158515241344302
2013-05-02 09:31:56,240 DEBUG [cloud.alert.ClusterAlertAdapter]
(Cluster-Notification-1:null) Receive cluster alert, EventArgs:
com.cloud.cluster.ClusterNodeJoinEventArgs
2013-05-02 09:31:56,240 DEBUG [cloud.alert.ClusterAlertAdapter]
(Cluster-Notification-1:null) Handle cluster node join alert, joined node:
127.0.0.1, msidL: 158515241344302
2013-05-02 09:31:56,240 DEBUG [cloud.alert.ClusterAlertAdapter]
(Cluster-Notification-1:null) Management server node 127.0.0.1 is up, send
alert
2013-05-02 09:32:01,929 INFO
[factory.annotation.AutowiredAnnotationBeanPostProcessor]
(1202242095@qtp-1264647577-2:null) JSR-330 'javax.inject.Inject' annotation
found and supported for autowiri$
2013-05-02 09:32:01,934 DEBUG [cloud.api.ApiServlet]
(1202242095@qtp-1264647577-2:null) ===START===  127.0.0.1 -- GET
_=1367461921927
2013-05-02 09:32:01,941 DEBUG [cloud.api.ApiServlet]
(1202242095@qtp-1264647577-2:null) ===END===  127.0.0.1 -- GET
_=1367461921927
2013-05-02 09:32:01,954 DEBUG [cloud.api.ApiServlet]
(1202242095@qtp-1264647577-2:null) ===START===  127.0.0.1 -- GET
command=listCapabilities&response=json&sessionkey=xdgYF5AzX9gHPSiOP4VSYcvf16s$
2013-05-02 09:32:01,956 DEBUG [cloud.api.ApiServer]
(1202242095@qtp-1264647577-2:null) Expired session, missing signature, or
missing apiKey -- ignoring request. Signature: null, apiKey: null
2013-05-02 09:32:01,958 DEBUG [cloud.api.ApiServlet]
(1202242095@qtp-1264647577-2:null) ===END===  127.0.0.1 -- GET
command=listCapabilities&response=json&sessionkey=xdgYF5AzX9gHPSiOP4VSYcvf16s%3$
2013-05-02 09:32:06,448 INFO  [cloud.server.StatsCollector]
(StatsCollector-1:null) HostStatsCollector is running...
2013-05-02 09:32:06,448 INFO  [cloud.server.StatsCollector]
(StatsCollector-2:null) VmStatsCollector is running...
2013-05-02 09:32:06,449 INFO  [cloud.server.StatsCollector]
(StatsCollector-3:null) StorageCollector is running...
2013-05-02 09:32:06,450 INFO  [cloud.server.StatsCollector]
(StatsCollector-4:null) MonitorCollector is running...
2013-05-02 09:32:06,451 INFO  [cloud.server.StatsCollector]
(StatsCollector-5:null) Auto Scale Out/In monitor is running...
2013-05-02 09:32:10,454 DEBUG [cloud.api.ApiServlet]
(1473245675@qtp-1264647577-7:null) ===START===  127.0.0.1 -- GET
_=1367461930451
2013-05-02 09:32:10,457 DEBUG [cloud.api.ApiServlet]
(1473245675@qtp-1264647577-7:null) ===END===  127.0.0.1 -- GET
_=1367461930451
2013-05-02 09:32:10,470 DEBUG [cloud.api.ApiServlet]
(1473245675@qtp-1264647577-7:null) ===START===  127.0.0.1 -- GET
command=listCapabilities&response=json&sessionkey=xdgYF5AzX9gHPSiOP4VSYcvf16s$
2013-05-02 09:32:10,471 DEBUG [cloud.api.ApiServer]
(1473245675@qtp-1264647577-7:null) Expired session, missing signature, or
missing apiKey -- ignoring request. Signature: null, apiKey: null
2013-05-02 09:32:10,472 DEBUG [cloud.api.ApiServlet]
(1473245675@qtp-1264647577-7:null) ===END===  127.0.0.1 -- GET
command=listCapabilities&response=json&sessionkey=xdgYF5AzX9gHPSiOP4VSYcvf16s%3$
2013-05-02 09:32:15,744 DEBUG [cloud.api.ApiServlet]
(1178768260@qtp-1264647577-3:null) ===START===  127.0.0.1 -- POST  null
2013-05-02 09:32:15,799 DEBUG [cloud.user.AccountManagerImpl]
(1178768260@qtp-1264647577-3:null) Attempting to log in user: admin in
domain 1
2013-05-02 09:32:15,799 DEBUG [server.auth.MD5UserAuthenticator]
(1178768260@qtp-1264647577-3:null) Retrieving user: admin
2013-05-02 09:32:15,809 DEBUG [cloud.user.AccountManagerImpl] *
(1178768260@qtp-1264647577-3:null) User: admin in domain 1 has successfully
logged in*

I don't know why. Any help?
-- 

N.g.U.y.e.N.A.n.H.t.U


OVS on KVM

2013-05-01 Thread Sheng Yang
Hi Hugo,

I am trying to use OVS on KVM now, but I found all public ports are not
tagged with public vlan as it supposed to be, so any public traffic cannot
goes out. I've verified that I am using OvsVifDriver.

Here is the output of ovs-vsctl show:


root@yasker-box1:~/kvm-agent# ovs-vsctl show
02281b72-131c-4b24-b191-fb1bb7fe186d
Bridge "cloud0"
Port "cloud0"
Interface "cloud0"
type: internal
Port "vnet3"
Interface "vnet3"
Port "vnet0"
Interface "vnet0"
Bridge "cloudbr0"
Port "vnet2"
Interface "vnet2"
Port "vnet6"
Interface "vnet6"
Port "vnet4"
Interface "vnet4"
Port "vnet9"
Interface "vnet9"
Port "vnet10"
Interface "vnet10"
Port "vnet1"
Interface "vnet1"
Port "cloudbr0"
Interface "cloudbr0"
type: internal
Port "eth0"
Interface "eth0"
Port "vnet5"
Interface "vnet5"
ovs_version: "1.4.3"


I've checked the Installation guide, it use different bridge for different
vlan. But would that be the only way to work? Because we can have different
public vlans. Maybe I got some setup wrong...

Any comments?

Thanks!

--Sheng


Re: Review Request: Volume snapshots enhancements for Vmware

2013-05-01 Thread Kelven Yang

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10892/#review20041
---

Ship it!


Ship It!

- Kelven Yang


On May 1, 2013, 10:45 p.m., Fang Wang wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/10892/
> ---
> 
> (Updated May 1, 2013, 10:45 p.m.)
> 
> 
> Review request for cloudstack and Kelven Yang.
> 
> 
> Description
> ---
> 
> Volume snapshot enhancements for vmware, combine the previous 3 patches. 
> 
> 
> This addresses bug CLOUDSTACK-671.
> https://issues.apache.org/jira/browse/CLOUDSTACK-671
> 
> 
> Diffs
> -
> 
> 
> Diff: https://reviews.apache.org/r/10892/diff/
> 
> 
> Testing
> ---
> 
> yes. tested the snapshots, volumes, and templates.
> 
> 
> Thanks,
> 
> Fang Wang
> 
>



Re: Review Request: Selenium Headless configuration using PhantomJS

2013-05-01 Thread edison su

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10846/#review20037
---

Ship it!


Ship It!

- edison su


On May 2, 2013, 12:08 a.m., Parth Jagirdar wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/10846/
> ---
> 
> (Updated May 2, 2013, 12:08 a.m.)
> 
> 
> Review request for cloudstack, David Nalley, Chip Childers, and edison su.
> 
> 
> Description
> ---
> 
> Selenium Headless configuration using PhantomJS.
> 
> Fixed Readme Typos, and added an extra field for PhantomJS and How to 
> configure Management Server IP.
> 
> 
> This addresses bug Cloudstack-2282.
> 
> 
> Diffs
> -
> 
>   test/selenium/ReadMe.txt 30b0e0d 
>   test/selenium/lib/initialize.py e8cc49a 
>   test/selenium/smoke/Login_and_Accounts.py c5132d9 
>   test/selenium/smoke/main.py 86bb930 
> 
> Diff: https://reviews.apache.org/r/10846/diff/
> 
> 
> Testing
> ---
> 
> NA.
> 
> 
> Thanks,
> 
> Parth Jagirdar
> 
>



Re: Review Request: Selenium Headless configuration using PhantomJS

2013-05-01 Thread Parth Jagirdar

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10846/
---

(Updated May 2, 2013, 12:08 a.m.)


Review request for cloudstack, David Nalley, Chip Childers, and edison su.


Changes
---

Adding command line Param for MS IP.


Description
---

Selenium Headless configuration using PhantomJS.

Fixed Readme Typos, and added an extra field for PhantomJS and How to configure 
Management Server IP.


This addresses bug Cloudstack-2282.


Diffs (updated)
-

  test/selenium/ReadMe.txt 30b0e0d 
  test/selenium/lib/initialize.py e8cc49a 
  test/selenium/smoke/Login_and_Accounts.py c5132d9 
  test/selenium/smoke/main.py 86bb930 

Diff: https://reviews.apache.org/r/10846/diff/


Testing
---

NA.


Thanks,

Parth Jagirdar



RE: [DISCUSS] Linux native VXLAN support on KVM hypervisor

2013-05-01 Thread Toshiaki Hatano
Sorry, I forgot to add users list in To.

Thanks,
--
Toshiaki

> -Original Message-
> From: Toshiaki Hatano [mailto:toshiaki.hat...@verio.net]
> Sent: Wednesday, May 01, 2013 2:58 PM
> To: dev@cloudstack.apache.org
> Subject: [DISCUSS] Linux native VXLAN support on KVM hypervisor
> 
> Hi all,
> 
> I’d like to add Linux native VXLAN support on KVM hypervisor.
> 
> Currently, advanced zone with VLAN isolation can hold only 4k networks (=
> accounts) in a zone due to the VLAN ID limitation.
> 4k accounts per zone is not enough for IaaS provider like us.
> Furthermore, VPC will allow single account to consume multiple networks.
> 
> Linux kernel 3.7 or later supports VXLAN as part of its ordinal networking
> function.
> VXLAN enable Layer 2 tunneling over UDP/IP with VLAN-like encapsulation
> and allow 16M isolated networks in the domain.
> So, by using linux native VXLAN support, we can extend network limits without
> introducing unnecessary complexity.
> (But in other words, it’s not as flexible as Open vSwitch. Only thing Linux
> native VXLAN provides is multipoint L2 tunneling.)
> 
> Any thoughts about this?
> 
> 
> P.S.
> 
> I’m currently working on this as my internship project.
> As proof of concept, I’ve modified “modifyvlan.sh” script which is actual
> VLAN create/delete manipulation script called from cloud-agent, to create
> and to use VXLAN interface instead of VLAN interface.
> Modified script is tested with CloudStack 4.0.1 and 3 KVM hypervisors based
> on CentOS 6.4 + 3.8.6 kernel.
> And it looks working. (But I’m still testing)
> 
> 
> P.S.2.
> 
> FYI: OpenStack already started process [1] to support Linux native VXLAN.
> [1] https://review.openstack.org/#/c/26516/
> 
> 
> Best Regards,
> --
> Toshiaki Hatano
> Verio, an NTT Communications company
> E-mail:   toshiaki.hat...@verio.net
> AIM: toshiaki.hat...@verio.net
> Phone:  (801)437-7482  Office
> (801)960-6410  Cellular
> 
> 
> This email message is intended for the use of the person to whom it has
> been sent, and may contain information that is confidential or legally
> protected. If you are not the intended recipient or have received this
> message in error, you are not authorized to copy, distribute, or otherwise
> use this message or its attachments. Please notify the sender immediately
> by return e-mail and permanently delete this message and any attachments.
> Verio Inc. makes no warranty that this email is error or virus free.  Thank
> you.


This email message is intended for the use of the person to whom it has been 
sent, and may contain information that is confidential or legally protected. If 
you are not the intended recipient or have received this message in error, you 
are not authorized to copy, distribute, or otherwise use this message or its 
attachments. Please notify the sender immediately by return e-mail and 
permanently delete this message and any attachments. Verio Inc. makes no 
warranty that this email is error or virus free.  Thank you.


Re: jclouds code

2013-05-01 Thread Mike Tutkowski
Hi,

Yes, the code to deploy a VM should be related to a method called
getDeployVirtualMachineCommand.  This will build up the command you want to
send to the executeCloudStackCommand method.

If you want it to run on XenServer, you will of course need to make sure
you have a XenServer host added into CloudStack.  In the cluster this host
resides, you'll need Primary Storage with a Storage Tag that you define.

If you reference this Storage Tag from a Compute Offering that you execute,
the VM should be placed on the Primary Storage that's being used by your
XenServer host.

I will CC the CloudStack e-mail list so other people can feel free to chime
in with suggestions.

The reason I sent my code directly to you was because the CloudStack e-mail
list will filter attachments out.

Having the entire group in on the conversation might be useful regarding
comments they might make.

Talk to you later!


On Wed, May 1, 2013 at 5:15 PM, Seif Eddine Jemli  wrote:

> thanks Mike.
>
> I am a beginner. i am doing this for a school project (i am a computer
> science student, i graduate the next year)
> does this code contain part that enable me to deploy virtual machines on
> xenserver hosts?
>
>
>
>
> 2013/5/2 Mike Tutkowski 
>
>> Here you go.
>>
>> So, just a couple of things to note:
>>
>> This little program demos how to issue CloudStack API commands, but it
>> also demos how to interact with XenServer and ESX as well as my company's
>> SAN (SolidFire).  Of course just ignore what is not of interest to you. :)
>>  You will most likely find the executeCloudStackCommand method to be of
>> interest.
>>
>> The name of the program (CreateVolume) is completely legacy as this
>> program does a lot more than create a volume on our SAN these days. :)
>>
>> You'll see a lot of code is commented out.  I tend to comment code out
>> and in within this program depending on what I want test with it.
>>
>> Let me know if you have any questions.
>>
>>
>> On Wed, May 1, 2013 at 4:14 PM, Seif Eddine Jemli <
>> seifeddineje...@gmail.com> wrote:
>>
>>> thanks a lot .
>>>
>>>
>>> 2013/5/1 Mike Tutkowski 
>>>
 Hi,

 No problem.

 At the moment, I do not have access to the file from where I'm located,
 but I should be able to send it to you within a few hours.

 Talk to you later,


 On Wed, May 1, 2013 at 4:07 PM, Seif Eddine Jemli <
 seifeddineje...@gmail.com> wrote:

> Hi Mike,
>
> thanks for you reply on the mailing list.
>
> i do have interest in your code.
>
> can you please send it to me to use it as a tuto?
>
> thanks in advance
>



 --
 *Mike Tutkowski*
  *Senior CloudStack Developer, SolidFire Inc.*
 e: mike.tutkow...@solidfire.com
 o: 303.746.7302
 Advancing the way the world uses the 
 cloud
 *™*

>>>
>>>
>>
>>
>> --
>> *Mike Tutkowski*
>> *Senior CloudStack Developer, SolidFire Inc.*
>> e: mike.tutkow...@solidfire.com
>> o: 303.746.7302
>> Advancing the way the world uses the 
>> cloud
>> *™*
>>
>
>


-- 
*Mike Tutkowski*
*Senior CloudStack Developer, SolidFire Inc.*
e: mike.tutkow...@solidfire.com
o: 303.746.7302
Advancing the way the world uses the
cloud
*™*


RE: Changes about to merged to master....

2013-05-01 Thread Alex Huang


> -Original Message-
> From: David Nalley [mailto:da...@gnsa.us]
> Sent: Wednesday, May 1, 2013 4:10 PM
> To: dev@cloudstack.apache.org
> Subject: Re: Changes about to merged to master
> 
> > The changes doesn't really have high impact on functionality of cloudstack
> as I didn't make any code changes but it does involve a lot of files.  I want 
> to
> make sure it's okay with everyone before I push it to master.  I will of 
> course
> test to make sure it works before the push.
> >
> 
> Via a BVT run? :)

Of course.

--Alex
> 
> --David


Re: Changes about to merged to master....

2013-05-01 Thread David Nalley
> The changes doesn't really have high impact on functionality of cloudstack as 
> I didn't make any code changes but it does involve a lot of files.  I want to 
> make sure it's okay with everyone before I push it to master.  I will of 
> course test to make sure it works before the push.
>

Via a BVT run? :)

--David


Changes about to merged to master....

2013-05-01 Thread Alex Huang
I've spent some time redistributing the java files in cloudstack to make it 
easier to understand and also more modular.

- cloud-engine-schema now contains all of the cloudstack vo and dao so if 
someone wants to access the cloudstack schema directly, they won't access the 
business logic as well.
- cloud-core now contains all of the agent commands but most have been moved 
out of it.
- cloud-api now contains only the interfaces and the query apis.

The changes doesn't really have high impact on functionality of cloudstack as I 
didn't make any code changes but it does involve a lot of files.  I want to 
make sure it's okay with everyone before I push it to master.  I will of course 
test to make sure it works before the push.

--Alex



Re: version of cloudmonkey

2013-05-01 Thread Justin Grudzien
It is currently in master but I will see if I can get Rohit, who I think owns 
the process, to create a new version for pip. If that isn't immediately 
possible I can revert the documentation until it is done. I figured 
documentation is always last :)

Justin 

On May 1, 2013, at 4:06 PM, Marcus Sorensen  wrote:

> The wiki was the one that had the 'display' parameter shown. I'm assuming
> the display parameter is only in master then?
> 
> 
> On Wed, May 1, 2013 at 2:56 PM, Justin Grudzien  wrote:
> 
>> Which documentation are you referring to? I updated cloudmonkey to add the
>> set display and I updated the wiki to include the changes. I also noticed
>> the async issue but haven't gotten around to fixing it yet.
>> 
>> 
>> On Wed, May 1, 2013 at 8:47 AM, Marcus Sorensen 
>> wrote:
>> 
>>> I noticed that the documentation doesn't quite match up with cloudmonkey
>> as
>>> installed via tools/cli, nor does it match the tarball. It seems to be
>>> missing 'set display', among other things, and the asyncblock never
>>> returns, in either version, long after the job is finished.
>> 


Review Request: Volume snapshots enhancements for Vmware

2013-05-01 Thread Fang Wang

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10892/
---

Review request for cloudstack and Kelven Yang.


Description
---

Volume snapshot enhancements for vmware, combine the previous 3 patches. 


This addresses bug CLOUDSTACK-671.
https://issues.apache.org/jira/browse/CLOUDSTACK-671


Diffs
-


Diff: https://reviews.apache.org/r/10892/diff/


Testing
---

yes. tested the snapshots, volumes, and templates.


Thanks,

Fang Wang



Re: Review Request: Release old DHCP entries

2013-05-01 Thread Chiradeep Vittal

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10884/#review20031
---



patches/systemvm/debian/config/root/edithosts.sh


Please check for the existence of 'dhcp_release' binary. You will have 
folks upgrading from 4.1 and expecting their 'old' system vms to work until 
they finish upgrading to the new system vm.


- Chiradeep Vittal


On May 1, 2013, 6:41 p.m., Dennis Lawler wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/10884/
> ---
> 
> (Updated May 1, 2013, 6:41 p.m.)
> 
> 
> Review request for cloudstack.
> 
> 
> Description
> ---
> 
> Release old DHCP entries when adding new entries. 
> 
> Add dnsmasq-utils to System VM template.
> 
> 
> This addresses bug CLOUDSTACK-2299.
> 
> 
> Diffs
> -
> 
>   patches/systemvm/debian/config/root/edithosts.sh 1f98fbf 
>   scripts/network/exdhcp/dnsmasq_edithosts.sh 05285d9 
>   tools/appliance/definitions/systemvmtemplate/postinstall.sh ae8f1ad 
>   tools/appliance/definitions/systemvmtemplate64/postinstall.sh ae8f1ad 
> 
> Diff: https://reviews.apache.org/r/10884/diff/
> 
> 
> Testing
> ---
> 
> Tested in staging VM destroyed and re-instantiated with same IP.
> Did not test adding dnsmasq-utils to system VM build (yet).
> 
> 
> Thanks,
> 
> Dennis Lawler
> 
>



Re: Jclouds

2013-05-01 Thread Mike Tutkowski
I have been using the CloudStack API from a test Java client I wrote.

If the code for this is of interest to you, just let me know.


On Wed, May 1, 2013 at 11:46 AM, David Nalley  wrote:

> On Wed, May 1, 2013 at 1:14 PM, Seif Eddine Jemli
>  wrote:
> > Hi,
> >
> >
> >
> > i am trying to implement a java code that should enable me to do simple
> > things: deploy Virtual machines for example.
> >
> >
> > I was advised to use Jclouds API, the problem is that i didn't find
> > "enough"  documentation on how to use Jclouds on a cloudstack private
> cloud
> > .
> >
> > Where can i find a jclouds code on cloudstack that i can use as a start
> > (like a tuto)?
> >
> > thanks
>
>
> This isn't the first time this has come up.
>
> Let me paste an IRC conversation that should help you make progress.
>
> 13:27 < adrianc> ke4qqq I think using the raw cloudstack api isn't
> something there's a very nice guide on
> 13:28 < adrianc> however, they can get started quite easily using
> jclouds-examples/compute-basics
> 13:28 < adrianc> and pass in the url to the cloudstack instance
> 13:28 < adrianc> abayer also has cloudcat
> 13:28 < adrianc> which is a cloudstack app
> 13:28 < adrianc> yp
> 13:28 < adrianc> ke4qqq the other thing is that there's tons of
> examples, if one is ok looking at live tests
> 13:29 < adrianc> ex. apis/cloudstack/src/test/java/...*LiveTest.java
> 13:29 < adrianc> contextBuilder.overrides
> 13:30 < adrianc> ke4qqq anyway we can do a lot better on asf in
> cloudstack doc stuff
>
> The cloudcat referenced is: https://github.com/abayer/cloudcat  <--
> which uses jclouds for CloudStack, so should give you an example.
>
> --David
>



-- 
*Mike Tutkowski*
*Senior CloudStack Developer, SolidFire Inc.*
e: mike.tutkow...@solidfire.com
o: 303.746.7302
Advancing the way the world uses the
cloud
*™*


Upgrade Path

2013-05-01 Thread maurice

Hello,

Would be suggested that I go ahead and upgrade? 4.0.1 | KVM | CentOS 
6.3?


If so, is there any known issues upgrading; or should I just stay put 
for now.


As I have read this is not a major upgrade.

- Maurice


Review Request: Volume snapshots enhancement for Vmware

2013-05-01 Thread Fang Wang

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10890/
---

Review request for cloudstack and Kelven Yang.


Description
---

Modify the template adapter and put the vmware specific OVA packaging handling 
inside the prepareExtractTemplate;
remove the PrepareOVAPacking in the base template adapter;
incorporate the review feedback from last review. 


This addresses bug CLOUDSTACK-671.


Diffs
-

  server/src/com/cloud/template/HypervisorTemplateAdapter.java 491900b 
  server/src/com/cloud/template/TemplateAdapter.java 1f8f491 
  server/src/com/cloud/template/TemplateAdapterBase.java 1b11425 
  server/src/com/cloud/template/TemplateManagerImpl.java c7eaa64 

Diff: https://reviews.apache.org/r/10890/diff/


Testing
---

Retested the template create/extract, vol and snapshot commands, as in previous 
patches. 


Thanks,

Fang Wang



Re: New Committer: Clayton Weise

2013-05-01 Thread Jason Davis
Finally!


On Wed, May 1, 2013 at 4:08 PM, John Burwell  wrote:

> Congrats, Clayton.
>
>
>
>
> On May 1, 2013, at 5:07 PM, Joe Brockmeier  wrote:
>
> > On Tue, Apr 30, 2013, at 11:53 AM, Chip Childers wrote:
> >> Please join me in congratulating Clayton!
> >
> > Congratulations, Clayton!
> >
> > Best,
> >
> > jzb
> > --
> > Joe Brockmeier
> > j...@zonker.net
> > Twitter: @jzb
> > http://www.dissociatedpress.net/
>


Re: New Committer: Clayton Weise

2013-05-01 Thread John Burwell
Congrats, Clayton.




On May 1, 2013, at 5:07 PM, Joe Brockmeier  wrote:

> On Tue, Apr 30, 2013, at 11:53 AM, Chip Childers wrote:
>> Please join me in congratulating Clayton!
>
> Congratulations, Clayton!
>
> Best,
>
> jzb
> --
> Joe Brockmeier
> j...@zonker.net
> Twitter: @jzb
> http://www.dissociatedpress.net/


Re: New Committer: Clayton Weise

2013-05-01 Thread Joe Brockmeier
On Tue, Apr 30, 2013, at 11:53 AM, Chip Childers wrote:
> Please join me in congratulating Clayton!

Congratulations, Clayton! 

Best,

jzb
-- 
Joe Brockmeier
j...@zonker.net
Twitter: @jzb
http://www.dissociatedpress.net/


Re: version of cloudmonkey

2013-05-01 Thread Marcus Sorensen
The wiki was the one that had the 'display' parameter shown. I'm assuming
the display parameter is only in master then?


On Wed, May 1, 2013 at 2:56 PM, Justin Grudzien  wrote:

> Which documentation are you referring to? I updated cloudmonkey to add the
> set display and I updated the wiki to include the changes. I also noticed
> the async issue but haven't gotten around to fixing it yet.
>
>
> On Wed, May 1, 2013 at 8:47 AM, Marcus Sorensen 
> wrote:
>
> > I noticed that the documentation doesn't quite match up with cloudmonkey
> as
> > installed via tools/cli, nor does it match the tarball. It seems to be
> > missing 'set display', among other things, and the asyncblock never
> > returns, in either version, long after the job is finished.
> >
>


[DISCUSS] Linux native VXLAN support on KVM hypervisor

2013-05-01 Thread Toshiaki Hatano
Hi all,

I’d like to add Linux native VXLAN support on KVM hypervisor.

Currently, advanced zone with VLAN isolation can hold only 4k networks (= 
accounts) in a zone due to the VLAN ID limitation.
4k accounts per zone is not enough for IaaS provider like us.
Furthermore, VPC will allow single account to consume multiple networks.

Linux kernel 3.7 or later supports VXLAN as part of its ordinal networking 
function.
VXLAN enable Layer 2 tunneling over UDP/IP with VLAN-like encapsulation and 
allow 16M isolated networks in the domain.
So, by using linux native VXLAN support, we can extend network limits without 
introducing unnecessary complexity.
(But in other words, it’s not as flexible as Open vSwitch. Only thing Linux 
native VXLAN provides is multipoint L2 tunneling.)

Any thoughts about this?


P.S.

I’m currently working on this as my internship project.
As proof of concept, I’ve modified “modifyvlan.sh” script which is actual VLAN 
create/delete manipulation script called from cloud-agent, to create and to use 
VXLAN interface instead of VLAN interface.
Modified script is tested with CloudStack 4.0.1 and 3 KVM hypervisors based on 
CentOS 6.4 + 3.8.6 kernel.
And it looks working. (But I’m still testing)


P.S.2.

FYI: OpenStack already started process [1] to support Linux native VXLAN. 
[1] https://review.openstack.org/#/c/26516/


Best Regards,
--  
Toshiaki Hatano
Verio, an NTT Communications company 
E-mail:   toshiaki.hat...@verio.net
AIM: toshiaki.hat...@verio.net
Phone:  (801)437-7482  Office
(801)960-6410  Cellular


This email message is intended for the use of the person to whom it has been 
sent, and may contain information that is confidential or legally protected. If 
you are not the intended recipient or have received this message in error, you 
are not authorized to copy, distribute, or otherwise use this message or its 
attachments. Please notify the sender immediately by return e-mail and 
permanently delete this message and any attachments. Verio Inc. makes no 
warranty that this email is error or virus free.  Thank you.


Re: version of cloudmonkey

2013-05-01 Thread Justin Grudzien
Which documentation are you referring to? I updated cloudmonkey to add the
set display and I updated the wiki to include the changes. I also noticed
the async issue but haven't gotten around to fixing it yet.


On Wed, May 1, 2013 at 8:47 AM, Marcus Sorensen  wrote:

> I noticed that the documentation doesn't quite match up with cloudmonkey as
> installed via tools/cli, nor does it match the tarball. It seems to be
> missing 'set display', among other things, and the asyncblock never
> returns, in either version, long after the job is finished.
>


Re: Virtual Router: DHCP and 2-second DNS outages

2013-05-01 Thread Marcus Sorensen
What is scripts/network/exdhcp/dnsmasq_edithosts.sh ?

I noticed that master is already patched to hup, but it's missing the
dhcp_release that dennis just put in a review for.


On Wed, May 1, 2013 at 1:43 PM, Marcus Sorensen  wrote:

> oops, minus my two 'echo' debugging lines in there
>
>
>
> On Wed, May 1, 2013 at 1:41 PM, Marcus Sorensen wrote:
>
>> I'm not sure how we'd handle older versions if they don't have the
>> dhcp_release util, but how about this going forward?
>>
>> diff --git a/patches/systemvm/debian/config/root/edithosts.sh
>> b/patches/systemvm/debian/config/root/edithosts.sh
>> index 9f21f20..f6e09d6 100755
>> --- a/patches/systemvm/debian/config/root/edithosts.sh
>> +++ b/patches/systemvm/debian/config/root/edithosts.sh
>> @@ -71,6 +71,7 @@ DHCP_HOSTS=/etc/dhcphosts.txt
>>  DHCP_OPTS=/etc/dhcpopts.txt
>>  DHCP_LEASES=/var/lib/misc/dnsmasq.leases
>>  HOSTS=/etc/hosts
>> +ROUTER_VERSION=$(cat /etc/debian_version | cut -d. -f1)
>>
>>  source /root/func.sh
>>
>> @@ -99,6 +100,14 @@ wait_for_dnsmasq () {
>>
>>  logger -t cloud "edithosts: update $1 $2 $3 to hosts"
>>
>> +if [ $ROUTER_VERSION -gt 6 ]
>> +then
>> +  #release previous dhcp lease if present
>> +  echo releasing $ipv4
>> +  dhcp_release lo $ipv4 $(grep $ipv4 $DHCP_LEASES | awk '{print $2}')
>> >/dev/null 2>&1
>> +  echo released $ipv4
>> +fi
>> +
>>  [ ! -f $DHCP_HOSTS ] && touch $DHCP_HOSTS
>>  [ ! -f $DHCP_OPTS ] && touch $DHCP_OPTS
>>  [ ! -f $DHCP_LEASES ] && touch $DHCP_LEASES
>> @@ -200,7 +209,12 @@ fi
>>  pid=$(pidof dnsmasq)
>>  if [ "$pid" != "" ]
>>  then
>> -  service dnsmasq restart
>> +  if [ $ROUTER_VERSION -gt 6 ]
>> +  then
>> +kill -s 1 $pid
>> +  else
>> +service dnsmasq restart
>> +  fi
>>  else
>>if [ $no_redundant -eq 1 ]
>>then
>>
>>
>>
>>
>> On Wed, May 1, 2013 at 12:33 PM, Chip Childers > > wrote:
>>
>>> On Wed, May 01, 2013 at 12:29:32PM -0600, Marcus Sorensen wrote:
>>> > How do we go about requesting that dnsmasq-utils be installed on the
>>> new
>>> > system VM?
>>>
>>> The code to create system VMs is in the repo now.  You should be able to
>>> just make the change and / or submit a patch suggesting the change.
>>>
>>> See:
>>>
>>> tools/appliance/definitions
>>>
>>
>>
>


Re: Review Request: CLOUDSTACK-741 global granular parameters and CLOUDSTACK-2036 router template Id

2013-05-01 Thread ASF Subversion and Git Services

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10862/#review20027
---


Commit 807ad0a39ab272a4af2de3156b0b367570acccea in branch refs/heads/internallb 
from Nitin Mehta 
[ https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;h=807ad0a ]

CLOUDSTACK-741 - Making storage disable thresholds configurable at zone level.


- ASF Subversion and Git Services


On April 30, 2013, 1:42 p.m., Harikrishna Patnala wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/10862/
> ---
> 
> (Updated April 30, 2013, 1:42 p.m.)
> 
> 
> Review request for cloudstack, Abhinandan Prateek and Nitin Mehta.
> 
> 
> Description
> ---
> 
> CLOUDSTACK-741: Granular Global Parameters Added parameters
>  to cluster level
>  cluster.storage.allocated.capacity.notificationthreshold
>  cluster.storage.capacity.notificationthreshold
> 
> CLOUDSTACK-2036
> global parameter for Router Template ID functionality added
> We use 5 parameters to set the router template name for each hypervisor
> 
> Moved cpu.overprovisioning.factor and mem.overprovisioning.factor to be able 
> to update/list using update/list configuration API at cluster level
> 
> 
> This addresses bugs CLOUDSTACK-2036 and CLOUDSTACK-741.
> 
> 
> Diffs
> -
> 
>   server/src/com/cloud/alert/AlertManagerImpl.java 6839d44 
>   server/src/com/cloud/configuration/Config.java af6adcf 
>   server/src/com/cloud/configuration/ConfigurationManagerImpl.java 068a586 
>   server/src/com/cloud/dc/ClusterDetailsDaoImpl.java 4c85918 
>   server/src/com/cloud/network/router/VirtualNetworkApplianceManagerImpl.java 
> 4c7bc75 
>   server/src/com/cloud/storage/dao/VMTemplateDao.java 3f1fe93 
>   server/src/com/cloud/storage/dao/VMTemplateDaoImpl.java 3b37f24 
>   test/integration/smoke/test_global_settings.py ec18cea 
> 
> Diff: https://reviews.apache.org/r/10862/diff/
> 
> 
> Testing
> ---
> 
> Tested locally
> 
> 
> Thanks,
> 
> Harikrishna Patnala
> 
>



Re: Review Request: CLOUDSTACK-741: Granular Global Parameters

2013-05-01 Thread ASF Subversion and Git Services

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10548/#review20026
---


Commit 807ad0a39ab272a4af2de3156b0b367570acccea in branch refs/heads/internallb 
from Nitin Mehta 
[ https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;h=807ad0a ]

CLOUDSTACK-741 - Making storage disable thresholds configurable at zone level.


- ASF Subversion and Git Services


On April 19, 2013, 4:07 a.m., Harikrishna Patnala wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/10548/
> ---
> 
> (Updated April 19, 2013, 4:07 a.m.)
> 
> 
> Review request for cloudstack, Abhinandan Prateek, Kishan Kavala, and Nitin 
> Mehta.
> 
> 
> Description
> ---
> 
> CLOUDSTACK-741: Granular Global Parameters
> 
> Modified UpdateConfiguration API and ListConfiguration API by adding 
> additional parameter scope and resource id (zone/cluster/pool/account).
> Scope decides the parameter which level we can update the value and id is the 
> corresponding id based on the scope.
> This scope is defined in the config.java file where we are creating groups 
> for each level(zone/cluster/pool/account).
> Currently submitted the patch for the zone level parameter use.external.dns.
> 
> Included unit tests and marvin tests.
> 
> 
> This addresses bug CLOUDSTACK-741.
> 
> 
> Diffs
> -
> 
>   api/src/org/apache/cloudstack/api/command/admin/config/ListCfgsByCmd.java 
> aabfd4a 
>   api/src/org/apache/cloudstack/api/command/admin/config/UpdateCfgCmd.java 
> ffeb586 
>   api/src/org/apache/cloudstack/api/response/ConfigurationResponse.java 
> 95b8af2 
>   api/test/org/apache/cloudstack/api/command/test/ListCfgCmdTest.java 
> PRE-CREATION 
>   api/test/org/apache/cloudstack/api/command/test/UpdateCfgCmdTest.java 
> PRE-CREATION 
>   
> engine/api/src/org/apache/cloudstack/storage/datastore/db/StoragePoolDetailsDao.java
>  be71670 
>   server/src/com/cloud/configuration/Config.java 2993966 
>   server/src/com/cloud/configuration/ConfigurationManager.java afaf0d6 
>   server/src/com/cloud/configuration/ConfigurationManagerImpl.java 4fc2db7 
>   server/src/com/cloud/configuration/dao/ConfigurationDao.java c86c024 
>   server/src/com/cloud/network/router/VirtualNetworkApplianceManagerImpl.java 
> ab91059 
>   server/src/com/cloud/server/ConfigurationServer.java f441b1f 
>   server/src/com/cloud/server/ConfigurationServerImpl.java c4da1ab 
>   server/src/com/cloud/server/ManagementServerImpl.java 98f789a 
>   server/src/com/cloud/storage/dao/StoragePoolDetailsDaoImpl.java 0d797ed 
>   server/test/com/cloud/vpc/MockConfigurationManagerImpl.java 9443815 
>   test/integration/smoke/test_UpdateCfg.py PRE-CREATION 
> 
> Diff: https://reviews.apache.org/r/10548/diff/
> 
> 
> Testing
> ---
> 
> Tested locally
> - tested the modified UpdateConfiguration API and ListConfiguration API by 
> providing the zone scope and zone id
> - tested the modified parameter to take the updated value at zone level(after 
> updation).
> 
> 
> Thanks,
> 
> Harikrishna Patnala
> 
>



Re: Review Request: Release old DHCP entries

2013-05-01 Thread Marcus Sorensen

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10884/#review20025
---



patches/systemvm/debian/config/root/edithosts.sh


shouldn't this be $ipv4?, and if it fails to find the mac in the leases 
file, will it kill the whole script?


- Marcus Sorensen


On May 1, 2013, 6:41 p.m., Dennis Lawler wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/10884/
> ---
> 
> (Updated May 1, 2013, 6:41 p.m.)
> 
> 
> Review request for cloudstack.
> 
> 
> Description
> ---
> 
> Release old DHCP entries when adding new entries. 
> 
> Add dnsmasq-utils to System VM template.
> 
> 
> This addresses bug CLOUDSTACK-2299.
> 
> 
> Diffs
> -
> 
>   patches/systemvm/debian/config/root/edithosts.sh 1f98fbf 
>   scripts/network/exdhcp/dnsmasq_edithosts.sh 05285d9 
>   tools/appliance/definitions/systemvmtemplate/postinstall.sh ae8f1ad 
>   tools/appliance/definitions/systemvmtemplate64/postinstall.sh ae8f1ad 
> 
> Diff: https://reviews.apache.org/r/10884/diff/
> 
> 
> Testing
> ---
> 
> Tested in staging VM destroyed and re-instantiated with same IP.
> Did not test adding dnsmasq-utils to system VM build (yet).
> 
> 
> Thanks,
> 
> Dennis Lawler
> 
>



[ACS41][Patch Request]

2013-05-01 Thread Marcus Sorensen
commit 71a17e4c139a5c4e4be326e15548e0d6036dfd9a
Author: Marcus Sorensen 
Date:   Wed May 1 14:10:56 2013 -0600

CLOUDSTACK-2110 : allow vm to have multiple dhcp entries on same router

Signed-off-by: Marcus Sorensen  1367439056
-0600


Re: Virtual Router: DHCP and 2-second DNS outages

2013-05-01 Thread Marcus Sorensen
oops, minus my two 'echo' debugging lines in there



On Wed, May 1, 2013 at 1:41 PM, Marcus Sorensen  wrote:

> I'm not sure how we'd handle older versions if they don't have the
> dhcp_release util, but how about this going forward?
>
> diff --git a/patches/systemvm/debian/config/root/edithosts.sh
> b/patches/systemvm/debian/config/root/edithosts.sh
> index 9f21f20..f6e09d6 100755
> --- a/patches/systemvm/debian/config/root/edithosts.sh
> +++ b/patches/systemvm/debian/config/root/edithosts.sh
> @@ -71,6 +71,7 @@ DHCP_HOSTS=/etc/dhcphosts.txt
>  DHCP_OPTS=/etc/dhcpopts.txt
>  DHCP_LEASES=/var/lib/misc/dnsmasq.leases
>  HOSTS=/etc/hosts
> +ROUTER_VERSION=$(cat /etc/debian_version | cut -d. -f1)
>
>  source /root/func.sh
>
> @@ -99,6 +100,14 @@ wait_for_dnsmasq () {
>
>  logger -t cloud "edithosts: update $1 $2 $3 to hosts"
>
> +if [ $ROUTER_VERSION -gt 6 ]
> +then
> +  #release previous dhcp lease if present
> +  echo releasing $ipv4
> +  dhcp_release lo $ipv4 $(grep $ipv4 $DHCP_LEASES | awk '{print $2}')
> >/dev/null 2>&1
> +  echo released $ipv4
> +fi
> +
>  [ ! -f $DHCP_HOSTS ] && touch $DHCP_HOSTS
>  [ ! -f $DHCP_OPTS ] && touch $DHCP_OPTS
>  [ ! -f $DHCP_LEASES ] && touch $DHCP_LEASES
> @@ -200,7 +209,12 @@ fi
>  pid=$(pidof dnsmasq)
>  if [ "$pid" != "" ]
>  then
> -  service dnsmasq restart
> +  if [ $ROUTER_VERSION -gt 6 ]
> +  then
> +kill -s 1 $pid
> +  else
> +service dnsmasq restart
> +  fi
>  else
>if [ $no_redundant -eq 1 ]
>then
>
>
>
>
> On Wed, May 1, 2013 at 12:33 PM, Chip Childers 
> wrote:
>
>> On Wed, May 01, 2013 at 12:29:32PM -0600, Marcus Sorensen wrote:
>> > How do we go about requesting that dnsmasq-utils be installed on the new
>> > system VM?
>>
>> The code to create system VMs is in the repo now.  You should be able to
>> just make the change and / or submit a patch suggesting the change.
>>
>> See:
>>
>> tools/appliance/definitions
>>
>
>


Re: Virtual Router: DHCP and 2-second DNS outages

2013-05-01 Thread Marcus Sorensen
I'm not sure how we'd handle older versions if they don't have the
dhcp_release util, but how about this going forward?

diff --git a/patches/systemvm/debian/config/root/edithosts.sh
b/patches/systemvm/debian/config/root/edithosts.sh
index 9f21f20..f6e09d6 100755
--- a/patches/systemvm/debian/config/root/edithosts.sh
+++ b/patches/systemvm/debian/config/root/edithosts.sh
@@ -71,6 +71,7 @@ DHCP_HOSTS=/etc/dhcphosts.txt
 DHCP_OPTS=/etc/dhcpopts.txt
 DHCP_LEASES=/var/lib/misc/dnsmasq.leases
 HOSTS=/etc/hosts
+ROUTER_VERSION=$(cat /etc/debian_version | cut -d. -f1)

 source /root/func.sh

@@ -99,6 +100,14 @@ wait_for_dnsmasq () {

 logger -t cloud "edithosts: update $1 $2 $3 to hosts"

+if [ $ROUTER_VERSION -gt 6 ]
+then
+  #release previous dhcp lease if present
+  echo releasing $ipv4
+  dhcp_release lo $ipv4 $(grep $ipv4 $DHCP_LEASES | awk '{print $2}')
>/dev/null 2>&1
+  echo released $ipv4
+fi
+
 [ ! -f $DHCP_HOSTS ] && touch $DHCP_HOSTS
 [ ! -f $DHCP_OPTS ] && touch $DHCP_OPTS
 [ ! -f $DHCP_LEASES ] && touch $DHCP_LEASES
@@ -200,7 +209,12 @@ fi
 pid=$(pidof dnsmasq)
 if [ "$pid" != "" ]
 then
-  service dnsmasq restart
+  if [ $ROUTER_VERSION -gt 6 ]
+  then
+kill -s 1 $pid
+  else
+service dnsmasq restart
+  fi
 else
   if [ $no_redundant -eq 1 ]
   then




On Wed, May 1, 2013 at 12:33 PM, Chip Childers wrote:

> On Wed, May 01, 2013 at 12:29:32PM -0600, Marcus Sorensen wrote:
> > How do we go about requesting that dnsmasq-utils be installed on the new
> > system VM?
>
> The code to create system VMs is in the repo now.  You should be able to
> just make the change and / or submit a patch suggesting the change.
>
> See:
>
> tools/appliance/definitions
>


[bo...@apache.org: ASF Board Report - Initial Reminder for May 2013]

2013-05-01 Thread Chip Childers
It's report time for us again (we are on a monthly schedule for our
first quarter as a TLP).

I'll provide a draft in the next couple of days, and kindly ask that
others review / edit it prior to submission...  unless someone beats me
to it and creates a draft here: 

https://cwiki.apache.org/confluence/display/CLOUDSTACK/Board+Reports

It would be similar to the report from last month:

https://cwiki.apache.org/confluence/display/CLOUDSTACK/2013-04+Board+Report+for+Apache+CloudStack

-chip

- Forwarded message from ASF Board  -

Date: Wed, 1 May 2013 19:21:00 +
From: ASF Board 
To: Chip Childers 
Subject: ASF Board Report - Initial Reminder for May 2013
Message-ID: <20130501192100.9264ef...@minotaur.apache.org>



This email was sent by an automated system on behalf of the ASF Board.
It is an initial reminder to give you plenty of time to prepare the report.

The meeting is scheduled for Wed, 15 May 2013, 10:30:00:00 PST and the deadline 
for
submitting your report is 1 full week prior to that (Wed, May 8th)!

According to board records, you are listed as the chair of at least one
committee that is due to submit a report this month. [1] [2]

Details on which project reports are due and how to submit a report 
are enclosed below.

Please submit your report with sufficient time to allow the board members
to review and digest. Again, the very latest you should submit your report
is 1 full week (7days) prior to the board meeting (Wed, May 8th).

If you feel that an error has been made, please consult [1] and if there
is still an issue then contact the board directly.

As always, PMC chairs are welcome to attend the board meeting.

Thanks,
The ASF Board

[1] - https://svn.apache.org/repos/private/committers/board/committee-info.txt
[2] - https://svn.apache.org/repos/private/committers/board/calendar.txt
[3] - https://svn.apache.org/repos/private/committers/board/templates


Submitting your Report
--

Full details about the process and schedule are in [1].

The report should be committed to the meeting agenda in the board directory
in the foundation repository, trying to keep a similar format to the others.
This can be found at:

  https://svn.apache.org/repos/private/foundation/board

Your report should also be sent in plain-text format to bo...@apache.org
with a Subject line that follows the below format:

Subject: [REPORT] Project Name

Cutting and pasting directly from a Wiki is not acceptable due to formatting
issues. Line lengths should be limited to 77 characters.


Resolutions
---

There are several templates for use for various Board resolutions.
They can be found in [3] and you are encouraged to use them. It is
strongly recommended that if you have a resolution before the board,
you are encouraged to attend that board meeting.


ASF Board Reports
-

Reports are due from you for the following committees:

 - CloudStack


- End forwarded message -


Re: [PROPOSAL] "Internal Load Balancing between VPC tiers"

2013-05-01 Thread Alena Prokharchyk
On 5/1/13 11:43 AM, "Chandan Purushothama"
 wrote:

>Hello Alena,
>
>I have the following questions pertaining to the feature [Ref:
>https://cwiki.apache.org/confluence/display/CLOUDSTACK/Internal+Load+Balan
>cing+between+VPC+tiers]
>
>1. Do we support Multiple Application Tiers with InternalLb Service?

We do.


>2. Do we support Network Tier Upgrade from a network offering with
>InternalLb Service to another network offering that supports VPC VR as LB
>provider?


There is no separate service for the internal LB. It is the same LB
service defined in the networkOffering, just with the capability
lbSchemes=internal. In this release the upgrade from offering with
lbSchemes=Internal to lbSchemes=Public (and vice versa) is not gonna be
supported.


-Alena.



>
>Thank you,
>Chandan.
>
>-Original Message-
>From: Alena Prokharchyk [mailto:alena.prokharc...@citrix.com]
>Sent: Tuesday, March 26, 2013 9:07 AM
>To: dev@cloudstack.apache.org
>Cc: Alex Huang; cloudstack-...@incubator.apache.org; Chiradeep Vittal
>Subject: Re: [PROPOSAL] "Internal Load Balancing between VPC tiers"
>
>Marcus is right. The LB VM resides just on one tier (App in my FS
>example). To manage the access from Web Tier to the App tier, Network
>ACLs will be used.
>
>-Alena.
>
>On 3/25/13 7:55 PM, "Marcus Sorensen"  wrote:
>
>>I assume, and it seems this way from the spec, that the load balancer
>>VM just lives in the same network as the VMS you want to balance and
>>redirects traffic to them. It has a link local nic plus 1 nic.
>>
>>That's why I was thinking it would be easy to just create a static Nat
>>rule to the internal load balancer for public load balancing on any
>>network tier.
>>On Mar 25, 2013 8:46 PM, "Vijay Venkatachalam" <
>>vijay.venkatacha...@citrix.com> wrote:
>>
>>> If the services are provided by a LBVM, it should have access to both
>>>networks, one NIC in the web tier (the guest network where the VIP is
>>> present) and one NIC in the App Tier (the guest network where the
>>>server  vms are present), would that understanding be right? So when
>>>provisioning  the LB VM the user has to specify these 2 networks?
>>>
>>> On the similar lines, if an external LB Appliance is providing the
>>> service,  it has to be wired to both the VIP network  and the server
>>> vm network.
>>>
>>> Thanks,
>>> Vijay V.
>>>
>>> > -Original Message-
>>> > From: Alena Prokharchyk [mailto:alena.prokharc...@citrix.com]
>>> > Sent: Saturday, March 23, 2013 4:28 AM
>>> > To: cloudstack-...@incubator.apache.org
>>> > Cc: Alex Huang; Chiradeep Vittal
>>> > Subject: [PROPOSAL] "Internal Load Balancing between VPC tiers"
>>> >
>>> > I would like to propose a new feature - "Internal Load Balancing
>>>between
>>> > VPC tiers".  With the feature support, you can set up the Load
>>>Balancer
>>> inside
>>> > the VPC without facing the public network side. It will allow to
>>>balance
>>> > internal traffic between tiers inside the VPC - for example,
>>> > traffic
>>> coming
>>> > from Web Tier to the App tier.
>>> >
>>> >
>>> > Please review the firs draft of FS and provide your comments and
>>> feedback.
>>> > If you feel like some details are missing, let me know and I'll
>>>update it
>>> > promptly.
>>> >
>>> > https://cwiki.apache.org/confluence/display/CLOUDSTACK/Internal+Loa
>>> > d+B
>>> > alanc
>>> > ing+between+VPC+tiers
>>> >
>>> >
>>> > Alex/Chiradeep, would appreciate your reviewal as you were the
>>>original
>>> > contributors for the majority of cloudStack Networking code.
>>> >
>>> >
>>> > Thank you,
>>> > -Alena.
>>>
>>>
>>
>
>
>




Re: Network Resource Certificate Management

2013-05-01 Thread Chiradeep Vittal
Hi, 

Registering keys into cloudstack is not automated. CloudStack does try to
do it for certs that connect to the agents (as you saw), but that's not
universally liked (I don't like it either).

For a real deployment, I expect documentation on how to install the
certificate in the management server's keystone

On 4/30/13 3:36 PM, "Soheil Eizadi"  wrote:

>Hi,
>What is the deployment model for how the SSL Certificate for a Network
>Resource that is managed by CloudStack will get into the CloudStack
>KeyStore? For Dev/Test I can ignore the Certificate for now but would like
>to know how this will work for a real deployment.
>
>Are there CloudStack APIs to copy the certificate to the Keystore?
>
>My only exposure to the Keystore is the warning I get when I run the
>application at startup:
>>> WARN  [utils.script.Script] (Timer-2:) Timed out: sudo keytool -genkey
>>>...
>
>Thanks,
>-Soheil
>



Re: DNS and multiple Guest Networks.

2013-05-01 Thread Jeronimo Garcia
Thanks a lot ... it's hard cause  we will get a lot of empty answers when
we query a given host ... maybe there's a BIND feature for this ... but is
unlikely


On Wed, May 1, 2013 at 1:36 PM, Chiradeep Vittal <
chiradeep.vit...@citrix.com> wrote:

> Ideally there should be a 'master' DNS server that can answer everything.
> However, each DNS server comes with its own "api", so CloudStack has been
> unwilling to commit to serve any one DNS implementation. Not that it
> shouldn't, but it hasn't.
>
> Everybody has their favorite DNS - Windows, Infoblox, BIND, etc.
>
> On 5/1/13 10:59 AM, "Jeronimo Garcia"  wrote:
>
> >Hey List.
> >
> >I've got the following problem:
> >
> >Currently i have 5 guest networks and several VMs across them.
> >
> >My problem is that when i set DNS forward on my main DNS server i get hit
> >and misses depending the DNS server i hit for instance:
> >
> >
> >mydomain.com  -> 10.0.1.31 , 10.0.2.31 , both of this are virtual routers
> >with DNS running on them.
> >
> >Each of them will answer about VMs they know about ... which make the dns
> >forward a bit of a gamble ... cause i will get empty answers and real ones
> >depending the server i hit.
> >
> >Is there a solution for this yet?
> >
> >Thanks!
>
>


RE: [PROPOSAL] "Internal Load Balancing between VPC tiers"

2013-05-01 Thread Chandan Purushothama
Hello Alena,

I have the following questions pertaining to the feature [Ref: 
https://cwiki.apache.org/confluence/display/CLOUDSTACK/Internal+Load+Balancing+between+VPC+tiers]

1. Do we support Multiple Application Tiers with InternalLb Service?
2. Do we support Network Tier Upgrade from a network offering with InternalLb 
Service to another network offering that supports VPC VR as LB provider?

Thank you,
Chandan.

-Original Message-
From: Alena Prokharchyk [mailto:alena.prokharc...@citrix.com] 
Sent: Tuesday, March 26, 2013 9:07 AM
To: dev@cloudstack.apache.org
Cc: Alex Huang; cloudstack-...@incubator.apache.org; Chiradeep Vittal
Subject: Re: [PROPOSAL] "Internal Load Balancing between VPC tiers"

Marcus is right. The LB VM resides just on one tier (App in my FS example). To 
manage the access from Web Tier to the App tier, Network ACLs will be used.

-Alena.

On 3/25/13 7:55 PM, "Marcus Sorensen"  wrote:

>I assume, and it seems this way from the spec, that the load balancer 
>VM just lives in the same network as the VMS you want to balance and 
>redirects traffic to them. It has a link local nic plus 1 nic.
>
>That's why I was thinking it would be easy to just create a static Nat 
>rule to the internal load balancer for public load balancing on any 
>network tier.
>On Mar 25, 2013 8:46 PM, "Vijay Venkatachalam" < 
>vijay.venkatacha...@citrix.com> wrote:
>
>> If the services are provided by a LBVM, it should have access to both  
>>networks, one NIC in the web tier (the guest network where the VIP is
>> present) and one NIC in the App Tier (the guest network where the 
>>server  vms are present), would that understanding be right? So when 
>>provisioning  the LB VM the user has to specify these 2 networks?
>>
>> On the similar lines, if an external LB Appliance is providing the 
>> service,  it has to be wired to both the VIP network  and the server 
>> vm network.
>>
>> Thanks,
>> Vijay V.
>>
>> > -Original Message-
>> > From: Alena Prokharchyk [mailto:alena.prokharc...@citrix.com]
>> > Sent: Saturday, March 23, 2013 4:28 AM
>> > To: cloudstack-...@incubator.apache.org
>> > Cc: Alex Huang; Chiradeep Vittal
>> > Subject: [PROPOSAL] "Internal Load Balancing between VPC tiers"
>> >
>> > I would like to propose a new feature - "Internal Load Balancing
>>between
>> > VPC tiers".  With the feature support, you can set up the Load
>>Balancer
>> inside
>> > the VPC without facing the public network side. It will allow to
>>balance
>> > internal traffic between tiers inside the VPC - for example, 
>> > traffic
>> coming
>> > from Web Tier to the App tier.
>> >
>> >
>> > Please review the firs draft of FS and provide your comments and
>> feedback.
>> > If you feel like some details are missing, let me know and I'll
>>update it
>> > promptly.
>> >
>> > https://cwiki.apache.org/confluence/display/CLOUDSTACK/Internal+Loa
>> > d+B
>> > alanc
>> > ing+between+VPC+tiers
>> >
>> >
>> > Alex/Chiradeep, would appreciate your reviewal as you were the
>>original
>> > contributors for the majority of cloudStack Networking code.
>> >
>> >
>> > Thank you,
>> > -Alena.
>>
>>
>




Review Request: Release old DHCP entries

2013-05-01 Thread Dennis Lawler

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10884/
---

Review request for cloudstack.


Description
---

Release old DHCP entries when adding new entries. 

Add dnsmasq-utils to System VM template.


This addresses bug CLOUDSTACK-2299.


Diffs
-

  patches/systemvm/debian/config/root/edithosts.sh 1f98fbf 
  scripts/network/exdhcp/dnsmasq_edithosts.sh 05285d9 
  tools/appliance/definitions/systemvmtemplate/postinstall.sh ae8f1ad 
  tools/appliance/definitions/systemvmtemplate64/postinstall.sh ae8f1ad 

Diff: https://reviews.apache.org/r/10884/diff/


Testing
---

Tested in staging VM destroyed and re-instantiated with same IP.
Did not test adding dnsmasq-utils to system VM build (yet).


Thanks,

Dennis Lawler



Re: DNS and multiple Guest Networks.

2013-05-01 Thread Chiradeep Vittal
Ideally there should be a 'master' DNS server that can answer everything.
However, each DNS server comes with its own "api", so CloudStack has been
unwilling to commit to serve any one DNS implementation. Not that it
shouldn't, but it hasn't.

Everybody has their favorite DNS - Windows, Infoblox, BIND, etc.

On 5/1/13 10:59 AM, "Jeronimo Garcia"  wrote:

>Hey List.
>
>I've got the following problem:
>
>Currently i have 5 guest networks and several VMs across them.
>
>My problem is that when i set DNS forward on my main DNS server i get hit
>and misses depending the DNS server i hit for instance:
>
>
>mydomain.com  -> 10.0.1.31 , 10.0.2.31 , both of this are virtual routers
>with DNS running on them.
>
>Each of them will answer about VMs they know about ... which make the dns
>forward a bit of a gamble ... cause i will get empty answers and real ones
>depending the server i hit.
>
>Is there a solution for this yet?
>
>Thanks!



Re: Virtual Router: DHCP and 2-second DNS outages

2013-05-01 Thread Chip Childers
On Wed, May 01, 2013 at 12:29:32PM -0600, Marcus Sorensen wrote:
> How do we go about requesting that dnsmasq-utils be installed on the new
> system VM?

The code to create system VMs is in the repo now.  You should be able to
just make the change and / or submit a patch suggesting the change.

See:

tools/appliance/definitions


Re: Virtual Router: DHCP and 2-second DNS outages

2013-05-01 Thread Chiradeep Vittal
The set of packages installed is here:
http://s.apache.org/0c.

If you change it, it should get picked up in the next Jenkins build.

HOWEVER, note that the VMWare systemvm build is not fully automated (and
probably cannot be)

On 5/1/13 11:29 AM, "Marcus Sorensen"  wrote:

>How do we go about requesting that dnsmasq-utils be installed on the new
>system VM?
>
>
>On Wed, May 1, 2013 at 11:15 AM, Marcus Sorensen
>wrote:
>
>> I think on new system VM edithosts should preemptively expire lease for
>> the passed ip and then sighup. That avoids complications in having to
>>put
>> in separate calls to the router VM in each agent resource just to
>>expire.
>> On May 1, 2013 9:10 AM, "Dennis Lawler"  wrote:
>>
>>> It does reconfigure the available leases for new IP allocations.  It
>>>just
>>> doesn't expire the leases it has already handed out.
>>>
>>> If you replace the "service dnsmasq restart" in edithosts.sh with
>>>"kill -s
>>> 1" on the router VM, you'll start seeing these log messages when a VM
>>>is
>>> destroyed and re-allocated:
>>>
>>> dnsmasq-dhcp[pid]: not using configured address 192.168.1.100 because
>>>it
>>> is
>>> leased to aa:bb:cc:11:22:33
>>> dnsmasq-dhcp[pid]: DHCPDISCOVER(eth0) aa:bb:cc:22:33:44 no address
>>> available
>>>
>>>
>>>
>>>
>>> On Tue, Apr 30, 2013 at 10:10 PM, Marcus Sorensen >> >wrote:
>>>
>>> > that's strange, because the dnsmasq man page explicitly calls out the
>>> > SIGHUP as a way to reconfigure DHCP hosts entries from a
>>> --dhcp-hostsfile
>>> > parameter. Or are these not the same thing?
>>> >
>>> >
>>> > On Tue, Apr 30, 2013 at 5:52 PM, Chiradeep Vittal <
>>> > chiradeep.vit...@citrix.com> wrote:
>>> >
>>> > >
>>> > >
>>> > > On 4/30/13 3:26 PM, "Dennis Lawler"  wrote:
>>> > >
>>> > > >Every time a new VM is started up, there is a 2 second outage in
>>>DNS
>>> > > >services that can cause problems in guest VMs that use the router
>>>VM
>>> for
>>> > > >DNS.
>>> > > >
>>> > > >
>>> > > >
>>> > > >For Cloudstack configurations using both DHCP and DNS services on
>>>the
>>> > > >router
>>> > > >VM (both implemented with dnsmasq), there is currently a 2 second
>>>DNS
>>> > > >service outage every time a new VM is instantiated
>>> > > >
>>> > > >
>>> > > >
>>> > > >The source of this outage is in edithosts.sh, which uses "service
>>> > dnsmasq
>>> > > >restart" to pick up the freshly added DNS and DHCP entries.
>>> > > >
>>> > > >Restarting the dnsmasq service triggers a sleep for 2 seconds
>>>after
>>> > > >killing
>>> > > >dnsmasq before starting it back up again.
>>> > > >
>>> > > >
>>> > > >
>>> > > >An obvious solution would be to replace "service dnsmasq restart"
>>> with
>>> > > >"kill
>>> > > >-s 1 $pid" (SIGHUP) so that dnsmasq reads the new DHCP entries
>>> without
>>> > > >restarting, as in dnsmasq_edithosts.sh (external dhcp).
>>> > > >
>>> > > >
>>> > > >Unfortunately, this solution is flawed because dnsmasq SIGHUP
>>> handling
>>> > > >does
>>> > > >not expire in-memory DHCP leases in dnsmasq and all leases are
>>> infinite
>>> > by
>>> > > >default.
>>> > >
>>> > > Aha! That's why SIGHUP didn't work consistently. This has been
>>> bugging me
>>> > > for a long time.
>>> > >
>>> > > >Thus, this will only work if the guest VM performs a DHCP release
>>>on
>>> > > >shutdown, which cannot always be guaranteed.
>>> > > >
>>> > > >
>>> > > >
>>> > > >A few possible solutions off the top of my head:
>>> > > >
>>> > > >1.   Separate DNS and DHCP services.  While DHCP services
>>>still
>>> > > >experience an outage during VM,  DNS will not necessarily be
>>> impacted if
>>> > > >implemented correctly.
>>> > > >
>>> > > >2.   Use SIGHUP with dnsmasq and implement a removeDhcpEntry
>>> > interface
>>> > > >for network appliances to force a DHCP release whenever a NIC /
>>>IP is
>>> > > >deallocated.  This can use dhcp_release to simulate a DHCP
>>>release on
>>> > the
>>> > > >router VM.
>>> > > >Catch: dhcp_release is not available for Debian 6.0.  The System
>>>VM
>>> > needs
>>> > > >to
>>> > > >be updated to at least Debian 7.0, or the dnsmasq-tools .deb from
>>>7.0
>>> > > >would
>>> > > >need to be included in the System VM image.
>>> > >
>>> > > There is going to be a new system vm based on 7.0 for the upcoming
>>> > > release. This should work with earlier releases as well.
>>> > > https://cwiki.apache.org/confluence/x/UlHVAQ
>>> > >
>>> > > >
>>> > > >3.   Change DHCP to have a shorter lease, track de-allocation
>>>of
>>> IPs
>>> > > >separately from VM destruction.
>>> > > >Catch: This may cause occasional IP pool exhaustion depending on
>>> > > >allocation
>>> > > >of the guest IP range and the rate of VM destruction /
>>>instantiation
>>> in
>>> > > >the
>>> > > >network.
>>> > > >
>>> > > >
>>> > > >
>>> > > >Thoughts?
>>> > > >
>>> > >
>>> > >
>>> >
>>>
>>



Re: Virtual Router: DHCP and 2-second DNS outages

2013-05-01 Thread Dennis Lawler
Something like this:

--- a/patches/systemvm/debian/config/root/edithosts.sh
+++ b/patches/systemvm/debian/config/root/edithosts.sh
@@ -99,6 +99,10 @@ wait_for_dnsmasq () {

 logger -t cloud "edithosts: update $1 $2 $3 to hosts"

+#release previous dhcp lease if present
+dhcp_release eth0 $ip $(grep $ip $DHCP_LEASES | awk '{print $2}')

(same for dnsmasq_edithosts.sh)

--- a/tools/appliance/definitions/systemvmtemplate/postinstall.sh
+++ b/tools/appliance/definitions/systemvmtemplate/postinstall.sh
@@ -40,7 +40,7 @@ install_packages() {
   # haproxy
   apt-get --no-install-recommends -q -y --force-yes install haproxy
   # dnsmasq
-  apt-get --no-install-recommends -q -y --force-yes install dnsmasq
+  apt-get --no-install-recommends -q -y --force-yes install dnsmasq
dnsmasq-utils

Would need a rebuild of system VM, perhaps documentation update to notify
users that external dnsmasq should also have dnsmasq-utils package
installed.


On Wed, May 1, 2013 at 11:29 AM, Marcus Sorensen wrote:

> How do we go about requesting that dnsmasq-utils be installed on the new
> system VM?
>
>
> On Wed, May 1, 2013 at 11:15 AM, Marcus Sorensen  >wrote:
>
> > I think on new system VM edithosts should preemptively expire lease for
> > the passed ip and then sighup. That avoids complications in having to put
> > in separate calls to the router VM in each agent resource just to expire.
> > On May 1, 2013 9:10 AM, "Dennis Lawler"  wrote:
> >
> >> It does reconfigure the available leases for new IP allocations.  It
> just
> >> doesn't expire the leases it has already handed out.
> >>
> >> If you replace the "service dnsmasq restart" in edithosts.sh with "kill
> -s
> >> 1" on the router VM, you'll start seeing these log messages when a VM is
> >> destroyed and re-allocated:
> >>
> >> dnsmasq-dhcp[pid]: not using configured address 192.168.1.100 because it
> >> is
> >> leased to aa:bb:cc:11:22:33
> >> dnsmasq-dhcp[pid]: DHCPDISCOVER(eth0) aa:bb:cc:22:33:44 no address
> >> available
> >>
> >>
> >>
> >>
> >> On Tue, Apr 30, 2013 at 10:10 PM, Marcus Sorensen  >> >wrote:
> >>
> >> > that's strange, because the dnsmasq man page explicitly calls out the
> >> > SIGHUP as a way to reconfigure DHCP hosts entries from a
> >> --dhcp-hostsfile
> >> > parameter. Or are these not the same thing?
> >> >
> >> >
> >> > On Tue, Apr 30, 2013 at 5:52 PM, Chiradeep Vittal <
> >> > chiradeep.vit...@citrix.com> wrote:
> >> >
> >> > >
> >> > >
> >> > > On 4/30/13 3:26 PM, "Dennis Lawler"  wrote:
> >> > >
> >> > > >Every time a new VM is started up, there is a 2 second outage in
> DNS
> >> > > >services that can cause problems in guest VMs that use the router
> VM
> >> for
> >> > > >DNS.
> >> > > >
> >> > > >
> >> > > >
> >> > > >For Cloudstack configurations using both DHCP and DNS services on
> the
> >> > > >router
> >> > > >VM (both implemented with dnsmasq), there is currently a 2 second
> DNS
> >> > > >service outage every time a new VM is instantiated
> >> > > >
> >> > > >
> >> > > >
> >> > > >The source of this outage is in edithosts.sh, which uses "service
> >> > dnsmasq
> >> > > >restart" to pick up the freshly added DNS and DHCP entries.
> >> > > >
> >> > > >Restarting the dnsmasq service triggers a sleep for 2 seconds after
> >> > > >killing
> >> > > >dnsmasq before starting it back up again.
> >> > > >
> >> > > >
> >> > > >
> >> > > >An obvious solution would be to replace "service dnsmasq restart"
> >> with
> >> > > >"kill
> >> > > >-s 1 $pid" (SIGHUP) so that dnsmasq reads the new DHCP entries
> >> without
> >> > > >restarting, as in dnsmasq_edithosts.sh (external dhcp).
> >> > > >
> >> > > >
> >> > > >Unfortunately, this solution is flawed because dnsmasq SIGHUP
> >> handling
> >> > > >does
> >> > > >not expire in-memory DHCP leases in dnsmasq and all leases are
> >> infinite
> >> > by
> >> > > >default.
> >> > >
> >> > > Aha! That's why SIGHUP didn't work consistently. This has been
> >> bugging me
> >> > > for a long time.
> >> > >
> >> > > >Thus, this will only work if the guest VM performs a DHCP release
> on
> >> > > >shutdown, which cannot always be guaranteed.
> >> > > >
> >> > > >
> >> > > >
> >> > > >A few possible solutions off the top of my head:
> >> > > >
> >> > > >1.   Separate DNS and DHCP services.  While DHCP services still
> >> > > >experience an outage during VM,  DNS will not necessarily be
> >> impacted if
> >> > > >implemented correctly.
> >> > > >
> >> > > >2.   Use SIGHUP with dnsmasq and implement a removeDhcpEntry
> >> > interface
> >> > > >for network appliances to force a DHCP release whenever a NIC / IP
> is
> >> > > >deallocated.  This can use dhcp_release to simulate a DHCP release
> on
> >> > the
> >> > > >router VM.
> >> > > >Catch: dhcp_release is not available for Debian 6.0.  The System VM
> >> > needs
> >> > > >to
> >> > > >be updated to at least Debian 7.0, or the dnsmasq-tools .deb from
> 7.0
> >> > > >would
> >> > > >need to be included in the System VM image.
> >> > >
> >> > > There is going 

Re: Virtual Router: DHCP and 2-second DNS outages

2013-05-01 Thread Marcus Sorensen
How do we go about requesting that dnsmasq-utils be installed on the new
system VM?


On Wed, May 1, 2013 at 11:15 AM, Marcus Sorensen wrote:

> I think on new system VM edithosts should preemptively expire lease for
> the passed ip and then sighup. That avoids complications in having to put
> in separate calls to the router VM in each agent resource just to expire.
> On May 1, 2013 9:10 AM, "Dennis Lawler"  wrote:
>
>> It does reconfigure the available leases for new IP allocations.  It just
>> doesn't expire the leases it has already handed out.
>>
>> If you replace the "service dnsmasq restart" in edithosts.sh with "kill -s
>> 1" on the router VM, you'll start seeing these log messages when a VM is
>> destroyed and re-allocated:
>>
>> dnsmasq-dhcp[pid]: not using configured address 192.168.1.100 because it
>> is
>> leased to aa:bb:cc:11:22:33
>> dnsmasq-dhcp[pid]: DHCPDISCOVER(eth0) aa:bb:cc:22:33:44 no address
>> available
>>
>>
>>
>>
>> On Tue, Apr 30, 2013 at 10:10 PM, Marcus Sorensen > >wrote:
>>
>> > that's strange, because the dnsmasq man page explicitly calls out the
>> > SIGHUP as a way to reconfigure DHCP hosts entries from a
>> --dhcp-hostsfile
>> > parameter. Or are these not the same thing?
>> >
>> >
>> > On Tue, Apr 30, 2013 at 5:52 PM, Chiradeep Vittal <
>> > chiradeep.vit...@citrix.com> wrote:
>> >
>> > >
>> > >
>> > > On 4/30/13 3:26 PM, "Dennis Lawler"  wrote:
>> > >
>> > > >Every time a new VM is started up, there is a 2 second outage in DNS
>> > > >services that can cause problems in guest VMs that use the router VM
>> for
>> > > >DNS.
>> > > >
>> > > >
>> > > >
>> > > >For Cloudstack configurations using both DHCP and DNS services on the
>> > > >router
>> > > >VM (both implemented with dnsmasq), there is currently a 2 second DNS
>> > > >service outage every time a new VM is instantiated
>> > > >
>> > > >
>> > > >
>> > > >The source of this outage is in edithosts.sh, which uses "service
>> > dnsmasq
>> > > >restart" to pick up the freshly added DNS and DHCP entries.
>> > > >
>> > > >Restarting the dnsmasq service triggers a sleep for 2 seconds after
>> > > >killing
>> > > >dnsmasq before starting it back up again.
>> > > >
>> > > >
>> > > >
>> > > >An obvious solution would be to replace "service dnsmasq restart"
>> with
>> > > >"kill
>> > > >-s 1 $pid" (SIGHUP) so that dnsmasq reads the new DHCP entries
>> without
>> > > >restarting, as in dnsmasq_edithosts.sh (external dhcp).
>> > > >
>> > > >
>> > > >Unfortunately, this solution is flawed because dnsmasq SIGHUP
>> handling
>> > > >does
>> > > >not expire in-memory DHCP leases in dnsmasq and all leases are
>> infinite
>> > by
>> > > >default.
>> > >
>> > > Aha! That's why SIGHUP didn't work consistently. This has been
>> bugging me
>> > > for a long time.
>> > >
>> > > >Thus, this will only work if the guest VM performs a DHCP release on
>> > > >shutdown, which cannot always be guaranteed.
>> > > >
>> > > >
>> > > >
>> > > >A few possible solutions off the top of my head:
>> > > >
>> > > >1.   Separate DNS and DHCP services.  While DHCP services still
>> > > >experience an outage during VM,  DNS will not necessarily be
>> impacted if
>> > > >implemented correctly.
>> > > >
>> > > >2.   Use SIGHUP with dnsmasq and implement a removeDhcpEntry
>> > interface
>> > > >for network appliances to force a DHCP release whenever a NIC / IP is
>> > > >deallocated.  This can use dhcp_release to simulate a DHCP release on
>> > the
>> > > >router VM.
>> > > >Catch: dhcp_release is not available for Debian 6.0.  The System VM
>> > needs
>> > > >to
>> > > >be updated to at least Debian 7.0, or the dnsmasq-tools .deb from 7.0
>> > > >would
>> > > >need to be included in the System VM image.
>> > >
>> > > There is going to be a new system vm based on 7.0 for the upcoming
>> > > release. This should work with earlier releases as well.
>> > > https://cwiki.apache.org/confluence/x/UlHVAQ
>> > >
>> > > >
>> > > >3.   Change DHCP to have a shorter lease, track de-allocation of
>> IPs
>> > > >separately from VM destruction.
>> > > >Catch: This may cause occasional IP pool exhaustion depending on
>> > > >allocation
>> > > >of the guest IP range and the rate of VM destruction / instantiation
>> in
>> > > >the
>> > > >network.
>> > > >
>> > > >
>> > > >
>> > > >Thoughts?
>> > > >
>> > >
>> > >
>> >
>>
>


Re: Review Request: Selenium Headless configuration using PhantomJS

2013-05-01 Thread edison su

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10846/#review20012
---



test/selenium/smoke/Login_and_Accounts.py


For this kind of global configurations, what we did in marvin, is that, 
inject global configurations into each unit test case. For example, we can add 
a command line option(mgt server ip) in test/selenium/smoke/main.py, then 
inject mgt server ip address into each unit test case:  setattr(test, 
"base_url", "http://mgt-serv-ip-got-from-command-line:8080/";), then inside each 
unit test, self.base_url is already initialized.


- edison su


On May 1, 2013, 5:48 p.m., Parth Jagirdar wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/10846/
> ---
> 
> (Updated May 1, 2013, 5:48 p.m.)
> 
> 
> Review request for cloudstack, David Nalley, Chip Childers, and edison su.
> 
> 
> Description
> ---
> 
> Selenium Headless configuration using PhantomJS.
> 
> Fixed Readme Typos, and added an extra field for PhantomJS and How to 
> configure Management Server IP.
> 
> 
> This addresses bug Cloudstack-2282.
> 
> 
> Diffs
> -
> 
>   test/selenium/ReadMe.txt 30b0e0d 
>   test/selenium/lib/initialize.py e8cc49a 
>   test/selenium/smoke/Login_and_Accounts.py c5132d9 
> 
> Diff: https://reviews.apache.org/r/10846/diff/
> 
> 
> Testing
> ---
> 
> NA.
> 
> 
> Thanks,
> 
> Parth Jagirdar
> 
>



DNS and multiple Guest Networks.

2013-05-01 Thread Jeronimo Garcia
Hey List.

I've got the following problem:

Currently i have 5 guest networks and several VMs across them.

My problem is that when i set DNS forward on my main DNS server i get hit
and misses depending the DNS server i hit for instance:


mydomain.com  -> 10.0.1.31 , 10.0.2.31 , both of this are virtual routers
with DNS running on them.

Each of them will answer about VMs they know about ... which make the dns
forward a bit of a gamble ... cause i will get empty answers and real ones
depending the server i hit.

Is there a solution for this yet?

Thanks!


Re: Review Request: Selenium Headless configuration using PhantomJS

2013-05-01 Thread Parth Jagirdar

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10846/
---

(Updated May 1, 2013, 5:48 p.m.)


Review request for cloudstack, David Nalley, Chip Childers, and edison su.


Changes
---

Updating the diff


Description
---

Selenium Headless configuration using PhantomJS.

Fixed Readme Typos, and added an extra field for PhantomJS and How to configure 
Management Server IP.


This addresses bug Cloudstack-2282.


Diffs (updated)
-

  test/selenium/ReadMe.txt 30b0e0d 
  test/selenium/lib/initialize.py e8cc49a 
  test/selenium/smoke/Login_and_Accounts.py c5132d9 

Diff: https://reviews.apache.org/r/10846/diff/


Testing
---

NA.


Thanks,

Parth Jagirdar



Re: Jclouds

2013-05-01 Thread David Nalley
On Wed, May 1, 2013 at 1:14 PM, Seif Eddine Jemli
 wrote:
> Hi,
>
>
>
> i am trying to implement a java code that should enable me to do simple
> things: deploy Virtual machines for example.
>
>
> I was advised to use Jclouds API, the problem is that i didn't find
> "enough"  documentation on how to use Jclouds on a cloudstack private cloud
> .
>
> Where can i find a jclouds code on cloudstack that i can use as a start
> (like a tuto)?
>
> thanks


This isn't the first time this has come up.

Let me paste an IRC conversation that should help you make progress.

13:27 < adrianc> ke4qqq I think using the raw cloudstack api isn't
something there's a very nice guide on
13:28 < adrianc> however, they can get started quite easily using
jclouds-examples/compute-basics
13:28 < adrianc> and pass in the url to the cloudstack instance
13:28 < adrianc> abayer also has cloudcat
13:28 < adrianc> which is a cloudstack app
13:28 < adrianc> yp
13:28 < adrianc> ke4qqq the other thing is that there's tons of
examples, if one is ok looking at live tests
13:29 < adrianc> ex. apis/cloudstack/src/test/java/...*LiveTest.java
13:29 < adrianc> contextBuilder.overrides
13:30 < adrianc> ke4qqq anyway we can do a lot better on asf in
cloudstack doc stuff

The cloudcat referenced is: https://github.com/abayer/cloudcat  <--
which uses jclouds for CloudStack, so should give you an example.

--David


Re: Review Request: Selenium Headless configuration using PhantomJS

2013-05-01 Thread edison su

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10846/#review20009
---


Did you attache a wrong patch?

- edison su


On April 30, 2013, 5:56 p.m., Parth Jagirdar wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/10846/
> ---
> 
> (Updated April 30, 2013, 5:56 p.m.)
> 
> 
> Review request for cloudstack, David Nalley, Chip Childers, and edison su.
> 
> 
> Description
> ---
> 
> Selenium Headless configuration using PhantomJS.
> 
> Fixed Readme Typos, and added an extra field for PhantomJS and How to 
> configure Management Server IP.
> 
> 
> This addresses bug Cloudstack-2282.
> 
> 
> Diffs
> -
> 
>   
> framework/ipc/src/org/apache/cloudstack/framework/messagebus/MessageBus.java 
> 4aa007d 
>   
> framework/ipc/src/org/apache/cloudstack/framework/messagebus/MessageBusBase.java
>  5b7af4d 
>   framework/ipc/test/org/apache/cloudstack/messagebus/TestMessageBus.java 
> PRE-CREATION 
>   framework/ipc/test/resources/MessageBusTestContext.xml PRE-CREATION 
> 
> Diff: https://reviews.apache.org/r/10846/diff/
> 
> 
> Testing
> ---
> 
> NA.
> 
> 
> Thanks,
> 
> Parth Jagirdar
> 
>



Summary of IRC meeting in #cloudstack-meeting, Wed May 1 17:05:15 2013

2013-05-01 Thread ASF IRC Services
Members present: animesh, chipc


Meeting summary:


1. Preface

2. 4.1.0 Release

3. 4.2.0 Release
  a. 
https://cwiki.apache.org/confluence/display/CLOUDSTACK/Cloudstack+4.2+Release 
(chipc, 3)
  b. 
https://cwiki.apache.org/confluence/display/CLOUDSTACK/Current+Maintainers+Per+Component
 (chipc, 3)

4. Other Topics

IRC log follows:


# 1. Preface #
17:05:16 [chipc]: ASFBot: meeting start


# 2. 4.1.0 Release #
17:05:52 [chipc]: Here's where we stand on 4.1.0: we still have upgrade issues 
to re-test
17:06:10 [chipc]: and I believe there is an issue I saw on the ML for another 
upgrade problem, but no bug ID
17:06:17 [chipc]: I'll have to get back through the list to see
17:07:00 [chipc]: it's a little difficult to get through these problems, since 
they are reported by someone in a very different timezone than the devs that 
can help fix the problems
17:07:09 [chipc]: and today being a holiday in the EU is delaying retesting
17:07:22 [chipc]: so that's unfortunate, but it is what it is
17:07:30 [chipc]: any other 4.1.0 topics?
17:07:52 [chipc]: going once
17:08:09 [chipc]: twice
17:08:30 [chipc]: sold...  moving on


# 3. 4.2.0 Release #
17:08:46 [chipc]: animesh: have anything to share?
17:09:00 [animesh]: Ok so last week we concluded to keep 4.2 on 4 month schedule
17:09:07 [chipc]: yes
17:09:07 [animesh]: I have updated the 4.2 release page
17:09:30 [animesh]: I have setup a bunch of filters based on open issues for 
specific components
17:09:38 [chipc]: #info 
https://cwiki.apache.org/confluence/display/CLOUDSTACK/Cloudstack+4.2+Release
17:09:52 [chipc]: animesh: did you share those filters with the ML?
17:10:02 [animesh]: I am updating the current maintainers page with 
subscription links to these filters
17:10:30 [animesh]: Folks should be able to setup personal subscription for the 
components they are interested in
17:11:15 [chipc]: #info 
https://cwiki.apache.org/confluence/display/CLOUDSTACK/Current+Maintainers+Per+Component
17:11:15 [animesh]: I would have like to add cloudstack dev mailing list to 
receive direct emails for the component issues
17:11:22 [chipc]: looks good!
17:11:39 [animesh]: I was working with infra to see if that could be done, but 
it is not supported
17:12:00 [chipc]: what would that mean?  some sort of weekly or daily email 
from each component?
17:12:15 [animesh]: I will setup my own personal subscriptions and set up mail 
client rule to forward the component issues to dev mailing list
17:12:39 [animesh]: Next I will set up dashboard for 4.2
17:13:01 [chipc]: but what would it look like coming to dev@?
17:13:30 [animesh]: I will send out an email to dev later today on the filters 
and subscription
17:13:37 [chipc]: ok, thx
17:14:06 [animesh]: I will open up a discussion on dev on how often we would 
like to see the component issue emails. may be a week
17:15:00 [chipc]: perhaps a different approach could be to have 
issues@cloudstack.a.o emails get the component in the subject line?
17:15:15 [chipc]: I'll reply with that idea when you start the DISCUSS thread
17:15:17 [chipc]: ok - so anything else on 4.2.0?
17:15:39 [animesh]: Yes the component description shows up in subject line
17:16:30 [animesh]: That's all that I know, let me know if I am missing anything
17:16:41 [chipc]: well, I guess that's it then ;-)
17:16:54 [chipc]: ok...  next topic


# 4. Other Topics #
17:17:21 [chipc]: Since I think it's just animesh and I in the meeting...  
generalized this section
17:17:30 [chipc]: anyone have anything else to discuss?
17:18:07 [chipc]: ok then...  I guess that;'s it.  Thanks for joining Animesh
17:18:15 [chipc]: ACTION wishes others made it



Re: Virtual Router: DHCP and 2-second DNS outages

2013-05-01 Thread Marcus Sorensen
I think on new system VM edithosts should preemptively expire lease for the
passed ip and then sighup. That avoids complications in having to put in
separate calls to the router VM in each agent resource just to expire.
On May 1, 2013 9:10 AM, "Dennis Lawler"  wrote:

> It does reconfigure the available leases for new IP allocations.  It just
> doesn't expire the leases it has already handed out.
>
> If you replace the "service dnsmasq restart" in edithosts.sh with "kill -s
> 1" on the router VM, you'll start seeing these log messages when a VM is
> destroyed and re-allocated:
>
> dnsmasq-dhcp[pid]: not using configured address 192.168.1.100 because it is
> leased to aa:bb:cc:11:22:33
> dnsmasq-dhcp[pid]: DHCPDISCOVER(eth0) aa:bb:cc:22:33:44 no address
> available
>
>
>
>
> On Tue, Apr 30, 2013 at 10:10 PM, Marcus Sorensen  >wrote:
>
> > that's strange, because the dnsmasq man page explicitly calls out the
> > SIGHUP as a way to reconfigure DHCP hosts entries from a --dhcp-hostsfile
> > parameter. Or are these not the same thing?
> >
> >
> > On Tue, Apr 30, 2013 at 5:52 PM, Chiradeep Vittal <
> > chiradeep.vit...@citrix.com> wrote:
> >
> > >
> > >
> > > On 4/30/13 3:26 PM, "Dennis Lawler"  wrote:
> > >
> > > >Every time a new VM is started up, there is a 2 second outage in DNS
> > > >services that can cause problems in guest VMs that use the router VM
> for
> > > >DNS.
> > > >
> > > >
> > > >
> > > >For Cloudstack configurations using both DHCP and DNS services on the
> > > >router
> > > >VM (both implemented with dnsmasq), there is currently a 2 second DNS
> > > >service outage every time a new VM is instantiated
> > > >
> > > >
> > > >
> > > >The source of this outage is in edithosts.sh, which uses "service
> > dnsmasq
> > > >restart" to pick up the freshly added DNS and DHCP entries.
> > > >
> > > >Restarting the dnsmasq service triggers a sleep for 2 seconds after
> > > >killing
> > > >dnsmasq before starting it back up again.
> > > >
> > > >
> > > >
> > > >An obvious solution would be to replace "service dnsmasq restart" with
> > > >"kill
> > > >-s 1 $pid" (SIGHUP) so that dnsmasq reads the new DHCP entries without
> > > >restarting, as in dnsmasq_edithosts.sh (external dhcp).
> > > >
> > > >
> > > >Unfortunately, this solution is flawed because dnsmasq SIGHUP handling
> > > >does
> > > >not expire in-memory DHCP leases in dnsmasq and all leases are
> infinite
> > by
> > > >default.
> > >
> > > Aha! That's why SIGHUP didn't work consistently. This has been bugging
> me
> > > for a long time.
> > >
> > > >Thus, this will only work if the guest VM performs a DHCP release on
> > > >shutdown, which cannot always be guaranteed.
> > > >
> > > >
> > > >
> > > >A few possible solutions off the top of my head:
> > > >
> > > >1.   Separate DNS and DHCP services.  While DHCP services still
> > > >experience an outage during VM,  DNS will not necessarily be impacted
> if
> > > >implemented correctly.
> > > >
> > > >2.   Use SIGHUP with dnsmasq and implement a removeDhcpEntry
> > interface
> > > >for network appliances to force a DHCP release whenever a NIC / IP is
> > > >deallocated.  This can use dhcp_release to simulate a DHCP release on
> > the
> > > >router VM.
> > > >Catch: dhcp_release is not available for Debian 6.0.  The System VM
> > needs
> > > >to
> > > >be updated to at least Debian 7.0, or the dnsmasq-tools .deb from 7.0
> > > >would
> > > >need to be included in the System VM image.
> > >
> > > There is going to be a new system vm based on 7.0 for the upcoming
> > > release. This should work with earlier releases as well.
> > > https://cwiki.apache.org/confluence/x/UlHVAQ
> > >
> > > >
> > > >3.   Change DHCP to have a shorter lease, track de-allocation of
> IPs
> > > >separately from VM destruction.
> > > >Catch: This may cause occasional IP pool exhaustion depending on
> > > >allocation
> > > >of the guest IP range and the rate of VM destruction / instantiation
> in
> > > >the
> > > >network.
> > > >
> > > >
> > > >
> > > >Thoughts?
> > > >
> > >
> > >
> >
>


Jclouds

2013-05-01 Thread Seif Eddine Jemli
Hi,



i am trying to implement a java code that should enable me to do simple
things: deploy Virtual machines for example.


I was advised to use Jclouds API, the problem is that i didn't find
"enough"  documentation on how to use Jclouds on a cloudstack private cloud
.

Where can i find a jclouds code on cloudstack that i can use as a start
(like a tuto)?

thanks


Re: Virtual Router: DHCP and 2-second DNS outages

2013-05-01 Thread Marcus Sorensen
Ah.

I think this is a pretty big issue, especially in VPC, people could miss
getting an address if the router's service goes out. It may be the root
cause of CLOUDSTACK-2110. We are looking into it.
On May 1, 2013 9:10 AM, "Dennis Lawler"  wrote:

> It does reconfigure the available leases for new IP allocations.  It just
> doesn't expire the leases it has already handed out.
>
> If you replace the "service dnsmasq restart" in edithosts.sh with "kill -s
> 1" on the router VM, you'll start seeing these log messages when a VM is
> destroyed and re-allocated:
>
> dnsmasq-dhcp[pid]: not using configured address 192.168.1.100 because it is
> leased to aa:bb:cc:11:22:33
> dnsmasq-dhcp[pid]: DHCPDISCOVER(eth0) aa:bb:cc:22:33:44 no address
> available
>
>
>
>
> On Tue, Apr 30, 2013 at 10:10 PM, Marcus Sorensen  >wrote:
>
> > that's strange, because the dnsmasq man page explicitly calls out the
> > SIGHUP as a way to reconfigure DHCP hosts entries from a --dhcp-hostsfile
> > parameter. Or are these not the same thing?
> >
> >
> > On Tue, Apr 30, 2013 at 5:52 PM, Chiradeep Vittal <
> > chiradeep.vit...@citrix.com> wrote:
> >
> > >
> > >
> > > On 4/30/13 3:26 PM, "Dennis Lawler"  wrote:
> > >
> > > >Every time a new VM is started up, there is a 2 second outage in DNS
> > > >services that can cause problems in guest VMs that use the router VM
> for
> > > >DNS.
> > > >
> > > >
> > > >
> > > >For Cloudstack configurations using both DHCP and DNS services on the
> > > >router
> > > >VM (both implemented with dnsmasq), there is currently a 2 second DNS
> > > >service outage every time a new VM is instantiated
> > > >
> > > >
> > > >
> > > >The source of this outage is in edithosts.sh, which uses "service
> > dnsmasq
> > > >restart" to pick up the freshly added DNS and DHCP entries.
> > > >
> > > >Restarting the dnsmasq service triggers a sleep for 2 seconds after
> > > >killing
> > > >dnsmasq before starting it back up again.
> > > >
> > > >
> > > >
> > > >An obvious solution would be to replace "service dnsmasq restart" with
> > > >"kill
> > > >-s 1 $pid" (SIGHUP) so that dnsmasq reads the new DHCP entries without
> > > >restarting, as in dnsmasq_edithosts.sh (external dhcp).
> > > >
> > > >
> > > >Unfortunately, this solution is flawed because dnsmasq SIGHUP handling
> > > >does
> > > >not expire in-memory DHCP leases in dnsmasq and all leases are
> infinite
> > by
> > > >default.
> > >
> > > Aha! That's why SIGHUP didn't work consistently. This has been bugging
> me
> > > for a long time.
> > >
> > > >Thus, this will only work if the guest VM performs a DHCP release on
> > > >shutdown, which cannot always be guaranteed.
> > > >
> > > >
> > > >
> > > >A few possible solutions off the top of my head:
> > > >
> > > >1.   Separate DNS and DHCP services.  While DHCP services still
> > > >experience an outage during VM,  DNS will not necessarily be impacted
> if
> > > >implemented correctly.
> > > >
> > > >2.   Use SIGHUP with dnsmasq and implement a removeDhcpEntry
> > interface
> > > >for network appliances to force a DHCP release whenever a NIC / IP is
> > > >deallocated.  This can use dhcp_release to simulate a DHCP release on
> > the
> > > >router VM.
> > > >Catch: dhcp_release is not available for Debian 6.0.  The System VM
> > needs
> > > >to
> > > >be updated to at least Debian 7.0, or the dnsmasq-tools .deb from 7.0
> > > >would
> > > >need to be included in the System VM image.
> > >
> > > There is going to be a new system vm based on 7.0 for the upcoming
> > > release. This should work with earlier releases as well.
> > > https://cwiki.apache.org/confluence/x/UlHVAQ
> > >
> > > >
> > > >3.   Change DHCP to have a shorter lease, track de-allocation of
> IPs
> > > >separately from VM destruction.
> > > >Catch: This may cause occasional IP pool exhaustion depending on
> > > >allocation
> > > >of the guest IP range and the rate of VM destruction / instantiation
> in
> > > >the
> > > >network.
> > > >
> > > >
> > > >
> > > >Thoughts?
> > > >
> > >
> > >
> >
>


Re: Review Request: Remove filterwin2k from virtual router default config

2013-05-01 Thread Dennis Lawler

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10843/
---

(Updated May 1, 2013, 4:47 p.m.)


Review request for cloudstack and Frank Zhang.


Changes
---

Missed vpcdnsmasq.conf in original patch.


Description
---

Commenting out filterwin2k.

Should this be pushed back as a patch for older branches as well?


This addresses bugs CLOUDSTACK-2224 and CLOUDSTACK-282.


Diffs (updated)
-

  patches/systemvm/debian/config/etc/dnsmasq.conf 7d656cb 
  patches/systemvm/debian/config/etc/vpcdnsmasq.conf 3717fc8 

Diff: https://reviews.apache.org/r/10843/diff/


Testing
---

Verified in local environment that SRV records are accessible, enabling Windows 
KMS services.


Thanks,

Dennis Lawler



Re: New Committer: Clayton Weise

2013-05-01 Thread Min Chen
Congratulations, Clayton.

On 4/30/13 9:53 AM, "Chip Childers"  wrote:

>The Project Management Committee (PMC) for Apache CloudStack
>has asked Clayton Weise to become a committer and we are pleased to
>announce that he has accepted.
>
>Clayton is exceptionally active on the #cloudstack IRC channel, helping
>users with all sorts of questions and support topics.  He's also been
>active on the user list in a similar capacity.
>
>Being a committer allows many contributors to contribute more
>autonomously. For developers, it makes it easier to submit changes and
>eliminates the need to have contributions reviewed via the patch
>submission process. Whether contributions are development-related or
>otherwise, it is a recognition of a contributor's participation in the
>project and commitment to the project and the Apache Way.
>
>Please join me in congratulating Clayton!
>
>--Chip Childers
>on behalf of the CloudStack PMC



Re: Review Request: Remove filterwin2k from virtual router default config

2013-05-01 Thread Dennis Lawler

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10843/
---

(Updated May 1, 2013, 4:16 p.m.)


Review request for cloudstack and Frank Zhang.


Description
---

Commenting out filterwin2k.

Should this be pushed back as a patch for older branches as well?


This addresses bugs CLOUDSTACK-2224 and CLOUDSTACK-282.


Diffs
-

  patches/systemvm/debian/config/etc/dnsmasq.conf 7d656cb 

Diff: https://reviews.apache.org/r/10843/diff/


Testing
---

Verified in local environment that SRV records are accessible, enabling Windows 
KMS services.


Thanks,

Dennis Lawler



Review Request: CLOUDSTACK-2178 : "Add guest network" button is not responding

2013-05-01 Thread Isaac Chiang

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10882/
---

Review request for cloudstack and Pranav Saxena.


Description
---

The root cause of the issue is that the makeForm function in dialog.js cannot 
work with dependsOn field correctly.

Changed :
1. Dialog.js : Modify makeForm function in Dialog.js to work correctly with 
"dependsOn" field.
2. Network.js : Add checking for response in the call back function.


This addresses bug CLOUDSTACK-2178.


Diffs
-

  ui/scripts/network.js 9ba725a 
  ui/scripts/ui/dialog.js bb372fb 

Diff: https://reviews.apache.org/r/10882/diff/


Testing
---

Test from ui ans work well


Thanks,

Isaac Chiang



RE: startup slow after changing api

2013-05-01 Thread Daan Hoogland
I noticed this change in startup time is mainly noticeable in the debugger. I 
made a patch for review. I am puzzled as the change seems trivial:

diff --git a/api/src/com/cloud/network/NetworkService.java 
b/api/src/com/cloud/network/NetworkService.java
old mode 100755
new mode 100644
index 22f1502..c3850c3
--- a/api/src/com/cloud/network/NetworkService.java
+++ b/api/src/com/cloud/network/NetworkService.java
@@ -148,13 +148,14 @@
  * @param netmask
  * @param networkOwnerId
  * @param vpcId TODO
+ * @param networkOffering
  * @return
  * @throws InsufficientCapacityException
  * @throws ConcurrentOperationException
  * @throws ResourceAllocationException
  */
 Network createPrivateNetwork(String networkName, String displayText, long 
physicalNetworkId, String broadcastUri,
-String startIp, String endIP, String gateway, String netmask, long 
networkOwnerId, Long vpcId)
+String startIp, String endIP, String gateway, String netmask, long 
networkOwnerId, Long vpcId, String networkOffering)
 throws ResourceAllocationException, 
ConcurrentOperationException, InsufficientCapacityException;
 
 /* Requests an IP address for the guest nic */
diff --git a/api/src/com/cloud/network/vpc/VpcService.java 
b/api/src/com/cloud/network/vpc/VpcService.java
index 07ce89b..d8c7396 100644
--- a/api/src/com/cloud/network/vpc/VpcService.java
+++ b/api/src/com/cloud/network/vpc/VpcService.java
@@ -165,18 +165,19 @@
  * 
  * @param vpcId TODO
  * @param physicalNetworkId
- * @param vlan
+ * @param broadcastUri
  * @param ipAddress
  * @param gateway
  * @param netmask
  * @param gatewayOwnerId
+ * @param networkOffering
  * @return
  * @throws InsufficientCapacityException
  * @throws ConcurrentOperationException
  * @throws ResourceAllocationException
  */
-public PrivateGateway createVpcPrivateGateway(long vpcId, Long 
physicalNetworkId, String vlan, String ipAddress,
-String gateway, String netmask, long gatewayOwnerId) throws 
ResourceAllocationException,
+public PrivateGateway createVpcPrivateGateway(long vpcId, Long 
physicalNetworkId, String broadcastUri, String ipAddress,
+String gateway, String netmask, long gatewayOwnerId, String 
networkOffering) throws ResourceAllocationException,
 ConcurrentOperationException, InsufficientCapacityException;
 
 /**
diff --git a/api/src/org/apache/cloudstack/api/ApiConstants.java 
b/api/src/org/apache/cloudstack/api/ApiConstants.java
old mode 100755
new mode 100644
index 1165c7b..c266d78
--- a/api/src/org/apache/cloudstack/api/ApiConstants.java
+++ b/api/src/org/apache/cloudstack/api/ApiConstants.java
@@ -237,6 +237,7 @@
 public static final String PAGE_SIZE = "pagesize";
 public static final String COUNT = "count";
 public static final String TRAFFIC_TYPE = "traffictype";
+public static final String NETWORK_OFFERING_NAME = "networkoffering";
 public static final String NETWORK_OFFERING_ID = "networkofferingid";
 public static final String NETWORK_IDS = "networkids";
 public static final String NETWORK_ID = "networkid";
diff --git 
a/api/src/org/apache/cloudstack/api/command/admin/vpc/CreatePrivateGatewayCmd.java
 
b/api/src/org/apache/cloudstack/api/command/admin/vpc/CreatePrivateGatewayCmd.java
index 9da572d..014d053 100644
--- 
a/api/src/org/apache/cloudstack/api/command/admin/vpc/CreatePrivateGatewayCmd.java
+++ 
b/api/src/org/apache/cloudstack/api/command/admin/vpc/CreatePrivateGatewayCmd.java
@@ -69,6 +69,9 @@
 required=true, description="the VPC network belongs to")
 private Long vpcId;
 
+@Parameter(name=ApiConstants.NETWORK_OFFERING_NAME, 
type=CommandType.STRING, description="the name of the network offering to use 
for the private gateways network connection")
+private String networkOffering;
+
 /
 /// Accessors ///
 /
@@ -97,6 +100,10 @@
 return vpcId;
 }
 
+public String getNetworkOffering() {
+   return networkOffering;
+   }
+
 /
 /// API Implementation///
 /
@@ -111,7 +118,7 @@
 PrivateGateway result = null;
 try {
 result = _vpcService.createVpcPrivateGateway(getVpcId(), 
getPhysicalNetworkId(),
-getBroadcastUri(), getStartIp(), getGateway(), 
getNetmask(), getEntityOwnerId());
+getBroadcastUri(), getStartIp(), getGateway(), 
getNetmask(), getEntityOwnerId(), getNetworkOffering());
 } catch (InsufficientCapacityException ex){
 s_logger.info(ex);
 s_logger.trace(ex);
@@ -129,7 +136,7 @@
 }
 }
 

Re: Virtual Router: DHCP and 2-second DNS outages

2013-05-01 Thread Dennis Lawler
It does reconfigure the available leases for new IP allocations.  It just
doesn't expire the leases it has already handed out.

If you replace the "service dnsmasq restart" in edithosts.sh with "kill -s
1" on the router VM, you'll start seeing these log messages when a VM is
destroyed and re-allocated:

dnsmasq-dhcp[pid]: not using configured address 192.168.1.100 because it is
leased to aa:bb:cc:11:22:33
dnsmasq-dhcp[pid]: DHCPDISCOVER(eth0) aa:bb:cc:22:33:44 no address available




On Tue, Apr 30, 2013 at 10:10 PM, Marcus Sorensen wrote:

> that's strange, because the dnsmasq man page explicitly calls out the
> SIGHUP as a way to reconfigure DHCP hosts entries from a --dhcp-hostsfile
> parameter. Or are these not the same thing?
>
>
> On Tue, Apr 30, 2013 at 5:52 PM, Chiradeep Vittal <
> chiradeep.vit...@citrix.com> wrote:
>
> >
> >
> > On 4/30/13 3:26 PM, "Dennis Lawler"  wrote:
> >
> > >Every time a new VM is started up, there is a 2 second outage in DNS
> > >services that can cause problems in guest VMs that use the router VM for
> > >DNS.
> > >
> > >
> > >
> > >For Cloudstack configurations using both DHCP and DNS services on the
> > >router
> > >VM (both implemented with dnsmasq), there is currently a 2 second DNS
> > >service outage every time a new VM is instantiated
> > >
> > >
> > >
> > >The source of this outage is in edithosts.sh, which uses "service
> dnsmasq
> > >restart" to pick up the freshly added DNS and DHCP entries.
> > >
> > >Restarting the dnsmasq service triggers a sleep for 2 seconds after
> > >killing
> > >dnsmasq before starting it back up again.
> > >
> > >
> > >
> > >An obvious solution would be to replace "service dnsmasq restart" with
> > >"kill
> > >-s 1 $pid" (SIGHUP) so that dnsmasq reads the new DHCP entries without
> > >restarting, as in dnsmasq_edithosts.sh (external dhcp).
> > >
> > >
> > >Unfortunately, this solution is flawed because dnsmasq SIGHUP handling
> > >does
> > >not expire in-memory DHCP leases in dnsmasq and all leases are infinite
> by
> > >default.
> >
> > Aha! That's why SIGHUP didn't work consistently. This has been bugging me
> > for a long time.
> >
> > >Thus, this will only work if the guest VM performs a DHCP release on
> > >shutdown, which cannot always be guaranteed.
> > >
> > >
> > >
> > >A few possible solutions off the top of my head:
> > >
> > >1.   Separate DNS and DHCP services.  While DHCP services still
> > >experience an outage during VM,  DNS will not necessarily be impacted if
> > >implemented correctly.
> > >
> > >2.   Use SIGHUP with dnsmasq and implement a removeDhcpEntry
> interface
> > >for network appliances to force a DHCP release whenever a NIC / IP is
> > >deallocated.  This can use dhcp_release to simulate a DHCP release on
> the
> > >router VM.
> > >Catch: dhcp_release is not available for Debian 6.0.  The System VM
> needs
> > >to
> > >be updated to at least Debian 7.0, or the dnsmasq-tools .deb from 7.0
> > >would
> > >need to be included in the System VM image.
> >
> > There is going to be a new system vm based on 7.0 for the upcoming
> > release. This should work with earlier releases as well.
> > https://cwiki.apache.org/confluence/x/UlHVAQ
> >
> > >
> > >3.   Change DHCP to have a shorter lease, track de-allocation of IPs
> > >separately from VM destruction.
> > >Catch: This may cause occasional IP pool exhaustion depending on
> > >allocation
> > >of the guest IP range and the rate of VM destruction / instantiation in
> > >the
> > >network.
> > >
> > >
> > >
> > >Thoughts?
> > >
> >
> >
>


Re: version of cloudmonkey

2013-05-01 Thread Sebastien Goasguen


On 1 May 2013, at 15:47, Marcus Sorensen  wrote:

> I noticed that the documentation doesn't quite match up with cloudmonkey as
> installed via tools/cli, nor does it match the tarball. It seems to be
> missing 'set display', among other things, and the asyncblock never
> returns, in either version, long after the job is finished.

Marcus, i noticed the asyncblock issue the other day as well but did not have 
time to investigate whether it was a bug or not.

startup slow after changing api

2013-05-01 Thread Daan Hoogland
LS,

I experimented with adding an parameter to the api call 
createVpcPrivateGateway. I added an optional network offering name. After this 
the startup time got tens of minutes slower in my eclipse env. I stashed my 
change away and so where these awful minutes. Is there something to keep in 
mind when extending the api, something that need regenerated extra with respect 
to 'mvn clean test install'?

Note: I did add handling code to the implementation in VpcManagerImpl and 
NetworkManagerImpl.

Thanks for any pointers,
Daan Hoogland


version of cloudmonkey

2013-05-01 Thread Marcus Sorensen
I noticed that the documentation doesn't quite match up with cloudmonkey as
installed via tools/cli, nor does it match the tarball. It seems to be
missing 'set display', among other things, and the asyncblock never
returns, in either version, long after the job is finished.


RE: [MERGE] Dedicate guest vlan ranges to account

2013-05-01 Thread Hugo Trippaers
Likitha,

Couple of remarks on the merge request:

I think the calls you added to the system should fail with an informative error 
message if the physical network does not have the isolation type VLAN, as your 
code is only usable in networks with VLAN style isolation.

Can you double check your formatting and line endings of the new files? For 
example DedicateGuestVlanRangeCmd.java seems to have windows style line endings.

 I also noticed some files with changed permissions (from 644 to 755) (in one 
case without any changes in the file itself).  Can you fix that? Permissions 
should be 644 for java code.

Cheers,

Hugo

> -Original Message-
> From: Likitha Shetty [mailto:likitha.she...@citrix.com]
> Sent: Wednesday, May 01, 2013 12:39 PM
> To: dev@cloudstack.apache.org
> Subject: [MERGE] Dedicate guest vlan ranges to account
> 
> Hi all,
> 
> I would like to merge the feature Dedicate Guest VLAN range to master.
> 
> Jira ticket - https://issues.apache.org/jira/browse/CLOUDSTACK-704
> FS - https://cwiki.apache.org/confluence/display/CLOUDSTACK/FS-
> +Dedicate+Guest+VLANs+per+tenant
> Branch - dedicate-guest-vlan-ranges_2 (was developed in branch dedicate-
> guest-vlan-ranges) Unit tests -  Unit tests for the new API's can be found at
> server/test/com/cloud/network/DedicateGuestVlanRangesTest.java
> Integration tests - Python tests can be found be found at
> test/integration/smoke/test_guest_vlan_range.py
> Rebased the branch with master - Commit id:
> 807ad0a39ab272a4af2de3156b0b367570acccea
> RAT - RAT build is successful and no new dependencies introduced
> 
> Thanks,
> Likitha


[MERGE] Dedicate guest vlan ranges to account

2013-05-01 Thread Likitha Shetty
Hi all,

I would like to merge the feature Dedicate Guest VLAN range to master.

Jira ticket - https://issues.apache.org/jira/browse/CLOUDSTACK-704 
FS - 
https://cwiki.apache.org/confluence/display/CLOUDSTACK/FS-+Dedicate+Guest+VLANs+per+tenant
 
Branch - dedicate-guest-vlan-ranges_2 (was developed in branch 
dedicate-guest-vlan-ranges)
Unit tests -  Unit tests for the new API's can be found at 
server/test/com/cloud/network/DedicateGuestVlanRangesTest.java
Integration tests - Python tests can be found be found at 
test/integration/smoke/test_guest_vlan_range.py
Rebased the branch with master - Commit id: 
807ad0a39ab272a4af2de3156b0b367570acccea
RAT - RAT build is successful and no new dependencies introduced

Thanks,
Likitha


Re: Review Request: CLOUDSTACK-2085: VM weight on xen remain same as before vmscaleup

2013-05-01 Thread Abhinandan Prateek

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10881/#review20002
---


Double check on the Xen versions/license that could support this feature for 
rest you need to flag an error.

- Abhinandan Prateek


On May 1, 2013, 10:18 a.m., Harikrishna Patnala wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/10881/
> ---
> 
> (Updated May 1, 2013, 10:18 a.m.)
> 
> 
> Review request for cloudstack, Abhinandan Prateek and Nitin Mehta.
> 
> 
> Description
> ---
> 
> CLOUDSTACK-2085: VM weight on xen remain same as before vmscaleup ;because 
> "Add-To-VCPUs-Params-Live.sh" is not getting copied on xs host 
> Fix: created entry for script "Add-To-VCPUs-Params-Live.sh" in the patch 
> files that has entries to copy scipts on xenserver.
> 
> 
> This addresses bug CLOUDSTACK-2085.
> 
> 
> Diffs
> -
> 
>   
> plugins/hypervisors/xen/src/com/cloud/hypervisor/xen/resource/CitrixResourceBase.java
>  46ae35a 
>   scripts/vm/hypervisor/xenserver/xcpserver/patch b7961bb 
>   scripts/vm/hypervisor/xenserver/xenserver56/patch 36dba3d 
>   scripts/vm/hypervisor/xenserver/xenserver56fp1/patch d20e60f 
>   scripts/vm/hypervisor/xenserver/xenserver60/patch c9125f4 
> 
> Diff: https://reviews.apache.org/r/10881/diff/
> 
> 
> Testing
> ---
> 
> Tested locally by scaling up the vm and checked that VCPU param got updated 
> with new weight. 
> 
> 
> Thanks,
> 
> Harikrishna Patnala
> 
>



Review Request: CLOUDSTACK-2085: VM weight on xen remain same as before vmscaleup

2013-05-01 Thread Harikrishna Patnala

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10881/
---

Review request for cloudstack, Abhinandan Prateek and Nitin Mehta.


Description
---

CLOUDSTACK-2085: VM weight on xen remain same as before vmscaleup ;because 
"Add-To-VCPUs-Params-Live.sh" is not getting copied on xs host 
Fix: created entry for script "Add-To-VCPUs-Params-Live.sh" in the patch files 
that has entries to copy scipts on xenserver.


This addresses bug CLOUDSTACK-2085.


Diffs
-

  
plugins/hypervisors/xen/src/com/cloud/hypervisor/xen/resource/CitrixResourceBase.java
 46ae35a 
  scripts/vm/hypervisor/xenserver/xcpserver/patch b7961bb 
  scripts/vm/hypervisor/xenserver/xenserver56/patch 36dba3d 
  scripts/vm/hypervisor/xenserver/xenserver56fp1/patch d20e60f 
  scripts/vm/hypervisor/xenserver/xenserver60/patch c9125f4 

Diff: https://reviews.apache.org/r/10881/diff/


Testing
---

Tested locally by scaling up the vm and checked that VCPU param got updated 
with new weight. 


Thanks,

Harikrishna Patnala



Re: Review Request: CLOUDSTACK-741: Granular Global Parameters

2013-05-01 Thread ASF Subversion and Git Services

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10548/#review20001
---


Commit 807ad0a39ab272a4af2de3156b0b367570acccea in branch refs/heads/master 
from Nitin Mehta 
[ https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;h=807ad0a ]

CLOUDSTACK-741 - Making storage disable thresholds configurable at zone level.


- ASF Subversion and Git Services


On April 19, 2013, 4:07 a.m., Harikrishna Patnala wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/10548/
> ---
> 
> (Updated April 19, 2013, 4:07 a.m.)
> 
> 
> Review request for cloudstack, Abhinandan Prateek, Kishan Kavala, and Nitin 
> Mehta.
> 
> 
> Description
> ---
> 
> CLOUDSTACK-741: Granular Global Parameters
> 
> Modified UpdateConfiguration API and ListConfiguration API by adding 
> additional parameter scope and resource id (zone/cluster/pool/account).
> Scope decides the parameter which level we can update the value and id is the 
> corresponding id based on the scope.
> This scope is defined in the config.java file where we are creating groups 
> for each level(zone/cluster/pool/account).
> Currently submitted the patch for the zone level parameter use.external.dns.
> 
> Included unit tests and marvin tests.
> 
> 
> This addresses bug CLOUDSTACK-741.
> 
> 
> Diffs
> -
> 
>   api/src/org/apache/cloudstack/api/command/admin/config/ListCfgsByCmd.java 
> aabfd4a 
>   api/src/org/apache/cloudstack/api/command/admin/config/UpdateCfgCmd.java 
> ffeb586 
>   api/src/org/apache/cloudstack/api/response/ConfigurationResponse.java 
> 95b8af2 
>   api/test/org/apache/cloudstack/api/command/test/ListCfgCmdTest.java 
> PRE-CREATION 
>   api/test/org/apache/cloudstack/api/command/test/UpdateCfgCmdTest.java 
> PRE-CREATION 
>   
> engine/api/src/org/apache/cloudstack/storage/datastore/db/StoragePoolDetailsDao.java
>  be71670 
>   server/src/com/cloud/configuration/Config.java 2993966 
>   server/src/com/cloud/configuration/ConfigurationManager.java afaf0d6 
>   server/src/com/cloud/configuration/ConfigurationManagerImpl.java 4fc2db7 
>   server/src/com/cloud/configuration/dao/ConfigurationDao.java c86c024 
>   server/src/com/cloud/network/router/VirtualNetworkApplianceManagerImpl.java 
> ab91059 
>   server/src/com/cloud/server/ConfigurationServer.java f441b1f 
>   server/src/com/cloud/server/ConfigurationServerImpl.java c4da1ab 
>   server/src/com/cloud/server/ManagementServerImpl.java 98f789a 
>   server/src/com/cloud/storage/dao/StoragePoolDetailsDaoImpl.java 0d797ed 
>   server/test/com/cloud/vpc/MockConfigurationManagerImpl.java 9443815 
>   test/integration/smoke/test_UpdateCfg.py PRE-CREATION 
> 
> Diff: https://reviews.apache.org/r/10548/diff/
> 
> 
> Testing
> ---
> 
> Tested locally
> - tested the modified UpdateConfiguration API and ListConfiguration API by 
> providing the zone scope and zone id
> - tested the modified parameter to take the updated value at zone level(after 
> updation).
> 
> 
> Thanks,
> 
> Harikrishna Patnala
> 
>



Re: Review Request: CLOUDSTACK-741 global granular parameters and CLOUDSTACK-2036 router template Id

2013-05-01 Thread ASF Subversion and Git Services

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10862/#review2
---


Commit 807ad0a39ab272a4af2de3156b0b367570acccea in branch refs/heads/master 
from Nitin Mehta 
[ https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;h=807ad0a ]

CLOUDSTACK-741 - Making storage disable thresholds configurable at zone level.


- ASF Subversion and Git Services


On April 30, 2013, 1:42 p.m., Harikrishna Patnala wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/10862/
> ---
> 
> (Updated April 30, 2013, 1:42 p.m.)
> 
> 
> Review request for cloudstack, Abhinandan Prateek and Nitin Mehta.
> 
> 
> Description
> ---
> 
> CLOUDSTACK-741: Granular Global Parameters Added parameters
>  to cluster level
>  cluster.storage.allocated.capacity.notificationthreshold
>  cluster.storage.capacity.notificationthreshold
> 
> CLOUDSTACK-2036
> global parameter for Router Template ID functionality added
> We use 5 parameters to set the router template name for each hypervisor
> 
> Moved cpu.overprovisioning.factor and mem.overprovisioning.factor to be able 
> to update/list using update/list configuration API at cluster level
> 
> 
> This addresses bugs CLOUDSTACK-2036 and CLOUDSTACK-741.
> 
> 
> Diffs
> -
> 
>   server/src/com/cloud/alert/AlertManagerImpl.java 6839d44 
>   server/src/com/cloud/configuration/Config.java af6adcf 
>   server/src/com/cloud/configuration/ConfigurationManagerImpl.java 068a586 
>   server/src/com/cloud/dc/ClusterDetailsDaoImpl.java 4c85918 
>   server/src/com/cloud/network/router/VirtualNetworkApplianceManagerImpl.java 
> 4c7bc75 
>   server/src/com/cloud/storage/dao/VMTemplateDao.java 3f1fe93 
>   server/src/com/cloud/storage/dao/VMTemplateDaoImpl.java 3b37f24 
>   test/integration/smoke/test_global_settings.py ec18cea 
> 
> Diff: https://reviews.apache.org/r/10862/diff/
> 
> 
> Testing
> ---
> 
> Tested locally
> 
> 
> Thanks,
> 
> Harikrishna Patnala
> 
>



[GSOC] Deadline for proposal is May 3rd !!!

2013-05-01 Thread Sebastien Goasguen
Hi,

Deadline for student proposal is May 3rd (this coming Friday).

Make sure you get your proposal in. You don't need to have all the answers, it 
is better to show how you understand the project and how you plan to tackle it. 
The community will help you iron things out as your progress.

I will be off-line for couple days unfortunately, but folks will help you if 
you have questions. 

Do submit the proposals :)

Cheers,

-Sebastien

Re: [GSoC][Proposal] Integration project to deploy and use Mesos on a CloudStack based cloud

2013-05-01 Thread Sebastien Goasguen

On Apr 30, 2013, at 4:59 PM, Chiradeep Vittal  
wrote:

> 
> 
> On 4/30/13 5:01 AM, "Sebastien Goasguen"  wrote:
> 
>> Dharmesh, see in-line
>> 
>> On Apr 30, 2013, at 5:34 AM, Dharmesh Kakadia  wrote:
>> 
>>> Hi,
>>> 
>>> I am Dharmesh Kakdia and interested in project "Integration project to
>>> deploy and use Mesos on a CloudStack based cloud" (
>>> https://issues.apache.org/jira/browse/CLOUDSTACK-1784)
>>> 
>>> I am working on proposal and want to get feedback. Please provide
>>> suggestions :)
>>> 
>>> *
>>> 
>>> Abstract:
>>> 
>>> The project aims to bring cloudformation[1] like service to cloudstack.
>>> One
>>> of the prime use-case is cluster computing frameworks on cloudstack. A
>>> cloudformation service will give users and administrators of cloudstack
>>> ability to manage and control a set of resources easily. The
>>> cloudformation
>>> will allow booting and configuring a set of VMs and form a cluster.
>>> Simple
>>> example would be LAMP stack. More complex clusters such as mesos or
>>> hadoop
>>> cluster requires a little more advanced configuration. There is already
>>> some work done by Chiradeep Vittal at this front [5] using route and
>> 
>> it's using ruote: http://ruote.rubyforge.org
>> 
>>> sinatra. In this project, I will implement cloudformation service and
>>> demonstrate how to run mesos cluster using it.
>> 
>> You will create cloud formation templates that describe a mesos cluster
>> 
>>> 
>>> Mesos:
>>> 
>>> Mesos is a resource management platform for clusters [2]. It aims to
>>> increase resource utilization of clusters by sharing cluster resources
>>> among multiple processing frameworks(like MapReduce, MPI, Graph
>>> Processing)
>>> or multiple instances of same framework. It provides efficient resource
>>> isolation through use of containers. Uses zookeeper for state
>>> maintenance
>>> and fault tolerance.
>>> 
>>> What can run on mesos ?
>>> 
>>> Spark: A cluster computing framework based on the Resilient Distributed
>>> Datasets (RDDs) abstraction. RDD is more generalized than MapReduce and
>>> can
>>> support iterative and interactive computation while retaining fault
>>> tolerance, scalability, data locality etc.
>>> 
>>> Hadoop: Hadoop is fault tolerant and scalable distributed computing
>>> framework based on MapReduce abstraction.
>>> 
>>> Begel: A graph processing framework based on pregel.
>>> 
>>> and other frameworks like MPI, Hypertable.
>>> 
>>> How to deploy mesos
>>> 
>>> Mesos provides cluster installation scripts [7] for cluster deployment.
>>> There are also scripts available to deploy a cluster on Amazon EC2 [8].
>> 
>> It would be nice to see if these scripts can be used as is with the
>> CloudStack EC2 service.
>> 
>>> 
>>> Deliverables:
>>> 
>>> 1. Cloudformation service implementation on cloudstack.
>>> 
>>> 2. Integration of cloudformation with cloudmonkey, CLI tool.
>> 
>> 2. is a little confusing. I believe that what Chiradeep prototype runs on
>> the client side. What is needed is a server side implementation.
>> That way we could use existing cloudformation cli tools to talk to it.
>> I don't understand where cloudmonkey comes into play. CloudMonkey is a
>> cli for the CloudStack API. Unless you plan to integrate the
>> cloudformation API directly in the cloudstack source code, the
>> integration you propose is not clear to me.
>> 
> 
> Sebastien is correct. I intend to put in the query API server around the
> core of stack mate soon (as soon as I'm done helping on the internal
> loadbalancer). This will be written in Ruby.
> 
> 

Dharmesh I suggest you propose the following:

1-Deploy CloudStack and understand instance configuration/contextualization
2-Test and deploy Mesos on a set of CloudStack based VM, manually. 
Design/propose an automation framework.
3-Test stackmate and engage chiradeep (report bugs, make suggestion, make pull 
request)
4-Create cloud formation template to provision a Mesos Cluster
5-Compare with Apache Whirr or other cluster provisioning tools.
6-Potentially if you see a link with cloudmonkey, see how you could extend it 
to talk to stackmate in a similar manner that it talks to CloudStack.


You are pretty close and this is a very exciting projects, so go ahead, modify 
a bit your proposal and submit it.

Deadline for applications is this Friday May 3rd.

-sebastien





Re: Review Request: CLOUDSTACK-741 global granular parameters and CLOUDSTACK-2036 router template Id

2013-05-01 Thread ASF Subversion and Git Services

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10862/#review19998
---


Commit b16ccc9fa6c5dd05a3016e3b2e22ecdc3f06b1ef in branch refs/heads/master 
from Nitin Mehta 
[ https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;h=b16ccc9 ]

CLOUDSTACK-2036 - Adding storage storage.overprovisioning.factor configurable 
at zone level.


- ASF Subversion and Git Services


On April 30, 2013, 1:42 p.m., Harikrishna Patnala wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/10862/
> ---
> 
> (Updated April 30, 2013, 1:42 p.m.)
> 
> 
> Review request for cloudstack, Abhinandan Prateek and Nitin Mehta.
> 
> 
> Description
> ---
> 
> CLOUDSTACK-741: Granular Global Parameters Added parameters
>  to cluster level
>  cluster.storage.allocated.capacity.notificationthreshold
>  cluster.storage.capacity.notificationthreshold
> 
> CLOUDSTACK-2036
> global parameter for Router Template ID functionality added
> We use 5 parameters to set the router template name for each hypervisor
> 
> Moved cpu.overprovisioning.factor and mem.overprovisioning.factor to be able 
> to update/list using update/list configuration API at cluster level
> 
> 
> This addresses bugs CLOUDSTACK-2036 and CLOUDSTACK-741.
> 
> 
> Diffs
> -
> 
>   server/src/com/cloud/alert/AlertManagerImpl.java 6839d44 
>   server/src/com/cloud/configuration/Config.java af6adcf 
>   server/src/com/cloud/configuration/ConfigurationManagerImpl.java 068a586 
>   server/src/com/cloud/dc/ClusterDetailsDaoImpl.java 4c85918 
>   server/src/com/cloud/network/router/VirtualNetworkApplianceManagerImpl.java 
> 4c7bc75 
>   server/src/com/cloud/storage/dao/VMTemplateDao.java 3f1fe93 
>   server/src/com/cloud/storage/dao/VMTemplateDaoImpl.java 3b37f24 
>   test/integration/smoke/test_global_settings.py ec18cea 
> 
> Diff: https://reviews.apache.org/r/10862/diff/
> 
> 
> Testing
> ---
> 
> Tested locally
> 
> 
> Thanks,
> 
> Harikrishna Patnala
> 
>



Re: [EVENTS] Linux Tag Berlin May 22-25

2013-05-01 Thread Wido den Hollander

On 04/30/2013 02:32 PM, Sebastien Goasguen wrote:

Hi, [BCC users@]

I managed to get an Apache CloudStack booth at Linux Tag Berlin, May 22-25.

I need help to man the booth and talk about CloudStack. If you are interested 
please let me know asap so that I request an exhibitor badge for you.



I'd have to check. I see that I have an appointment at May 22nd, but I 
could maybe go to Berlin on the 23rd, but I'd have to check.


Wido


thanks,

-Sebastien





Re: Review Request: CLOUDSTACK-2180: restoreVirtualMachine returns no password if the template is password enabled

2013-05-01 Thread ASF Subversion and Git Services

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10772/#review19997
---


Commit 1cb9bd531f4eaaef3a99608ab77cba1851b37e42 in branch refs/heads/master 
from Abhinandan Prateek 
[ https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;h=1cb9bd5 ]

CLOUDSTACK-2180: restoreVirtualMachine returns no password if the template is 
password enabled

New password is generated as part of restore vm(passwd enabled template) and 
send new password on VR

Signed-off-by: Abhinandan Prateek 


- ASF Subversion and Git Services


On April 25, 2013, 9:05 a.m., Harikrishna Patnala wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/10772/
> ---
> 
> (Updated April 25, 2013, 9:05 a.m.)
> 
> 
> Review request for cloudstack, Abhinandan Prateek, Koushik Das, and Wei Zhou.
> 
> 
> Description
> ---
> 
> CLOUDSTACK-2180: restoreVirtualMachine returns no password
>  if the template is password enabled
> 
> New password is generated as part of restore vm(passwd enabled template) and 
> send new password on VR
> 
> 
> This addresses bug CLOUDSTACK-2180.
> 
> 
> Diffs
> -
> 
>   api/src/com/cloud/vm/UserVmService.java 7e89cd3 
>   server/src/com/cloud/vm/UserVmManagerImpl.java ebc5757 
>   server/test/com/cloud/vm/MockUserVmManagerImpl.java d886fd8 
>   server/test/com/cloud/vm/UserVmManagerTest.java e5e2ff2 
> 
> Diff: https://reviews.apache.org/r/10772/diff/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Harikrishna Patnala
> 
>