Review Request: Cloudstack-2644 [Multiple_IP_Ranges] user data service on VR does not work in case of multiple subnets Cloudstack-2953 [Multiple_IP_Ranges] VM does not get the public key from VR incas

[bharat kumar]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/11959/
---

Review request for cloudstack and Abhinandan Prateek.


Description
---

Cloudstack-2644 [Multiple_IP_Ranges] user data service on VR does not work in 
case of multiple subnets 
https://issues.apache.org/jira/browse/CLOUDSTACK-2644

Cloudstack-2953 [Multiple_IP_Ranges] VM does not get the public key from VR 
incase of multiple subnets per vlan Also removed some
 unused code.
https://issues.apache.org/jira/browse/CLOUDSTACK-2953


This addresses bugs Cloudstack-2644 and Cloudstack-2953.


Diffs
-

  patches/systemvm/debian/config/etc/init.d/cloud-early-config 0dcd571 
  server/src/com/cloud/network/router/VirtualNetworkApplianceManagerImpl.java 
8da5176 
  server/src/com/cloud/vm/dao/NicIpAliasDao.java f1e4b8e 
  server/src/com/cloud/vm/dao/NicIpAliasDaoImpl.java e6c52a2 
  setup/bindir/cloud-set-guest-sshkey.in 15008b8 

Diff: https://reviews.apache.org/r/11959/diff/


Testing
---

tested on master.


Thanks,

bharat kumar

Re: Review Request: Bugfix CLOUDSTACK-1594: Secondary storage host always remains Alert status

[roxanne chang]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/9818/
---

(Updated June 19, 2013, 6:50 a.m.)


Review request for cloudstack, Abhinandan Prateek, Nitin Mehta, and edison su.


Changes
---

add Nitin


Description
---

Bugfix CLOUDSTACK-1594: Secondary storage host always remains Alert status
[https://issues.apache.org/jira/browse/CLOUDSTACK-1594]

In file SecondarySotrageManagerImpl.java, function generateSetupCommand, if the 
host type is Secondary storage VM, the logic is to set secondarystorage host, 
at this time, secondarystorage host stauts should become Up.

The secondary storage host always remains Alert status, because before the 
secondary storage vm is deployed, the secondary storage host is created. The 
tricky way (in the end of file AgentManagerImpl.java, function 
NotifiMonitorsOfConnection) will try to disconnect secondary storage, therefore 
the secondary storage host becomes Alert status. The code should take SSVM into 
consider, not only Answer reponse.

File ResourceManagerImpl.java, function discoverHostsFull, in the end will call 
discoverer.postDiscovery, in file SecondarySotrageDiscover.postDiscovery, the 
condition _userServiceVM is not needed since its use to make secondary storage 
host wait for SSVM is already done in SecondaryStorageManagerImpl. This makes 
why secondary storage host always remains Alert status.


This addresses bug https://issues.apache.org/jira/browse/CLOUDSTACK-1594.


Diffs
-

  server/src/com/cloud/agent/manager/AgentManagerImpl.java 6baeecf 
  server/src/com/cloud/storage/secondary/SecondaryStorageManagerImpl.java 
c343286 
  
services/secondary-storage/src/org/apache/cloudstack/storage/resource/SecondaryStorageDiscoverer.java
 d3af792 

Diff: https://reviews.apache.org/r/9818/diff/


Testing
---

Test 4.0.0, 4.2.0 in basic mode, works well.


Thanks,

roxanne chang

Re: Review Request: CLOUDSATCK-1758: Update ssh key location for vmware

[Prasanna Santhanam]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/11956/#review22111
---

Ship it!


6e63bb7

- Prasanna Santhanam


On June 19, 2013, 6:31 a.m., Girish Shilamkar wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/11956/
> ---
> 
> (Updated June 19, 2013, 6:31 a.m.)
> 
> 
> Review request for cloudstack and Prasanna Santhanam.
> 
> 
> Description
> ---
> 
> Update ssh key location for vmware
> 
> 
> This addresses bug CLOUDSTACK-1758.
> 
> 
> Diffs
> -
> 
>   tools/marvin/marvin/integration/lib/utils.py 6892c41 
> 
> Diff: https://reviews.apache.org/r/11956/diff/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Girish Shilamkar
> 
>

Re: Review Request: Bugfix CLOUDSTACK-1594: Secondary storage host always remains Alert status

[roxanne chang]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/9818/
---

(Updated June 19, 2013, 6:45 a.m.)


Review request for cloudstack, Abhinandan Prateek and edison su.


Changes
---

update.


Description
---

Bugfix CLOUDSTACK-1594: Secondary storage host always remains Alert status
[https://issues.apache.org/jira/browse/CLOUDSTACK-1594]

In file SecondarySotrageManagerImpl.java, function generateSetupCommand, if the 
host type is Secondary storage VM, the logic is to set secondarystorage host, 
at this time, secondarystorage host stauts should become Up.

The secondary storage host always remains Alert status, because before the 
secondary storage vm is deployed, the secondary storage host is created. The 
tricky way (in the end of file AgentManagerImpl.java, function 
NotifiMonitorsOfConnection) will try to disconnect secondary storage, therefore 
the secondary storage host becomes Alert status. The code should take SSVM into 
consider, not only Answer reponse.

File ResourceManagerImpl.java, function discoverHostsFull, in the end will call 
discoverer.postDiscovery, in file SecondarySotrageDiscover.postDiscovery, the 
condition _userServiceVM is not needed since its use to make secondary storage 
host wait for SSVM is already done in SecondaryStorageManagerImpl. This makes 
why secondary storage host always remains Alert status.


This addresses bug https://issues.apache.org/jira/browse/CLOUDSTACK-1594.


Diffs (updated)
-

  server/src/com/cloud/agent/manager/AgentManagerImpl.java 6baeecf 
  server/src/com/cloud/storage/secondary/SecondaryStorageManagerImpl.java 
c343286 
  
services/secondary-storage/src/org/apache/cloudstack/storage/resource/SecondaryStorageDiscoverer.java
 d3af792 

Diff: https://reviews.apache.org/r/9818/diff/


Testing
---

Test 4.0.0, 4.2.0 in basic mode, works well.


Thanks,

roxanne chang

Re: Review Request: Bugfix CLOUDSTACK-1594: Secondary storage host always remains Alert status

[roxanne chang]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/9818/
---

(Updated June 19, 2013, 6:42 a.m.)


Review request for cloudstack, Abhinandan Prateek and edison su.


Changes
---

new patch to solve Secondary storage host always remains Alert status.


Description
---

Bugfix CLOUDSTACK-1594: Secondary storage host always remains Alert status
[https://issues.apache.org/jira/browse/CLOUDSTACK-1594]

In file SecondarySotrageManagerImpl.java, function generateSetupCommand, if the 
host type is Secondary storage VM, the logic is to set secondarystorage host, 
at this time, secondarystorage host stauts should become Up.

The secondary storage host always remains Alert status, because before the 
secondary storage vm is deployed, the secondary storage host is created. The 
tricky way (in the end of file AgentManagerImpl.java, function 
NotifiMonitorsOfConnection) will try to disconnect secondary storage, therefore 
the secondary storage host becomes Alert status. The code should take SSVM into 
consider, not only Answer reponse.

File ResourceManagerImpl.java, function discoverHostsFull, in the end will call 
discoverer.postDiscovery, in file SecondarySotrageDiscover.postDiscovery, the 
condition _userServiceVM is not needed since its use to make secondary storage 
host wait for SSVM is already done in SecondaryStorageManagerImpl. This makes 
why secondary storage host always remains Alert status.


This addresses bug https://issues.apache.org/jira/browse/CLOUDSTACK-1594.


Diffs
-

  server/src/com/cloud/agent/manager/AgentManagerImpl.java c1bbb58 
  server/src/com/cloud/storage/secondary/SecondaryStorageDiscoverer.java 
3ca74a3 
  server/src/com/cloud/storage/secondary/SecondaryStorageManagerImpl.java 
46ac7af 

Diff: https://reviews.apache.org/r/9818/diff/


Testing
---

Test 4.0.0, 4.2.0 in basic mode, works well.


Thanks,

roxanne chang

Re: [MERGE] disk_io_throttling to MASTER

[Mike Tutkowski]

I've started in on making Wei's feature and mine mutually exclusive.

We had talked about using radio buttons to do this in the GUI, but I don't
see radio buttons in use at present in the CS GUI.

Instead, I'm following the current paradigm in the GUI where a combo box
presents options to accomplish this. If you select the empty option, you
get neither Wei's fields nor mine. If you select 'hypervisor', you get
Wei's fields. If you select 'storage', you get mine. The combo box has the
name 'QoS Type' and has a tool tip.

This technique is working well and fits in nicely with how a similar
selection process happens on the Add Volume dialog via a combo box.

I don't have all of the code written at present, but it should be done
tomorrow (well...technically later today).

Talk to you later!


On Tue, Jun 18, 2013 at 6:05 PM, Mike Tutkowski <
mike.tutkow...@solidfire.com> wrote:

> OK, I've gone ahead and updated Review Board with a new diff.
>
> Please check it out and let me know what you think.
>
> Thanks!
>
>
> On Mon, Jun 17, 2013 at 2:52 PM, Mike Tutkowski <
> mike.tutkow...@solidfire.com> wrote:
>
>> Sounds good
>>
>> I have a little bit of clean-up work to do and then I must figure out how
>> to generate a patch (since I was using merge rather than rebase during
>> development), so it will probably be tomorrow.
>>
>>
>> On Mon, Jun 17, 2013 at 2:50 PM, John Burwell  wrote:
>>
>>> Mike,
>>>
>>> Great news.  Let me know when Review Board is updated, and I will
>>> perform a second round review.
>>>
>>> Thanks,
>>> -John
>>>
>>> On Jun 17, 2013, at 4:48 PM, Mike Tutkowski <
>>> mike.tutkow...@solidfire.com> wrote:
>>>
>>> > FYI: I added the IOPS-capacity parameter and related code over the
>>> weekend.
>>> >
>>> > The final bit of work for me comes when Wei's code is merged into
>>> master
>>> > and I pull it down.
>>> >
>>> > At that point, I need to add the GUI and API logic to support mutual
>>> > exclusion of our features.
>>> >
>>> >
>>> > On Sat, Jun 15, 2013 at 11:12 AM, Chip Childers
>>> > wrote:
>>> >
>>> >> On Fri, Jun 14, 2013 at 05:56:27PM -0400, John Burwell wrote:
>>> >>> Mike,
>>> >>>
>>> >>> Awesome.  +1.
>>> >>>
>>> >>> Thanks for your patience with the back and forth,
>>> >>> -John
>>> >>
>>> >> +1 - this now looks like a great approach.
>>> >>
>>> >
>>> >
>>> >
>>> > --
>>> > *Mike Tutkowski*
>>> > *Senior CloudStack Developer, SolidFire Inc.*
>>> > e: mike.tutkow...@solidfire.com
>>> > o: 303.746.7302
>>> > Advancing the way the world uses the
>>> > cloud
>>> > *™*
>>>
>>>
>>
>>
>> --
>> *Mike Tutkowski*
>>  *Senior CloudStack Developer, SolidFire Inc.*
>> e: mike.tutkow...@solidfire.com
>> o: 303.746.7302
>> Advancing the way the world uses the 
>> cloud
>> *™*
>>
>
>
>
> --
> *Mike Tutkowski*
> *Senior CloudStack Developer, SolidFire Inc.*
> e: mike.tutkow...@solidfire.com
> o: 303.746.7302
> Advancing the way the world uses the 
> cloud
> *™*
>



-- 
*Mike Tutkowski*
*Senior CloudStack Developer, SolidFire Inc.*
e: mike.tutkow...@solidfire.com
o: 303.746.7302
Advancing the way the world uses the
cloud
*™*

Review Request: CLOUDSATCK-1758: Update ssh key location for vmware

[Girish Shilamkar]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/11956/
---

Review request for cloudstack and Prasanna Santhanam.


Description
---

Update ssh key location for vmware


This addresses bug CLOUDSTACK-1758.


Diffs
-

  tools/marvin/marvin/integration/lib/utils.py 6892c41 

Diff: https://reviews.apache.org/r/11956/diff/


Testing
---


Thanks,

Girish Shilamkar

Re: Review Request: Fix for CLOUDSTACK-2987 Ensure XStools to be there in template inorder to enable dynamic scaling of vm

[Nitin Mehta]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/11910/#review22110
---



api/src/com/cloud/agent/api/to/VirtualMachineTO.java


is this not the same attribute ?



api/src/org/apache/cloudstack/api/BaseUpdateTemplateOrIsoCmd.java


is this only for template or isos as well ? if both change the comment



api/src/org/apache/cloudstack/api/command/user/vm/UpdateVMCmd.java


change the comment



engine/schema/src/com/cloud/storage/VMTemplateVO.java


dynamically scalable instead of scalable?



engine/storage/src/org/apache/cloudstack/storage/image/TemplateEntityImpl.java


TODO ?



plugins/hypervisors/xen/src/com/cloud/hypervisor/xen/resource/XenServer56FP1Resource.java


vmSpec.isEnableDynamicallyScaleVm() && 
details.get("isscalable").equals("true"))

Just one of them should do



server/src/com/cloud/vm/VirtualMachineManagerImpl.java


can u write a small utility function which fetches it from details table 
and does all this logic instead of muddling this function


- Nitin Mehta


On June 18, 2013, 7:05 a.m., Harikrishna Patnala wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/11910/
> ---
> 
> (Updated June 18, 2013, 7:05 a.m.)
> 
> 
> Review request for cloudstack, Abhinandan Prateek and Nitin Mehta.
> 
> 
> Description
> ---
> 
> CLOUDSTACK-2987 Ensure XStools to be there in template inorder to enable 
> dynamic scaling of vm 
> 
> CLOUDSTACK-3042 - handle Scaling up of vm memory/CPU based on the presence of 
> XS tools in the template
> This should also take care of updation of VM after XS tools are installed in 
> the vm and set memory values accordingly to support dynamic scaling after 
> stop start of VM
> 
> 
> This addresses bugs CLOUDSTACK-2987 and CLOUDSTACK-3042.
> 
> 
> Diffs
> -
> 
>   api/src/com/cloud/agent/api/to/VirtualMachineTO.java 46ee01b 
>   api/src/com/cloud/template/VirtualMachineTemplate.java cedc793 
>   api/src/org/apache/cloudstack/api/ApiConstants.java ab1402c 
>   api/src/org/apache/cloudstack/api/BaseUpdateTemplateOrIsoCmd.java 6fd9773 
>   api/src/org/apache/cloudstack/api/command/user/iso/RegisterIsoCmd.java 
> 284d553 
>   
> api/src/org/apache/cloudstack/api/command/user/template/RegisterTemplateCmd.java
>  c9da0c2 
>   api/src/org/apache/cloudstack/api/command/user/vm/UpdateVMCmd.java 2860283 
>   api/src/org/apache/cloudstack/api/response/TemplateResponse.java 896154a 
>   api/src/org/apache/cloudstack/api/response/UserVmResponse.java 1f9eb1a 
>   core/src/com/cloud/agent/api/ScaleVmCommand.java b361485 
>   engine/schema/src/com/cloud/storage/VMTemplateVO.java e643d75 
>   engine/schema/src/com/cloud/vm/VMInstanceVO.java fbe03dc 
>   
> engine/storage/src/org/apache/cloudstack/storage/image/TemplateEntityImpl.java
>  4d162bb 
>   plugins/hypervisors/xen/src/com/cloud/hypervisor/XenServerGuru.java 8c38a69 
>   
> plugins/hypervisors/xen/src/com/cloud/hypervisor/xen/resource/CitrixResourceBase.java
>  5e8283a 
>   
> plugins/hypervisors/xen/src/com/cloud/hypervisor/xen/resource/XenServer56FP1Resource.java
>  8e37809 
>   server/src/com/cloud/api/ApiResponseHelper.java 94c5d6c 
>   server/src/com/cloud/api/query/dao/UserVmJoinDaoImpl.java dbfe94d 
>   server/src/com/cloud/api/query/vo/UserVmJoinVO.java 8ad0fdd 
>   server/src/com/cloud/hypervisor/HypervisorGuruBase.java 1ad9a1f 
>   server/src/com/cloud/server/ManagementServerImpl.java 96c72e4 
>   server/src/com/cloud/storage/TemplateProfile.java 0b55f1f 
>   server/src/com/cloud/template/TemplateAdapter.java 9a2d877 
>   server/src/com/cloud/template/TemplateAdapterBase.java 0940d3e 
>   server/src/com/cloud/vm/UserVmManagerImpl.java 1c8ab75 
>   server/src/com/cloud/vm/VirtualMachineManagerImpl.java f946cd1 
>   server/test/com/cloud/vm/VirtualMachineManagerImplTest.java 8715c9e 
>   setup/db/db/schema-410to420.sql 272fc42 
> 
> Diff: https://reviews.apache.org/r/11910/diff/
> 
> 
> Testing
> ---
> 
> Tested locally
> 
> 
> Thanks,
> 
> Harikrishna Patnala
> 
>

Re: Review Request: Fix for CLOUDSTACK-2987 Ensure XStools to be there in template inorder to enable dynamic scaling of vm

[Abhinandan Prateek]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/11910/#review22108
---


Try to use final String instead of literals for better maintainability.

- Abhinandan Prateek


On June 18, 2013, 7:05 a.m., Harikrishna Patnala wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/11910/
> ---
> 
> (Updated June 18, 2013, 7:05 a.m.)
> 
> 
> Review request for cloudstack, Abhinandan Prateek and Nitin Mehta.
> 
> 
> Description
> ---
> 
> CLOUDSTACK-2987 Ensure XStools to be there in template inorder to enable 
> dynamic scaling of vm 
> 
> CLOUDSTACK-3042 - handle Scaling up of vm memory/CPU based on the presence of 
> XS tools in the template
> This should also take care of updation of VM after XS tools are installed in 
> the vm and set memory values accordingly to support dynamic scaling after 
> stop start of VM
> 
> 
> This addresses bugs CLOUDSTACK-2987 and CLOUDSTACK-3042.
> 
> 
> Diffs
> -
> 
>   api/src/com/cloud/agent/api/to/VirtualMachineTO.java 46ee01b 
>   api/src/com/cloud/template/VirtualMachineTemplate.java cedc793 
>   api/src/org/apache/cloudstack/api/ApiConstants.java ab1402c 
>   api/src/org/apache/cloudstack/api/BaseUpdateTemplateOrIsoCmd.java 6fd9773 
>   api/src/org/apache/cloudstack/api/command/user/iso/RegisterIsoCmd.java 
> 284d553 
>   
> api/src/org/apache/cloudstack/api/command/user/template/RegisterTemplateCmd.java
>  c9da0c2 
>   api/src/org/apache/cloudstack/api/command/user/vm/UpdateVMCmd.java 2860283 
>   api/src/org/apache/cloudstack/api/response/TemplateResponse.java 896154a 
>   api/src/org/apache/cloudstack/api/response/UserVmResponse.java 1f9eb1a 
>   core/src/com/cloud/agent/api/ScaleVmCommand.java b361485 
>   engine/schema/src/com/cloud/storage/VMTemplateVO.java e643d75 
>   engine/schema/src/com/cloud/vm/VMInstanceVO.java fbe03dc 
>   
> engine/storage/src/org/apache/cloudstack/storage/image/TemplateEntityImpl.java
>  4d162bb 
>   plugins/hypervisors/xen/src/com/cloud/hypervisor/XenServerGuru.java 8c38a69 
>   
> plugins/hypervisors/xen/src/com/cloud/hypervisor/xen/resource/CitrixResourceBase.java
>  5e8283a 
>   
> plugins/hypervisors/xen/src/com/cloud/hypervisor/xen/resource/XenServer56FP1Resource.java
>  8e37809 
>   server/src/com/cloud/api/ApiResponseHelper.java 94c5d6c 
>   server/src/com/cloud/api/query/dao/UserVmJoinDaoImpl.java dbfe94d 
>   server/src/com/cloud/api/query/vo/UserVmJoinVO.java 8ad0fdd 
>   server/src/com/cloud/hypervisor/HypervisorGuruBase.java 1ad9a1f 
>   server/src/com/cloud/server/ManagementServerImpl.java 96c72e4 
>   server/src/com/cloud/storage/TemplateProfile.java 0b55f1f 
>   server/src/com/cloud/template/TemplateAdapter.java 9a2d877 
>   server/src/com/cloud/template/TemplateAdapterBase.java 0940d3e 
>   server/src/com/cloud/vm/UserVmManagerImpl.java 1c8ab75 
>   server/src/com/cloud/vm/VirtualMachineManagerImpl.java f946cd1 
>   server/test/com/cloud/vm/VirtualMachineManagerImplTest.java 8715c9e 
>   setup/db/db/schema-410to420.sql 272fc42 
> 
> Diff: https://reviews.apache.org/r/11910/diff/
> 
> 
> Testing
> ---
> 
> Tested locally
> 
> 
> Thanks,
> 
> Harikrishna Patnala
> 
>

Re: Review Request: Fix CLOUDSTACK-2168

[Abhinandan Prateek]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/11907/#review22106
---



api/src/org/apache/cloudstack/api/command/admin/ldap/LDAPConfigCmd.java


Minor: Hyp..CapabilitiesResponse import is not required here.


- Abhinandan Prateek


On June 18, 2013, 8:38 a.m., Ian Duffy wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/11907/
> ---
> 
> (Updated June 18, 2013, 8:38 a.m.)
> 
> 
> Review request for cloudstack, Abhinandan Prateek and Sebastien Goasguen.
> 
> 
> Description
> ---
> 
> CLOUDSTACK-2168 detailed a bug that caused the ldap configuration to not 
> appear.
> 
> This bug occurred due to the UI expecting a "list" of ldap configurations 
> back from the API.
> 
> I have modified the API command to return a "list" like format, but since 
> cloudstack only currently supports authentication against one ldap server it 
> will only return 1 configuration.
> 
> Whoever takes up CLOUDSTACK-430 
> https://issues.apache.org/jira/browse/CLOUDSTACK-430 - Add support for 
> multiple ldap servers will have to expand on this output. 
> 
> 
> This addresses bug CLOUDSTACK-2168.
> 
> 
> Diffs
> -
> 
>   api/src/org/apache/cloudstack/api/command/admin/ldap/LDAPConfigCmd.java 
> 2726f84 
> 
> Diff: https://reviews.apache.org/r/11907/diff/
> 
> 
> Testing
> ---
> 
> Build the code with the changes, confirmed the API still returned the 
> expected results.
> Confirmed that the UI showed the configuration.
> 
> 
> Thanks,
> 
> Ian Duffy
> 
>

Re: [GSOC]CloudStack deployment questions

[Prasanna Santhanam]

On Tue, Jun 18, 2013 at 10:45:27PM -0400, Han,Meng wrote:
> Hi all,
> 
> I have a few questions about CloudStack deployment.
> 
> 1. I am trying to deploy CloudStack, use CloudStack to start a
> cluster and run hadoop on it. Now I have only one computer with
> virtulization extension support in hardware and the OS is ubuntu
> 12.04.

I'm no hadoop person but if you require large swaths of storage you
are going to use I imagine that will be external to your development
environment. Is this true?

> 
> what would be a good deployment suit?
> 
> Devcloud? It seems like the tiny linux guest VM in devcloud won't be
> sufficient to play with hadoop.

You can register a VM of your choice in devcloud from the UI. If
devcloud is unsuitable, tell us what is missing and we can see if it
can be tailored to fit your use case.

> 
> Install Xenserver on my desktop, using one VM as the management
> server and other VMs as guest VMs.
> 
> Install management server on my ubuntu desktop. Using KVM to
> provision guest VMs. This is the guide I found for this solution:
> http://cloudstack.apache.org/docs/en-US/Apache_CloudStack/4.0.2/html/Quick_Install_Guide/index.html
> 
> Or anything else?
> 

You can run all the management server code from your laptop as a
development environment and add an external hypervisor host (Either
Xen/KVM) to it. The guests, system VMs etc will then be deployed on
your host and not eat up any memory on your laptop. Management server
does require quite a bit of memory to run and having Hypervisor +
Management server + storage + kitchen sink will slow it down (unless
you just need devcloud).

> 
> 2. When I try to deploy management server on my desktop. I
> encountered below error when running the command "mvn -P developer
> -pl developer,tools/devcloud -Ddeploydb" in this tutorial:
> https://cwiki.apache.org/CLOUDSTACK/devcloud.html

Did mvn -Pdeveloper -Dsystevm clean install succeed for you?

> 
> 
> > WARNING: Provided file does not exist:
> /home/meng/cloudstack/developer/../utils/conf/db.properties.override
> > Initializing database=cloud with host=localhost port=3306
> username=cloud password=cloud
> > Running query: drop database if exists `cloud`
> SQL exception in trying initDB: java.sql.SQLException: Access denied
> for user 'root'@'localhost' (using password: NO)
> 
Does your mysql instance have a root password? If so you'll have to
put that into db.properties.override file under utils/conf.

I see the wiki(s) are missing this info, so we'll need to edit that
with this step if it works for you. 

let us know.

> 
> I am running the mvn command as root.  Mysql is setup locally.
> 
> 

-- 
Prasanna.,


Powered by BigRock.com

Re: Review Request: Test Snapshot Services

[sanjeev n]

> On June 18, 2013, 6:40 a.m., Prasanna Santhanam wrote:
> > This test actually passes on jenkins. What are we changing here?

In an environment created with apche master, I see ssvm type as 
"SecondaryStorageVM" in host table. So I modified the script accordingly.


- sanjeev


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/11904/#review22054
---


On June 17, 2013, 6:37 a.m., sanjeev n wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/11904/
> ---
> 
> (Updated June 17, 2013, 6:37 a.m.)
> 
> 
> Review request for cloudstack, Prasanna Santhanam and SrikanteswaraRao 
> Talluri.
> 
> 
> Description
> ---
> 
> Secondary Storage vm type has been modified from "SecondaryStorage" to 
> "SecondaryStorageVM" in host table in Cloud db.
> Modified the same in the test.
> 
> 
> Diffs
> -
> 
>   test/integration/component/test_snapshots.py 014b55a 
> 
> Diff: https://reviews.apache.org/r/11904/diff/
> 
> 
> Testing
> ---
> 
> Yes
> 
> 
> Thanks,
> 
> sanjeev n
> 
>

Re: ????: VM snapshots on KVM

[Prasanna Santhanam]

On Wed, Jun 19, 2013 at 10:45:53AM +0800, Mice Xia wrote:
> 
> codes for vm snapshot for KVM has not been merged due to it depends
> on a new version libvirt-java.

Sorry if this was already mentioned before. Is the libvirt-java
release for this fix not out yet? Can you add this note to the design
doc for now mentioning the version of libvirt-java etc?

> can we skip the tests for KVM right now?

We can, but I'll keep it for when libvirt-java is released. I don't
mind the tests failing for now.

-- 
Prasanna.,


Powered by BigRock.com

Re: Review Request: Fix for regression issue: CLOUDSTACK - 3021

[Prasanna Santhanam]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/11935/#review22100
---

Ship it!


b6850c28dc664e88c0128ddbae7c3ee468290350

- Prasanna Santhanam


On June 18, 2013, 1:39 p.m., Gaurav Aradhye wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/11935/
> ---
> 
> (Updated June 18, 2013, 1:39 p.m.)
> 
> 
> Review request for cloudstack and Prasanna Santhanam.
> 
> 
> Description
> ---
> 
> Fix for issue: https://issues.apache.org/jira/browse/CLOUDSTACK-3021
> Changed order of cleanup list of resources in order to remove them properly 
> (first child then parent)
> 
> 
> Diffs
> -
> 
>   test/integration/component/test_accounts.py ec135b1 
> 
> Diff: https://reviews.apache.org/r/11935/diff/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Gaurav Aradhye
> 
>

Review Request: Remove code that does nothing but allocate a bunch of objects

[Dave Brosius]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/11953/
---

Review request for cloudstack.


Description
---

remove code that may have been used for something in the past, but now does 
nothing but allocate memory temporarily.


Diffs
-

  
engine/orchestration/src/org/apache/cloudstack/engine/cloud/entity/api/VMEntityManagerImpl.java
 38ed7e6 

Diff: https://reviews.apache.org/r/11953/diff/


Testing
---


Thanks,

Dave Brosius

答复: VM snapshots on KVM

[Mice Xia]

codes for vm snapshot for KVM has not been merged due to it depends on a new 
version libvirt-java.
can we skip the tests for KVM right now?

-Mice 

-Original Message-
From: Prasanna Santhanam [mailto:t...@apache.org]
Sent: 2013-6-18 (星期二) 16:12
To: CloudStack Dev
Subject: VM snapshots on KVM
 
Hi,

It looks like VM snapshotting is supported on KVM [0] and yet the
test_vm_snapshots has never passed for the KVM environment [1][2][3].
It works for XCP and Xen however.

Is there something special that needs to happen for guests on KVM to
perform the VM snapshot? 

[0] https://cwiki.apache.org/confluence/x/4wLMAQ
[1] 
http://jenkins.buildacloud.org/view/cloudstack-qa/job/test-smoke-matrix/477/suite=test_vm_snapshots/
[2] 
http://jenkins.buildacloud.org/view/cloudstack-qa/job/test-smoke-matrix/474/suite=test_vm_snapshots/
[3] 
http://jenkins.buildacloud.org/view/cloudstack-qa/job/test-smoke-matrix/480/suite=test_vm_snapshots/

-- 
Prasanna.,


Powered by BigRock.com

[GSOC]CloudStack deployment questions

[Han,Meng]

Hi all,

I have a few questions about CloudStack deployment.

1. I am trying to deploy CloudStack, use CloudStack to start a cluster 
and run hadoop on it. Now I have only one computer with virtulization 
extension support in hardware and the OS is ubuntu 12.04.


what would be a good deployment suit?

Devcloud? It seems like the tiny linux guest VM in devcloud won't be 
sufficient to play with hadoop.


Install Xenserver on my desktop, using one VM as the management server 
and other VMs as guest VMs.


Install management server on my ubuntu desktop. Using KVM to provision 
guest VMs. This is the guide I found for this solution: 
http://cloudstack.apache.org/docs/en-US/Apache_CloudStack/4.0.2/html/Quick_Install_Guide/index.html


Or anything else?


2. When I try to deploy management server on my desktop. I encountered 
below error when running the command "mvn -P developer -pl 
developer,tools/devcloud -Ddeploydb" in this tutorial: 
https://cwiki.apache.org/CLOUDSTACK/devcloud.html



> WARNING: Provided file does not exist: 
/home/meng/cloudstack/developer/../utils/conf/db.properties.override
> Initializing database=cloud with host=localhost port=3306 
username=cloud password=cloud

> Running query: drop database if exists `cloud`
SQL exception in trying initDB: java.sql.SQLException: Access denied 
for user 'root'@'localhost' (using password: NO)



I am running the mvn command as root.  Mysql is setup locally.


Thanks a bunch folks!

Cheers,
Meng

Re: NFS Cache storage query

[John Burwell]

Edison,

Are we going to change the name of this mechanism to be more
representative of its role as a staging/temporary area rather than a
cache?

Thanks,
-John

On Jun 18, 2013, at 9:06 PM, Edison Su  wrote:

> Currently, no, I can add an API for it.
>
>> -Original Message-
>> From: Jessica Wang [mailto:jessica.w...@citrix.com]
>> Sent: Tuesday, June 18, 2013 4:24 PM
>> To: Min Chen
>> Cc: dev@cloudstack.apache.org
>> Subject: RE: NFS Cache storage query
>>
>> Min,
>>
>>> We may need to provide a way from UI to allow users to configure and
>> display their NFS cache.
>> Is there an API that list NFS cache?
>>
>> Jessica
>>
>> -Original Message-
>> From: Min Chen
>> Sent: Friday, June 14, 2013 9:26 AM
>> To: dev@cloudstack.apache.org
>> Cc: Jessica Wang
>> Subject: Re: NFS Cache storage query
>>
>> Hi Sanjeev,
>>
>>In 4.2 release, we require that a NFS cache storage has to be added if
>> you choose S3 as the storage provider since we haven't refactored
>> hypervisor side code to handle s3 directly by bypassing NFS caching, which is
>> the goal for 4.3 release. I see an issue with current UI, where user can only
>> add cache storage when he/she adds a S3 storage. We may need to provide
>> a way from UI to allow users to configure and display their NFS cache. You
>> can file a JIRA ticket for this UI enhancement.
>>
>>Thanks
>>-min
>>
>> On 6/14/13 6:35 AM, "Chip Childers"  wrote:
>>
>>> On Fri, Jun 14, 2013 at 01:06:30PM +, Sanjeev Neelarapu wrote:
 Hi,

 I have a query on how to add NFS Cache storage.
 Before creating a zone if we create a secondary storage with s3 as
 the storage provider and don't select NFS Cache Storage then we treat
 it as
 S3 at region level.
 Later I create a zone and at "add secondary storage" creation wizard
 in UI if I select NFS as secondary storage provider will it be treated
 as NFS Cache Storage? If not is there a way to add NFS cache storage
 for that zone?

 Thanks,
 Sanjeev
>>>
>>> Based on the thread talking about this [1], I'm not sure that it will
>>> be implemented this way anymore.
>>>
>>> -chip
>>>
>>> [1] http://markmail.org/message/c73nagj45q6iktfh
>

Re: NFS Cache storage query

[Min Chen]

Edison, we can just add a parameter in listImageStoreCmd to show cache
store.

Thanks
-min

On 6/18/13 6:06 PM, "Edison Su"  wrote:

>Currently, no, I can add an API for it.
>
>> -Original Message-
>> From: Jessica Wang [mailto:jessica.w...@citrix.com]
>> Sent: Tuesday, June 18, 2013 4:24 PM
>> To: Min Chen
>> Cc: dev@cloudstack.apache.org
>> Subject: RE: NFS Cache storage query
>> 
>> Min,
>> 
>> > We may need to provide a way from UI to allow users to configure and
>> display their NFS cache.
>> Is there an API that list NFS cache?
>> 
>> Jessica
>> 
>> -Original Message-
>> From: Min Chen
>> Sent: Friday, June 14, 2013 9:26 AM
>> To: dev@cloudstack.apache.org
>> Cc: Jessica Wang
>> Subject: Re: NFS Cache storage query
>> 
>> Hi Sanjeev,
>> 
>>  In 4.2 release, we require that a NFS cache storage has to be added if
>> you choose S3 as the storage provider since we haven't refactored
>> hypervisor side code to handle s3 directly by bypassing NFS caching,
>>which is
>> the goal for 4.3 release. I see an issue with current UI, where user
>>can only
>> add cache storage when he/she adds a S3 storage. We may need to provide
>> a way from UI to allow users to configure and display their NFS cache.
>>You
>> can file a JIRA ticket for this UI enhancement.
>> 
>>  Thanks
>>  -min
>> 
>> On 6/14/13 6:35 AM, "Chip Childers"  wrote:
>> 
>> >On Fri, Jun 14, 2013 at 01:06:30PM +, Sanjeev Neelarapu wrote:
>> >> Hi,
>> >>
>> >> I have a query on how to add NFS Cache storage.
>> >> Before creating a zone if we create a secondary storage with s3 as
>> >>the storage provider and don't select NFS Cache Storage then we treat
>> >>it as
>> >>S3 at region level.
>> >> Later I create a zone and at "add secondary storage" creation wizard
>> >>in UI if I select NFS as secondary storage provider will it be treated
>> >>as NFS Cache Storage? If not is there a way to add NFS cache storage
>> >>for that zone?
>> >>
>> >> Thanks,
>> >> Sanjeev
>> >>
>> >
>> >Based on the thread talking about this [1], I'm not sure that it will
>> >be implemented this way anymore.
>> >
>> >-chip
>> >
>> >[1] http://markmail.org/message/c73nagj45q6iktfh
>

RE: NFS Cache storage query

[Edison Su]

Currently, no, I can add an API for it.

> -Original Message-
> From: Jessica Wang [mailto:jessica.w...@citrix.com]
> Sent: Tuesday, June 18, 2013 4:24 PM
> To: Min Chen
> Cc: dev@cloudstack.apache.org
> Subject: RE: NFS Cache storage query
> 
> Min,
> 
> > We may need to provide a way from UI to allow users to configure and
> display their NFS cache.
> Is there an API that list NFS cache?
> 
> Jessica
> 
> -Original Message-
> From: Min Chen
> Sent: Friday, June 14, 2013 9:26 AM
> To: dev@cloudstack.apache.org
> Cc: Jessica Wang
> Subject: Re: NFS Cache storage query
> 
> Hi Sanjeev,
> 
>   In 4.2 release, we require that a NFS cache storage has to be added if
> you choose S3 as the storage provider since we haven't refactored
> hypervisor side code to handle s3 directly by bypassing NFS caching, which is
> the goal for 4.3 release. I see an issue with current UI, where user can only
> add cache storage when he/she adds a S3 storage. We may need to provide
> a way from UI to allow users to configure and display their NFS cache. You
> can file a JIRA ticket for this UI enhancement.
> 
>   Thanks
>   -min
> 
> On 6/14/13 6:35 AM, "Chip Childers"  wrote:
> 
> >On Fri, Jun 14, 2013 at 01:06:30PM +, Sanjeev Neelarapu wrote:
> >> Hi,
> >>
> >> I have a query on how to add NFS Cache storage.
> >> Before creating a zone if we create a secondary storage with s3 as
> >>the storage provider and don't select NFS Cache Storage then we treat
> >>it as
> >>S3 at region level.
> >> Later I create a zone and at "add secondary storage" creation wizard
> >>in UI if I select NFS as secondary storage provider will it be treated
> >>as NFS Cache Storage? If not is there a way to add NFS cache storage
> >>for that zone?
> >>
> >> Thanks,
> >> Sanjeev
> >>
> >
> >Based on the thread talking about this [1], I'm not sure that it will
> >be implemented this way anymore.
> >
> >-chip
> >
> >[1] http://markmail.org/message/c73nagj45q6iktfh

Re: CLOUDSTACK-2534 - Automation Blocker

[Sheng Yang]

Committed a fix and later found it's not right.

The correct key file is at: /var/cloudstack/management/.ssh/id_rsa, which
owned by user cloud and has 600 permission.

--Sheng


On Tue, Jun 18, 2013 at 3:37 PM, Rayees Namathponnan <
rayees.namathpon...@citrix.com> wrote:

> Hi All,
>
> Is some possible to take look on VMware automation blocker defect
> https://issues.apache.org/jira/browse/CLOUDSTACK-2534.
>
> 12 test cases (SSVM and Router) failing due to this in VMware runs.
>
> Regards,
> Rayees
>
>
>
>
>

Re: Baremetal re-enabling

[Sheng Yang]

Done DB upgrading code, and tested.

I've created a new branch baremetal-4.2 for review.

--Sheng


On Tue, Jun 18, 2013 at 3:16 PM, Sheng Yang  wrote:

> On Tue, Jun 18, 2013 at 2:59 PM, Alena Prokharchyk <
> alena.prokharc...@citrix.com> wrote:
>
>> On 6/18/13 2:44 PM, "Sheng Yang"  wrote:
>>
>> >It seems no change has been done for db upgrade part(no reverting I
>> >meant).
>> >
>> >If it's incorrect someone please pointed out.
>>
>> 1) Check if these parameters are being inserted as a part of the upgrade
>> to 4.2:
>>
>> "external,baremetal.resource.classname"
>> "external.baremetal.system.url"
>>
>
> Frank didn't add this part, I would add it.
>
>>
>>
>>
>> Also would be good to replace "," with "." in the global config name
>>
>> 2) Check if the foreign keys below exist on fresh as well as upgraded
>> setups:
>>
>> baremetal_dhcp_devices
>>
>> `fk_external_dhcp_devices_nsp_id`
>> `fk_external_dhcp_devices_host_id`
>> `fk_external_dhcp_devices_pod_id`
>> `fk_external_dhcp_devices_physical_network_id`
>>
>>
>>
>> baremetal_pxe_devices
>>
>> `fk_external_pxe_devices_nsp_id`
>> `fk_external_pxe_devices_pod_id`
>> `fk_external_pxe_devices_host_id`
>> `fk_external_pxe_devices_physical_network_id`
>>
>
> Where are these foreign keys? I cannot find them in code.
>
> --Sheng
>
>
>>
>>
>>
>> -alena.
>>
>>
>> >
>> >--Sheng
>> >
>> >
>> >On Tue, Jun 18, 2013 at 2:29 PM, Alena Prokharchyk <
>> >alena.prokharc...@citrix.com> wrote:
>> >
>> >> Sheng, can you also check if all the DB upgrade related changes are
>> >>merged
>> >> back in as well? In case they were dropped at some point.
>> >>
>> >> -Alena.
>> >>
>> >> On 6/18/13 1:53 PM, "Sheng Yang"  wrote:
>> >>
>> >> >Hi,
>> >> >
>> >> >Due to absent of Frank, I've tried to make sure Baremetal wouldn't
>> miss
>> >> >4.2. So for the last a few days work, I am able to re-enable baremetal
>> >>for
>> >> >master.
>> >> >
>> >> >It turn out the change is not big, and most of it just compose of
>> >>revert
>> >> >of
>> >> >previous change, and I fixed some issues brought by the new features.
>> >> >
>> >> >The total change summary is:
>> >> >
>> >> >--
>> >> > client/pom.xml
>> >> >|  5 +
>> >> > client/tomcatconf/applicationContext.xml.in
>> >> > |  4 
>> >> > client/tomcatconf/componentContext.xml.in
>> >> > | 10 --
>> >> > client/tomcatconf/nonossComponentContext.xml.in
>> >> > |  8 
>> >> >
>> >>
>>
>> >>>plugins/hypervisors/baremetal/src/com/cloud/baremetal/manager/BareMetalD
>> >>>is
>> >> >coverer.java
>> >> >|  3 ++-
>> >> >
>> >>
>>
>> >>>plugins/hypervisors/baremetal/src/com/cloud/baremetal/manager/BareMetalT
>> >>>em
>> >> >plateAdapter.java
>> >> >   |  6 --
>> >> >
>> >>
>>
>> >>>plugins/hypervisors/baremetal/src/com/cloud/baremetal/networkservice/Bar
>> >>>em
>> >> >etalDhcpElement.java
>> >> >|  6 --
>> >> >
>> plugins/network-elements/dns-notifier/resources/components-example.xml
>> >> >|  8 
>> >> > server/src/com/cloud/network/NetworkServiceImpl.java
>> >> >|  9 +++--
>> >> > 9 files changed, 14 insertions(+), 45 deletions(-)
>> >> >
>> >> >
>> >> >I've tested against the original blocker issues:
>> >> >https://issues.apache.org/jira/browse/CLOUDSTACK-1610
>> >> >https://issues.apache.org/jira/browse/CLOUDSTACK-1618
>> >> >https://issues.apache.org/jira/browse/CLOUDSTACK-1614
>> >> >https://issues.apache.org/jira/browse/CLOUDSTACK-1440
>> >> >
>> >> >They all passed.
>> >> >
>> >> >Can I say we're ready to re-enable the baremetal in master now?
>> >> >
>> >> >--Sheng
>> >> >
>> >>
>> >>
>> >>
>> >
>>
>>
>>
>

Re: Review Request: SolidFire storage plug-in and enhancements to the storage framework and GUI

[Mike Tutkowski]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/11479/
---

(Updated June 19, 2013, 12:06 a.m.)


Review request for cloudstack, edison su and John Burwell.


Changes
---

I uploaded a new diff file.

The only remaining items are that we need a mechanism in the GUI and API for 
mutual exclusion of mine and Wei's features and that we haven't decided yet how 
to handle the hypervisor to use being required for a storage pool. For the time 
being at least, I have let my plug-in take on the hypervisor type of "Any" and 
I've placed some logic elsewhere to deal with this Any type in an allocator.


Description
---

This patch implements a storage plug-in for SolidFire. The plug-in is based on 
the new storage framework that went in with 4.2, as well.

In addition, there are GUI (and related) changes to enable admins and end users 
to specify a Min, Max, and Burst number of IOPS for a Disk Offering. These 
fields (although optional) tend to follow the pattern previously established 
for the Disk Size field.

Also, the storage framework itself has been enhanced. For example, it now 
supports creating and deleting storage repositories as is necessary for a 
dynamic type of zone-wide primary storage (such as the SolidFire plug-in is).

The desired behavior of the software is as such:

* Allow an admin to invoke the CloudStack API to add Primary Storage based on 
the SolidFire plug-in.

* Allow an admin to create a Disk Offering that specifies a Min, Max, and Burst 
number of IOPS or allows the admin to pass this ability on to the end user.

* Allow an end user to execute such a Disk Offering. As is the case for any 
Disk Offering, this leads to the creation of a row in the volumes table.

* Allow an end user to attach the resultant volume (noted in the DB) to a VM. 
The storage framework invokes logic in the plug-in and the plug-in creates a 
volume on its SAN with the correct size and IOPS values. The agent software for 
XenServer detects that such an attach is being requested and creates a Storage 
Repository (and single VDI within the SR) based on the storage IP address of 
the SAN and the IQN of the volume. The VDI is then hooked up to the VM.

* Allow an end user to detach the volume. This leads to the destruction of the 
SR, but the SAN volume remains intact and can be reattached later to any VM 
running in a XenServer resource pool in the zone.

* Allow an end user to delete the volume. This leads to the volume being 
deleted on the SAN and being marked in the CloudStack DB as deleted.


Diffs (updated)
-

  api/src/com/cloud/offering/DiskOffering.java ae4528c 
  api/src/com/cloud/storage/StoragePool.java 8b95383 
  api/src/com/cloud/storage/Volume.java 4903594 
  api/src/org/apache/cloudstack/api/ApiConstants.java 1704ca3 
  
api/src/org/apache/cloudstack/api/command/admin/offering/CreateDiskOfferingCmd.java
 a2c5f77 
  
api/src/org/apache/cloudstack/api/command/admin/storage/CreateStoragePoolCmd.java
 74eb2b9 
  api/src/org/apache/cloudstack/api/command/user/volume/CreateVolumeCmd.java 
86a494b 
  api/src/org/apache/cloudstack/api/response/DiskOfferingResponse.java 35cf21a 
  api/src/org/apache/cloudstack/api/response/StoragePoolResponse.java 965407d 
  api/src/org/apache/cloudstack/api/response/VolumeResponse.java e3463bd 
  client/WEB-INF/classes/resources/messages.properties a0a36c8 
  client/pom.xml ab758eb 
  client/tomcatconf/applicationContext.xml.in 049e483 
  core/src/com/cloud/agent/api/AttachVolumeAnswer.java b377b7c 
  core/src/com/cloud/agent/api/AttachVolumeCommand.java 2658262 
  core/test/org/apache/cloudstack/api/agent/test/AttachVolumeAnswerTest.java 
251a6cb 
  core/test/org/apache/cloudstack/api/agent/test/AttachVolumeCommandTest.java 
1ec416a 
  core/test/org/apache/cloudstack/api/agent/test/BackupSnapshotCommandTest.java 
44d53aa 
  core/test/org/apache/cloudstack/api/agent/test/SnapshotCommandTest.java 
c2d69c0 
  core/test/src/com/cloud/agent/api/test/ResizeVolumeCommandTest.java 02085f5 
  
engine/api/src/org/apache/cloudstack/engine/subsystem/api/storage/DataStoreDriver.java
 cf5759b 
  
engine/api/src/org/apache/cloudstack/engine/subsystem/api/storage/PrimaryDataStoreParameters.java
 b2b787c 
  
engine/api/src/org/apache/cloudstack/storage/datastore/db/PrimaryDataStoreDaoImpl.java
 d461d58 
  engine/api/src/org/apache/cloudstack/storage/datastore/db/StoragePoolVO.java 
0262f65 
  engine/schema/src/com/cloud/storage/DiskOfferingVO.java 44f9e8f 
  engine/schema/src/com/cloud/storage/VolumeVO.java 1699afd 
  engine/schema/src/com/cloud/storage/dao/VolumeDao.java 2513181 
  engine/schema/src/com/cloud/storage/dao/VolumeDaoImpl.java 12ca3c7 
  
engine/storage/image/src/org/apache/cloudstack/storage/image/ImageServiceImpl.java
 99b1013 
  
engine/storage/image/src/org/apache/cloudstack/storage/image/driver/AncientImageD

Re: [MERGE] disk_io_throttling to MASTER

[Mike Tutkowski]

OK, I've gone ahead and updated Review Board with a new diff.

Please check it out and let me know what you think.

Thanks!


On Mon, Jun 17, 2013 at 2:52 PM, Mike Tutkowski <
mike.tutkow...@solidfire.com> wrote:

> Sounds good
>
> I have a little bit of clean-up work to do and then I must figure out how
> to generate a patch (since I was using merge rather than rebase during
> development), so it will probably be tomorrow.
>
>
> On Mon, Jun 17, 2013 at 2:50 PM, John Burwell  wrote:
>
>> Mike,
>>
>> Great news.  Let me know when Review Board is updated, and I will perform
>> a second round review.
>>
>> Thanks,
>> -John
>>
>> On Jun 17, 2013, at 4:48 PM, Mike Tutkowski 
>> wrote:
>>
>> > FYI: I added the IOPS-capacity parameter and related code over the
>> weekend.
>> >
>> > The final bit of work for me comes when Wei's code is merged into master
>> > and I pull it down.
>> >
>> > At that point, I need to add the GUI and API logic to support mutual
>> > exclusion of our features.
>> >
>> >
>> > On Sat, Jun 15, 2013 at 11:12 AM, Chip Childers
>> > wrote:
>> >
>> >> On Fri, Jun 14, 2013 at 05:56:27PM -0400, John Burwell wrote:
>> >>> Mike,
>> >>>
>> >>> Awesome.  +1.
>> >>>
>> >>> Thanks for your patience with the back and forth,
>> >>> -John
>> >>
>> >> +1 - this now looks like a great approach.
>> >>
>> >
>> >
>> >
>> > --
>> > *Mike Tutkowski*
>> > *Senior CloudStack Developer, SolidFire Inc.*
>> > e: mike.tutkow...@solidfire.com
>> > o: 303.746.7302
>> > Advancing the way the world uses the
>> > cloud
>> > *™*
>>
>>
>
>
> --
> *Mike Tutkowski*
> *Senior CloudStack Developer, SolidFire Inc.*
> e: mike.tutkow...@solidfire.com
> o: 303.746.7302
> Advancing the way the world uses the 
> cloud
> *™*
>



-- 
*Mike Tutkowski*
*Senior CloudStack Developer, SolidFire Inc.*
e: mike.tutkow...@solidfire.com
o: 303.746.7302
Advancing the way the world uses the
cloud
*™*

Re: Review Request: CLOUDSTACK-702: Tests for Multiple IP Ranges

[ASF Subversion and Git Services]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/11026/#review22089
---


Commit 192523f76843c7cac16fc12e01384771826b5209 in branch 
refs/heads/baremetal-4.2 from Sheng Yang
[ https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;h=192523f ]

Fix baremetal functionality

1. Baremetal doesn't have secondary storage, so we don't need check them.

2. The new "AddBaremetalHostCmd" hasn't been used by UI, so keep the validity
checking out for now. "AddHostCmd" would still works.

3. Baremetal haven't implemented multiple ip range feature(CLOUDSTACK-702),
return true for now for single range.



- ASF Subversion and Git Services


On May 9, 2013, 1:23 p.m., sanjeev n wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/11026/
> ---
> 
> (Updated May 9, 2013, 1:23 p.m.)
> 
> 
> Review request for cloudstack, Prasanna Santhanam and SrikanteswaraRao 
> Talluri.
> 
> 
> Description
> ---
> 
> CLOUDSTACK-702: Tests for Multiple IP Ranges
> 1. Add ip range super set to existing CIDR
> 2. Add ip range subset to existing CIDR
> 
> 
> This addresses bug CLOUDSTACK-702.
> 
> 
> Diffs
> -
> 
>   test/integration/component/test_multiple_ip_ranges.py 7e9eeb1 
> 
> Diff: https://reviews.apache.org/r/11026/diff/
> 
> 
> Testing
> ---
> 
> yes
> 
> 
> Thanks,
> 
> sanjeev n
> 
>

RE: NFS Cache storage query

[Jessica Wang]

Min,

> We may need to provide a way from UI to allow users to configure and display 
> their NFS cache.
Is there an API that list NFS cache?

Jessica

-Original Message-
From: Min Chen 
Sent: Friday, June 14, 2013 9:26 AM
To: dev@cloudstack.apache.org
Cc: Jessica Wang
Subject: Re: NFS Cache storage query

Hi Sanjeev,

In 4.2 release, we require that a NFS cache storage has to be added if
you choose S3 as the storage provider since we haven't refactored
hypervisor side code to handle s3 directly by bypassing NFS caching, which
is the goal for 4.3 release. I see an issue with current UI, where user
can only add cache storage when he/she adds a S3 storage. We may need to
provide a way from UI to allow users to configure and display their NFS
cache. You can file a JIRA ticket for this UI enhancement.

Thanks
-min

On 6/14/13 6:35 AM, "Chip Childers"  wrote:

>On Fri, Jun 14, 2013 at 01:06:30PM +, Sanjeev Neelarapu wrote:
>> Hi,
>> 
>> I have a query on how to add NFS Cache storage.
>> Before creating a zone if we create a secondary storage with s3 as the
>>storage provider and don't select NFS Cache Storage then we treat it as
>>S3 at region level.
>> Later I create a zone and at "add secondary storage" creation wizard in
>>UI if I select NFS as secondary storage provider will it be treated as
>>NFS Cache Storage? If not is there a way to add NFS cache storage for
>>that zone?
>> 
>> Thanks,
>> Sanjeev
>>
>
>Based on the thread talking about this [1], I'm not sure that it will be
>implemented this way anymore.
>
>-chip
>
>[1] http://markmail.org/message/c73nagj45q6iktfh

CLOUDSTACK-2534 - Automation Blocker

[Rayees Namathponnan]

Hi All,

Is some possible to take look on VMware automation blocker defect 
https://issues.apache.org/jira/browse/CLOUDSTACK-2534.

12 test cases (SSVM and Router) failing due to this in VMware runs.

Regards,
Rayees

Re: [MERGE] Merge VMSync improvement branch into master

[Kelven Yang]

On 6/17/13 7:43 PM, "Mice Xia"  wrote:

>Kelven,
>
>After the refactoring, will CS still restart HA enabled VM when it is
>power off externally (e.g. using xencenter) or internally (user initiated
>shutdown or crash)?


If HA functionality is provided by external manager (i.e., vCenter), CS
won't try to restart it, but if HA is provided by CloudStack, we will
restore the legacy logic. The hook up with old HA manager (between
HighAvailabilityManager/VirtualMachineManager) is in the wrap-up process


>
>Is seems the method HighAvailabilityManagerImpl .scheduleRestart() is not
>called when VM's actual state is stopped while expected state is running.
>
>
>Regards
>Mice
>
>-Original Message-
>From: Kelven Yang [mailto:kelven.y...@citrix.com]
>Sent: Tuesday, June 18, 2013 5:21 AM
>To: dev@cloudstack.apache.org
>Subject: Re: [MERGE] Merge VMSync improvement branch into master
>
>Haven't created a patch yet, will do it soon after some last wrap-ups.
>
>Kelven
>
>On 6/17/13 12:03 PM, "John Burwell"  wrote:
>
>>Kelven,
>>
>>Did this patch get pushed to Review Board?  If so, what is the URL?
>>
>>Thanks.
>>-John
>>
>>On Jun 17, 2013, at 1:40 PM, Kelven Yang  wrote:
>>
>>> Low level classes were tested in unit tests(MessageBus, Job
>>>framework, Job  dispatchers etc), interface layer changes are guarded
>>>through matching the  old semantics, but changes are tested manually,
>>>we are planning to get  this part of testing through BVT system after
>>>we have re-based the latest  master.
>>> 
>>> Kelven
>>> 
>>> On 6/17/13 10:01 AM, "Chip Childers"  wrote:
>>> 
 On Mon, Jun 17, 2013 at 04:59:00PM +, Kelven Yang wrote:
> I'd like to kick off the official merge process. We will start the
>merge  process after the branch has passed necessary tests
> 
> Kelven
 
 Can you share what testing is being run against the branch?
>>> 
>>
>

Re: Baremetal re-enabling

[Sheng Yang]

On Tue, Jun 18, 2013 at 2:59 PM, Alena Prokharchyk <
alena.prokharc...@citrix.com> wrote:

> On 6/18/13 2:44 PM, "Sheng Yang"  wrote:
>
> >It seems no change has been done for db upgrade part(no reverting I
> >meant).
> >
> >If it's incorrect someone please pointed out.
>
> 1) Check if these parameters are being inserted as a part of the upgrade
> to 4.2:
>
> "external,baremetal.resource.classname"
> "external.baremetal.system.url"
>

Frank didn't add this part, I would add it.

>
>
>
> Also would be good to replace "," with "." in the global config name
>
> 2) Check if the foreign keys below exist on fresh as well as upgraded
> setups:
>
> baremetal_dhcp_devices
>
> `fk_external_dhcp_devices_nsp_id`
> `fk_external_dhcp_devices_host_id`
> `fk_external_dhcp_devices_pod_id`
> `fk_external_dhcp_devices_physical_network_id`
>
>
>
> baremetal_pxe_devices
>
> `fk_external_pxe_devices_nsp_id`
> `fk_external_pxe_devices_pod_id`
> `fk_external_pxe_devices_host_id`
> `fk_external_pxe_devices_physical_network_id`
>

Where are these foreign keys? I cannot find them in code.

--Sheng


>
>
>
> -alena.
>
>
> >
> >--Sheng
> >
> >
> >On Tue, Jun 18, 2013 at 2:29 PM, Alena Prokharchyk <
> >alena.prokharc...@citrix.com> wrote:
> >
> >> Sheng, can you also check if all the DB upgrade related changes are
> >>merged
> >> back in as well? In case they were dropped at some point.
> >>
> >> -Alena.
> >>
> >> On 6/18/13 1:53 PM, "Sheng Yang"  wrote:
> >>
> >> >Hi,
> >> >
> >> >Due to absent of Frank, I've tried to make sure Baremetal wouldn't miss
> >> >4.2. So for the last a few days work, I am able to re-enable baremetal
> >>for
> >> >master.
> >> >
> >> >It turn out the change is not big, and most of it just compose of
> >>revert
> >> >of
> >> >previous change, and I fixed some issues brought by the new features.
> >> >
> >> >The total change summary is:
> >> >
> >> >--
> >> > client/pom.xml
> >> >|  5 +
> >> > client/tomcatconf/applicationContext.xml.in
> >> > |  4 
> >> > client/tomcatconf/componentContext.xml.in
> >> > | 10 --
> >> > client/tomcatconf/nonossComponentContext.xml.in
> >> > |  8 
> >> >
> >>
> >>>plugins/hypervisors/baremetal/src/com/cloud/baremetal/manager/BareMetalD
> >>>is
> >> >coverer.java
> >> >|  3 ++-
> >> >
> >>
> >>>plugins/hypervisors/baremetal/src/com/cloud/baremetal/manager/BareMetalT
> >>>em
> >> >plateAdapter.java
> >> >   |  6 --
> >> >
> >>
> >>>plugins/hypervisors/baremetal/src/com/cloud/baremetal/networkservice/Bar
> >>>em
> >> >etalDhcpElement.java
> >> >|  6 --
> >> > plugins/network-elements/dns-notifier/resources/components-example.xml
> >> >|  8 
> >> > server/src/com/cloud/network/NetworkServiceImpl.java
> >> >|  9 +++--
> >> > 9 files changed, 14 insertions(+), 45 deletions(-)
> >> >
> >> >
> >> >I've tested against the original blocker issues:
> >> >https://issues.apache.org/jira/browse/CLOUDSTACK-1610
> >> >https://issues.apache.org/jira/browse/CLOUDSTACK-1618
> >> >https://issues.apache.org/jira/browse/CLOUDSTACK-1614
> >> >https://issues.apache.org/jira/browse/CLOUDSTACK-1440
> >> >
> >> >They all passed.
> >> >
> >> >Can I say we're ready to re-enable the baremetal in master now?
> >> >
> >> >--Sheng
> >> >
> >>
> >>
> >>
> >
>
>
>

Re: Baremetal re-enabling

[Alena Prokharchyk]

On 6/18/13 2:44 PM, "Sheng Yang"  wrote:

>It seems no change has been done for db upgrade part(no reverting I
>meant).
>
>If it's incorrect someone please pointed out.

1) Check if these parameters are being inserted as a part of the upgrade
to 4.2:

"external,baremetal.resource.classname"
"external.baremetal.system.url"



Also would be good to replace "," with "." in the global config name

2) Check if the foreign keys below exist on fresh as well as upgraded
setups:

baremetal_dhcp_devices
 
`fk_external_dhcp_devices_nsp_id`
`fk_external_dhcp_devices_host_id`
`fk_external_dhcp_devices_pod_id`
`fk_external_dhcp_devices_physical_network_id`

 
 
baremetal_pxe_devices
 
`fk_external_pxe_devices_nsp_id`
`fk_external_pxe_devices_pod_id`
`fk_external_pxe_devices_host_id`
`fk_external_pxe_devices_physical_network_id`



-alena.


>
>--Sheng
>
>
>On Tue, Jun 18, 2013 at 2:29 PM, Alena Prokharchyk <
>alena.prokharc...@citrix.com> wrote:
>
>> Sheng, can you also check if all the DB upgrade related changes are
>>merged
>> back in as well? In case they were dropped at some point.
>>
>> -Alena.
>>
>> On 6/18/13 1:53 PM, "Sheng Yang"  wrote:
>>
>> >Hi,
>> >
>> >Due to absent of Frank, I've tried to make sure Baremetal wouldn't miss
>> >4.2. So for the last a few days work, I am able to re-enable baremetal
>>for
>> >master.
>> >
>> >It turn out the change is not big, and most of it just compose of
>>revert
>> >of
>> >previous change, and I fixed some issues brought by the new features.
>> >
>> >The total change summary is:
>> >
>> >--
>> > client/pom.xml
>> >|  5 +
>> > client/tomcatconf/applicationContext.xml.in
>> > |  4 
>> > client/tomcatconf/componentContext.xml.in
>> > | 10 --
>> > client/tomcatconf/nonossComponentContext.xml.in
>> > |  8 
>> >
>> 
>>>plugins/hypervisors/baremetal/src/com/cloud/baremetal/manager/BareMetalD
>>>is
>> >coverer.java
>> >|  3 ++-
>> >
>> 
>>>plugins/hypervisors/baremetal/src/com/cloud/baremetal/manager/BareMetalT
>>>em
>> >plateAdapter.java
>> >   |  6 --
>> >
>> 
>>>plugins/hypervisors/baremetal/src/com/cloud/baremetal/networkservice/Bar
>>>em
>> >etalDhcpElement.java
>> >|  6 --
>> > plugins/network-elements/dns-notifier/resources/components-example.xml
>> >|  8 
>> > server/src/com/cloud/network/NetworkServiceImpl.java
>> >|  9 +++--
>> > 9 files changed, 14 insertions(+), 45 deletions(-)
>> >
>> >
>> >I've tested against the original blocker issues:
>> >https://issues.apache.org/jira/browse/CLOUDSTACK-1610
>> >https://issues.apache.org/jira/browse/CLOUDSTACK-1618
>> >https://issues.apache.org/jira/browse/CLOUDSTACK-1614
>> >https://issues.apache.org/jira/browse/CLOUDSTACK-1440
>> >
>> >They all passed.
>> >
>> >Can I say we're ready to re-enable the baremetal in master now?
>> >
>> >--Sheng
>> >
>>
>>
>>
>

Re: Baremetal re-enabling

[Sheng Yang]

It seems no change has been done for db upgrade part(no reverting I meant).

If it's incorrect someone please pointed out.

--Sheng


On Tue, Jun 18, 2013 at 2:29 PM, Alena Prokharchyk <
alena.prokharc...@citrix.com> wrote:

> Sheng, can you also check if all the DB upgrade related changes are merged
> back in as well? In case they were dropped at some point.
>
> -Alena.
>
> On 6/18/13 1:53 PM, "Sheng Yang"  wrote:
>
> >Hi,
> >
> >Due to absent of Frank, I've tried to make sure Baremetal wouldn't miss
> >4.2. So for the last a few days work, I am able to re-enable baremetal for
> >master.
> >
> >It turn out the change is not big, and most of it just compose of revert
> >of
> >previous change, and I fixed some issues brought by the new features.
> >
> >The total change summary is:
> >
> >--
> > client/pom.xml
> >|  5 +
> > client/tomcatconf/applicationContext.xml.in
> > |  4 
> > client/tomcatconf/componentContext.xml.in
> > | 10 --
> > client/tomcatconf/nonossComponentContext.xml.in
> > |  8 
> >
> >plugins/hypervisors/baremetal/src/com/cloud/baremetal/manager/BareMetalDis
> >coverer.java
> >|  3 ++-
> >
> >plugins/hypervisors/baremetal/src/com/cloud/baremetal/manager/BareMetalTem
> >plateAdapter.java
> >   |  6 --
> >
> >plugins/hypervisors/baremetal/src/com/cloud/baremetal/networkservice/Barem
> >etalDhcpElement.java
> >|  6 --
> > plugins/network-elements/dns-notifier/resources/components-example.xml
> >|  8 
> > server/src/com/cloud/network/NetworkServiceImpl.java
> >|  9 +++--
> > 9 files changed, 14 insertions(+), 45 deletions(-)
> >
> >
> >I've tested against the original blocker issues:
> >https://issues.apache.org/jira/browse/CLOUDSTACK-1610
> >https://issues.apache.org/jira/browse/CLOUDSTACK-1618
> >https://issues.apache.org/jira/browse/CLOUDSTACK-1614
> >https://issues.apache.org/jira/browse/CLOUDSTACK-1440
> >
> >They all passed.
> >
> >Can I say we're ready to re-enable the baremetal in master now?
> >
> >--Sheng
> >
>
>
>

Re: [ANNOUNCE] New CloudStack PMC Member: John Burwell

[Kelcey Jamison Damage]

Congratulations John!

- Original Message -
From: "John Burwell" 
To: dev@cloudstack.apache.org
Sent: Tuesday, June 18, 2013 2:04:28 PM
Subject: Re: [ANNOUNCE] New CloudStack PMC Member: John Burwell

All,

I just wanted to thank the community for being so welcoming.  Since I started 
working on the project last September, I have greatly appreciated the 
community's openness to exploring new ideas and patience in explaining old 
concepts to a noob like me.

I look forward to continuing to help out,
-John

On Jun 5, 2013, at 2:51 AM, Radhika Puthiyetath 
 wrote:

> I thought John is already one :-)
> 
> Congrats John
> -Radhika
> 
> -Original Message-
> From: Chip Childers [mailto:chipchild...@apache.org] 
> Sent: Tuesday, June 04, 2013 7:05 PM
> To: dev@cloudstack.apache.org
> Subject: [ANNOUNCE] New CloudStack PMC Member: John Burwell
> 
> The Apache CloudStack PMC has invited John Burwell to join the PMC, and he 
> has accepted.  Congrats John!
> 
> -chip

Re: Baremetal re-enabling

[Alena Prokharchyk]

Sheng, can you also check if all the DB upgrade related changes are merged
back in as well? In case they were dropped at some point.

-Alena.

On 6/18/13 1:53 PM, "Sheng Yang"  wrote:

>Hi,
>
>Due to absent of Frank, I've tried to make sure Baremetal wouldn't miss
>4.2. So for the last a few days work, I am able to re-enable baremetal for
>master.
>
>It turn out the change is not big, and most of it just compose of revert
>of
>previous change, and I fixed some issues brought by the new features.
>
>The total change summary is:
>
>--
> client/pom.xml
>|  5 +
> client/tomcatconf/applicationContext.xml.in
> |  4 
> client/tomcatconf/componentContext.xml.in
> | 10 --
> client/tomcatconf/nonossComponentContext.xml.in
> |  8 
> 
>plugins/hypervisors/baremetal/src/com/cloud/baremetal/manager/BareMetalDis
>coverer.java
>|  3 ++-
> 
>plugins/hypervisors/baremetal/src/com/cloud/baremetal/manager/BareMetalTem
>plateAdapter.java
>   |  6 --
> 
>plugins/hypervisors/baremetal/src/com/cloud/baremetal/networkservice/Barem
>etalDhcpElement.java
>|  6 --
> plugins/network-elements/dns-notifier/resources/components-example.xml
>|  8 
> server/src/com/cloud/network/NetworkServiceImpl.java
>|  9 +++--
> 9 files changed, 14 insertions(+), 45 deletions(-)
>
>
>I've tested against the original blocker issues:
>https://issues.apache.org/jira/browse/CLOUDSTACK-1610
>https://issues.apache.org/jira/browse/CLOUDSTACK-1618
>https://issues.apache.org/jira/browse/CLOUDSTACK-1614
>https://issues.apache.org/jira/browse/CLOUDSTACK-1440
>
>They all passed.
>
>Can I say we're ready to re-enable the baremetal in master now?
>
>--Sheng
>

Re: [ANNOUNCE] New CloudStack PMC Member: John Burwell

[John Burwell]

All,

I just wanted to thank the community for being so welcoming.  Since I started 
working on the project last September, I have greatly appreciated the 
community's openness to exploring new ideas and patience in explaining old 
concepts to a noob like me.

I look forward to continuing to help out,
-John

On Jun 5, 2013, at 2:51 AM, Radhika Puthiyetath 
 wrote:

> I thought John is already one :-)
> 
> Congrats John
> -Radhika
> 
> -Original Message-
> From: Chip Childers [mailto:chipchild...@apache.org] 
> Sent: Tuesday, June 04, 2013 7:05 PM
> To: dev@cloudstack.apache.org
> Subject: [ANNOUNCE] New CloudStack PMC Member: John Burwell
> 
> The Apache CloudStack PMC has invited John Burwell to join the PMC, and he 
> has accepted.  Congrats John!
> 
> -chip

Baremetal re-enabling

[Sheng Yang]

Hi,

Due to absent of Frank, I've tried to make sure Baremetal wouldn't miss
4.2. So for the last a few days work, I am able to re-enable baremetal for
master.

It turn out the change is not big, and most of it just compose of revert of
previous change, and I fixed some issues brought by the new features.

The total change summary is:

--
 client/pom.xml
|  5 +
 client/tomcatconf/applicationContext.xml.in
 |  4 
 client/tomcatconf/componentContext.xml.in
 | 10 --
 client/tomcatconf/nonossComponentContext.xml.in
 |  8 
 
plugins/hypervisors/baremetal/src/com/cloud/baremetal/manager/BareMetalDiscoverer.java
|  3 ++-
 
plugins/hypervisors/baremetal/src/com/cloud/baremetal/manager/BareMetalTemplateAdapter.java
   |  6 --
 
plugins/hypervisors/baremetal/src/com/cloud/baremetal/networkservice/BaremetalDhcpElement.java
|  6 --
 plugins/network-elements/dns-notifier/resources/components-example.xml
|  8 
 server/src/com/cloud/network/NetworkServiceImpl.java
|  9 +++--
 9 files changed, 14 insertions(+), 45 deletions(-)


I've tested against the original blocker issues:
https://issues.apache.org/jira/browse/CLOUDSTACK-1610
https://issues.apache.org/jira/browse/CLOUDSTACK-1618
https://issues.apache.org/jira/browse/CLOUDSTACK-1614
https://issues.apache.org/jira/browse/CLOUDSTACK-1440

They all passed.

Can I say we're ready to re-enable the baremetal in master now?

--Sheng

Review Request: ProcessUtil cleanup

[Laszlo Hornyak]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/11942/
---

Review request for cloudstack.


Description
---

- possible resource leak closed
- file content read uses now commons-lang FileUtils
- Added unit tests


Diffs
-

  utils/src/com/cloud/utils/ProcessUtil.java c9fdf35 
  utils/test/com/cloud/utils/ProcessUtilTest.java PRE-CREATION 

Diff: https://reviews.apache.org/r/11942/diff/


Testing
---

test included


Thanks,

Laszlo Hornyak

RE: Git Push Summary

[Jessica Wang]

Chip,

> all my fixes that I've put to this branch, were originally committed to 
> master.
Me, too.

Jessica

-Original Message-
From: Alena Prokharchyk 
Sent: Tuesday, June 18, 2013 12:32 PM
To: Chip Childers; dev@cloudstack.apache.org
Cc: Jessica Wang; Min Chen
Subject: Re: Git Push Summary

Chip, all my fixes that I've put to this branch, were originally committed
to master. I cherry-picked them to the master-6-17-stable.


commit 5d0a1cee13fb3006f3e35cd221e553587ea20ce2
Author: Alena Prokharchyk 
Date:   Mon Jun 17 16:10:12 2013 -0700

CLOUDSTACK-2883: create default network offering with internal lb
support (if doesn't exist already)

commit 952fa2464da9f10b63fbba869922ee735c231c42
Author: Alena Prokharchyk 
Date:   Mon Jun 17 10:50:22 2013 -0700

LOUDSTACK-2914: handle situation when serviceProvider map is empty

commit fc16e29f992d81156a4e08a77da215f8276f4efe
Author: Alena Prokharchyk 
Date:   Mon Jun 17 10:09:52 2013 -0700

CLOUDSTACK-2914: default lb scheme to Public when the service LB is
enabled, and scheme is not specified explicitly



-Alena.


On 6/18/13 11:59 AM, "Chip Childers"  wrote:

>Min, Jessica, Alena,
>
>What's going on in this branch?
>
>The commits are curious.  Are these fixes going into master?
>
>On Mon, Jun 17, 2013 at 07:37:52PM +, Chiradeep Vittal wrote:
>> David, this is a temporary scratch branch to perform some integration
>> testing since atm the master looks stable.
>> 
>> On 6/17/13 11:57 AM, "David Nalley"  wrote:
>> 
>> >What is this branch for?
>> >On Jun 17, 2013 1:27 PM,  wrote:
>> >
>> >> Updated Branches:
>> >>   refs/heads/master-6-17-stable [created] fc16e29f9
>> >>
>> 
>> 
>

Re: Query String Request Authentication(QSRA) support by S3 providers

[Min Chen]

John,
In that case, how do we keep backward compatibility of extractTemplate
api, which requires a URL in the response?

Thanks
-min

On 6/18/13 11:53 AM, "John Burwell"  wrote:

>Min,
>
>Looking through the code, I think we can simplify driver operation and
>increase robustness by changing ImageStoreDriver#createEntityExtractUrl()
>: String to ImageStoreDriver#readEntity(Š) : InputStream.  My first
>concern with the current implementation is that it circumvents any
>connection pooling/resource management underlying client libraries
>provide.  I/O streams provide a higher-level abstraction that allows
>drivers to provide the orchestration components with actual resources
>rather String references.  Second, the current interface seems to appears
>to assume that an http/https URL will be returned.  With I/O streams, we
>can support any client library capable of using the standard I/O
>framework -- enabling us to support other protocols for downloading
>templates in the future (e.g. RBD, local filesystem, NBD, etc).
>
>Thanks,
>-John
>
>On Jun 18, 2013, at 1:11 PM, Min Chen  wrote:
>
>> A new version of using generatePresignedUrl in S3ImageStoreDriverImpl is
>> checked into object_store.
>> 
>> THanks
>> -min
>> 
>> On 6/18/13 8:29 AM, "Min Chen"  wrote:
>> 
>>> Yes, current code is in S3ImageStoreDriverImpl.createEntityExtractUrl,
>>> which has a security issue mentioned in CLOUDSTACK-3030. I am going to
>>> change it to use generatePresignedUrl api from AWS S3 api.
>>> 
>>> Thanks
>>> -min
>>> 
>>> From: John Burwell mailto:jburw...@basho.com>>
>>> Date: Tuesday, June 18, 2013 8:07 AM
>>> To: Min Chen mailto:min.c...@citrix.com>>
>>> Cc: Thomas O'Dowd mailto:tpod...@cloudian.com>>,
>>> "dev@cloudstack.apache.org"
>>> mailto:dev@cloudstack.apache.org>>
>>> Subject: Re: Query String Request Authentication(QSRA) support by S3
>>> providers
>>> 
>>> Min,
>>> 
>>> Is the code checked into the object_store branch?  If so, which lines
>>>in
>>> S3TemplateDownloader?
>>> 
>>> Thanks,
>>> -John
>>> 
>>> On Jun 18, 2013, at 12:39 AM, Min Chen
>>> mailto:min.c...@citrix.com>> wrote:
>>> 
>>> Hi John,
>>> 
>>> This is regarding extractTemplate api, where for extractable template,
>>> users can click "Download Template" button from UI to get a http url to
>>> download the template already stored at S3 without providing S3
>>> credentials. In 4.1, we don't have this issue, since the URL returned
>>>is
>>> the public web server location hosted in ssvm, and in 4.2, we are
>>> returning URL pointing to s3 object. Without setting ACL to the S3
>>> object, user cannot directly click the URL returned  from
>>>extractTemplate
>>> api to download the template without providing credentials. By reading
>>> the AWS SDK doc today, I ran across the following API that I may be
>>>able
>>> to use for this purpose:
>>> 
>>> 
>>> 
>>>URL>>l=
>>> true>
>>> 
>>>generatePresignedUrl>>c/
>>> 
>>>com/amazonaws/services/s3/AmazonS3Client.html#generatePresignedUrl%28jav
>>>a.
>>> 
>>>lang.String,%20java.lang.String,%20java.util.Date,%20com.amazonaws.HttpM
>>>et
>>> 
>>>hod%29>(String>>ht
>>> ml?is-external=true> bucketName,
>>> 
>>>String>>ex
>>> ternal=true> key,
>>> 
>>>Date>>rn
>>> al=true> expiration,
>>> 
>>>HttpMethod>>on
>>> aws/HttpMethod.html> method)
>>>  Returns a pre-signed URL for accessing an Amazon S3 resource.
>>> 
>>> This is along the same line as QSRA mentioned by Tom, by wrapped in
>>> AmazonS3Client for easy consumption. By using this method, I think
>>>that I
>>> don't need to change ACL of S3 object to open a security hole.
>>> 
>>> Thanks
>>> -min
>>> 
>>> From: John Burwell mailto:jburw...@basho.com>>
>>> Date: Monday, June 17, 2013 7:38 PM
>>> To: Min Chen mailto:min.c...@citrix.com>>
>>> Cc: Thomas O'Dowd mailto:tpod...@cloudian.com>>,
>>> "dev@cloudstack.apache.org"
>>> mailto:dev@cloudstack.apache.org>>
>>> Subject: Re: Query String Request Authentication(QSRA) support by S3
>>> providers
>>> 
>>> Min,
>>> 
>>> Why are we mucking with ACLs at all?  The best security practice would
>>>be
>>> to create a bucket for CloudStack's use and assign it a dedicated
>>>access
>>> key and secret key pair with read/write access only to that bucket.
>>> Requiring an administrative account to an object store opens an
>>> unnecessarily large attack surface.  Therefore, as implemented in 4.1,
>>>we
>>> should defer bucket creation, ACL assignment, and credential creation
>>>to
>>> the administrator/operator.
>>> 
>>> Thanks,
>>> -John
>>> 
>>> On 

Re: Git Push Summary

[Min Chen]

Yes, my commit is also pushed master.

Thanks
-min

On 6/18/13 12:34 PM, "Chip Childers"  wrote:

>Gotcha!
>
>So are you folks using this branch to do some testing now?  Sounds like
>a great idea to start testing before the last big merges come in.
>
>-chip
>
>On Tue, Jun 18, 2013 at 07:32:10PM +, Alena Prokharchyk wrote:
>> Chip, all my fixes that I've put to this branch, were originally
>>committed
>> to master. I cherry-picked them to the master-6-17-stable.
>> 
>> 
>> commit 5d0a1cee13fb3006f3e35cd221e553587ea20ce2
>> Author: Alena Prokharchyk 
>> Date:   Mon Jun 17 16:10:12 2013 -0700
>> 
>> CLOUDSTACK-2883: create default network offering with internal lb
>> support (if doesn't exist already)
>> 
>> commit 952fa2464da9f10b63fbba869922ee735c231c42
>> Author: Alena Prokharchyk 
>> Date:   Mon Jun 17 10:50:22 2013 -0700
>> 
>> LOUDSTACK-2914: handle situation when serviceProvider map is empty
>> 
>> commit fc16e29f992d81156a4e08a77da215f8276f4efe
>> Author: Alena Prokharchyk 
>> Date:   Mon Jun 17 10:09:52 2013 -0700
>> 
>> CLOUDSTACK-2914: default lb scheme to Public when the service LB is
>> enabled, and scheme is not specified explicitly
>> 
>> 
>> 
>> -Alena.
>> 
>> 
>> On 6/18/13 11:59 AM, "Chip Childers"  wrote:
>> 
>> >Min, Jessica, Alena,
>> >
>> >What's going on in this branch?
>> >
>> >The commits are curious.  Are these fixes going into master?
>> >
>> >On Mon, Jun 17, 2013 at 07:37:52PM +, Chiradeep Vittal wrote:
>> >> David, this is a temporary scratch branch to perform some integration
>> >> testing since atm the master looks stable.
>> >> 
>> >> On 6/17/13 11:57 AM, "David Nalley"  wrote:
>> >> 
>> >> >What is this branch for?
>> >> >On Jun 17, 2013 1:27 PM,  wrote:
>> >> >
>> >> >> Updated Branches:
>> >> >>   refs/heads/master-6-17-stable [created] fc16e29f9
>> >> >>
>> >> 
>> >> 
>> >
>> 
>> 
>> 

Re: Git Push Summary

[Chip Childers]

Gotcha!

So are you folks using this branch to do some testing now?  Sounds like
a great idea to start testing before the last big merges come in.

-chip

On Tue, Jun 18, 2013 at 07:32:10PM +, Alena Prokharchyk wrote:
> Chip, all my fixes that I've put to this branch, were originally committed
> to master. I cherry-picked them to the master-6-17-stable.
> 
> 
> commit 5d0a1cee13fb3006f3e35cd221e553587ea20ce2
> Author: Alena Prokharchyk 
> Date:   Mon Jun 17 16:10:12 2013 -0700
> 
> CLOUDSTACK-2883: create default network offering with internal lb
> support (if doesn't exist already)
> 
> commit 952fa2464da9f10b63fbba869922ee735c231c42
> Author: Alena Prokharchyk 
> Date:   Mon Jun 17 10:50:22 2013 -0700
> 
> LOUDSTACK-2914: handle situation when serviceProvider map is empty
> 
> commit fc16e29f992d81156a4e08a77da215f8276f4efe
> Author: Alena Prokharchyk 
> Date:   Mon Jun 17 10:09:52 2013 -0700
> 
> CLOUDSTACK-2914: default lb scheme to Public when the service LB is
> enabled, and scheme is not specified explicitly
> 
> 
> 
> -Alena.
> 
> 
> On 6/18/13 11:59 AM, "Chip Childers"  wrote:
> 
> >Min, Jessica, Alena,
> >
> >What's going on in this branch?
> >
> >The commits are curious.  Are these fixes going into master?
> >
> >On Mon, Jun 17, 2013 at 07:37:52PM +, Chiradeep Vittal wrote:
> >> David, this is a temporary scratch branch to perform some integration
> >> testing since atm the master looks stable.
> >> 
> >> On 6/17/13 11:57 AM, "David Nalley"  wrote:
> >> 
> >> >What is this branch for?
> >> >On Jun 17, 2013 1:27 PM,  wrote:
> >> >
> >> >> Updated Branches:
> >> >>   refs/heads/master-6-17-stable [created] fc16e29f9
> >> >>
> >> 
> >> 
> >
> 
> 
> 

Re: Git Push Summary

[Alena Prokharchyk]

Chip, all my fixes that I've put to this branch, were originally committed
to master. I cherry-picked them to the master-6-17-stable.


commit 5d0a1cee13fb3006f3e35cd221e553587ea20ce2
Author: Alena Prokharchyk 
Date:   Mon Jun 17 16:10:12 2013 -0700

CLOUDSTACK-2883: create default network offering with internal lb
support (if doesn't exist already)

commit 952fa2464da9f10b63fbba869922ee735c231c42
Author: Alena Prokharchyk 
Date:   Mon Jun 17 10:50:22 2013 -0700

LOUDSTACK-2914: handle situation when serviceProvider map is empty

commit fc16e29f992d81156a4e08a77da215f8276f4efe
Author: Alena Prokharchyk 
Date:   Mon Jun 17 10:09:52 2013 -0700

CLOUDSTACK-2914: default lb scheme to Public when the service LB is
enabled, and scheme is not specified explicitly



-Alena.


On 6/18/13 11:59 AM, "Chip Childers"  wrote:

>Min, Jessica, Alena,
>
>What's going on in this branch?
>
>The commits are curious.  Are these fixes going into master?
>
>On Mon, Jun 17, 2013 at 07:37:52PM +, Chiradeep Vittal wrote:
>> David, this is a temporary scratch branch to perform some integration
>> testing since atm the master looks stable.
>> 
>> On 6/17/13 11:57 AM, "David Nalley"  wrote:
>> 
>> >What is this branch for?
>> >On Jun 17, 2013 1:27 PM,  wrote:
>> >
>> >> Updated Branches:
>> >>   refs/heads/master-6-17-stable [created] fc16e29f9
>> >>
>> 
>> 
>

Re: Review Request: removed 3 NumbersUtils methods

[Chip Childers]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/11894/#review22071
---


I'm still seeing merge failures using both git am and git apply.

error: patch failed: 
plugins/affinity-group-processors/host-anti-affinity/src/org/apache/cloudstack/affinity/HostAntiAffinityProcessor.java:25

Are you basing this off of HEAD on master?

Thanks for the second attempt!

- Chip Childers


On June 18, 2013, 7:21 p.m., Laszlo Hornyak wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/11894/
> ---
> 
> (Updated June 18, 2013, 7:21 p.m.)
> 
> 
> Review request for cloudstack.
> 
> 
> Description
> ---
> 
> Removed parseInt, parseLong and parseFloat and replaced with calls to 
> commons-lang NumberUtils
> 
> 
> Diffs
> -
> 
>   agent/src/com/cloud/agent/AgentShell.java cf454b8 
>   agent/src/com/cloud/agent/VmmAgentShell.java 190d116 
>   agent/src/com/cloud/agent/resource/consoleproxy/ConsoleProxyResource.java 
> 991764c 
>   
> core/src/com/cloud/agent/resource/virtualnetwork/VirtualRoutingResource.java 
> dae1c85 
>   core/src/com/cloud/storage/template/TemplateLocation.java 58d023a 
>   
> engine/orchestration/src/org/apache/cloudstack/engine/datacenter/entity/api/db/dao/EngineDataCenterDaoImpl.java
>  f99bc6c 
>   engine/schema/src/com/cloud/dc/dao/DataCenterDaoImpl.java 503306f 
>   engine/schema/src/com/cloud/upgrade/dao/Upgrade218to22.java 2ef842a 
>   
> engine/storage/snapshot/src/org/apache/cloudstack/storage/snapshot/strategy/AncientSnapshotStrategy.java
>  4aba3d9 
>   
> engine/storage/src/org/apache/cloudstack/storage/allocator/AbstractStoragePoolAllocator.java
>  5326701 
>   
> engine/storage/src/org/apache/cloudstack/storage/allocator/LocalStoragePoolAllocator.java
>  632ba43 
>   
> engine/storage/src/org/apache/cloudstack/storage/motion/AncientDataMotionStrategy.java
>  a6880c3 
>   
> plugins/affinity-group-processors/host-anti-affinity/src/org/apache/cloudstack/affinity/HostAntiAffinityProcessor.java
>  6c3f57f 
>   
> plugins/dedicated-resources/src/org/apache/cloudstack/dedicated/DedicatedResourceManagerImpl.java
>  c321b22 
>   
> plugins/deployment-planners/implicit-dedication/src/com/cloud/deploy/ImplicitDedicationPlanner.java
>  be016cb 
>   
> plugins/deployment-planners/user-dispersing/src/com/cloud/deploy/UserDispersingPlanner.java
>  2b0b158 
>   
> plugins/hypervisors/kvm/src/com/cloud/hypervisor/kvm/resource/BridgeVifDriver.java
>  b897df2 
>   
> plugins/hypervisors/kvm/src/com/cloud/hypervisor/kvm/resource/LibvirtComputingResource.java
>  7d90f6a 
>   
> plugins/hypervisors/kvm/src/com/cloud/hypervisor/kvm/resource/OvsVifDriver.java
>  eac3248 
>   
> plugins/hypervisors/vmware/src/com/cloud/hypervisor/vmware/manager/VmwareManagerImpl.java
>  a604392 
>   
> plugins/hypervisors/vmware/src/com/cloud/hypervisor/vmware/manager/VmwareStorageManagerImpl.java
>  4ae0f30 
>   
> plugins/hypervisors/xen/src/com/cloud/hypervisor/xen/discoverer/XcpServerDiscoverer.java
>  5b6b546 
>   
> plugins/hypervisors/xen/src/com/cloud/hypervisor/xen/resource/CitrixResourceBase.java
>  5e8283a 
>   
> plugins/network-elements/cisco-vnmc/src/com/cloud/network/resource/CiscoVnmcResource.java
>  9524bf9 
>   
> plugins/network-elements/elastic-loadbalancer/src/com/cloud/network/lb/ElasticLoadBalancerManagerImpl.java
>  b21e8f9 
>   
> plugins/network-elements/f5/src/com/cloud/network/element/F5ExternalLoadBalancerElement.java
>  80b42e0 
>   
> plugins/network-elements/f5/src/com/cloud/network/resource/F5BigIpResource.java
>  1733712 
>   
> plugins/network-elements/juniper-srx/src/com/cloud/network/element/JuniperSRXExternalFirewallElement.java
>  c00d99a 
>   
> plugins/network-elements/juniper-srx/src/com/cloud/network/resource/JuniperSrxResource.java
>  fd065d5 
>   
> plugins/network-elements/midonet/src/com/cloud/network/resource/MidoNetVifDriver.java
>  3c7c23d 
>   
> plugins/network-elements/netscaler/src/com/cloud/network/element/NetscalerElement.java
>  13a6900 
>   
> plugins/network-elements/netscaler/src/com/cloud/network/resource/NetscalerResource.java
>  263e13b 
>   
> plugins/storage/volume/default/src/org/apache/cloudstack/storage/datastore/lifecycle/CloudStackPrimaryDataStoreLifeCycleImpl.java
>  fb37e8f 
>   server/src/com/cloud/agent/manager/AgentManagerImpl.java 6baeecf 
>   server/src/com/cloud/agent/manager/ClusteredAgentManagerImpl.java 3ce60b7 
>   server/src/com/cloud/agent/manager/allocator/impl/FirstFitAllocator.java 
> b6286aa 
>   
> server/src/com/cloud/agent/manager/allocator/impl/UserConcentratedAllocator.java
>  29e1be9 
>   server/src/com/cloud/alert/AlertManagerImpl.java 9b7cd27 
>   server/src/com/cloud/api/ApiDBUtils.java e5fa2e1 
>   server/sr

Re: Review Request: removed 3 NumbersUtils methods

[Laszlo Hornyak]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/11894/
---

(Updated June 18, 2013, 7:21 p.m.)


Review request for cloudstack.


Description
---

Removed parseInt, parseLong and parseFloat and replaced with calls to 
commons-lang NumberUtils


Diffs (updated)
-

  agent/src/com/cloud/agent/AgentShell.java cf454b8 
  agent/src/com/cloud/agent/VmmAgentShell.java 190d116 
  agent/src/com/cloud/agent/resource/consoleproxy/ConsoleProxyResource.java 
991764c 
  core/src/com/cloud/agent/resource/virtualnetwork/VirtualRoutingResource.java 
dae1c85 
  core/src/com/cloud/storage/template/TemplateLocation.java 58d023a 
  
engine/orchestration/src/org/apache/cloudstack/engine/datacenter/entity/api/db/dao/EngineDataCenterDaoImpl.java
 f99bc6c 
  engine/schema/src/com/cloud/dc/dao/DataCenterDaoImpl.java 503306f 
  engine/schema/src/com/cloud/upgrade/dao/Upgrade218to22.java 2ef842a 
  
engine/storage/snapshot/src/org/apache/cloudstack/storage/snapshot/strategy/AncientSnapshotStrategy.java
 4aba3d9 
  
engine/storage/src/org/apache/cloudstack/storage/allocator/AbstractStoragePoolAllocator.java
 5326701 
  
engine/storage/src/org/apache/cloudstack/storage/allocator/LocalStoragePoolAllocator.java
 632ba43 
  
engine/storage/src/org/apache/cloudstack/storage/motion/AncientDataMotionStrategy.java
 a6880c3 
  
plugins/affinity-group-processors/host-anti-affinity/src/org/apache/cloudstack/affinity/HostAntiAffinityProcessor.java
 6c3f57f 
  
plugins/dedicated-resources/src/org/apache/cloudstack/dedicated/DedicatedResourceManagerImpl.java
 c321b22 
  
plugins/deployment-planners/implicit-dedication/src/com/cloud/deploy/ImplicitDedicationPlanner.java
 be016cb 
  
plugins/deployment-planners/user-dispersing/src/com/cloud/deploy/UserDispersingPlanner.java
 2b0b158 
  
plugins/hypervisors/kvm/src/com/cloud/hypervisor/kvm/resource/BridgeVifDriver.java
 b897df2 
  
plugins/hypervisors/kvm/src/com/cloud/hypervisor/kvm/resource/LibvirtComputingResource.java
 7d90f6a 
  
plugins/hypervisors/kvm/src/com/cloud/hypervisor/kvm/resource/OvsVifDriver.java 
eac3248 
  
plugins/hypervisors/vmware/src/com/cloud/hypervisor/vmware/manager/VmwareManagerImpl.java
 a604392 
  
plugins/hypervisors/vmware/src/com/cloud/hypervisor/vmware/manager/VmwareStorageManagerImpl.java
 4ae0f30 
  
plugins/hypervisors/xen/src/com/cloud/hypervisor/xen/discoverer/XcpServerDiscoverer.java
 5b6b546 
  
plugins/hypervisors/xen/src/com/cloud/hypervisor/xen/resource/CitrixResourceBase.java
 5e8283a 
  
plugins/network-elements/cisco-vnmc/src/com/cloud/network/resource/CiscoVnmcResource.java
 9524bf9 
  
plugins/network-elements/elastic-loadbalancer/src/com/cloud/network/lb/ElasticLoadBalancerManagerImpl.java
 b21e8f9 
  
plugins/network-elements/f5/src/com/cloud/network/element/F5ExternalLoadBalancerElement.java
 80b42e0 
  
plugins/network-elements/f5/src/com/cloud/network/resource/F5BigIpResource.java 
1733712 
  
plugins/network-elements/juniper-srx/src/com/cloud/network/element/JuniperSRXExternalFirewallElement.java
 c00d99a 
  
plugins/network-elements/juniper-srx/src/com/cloud/network/resource/JuniperSrxResource.java
 fd065d5 
  
plugins/network-elements/midonet/src/com/cloud/network/resource/MidoNetVifDriver.java
 3c7c23d 
  
plugins/network-elements/netscaler/src/com/cloud/network/element/NetscalerElement.java
 13a6900 
  
plugins/network-elements/netscaler/src/com/cloud/network/resource/NetscalerResource.java
 263e13b 
  
plugins/storage/volume/default/src/org/apache/cloudstack/storage/datastore/lifecycle/CloudStackPrimaryDataStoreLifeCycleImpl.java
 fb37e8f 
  server/src/com/cloud/agent/manager/AgentManagerImpl.java 6baeecf 
  server/src/com/cloud/agent/manager/ClusteredAgentManagerImpl.java 3ce60b7 
  server/src/com/cloud/agent/manager/allocator/impl/FirstFitAllocator.java 
b6286aa 
  
server/src/com/cloud/agent/manager/allocator/impl/UserConcentratedAllocator.java
 29e1be9 
  server/src/com/cloud/alert/AlertManagerImpl.java 9b7cd27 
  server/src/com/cloud/api/ApiDBUtils.java e5fa2e1 
  server/src/com/cloud/api/ApiServer.java 0cd1d61 
  server/src/com/cloud/async/AsyncJobManagerImpl.java 0101a8a 
  server/src/com/cloud/capacity/CapacityManagerImpl.java e58ae40 
  server/src/com/cloud/cluster/ClusterManagerImpl.java 118de41 
  server/src/com/cloud/cluster/ClusterServiceServletAdapter.java 04026d30 
  server/src/com/cloud/configuration/ConfigurationManagerImpl.java e7e3f74 
  server/src/com/cloud/consoleproxy/AgentBasedConsoleProxyManager.java df53e0d 
  server/src/com/cloud/consoleproxy/ConsoleProxyManagerImpl.java 7362cf1 
  server/src/com/cloud/consoleproxy/StaticConsoleProxyManager.java 7b59a6b 
  server/src/com/cloud/deploy/DeploymentPlanningManagerImpl.java eb895e5 
  server/src/com/cloud/deploy/FirstFitPlanner.java 7124de2 
  server/src/com/cloud/ha/HighAvailabilityManagerImpl.java 25c5a04 
  

Re: Git Push Summary

[Chip Childers]

Min, Jessica, Alena,

What's going on in this branch?

The commits are curious.  Are these fixes going into master?

On Mon, Jun 17, 2013 at 07:37:52PM +, Chiradeep Vittal wrote:
> David, this is a temporary scratch branch to perform some integration
> testing since atm the master looks stable.
> 
> On 6/17/13 11:57 AM, "David Nalley"  wrote:
> 
> >What is this branch for?
> >On Jun 17, 2013 1:27 PM,  wrote:
> >
> >> Updated Branches:
> >>   refs/heads/master-6-17-stable [created] fc16e29f9
> >>
> 
> 

Re: Query String Request Authentication(QSRA) support by S3 providers

[John Burwell]

Min,

Looking through the code, I think we can simplify driver operation and increase 
robustness by changing ImageStoreDriver#createEntityExtractUrl() : String to 
ImageStoreDriver#readEntity(…) : InputStream.  My first concern with the 
current implementation is that it circumvents any connection pooling/resource 
management underlying client libraries provide.  I/O streams provide a 
higher-level abstraction that allows drivers to provide the orchestration 
components with actual resources rather String references.  Second, the current 
interface seems to appears to assume that an http/https URL will be returned.  
With I/O streams, we can support any client library capable of using the 
standard I/O framework -- enabling us to support other protocols for 
downloading templates in the future (e.g. RBD, local filesystem, NBD, etc).

Thanks,
-John

On Jun 18, 2013, at 1:11 PM, Min Chen  wrote:

> A new version of using generatePresignedUrl in S3ImageStoreDriverImpl is
> checked into object_store.
> 
> THanks
> -min
> 
> On 6/18/13 8:29 AM, "Min Chen"  wrote:
> 
>> Yes, current code is in S3ImageStoreDriverImpl.createEntityExtractUrl,
>> which has a security issue mentioned in CLOUDSTACK-3030. I am going to
>> change it to use generatePresignedUrl api from AWS S3 api.
>> 
>> Thanks
>> -min
>> 
>> From: John Burwell mailto:jburw...@basho.com>>
>> Date: Tuesday, June 18, 2013 8:07 AM
>> To: Min Chen mailto:min.c...@citrix.com>>
>> Cc: Thomas O'Dowd mailto:tpod...@cloudian.com>>,
>> "dev@cloudstack.apache.org"
>> mailto:dev@cloudstack.apache.org>>
>> Subject: Re: Query String Request Authentication(QSRA) support by S3
>> providers
>> 
>> Min,
>> 
>> Is the code checked into the object_store branch?  If so, which lines in
>> S3TemplateDownloader?
>> 
>> Thanks,
>> -John
>> 
>> On Jun 18, 2013, at 12:39 AM, Min Chen
>> mailto:min.c...@citrix.com>> wrote:
>> 
>> Hi John,
>> 
>> This is regarding extractTemplate api, where for extractable template,
>> users can click "Download Template" button from UI to get a http url to
>> download the template already stored at S3 without providing S3
>> credentials. In 4.1, we don't have this issue, since the URL returned is
>> the public web server location hosted in ssvm, and in 4.2, we are
>> returning URL pointing to s3 object. Without setting ACL to the S3
>> object, user cannot directly click the URL returned  from extractTemplate
>> api to download the template without providing credentials. By reading
>> the AWS SDK doc today, I ran across the following API that I may be able
>> to use for this purpose:
>> 
>> 
>> URL> true>
>> generatePresignedUrl> com/amazonaws/services/s3/AmazonS3Client.html#generatePresignedUrl%28java.
>> lang.String,%20java.lang.String,%20java.util.Date,%20com.amazonaws.HttpMet
>> hod%29>(String> ml?is-external=true> bucketName,
>> String> ternal=true> key, 
>> Date> al=true> expiration,
>> HttpMethod> aws/HttpMethod.html> method)
>>  Returns a pre-signed URL for accessing an Amazon S3 resource.
>> 
>> This is along the same line as QSRA mentioned by Tom, by wrapped in
>> AmazonS3Client for easy consumption. By using this method, I think that I
>> don't need to change ACL of S3 object to open a security hole.
>> 
>> Thanks
>> -min
>> 
>> From: John Burwell mailto:jburw...@basho.com>>
>> Date: Monday, June 17, 2013 7:38 PM
>> To: Min Chen mailto:min.c...@citrix.com>>
>> Cc: Thomas O'Dowd mailto:tpod...@cloudian.com>>,
>> "dev@cloudstack.apache.org"
>> mailto:dev@cloudstack.apache.org>>
>> Subject: Re: Query String Request Authentication(QSRA) support by S3
>> providers
>> 
>> Min,
>> 
>> Why are we mucking with ACLs at all?  The best security practice would be
>> to create a bucket for CloudStack's use and assign it a dedicated access
>> key and secret key pair with read/write access only to that bucket.
>> Requiring an administrative account to an object store opens an
>> unnecessarily large attack surface.  Therefore, as implemented in 4.1, we
>> should defer bucket creation, ACL assignment, and credential creation to
>> the administrator/operator.
>> 
>> Thanks,
>> -John
>> 
>> On Jun 17, 2013, at 1:15 PM, Min Chen
>> mailto:min.c...@citrix.com>> wrote:
>> 
>> Tom filed a very good bug for ACL setting change on S3 object when users
>> issue extractTemplate API
>> (https://issues.apache.org/jira/browse/CLOUDSTACK-3030), and his
>> recommendation of using Query String Request Authentication (QSRA)
>> alternative sounds like a right approach to fix this bug. Before
>> imple

Re: Cannot log in to fresh install as admin

[David Nalley]

On Tue, Jun 18, 2013 at 2:36 PM, SuichII, Christopher
 wrote:
> Well, I've finally got it working…not sure how or why, though.
>
> Wei, it looks like it may be a timing thing. I'll have to keep looking in to 
> that, but the other install (which this is a VM clone of and is running on 
> the same machine) has never had this issue.
>
> David, is this in the root CloudStack directory? I'm not seeing a 
> catalina.out. I've been tailing api.log and vmops.log when looking for logs.
>

Assuming 4.1 - should be in /var/log/cloudstack/management/catalina.out

--David

Re: Cannot log in to fresh install as admin

[SuichII, Christopher]

Well, I've finally got it working…not sure how or why, though.

Wei, it looks like it may be a timing thing. I'll have to keep looking in to 
that, but the other install (which this is a VM clone of and is running on the 
same machine) has never had this issue.

David, is this in the root CloudStack directory? I'm not seeing a catalina.out. 
I've been tailing api.log and vmops.log when looking for logs.

-Chris

On Jun 18, 2013, at 2:21 PM, David Nalley 
 wrote:

> Chris - take a look at catalina.out and see whats there - it will
> likely tell you why the management server isn't starting.
> 
> --David
> 
> On Tue, Jun 18, 2013 at 2:00 PM, SuichII, Christopher
>  wrote:
>> This is what is logged when I attempt to log in:
>> 
>> 2013-06-18 13:59:25,450 DEBUG [cloud.api.ApiServlet] 
>> (1516814774@qtp-1413016515-4:null) ===START===  10.61.25.162 -- POST  null
>> 2013-06-18 13:59:25,457 DEBUG [cloud.user.AccountManagerImpl] 
>> (1516814774@qtp-1413016515-4:null) Attempting to log in user: admin in 
>> domain 1
>> 2013-06-18 13:59:25,457 DEBUG [server.auth.SHA256SaltedUserAuthenticator] 
>> (1516814774@qtp-1413016515-4:null) Retrieving user: admin
>> 2013-06-18 13:59:25,469 DEBUG [cloud.user.AccountManagerImpl] 
>> (1516814774@qtp-1413016515-4:null) User: admin in domain 1 has successfully 
>> logged in
>> 2013-06-18 13:59:25,491 DEBUG [cloud.api.ApiServlet] 
>> (1516814774@qtp-1413016515-4:null) ===END===  10.61.25.162 -- POST  null
>> 2013-06-18 13:59:25,501 DEBUG [cloud.api.ApiServlet] 
>> (1516814774@qtp-1413016515-4:null) ===START===  10.61.25.162 -- GET  
>> command=listCapabilities&response=json&sessionkey=bF5nZqmg1r%2F2u5NltZDSRHqz%2Fbc%3D&_=1371578368902
>> 2013-06-18 13:59:25,520 DEBUG [cloud.api.ApiServer] 
>> (1516814774@qtp-1413016515-4:null) The given command:listCapabilities does 
>> not exist or it is not available for user with id:2
>> 2013-06-18 13:59:25,521 DEBUG [cloud.api.ApiServlet] 
>> (1516814774@qtp-1413016515-4:null) ===END===  10.61.25.162 -- GET  
>> command=listCapabilities&response=json&sessionkey=bF5nZqmg1r%2F2u5NltZDSRHqz%2Fbc%3D&_=1371578368902
>> 2013-06-18 13:59:25,528 DEBUG [cloud.api.ApiServlet] 
>> (1516814774@qtp-1413016515-4:null) ===START===  10.61.25.162 -- GET  
>> command=listSwifts&response=json&sessionkey=bF5nZqmg1r%2F2u5NltZDSRHqz%2Fbc%3D&_=1371578368929
>> 2013-06-18 13:59:25,543 DEBUG [cloud.api.ApiServer] 
>> (1516814774@qtp-1413016515-4:null) The given command:listSwifts does not 
>> exist or it is not available for user with id:2
>> 2013-06-18 13:59:25,544 DEBUG [cloud.api.ApiServlet] 
>> (1516814774@qtp-1413016515-4:null) ===END===  10.61.25.162 -- GET  
>> command=listSwifts&response=json&sessionkey=bF5nZqmg1r%2F2u5NltZDSRHqz%2Fbc%3D&_=1371578368929
>> 
>> 
>> 
>> 
>> 
>> On Jun 18, 2013, at 1:45 PM, "SuichII, Christopher"  
>> wrote:
>> 
>>> I have another installation that is up and running fine, so I copied the 
>>> hashed admin password into the new installation's database an set the state 
>>> to enabled. Now attempting to log in produces this popup in the UI:
>>> 
>>> "The given command does not exist or it is not available for user"
>>> 
>>> Any thoughts?
>>> 
>>> -Chris
>>> 
>>> On Jun 18, 2013, at 11:04 AM, "SuichII, Christopher" 
>>>  wrote:
>>> 
 Nope. I just pulled, clean installed and deployed the db this morning.
 
 -Chris
 
 On Jun 18, 2013, at 10:58 AM, David Nalley 
 wrote:
 
> On Tue, Jun 18, 2013 at 10:56 AM, SuichII, Christopher
>  wrote:
>> I've created a fresh install of CS 4.2 with source from git, however 
>> when I attempt to log in, the following is logged:
>> 
>> WARN  [server.auth.SHA256SaltedUserAuthenticator] 
>> (1774710861@qtp-1102259485-4:) The stored password for admin isn't in 
>> the right format for this authenticator
>> INFO  [cloud.user.AccountManagerImpl] (1774710861@qtp-1102259485-4:) 
>> User admin in domain ROOT is disabled/locked (or account is 
>> disabled/locked)
>> 
>> I handle the second issue by updating the state either in 
>> developer-prefill.sql or in the database itself. However, I'm less 
>> knowledgeable about the password hash and salting. Is there something I 
>> have done wrong or not set up properly?
>> 
>> Thanks,
>> Chris
> 
> Is this an upgrade?
> 
> --David
 
>>> 
>> 

Re: [DISCUSS] Issue with cloudmonkey-4.1.0-0 on pypi

[Rohit Yadav]

On Tue, Jun 18, 2013 at 9:08 PM, David Nalley  wrote:

> On Tue, Jun 18, 2013 at 11:33 AM, Sebastien Goasguen 
> wrote:
> >
> >
> >
> > On 18 Jun 2013, at 17:08, David Nalley  wrote:
> >
> >> On Mon, Jun 17, 2013 at 7:00 AM, Prasanna Santhanam 
> wrote:
> >>> On Sun, Jun 09, 2013 at 10:26:43AM -0400, David Nalley wrote:
>  On Sun, Jun 9, 2013 at 7:51 AM, Rohit Yadav 
> wrote:
> > Hi,
> >
> > I was about to test CloudStack but the cloudmonkey-4.1.0-0 release
> on pypi
> > does not bundle failsafe api cache so when I install it I don't get
> any api
> > commands. The autodiscovery using sync is useful but only with the
> > ApiDiscovery plugin which works only for 4.2 and later. For 4.1 and
> below I
> > think we should, in that case, bundle the cache for all the apis. Or
> maybe
> > just oss components/plugins?
> >
> > I'll wait for Chip and others to comment if we want to ship it as it
> is or
> > bundle the cache against 4.1 release?
> >
> > Cheers.
> 
>  Honestly - this is exactly why I've been suggesting[1] that we break
>  CloudMonkey (and Marvin) out of the main repo and giving it it's own
>  lifecycle. It's far easier/faster to iterate cloudmonkey than all of
>  CloudStack and tying it to the slower lifecycle of ACS will continue
>  to trouble it IMO.
> 
>  --David
> 
>  [1] http://markmail.org/message/wir5vfawex3y22ot
> >>>
> >>> I haven't given breaking out the project much thought. But it's
> >>> certainly a possibility:
> >>>
> >>> a) However, there are parts of the codebase (checkin tests) that depend
> >>> on marvin.
> >>>
> >>> b) I need to come up with a easier way to update marvin across
> >>> cloudstack providers to enable auto-upating marvin's libraries like
> >>> cloudmonkey can. For this I've made a couple enhancements to
> >>> apidiscovery but it's not in master yet and I don't have it fully
> >>> figured out.
> >>>
> >>> Need some time to think through this.
> >>>
> >>> --
> >>> Prasanna.,
> >>>
> >>> 
> >>> Powered by BigRock.com
> >>>
> >>
> >>
> >> OK - are your concerns CM-related? or Marvin only?
> >>
> >> Any problems I am not seeing with breaking out CloudMonkey?
> >>
> >> Anyone else have concerns here about breaking out CloudMonkey?
> >>
> >> --David
> >
> > Could we talk about it during the hack day and report to the list ? I
> for one dont understand how these break out repos would work ...process
> wise, release wise, ml wise etc ?
>
>
> Seems like it's something that we def. need to discuss on list.
>
> Here is my thinking:
>
> I'd move everything under tools/cli in master to a separate repo - I'd
> abandon history (unless someone objects and volunteers to extract all
> of that history)
>
> Releases - they'd be separate, with separate versioning. We'd still
> vote on CM releases, but likely at a much faster rate than current
> mainline ACS releases.
>
>
Hey David, let's do that. Separate versioning makes sense as cloudmonkey no
longer really depends on CloudStack or marvin with its api discovery,
though we can keep a failsafe precache or have instructions on how to build
one using one's synced cache (which is in ~/.cloudmonkey/cache).

I've separated out cloudmonkey in a separate git repo retaining its history
using my git-fu; https://github.com/bhaisaab/cloudmonkey

It's same as latest master plus some commit on adding the license file from
CloudStack's root directory, a README.md file, a Makefile and a .gitignore
file.

Cheers.


> I don't envision a different mailing list.
>
> Things I don't yet have opinions on. Repo name: Should it be
> cloudstack-cloudmonkey.git or cloudstack-cli.git or something else?
>
> --David
>

Re: Cannot log in to fresh install as admin

[David Nalley]

Chris - take a look at catalina.out and see whats there - it will
likely tell you why the management server isn't starting.

--David

On Tue, Jun 18, 2013 at 2:00 PM, SuichII, Christopher
 wrote:
> This is what is logged when I attempt to log in:
>
> 2013-06-18 13:59:25,450 DEBUG [cloud.api.ApiServlet] 
> (1516814774@qtp-1413016515-4:null) ===START===  10.61.25.162 -- POST  null
> 2013-06-18 13:59:25,457 DEBUG [cloud.user.AccountManagerImpl] 
> (1516814774@qtp-1413016515-4:null) Attempting to log in user: admin in domain 
> 1
> 2013-06-18 13:59:25,457 DEBUG [server.auth.SHA256SaltedUserAuthenticator] 
> (1516814774@qtp-1413016515-4:null) Retrieving user: admin
> 2013-06-18 13:59:25,469 DEBUG [cloud.user.AccountManagerImpl] 
> (1516814774@qtp-1413016515-4:null) User: admin in domain 1 has successfully 
> logged in
> 2013-06-18 13:59:25,491 DEBUG [cloud.api.ApiServlet] 
> (1516814774@qtp-1413016515-4:null) ===END===  10.61.25.162 -- POST  null
> 2013-06-18 13:59:25,501 DEBUG [cloud.api.ApiServlet] 
> (1516814774@qtp-1413016515-4:null) ===START===  10.61.25.162 -- GET  
> command=listCapabilities&response=json&sessionkey=bF5nZqmg1r%2F2u5NltZDSRHqz%2Fbc%3D&_=1371578368902
> 2013-06-18 13:59:25,520 DEBUG [cloud.api.ApiServer] 
> (1516814774@qtp-1413016515-4:null) The given command:listCapabilities does 
> not exist or it is not available for user with id:2
> 2013-06-18 13:59:25,521 DEBUG [cloud.api.ApiServlet] 
> (1516814774@qtp-1413016515-4:null) ===END===  10.61.25.162 -- GET  
> command=listCapabilities&response=json&sessionkey=bF5nZqmg1r%2F2u5NltZDSRHqz%2Fbc%3D&_=1371578368902
> 2013-06-18 13:59:25,528 DEBUG [cloud.api.ApiServlet] 
> (1516814774@qtp-1413016515-4:null) ===START===  10.61.25.162 -- GET  
> command=listSwifts&response=json&sessionkey=bF5nZqmg1r%2F2u5NltZDSRHqz%2Fbc%3D&_=1371578368929
> 2013-06-18 13:59:25,543 DEBUG [cloud.api.ApiServer] 
> (1516814774@qtp-1413016515-4:null) The given command:listSwifts does not 
> exist or it is not available for user with id:2
> 2013-06-18 13:59:25,544 DEBUG [cloud.api.ApiServlet] 
> (1516814774@qtp-1413016515-4:null) ===END===  10.61.25.162 -- GET  
> command=listSwifts&response=json&sessionkey=bF5nZqmg1r%2F2u5NltZDSRHqz%2Fbc%3D&_=1371578368929
>
>
>
>
>
> On Jun 18, 2013, at 1:45 PM, "SuichII, Christopher"  
> wrote:
>
>> I have another installation that is up and running fine, so I copied the 
>> hashed admin password into the new installation's database an set the state 
>> to enabled. Now attempting to log in produces this popup in the UI:
>>
>> "The given command does not exist or it is not available for user"
>>
>> Any thoughts?
>>
>> -Chris
>>
>> On Jun 18, 2013, at 11:04 AM, "SuichII, Christopher" 
>>  wrote:
>>
>>> Nope. I just pulled, clean installed and deployed the db this morning.
>>>
>>> -Chris
>>>
>>> On Jun 18, 2013, at 10:58 AM, David Nalley 
>>> wrote:
>>>
 On Tue, Jun 18, 2013 at 10:56 AM, SuichII, Christopher
  wrote:
> I've created a fresh install of CS 4.2 with source from git, however when 
> I attempt to log in, the following is logged:
>
> WARN  [server.auth.SHA256SaltedUserAuthenticator] 
> (1774710861@qtp-1102259485-4:) The stored password for admin isn't in the 
> right format for this authenticator
> INFO  [cloud.user.AccountManagerImpl] (1774710861@qtp-1102259485-4:) User 
> admin in domain ROOT is disabled/locked (or account is disabled/locked)
>
> I handle the second issue by updating the state either in 
> developer-prefill.sql or in the database itself. However, I'm less 
> knowledgeable about the password hash and salting. Is there something I 
> have done wrong or not set up properly?
>
> Thanks,
> Chris

 Is this an upgrade?

 --David
>>>
>>
>

Re: Cannot log in to fresh install as admin

[Wei ZHOU]

Chris,

It is because the management server does not start completely. The start of
ehcache takes a long time (about one minute on my machine).
If you try to login in this period, an error dialog will popup.

-Wei


2013/6/18 SuichII, Christopher 

> I have another installation that is up and running fine, so I copied the
> hashed admin password into the new installation's database an set the state
> to enabled. Now attempting to log in produces this popup in the UI:
>
> "The given command does not exist or it is not available for user"
>
> Any thoughts?
>
> -Chris
>
> On Jun 18, 2013, at 11:04 AM, "SuichII, Christopher" <
> chris.su...@netapp.com> wrote:
>
> > Nope. I just pulled, clean installed and deployed the db this morning.
> >
> > -Chris
> >
> > On Jun 18, 2013, at 10:58 AM, David Nalley 
> > wrote:
> >
> >> On Tue, Jun 18, 2013 at 10:56 AM, SuichII, Christopher
> >>  wrote:
> >>> I've created a fresh install of CS 4.2 with source from git, however
> when I attempt to log in, the following is logged:
> >>>
> >>> WARN  [server.auth.SHA256SaltedUserAuthenticator]
> (1774710861@qtp-1102259485-4:) The stored password for admin isn't in the
> right format for this authenticator
> >>> INFO  [cloud.user.AccountManagerImpl] (1774710861@qtp-1102259485-4:)
> User admin in domain ROOT is disabled/locked (or account is disabled/locked)
> >>>
> >>> I handle the second issue by updating the state either in
> developer-prefill.sql or in the database itself. However, I'm less
> knowledgeable about the password hash and salting. Is there something I
> have done wrong or not set up properly?
> >>>
> >>> Thanks,
> >>> Chris
> >>
> >> Is this an upgrade?
> >>
> >> --David
> >
>
>

RE: UI Plugin Internationalization

[Brian Federle]

FYI, I created an improvement ticket for plugin localization: 
https://issues.apache.org/jira/browse/CLOUDSTACK-3058

-Original Message-
From: Brian Federle [mailto:brian.fede...@citrix.com] 
Sent: Tuesday, June 18, 2013 11:00 AM
To: dev@cloudstack.apache.org; 'SuichII, Christopher'
Cc: Pranav Saxena; Sonny Chhen; Jessica Wang
Subject: RE: UI Plugin Internationalization

Hey Chris,

How you described it is pretty much how I planned on implementing plugin 
dictionaries.

You can actually attach the plugin's dictionary to 
cloudStack.plugins.[pluginName], for example 
cloudStack.plugins.testPlugin.dictionary, and only attach the dictionary JS 
that is set to your locale -- there is a global variable in the JS which 
indicates what the current locale is. Alternatively, plugin handling routine 
can attach the dictionary directly to the object passed to your plugin's 
function (i.e., 'plugin.dictionary' from cloudStack.plugins.myPlugin(plugin) {} 
function), so you won't have to worry about namespace issues.

If you've already written code, then feel free to submit a patch via 
reviews.apache.org and I can take a look at it.

-Brian

-Original Message-
From: Chip Childers [mailto:chip.child...@sungard.com]
Sent: Tuesday, June 18, 2013 9:31 AM
To: dev@cloudstack.apache.org
Cc: Brian Federle; Pranav Saxena; Sonny Chhen; Jessica Wang
Subject: Re: UI Plugin Internationalization

Adding some UI focused folks to the CC.

On Tue, Jun 18, 2013 at 03:15:53PM +, SuichII, Christopher wrote:
> Sure!
> 
> What I'd like: As someone developing a UI plugin, I'd like to be able to 
> contribute my own internationalized messages/labels/etc. to the JS 
> dictionary. Currently, this can be done by shoving them all in to the 
> dictionary when your plugin is initialized, but it is not very pretty - 
> requiring you to determine the locale and require the messages file yourself.
> 
> So a little preface. As far as I can tell, all UI plugin loading is done in 
> JS - that is, not at all in JSPs. So, any UI plugin internationalization 
> needs to be done in JS, or some of the UI plugin loading needs to be done in 
> JSPs (I'm gonna bet the former is preferred).
> 
> My idea was to add some JS to dictionary.jsp (whose JS is executed after UI 
> plugins are loaded). Here we would take the locale from the JSP and require a 
> JS file in plugins//dictionary/ depending on the locale.
> 
> In my current prototype, the JS files holding the internationalized strings 
> just store everything in a hash in the cloudStack variable, like: 
> cloudStack.plugin_dictionaries.. I've done this because (I'm new 
> to requirejs and) I am yet to find a way to simply return the hash or have 
> the hash sent as a parameter to a callback of require(…).
> 
> Does anyone with more requirejs experience know how we could accomplish this 
> more elegantly?
> 
> I'm also open to suggestions on completely different designs. =)
> 
> -Chris
> 
> On Jun 18, 2013, at 10:55 AM, Chip Childers 
> 
>  wrote:
> 
> > On Tue, Jun 18, 2013 at 12:18:16PM +, SuichII, Christopher wrote:
> >> I've got some ideas on how to implement a system for allowing ui plugins 
> >> to contribute internationalized strings to the ui dictionary, but I'd like 
> >> to run things by a committer. Is there someone(s) who would like to talk 
> >> offline (or keep replying here) about this feature?
> >> 
> >> Thanks,
> >> Chris
> > 
> > The best method to collaborate on the project is to use the list to 
> > build up the feature proposal...  so explain away here please!
> 
> 

Re: [DISCUSS] Issue with cloudmonkey-4.1.0-0 on pypi

[Rohit Yadav]

On Tue, Jun 18, 2013 at 9:08 PM, David Nalley  wrote:

> On Tue, Jun 18, 2013 at 11:33 AM, Sebastien Goasguen 
> wrote:
> >
> >
> >
> > On 18 Jun 2013, at 17:08, David Nalley  wrote:
> >
> >> On Mon, Jun 17, 2013 at 7:00 AM, Prasanna Santhanam 
> wrote:
> >>> On Sun, Jun 09, 2013 at 10:26:43AM -0400, David Nalley wrote:
>  On Sun, Jun 9, 2013 at 7:51 AM, Rohit Yadav 
> wrote:
> > Hi,
> >
> > I was about to test CloudStack but the cloudmonkey-4.1.0-0 release
> on pypi
> > does not bundle failsafe api cache so when I install it I don't get
> any api
> > commands. The autodiscovery using sync is useful but only with the
> > ApiDiscovery plugin which works only for 4.2 and later. For 4.1 and
> below I
> > think we should, in that case, bundle the cache for all the apis. Or
> maybe
> > just oss components/plugins?
> >
> > I'll wait for Chip and others to comment if we want to ship it as it
> is or
> > bundle the cache against 4.1 release?
> >
> > Cheers.
> 
>  Honestly - this is exactly why I've been suggesting[1] that we break
>  CloudMonkey (and Marvin) out of the main repo and giving it it's own
>  lifecycle. It's far easier/faster to iterate cloudmonkey than all of
>  CloudStack and tying it to the slower lifecycle of ACS will continue
>  to trouble it IMO.
> 
>  --David
> 
>  [1] http://markmail.org/message/wir5vfawex3y22ot
> >>>
> >>> I haven't given breaking out the project much thought. But it's
> >>> certainly a possibility:
> >>>
> >>> a) However, there are parts of the codebase (checkin tests) that depend
> >>> on marvin.
> >>>
> >>> b) I need to come up with a easier way to update marvin across
> >>> cloudstack providers to enable auto-upating marvin's libraries like
> >>> cloudmonkey can. For this I've made a couple enhancements to
> >>> apidiscovery but it's not in master yet and I don't have it fully
> >>> figured out.
> >>>
> >>> Need some time to think through this.
> >>>
> >>> --
> >>> Prasanna.,
> >>>
> >>> 
> >>> Powered by BigRock.com
> >>>
> >>
> >>
> >> OK - are your concerns CM-related? or Marvin only?
> >>
> >> Any problems I am not seeing with breaking out CloudMonkey?
> >>
> >> Anyone else have concerns here about breaking out CloudMonkey?
> >>
> >> --David
> >
> > Could we talk about it during the hack day and report to the list ? I
> for one dont understand how these break out repos would work ...process
> wise, release wise, ml wise etc ?
>
>
> Seems like it's something that we def. need to discuss on list.
>
> Here is my thinking:
>
> I'd move everything under tools/cli in master to a separate repo - I'd
> abandon history (unless someone objects and volunteers to extract all
> of that history)
>
> Releases - they'd be separate, with separate versioning. We'd still
> vote on CM releases, but likely at a much faster rate than current
> mainline ACS releases.
>
> I don't envision a different mailing list.
>
> Things I don't yet have opinions on. Repo name: Should it be
> cloudstack-cloudmonkey.git or cloudstack-cli.git or something else?
>

+1 break out the repo cloudstack-cloudmonkey.git
I can help extract the history out but it's not very necessary.

CloudStack cloudmonkey was completely independent of any CloudStack
component after I had implemented the API Discovery plugin which made it
more maintainable and relevant :)

Cheers.



>
> --David
>

Re: Cannot log in to fresh install as admin

[SuichII, Christopher]

This is what is logged when I attempt to log in:

2013-06-18 13:59:25,450 DEBUG [cloud.api.ApiServlet] 
(1516814774@qtp-1413016515-4:null) ===START===  10.61.25.162 -- POST  null
2013-06-18 13:59:25,457 DEBUG [cloud.user.AccountManagerImpl] 
(1516814774@qtp-1413016515-4:null) Attempting to log in user: admin in domain 1
2013-06-18 13:59:25,457 DEBUG [server.auth.SHA256SaltedUserAuthenticator] 
(1516814774@qtp-1413016515-4:null) Retrieving user: admin
2013-06-18 13:59:25,469 DEBUG [cloud.user.AccountManagerImpl] 
(1516814774@qtp-1413016515-4:null) User: admin in domain 1 has successfully 
logged in
2013-06-18 13:59:25,491 DEBUG [cloud.api.ApiServlet] 
(1516814774@qtp-1413016515-4:null) ===END===  10.61.25.162 -- POST  null
2013-06-18 13:59:25,501 DEBUG [cloud.api.ApiServlet] 
(1516814774@qtp-1413016515-4:null) ===START===  10.61.25.162 -- GET  
command=listCapabilities&response=json&sessionkey=bF5nZqmg1r%2F2u5NltZDSRHqz%2Fbc%3D&_=1371578368902
2013-06-18 13:59:25,520 DEBUG [cloud.api.ApiServer] 
(1516814774@qtp-1413016515-4:null) The given command:listCapabilities does not 
exist or it is not available for user with id:2
2013-06-18 13:59:25,521 DEBUG [cloud.api.ApiServlet] 
(1516814774@qtp-1413016515-4:null) ===END===  10.61.25.162 -- GET  
command=listCapabilities&response=json&sessionkey=bF5nZqmg1r%2F2u5NltZDSRHqz%2Fbc%3D&_=1371578368902
2013-06-18 13:59:25,528 DEBUG [cloud.api.ApiServlet] 
(1516814774@qtp-1413016515-4:null) ===START===  10.61.25.162 -- GET  
command=listSwifts&response=json&sessionkey=bF5nZqmg1r%2F2u5NltZDSRHqz%2Fbc%3D&_=1371578368929
2013-06-18 13:59:25,543 DEBUG [cloud.api.ApiServer] 
(1516814774@qtp-1413016515-4:null) The given command:listSwifts does not exist 
or it is not available for user with id:2
2013-06-18 13:59:25,544 DEBUG [cloud.api.ApiServlet] 
(1516814774@qtp-1413016515-4:null) ===END===  10.61.25.162 -- GET  
command=listSwifts&response=json&sessionkey=bF5nZqmg1r%2F2u5NltZDSRHqz%2Fbc%3D&_=1371578368929





On Jun 18, 2013, at 1:45 PM, "SuichII, Christopher"  
wrote:

> I have another installation that is up and running fine, so I copied the 
> hashed admin password into the new installation's database an set the state 
> to enabled. Now attempting to log in produces this popup in the UI:
> 
> "The given command does not exist or it is not available for user"
> 
> Any thoughts?
> 
> -Chris
> 
> On Jun 18, 2013, at 11:04 AM, "SuichII, Christopher"  
> wrote:
> 
>> Nope. I just pulled, clean installed and deployed the db this morning.
>> 
>> -Chris
>> 
>> On Jun 18, 2013, at 10:58 AM, David Nalley 
>> wrote:
>> 
>>> On Tue, Jun 18, 2013 at 10:56 AM, SuichII, Christopher
>>>  wrote:
 I've created a fresh install of CS 4.2 with source from git, however when 
 I attempt to log in, the following is logged:
 
 WARN  [server.auth.SHA256SaltedUserAuthenticator] 
 (1774710861@qtp-1102259485-4:) The stored password for admin isn't in the 
 right format for this authenticator
 INFO  [cloud.user.AccountManagerImpl] (1774710861@qtp-1102259485-4:) User 
 admin in domain ROOT is disabled/locked (or account is disabled/locked)
 
 I handle the second issue by updating the state either in 
 developer-prefill.sql or in the database itself. However, I'm less 
 knowledgeable about the password hash and salting. Is there something I 
 have done wrong or not set up properly?
 
 Thanks,
 Chris
>>> 
>>> Is this an upgrade?
>>> 
>>> --David
>> 
> 

RE: UI Plugin Internationalization

[Brian Federle]

Hey Chris,

How you described it is pretty much how I planned on implementing plugin 
dictionaries.

You can actually attach the plugin's dictionary to 
cloudStack.plugins.[pluginName], for example 
cloudStack.plugins.testPlugin.dictionary, and only attach the dictionary JS 
that is set to your locale -- there is a global variable in the JS which 
indicates what the current locale is. Alternatively, plugin handling routine 
can attach the dictionary directly to the object passed to your plugin's 
function (i.e., 'plugin.dictionary' from cloudStack.plugins.myPlugin(plugin) {} 
function), so you won't have to worry about namespace issues.

If you've already written code, then feel free to submit a patch via 
reviews.apache.org and I can take a look at it.

-Brian

-Original Message-
From: Chip Childers [mailto:chip.child...@sungard.com] 
Sent: Tuesday, June 18, 2013 9:31 AM
To: dev@cloudstack.apache.org
Cc: Brian Federle; Pranav Saxena; Sonny Chhen; Jessica Wang
Subject: Re: UI Plugin Internationalization

Adding some UI focused folks to the CC.

On Tue, Jun 18, 2013 at 03:15:53PM +, SuichII, Christopher wrote:
> Sure!
> 
> What I'd like: As someone developing a UI plugin, I'd like to be able to 
> contribute my own internationalized messages/labels/etc. to the JS 
> dictionary. Currently, this can be done by shoving them all in to the 
> dictionary when your plugin is initialized, but it is not very pretty - 
> requiring you to determine the locale and require the messages file yourself.
> 
> So a little preface. As far as I can tell, all UI plugin loading is done in 
> JS - that is, not at all in JSPs. So, any UI plugin internationalization 
> needs to be done in JS, or some of the UI plugin loading needs to be done in 
> JSPs (I'm gonna bet the former is preferred).
> 
> My idea was to add some JS to dictionary.jsp (whose JS is executed after UI 
> plugins are loaded). Here we would take the locale from the JSP and require a 
> JS file in plugins//dictionary/ depending on the locale.
> 
> In my current prototype, the JS files holding the internationalized strings 
> just store everything in a hash in the cloudStack variable, like: 
> cloudStack.plugin_dictionaries.. I've done this because (I'm new 
> to requirejs and) I am yet to find a way to simply return the hash or have 
> the hash sent as a parameter to a callback of require(…).
> 
> Does anyone with more requirejs experience know how we could accomplish this 
> more elegantly?
> 
> I'm also open to suggestions on completely different designs. =)
> 
> -Chris
> 
> On Jun 18, 2013, at 10:55 AM, Chip Childers 
> 
>  wrote:
> 
> > On Tue, Jun 18, 2013 at 12:18:16PM +, SuichII, Christopher wrote:
> >> I've got some ideas on how to implement a system for allowing ui plugins 
> >> to contribute internationalized strings to the ui dictionary, but I'd like 
> >> to run things by a committer. Is there someone(s) who would like to talk 
> >> offline (or keep replying here) about this feature?
> >> 
> >> Thanks,
> >> Chris
> > 
> > The best method to collaborate on the project is to use the list to 
> > build up the feature proposal...  so explain away here please!
> 
> 

Re: Cannot log in to fresh install as admin

[SuichII, Christopher]

I have another installation that is up and running fine, so I copied the hashed 
admin password into the new installation's database an set the state to 
enabled. Now attempting to log in produces this popup in the UI:

"The given command does not exist or it is not available for user"

Any thoughts?

-Chris

On Jun 18, 2013, at 11:04 AM, "SuichII, Christopher"  
wrote:

> Nope. I just pulled, clean installed and deployed the db this morning.
> 
> -Chris
> 
> On Jun 18, 2013, at 10:58 AM, David Nalley 
> wrote:
> 
>> On Tue, Jun 18, 2013 at 10:56 AM, SuichII, Christopher
>>  wrote:
>>> I've created a fresh install of CS 4.2 with source from git, however when I 
>>> attempt to log in, the following is logged:
>>> 
>>> WARN  [server.auth.SHA256SaltedUserAuthenticator] 
>>> (1774710861@qtp-1102259485-4:) The stored password for admin isn't in the 
>>> right format for this authenticator
>>> INFO  [cloud.user.AccountManagerImpl] (1774710861@qtp-1102259485-4:) User 
>>> admin in domain ROOT is disabled/locked (or account is disabled/locked)
>>> 
>>> I handle the second issue by updating the state either in 
>>> developer-prefill.sql or in the database itself. However, I'm less 
>>> knowledgeable about the password hash and salting. Is there something I 
>>> have done wrong or not set up properly?
>>> 
>>> Thanks,
>>> Chris
>> 
>> Is this an upgrade?
>> 
>> --David
> 

OFFLINE 6/20-7/11

[Chiradeep Vittal]

Will have access to email, but I don't plan on checking it :)

Re: Query String Request Authentication(QSRA) support by S3 providers

[Min Chen]

A new version of using generatePresignedUrl in S3ImageStoreDriverImpl is
checked into object_store.

THanks
-min

On 6/18/13 8:29 AM, "Min Chen"  wrote:

>Yes, current code is in S3ImageStoreDriverImpl.createEntityExtractUrl,
>which has a security issue mentioned in CLOUDSTACK-3030. I am going to
>change it to use generatePresignedUrl api from AWS S3 api.
>
>Thanks
>-min
>
>From: John Burwell mailto:jburw...@basho.com>>
>Date: Tuesday, June 18, 2013 8:07 AM
>To: Min Chen mailto:min.c...@citrix.com>>
>Cc: Thomas O'Dowd mailto:tpod...@cloudian.com>>,
>"dev@cloudstack.apache.org"
>mailto:dev@cloudstack.apache.org>>
>Subject: Re: Query String Request Authentication(QSRA) support by S3
>providers
>
>Min,
>
>Is the code checked into the object_store branch?  If so, which lines in
>S3TemplateDownloader?
>
>Thanks,
>-John
>
>On Jun 18, 2013, at 12:39 AM, Min Chen
>mailto:min.c...@citrix.com>> wrote:
>
>Hi John,
>
>This is regarding extractTemplate api, where for extractable template,
>users can click "Download Template" button from UI to get a http url to
>download the template already stored at S3 without providing S3
>credentials. In 4.1, we don't have this issue, since the URL returned is
>the public web server location hosted in ssvm, and in 4.2, we are
>returning URL pointing to s3 object. Without setting ACL to the S3
>object, user cannot directly click the URL returned  from extractTemplate
>api to download the template without providing credentials. By reading
>the AWS SDK doc today, I ran across the following API that I may be able
>to use for this purpose:
>
> 
>URLtrue>
>generatePresignedUrlcom/amazonaws/services/s3/AmazonS3Client.html#generatePresignedUrl%28java.
>lang.String,%20java.lang.String,%20java.util.Date,%20com.amazonaws.HttpMet
>hod%29>(Stringml?is-external=true> bucketName,
>Stringternal=true> key, 
>Dateal=true> expiration,
>HttpMethodaws/HttpMethod.html> method)
>   Returns a pre-signed URL for accessing an Amazon S3 resource.
>
>This is along the same line as QSRA mentioned by Tom, by wrapped in
>AmazonS3Client for easy consumption. By using this method, I think that I
>don't need to change ACL of S3 object to open a security hole.
>
>Thanks
>-min
>
>From: John Burwell mailto:jburw...@basho.com>>
>Date: Monday, June 17, 2013 7:38 PM
>To: Min Chen mailto:min.c...@citrix.com>>
>Cc: Thomas O'Dowd mailto:tpod...@cloudian.com>>,
>"dev@cloudstack.apache.org"
>mailto:dev@cloudstack.apache.org>>
>Subject: Re: Query String Request Authentication(QSRA) support by S3
>providers
>
>Min,
>
>Why are we mucking with ACLs at all?  The best security practice would be
>to create a bucket for CloudStack's use and assign it a dedicated access
>key and secret key pair with read/write access only to that bucket.
>Requiring an administrative account to an object store opens an
>unnecessarily large attack surface.  Therefore, as implemented in 4.1, we
>should defer bucket creation, ACL assignment, and credential creation to
>the administrator/operator.
>
>Thanks,
>-John
>
>On Jun 17, 2013, at 1:15 PM, Min Chen
>mailto:min.c...@citrix.com>> wrote:
>
>Tom filed a very good bug for ACL setting change on S3 object when users
>issue extractTemplate API
>(https://issues.apache.org/jira/browse/CLOUDSTACK-3030), and his
>recommendation of using Query String Request Authentication (QSRA)
>alternative sounds like a right approach to fix this bug. Before
>implementing it, I would like to confirm if QSRA should be supported by
>all S3 providers if they claim that they are AWS s3 compatible. If so, we
>will make this assumption in our code. Based on Tom, Cloudian is
>supporting it. How about RiakCS, John?
>
>Thanks
>-min
>
>

RE: starting VM and get error of "unable to create a deployment for VM[user|i-2-107-VM]"

[William Jiang]

Hi Nitin,
Ubuntu 12.04 does not fully supported by xenserver 6.0.2, but we have some 
Ubuntu 12.04 work well, and we also saw same issue in one windows server 2008 
R2 VM which is fully supported by hypervisor.

The complete logs as following:

#
2013-06-14 12:28:34,328 DEBUG [cloud.async.AsyncJobManagerImpl] 
(catalina-exec-18:null) submit async job-626, details: AsyncJobVO {id:626, 
userId: 2, accountId: 2, sessionKey: null, instanceType: VirtualMachine, 
instanceId: 107, cmd: com.cloud.api.commands.StartVMCmd, cmdOriginator: null, 
cmdInfo: 
{"id":"2d7d30a0-83d1-4050-a8dd-1b702fbb08e6","response":"json","sessionkey":"eihe8Buev1Ale+nhxw+w1nqQ\u003d","ctxUserId":"2","_":"1371227586576","ctxAccountId":"2","ctxStartEventId":"2584"},
 cmdVersion: 0, callbackType: 0, callbackAddress: null, status: 0, 
processStatus: 0, resultCode: 0, result: null, initMsid: 110492071566, 
completeMsid: null, lastUpdated: null, lastPolled: null, created: null}
2013-06-14 12:28:34,331 DEBUG [cloud.async.AsyncJobManagerImpl] 
(Job-Executor-16:job-626) Executing com.cloud.api.commands.StartVMCmd for 
job-626
2013-06-14 12:28:34,349 DEBUG [cloud.network.NetworkManagerImpl] 
(Job-Executor-16:job-626) Service SecurityGroup is not supported in the network 
id=214
2013-06-14 12:28:34,353 DEBUG [cloud.network.NetworkManagerImpl] 
(Job-Executor-16:job-626) Service SecurityGroup is not supported in the network 
id=214
2013-06-14 12:28:34,355 DEBUG [cloud.capacity.CapacityManagerImpl] 
(Job-Executor-16:job-626) VM state transitted from :Stopped to Starting with 
event: StartRequestedvm's original host id: 9 new host id: null host id before 
state transition: null
2013-06-14 12:28:34,356 DEBUG [cloud.vm.VirtualMachineManagerImpl] 
(Job-Executor-16:job-626) Successfully transitioned to start state for 
VM[User|i-2-107-VM] reservation id = 3ee7e4d1-a732-4e6b-96d3-eb02caec4df3
2013-06-14 12:28:34,357 DEBUG [cloud.vm.VirtualMachineManagerImpl] 
(Job-Executor-16:job-626) Trying to deploy VM, vm has dcId: 3 and podId: 3
2013-06-14 12:28:34,357 DEBUG [cloud.vm.VirtualMachineManagerImpl] 
(Job-Executor-16:job-626) Deploy avoids pods: null, clusters: null, hosts: null
2013-06-14 12:28:34,359 DEBUG [cloud.vm.VirtualMachineManagerImpl] 
(Job-Executor-16:job-626) Root volume is ready, need to place VM in volume's 
cluster
2013-06-14 12:28:34,359 DEBUG [cloud.vm.VirtualMachineManagerImpl] 
(Job-Executor-16:job-626) Vol[129|vm=107|ROOT] is READY, changing deployment 
plan to use this pool's dcId: 3 , podId: 3 , and clusterId: 3
2013-06-14 12:28:34,360 DEBUG [cloud.deploy.FirstFitPlanner] 
(Job-Executor-16:job-626) DeploymentPlanner allocation algorithm: random
2013-06-14 12:28:34,360 DEBUG [cloud.deploy.FirstFitPlanner] 
(Job-Executor-16:job-626) Trying to allocate a host and storage pools from 
dc:3, pod:3,cluster:3, requested cpu: 1000, requested ram: 1073741824
2013-06-14 12:28:34,360 DEBUG [cloud.deploy.FirstFitPlanner] 
(Job-Executor-16:job-626) Is ROOT volume READY (pool already allocated)?: Yes
2013-06-14 12:28:34,360 DEBUG [cloud.deploy.FirstFitPlanner] 
(Job-Executor-16:job-626) This VM has last host_id specified, trying to choose 
the same host: 9
2013-06-14 12:28:34,361 DEBUG [cloud.capacity.CapacityManagerImpl] 
(Job-Executor-16:job-626) Checking if host: 9 has enough capacity for requested 
CPU: 1000 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
2013-06-14 12:28:34,362 DEBUG [cloud.capacity.CapacityManagerImpl] 
(Job-Executor-16:job-626) Hosts's actual total CPU: 18616 and CPU after 
applying overprovisioning: 18616
2013-06-14 12:28:34,362 DEBUG [cloud.capacity.CapacityManagerImpl] 
(Job-Executor-16:job-626) We need to allocate to the last host again, so 
checking if there is enough reserved capacity
2013-06-14 12:28:34,362 DEBUG [cloud.capacity.CapacityManagerImpl] 
(Job-Executor-16:job-626) Reserved CPU: 0 , Requested CPU: 1000
2013-06-14 12:28:34,362 DEBUG [cloud.capacity.CapacityManagerImpl] 
(Job-Executor-16:job-626) Reserved RAM: 0 , Requested RAM: 1073741824
2013-06-14 12:28:34,362 DEBUG [cloud.capacity.CapacityManagerImpl] 
(Job-Executor-16:job-626) STATS: Failed to alloc resource from host: 9 
reservedCpu: 0, requested cpu: 1000, reservedMem: 0, requested mem: 1073741824
2013-06-14 12:28:34,362 DEBUG [cloud.capacity.CapacityManagerImpl] 
(Job-Executor-16:job-626) Host does not have enough reserved CPU available, 
cannot allocate to this host.
2013-06-14 12:28:34,362 DEBUG [cloud.deploy.FirstFitPlanner] 
(Job-Executor-16:job-626) The last host of this VM does not have enough capacity
2013-06-14 12:28:34,362 DEBUG [cloud.deploy.FirstFitPlanner] 
(Job-Executor-16:job-626) Cannot choose the last host to deploy this VM
2013-06-14 12:28:34,362 DEBUG [cloud.deploy.FirstFitPlanner] 
(Job-Executor-16:job-626) Searching resources only under specified Cluster: 3
2013-06-14 12:

Re: UI Plugin Internationalization

[Chip Childers]

Adding some UI focused folks to the CC.

On Tue, Jun 18, 2013 at 03:15:53PM +, SuichII, Christopher wrote:
> Sure!
> 
> What I'd like: As someone developing a UI plugin, I'd like to be able to 
> contribute my own internationalized messages/labels/etc. to the JS 
> dictionary. Currently, this can be done by shoving them all in to the 
> dictionary when your plugin is initialized, but it is not very pretty - 
> requiring you to determine the locale and require the messages file yourself.
> 
> So a little preface. As far as I can tell, all UI plugin loading is done in 
> JS - that is, not at all in JSPs. So, any UI plugin internationalization 
> needs to be done in JS, or some of the UI plugin loading needs to be done in 
> JSPs (I'm gonna bet the former is preferred).
> 
> My idea was to add some JS to dictionary.jsp (whose JS is executed after UI 
> plugins are loaded). Here we would take the locale from the JSP and require a 
> JS file in plugins//dictionary/ depending on the locale.
> 
> In my current prototype, the JS files holding the internationalized strings 
> just store everything in a hash in the cloudStack variable, like: 
> cloudStack.plugin_dictionaries.. I've done this because (I'm new 
> to requirejs and) I am yet to find a way to simply return the hash or have 
> the hash sent as a parameter to a callback of require(…).
> 
> Does anyone with more requirejs experience know how we could accomplish this 
> more elegantly?
> 
> I'm also open to suggestions on completely different designs. =)
> 
> -Chris
> 
> On Jun 18, 2013, at 10:55 AM, Chip Childers 
>  wrote:
> 
> > On Tue, Jun 18, 2013 at 12:18:16PM +, SuichII, Christopher wrote:
> >> I've got some ideas on how to implement a system for allowing ui plugins 
> >> to contribute internationalized strings to the ui dictionary, but I'd like 
> >> to run things by a committer. Is there someone(s) who would like to talk 
> >> offline (or keep replying here) about this feature?
> >> 
> >> Thanks,
> >> Chris
> > 
> > The best method to collaborate on the project is to use the list to
> > build up the feature proposal...  so explain away here please!
> 
> 

Re: starting VM and get error of "unable to create a deployment for VM[user|i-2-107-VM]"

[Nitin Mehta]

Can you check the hypervisor admin guide to see if this version of guest
os is supported ?
Also can u please paste the complete logs (grep for job-626 would work as
well) 

On 18/06/13 8:15 PM, "William Jiang"  wrote:

>Hi,
>
>We have a Ubuntu 12.04 VM with one disk on shared storage, it was working
>well before but now we saw the error of "unable to create a deployment
>for VM[user|i-2-107-VM]" during starting.
>We saw this kind of issue happened on a windows server 2008 VM before.
>
>In /var/log/cloud/management/management-server.log
>We got following errors:
>
>2013-06-14 12:28:34,362 DEBUG [cloud.capacity.CapacityManagerImpl]
>(Job-Executor-16:job-626) We need to allocate to the last host again, so
>checking if there is enough reserved capacity
>2013-06-14 12:28:34,362 DEBUG [cloud.capacity.CapacityManagerImpl]
>(Job-Executor-16:job-626) Reserved CPU: 0 , Requested CPU: 1000
>2013-06-14 12:28:34,362 DEBUG [cloud.capacity.CapacityManagerImpl]
>(Job-Executor-16:job-626) Reserved RAM: 0 , Requested RAM: 1073741824
>2013-06-14 12:28:34,362 DEBUG [cloud.capacity.CapacityManagerImpl]
>(Job-Executor-16:job-626) STATS: Failed to alloc resource from host: 9
>reservedCpu: 0, requested cpu: 1000, reservedMem: 0, requested mem:
>1073741824
>2013-06-14 12:28:34,362 DEBUG [cloud.capacity.CapacityManagerImpl]
>(Job-Executor-16:job-626) Host does not have enough reserved CPU
>available, cannot allocate to this host.
>2013-06-14 12:28:34,362 DEBUG [cloud.deploy.FirstFitPlanner]
>(Job-Executor-16:job-626) The last host of this VM does not have enough
>capacity
>2013-06-14 12:28:34,362 DEBUG [cloud.deploy.FirstFitPlanner]
>(Job-Executor-16:job-626) Cannot choose the last host to deploy this VM
>
>Any ideas about this issue?
>
>Thanks,
>William
>This e-mail may be privileged and/or confidential, and the sender does
>not waive any related rights and obligations. Any distribution, use or
>copying of this e-mail or the information it contains by other than an
>intended recipient is unauthorized. If you received this e-mail in error,
>please advise me (by return e-mail or otherwise) immediately. Ce courrier
>?lectronique est confidentiel et prot?g?. L'exp?diteur ne renonce pas aux
>droits et obligations qui s'y rapportent. Toute diffusion, utilisation ou
>copie de ce message ou des renseignements qu'il contient par une personne
>autre que le (les) destinataire(s) d?sign?(s) est interdite. Si vous
>recevez ce courrier ?lectronique par erreur, veuillez m'en aviser
>imm?diatement, par retour de courrier ?lectronique ou par un autre moyen.

Re: [DISCUSS] Issue with cloudmonkey-4.1.0-0 on pypi

[Prasanna Santhanam]

On Tue, Jun 18, 2013 at 11:08:57AM -0400, David Nalley wrote:
> 
> 
> OK - are your concerns CM-related? or Marvin only?

Marvin only at this point.

> 
> Any problems I am not seeing with breaking out CloudMonkey?

Cloudmonkey has become independant of Marvin. Both can exist
independantly

> 
> Anyone else have concerns here about breaking out CloudMonkey?
> 
> --David

-- 
Prasanna.,


Powered by BigRock.com

Re: [DISCUSS] Issue with cloudmonkey-4.1.0-0 on pypi

[David Nalley]

On Tue, Jun 18, 2013 at 11:33 AM, Sebastien Goasguen  wrote:
>
>
>
> On 18 Jun 2013, at 17:08, David Nalley  wrote:
>
>> On Mon, Jun 17, 2013 at 7:00 AM, Prasanna Santhanam  wrote:
>>> On Sun, Jun 09, 2013 at 10:26:43AM -0400, David Nalley wrote:
 On Sun, Jun 9, 2013 at 7:51 AM, Rohit Yadav  wrote:
> Hi,
>
> I was about to test CloudStack but the cloudmonkey-4.1.0-0 release on pypi
> does not bundle failsafe api cache so when I install it I don't get any 
> api
> commands. The autodiscovery using sync is useful but only with the
> ApiDiscovery plugin which works only for 4.2 and later. For 4.1 and below 
> I
> think we should, in that case, bundle the cache for all the apis. Or maybe
> just oss components/plugins?
>
> I'll wait for Chip and others to comment if we want to ship it as it is or
> bundle the cache against 4.1 release?
>
> Cheers.

 Honestly - this is exactly why I've been suggesting[1] that we break
 CloudMonkey (and Marvin) out of the main repo and giving it it's own
 lifecycle. It's far easier/faster to iterate cloudmonkey than all of
 CloudStack and tying it to the slower lifecycle of ACS will continue
 to trouble it IMO.

 --David

 [1] http://markmail.org/message/wir5vfawex3y22ot
>>>
>>> I haven't given breaking out the project much thought. But it's
>>> certainly a possibility:
>>>
>>> a) However, there are parts of the codebase (checkin tests) that depend
>>> on marvin.
>>>
>>> b) I need to come up with a easier way to update marvin across
>>> cloudstack providers to enable auto-upating marvin's libraries like
>>> cloudmonkey can. For this I've made a couple enhancements to
>>> apidiscovery but it's not in master yet and I don't have it fully
>>> figured out.
>>>
>>> Need some time to think through this.
>>>
>>> --
>>> Prasanna.,
>>>
>>> 
>>> Powered by BigRock.com
>>>
>>
>>
>> OK - are your concerns CM-related? or Marvin only?
>>
>> Any problems I am not seeing with breaking out CloudMonkey?
>>
>> Anyone else have concerns here about breaking out CloudMonkey?
>>
>> --David
>
> Could we talk about it during the hack day and report to the list ? I for one 
> dont understand how these break out repos would work ...process wise, release 
> wise, ml wise etc ?


Seems like it's something that we def. need to discuss on list.

Here is my thinking:

I'd move everything under tools/cli in master to a separate repo - I'd
abandon history (unless someone objects and volunteers to extract all
of that history)

Releases - they'd be separate, with separate versioning. We'd still
vote on CM releases, but likely at a much faster rate than current
mainline ACS releases.

I don't envision a different mailing list.

Things I don't yet have opinions on. Repo name: Should it be
cloudstack-cloudmonkey.git or cloudstack-cli.git or something else?

--David

Re: [ANNOUNCE] New committer: Jayapal Reddy Uradi

[Wei ZHOU]

Congratulations Jayapal !


2013/6/18 Venkata SwamyBabu Budumuru 

> Congrats Jayapal!
>
> On 18/06/13 1:05 PM, "Suresh Sadhu"  wrote:
>
> >Congrats Jayapal !!
> >
> >-Original Message-
> >From: Chip Childers [mailto:chip.child...@sungard.com]
> >Sent: Monday, June 17, 2013 9:00 PM
> >To: dev@cloudstack.apache.org
> >Subject: [ANNOUNCE] New committer: Jayapal Reddy Uradi
> >
> >The Project Management Committee (PMC) for Apache CloudStack has asked
> >Jayapal Reddy Uradi to become a committer and we are pleased to announce
> >that they have accepted.
> >
> >Being a committer allows many contributors to contribute more
> >autonomously. For developers, it makes it easier to submit changes and
> >eliminates the need to have contributions reviewed via the patch
> >submission process. Whether contributions are development-related or
> >otherwise, it is a recognition of a contributor's participation in the
> >project and commitment to the project and the Apache Way.
> >
> >Please join me in congratulating Jayapal!
> >
> >-chip
> >on behalf of the CloudStack PMC
>
>

Re: [DISCUSS] Issue with cloudmonkey-4.1.0-0 on pypi

[Sebastien Goasguen]

On 18 Jun 2013, at 17:08, David Nalley  wrote:

> On Mon, Jun 17, 2013 at 7:00 AM, Prasanna Santhanam  wrote:
>> On Sun, Jun 09, 2013 at 10:26:43AM -0400, David Nalley wrote:
>>> On Sun, Jun 9, 2013 at 7:51 AM, Rohit Yadav  wrote:
 Hi,
 
 I was about to test CloudStack but the cloudmonkey-4.1.0-0 release on pypi
 does not bundle failsafe api cache so when I install it I don't get any api
 commands. The autodiscovery using sync is useful but only with the
 ApiDiscovery plugin which works only for 4.2 and later. For 4.1 and below I
 think we should, in that case, bundle the cache for all the apis. Or maybe
 just oss components/plugins?
 
 I'll wait for Chip and others to comment if we want to ship it as it is or
 bundle the cache against 4.1 release?
 
 Cheers.
>>> 
>>> Honestly - this is exactly why I've been suggesting[1] that we break
>>> CloudMonkey (and Marvin) out of the main repo and giving it it's own
>>> lifecycle. It's far easier/faster to iterate cloudmonkey than all of
>>> CloudStack and tying it to the slower lifecycle of ACS will continue
>>> to trouble it IMO.
>>> 
>>> --David
>>> 
>>> [1] http://markmail.org/message/wir5vfawex3y22ot
>> 
>> I haven't given breaking out the project much thought. But it's
>> certainly a possibility:
>> 
>> a) However, there are parts of the codebase (checkin tests) that depend
>> on marvin.
>> 
>> b) I need to come up with a easier way to update marvin across
>> cloudstack providers to enable auto-upating marvin's libraries like
>> cloudmonkey can. For this I've made a couple enhancements to
>> apidiscovery but it's not in master yet and I don't have it fully
>> figured out.
>> 
>> Need some time to think through this.
>> 
>> --
>> Prasanna.,
>> 
>> 
>> Powered by BigRock.com
>> 
> 
> 
> OK - are your concerns CM-related? or Marvin only?
> 
> Any problems I am not seeing with breaking out CloudMonkey?
> 
> Anyone else have concerns here about breaking out CloudMonkey?
> 
> --David

Could we talk about it during the hack day and report to the list ? I for one 
dont understand how these break out repos would work ...process wise, release 
wise, ml wise etc ?

Re: Query String Request Authentication(QSRA) support by S3 providers

[Min Chen]

Yes, current code is in S3ImageStoreDriverImpl.createEntityExtractUrl, which 
has a security issue mentioned in CLOUDSTACK-3030. I am going to change it to 
use generatePresignedUrl api from AWS S3 api.

Thanks
-min

From: John Burwell mailto:jburw...@basho.com>>
Date: Tuesday, June 18, 2013 8:07 AM
To: Min Chen mailto:min.c...@citrix.com>>
Cc: Thomas O'Dowd mailto:tpod...@cloudian.com>>, 
"dev@cloudstack.apache.org" 
mailto:dev@cloudstack.apache.org>>
Subject: Re: Query String Request Authentication(QSRA) support by S3 providers

Min,

Is the code checked into the object_store branch?  If so, which lines in 
S3TemplateDownloader?

Thanks,
-John

On Jun 18, 2013, at 12:39 AM, Min Chen 
mailto:min.c...@citrix.com>> wrote:

Hi John,

This is regarding extractTemplate api, where for extractable template, users 
can click "Download Template" button from UI to get a http url to download the 
template already stored at S3 without providing S3 credentials. In 4.1, we 
don't have this issue, since the URL returned is the public web server location 
hosted in ssvm, and in 4.2, we are returning URL pointing to s3 object. Without 
setting ACL to the S3 object, user cannot directly click the URL returned  from 
extractTemplate api to download the template without providing credentials. By 
reading the AWS SDK doc today, I ran across the following API that I may be 
able to use for this purpose:

 
URL 
   
generatePresignedUrl(String
 bucketName, 
String
 key, 
Date
 expiration, 
HttpMethod
 method)
   Returns a pre-signed URL for accessing an Amazon S3 resource.

This is along the same line as QSRA mentioned by Tom, by wrapped in 
AmazonS3Client for easy consumption. By using this method, I think that I don't 
need to change ACL of S3 object to open a security hole.

Thanks
-min

From: John Burwell mailto:jburw...@basho.com>>
Date: Monday, June 17, 2013 7:38 PM
To: Min Chen mailto:min.c...@citrix.com>>
Cc: Thomas O'Dowd mailto:tpod...@cloudian.com>>, 
"dev@cloudstack.apache.org" 
mailto:dev@cloudstack.apache.org>>
Subject: Re: Query String Request Authentication(QSRA) support by S3 providers

Min,

Why are we mucking with ACLs at all?  The best security practice would be to 
create a bucket for CloudStack's use and assign it a dedicated access key and 
secret key pair with read/write access only to that bucket.  Requiring an 
administrative account to an object store opens an unnecessarily large attack 
surface.  Therefore, as implemented in 4.1, we should defer bucket creation, 
ACL assignment, and credential creation to the administrator/operator.

Thanks,
-John

On Jun 17, 2013, at 1:15 PM, Min Chen 
mailto:min.c...@citrix.com>> wrote:

Tom filed a very good bug for ACL setting change on S3 object when users issue 
extractTemplate API (https://issues.apache.org/jira/browse/CLOUDSTACK-3030), 
and his recommendation of using Query String Request Authentication (QSRA) 
alternative sounds like a right approach to fix this bug. Before implementing 
it, I would like to confirm if QSRA should be supported by all S3 providers if 
they claim that they are AWS s3 compatible. If so, we will make this assumption 
in our code. Based on Tom, Cloudian is supporting it. How about RiakCS, John?

Thanks
-min

Re: committer wanted for review

[Daan Hoogland]

<<< text/html; charset=windows-1252: Unrecognized >>>
<>

Re: UI Plugin Internationalization

[SuichII, Christopher]

Sure!

What I'd like: As someone developing a UI plugin, I'd like to be able to 
contribute my own internationalized messages/labels/etc. to the JS dictionary. 
Currently, this can be done by shoving them all in to the dictionary when your 
plugin is initialized, but it is not very pretty - requiring you to determine 
the locale and require the messages file yourself.

So a little preface. As far as I can tell, all UI plugin loading is done in JS 
- that is, not at all in JSPs. So, any UI plugin internationalization needs to 
be done in JS, or some of the UI plugin loading needs to be done in JSPs (I'm 
gonna bet the former is preferred).

My idea was to add some JS to dictionary.jsp (whose JS is executed after UI 
plugins are loaded). Here we would take the locale from the JSP and require a 
JS file in plugins//dictionary/ depending on the locale.

In my current prototype, the JS files holding the internationalized strings 
just store everything in a hash in the cloudStack variable, like: 
cloudStack.plugin_dictionaries.. I've done this because (I'm new 
to requirejs and) I am yet to find a way to simply return the hash or have the 
hash sent as a parameter to a callback of require(…).

Does anyone with more requirejs experience know how we could accomplish this 
more elegantly?

I'm also open to suggestions on completely different designs. =)

-Chris

On Jun 18, 2013, at 10:55 AM, Chip Childers 
 wrote:

> On Tue, Jun 18, 2013 at 12:18:16PM +, SuichII, Christopher wrote:
>> I've got some ideas on how to implement a system for allowing ui plugins to 
>> contribute internationalized strings to the ui dictionary, but I'd like to 
>> run things by a committer. Is there someone(s) who would like to talk 
>> offline (or keep replying here) about this feature?
>> 
>> Thanks,
>> Chris
> 
> The best method to collaborate on the project is to use the list to
> build up the feature proposal...  so explain away here please!

Re: [ANNOUNCE] New committer: Jayapal Reddy Uradi

[Venkata SwamyBabu Budumuru]

Congrats Jayapal!

On 18/06/13 1:05 PM, "Suresh Sadhu"  wrote:

>Congrats Jayapal !!
>
>-Original Message-
>From: Chip Childers [mailto:chip.child...@sungard.com]
>Sent: Monday, June 17, 2013 9:00 PM
>To: dev@cloudstack.apache.org
>Subject: [ANNOUNCE] New committer: Jayapal Reddy Uradi
>
>The Project Management Committee (PMC) for Apache CloudStack has asked
>Jayapal Reddy Uradi to become a committer and we are pleased to announce
>that they have accepted.
>
>Being a committer allows many contributors to contribute more
>autonomously. For developers, it makes it easier to submit changes and
>eliminates the need to have contributions reviewed via the patch
>submission process. Whether contributions are development-related or
>otherwise, it is a recognition of a contributor's participation in the
>project and commitment to the project and the Apache Way.
>
>Please join me in congratulating Jayapal!
>
>-chip
>on behalf of the CloudStack PMC

Re: Cannot log in to fresh install as admin

[SuichII, Christopher]

Nope. I just pulled, clean installed and deployed the db this morning.

-Chris

On Jun 18, 2013, at 10:58 AM, David Nalley 
 wrote:

> On Tue, Jun 18, 2013 at 10:56 AM, SuichII, Christopher
>  wrote:
>> I've created a fresh install of CS 4.2 with source from git, however when I 
>> attempt to log in, the following is logged:
>> 
>> WARN  [server.auth.SHA256SaltedUserAuthenticator] 
>> (1774710861@qtp-1102259485-4:) The stored password for admin isn't in the 
>> right format for this authenticator
>> INFO  [cloud.user.AccountManagerImpl] (1774710861@qtp-1102259485-4:) User 
>> admin in domain ROOT is disabled/locked (or account is disabled/locked)
>> 
>> I handle the second issue by updating the state either in 
>> developer-prefill.sql or in the database itself. However, I'm less 
>> knowledgeable about the password hash and salting. Is there something I have 
>> done wrong or not set up properly?
>> 
>> Thanks,
>> Chris
> 
> Is this an upgrade?
> 
> --David

Re: [DISCUSS] Issue with cloudmonkey-4.1.0-0 on pypi

[David Nalley]

On Mon, Jun 17, 2013 at 7:00 AM, Prasanna Santhanam  wrote:
> On Sun, Jun 09, 2013 at 10:26:43AM -0400, David Nalley wrote:
>> On Sun, Jun 9, 2013 at 7:51 AM, Rohit Yadav  wrote:
>> > Hi,
>> >
>> > I was about to test CloudStack but the cloudmonkey-4.1.0-0 release on pypi
>> > does not bundle failsafe api cache so when I install it I don't get any api
>> > commands. The autodiscovery using sync is useful but only with the
>> > ApiDiscovery plugin which works only for 4.2 and later. For 4.1 and below I
>> > think we should, in that case, bundle the cache for all the apis. Or maybe
>> > just oss components/plugins?
>> >
>> > I'll wait for Chip and others to comment if we want to ship it as it is or
>> > bundle the cache against 4.1 release?
>> >
>> > Cheers.
>>
>> Honestly - this is exactly why I've been suggesting[1] that we break
>> CloudMonkey (and Marvin) out of the main repo and giving it it's own
>> lifecycle. It's far easier/faster to iterate cloudmonkey than all of
>> CloudStack and tying it to the slower lifecycle of ACS will continue
>> to trouble it IMO.
>>
>> --David
>>
>> [1] http://markmail.org/message/wir5vfawex3y22ot
>
> I haven't given breaking out the project much thought. But it's
> certainly a possibility:
>
> a) However, there are parts of the codebase (checkin tests) that depend
> on marvin.
>
> b) I need to come up with a easier way to update marvin across
> cloudstack providers to enable auto-upating marvin's libraries like
> cloudmonkey can. For this I've made a couple enhancements to
> apidiscovery but it's not in master yet and I don't have it fully
> figured out.
>
> Need some time to think through this.
>
> --
> Prasanna.,
>
> 
> Powered by BigRock.com
>


OK - are your concerns CM-related? or Marvin only?

Any problems I am not seeing with breaking out CloudMonkey?

Anyone else have concerns here about breaking out CloudMonkey?

--David

Re: Query String Request Authentication(QSRA) support by S3 providers

[John Burwell]

Min,

Is the code checked into the object_store branch?  If so, which lines in 
S3TemplateDownloader?

Thanks,
-John

On Jun 18, 2013, at 12:39 AM, Min Chen  wrote:

> Hi John,
> 
> This is regarding extractTemplate api, where for extractable template, users 
> can click "Download Template" button from UI to get a http url to download 
> the template already stored at S3 without providing S3 credentials. In 4.1, 
> we don't have this issue, since the URL returned is the public web server 
> location hosted in ssvm, and in 4.2, we are returning URL pointing to s3 
> object. Without setting ACL to the S3 object, user cannot directly click the 
> URL returned  from extractTemplate api to download the template without 
> providing credentials. By reading the AWS SDK doc today, I ran across the 
> following API that I may be able to use for this purpose:
> 
>  URL  generatePresignedUrl(String bucketName, String key, Date expiration, 
> HttpMethod method) 
>Returns a pre-signed URL for accessing an Amazon S3 resource.
> 
> This is along the same line as QSRA mentioned by Tom, by wrapped in 
> AmazonS3Client for easy consumption. By using this method, I think that I 
> don't need to change ACL of S3 object to open a security hole.
> 
> Thanks
> -min
> 
> From: John Burwell 
> Date: Monday, June 17, 2013 7:38 PM
> To: Min Chen 
> Cc: Thomas O'Dowd , "dev@cloudstack.apache.org" 
> 
> Subject: Re: Query String Request Authentication(QSRA) support by S3 providers
> 
> Min,
> 
> Why are we mucking with ACLs at all?  The best security practice would be to 
> create a bucket for CloudStack's use and assign it a dedicated access key and 
> secret key pair with read/write access only to that bucket.  Requiring an 
> administrative account to an object store opens an unnecessarily large attack 
> surface.  Therefore, as implemented in 4.1, we should defer bucket creation, 
> ACL assignment, and credential creation to the administrator/operator.
> 
> Thanks,
> -John
> 
> On Jun 17, 2013, at 1:15 PM, Min Chen  wrote:
> 
>> Tom filed a very good bug for ACL setting change on S3 object when users 
>> issue extractTemplate API 
>> (https://issues.apache.org/jira/browse/CLOUDSTACK-3030), and his 
>> recommendation of using Query String Request Authentication (QSRA) 
>> alternative sounds like a right approach to fix this bug. Before 
>> implementing it, I would like to confirm if QSRA should be supported by all 
>> S3 providers if they claim that they are AWS s3 compatible. If so, we will 
>> make this assumption in our code. Based on Tom, Cloudian is supporting it. 
>> How about RiakCS, John?
>> 
>> Thanks
>> -min
>> 

Re: How to propose dev ?

[Chip Childers]

On Tue, Jun 11, 2013 at 12:26:20PM +0200, nfoata@orange.com wrote:
> Hi Cloudstack community,

Hi!

Sorry that nobody got back to you earlier.

> 
> I would like to propose two developments queries if possible (see below).
> However, it seems if I want to submit them, I have to send a git diff (I can 
> do it if need be).
> Is it the good way to do it or I have to follow a specific process ?

We have a couple of processes... but basically, it works like this:

1) propose the changes on this list (dev@cloudstack.apache.org).

2) if the changes are "large", then it's useful to document the changes
in a functional specification.

Here's a good example:

https://cwiki.apache.org/confluence/display/CLOUDSTACK/API+Request+Throttling

Here's the template page:

https://cwiki.apache.org/confluence/display/CLOUDSTACK/Design+Document+Template

Here's the wiki page that you would create your FS as a child page of:

https://cwiki.apache.org/confluence/display/CLOUDSTACK/Design+Documents+Not+Committed+to+a+Release

> 
> In my mind, I thought that first we have to propose (to be sure that nobody 
> done it or the community is ok),
> and then if everything goes fine, to do and send it.
> 
> Thanks in advance,
> 
> Have a good day,
> 
> Best regards,
> 
> Nicolas Foata
> 

These look like good ideas, but could benefit the community by being
sent out as individual proposals.  We use subject line prefixes like
"[PROPOSE]" to get people attention, followed by a good subject
describing the proposal.

Can you break them out into their own threads?

> 
>  1) VM instantiation : network information for VM
> 
> Goal: Sending network information to a new VM instance
> 
> Abstract/suggestion:
> While a VM is instantiated, CloudStack could also send the following 
> information if need be :
> - the instance name  (CS uuid)
> - the display name
> - VM tags
> - network information (IPv4, IPv6, netmask, routing, gateway, mac address, 
> etc.)
> just if we activate some global settings such as :
> - vm.instance.boot.network.required (true/false)
> - vm.instance.boot.vmname (true/false)
> - vm.instance.boot.uuid (true/false)
> - vm.instance.boot.tags (true/false)
> 
> Applications:
> - A VM could discover its network and dialog with physical and virtual 
> machines, etc.
> - A VM do not need a virtual router
> - According of this type of information (tags, names, ...) , management 
> servers could be able to configure and deploy correctly VMs.
> 
> 
> 
> 2)  VM instantiation : specific information for hypervisors
> 
> Goal  : Sending specific information for the hypervisor to well instantiate a 
> VM
> 
> Abstract/suggestion:
> While a VM is instantiated, Cloudstack could send and add furthermore data 
> for the hypervisor
> coming from a new field such as 'Other options/Other configuration' for 
> example in the 'Compute offering' screen.
> Thus, each hypervisor could decide whether it want to process the data and 
> how or to do not take it into account.
> With a such input, Cloudstack will be able to use the specificity and the 
> full power of each hypervisor.
> 
> Applications:
> 1) On XCP, it will be possible to branch some pci straightforwardly (via pci 
> passthrough)
> 2) To use the more efficiently the min, max memories (static and/or dynamic)
> 
> Please feel free to modify the text if you to find better and sexy 
> application examples
> with this two kinds of features and of course to correct mistakes.
> 
> 
> 
> 
> 
> 
> _
> 
> Ce message et ses pieces jointes peuvent contenir des informations 
> confidentielles ou privilegiees et ne doivent donc
> pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu 
> ce message par erreur, veuillez le signaler
> a l'expediteur et le detruire ainsi que les pieces jointes. Les messages 
> electroniques etant susceptibles d'alteration,
> France Telecom - Orange decline toute responsabilite si ce message a ete 
> altere, deforme ou falsifie. Merci.
> 
> This message and its attachments may contain confidential or privileged 
> information that may be protected by law;
> they should not be distributed, used or copied without authorisation.
> If you have received this email in error, please notify the sender and delete 
> this message and its attachments.
> As emails may be altered, France Telecom - Orange is not liable for messages 
> that have been modified, changed or falsified.
> Thank you.
> 

Re: enableStorageMaintenance

[La Motta, David]

I smell another hackathon topic  ;-)


David La Motta
Technical Marketing Engineer
Citrix Solutions

NetApp
919.476.5042
dlamo...@netapp.com



On Jun 18, 2013, at 10:56 AM, Chip Childers 
mailto:chip.child...@sungard.com>>
 wrote:

On Tue, Jun 18, 2013 at 01:32:40PM +, La Motta, David wrote:
Thanks, Edison.

"With the job ID, you can periodically check the job status by making calls to 
queryAsyncJobResult command."

My question remains, then: can the API introduce callbacks so we don't have to 
polling, especially on long running operations?

Someone would need to design / implement that, and proposals + patches
are welcome!

Re: Cannot log in to fresh install as admin

[David Nalley]

On Tue, Jun 18, 2013 at 10:56 AM, SuichII, Christopher
 wrote:
> I've created a fresh install of CS 4.2 with source from git, however when I 
> attempt to log in, the following is logged:
>
> WARN  [server.auth.SHA256SaltedUserAuthenticator] 
> (1774710861@qtp-1102259485-4:) The stored password for admin isn't in the 
> right format for this authenticator
> INFO  [cloud.user.AccountManagerImpl] (1774710861@qtp-1102259485-4:) User 
> admin in domain ROOT is disabled/locked (or account is disabled/locked)
>
> I handle the second issue by updating the state either in 
> developer-prefill.sql or in the database itself. However, I'm less 
> knowledgeable about the password hash and salting. Is there something I have 
> done wrong or not set up properly?
>
> Thanks,
> Chris

Is this an upgrade?

--David

Re: enableStorageMaintenance

[Chip Childers]

On Tue, Jun 18, 2013 at 01:32:40PM +, La Motta, David wrote:
> Thanks, Edison.
> 
> "With the job ID, you can periodically check the job status by making calls 
> to queryAsyncJobResult command."
> 
> My question remains, then: can the API introduce callbacks so we don't have 
> to polling, especially on long running operations?

Someone would need to design / implement that, and proposals + patches
are welcome!

Cannot log in to fresh install as admin

[SuichII, Christopher]

I've created a fresh install of CS 4.2 with source from git, however when I 
attempt to log in, the following is logged:

WARN  [server.auth.SHA256SaltedUserAuthenticator] 
(1774710861@qtp-1102259485-4:) The stored password for admin isn't in the right 
format for this authenticator
INFO  [cloud.user.AccountManagerImpl] (1774710861@qtp-1102259485-4:) User admin 
in domain ROOT is disabled/locked (or account is disabled/locked)

I handle the second issue by updating the state either in developer-prefill.sql 
or in the database itself. However, I'm less knowledgeable about the password 
hash and salting. Is there something I have done wrong or not set up properly?

Thanks,
Chris

Re: UI Plugin Internationalization

[Chip Childers]

On Tue, Jun 18, 2013 at 12:18:16PM +, SuichII, Christopher wrote:
> I've got some ideas on how to implement a system for allowing ui plugins to 
> contribute internationalized strings to the ui dictionary, but I'd like to 
> run things by a committer. Is there someone(s) who would like to talk offline 
> (or keep replying here) about this feature?
> 
> Thanks,
> Chris

The best method to collaborate on the project is to use the list to
build up the feature proposal...  so explain away here please!

Re: [gmcdon...@apache.org: IMPORTANT: Major Confluence Upgrade Coming Soon. Please review test instance now.]

[Joe Brockmeier]

On Tue, Jun 18, 2013, at 09:36 AM, Chip Childers wrote:
> 
> This is going to require that we re-point all of the website links to
> the wiki to the actual wiki URL's (not the exported HTML).

So much for "The first rule of CWIKI is don't link to CWIKI!" 

I'll make the changes today so we don't get caught unawares next week.

Best,

jzb
-- 
Joe Brockmeier
j...@zonker.net
Twitter: @jzb
http://www.dissociatedpress.net/

Re: committer wanted for review

[John Burwell]

On Jun 18, 2013, at 1:09 AM, Daan Hoogland  wrote:

> John,
> 
> I like your ground principles, I will keep looking a bit for a better spot
> to solve the problem.
> 
> I am not sure your arguments about technical debt and user input validation
> apply in the situation at hand.
> 
> A user will probably be just annoyed if we reject a valid posix path
> because it does not comply to unc or vice versa. So the policy of being
> strict on the output lenient on the input is maybe desirable.

As previous explained by Hiroaki, we have four issues around NFS path 
specifications.  The patch, as currently constituted address one of the issues 
while masking another.  Therefore, we are going to have to address this issue 
again in the future to address the other issues, and, likely, deal with the 
ramifications of having CloudStack incorrectly generating paths.  While ugly, 
the current code breaks -- giving us some trail to to the root cause of the 
problem.  With this fix, we are masking the issue of CloudStack code generating 
invalid paths.  Based on this understanding, I feel that we are expanding the 
technical debt around paths, not reducing it.

If I am understanding the UI flow correctly, we are talking about the path 
entered when creating secondary storage.  If so, the end user is a system 
administrator/operator who shouldn't find such a requirement onerous.  For 
input validation, we would need to add some on-line help pointing folks to the 
relevant RFCs explaining the format.

> 
> A more pragmatic argument, which i make maybe without being hindered by
> deep knowledge of cloudstack code, is that a path may be constructed in a
> distributed way and the error may occur at several locations. The path my
> users found had two instances of double slashes. It is both cheap,
> maintainable and robust to solve it in one location. I do not pretend that
> I have found that location however.

The situation you describe seems to beg for a dedicated Path immutable value 
object with either static factory methods or an associated builder than 
understands the rules around concatenation.  The more I think about the 
invocation of the fixPath method is that are typically lack the context to 
understand intent.  Providing a value object and explicit creational mechanisms 
allows clients to express intent and for the Storage layer to establish a 
deterministic contact for clients.

> 
> Then their is the question of whether this is an improvement or really only
> an ugly workaround. If you say yes to the latter, my submission should be
> refused altogether.
> 
> Having made those arguments; The priority on has been lowered by my users
> so much more time to work on it is not available. It was fun so far and i
> will have another dive at the code to find a good spot to solve this
> particular problem.

First and foremost, I appreciate anyone who wants to roll up their sleeves and 
help improve CloudStack (particularly storage).  Second, please don't take my 
feedback as passing judgements such as things being ugly or pretty.  Instead, 
the review process has evolved our understanding of the problem to be larger 
than just Windows clients.  From my perspective, this work has expanded our 
understanding of the system and some lurking issues.  I do think we need to 
re-approach the fix in light of our deeper understanding.  That being said, I 
think a new approach would actually be less code ….

> 
> thanks for your comments John,
> Daan
> 
> 
> On Mon, Jun 17, 2013 at 6:49 PM, John Burwell  wrote:
> 
>> Daan,
>> 
>> Please see my comments in-line below.
>> 
>> Thanks,
>> -John
>> 
>> On Jun 17, 2013, at 9:40 AM, Daan Hoogland 
>> wrote:
>> 
>>> John,
>>> 
>>> If I understand it correctly, you are stating that my take on the
>> solution
>>> is 'not done/not the way to go'?
>> 
>>> 
>>> For the record the case I solved was an instance of A, but I would not
>> call
>>> it adding technical debt. A arose from existing code in combination of a
>>> requirement to work with a non-posix-path compliant (but unc) nfs server.
>> 
>> From my perspective, it is technical debt because the solution, as
>> implemented, is masking/compensating for underlying defects.  I think we
>> should fix the underlying defects, input validation and value persistence,
>> rather than trying to compensate for it in the storage layer.  We also
>> likely need some type of utility/functionality to upgrade tools to identify
>> invalid path data in existing installations for correction.
>> 
>>> 
>>> regards,
>>> 
>>> 
>>> On Mon, Jun 17, 2013 at 2:01 PM, John Burwell 
>> wrote:
>>> 
 All,
 
 Please see my comments in-line below.
 
 Thanks,
 -John
 
 On Jun 15, 2013, at 6:11 AM, Hiroaki KAWAI 
 wrote:
 
> Probably we've agreed on that double slash should not
> generated by cloudstack.
> 
> If something went wrong and double slash was passed to
> Winfows based NFS, the reason may A) there was another

starting VM and get error of "unable to create a deployment for VM[user|i-2-107-VM]"

[William Jiang]

Hi,

We have a Ubuntu 12.04 VM with one disk on shared storage, it was working well 
before but now we saw the error of "unable to create a deployment for 
VM[user|i-2-107-VM]" during starting.
We saw this kind of issue happened on a windows server 2008 VM before.

In /var/log/cloud/management/management-server.log
We got following errors:

2013-06-14 12:28:34,362 DEBUG [cloud.capacity.CapacityManagerImpl] 
(Job-Executor-16:job-626) We need to allocate to the last host again, so 
checking if there is enough reserved capacity
2013-06-14 12:28:34,362 DEBUG [cloud.capacity.CapacityManagerImpl] 
(Job-Executor-16:job-626) Reserved CPU: 0 , Requested CPU: 1000
2013-06-14 12:28:34,362 DEBUG [cloud.capacity.CapacityManagerImpl] 
(Job-Executor-16:job-626) Reserved RAM: 0 , Requested RAM: 1073741824
2013-06-14 12:28:34,362 DEBUG [cloud.capacity.CapacityManagerImpl] 
(Job-Executor-16:job-626) STATS: Failed to alloc resource from host: 9 
reservedCpu: 0, requested cpu: 1000, reservedMem: 0, requested mem: 1073741824
2013-06-14 12:28:34,362 DEBUG [cloud.capacity.CapacityManagerImpl] 
(Job-Executor-16:job-626) Host does not have enough reserved CPU available, 
cannot allocate to this host.
2013-06-14 12:28:34,362 DEBUG [cloud.deploy.FirstFitPlanner] 
(Job-Executor-16:job-626) The last host of this VM does not have enough capacity
2013-06-14 12:28:34,362 DEBUG [cloud.deploy.FirstFitPlanner] 
(Job-Executor-16:job-626) Cannot choose the last host to deploy this VM

Any ideas about this issue?

Thanks,
William
This e-mail may be privileged and/or confidential, and the sender does not 
waive any related rights and obligations. Any distribution, use or copying of 
this e-mail or the information it contains by other than an intended recipient 
is unauthorized. If you received this e-mail in error, please advise me (by 
return e-mail or otherwise) immediately. Ce courrier ?lectronique est 
confidentiel et prot?g?. L'exp?diteur ne renonce pas aux droits et obligations 
qui s'y rapportent. Toute diffusion, utilisation ou copie de ce message ou des 
renseignements qu'il contient par une personne autre que le (les) 
destinataire(s) d?sign?(s) est interdite. Si vous recevez ce courrier 
?lectronique par erreur, veuillez m'en aviser imm?diatement, par retour de 
courrier ?lectronique ou par un autre moyen.

Re: Review Request: CLOUDSTACK-3054 modify cloud-set-guest-sshkey.in initscript to handle SELinux configuration

[David Nalley]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/11934/#review22064
---

Ship it!


Thanks for the patch 

commit 025f682e93edd662a0867bebbfc089039922df86
Author: Ian Service 
Date:   Tue Jun 18 10:39:31 2013 -0400

CLOUDSTACK-3054 - Have ssh key initscript handle SELinux permissions

- David Nalley


On June 18, 2013, 2:41 p.m., Ian Service wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/11934/
> ---
> 
> (Updated June 18, 2013, 2:41 p.m.)
> 
> 
> Review request for cloudstack.
> 
> 
> Description
> ---
> 
> With SELinux enabled on a CentOS VM template the automatic creation process 
> of ~/.ssh and ~/.ssh/authorized_keys doesn't contain the metadata required 
> for those files to be used for public key authentication.  Running 
> "restorecon -R -v ~/.ssh" restores the configuration and allows public key 
> authentication to function with SELinux in the enforcing state.
> 
> This patch checks for the existence of /sbin/restorecon when 
> /etc/init.d/cloud-set-guest-sshkey.in is run, after it would have updated the 
> .ssh directory and if it exists it restores the configuration.
> 
> 
> Diffs
> -
> 
>   setup/bindir/cloud-set-guest-sshkey.in 15008b8 
> 
> Diff: https://reviews.apache.org/r/11934/diff/
> 
> 
> Testing
> ---
> 
> Tested on latest CentOS 6.4 template.  Without this modification, machines 
> generated with with Cloudstack API's deployVirtualMachine and the keypair 
> parameter which have SELinux enabled still prompt for password even if the 
> correct private key is supplied to SSH.  Once this patch is applied those 
> same VMs will allow login via public key.
> 
> 
> Thanks,
> 
> Ian Service
> 
>

Re: Review Request: CLOUDSTACK-3054 modify cloud-set-guest-sshkey.in initscript to handle SELinux configuration

[David Nalley]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/11934/
---

(Updated June 18, 2013, 2:41 p.m.)


Review request for cloudstack.


Summary (updated)
-

CLOUDSTACK-3054 modify cloud-set-guest-sshkey.in initscript to handle SELinux 
configuration


Description
---

With SELinux enabled on a CentOS VM template the automatic creation process of 
~/.ssh and ~/.ssh/authorized_keys doesn't contain the metadata required for 
those files to be used for public key authentication.  Running "restorecon -R 
-v ~/.ssh" restores the configuration and allows public key authentication to 
function with SELinux in the enforcing state.

This patch checks for the existence of /sbin/restorecon when 
/etc/init.d/cloud-set-guest-sshkey.in is run, after it would have updated the 
.ssh directory and if it exists it restores the configuration.


Diffs
-

  setup/bindir/cloud-set-guest-sshkey.in 15008b8 

Diff: https://reviews.apache.org/r/11934/diff/


Testing
---

Tested on latest CentOS 6.4 template.  Without this modification, machines 
generated with with Cloudstack API's deployVirtualMachine and the keypair 
parameter which have SELinux enabled still prompt for password even if the 
correct private key is supplied to SSH.  Once this patch is applied those same 
VMs will allow login via public key.


Thanks,

Ian Service

Re: getting started

[Chip Childers]

On Tue, Jun 18, 2013 at 01:06:27PM +0200, Bogdan Cojocar wrote:
> Hi everyone,
> 
> My name is Bogdan. I am a software engineer working in the automotive
> industry. I am also passionate aboute cloud computing and I want to
> contribute to the CloudStack project by code.
> 
> I saw thaI have no rights to assign myself jira open issues. What is the
> procedure with this? Bassically I want to know how can I start.
> 
> Thanks and regards,
> Bogdan

Welcome!  I see that your Jira karma is fixed.  Please let us know if
you have any questions at all...

-chip

Review Request: Fix for CLOUDSTACK-2181: Scale down is allowed, which is not expected

[Harikrishna Patnala]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/11936/
---

Review request for cloudstack and Nitin Mehta.


Description
---

CLOUDSTACK-2181: Scale down is allowed when one resource(say cpu) is being 
scale up and other resource (say ram) is
 being scale down ;but not allowed when both resources are being scaledown


This addresses bug CLOUDSTACK-2181.


Diffs
-

  server/src/com/cloud/vm/UserVmManagerImpl.java e8ea024 

Diff: https://reviews.apache.org/r/11936/diff/


Testing
---

Tested locally


Thanks,

Harikrishna Patnala

[gmcdon...@apache.org: IMPORTANT: Major Confluence Upgrade Coming Soon. Please review test instance now.]

[Chip Childers]

This is going to require that we re-point all of the website links to
the wiki to the actual wiki URL's (not the exported HTML).

-chip

- Forwarded message from gmcdonald  -

Date: Tue, 18 Jun 2013 21:56:28 +1000
From: gmcdonald 
To: committ...@apache.org
Subject: IMPORTANT: Major Confluence Upgrade Coming Soon. Please review test 
instance now.
Reply-To: infrastruct...@apache.org
Organization: Apache Software Foundation
Message-ID: <06a101ce6c1a$dfb4ca40$9f1e5ec0$@apache.org>

[Note this message may be received twice as this may also hit any dev lists
you subscribe to]


Hi All,

If your project has a Confluence Wiki then this is an IMPORTANT announcement
for you and your project. Please read this email carefully.

NOTICE: The ASF Confluence instance is planned to be upgraded this Saturday
22nd June 2013. Judging by the time taken to upgrade the test instance,
please expect the service to be in a down or read only state for the entire
day.

This email is to let you know that a test upgrade has already occurred and
is live for you to play with now. This gives us all an opportunity to test
for stability as well as any upgrade/plugin issues that might have happened
along the way.

Our current confluence wiki is at version 3.4.9 from way back in February
2011 and Atlassian have released a further 45 updates along the way,
including another 2 major versions.
The test instance has been upgraded several times along the way, with
database surgery, operating system and server changes along the way. 

There have been casualties. Most notably is the Autoexport Plugin has had to
be disabled permanently as during extensive testing, this plugin stopped
working on version 4.3. Templates and Macros are also affected with major
changes from wiki markup to xhtml amongst other things. Some plugins
survived with upgrades all the way whilst some have been
decommissioned/replaced or have changed to 'paid for' versions that we need
to sort out licensing for. Nothing major that I can tell, but that's where
you lot come in with your testing of your own spaces.

Please familiarise yourself with what's new in Confluence 5.1 at
https://confluence.atlassian.com/display/DOC/Confluence+5.1+Release+Notes
and also take a good look around our upgraded test instance. Do not worry
about mucking anything up on the test instance as that is what it is there
for. Any changes/additions made will be lost on Saturday when a new
migration will take place. The current confluence version will remain online
in a read only state until the new version is completed.

A jira ticket has been raised at
https://issues.apache.org/jira/browse/INFRA-6406 where projects can add
comments on any issues they are having with the test instance as compared to
their old site. Just problems only please, do not turn it into a how to use
confluence 5 thread. In addition, if there are any features that you
currently use that do not work in the test instance, please replicate the
feature in the current production TEST space so that I can test them all in
the one place along the way. (Ask if you need create page permissions to
cwiki.apache.org/confluence/display/TEST )

It may be possible in the future to replace Autoexport by playing around
with the API to export the pages but this is not a priority, nor is it
supported. We warned projects long ago that the Autoexport Tool would be
incompatible with future Confluence versions and that time has now come.

Ok so, please test and report to the Jira Issue mentioned anything amiss
with your space. Go to https://cwiki2.apache.org/confluence and have a play
around. You have 3 DAYS to report anything you find.

Thanks

Gavin (ASF Infra)



- End forwarded message -

Fwd: IMPORTANT: Major Confluence Upgrade Coming Soon. Please review test instance now.

[Joe Brockmeier]

Just in case they don't send directly to our dev@ list. Major upgrade
coming to the wiki, some downtime ahead on Saturday, and some features
may not work afterwards. Please read!

- Original message -
From: gmcdonald 
To: committ...@apache.org
Subject: IMPORTANT: Major Confluence Upgrade Coming Soon. Please review
test instance now.
Date: Tue, 18 Jun 2013 21:56:28 +1000

[Note this message may be received twice as this may also hit any dev
lists
you subscribe to]


Hi All,

If your project has a Confluence Wiki then this is an IMPORTANT
announcement
for you and your project. Please read this email carefully.

NOTICE: The ASF Confluence instance is planned to be upgraded this
Saturday
22nd June 2013. Judging by the time taken to upgrade the test instance,
please expect the service to be in a down or read only state for the
entire
day.

This email is to let you know that a test upgrade has already occurred
and
is live for you to play with now. This gives us all an opportunity to
test
for stability as well as any upgrade/plugin issues that might have
happened
along the way.

Our current confluence wiki is at version 3.4.9 from way back in
February
2011 and Atlassian have released a further 45 updates along the way,
including another 2 major versions.
The test instance has been upgraded several times along the way, with
database surgery, operating system and server changes along the way. 

There have been casualties. Most notably is the Autoexport Plugin has
had to
be disabled permanently as during extensive testing, this plugin stopped
working on version 4.3. Templates and Macros are also affected with
major
changes from wiki markup to xhtml amongst other things. Some plugins
survived with upgrades all the way whilst some have been
decommissioned/replaced or have changed to 'paid for' versions that we
need
to sort out licensing for. Nothing major that I can tell, but that's
where
you lot come in with your testing of your own spaces.

Please familiarise yourself with what's new in Confluence 5.1 at
https://confluence.atlassian.com/display/DOC/Confluence+5.1+Release+Notes
and also take a good look around our upgraded test instance. Do not
worry
about mucking anything up on the test instance as that is what it is
there
for. Any changes/additions made will be lost on Saturday when a new
migration will take place. The current confluence version will remain
online
in a read only state until the new version is completed.

A jira ticket has been raised at
https://issues.apache.org/jira/browse/INFRA-6406 where projects can add
comments on any issues they are having with the test instance as
compared to
their old site. Just problems only please, do not turn it into a how to
use
confluence 5 thread. In addition, if there are any features that you
currently use that do not work in the test instance, please replicate
the
feature in the current production TEST space so that I can test them all
in
the one place along the way. (Ask if you need create page permissions to
cwiki.apache.org/confluence/display/TEST )

It may be possible in the future to replace Autoexport by playing around
with the API to export the pages but this is not a priority, nor is it
supported. We warned projects long ago that the Autoexport Tool would be
incompatible with future Confluence versions and that time has now come.

Ok so, please test and report to the Jira Issue mentioned anything amiss
with your space. Go to https://cwiki2.apache.org/confluence and have a
play
around. You have 3 DAYS to report anything you find.

Thanks

Gavin (ASF Infra)



Best,

jzb
-- 
Joe Brockmeier
j...@zonker.net
Twitter: @jzb
http://www.dissociatedpress.net/

Re: Review Request: Fix-all-occurrences-of-account.account-from-test_netscaler_configs.py

[Prasanna Santhanam]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/11900/#review22063
---


hmm - patch failed to apply

~/workspace/cloudstack/incubator-cloudstack/patch(branch:master*) » git am -s 
netscaler.patch 
  tsp@cloud-2
Applying: Fix all occurrences of account.account from test_netscaler_configs.py
error: patch failed: test/integration/component/test_netscaler_configs.py:725
error: test/integration/component/test_netscaler_configs.py: patch does not 
apply
Patch failed at 0001 Fix all occurrences of account.account from 
test_netscaler_configs.py
When you have resolved this problem run "git am --resolved".
If you would prefer to skip this patch, instead run "git am --skip".
To restore the original branch and stop patching run "git am --abort".

- Prasanna Santhanam


On June 18, 2013, 2:32 p.m., Rayees Namathponnan wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/11900/
> ---
> 
> (Updated June 18, 2013, 2:32 p.m.)
> 
> 
> Review request for cloudstack, Prasanna Santhanam and Girish Shilamkar.
> 
> 
> Description
> ---
> 
> Test cases test_netscaler_configs.py, failed due issue with account instance 
> create , 
> 
> 
> Diffs
> -
> 
> 
> Diff: https://reviews.apache.org/r/11900/diff/
> 
> 
> Testing
> ---
> 
> Tested
> 
> 
> Thanks,
> 
> Rayees Namathponnan
> 
>

Re: Review Request: Fix-all-occurrences-of-account.account-from-test_netscaler_configs.py

[Rayees Namathponnan]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/11900/
---

(Updated June 18, 2013, 2:32 p.m.)


Review request for cloudstack, Prasanna Santhanam and Girish Shilamkar.


Changes
---

Patch attached


Description
---

Test cases test_netscaler_configs.py, failed due issue with account instance 
create , 


Diffs
-


Diff: https://reviews.apache.org/r/11900/diff/


Testing
---

Tested


Thanks,

Rayees Namathponnan

Re: Review Request: modify cloud-set-guest-sshkey.in initscript to handle SELinux configuration

[Ian Service]

> On June 18, 2013, 1:58 p.m., David Nalley wrote:
> > Would you mind creating a bug for this?? 
> > 
> > --David

Not at all, not sure what detail was required, let me know if I need to update 
it.

https://issues.apache.org/jira/browse/CLOUDSTACK-3054


- Ian


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/11934/#review22060
---


On June 18, 2013, 1:53 p.m., Ian Service wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/11934/
> ---
> 
> (Updated June 18, 2013, 1:53 p.m.)
> 
> 
> Review request for cloudstack.
> 
> 
> Description
> ---
> 
> With SELinux enabled on a CentOS VM template the automatic creation process 
> of ~/.ssh and ~/.ssh/authorized_keys doesn't contain the metadata required 
> for those files to be used for public key authentication.  Running 
> "restorecon -R -v ~/.ssh" restores the configuration and allows public key 
> authentication to function with SELinux in the enforcing state.
> 
> This patch checks for the existence of /sbin/restorecon when 
> /etc/init.d/cloud-set-guest-sshkey.in is run, after it would have updated the 
> .ssh directory and if it exists it restores the configuration.
> 
> 
> Diffs
> -
> 
>   setup/bindir/cloud-set-guest-sshkey.in 15008b8 
> 
> Diff: https://reviews.apache.org/r/11934/diff/
> 
> 
> Testing
> ---
> 
> Tested on latest CentOS 6.4 template.  Without this modification, machines 
> generated with with Cloudstack API's deployVirtualMachine and the keypair 
> parameter which have SELinux enabled still prompt for password even if the 
> correct private key is supplied to SSH.  Once this patch is applied those 
> same VMs will allow login via public key.
> 
> 
> Thanks,
> 
> Ian Service
> 
>

Re: Review Request: modify cloud-set-guest-sshkey.in initscript to handle SELinux configuration

[David Nalley]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/11934/#review22060
---


Would you mind creating a bug for this?? 

--David

- David Nalley


On June 18, 2013, 1:53 p.m., Ian Service wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/11934/
> ---
> 
> (Updated June 18, 2013, 1:53 p.m.)
> 
> 
> Review request for cloudstack.
> 
> 
> Description
> ---
> 
> With SELinux enabled on a CentOS VM template the automatic creation process 
> of ~/.ssh and ~/.ssh/authorized_keys doesn't contain the metadata required 
> for those files to be used for public key authentication.  Running 
> "restorecon -R -v ~/.ssh" restores the configuration and allows public key 
> authentication to function with SELinux in the enforcing state.
> 
> This patch checks for the existence of /sbin/restorecon when 
> /etc/init.d/cloud-set-guest-sshkey.in is run, after it would have updated the 
> .ssh directory and if it exists it restores the configuration.
> 
> 
> Diffs
> -
> 
>   setup/bindir/cloud-set-guest-sshkey.in 15008b8 
> 
> Diff: https://reviews.apache.org/r/11934/diff/
> 
> 
> Testing
> ---
> 
> Tested on latest CentOS 6.4 template.  Without this modification, machines 
> generated with with Cloudstack API's deployVirtualMachine and the keypair 
> parameter which have SELinux enabled still prompt for password even if the 
> correct private key is supplied to SSH.  Once this patch is applied those 
> same VMs will allow login via public key.
> 
> 
> Thanks,
> 
> Ian Service
> 
>

Review Request: modify cloud-set-guest-sshkey.in initscript to handle SELinux configuration

[Ian Service]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/11934/
---

Review request for cloudstack.


Description
---

With SELinux enabled on a CentOS VM template the automatic creation process of 
~/.ssh and ~/.ssh/authorized_keys doesn't contain the metadata required for 
those files to be used for public key authentication.  Running "restorecon -R 
-v ~/.ssh" restores the configuration and allows public key authentication to 
function with SELinux in the enforcing state.

This patch checks for the existence of /sbin/restorecon when 
/etc/init.d/cloud-set-guest-sshkey.in is run, after it would have updated the 
.ssh directory and if it exists it restores the configuration.


Diffs
-

  setup/bindir/cloud-set-guest-sshkey.in 15008b8 

Diff: https://reviews.apache.org/r/11934/diff/


Testing
---

Tested on latest CentOS 6.4 template.  Without this modification, machines 
generated with with Cloudstack API's deployVirtualMachine and the keypair 
parameter which have SELinux enabled still prompt for password even if the 
correct private key is supplied to SSH.  Once this patch is applied those same 
VMs will allow login via public key.


Thanks,

Ian Service

Review Request: Fix for regression issue: CLOUDSTACK - 3021

[Gaurav Aradhye]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/11935/
---

Review request for cloudstack and Prasanna Santhanam.


Description
---

Fix for issue: https://issues.apache.org/jira/browse/CLOUDSTACK-3021
Changed order of cleanup list of resources in order to remove them properly 
(first child then parent)


Diffs
-

  test/integration/component/test_accounts.py ec135b1 

Diff: https://reviews.apache.org/r/11935/diff/


Testing
---


Thanks,

Gaurav Aradhye

Re: enableStorageMaintenance

[La Motta, David]

Thanks, Edison.

"With the job ID, you can periodically check the job status by making calls to 
queryAsyncJobResult command."

My question remains, then: can the API introduce callbacks so we don't have to 
polling, especially on long running operations?



David La Motta
Technical Marketing Engineer
Citrix Solutions

NetApp
919.476.5042
dlamo...@netapp.com



On Jun 17, 2013, at 1:57 PM, Edison Su 
mailto:edison...@citrix.com>> wrote:



-Original Message-
From: La Motta, David [mailto:david.lamo...@netapp.com]
Sent: Friday, June 14, 2013 7:54 AM
To: mailto:dev@cloudstack.apache.org>>
Subject: enableStorageMaintenance

...works great for putting down the storage into maintenance mode (looking
forward seeing this for secondary storage as well!).

Now the question is, after I've run it... how do I know when it is done so I can
operate on the volume?

enableStorageMaintenance will return a job id, which can be used in 
queryAsyncJobResult. Here is the doc:
http://cloudstack.apache.org/docs/en-US/Apache_CloudStack/4.1.0/html/Developers_Guide/asynchronous-commands.html



Poll using updateStoragePool and query the state for "Maintenance"?  What
about introducing the ability to pass in callback URLs to the REST call?



Thx.



David La Motta
Technical Marketing Engineer
Citrix Solutions

NetApp
919.476.5042
dlamo...@netapp.com

Re: Review Request: remove duplicated VPC router in return value of DomainRouterDaoImpl.listByStateAndNetworkType

[Wei Zhou]

> On June 17, 2013, 6:44 p.m., Chip Childers wrote:
> > Wei,
> > 
> > Should this still be applied?  If so, can you go ahead and do it (remember, 
> > 4.0 is not going to see another non-security release).
> > 
> > If not, can you please close this review?
> > 
> > -chip

Chip,
I just changed and committed it. Thanks.
-Wei


- Wei


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10062/#review22007
---


On March 22, 2013, 6:22 a.m., Wei Zhou wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/10062/
> ---
> 
> (Updated March 22, 2013, 6:22 a.m.)
> 
> 
> Review request for cloudstack.
> 
> 
> Description
> ---
> 
> The return value of listByStateAndNetworkType function in 
> server/src/com/cloud/vm/dao/DomainRouterDaoImpl.java contains duplicated VPC 
> router.
> For example, if a VPC contains 3 tiers, the return value contains 3 VPC 
> routers.
> 
> We need to get only one VPC router for a VPC.
> 
> This patch applies on 4.0.1. I will create a patch for master/4.1 later.
> 
> 
> Diffs
> -
> 
>   server/src/com/cloud/vm/dao/DomainRouterDaoImpl.java 175d3f2 
> 
> Diff: https://reviews.apache.org/r/10062/diff/
> 
> 
> Testing
> ---
> 
> Testing manually ok.
> 
> 
> Thanks,
> 
> Wei Zhou
> 
>

Re: Hack Day at CloudStack Collaboration Conference

[David Nalley]

On Tue, Jun 18, 2013 at 7:49 AM, John Burwell  wrote:
> Daan,
>
> I think that would make a lot of sense.  My plan is to collect a list
> of topics from the group and work through them. Does that still make
> sense?
>
> Thanks,
> -John
>

So we've had John Willis volunteer to run a Kanban board for us during
the hackathon - so bring plenty of topics, we'll work through them.

Re: Hack Day at CloudStack Collaboration Conference

[John Burwell]

Daan,

Cool.  As might be expected, I have some thoughts on maintenance mode, and, in 
particular, supporting it as a general notion across the system (not just 
storage).  I am looking forward to the conversation.

Thanks,
-John

On Jun 18, 2013, at 8:46 AM, Daan Hoogland  wrote:

> I think we are joining our sessions
> 
> 
> On Tue, Jun 18, 2013 at 1:49 PM, John Burwell  wrote:
> 
>> Daan,
>> 
>> I think that would make a lot of sense.  My plan is to collect a list
>> of topics from the group and work through them. Does that still make
>> sense?
>> 
>> Thanks,
>> -John
>> 
>> On Jun 18, 2013, at 1:14 AM, Daan Hoogland 
>> wrote:
>> 
>>> Is 'secondary storage maintenance mode' maybe a brake-out of your session
>>> John?
>>> 
>>> 
>>> On Mon, Jun 17, 2013 at 11:20 PM, John Burwell 
>> wrote:
>>> 
 All,
 
 I added a Storage Architecture topic to discuss the next steps in
>> evolving
 the Storage layer including (my hobby horse) breaking
>> Storage->Hypervisor
 dependencies.
 
 Thanks,
 -John
 
 On Jun 16, 2013, at 6:30 PM, John Burwell  wrote:
 
> All,
> 
> I added a topic to discuss Guava's features, and how we can exploit it
> in CloudStack.
> 
> Thanks,
> -John
> 
> 
> 
> 
> On Jun 16, 2013, at 4:53 PM, Sebastien Goasguen 
 wrote:
> 
>> I have added three items:
>> 
>> -libcloud: I have been submitting patches to libcloud for the
 cloudstack driver, it works for basic zones but we now need to improve
>> the
 advanced zone support
>> 
>> -whirr: I have tested apache whirr, it kind of works but there is an
 open bug
>> 
>> -deltacloud: discuss plans to have a cloudstack driver in delta cloud.
 I believe Chip's work on the ruby driver are a step in that
>> direction…maybe
 we can knock it down in a day.
>> 
>> -sebastien
>> 
>> On Jun 14, 2013, at 1:23 PM, Mike Tutkowski <
 mike.tutkow...@solidfire.com> wrote:
>> 
>>> Sounds good
>>> 
>>> I will update the Wiki.
>>> 
>>> 
>>> On Fri, Jun 14, 2013 at 10:58 AM, Joe Brockmeier 
 wrote:
>>> 
 Hi Mike,
 
 On Thu, Jun 13, 2013, at 03:55 PM, Mike Tutkowski wrote:
> I was wondering if we have the following documentation (below). If
 not, I
> was thinking it might be a good session to discuss and start in
>> (at a
> high level) on developing such documentation.
> 
> 1) Class diagrams highlighting the main classes that make up the
 Compute,
> Networking, and Storage components of CloudStack and how they
>> relate
 to
> each other.
> 
> 2) Object-interaction diagrams showing how the main instances in
>> the
> system coordinate execution of tasks.
> 
> 3) What kinds of threads are involved in the system (this will help
> developers better understand what resources are shared among
>> threads
 and
> need to be locked at certain times)?
 
 AFAIK, this doesn't exist currently. Would love to see this - so if
 you
 want to take lead, I'm happy to attend to help facilitate and take
 down
 notes, etc.
 
 Best,
 
 jzb
 --
 Joe Brockmeier
 j...@zonker.net
 Twitter: @jzb
 http://www.dissociatedpress.net/
>>> 
>>> 
>>> 
>>> --
>>> *Mike Tutkowski*
>>> *Senior CloudStack Developer, SolidFire Inc.*
>>> e: mike.tutkow...@solidfire.com
>>> o: 303.746.7302
>>> Advancing the way the world uses the
>>> cloud
>>> *™*
 
 
>> 

Re: Hack Day at CloudStack Collaboration Conference

[Daan Hoogland]

I think we are joining our sessions


On Tue, Jun 18, 2013 at 1:49 PM, John Burwell  wrote:

> Daan,
>
> I think that would make a lot of sense.  My plan is to collect a list
> of topics from the group and work through them. Does that still make
> sense?
>
> Thanks,
> -John
>
> On Jun 18, 2013, at 1:14 AM, Daan Hoogland 
> wrote:
>
> > Is 'secondary storage maintenance mode' maybe a brake-out of your session
> > John?
> >
> >
> > On Mon, Jun 17, 2013 at 11:20 PM, John Burwell 
> wrote:
> >
> >> All,
> >>
> >> I added a Storage Architecture topic to discuss the next steps in
> evolving
> >> the Storage layer including (my hobby horse) breaking
> Storage->Hypervisor
> >> dependencies.
> >>
> >> Thanks,
> >> -John
> >>
> >> On Jun 16, 2013, at 6:30 PM, John Burwell  wrote:
> >>
> >>> All,
> >>>
> >>> I added a topic to discuss Guava's features, and how we can exploit it
> >>> in CloudStack.
> >>>
> >>> Thanks,
> >>> -John
> >>>
> >>>
> >>>
> >>>
> >>> On Jun 16, 2013, at 4:53 PM, Sebastien Goasguen 
> >> wrote:
> >>>
>  I have added three items:
> 
>  -libcloud: I have been submitting patches to libcloud for the
> >> cloudstack driver, it works for basic zones but we now need to improve
> the
> >> advanced zone support
> 
>  -whirr: I have tested apache whirr, it kind of works but there is an
> >> open bug
> 
>  -deltacloud: discuss plans to have a cloudstack driver in delta cloud.
> >> I believe Chip's work on the ruby driver are a step in that
> direction…maybe
> >> we can knock it down in a day.
> 
>  -sebastien
> 
>  On Jun 14, 2013, at 1:23 PM, Mike Tutkowski <
> >> mike.tutkow...@solidfire.com> wrote:
> 
> > Sounds good
> >
> > I will update the Wiki.
> >
> >
> > On Fri, Jun 14, 2013 at 10:58 AM, Joe Brockmeier 
> >> wrote:
> >
> >> Hi Mike,
> >>
> >> On Thu, Jun 13, 2013, at 03:55 PM, Mike Tutkowski wrote:
> >>> I was wondering if we have the following documentation (below). If
> >> not, I
> >>> was thinking it might be a good session to discuss and start in
> (at a
> >>> high level) on developing such documentation.
> >>>
> >>> 1) Class diagrams highlighting the main classes that make up the
> >> Compute,
> >>> Networking, and Storage components of CloudStack and how they
> relate
> >> to
> >>> each other.
> >>>
> >>> 2) Object-interaction diagrams showing how the main instances in
> the
> >>> system coordinate execution of tasks.
> >>>
> >>> 3) What kinds of threads are involved in the system (this will help
> >>> developers better understand what resources are shared among
> threads
> >> and
> >>> need to be locked at certain times)?
> >>
> >> AFAIK, this doesn't exist currently. Would love to see this - so if
> >> you
> >> want to take lead, I'm happy to attend to help facilitate and take
> >> down
> >> notes, etc.
> >>
> >> Best,
> >>
> >> jzb
> >> --
> >> Joe Brockmeier
> >> j...@zonker.net
> >> Twitter: @jzb
> >> http://www.dissociatedpress.net/
> >
> >
> >
> > --
> > *Mike Tutkowski*
> > *Senior CloudStack Developer, SolidFire Inc.*
> > e: mike.tutkow...@solidfire.com
> > o: 303.746.7302
> > Advancing the way the world uses the
> > cloud
> > *™*
> >>
> >>
>

UI Plugin Internationalization

[SuichII, Christopher]

I've got some ideas on how to implement a system for allowing ui plugins to 
contribute internationalized strings to the ui dictionary, but I'd like to run 
things by a committer. Is there someone(s) who would like to talk offline (or 
keep replying here) about this feature?

Thanks,
Chris

Re: Hack Day at CloudStack Collaboration Conference

[John Burwell]

Daan,

I think that would make a lot of sense.  My plan is to collect a list
of topics from the group and work through them. Does that still make
sense?

Thanks,
-John

On Jun 18, 2013, at 1:14 AM, Daan Hoogland  wrote:

> Is 'secondary storage maintenance mode' maybe a brake-out of your session
> John?
>
>
> On Mon, Jun 17, 2013 at 11:20 PM, John Burwell  wrote:
>
>> All,
>>
>> I added a Storage Architecture topic to discuss the next steps in evolving
>> the Storage layer including (my hobby horse) breaking Storage->Hypervisor
>> dependencies.
>>
>> Thanks,
>> -John
>>
>> On Jun 16, 2013, at 6:30 PM, John Burwell  wrote:
>>
>>> All,
>>>
>>> I added a topic to discuss Guava's features, and how we can exploit it
>>> in CloudStack.
>>>
>>> Thanks,
>>> -John
>>>
>>>
>>>
>>>
>>> On Jun 16, 2013, at 4:53 PM, Sebastien Goasguen 
>> wrote:
>>>
 I have added three items:

 -libcloud: I have been submitting patches to libcloud for the
>> cloudstack driver, it works for basic zones but we now need to improve the
>> advanced zone support

 -whirr: I have tested apache whirr, it kind of works but there is an
>> open bug

 -deltacloud: discuss plans to have a cloudstack driver in delta cloud.
>> I believe Chip's work on the ruby driver are a step in that direction…maybe
>> we can knock it down in a day.

 -sebastien

 On Jun 14, 2013, at 1:23 PM, Mike Tutkowski <
>> mike.tutkow...@solidfire.com> wrote:

> Sounds good
>
> I will update the Wiki.
>
>
> On Fri, Jun 14, 2013 at 10:58 AM, Joe Brockmeier 
>> wrote:
>
>> Hi Mike,
>>
>> On Thu, Jun 13, 2013, at 03:55 PM, Mike Tutkowski wrote:
>>> I was wondering if we have the following documentation (below). If
>> not, I
>>> was thinking it might be a good session to discuss and start in (at a
>>> high level) on developing such documentation.
>>>
>>> 1) Class diagrams highlighting the main classes that make up the
>> Compute,
>>> Networking, and Storage components of CloudStack and how they relate
>> to
>>> each other.
>>>
>>> 2) Object-interaction diagrams showing how the main instances in the
>>> system coordinate execution of tasks.
>>>
>>> 3) What kinds of threads are involved in the system (this will help
>>> developers better understand what resources are shared among threads
>> and
>>> need to be locked at certain times)?
>>
>> AFAIK, this doesn't exist currently. Would love to see this - so if
>> you
>> want to take lead, I'm happy to attend to help facilitate and take
>> down
>> notes, etc.
>>
>> Best,
>>
>> jzb
>> --
>> Joe Brockmeier
>> j...@zonker.net
>> Twitter: @jzb
>> http://www.dissociatedpress.net/
>
>
>
> --
> *Mike Tutkowski*
> *Senior CloudStack Developer, SolidFire Inc.*
> e: mike.tutkow...@solidfire.com
> o: 303.746.7302
> Advancing the way the world uses the
> cloud
> *™*
>>
>>

Re: getting started

[Prasanna Santhanam]

On Tue, Jun 18, 2013 at 01:20:18PM +0200, Bogdan Cojocar wrote:
> My jira id is bogdan2000
> 

Given you JIRA permissions. Thanks,

-- 
Prasanna.,


Powered by BigRock.com