[GitHub] cloudstack issue #2006: CLOUDSTACK-9833: Move configuration parameters from ...

[harikrishna-patnala]

Github user harikrishna-patnala commented on the issue:

https://github.com/apache/cloudstack/pull/2006
  
Thanks @jayapalu I have also added some content security policy in HTTP 
servlet response to detect and mitigate certain type of attacks.
Restricted image source, style sheets, java scripts, URLs to be loaded only 
from self.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] cloudstack issue #2006: CLOUDSTACK-9833: Move configuration parameters from ...

[jayapalu]

Github user jayapalu commented on the issue:

https://github.com/apache/cloudstack/pull/2006
  
Code LGTM


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] cloudstack issue #1278: CLOUDSTACK-9198: Virtual router gets deployed in dis...

[anshul1886]

Github user anshul1886 commented on the issue:

https://github.com/apache/cloudstack/pull/1278
  
@rafaelweingartner Sorry for the late reply. But it seems you have 
misunderstood me here. I am not pointing finger here. I was just trying to 
point out that there may be developer concern there to not remove it. Some 
changes looks quite simple but have potential to cause regressions. That's why 
I have done this way. I prefer to have code improvements of that type of 
changes in a separate PR. If anything goes wrong then they can be easily 
reverted without causing any regression. In other words fix for some bug 
doesn't get accidentally removed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] cloudstack pull request #1867: CLOUDSTACK-9706: Added snapshots cleanup in s...

[anshul1886]

GitHub user anshul1886 reopened a pull request:

https://github.com/apache/cloudstack/pull/1867

CLOUDSTACK-9706: Added snapshots cleanup in start and storage GC thre…

…ad if they are failed to cleanup during DeleteSnapshot command

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/anshul1886/cloudstack-1 CLOUDSTACK-9706

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/cloudstack/pull/1867.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1867


commit c68931fc64718d8c7f22d401f624ae649effdf94
Author: Anshul Gangwar 
Date:   2016-05-09T07:15:31Z

CLOUDSTACK-9706: Added snapshots cleanup in start and storage GC thread if 
they are failed to cleanup during DeleteSnapshot command




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] cloudstack pull request #1282: CLOUDSTACK-9200: Fixed failed to delete snaps...

[anshul1886]

Github user anshul1886 closed the pull request at:

https://github.com/apache/cloudstack/pull/1282


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] cloudstack pull request #1282: CLOUDSTACK-9200: Fixed failed to delete snaps...

[anshul1886]

Github user anshul1886 commented on a diff in the pull request:

https://github.com/apache/cloudstack/pull/1282#discussion_r111531779
  
--- Diff: 
engine/storage/snapshot/src/org/apache/cloudstack/storage/snapshot/XenserverSnapshotStrategy.java
 ---
@@ -245,6 +245,12 @@ public boolean deleteSnapshot(Long snapshotId) {
 return true;
 }
 
+if(snapshotVO.getState() == Snapshot.State.Allocated) {
--- End diff --

@rhtyd Missed that change. Closing PR now.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] cloudstack pull request #1867: CLOUDSTACK-9706: Added snapshots cleanup in s...

[anshul1886]

Github user anshul1886 closed the pull request at:

https://github.com/apache/cloudstack/pull/1867


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] cloudstack issue #1941: CLOUDSTACK-8663: Fixed various issues to allow VM sn...

[anshul1886]

Github user anshul1886 commented on the issue:

https://github.com/apache/cloudstack/pull/1941
  
@karuturi Raised #2043 to remove the test which is no longer needed. 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] cloudstack pull request #2043: CLOUDSTACK-9876: Removed test test_01_test_vm...

[anshul1886]

GitHub user anshul1886 opened a pull request:

https://github.com/apache/cloudstack/pull/2043

CLOUDSTACK-9876: Removed test test_01_test_vm_volume_snapshot

As we no longer have that restriction and now after fix for CLOUDSTACK-8663 
we allow VM and volume snapshots to exist together

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/anshul1886/cloudstack-1 CLOUDSTACK-9876

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/cloudstack/pull/2043.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #2043


commit fa5e59675e2750edc55a4c75ff8770d363c55de7
Author: Anshul Gangwar 
Date:   2017-04-14T05:24:56Z

CLOUDSTACK-9876: Removed test test_01_test_vm_volume_snapshot as we no 
longer have that restriction and now after fix for CLOUDSTACK-8663 we allow VM 
and volume snapshots to exist together




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

Re: [4.10] VPN disconnected while network changes taken

[Rajani Karuturi]

Hi Haijiao,

Thanks for testing. Can you log a bug for this please? It can be
a blocker for 4.10.

@Will,

Did you get a chance to take a look at this issue?

Thanks,

~ Rajani

http://cloudplatform.accelerite.com/

On April 12, 2017 at 7:12 AM, Will Stevens
(wstev...@cloudops.com) wrote:

Thanks, I will have a look.

*Will STEVENS*
Lead Developer



On Tue, Apr 11, 2017 at 8:58 PM, Haijiao <18602198...@163.com>
wrote:

HI, Will
It's a Remote Access VPN that losing connection while new
network configs
introduced.
Thanks !

在2017年04月12 02时26分, "Will Stevens"写道:

Is this a Site-to-Site VPN connection or the Remote Access VPN
that is
losing connection when new network configs are introduced?

Thanks,

*Will STEVENS*
Lead Developer



On Sat, Apr 8, 2017 at 12:49 AM, Haijiao <18602198...@163.com>
wrote:

Hi,

We built and tested the ACS 4.10 from the latest master (Apr.7,
2017)

Our environment is,
- ACS: 4.10.0.0-SNAPSHOT
- Management Server: Centos7.2 1151
- Host: Centos7.2 1151
- System VM: systemvm64template-master-4.10.0-kvm.qcow2.bz2
- Network: Isolated Network
- Network Offering: Offering for Isolated networks with Source
Nat

service

enabled

We can successfully setup VPN and it works as expected. However,
once

we

take any network changes below, the VPN connnection will be
immediately
disconnected.

- Update firewall rules (add/change)
- Update port fowarding
- Update LB
- Add one more VPN account

Is there some configuration we missed ? Or it's due to the new
VPN
component (StrongSWAN) introcuced in 4.10 ?

Thanks in advance !

[GitHub] cloudstack pull request #2042: CLOUDSTACK-9875: Unable to re-apply Explicit ...

[harikrishna-patnala]

GitHub user harikrishna-patnala opened a pull request:

https://github.com/apache/cloudstack/pull/2042

CLOUDSTACK-9875: Unable to re-apply Explicit dedication to VM

Problem:
When a VM is deployed with in an Affinity group which has the cluster 
dedicated to a subdomain (zone is dedicated to parent domain) it is getting 
successful. We can also stop the vm and remove the affinity group, but if you 
want to add back the affinity it is failing.

Following are the steps to reproduce

1. I had created a Domain (Glass SA Parent Domain) and under it a subdomain 
(Glass SA Subdomain) and created an account to it.
2. Apply dedication to the zone for primary domain (Glass SA Parent Domain)
3. Apply dedication to the cluster for sub domain (Glass SA Subdomain)
4. Logged in with the Account of Subdomain.
5. Created an instance with the affinity (DedicatedGrp-domain-Glass SA 
Subdomain) - the dedication set with the cluster for the subdomain.
6. Powered off the VM, removed the affinity.
7. Tried adding back (the cluster affinity subdomain) - gives the error 
"Entity affinity Group () and entity Acct () belong to different accounts" 

Root cause:
During VM deployment there is clear check on affinity type 
(account/domain). Here since the acl_type is "domain" it does not expect to be 
same owner for entities.
But during update of affinity to VM there is no specific check for acl_type 
"domain".

Solution:
Fix is to make the access check similar to VM deployment where it does not 
expect to be same owner for entities if the acl_type is "domain".

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/Accelerite/cloudstack CLOUDSTACK-9875

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/cloudstack/pull/2042.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #2042


commit 4f6e5daa580aa5b456e946783cb08cabc4b9c6bc
Author: Harikrishna Patnala 
Date:   2015-11-18T12:03:49Z

CLOUDSTACK-9875: Unable to re-apply Explicit dedication to VM

Problem:
When a VM is deployed with in an Affinity group which has the cluster 
dedicated to a subdomain (zone is dedicated to parent domain) it is getting 
successful. We can also stop the vm and remove the affinity group, but if you 
want to add back the affinity it is failing.

Root cause:
During VM deployment there is clear check on affinity type 
(account/domain). Here since the acl_type is "domain" it does not expect to be 
same owner for entities.
But during update of affinity to VM there is no specific check for acl_type 
"domain".

Solution:
Fix is to make the access check similar to VM deployment where it does not 
expect to be same owner for entities if the acl_type is "domain".




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

Re: CloudStack related changes in Ansible 2.3

[Rajani Karuturi]

Great work Rene. Thank you.

~ Rajani

http://cloudplatform.accelerite.com/

On April 12, 2017 at 8:43 PM, Rene Moser (m...@renemoser.net)
wrote:

Hi CloudStack users

Ansible 2.3 is about to be released, I would like to summarize
the
CloudStack related features and changes in this release.

New modules
---

- cs_host
- cs_nic
- cs_region
- cs_role
- cs_vpc

Examples and usage for these modules can be found in the docs,
http://docs.ansible.com/ansible/list_of_cloud_modules.html#cloudstack
as
usual.

Docs


The CloudStack guide
http://docs.ansible.com/ansible/guide_cloudstack.html has been
updated,
note the new feature "Environment Variables"
http://docs.ansible.com/ansible/guide_cloudstack.html#environment-variables

VPC
---

The VPC support has been improved in the related modules, but
there is
still some work to do.

Integration tests
-

Soon, CloudStack related new Ansible PRs will be automatically
tested
(~1.000 tasks) on a CI against a CloudStack Simulator running
4.9.x.

Future Module Development
-

Due some other side projects of mine (writing books takes more
time than
one would might think), development of new modules is lagging a
bit. One
module (cs_serviceoffer) is currently WIP
https://github.com/ansible/ansible/pull/19041.

But no worries, new modules are planed:
- cs_diskoffer
- modules for VPN setup

Cloud Role
--

At SWISS TXT, we created a Ansible role for setting up VMs in a
cloudstack cloud with advanced networking for different customer
projects, The role is open source (BSD) and can be found on
GitHub
https://github.com/swisstxt/ansible-role-cloud-infra

Feel free to fork and improve it.

Goal of my Ansible CloudStack Project
-

I often get ask, why I am doing it.

My goal is to not only install and upgrade CloudStack by Ansible
(that
is relatively easy... and can even be done without that much
cloudstack
api interaction) but configure _and_ maintaining a cloud (basic
or
advanced networking) in a reliable way!

It will install the OS and install cloudstack management server,
install
the OS on the hosts, setup hypversisors, create zones, pods,
clusters,
accounts, users, add configured hosts to cloudstack all this by
a single
run and the best of it, you can re-run it safely again and
again,
without fear breaking anything.

Have to add a new host? No problem, put the hardware in the rack
and
connect it to the net, ansible will take care on the next run:
it can be
that simple.

Also note, ansible can manage your network switches, routers and
firewalls too!
http://docs.ansible.com/ansible/list_of_network_modules.html

The possibilities are endless...

Thanks
René

[GitHub] cloudstack issue #1996: CLOUDSTACK-9099: SecretKey is returned from the APIs

[jayapalu]

Github user jayapalu commented on the issue:

https://github.com/apache/cloudstack/pull/1996
  
In the travis ci the tests are failing it could be because of timeout. But 
when I run some of the test locally it is passing. 

The same test test_invalid_gw_nm  is failing in travis ci.


=my local xenserver setup test run ==
nosetests-2.7 --with-marvin 
--marvin-config=/Users/jayapal_uradi/dev/advanced.cfg --with-xunit  
--xunit-file=/tmp/test/testslog 
/Users/jayapal_uradi/dev/github/cloudstack/test/integration/component/test_invalid_gw_nm.py
 --zone=zone1 --hypervisor=xenserver

 Marvin Init Started 

=== Marvin Parse Config Successful ===

=== Marvin Setting TestData Successful===

 Log Folder Path: /tmp//MarvinLogs//Apr_14_2017_10_30_49_WKRPUW. All 
logs will be available here 

=== Marvin Init Logging Successful===

 Marvin Init Successful 
===final results are now copied to: 
/tmp//MarvinLogs/test_invalid_gw_nm_XQRFQU===
HSL007948:cloudstack jayapal_uradi$ vi 
/tmp//MarvinLogs/test_invalid_gw_nm_XQRFQU/
failed_plus_exceptions.txt  results.txt runinfo.txt 

HSL007948:cloudstack jayapal_uradi$ vi 
/tmp//MarvinLogs/test_invalid_gw_nm_XQRFQU/results.txt 
HSL007948:cloudstack jayapal_uradi$ cat  
/tmp//MarvinLogs/test_invalid_gw_nm_XQRFQU/results.txt 
test_isolated_nw_invalid_gw 
(integration.component.test_invalid_gw_nm.TestIsolatedNetworkInvalidGw) ... === 
TestName: test_isolated_nw_invalid_gw | Status : SUCCESS ===
ok

--
Ran 1 test in 5.837s

OK
== End of my local setup test run ==


https://travis-ci.org/apache/cloudstack/jobs/221647779

The command ./tools/travis/script.sh component/test_cpu_max_limits 
component/test_cpu_project_limits component/test_deploy_vm_userdata_multi_nic 
component/test_egress_fw_rules component/test_invalid_gw_nm 
component/test_ip_reservation component/test_lb_secondary_ip exited with 1

ContextSuite context=TestIsolatedNetw | exceptions.T | 0  | 
test_invalid_gw_nm   |
| orkInvalidGw>:setup   | ypeError ||   
 
  


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] cloudstack issue #1252: CLOUDSTACK-9182: Some running VMs turned off on manu...

[cloudmonger]

Github user cloudmonger commented on the issue:

https://github.com/apache/cloudstack/pull/1252
  
### ACS CI BVT Run
 **Sumarry:**
 Build Number 532
 Hypervisor xenserver
 NetworkType Advanced
 Passed=110
 Failed=2
 Skipped=7

_Link to logs Folder (search by build_no):_ 
https://www.dropbox.com/sh/yj3wnzbceo9uef2/AAB6u-Iap-xztdm6jHX9SjPja?dl=0


**Failed tests:**
* test_vm_snapshots.py

 * test_change_service_offering_for_vm_with_snapshots Failed

* test_routers_network_ops.py

 * test_03_RVR_Network_check_router_state Failed


**Skipped tests:**
test_01_test_vm_volume_snapshot
test_vm_nic_adapter_vmxnet3
test_static_role_account_acls
test_11_ss_nfs_version_on_ssvm
test_nested_virtualization_vmware
test_3d_gpu_support
test_deploy_vgpu_enabled_vm

**Passed test suits:**
test_deploy_vm_with_userdata.py
test_affinity_groups_projects.py
test_portable_publicip.py
test_over_provisioning.py
test_global_settings.py
test_scale_vm.py
test_service_offerings.py
test_routers_iptables_default_policy.py
test_loadbalance.py
test_routers.py
test_reset_vm_on_reboot.py
test_deploy_vms_with_varied_deploymentplanners.py
test_network.py
test_router_dns.py
test_non_contigiousvlan.py
test_login.py
test_deploy_vm_iso.py
test_list_ids_parameter.py
test_public_ip_range.py
test_multipleips_per_nic.py
test_metrics_api.py
test_regions.py
test_affinity_groups.py
test_network_acl.py
test_pvlan.py
test_volumes.py
test_nic.py
test_deploy_vm_root_resize.py
test_resource_detail.py
test_secondary_storage.py
test_vm_life_cycle.py
test_disk_offerings.py


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] cloudstack pull request #1950: [4.10] CLOUDSTACK-9462: Build packages on Ubu...

[asfgit]

Github user asfgit closed the pull request at:

https://github.com/apache/cloudstack/pull/1950


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] cloudstack pull request #2033: [master/4.10+] CLOUDSTACK-9462: Support for U...

[asfgit]

Github user asfgit closed the pull request at:

https://github.com/apache/cloudstack/pull/2033


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] cloudstack pull request #2023: BUG-ID: CLOUDSTACK-9808 Added system Vm upgra...

[asfgit]

Github user asfgit closed the pull request at:

https://github.com/apache/cloudstack/pull/2023


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] cloudstack issue #874: CLOUDSTACK-8897: baremetal:addHost:make host tag info...

[harikrishna-patnala]

Github user harikrishna-patnala commented on the issue:

https://github.com/apache/cloudstack/pull/874
  
tag:mergeready


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] cloudstack issue #1941: CLOUDSTACK-8663: Fixed various issues to allow VM sn...

[karuturi]

Github user karuturi commented on the issue:

https://github.com/apache/cloudstack/pull/1941
  
@anshul1886 There is a test regression due to this PR. Details are at 
https://github.com/apache/cloudstack/pull/1836#issuecomment-293897257
Can you take a look please?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] cloudstack issue #914: BUG-ID CLOUDSTACK-8939 VM Snapshot size with memory i...

[yvsubhash]

Github user yvsubhash commented on the issue:

https://github.com/apache/cloudstack/pull/914
  
tag:mergeready


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] cloudstack issue #1836: [4.10/master] Smoketest Health

[karuturi]

Github user karuturi commented on the issue:

https://github.com/apache/cloudstack/pull/1836
  
@rhtyd Thanks for running the tests and the report. I might request you 
again once the blockers are fixed :)
@serg38 Thanks for finding the PR. I will try and request the PR author to 
fix this. But, if there is no response, not sure what can be done.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] cloudstack issue #1716: CLOUDSTACK-9555 when a template is deleted and then ...

[ustcweizhou]

Github user ustcweizhou commented on the issue:

https://github.com/apache/cloudstack/pull/1716
  
this is not an isolated issue.
See https://issues.apache.org/jira/browse/CLOUDSTACK-8186
it would be better to fix it in framework/db/


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] cloudstack issue #1716: CLOUDSTACK-9555 when a template is deleted and then ...

[cloudmonger]

Github user cloudmonger commented on the issue:

https://github.com/apache/cloudstack/pull/1716
  
### ACS CI BVT Run
 **Sumarry:**
 Build Number 531
 Hypervisor xenserver
 NetworkType Advanced
 Passed=109
 Failed=3
 Skipped=7

_Link to logs Folder (search by build_no):_ 
https://www.dropbox.com/sh/yj3wnzbceo9uef2/AAB6u-Iap-xztdm6jHX9SjPja?dl=0


**Failed tests:**
* test_network.py

 * test_public_ip_admin_account Failed

* test_routers_network_ops.py

 * test_01_RVR_Network_FW_PF_SSH_default_routes_egress_true Failed

 * test_02_RVR_Network_FW_PF_SSH_default_routes_egress_false Failing since 
4 runs


**Skipped tests:**
test_01_test_vm_volume_snapshot
test_vm_nic_adapter_vmxnet3
test_static_role_account_acls
test_11_ss_nfs_version_on_ssvm
test_nested_virtualization_vmware
test_3d_gpu_support
test_deploy_vgpu_enabled_vm

**Passed test suits:**
test_deploy_vm_with_userdata.py
test_affinity_groups_projects.py
test_portable_publicip.py
test_over_provisioning.py
test_global_settings.py
test_scale_vm.py
test_service_offerings.py
test_routers_iptables_default_policy.py
test_loadbalance.py
test_routers.py
test_reset_vm_on_reboot.py
test_deploy_vms_with_varied_deploymentplanners.py
test_router_dns.py
test_non_contigiousvlan.py
test_login.py
test_deploy_vm_iso.py
test_list_ids_parameter.py
test_public_ip_range.py
test_multipleips_per_nic.py
test_metrics_api.py
test_regions.py
test_affinity_groups.py
test_network_acl.py
test_pvlan.py
test_volumes.py
test_nic.py
test_deploy_vm_root_resize.py
test_resource_detail.py
test_secondary_storage.py
test_vm_life_cycle.py
test_disk_offerings.py


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] cloudstack pull request #1282: CLOUDSTACK-9200: Fixed failed to delete snaps...

[Slair1]

Github user Slair1 commented on a diff in the pull request:

https://github.com/apache/cloudstack/pull/1282#discussion_r111500346
  
--- Diff: 
engine/storage/snapshot/src/org/apache/cloudstack/storage/snapshot/XenserverSnapshotStrategy.java
 ---
@@ -245,6 +245,12 @@ public boolean deleteSnapshot(Long snapshotId) {
 return true;
 }
 
+if(snapshotVO.getState() == Snapshot.State.Allocated) {
--- End diff --

@rhtyd , you're right, this change has since already been merged by PR 
#977.  


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

Re: Null Pointer listing public ips for a project

[Will Stevens]

Yes. I believe this is the issue we are facing as well. The query you
supplied returned 3 rows, so I think that is where the problem stems from.

We have seen some periodic issues with the deletion of a project not
actually cascading the delete of all of the resources associated with it.
We have monitoring setup on some resources to help detect zombies, but we
had not set one up on IPs.

We have not been able to isolate when/why we sometimes get the zombies when
deleting projects. We may just delete the resources owned by the project
first before deleting the project, but that is not ideal.

Thanks for the quick answer on the Wei.

On Apr 13, 2017 4:29 PM, "Wei ZHOU"  wrote:

> Hi Will,
>
> In our case, the account removal is terminated because the last host of a
> vm is removed from platform, so NPE was thrown.
> The NPE error is fixed by commit 4312d884629d4a9e7716da4c869433cdaa8181b8
> We were running with cloudstack 4.2.1 before, so we fixed it by similar
> change but the resources are not cleaned yet.
>
>
> -Wei
>
>
>
> 2017-04-13 22:06 GMT+02:00 Will Stevens :
>
> > Hey Wei,
> > That sounds about right.  I will have a look on our side and see what I
> can
> > come up with.
> >
> > Thanks,
> >
> > *Will STEVENS*
> > Lead Developer
> >
> > 
> >
> > On Thu, Apr 13, 2017 at 3:48 PM, Wei ZHOU  wrote:
> >
> > > Hi Will,
> > >
> > > I checked our platforms. We also have this issue. After investigation,
> I
> > > found a public ip was not released in an account removal in 2015 which
> > > should not happen.
> > >
> > > If you execute the following query, you should get empty result. If
> not,
> > > then something went wrong in the past.
> > > select * from user_ip_address uia join account on uia.account_id=
> > > account.id
> > > where account.removed is not null;
> > >
> > > -Wei
> > >
> > >
> > > 2017-04-13 18:36 GMT+02:00 Will Stevens :
> > >
> > > > The problem with that is that we are using the 'projectid=-1' to
> search
> > > > across all projects.
> > > >
> > > > I am not sure how a project gets into that state, but must be
> possible
> > > > through the API since that is our interface with ACS.
> > > >
> > > > We should be more defensive in this api call though because an end
> user
> > > api
> > > > call should never be able to throw a null pointer error.
> > > >
> > > > My guess is that we should do a null check on the 'project' here
> before
> > > we
> > > > try to use it.
> > > > https://github.com/apache/cloudstack/blob/master/server/
> > > src/com/cloud/api/
> > > > ApiResponseHelper.java#L2303
> > > >
> > > > *Will STEVENS*
> > > > Lead Developer
> > > >
> > > > 
> > > >
> > > > On Thu, Apr 13, 2017 at 12:17 PM, Rohit Yadav <
> > rohit.ya...@shapeblue.com
> > > >
> > > > wrote:
> > > >
> > > > > Hi Will,
> > > > >
> > > > >
> > > > > I tested this against a local KVM-based 4.9.2.0 environment and I
> > could
> > > > > not reproduce the error. I see this in api logs:
> > > > >
> > > > >
> > > > > ==> apilog.log <==
> > > > > 2017-04-13 18:16:30,340 INFO  [a.c.c.a.ApiServer]
> > > > > (catalina-exec-5:ctx-2b0966b8 ctx-2760e856) (logid:7439bdc4)
> > (userId=2
> > > > > accountId=2 sessionId=6183303731812D5EC32B1B37445AEC60)
> 192.168.1.58
> > > --
> > > > > GET signatureversion=3&sessionkey=H6E-LUsWpVY6WT_mJzz7qjGAdxg&
> > > > > command=listPublicIpAddresses&projectid=-1&expires=2017-04-
> > > > > 13T16%3A26%3A30%2B&response=json&listall=true 200 {"
> > > > > listpublicipaddressesresponse":{}}
> > > > >
> > > > > I think proper way to fix this would be to check that project
> object
> > is
> > > > > not null before calling any methods on it.
> > > > >
> > > > >
> > > > > Regards.
> > > > >
> > > > > 
> > > > > From: Will Stevens 
> > > > > Sent: 13 April 2017 21:38:34
> > > > > To: dev@cloudstack.apache.org
> > > > > Subject: Null Pointer listing public ips for a project
> > > > >
> > > > > Hey All,
> > > > > Looking for the best way to resolve this issue.
> > > > >
> > > > > My line numbers in the stack trace will not match the line numbers
> I
> > > > > reference because I am running 4.7 and I am linking the master
> files.
> > > > From
> > > > > what I can tell by reviewing the code, this has not been fixed in
> > > master.
> > > > > So here goes.
> > > > >
> > > > > When making a call to listPublicIpAddresses [1] with 'listall=true'
> > and
> > > > > 'projectid=-1', I get the following stacktrace.
> > > > >
> > > > > java.lang.NullPointerException
> > > > > at
> > > > > com.cloud.api.ApiResponseHelper.populateOwner(
> > > > ApiResponseHelper.java:2258)
> > > > > at
> > > > > com.cloud.api.ApiResponseHelper.createIPAddressResponse(
> > > > > ApiResponseHelper.java:718)
> > > > > at
> > > > > org.apache.cloudstack.api.command.admin.address.
> > > > > ListPublicIpAddressesCmdByAdmin.execute(
> > ListPublicIpAddressesCmdByAdmi
> > > > > n.java:44)
> > > > > at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:

Re: Null Pointer listing public ips for a project

[Wei ZHOU]

Hi Will,

In our case, the account removal is terminated because the last host of a
vm is removed from platform, so NPE was thrown.
The NPE error is fixed by commit 4312d884629d4a9e7716da4c869433cdaa8181b8
We were running with cloudstack 4.2.1 before, so we fixed it by similar
change but the resources are not cleaned yet.


-Wei



2017-04-13 22:06 GMT+02:00 Will Stevens :

> Hey Wei,
> That sounds about right.  I will have a look on our side and see what I can
> come up with.
>
> Thanks,
>
> *Will STEVENS*
> Lead Developer
>
> 
>
> On Thu, Apr 13, 2017 at 3:48 PM, Wei ZHOU  wrote:
>
> > Hi Will,
> >
> > I checked our platforms. We also have this issue. After investigation, I
> > found a public ip was not released in an account removal in 2015 which
> > should not happen.
> >
> > If you execute the following query, you should get empty result. If not,
> > then something went wrong in the past.
> > select * from user_ip_address uia join account on uia.account_id=
> > account.id
> > where account.removed is not null;
> >
> > -Wei
> >
> >
> > 2017-04-13 18:36 GMT+02:00 Will Stevens :
> >
> > > The problem with that is that we are using the 'projectid=-1' to search
> > > across all projects.
> > >
> > > I am not sure how a project gets into that state, but must be possible
> > > through the API since that is our interface with ACS.
> > >
> > > We should be more defensive in this api call though because an end user
> > api
> > > call should never be able to throw a null pointer error.
> > >
> > > My guess is that we should do a null check on the 'project' here before
> > we
> > > try to use it.
> > > https://github.com/apache/cloudstack/blob/master/server/
> > src/com/cloud/api/
> > > ApiResponseHelper.java#L2303
> > >
> > > *Will STEVENS*
> > > Lead Developer
> > >
> > > 
> > >
> > > On Thu, Apr 13, 2017 at 12:17 PM, Rohit Yadav <
> rohit.ya...@shapeblue.com
> > >
> > > wrote:
> > >
> > > > Hi Will,
> > > >
> > > >
> > > > I tested this against a local KVM-based 4.9.2.0 environment and I
> could
> > > > not reproduce the error. I see this in api logs:
> > > >
> > > >
> > > > ==> apilog.log <==
> > > > 2017-04-13 18:16:30,340 INFO  [a.c.c.a.ApiServer]
> > > > (catalina-exec-5:ctx-2b0966b8 ctx-2760e856) (logid:7439bdc4)
> (userId=2
> > > > accountId=2 sessionId=6183303731812D5EC32B1B37445AEC60) 192.168.1.58
> > --
> > > > GET signatureversion=3&sessionkey=H6E-LUsWpVY6WT_mJzz7qjGAdxg&
> > > > command=listPublicIpAddresses&projectid=-1&expires=2017-04-
> > > > 13T16%3A26%3A30%2B&response=json&listall=true 200 {"
> > > > listpublicipaddressesresponse":{}}
> > > >
> > > > I think proper way to fix this would be to check that project object
> is
> > > > not null before calling any methods on it.
> > > >
> > > >
> > > > Regards.
> > > >
> > > > 
> > > > From: Will Stevens 
> > > > Sent: 13 April 2017 21:38:34
> > > > To: dev@cloudstack.apache.org
> > > > Subject: Null Pointer listing public ips for a project
> > > >
> > > > Hey All,
> > > > Looking for the best way to resolve this issue.
> > > >
> > > > My line numbers in the stack trace will not match the line numbers I
> > > > reference because I am running 4.7 and I am linking the master files.
> > > From
> > > > what I can tell by reviewing the code, this has not been fixed in
> > master.
> > > > So here goes.
> > > >
> > > > When making a call to listPublicIpAddresses [1] with 'listall=true'
> and
> > > > 'projectid=-1', I get the following stacktrace.
> > > >
> > > > java.lang.NullPointerException
> > > > at
> > > > com.cloud.api.ApiResponseHelper.populateOwner(
> > > ApiResponseHelper.java:2258)
> > > > at
> > > > com.cloud.api.ApiResponseHelper.createIPAddressResponse(
> > > > ApiResponseHelper.java:718)
> > > > at
> > > > org.apache.cloudstack.api.command.admin.address.
> > > > ListPublicIpAddressesCmdByAdmin.execute(
> ListPublicIpAddressesCmdByAdmi
> > > > n.java:44)
> > > > at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:150)
> > > > at com.cloud.api.ApiServer.queueCommand(ApiServer.java:698)
> > > > at com.cloud.api.ApiServer.handleRequest(ApiServer.java:529)
> > > > at com.cloud.api.ApiServlet.processRequestInContext(
> > ApiServlet.java:297)
> > > > at com.cloud.api.ApiServlet$1.run(ApiServlet.java:127)
> > > > at
> > > > org.apache.cloudstack.managed.context.impl.
> > DefaultManagedContext$1.call(
> > > > DefaultManagedContext.java:56)
> > > > at
> > > > org.apache.cloudstack.managed.context.impl.DefaultManagedContext.
> > > > callWithContext(DefaultManagedContext.java:103)
> > > > at
> > > > org.apache.cloudstack.managed.context.impl.DefaultManagedContext.
> > > > runWithContext(DefaultManagedContext.java:53)
> > > > at com.cloud.api.ApiServlet.processRequest(ApiServlet.java:124)
> > > > at com.cloud.api.ApiServlet.doGet(ApiServlet.java:86)
> > > > at javax.servlet.http.HttpServlet.service(HttpServlet.java:617)
> > > > at javax.servlet.http.HttpServlet.service

Re: Null Pointer listing public ips for a project

[Will Stevens]

Hey Wei,
That sounds about right.  I will have a look on our side and see what I can
come up with.

Thanks,

*Will STEVENS*
Lead Developer



On Thu, Apr 13, 2017 at 3:48 PM, Wei ZHOU  wrote:

> Hi Will,
>
> I checked our platforms. We also have this issue. After investigation, I
> found a public ip was not released in an account removal in 2015 which
> should not happen.
>
> If you execute the following query, you should get empty result. If not,
> then something went wrong in the past.
> select * from user_ip_address uia join account on uia.account_id=
> account.id
> where account.removed is not null;
>
> -Wei
>
>
> 2017-04-13 18:36 GMT+02:00 Will Stevens :
>
> > The problem with that is that we are using the 'projectid=-1' to search
> > across all projects.
> >
> > I am not sure how a project gets into that state, but must be possible
> > through the API since that is our interface with ACS.
> >
> > We should be more defensive in this api call though because an end user
> api
> > call should never be able to throw a null pointer error.
> >
> > My guess is that we should do a null check on the 'project' here before
> we
> > try to use it.
> > https://github.com/apache/cloudstack/blob/master/server/
> src/com/cloud/api/
> > ApiResponseHelper.java#L2303
> >
> > *Will STEVENS*
> > Lead Developer
> >
> > 
> >
> > On Thu, Apr 13, 2017 at 12:17 PM, Rohit Yadav  >
> > wrote:
> >
> > > Hi Will,
> > >
> > >
> > > I tested this against a local KVM-based 4.9.2.0 environment and I could
> > > not reproduce the error. I see this in api logs:
> > >
> > >
> > > ==> apilog.log <==
> > > 2017-04-13 18:16:30,340 INFO  [a.c.c.a.ApiServer]
> > > (catalina-exec-5:ctx-2b0966b8 ctx-2760e856) (logid:7439bdc4) (userId=2
> > > accountId=2 sessionId=6183303731812D5EC32B1B37445AEC60) 192.168.1.58
> --
> > > GET signatureversion=3&sessionkey=H6E-LUsWpVY6WT_mJzz7qjGAdxg&
> > > command=listPublicIpAddresses&projectid=-1&expires=2017-04-
> > > 13T16%3A26%3A30%2B&response=json&listall=true 200 {"
> > > listpublicipaddressesresponse":{}}
> > >
> > > I think proper way to fix this would be to check that project object is
> > > not null before calling any methods on it.
> > >
> > >
> > > Regards.
> > >
> > > 
> > > From: Will Stevens 
> > > Sent: 13 April 2017 21:38:34
> > > To: dev@cloudstack.apache.org
> > > Subject: Null Pointer listing public ips for a project
> > >
> > > Hey All,
> > > Looking for the best way to resolve this issue.
> > >
> > > My line numbers in the stack trace will not match the line numbers I
> > > reference because I am running 4.7 and I am linking the master files.
> > From
> > > what I can tell by reviewing the code, this has not been fixed in
> master.
> > > So here goes.
> > >
> > > When making a call to listPublicIpAddresses [1] with 'listall=true' and
> > > 'projectid=-1', I get the following stacktrace.
> > >
> > > java.lang.NullPointerException
> > > at
> > > com.cloud.api.ApiResponseHelper.populateOwner(
> > ApiResponseHelper.java:2258)
> > > at
> > > com.cloud.api.ApiResponseHelper.createIPAddressResponse(
> > > ApiResponseHelper.java:718)
> > > at
> > > org.apache.cloudstack.api.command.admin.address.
> > > ListPublicIpAddressesCmdByAdmin.execute(ListPublicIpAddressesCmdByAdmi
> > > n.java:44)
> > > at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:150)
> > > at com.cloud.api.ApiServer.queueCommand(ApiServer.java:698)
> > > at com.cloud.api.ApiServer.handleRequest(ApiServer.java:529)
> > > at com.cloud.api.ApiServlet.processRequestInContext(
> ApiServlet.java:297)
> > > at com.cloud.api.ApiServlet$1.run(ApiServlet.java:127)
> > > at
> > > org.apache.cloudstack.managed.context.impl.
> DefaultManagedContext$1.call(
> > > DefaultManagedContext.java:56)
> > > at
> > > org.apache.cloudstack.managed.context.impl.DefaultManagedContext.
> > > callWithContext(DefaultManagedContext.java:103)
> > > at
> > > org.apache.cloudstack.managed.context.impl.DefaultManagedContext.
> > > runWithContext(DefaultManagedContext.java:53)
> > > at com.cloud.api.ApiServlet.processRequest(ApiServlet.java:124)
> > > at com.cloud.api.ApiServlet.doGet(ApiServlet.java:86)
> > > at javax.servlet.http.HttpServlet.service(HttpServlet.java:617)
> > > at javax.servlet.http.HttpServlet.service(HttpServlet.java:723)
> > > at
> > > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> > > ApplicationFilterChain.java:290)
> > > at
> > > org.apache.catalina.core.ApplicationFilterChain.doFilter(
> > > ApplicationFilterChain.java:206)
> > > at
> > > org.apache.catalina.core.StandardWrapperValve.invoke(
> > > StandardWrapperValve.java:233)
> > > at
> > > org.apache.catalina.core.StandardContextValve.invoke(
> > > StandardContextValve.java:191)
> > > at
> > > org.apache.catalina.core.StandardHostValve.invoke(
> > > StandardHostValve.java:127)
> > > at
> > > org.apache.catalina.valves.ErrorReportValve.invoke(
> > > ErrorReportValve.java:102)
> > >

Re: Null Pointer listing public ips for a project

[Wei ZHOU]

Hi Will,

I checked our platforms. We also have this issue. After investigation, I
found a public ip was not released in an account removal in 2015 which
should not happen.

If you execute the following query, you should get empty result. If not,
then something went wrong in the past.
select * from user_ip_address uia join account on uia.account_id=account.id
where account.removed is not null;

-Wei


2017-04-13 18:36 GMT+02:00 Will Stevens :

> The problem with that is that we are using the 'projectid=-1' to search
> across all projects.
>
> I am not sure how a project gets into that state, but must be possible
> through the API since that is our interface with ACS.
>
> We should be more defensive in this api call though because an end user api
> call should never be able to throw a null pointer error.
>
> My guess is that we should do a null check on the 'project' here before we
> try to use it.
> https://github.com/apache/cloudstack/blob/master/server/src/com/cloud/api/
> ApiResponseHelper.java#L2303
>
> *Will STEVENS*
> Lead Developer
>
> 
>
> On Thu, Apr 13, 2017 at 12:17 PM, Rohit Yadav 
> wrote:
>
> > Hi Will,
> >
> >
> > I tested this against a local KVM-based 4.9.2.0 environment and I could
> > not reproduce the error. I see this in api logs:
> >
> >
> > ==> apilog.log <==
> > 2017-04-13 18:16:30,340 INFO  [a.c.c.a.ApiServer]
> > (catalina-exec-5:ctx-2b0966b8 ctx-2760e856) (logid:7439bdc4) (userId=2
> > accountId=2 sessionId=6183303731812D5EC32B1B37445AEC60) 192.168.1.58 --
> > GET signatureversion=3&sessionkey=H6E-LUsWpVY6WT_mJzz7qjGAdxg&
> > command=listPublicIpAddresses&projectid=-1&expires=2017-04-
> > 13T16%3A26%3A30%2B&response=json&listall=true 200 {"
> > listpublicipaddressesresponse":{}}
> >
> > I think proper way to fix this would be to check that project object is
> > not null before calling any methods on it.
> >
> >
> > Regards.
> >
> > 
> > From: Will Stevens 
> > Sent: 13 April 2017 21:38:34
> > To: dev@cloudstack.apache.org
> > Subject: Null Pointer listing public ips for a project
> >
> > Hey All,
> > Looking for the best way to resolve this issue.
> >
> > My line numbers in the stack trace will not match the line numbers I
> > reference because I am running 4.7 and I am linking the master files.
> From
> > what I can tell by reviewing the code, this has not been fixed in master.
> > So here goes.
> >
> > When making a call to listPublicIpAddresses [1] with 'listall=true' and
> > 'projectid=-1', I get the following stacktrace.
> >
> > java.lang.NullPointerException
> > at
> > com.cloud.api.ApiResponseHelper.populateOwner(
> ApiResponseHelper.java:2258)
> > at
> > com.cloud.api.ApiResponseHelper.createIPAddressResponse(
> > ApiResponseHelper.java:718)
> > at
> > org.apache.cloudstack.api.command.admin.address.
> > ListPublicIpAddressesCmdByAdmin.execute(ListPublicIpAddressesCmdByAdmi
> > n.java:44)
> > at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:150)
> > at com.cloud.api.ApiServer.queueCommand(ApiServer.java:698)
> > at com.cloud.api.ApiServer.handleRequest(ApiServer.java:529)
> > at com.cloud.api.ApiServlet.processRequestInContext(ApiServlet.java:297)
> > at com.cloud.api.ApiServlet$1.run(ApiServlet.java:127)
> > at
> > org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(
> > DefaultManagedContext.java:56)
> > at
> > org.apache.cloudstack.managed.context.impl.DefaultManagedContext.
> > callWithContext(DefaultManagedContext.java:103)
> > at
> > org.apache.cloudstack.managed.context.impl.DefaultManagedContext.
> > runWithContext(DefaultManagedContext.java:53)
> > at com.cloud.api.ApiServlet.processRequest(ApiServlet.java:124)
> > at com.cloud.api.ApiServlet.doGet(ApiServlet.java:86)
> > at javax.servlet.http.HttpServlet.service(HttpServlet.java:617)
> > at javax.servlet.http.HttpServlet.service(HttpServlet.java:723)
> > at
> > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> > ApplicationFilterChain.java:290)
> > at
> > org.apache.catalina.core.ApplicationFilterChain.doFilter(
> > ApplicationFilterChain.java:206)
> > at
> > org.apache.catalina.core.StandardWrapperValve.invoke(
> > StandardWrapperValve.java:233)
> > at
> > org.apache.catalina.core.StandardContextValve.invoke(
> > StandardContextValve.java:191)
> > at
> > org.apache.catalina.core.StandardHostValve.invoke(
> > StandardHostValve.java:127)
> > at
> > org.apache.catalina.valves.ErrorReportValve.invoke(
> > ErrorReportValve.java:102)
> > at org.apache.catalina.valves.AccessLogValve.invoke(
> > AccessLogValve.java:555)
> > at
> > org.apache.catalina.core.StandardEngineValve.invoke(
> > StandardEngineValve.java:109)
> > at
> > org.apache.catalina.connector.CoyoteAdapter.service(
> > CoyoteAdapter.java:299)
> > at
> > org.apache.coyote.http11.Http11NioProcessor.process(
> > Http11NioProcessor.java:889)
> > at
> > org.apache.coyote.http11.Http11NioProtocol$Http11ConnectionHandler.
> > process(Http11NioProtocol.java:

[GitHub] cloudstack issue #1837: [4.9] Smoketest Health

[blueorangutan]

Github user blueorangutan commented on the issue:

https://github.com/apache/cloudstack/pull/1837
  
Trillian test result (tid-997)
Environment: vmware-55u3 (x2), Advanced Networking with Mgmt server 7
Total time taken: 36449 seconds
Marvin logs: 
https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1837-t997-vmware-55u3.zip
Intermitten failure detected: /marvin/tests/smoke/test_internal_lb.py
Intermitten failure detected: /marvin/tests/smoke/test_privategw_acl.py
Intermitten failure detected: 
/marvin/tests/smoke/test_routers_network_ops.py
Intermitten failure detected: /marvin/tests/smoke/test_snapshots.py
Intermitten failure detected: /marvin/tests/smoke/test_vm_snapshots.py
Test completed. 45 look ok, 4 have error(s)


Test | Result | Time (s) | Test File
--- | --- | --- | ---
test_01_test_vm_volume_snapshot | `Failure` | 403.75 | test_vm_snapshots.py
test_04_rvpc_privategw_static_routes | `Failure` | 873.63 | 
test_privategw_acl.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfaces | `Failure` | 
106.24 | test_internal_lb.py
test_03_delete_vm_snapshots | `Error` | 127.20 | test_vm_snapshots.py
ContextSuite context=TestVmSnapshot>:teardown | `Error` | 254.43 | 
test_vm_snapshots.py
test_02_list_snapshots_with_removed_data_store | `Error` | 126.45 | 
test_snapshots.py
test_02_list_snapshots_with_removed_data_store | `Error` | 131.54 | 
test_snapshots.py
test_02_vpc_privategw_static_routes | `Error` | 591.55 | 
test_privategw_acl.py
test_02_revert_vm_snapshots | Success | 232.41 | test_vm_snapshots.py
test_01_create_vm_snapshots | Success | 161.70 | test_vm_snapshots.py
test_deploy_vm_multiple | Success | 288.21 | test_vm_life_cycle.py
test_deploy_vm | Success | 0.03 | test_vm_life_cycle.py
test_advZoneVirtualRouter | Success | 0.02 | test_vm_life_cycle.py
test_10_attachAndDetach_iso | Success | 27.22 | test_vm_life_cycle.py
test_09_expunge_vm | Success | 125.24 | test_vm_life_cycle.py
test_08_migrate_vm | Success | 81.42 | test_vm_life_cycle.py
test_07_restore_vm | Success | 0.11 | test_vm_life_cycle.py
test_06_destroy_vm | Success | 10.25 | test_vm_life_cycle.py
test_03_reboot_vm | Success | 5.15 | test_vm_life_cycle.py
test_02_start_vm | Success | 20.32 | test_vm_life_cycle.py
test_01_stop_vm | Success | 10.24 | test_vm_life_cycle.py
test_CreateTemplateWithDuplicateName | Success | 252.89 | test_templates.py
test_08_list_system_templates | Success | 0.04 | test_templates.py
test_07_list_public_templates | Success | 0.05 | test_templates.py
test_05_template_permissions | Success | 0.10 | test_templates.py
test_04_extract_template | Success | 10.39 | test_templates.py
test_03_delete_template | Success | 5.11 | test_templates.py
test_02_edit_template | Success | 90.10 | test_templates.py
test_01_create_template | Success | 126.41 | test_templates.py
test_10_destroy_cpvm | Success | 236.91 | test_ssvm.py
test_09_destroy_ssvm | Success | 239.12 | test_ssvm.py
test_08_reboot_cpvm | Success | 186.73 | test_ssvm.py
test_07_reboot_ssvm | Success | 158.52 | test_ssvm.py
test_06_stop_cpvm | Success | 206.92 | test_ssvm.py
test_05_stop_ssvm | Success | 213.92 | test_ssvm.py
test_04_cpvm_internals | Success | 1.24 | test_ssvm.py
test_03_ssvm_internals | Success | 3.56 | test_ssvm.py
test_02_list_cpvm_vm | Success | 0.12 | test_ssvm.py
test_01_list_sec_storage_vm | Success | 0.13 | test_ssvm.py
test_01_snapshot_root_disk | Success | 26.25 | test_snapshots.py
test_04_change_offering_small | Success | 92.49 | test_service_offerings.py
test_03_delete_service_offering | Success | 0.04 | test_service_offerings.py
test_02_edit_service_offering | Success | 0.08 | test_service_offerings.py
test_01_create_service_offering | Success | 0.20 | test_service_offerings.py
test_02_sys_template_ready | Success | 0.13 | test_secondary_storage.py
test_01_sys_vm_start | Success | 0.18 | test_secondary_storage.py
test_09_reboot_router | Success | 161.39 | test_routers.py
test_08_start_router | Success | 156.46 | test_routers.py
test_07_stop_router | Success | 25.23 | test_routers.py
test_06_router_advanced | Success | 0.06 | test_routers.py
test_05_router_basic | Success | 0.04 | test_routers.py
test_04_restart_network_wo_cleanup | Success | 5.67 | test_routers.py
test_03_restart_network_cleanup | Success | 196.37 | test_routers.py
test_02_router_internal_adv | Success | 1.06 | test_routers.py
test_01_router_internal_basic | Success | 0.57 | test_routers.py
test_router_dns_guestipquery | Success | 76.77 | test_router_dns.py
test_router_dns_externalipquery | Success | 0.08 | test_router_dns.py
test_router_dhcphosts | Success | 155.82 | test_router_dhcphosts.py
test_router_dhcp_opts | Success | 21.69 | test_router_dhcphosts.p

[GitHub] cloudstack issue #1837: [4.9] Smoketest Health

[blueorangutan]

Github user blueorangutan commented on the issue:

https://github.com/apache/cloudstack/pull/1837
  
Trillian test result (tid-996)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 36731 seconds
Marvin logs: 
https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1837-t996-kvm-centos7.zip
Intermitten failure detected: /marvin/tests/smoke/test_privategw_acl.py
Intermitten failure detected: /marvin/tests/smoke/test_snapshots.py
Intermitten failure detected: /marvin/tests/smoke/test_vpc_redundant.py
Intermitten failure detected: /marvin/tests/smoke/test_vpc_vpn.py
Test completed. 45 look ok, 4 have error(s)


Test | Result | Time (s) | Test File
--- | --- | --- | ---
test_02_redundant_VPC_default_routes | `Failure` | 877.26 | 
test_vpc_redundant.py
test_04_rvpc_privategw_static_routes | `Failure` | 334.68 | 
test_privategw_acl.py
ContextSuite context=TestRVPCSite2SiteVpn>:setup | `Error` | 0.00 | 
test_vpc_vpn.py
test_02_redundant_VPC_default_routes | `Error` | 963.13 | 
test_vpc_redundant.py
test_02_list_snapshots_with_removed_data_store | `Error` | 0.03 | 
test_snapshots.py
test_01_vpc_site2site_vpn | Success | 144.53 | test_vpc_vpn.py
test_01_vpc_remote_access_vpn | Success | 61.25 | test_vpc_vpn.py
test_02_VPC_default_routes | Success | 301.42 | test_vpc_router_nics.py
test_01_VPC_nics_after_destroy | Success | 533.63 | test_vpc_router_nics.py
test_05_rvpc_multi_tiers | Success | 521.16 | test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics | Success | 1335.72 | 
test_vpc_redundant.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers | 
Success | 667.36 | test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL | Success | 1303.54 | 
test_vpc_redundant.py
test_09_delete_detached_volume | Success | 151.11 | test_volumes.py
test_08_resize_volume | Success | 156.08 | test_volumes.py
test_07_resize_fail | Success | 161.08 | test_volumes.py
test_06_download_detached_volume | Success | 155.99 | test_volumes.py
test_05_detach_volume | Success | 155.60 | test_volumes.py
test_04_delete_attached_volume | Success | 146.10 | test_volumes.py
test_03_download_attached_volume | Success | 156.11 | test_volumes.py
test_02_attach_volume | Success | 89.79 | test_volumes.py
test_01_create_volume | Success | 711.06 | test_volumes.py
test_deploy_vm_multiple | Success | 261.94 | test_vm_life_cycle.py
test_deploy_vm | Success | 0.02 | test_vm_life_cycle.py
test_advZoneVirtualRouter | Success | 0.02 | test_vm_life_cycle.py
test_10_attachAndDetach_iso | Success | 26.53 | test_vm_life_cycle.py
test_09_expunge_vm | Success | 125.14 | test_vm_life_cycle.py
test_08_migrate_vm | Success | 40.67 | test_vm_life_cycle.py
test_07_restore_vm | Success | 0.08 | test_vm_life_cycle.py
test_06_destroy_vm | Success | 125.65 | test_vm_life_cycle.py
test_03_reboot_vm | Success | 125.66 | test_vm_life_cycle.py
test_02_start_vm | Success | 10.12 | test_vm_life_cycle.py
test_01_stop_vm | Success | 40.24 | test_vm_life_cycle.py
test_CreateTemplateWithDuplicateName | Success | 55.41 | test_templates.py
test_08_list_system_templates | Success | 0.02 | test_templates.py
test_07_list_public_templates | Success | 0.02 | test_templates.py
test_05_template_permissions | Success | 0.04 | test_templates.py
test_04_extract_template | Success | 5.13 | test_templates.py
test_03_delete_template | Success | 5.08 | test_templates.py
test_02_edit_template | Success | 90.15 | test_templates.py
test_01_create_template | Success | 45.34 | test_templates.py
test_10_destroy_cpvm | Success | 161.62 | test_ssvm.py
test_09_destroy_ssvm | Success | 163.69 | test_ssvm.py
test_08_reboot_cpvm | Success | 101.44 | test_ssvm.py
test_07_reboot_ssvm | Success | 133.56 | test_ssvm.py
test_06_stop_cpvm | Success | 131.57 | test_ssvm.py
test_05_stop_ssvm | Success | 163.64 | test_ssvm.py
test_04_cpvm_internals | Success | 1.22 | test_ssvm.py
test_03_ssvm_internals | Success | 3.40 | test_ssvm.py
test_02_list_cpvm_vm | Success | 0.09 | test_ssvm.py
test_01_list_sec_storage_vm | Success | 0.09 | test_ssvm.py
test_01_snapshot_root_disk | Success | 10.93 | test_snapshots.py
test_04_change_offering_small | Success | 210.82 | test_service_offerings.py
test_03_delete_service_offering | Success | 0.03 | test_service_offerings.py
test_02_edit_service_offering | Success | 0.04 | test_service_offerings.py
test_01_create_service_offering | Success | 0.09 | test_service_offerings.py
test_02_sys_template_ready | Success | 0.08 | test_secondary_storage.py
test_01_sys_vm_start | Success | 0.12 | test_secondary_storage.py
test_09_reboot_router | Success | 40.25 | test_routers.py
test_08_start_router | Success 

[GitHub] cloudstack issue #1837: [4.9] Smoketest Health

[blueorangutan]

Github user blueorangutan commented on the issue:

https://github.com/apache/cloudstack/pull/1837
  
Trillian test result (tid-995)
Environment: xenserver-65sp1 (x2), Advanced Networking with Mgmt server 6
Total time taken: 36760 seconds
Marvin logs: 
https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1837-t995-xenserver-65sp1.zip
Intermitten failure detected: /marvin/tests/smoke/test_network.py
Intermitten failure detected: /marvin/tests/smoke/test_privategw_acl.py
Intermitten failure detected: /marvin/tests/smoke/test_snapshots.py
Intermitten failure detected: /marvin/tests/smoke/test_vpc_redundant.py
Test completed. 46 look ok, 3 have error(s)


Test | Result | Time (s) | Test File
--- | --- | --- | ---
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL | `Failure` | 528.03 
| test_vpc_redundant.py
test_04_rvpc_privategw_static_routes | `Failure` | 739.66 | 
test_privategw_acl.py
test_05_rvpc_multi_tiers | `Error` | 0.00 | test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics | `Error` | 0.00 | 
test_vpc_redundant.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers | 
`Error` | 0.01 | test_vpc_redundant.py
test_02_redundant_VPC_default_routes | `Error` | 962.90 | 
test_vpc_redundant.py
ContextSuite context=TestVPCRedundancy>:teardown | `Error` | 0.01 | 
test_vpc_redundant.py
test_02_list_snapshots_with_removed_data_store | `Error` | 89.37 | 
test_snapshots.py
test_02_list_snapshots_with_removed_data_store | `Error` | 94.50 | 
test_snapshots.py
test_09_delete_detached_volume | Success | 16.16 | test_volumes.py
test_08_resize_volume | Success | 91.67 | test_volumes.py
test_07_resize_fail | Success | 842.26 | test_volumes.py
test_06_download_detached_volume | Success | 20.42 | test_volumes.py
test_05_detach_volume | Success | 100.30 | test_volumes.py
test_04_delete_attached_volume | Success | 10.23 | test_volumes.py
test_03_download_attached_volume | Success | 15.34 | test_volumes.py
test_02_attach_volume | Success | 10.73 | test_volumes.py
test_01_create_volume | Success | 397.57 | test_volumes.py
test_03_delete_vm_snapshots | Success | 280.25 | test_vm_snapshots.py
test_02_revert_vm_snapshots | Success | 211.40 | test_vm_snapshots.py
test_01_create_vm_snapshots | Success | 100.78 | test_vm_snapshots.py
test_deploy_vm_multiple | Success | 204.09 | test_vm_life_cycle.py
test_deploy_vm | Success | 0.03 | test_vm_life_cycle.py
test_advZoneVirtualRouter | Success | 0.02 | test_vm_life_cycle.py
test_10_attachAndDetach_iso | Success | 31.81 | test_vm_life_cycle.py
test_09_expunge_vm | Success | 125.19 | test_vm_life_cycle.py
test_08_migrate_vm | Success | 61.14 | test_vm_life_cycle.py
test_07_restore_vm | Success | 0.14 | test_vm_life_cycle.py
test_06_destroy_vm | Success | 10.17 | test_vm_life_cycle.py
test_03_reboot_vm | Success | 15.23 | test_vm_life_cycle.py
test_02_start_vm | Success | 25.28 | test_vm_life_cycle.py
test_01_stop_vm | Success | 30.31 | test_vm_life_cycle.py
test_CreateTemplateWithDuplicateName | Success | 90.84 | test_templates.py
test_08_list_system_templates | Success | 0.03 | test_templates.py
test_07_list_public_templates | Success | 0.04 | test_templates.py
test_05_template_permissions | Success | 0.06 | test_templates.py
test_04_extract_template | Success | 5.21 | test_templates.py
test_03_delete_template | Success | 5.12 | test_templates.py
test_02_edit_template | Success | 90.13 | test_templates.py
test_01_create_template | Success | 50.55 | test_templates.py
test_10_destroy_cpvm | Success | 196.55 | test_ssvm.py
test_09_destroy_ssvm | Success | 198.69 | test_ssvm.py
test_08_reboot_cpvm | Success | 296.80 | test_ssvm.py
test_07_reboot_ssvm | Success | 143.72 | test_ssvm.py
test_06_stop_cpvm | Success | 166.71 | test_ssvm.py
test_05_stop_ssvm | Success | 168.94 | test_ssvm.py
test_04_cpvm_internals | Success | 0.98 | test_ssvm.py
test_03_ssvm_internals | Success | 3.33 | test_ssvm.py
test_02_list_cpvm_vm | Success | 0.14 | test_ssvm.py
test_01_list_sec_storage_vm | Success | 0.17 | test_ssvm.py
test_01_snapshot_root_disk | Success | 16.34 | test_snapshots.py
test_04_change_offering_small | Success | 129.18 | test_service_offerings.py
test_03_delete_service_offering | Success | 0.04 | test_service_offerings.py
test_02_edit_service_offering | Success | 0.10 | test_service_offerings.py
test_01_create_service_offering | Success | 0.10 | test_service_offerings.py
test_02_sys_template_ready | Success | 0.13 | test_secondary_storage.py
test_01_sys_vm_start | Success | 0.18 | test_secondary_storage.py
test_01_scale_vm | Success | 5.24 | test_scale_vm.py
test_09_reboot_router | Success | 55.51 | test_routers.py
test_08_start_router | Success | 40.41 |

Re: Null Pointer listing public ips for a project

[Will Stevens]

The problem with that is that we are using the 'projectid=-1' to search
across all projects.

I am not sure how a project gets into that state, but must be possible
through the API since that is our interface with ACS.

We should be more defensive in this api call though because an end user api
call should never be able to throw a null pointer error.

My guess is that we should do a null check on the 'project' here before we
try to use it.
https://github.com/apache/cloudstack/blob/master/server/src/com/cloud/api/ApiResponseHelper.java#L2303

*Will STEVENS*
Lead Developer



On Thu, Apr 13, 2017 at 12:17 PM, Rohit Yadav 
wrote:

> Hi Will,
>
>
> I tested this against a local KVM-based 4.9.2.0 environment and I could
> not reproduce the error. I see this in api logs:
>
>
> ==> apilog.log <==
> 2017-04-13 18:16:30,340 INFO  [a.c.c.a.ApiServer]
> (catalina-exec-5:ctx-2b0966b8 ctx-2760e856) (logid:7439bdc4) (userId=2
> accountId=2 sessionId=6183303731812D5EC32B1B37445AEC60) 192.168.1.58 --
> GET signatureversion=3&sessionkey=H6E-LUsWpVY6WT_mJzz7qjGAdxg&
> command=listPublicIpAddresses&projectid=-1&expires=2017-04-
> 13T16%3A26%3A30%2B&response=json&listall=true 200 {"
> listpublicipaddressesresponse":{}}
>
> I think proper way to fix this would be to check that project object is
> not null before calling any methods on it.
>
>
> Regards.
>
> 
> From: Will Stevens 
> Sent: 13 April 2017 21:38:34
> To: dev@cloudstack.apache.org
> Subject: Null Pointer listing public ips for a project
>
> Hey All,
> Looking for the best way to resolve this issue.
>
> My line numbers in the stack trace will not match the line numbers I
> reference because I am running 4.7 and I am linking the master files.  From
> what I can tell by reviewing the code, this has not been fixed in master.
> So here goes.
>
> When making a call to listPublicIpAddresses [1] with 'listall=true' and
> 'projectid=-1', I get the following stacktrace.
>
> java.lang.NullPointerException
> at
> com.cloud.api.ApiResponseHelper.populateOwner(ApiResponseHelper.java:2258)
> at
> com.cloud.api.ApiResponseHelper.createIPAddressResponse(
> ApiResponseHelper.java:718)
> at
> org.apache.cloudstack.api.command.admin.address.
> ListPublicIpAddressesCmdByAdmin.execute(ListPublicIpAddressesCmdByAdmi
> n.java:44)
> at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:150)
> at com.cloud.api.ApiServer.queueCommand(ApiServer.java:698)
> at com.cloud.api.ApiServer.handleRequest(ApiServer.java:529)
> at com.cloud.api.ApiServlet.processRequestInContext(ApiServlet.java:297)
> at com.cloud.api.ApiServlet$1.run(ApiServlet.java:127)
> at
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(
> DefaultManagedContext.java:56)
> at
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.
> callWithContext(DefaultManagedContext.java:103)
> at
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.
> runWithContext(DefaultManagedContext.java:53)
> at com.cloud.api.ApiServlet.processRequest(ApiServlet.java:124)
> at com.cloud.api.ApiServlet.doGet(ApiServlet.java:86)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:617)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:723)
> at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:290)
> at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:206)
> at
> org.apache.catalina.core.StandardWrapperValve.invoke(
> StandardWrapperValve.java:233)
> at
> org.apache.catalina.core.StandardContextValve.invoke(
> StandardContextValve.java:191)
> at
> org.apache.catalina.core.StandardHostValve.invoke(
> StandardHostValve.java:127)
> at
> org.apache.catalina.valves.ErrorReportValve.invoke(
> ErrorReportValve.java:102)
> at org.apache.catalina.valves.AccessLogValve.invoke(
> AccessLogValve.java:555)
> at
> org.apache.catalina.core.StandardEngineValve.invoke(
> StandardEngineValve.java:109)
> at
> org.apache.catalina.connector.CoyoteAdapter.service(
> CoyoteAdapter.java:299)
> at
> org.apache.coyote.http11.Http11NioProcessor.process(
> Http11NioProcessor.java:889)
> at
> org.apache.coyote.http11.Http11NioProtocol$Http11ConnectionHandler.
> process(Http11NioProtocol.java:732)
> at
> org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.
> run(NioEndpoint.java:2274)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
>
>
> The stack trace comes from this code [2]:
> Project project = ApiDBUtils.findProjectByProjectAccountId(
> account.getId());
> response.setProjectId(project.getUuid());  // <-- Null Pointer
> response.setProjectName(project.getName());
>
> In this case, the flow is coming from [3], which comes from [4].
>
> What would be the right way to fix this issue?
>
> Tha

[GitHub] cloudstack issue #1252: CLOUDSTACK-9182: Some running VMs turned off on manu...

[cloudmonger]

Github user cloudmonger commented on the issue:

https://github.com/apache/cloudstack/pull/1252
  
### ACS CI BVT Run
 **Sumarry:**
 Build Number 530
 Hypervisor xenserver
 NetworkType Advanced
 Passed=110
 Failed=2
 Skipped=7

_Link to logs Folder (search by build_no):_ 
https://www.dropbox.com/sh/yj3wnzbceo9uef2/AAB6u-Iap-xztdm6jHX9SjPja?dl=0


**Failed tests:**
* test_routers_network_ops.py

 * test_02_RVR_Network_FW_PF_SSH_default_routes_egress_false Failing since 
3 runs

 * test_03_RVR_Network_check_router_state Failed


**Skipped tests:**
test_01_test_vm_volume_snapshot
test_vm_nic_adapter_vmxnet3
test_static_role_account_acls
test_11_ss_nfs_version_on_ssvm
test_nested_virtualization_vmware
test_3d_gpu_support
test_deploy_vgpu_enabled_vm

**Passed test suits:**
test_deploy_vm_with_userdata.py
test_affinity_groups_projects.py
test_portable_publicip.py
test_over_provisioning.py
test_global_settings.py
test_scale_vm.py
test_service_offerings.py
test_routers_iptables_default_policy.py
test_loadbalance.py
test_routers.py
test_reset_vm_on_reboot.py
test_deploy_vms_with_varied_deploymentplanners.py
test_network.py
test_router_dns.py
test_non_contigiousvlan.py
test_login.py
test_deploy_vm_iso.py
test_list_ids_parameter.py
test_public_ip_range.py
test_multipleips_per_nic.py
test_metrics_api.py
test_regions.py
test_affinity_groups.py
test_network_acl.py
test_pvlan.py
test_volumes.py
test_nic.py
test_deploy_vm_root_resize.py
test_resource_detail.py
test_secondary_storage.py
test_vm_life_cycle.py
test_disk_offerings.py


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

Re: Null Pointer listing public ips for a project

[Rohit Yadav]

Hi Will,


I tested this against a local KVM-based 4.9.2.0 environment and I could not 
reproduce the error. I see this in api logs:


==> apilog.log <==
2017-04-13 18:16:30,340 INFO  [a.c.c.a.ApiServer] (catalina-exec-5:ctx-2b0966b8 
ctx-2760e856) (logid:7439bdc4) (userId=2 accountId=2 
sessionId=6183303731812D5EC32B1B37445AEC60) 192.168.1.58 -- GET 
signatureversion=3&sessionkey=H6E-LUsWpVY6WT_mJzz7qjGAdxg&command=listPublicIpAddresses&projectid=-1&expires=2017-04-13T16%3A26%3A30%2B&response=json&listall=true
 200 {"listpublicipaddressesresponse":{}}

I think proper way to fix this would be to check that project object is not 
null before calling any methods on it.


Regards.


From: Will Stevens 
Sent: 13 April 2017 21:38:34
To: dev@cloudstack.apache.org
Subject: Null Pointer listing public ips for a project

Hey All,
Looking for the best way to resolve this issue.

My line numbers in the stack trace will not match the line numbers I
reference because I am running 4.7 and I am linking the master files.  From
what I can tell by reviewing the code, this has not been fixed in master.
So here goes.

When making a call to listPublicIpAddresses [1] with 'listall=true' and
'projectid=-1', I get the following stacktrace.

java.lang.NullPointerException
at
com.cloud.api.ApiResponseHelper.populateOwner(ApiResponseHelper.java:2258)
at
com.cloud.api.ApiResponseHelper.createIPAddressResponse(ApiResponseHelper.java:718)
at
org.apache.cloudstack.api.command.admin.address.ListPublicIpAddressesCmdByAdmin.execute(ListPublicIpAddressesCmdByAdmin.java:44)
at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:150)
at com.cloud.api.ApiServer.queueCommand(ApiServer.java:698)
at com.cloud.api.ApiServer.handleRequest(ApiServer.java:529)
at com.cloud.api.ApiServlet.processRequestInContext(ApiServlet.java:297)
at com.cloud.api.ApiServlet$1.run(ApiServlet.java:127)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at com.cloud.api.ApiServlet.processRequest(ApiServlet.java:124)
at com.cloud.api.ApiServlet.doGet(ApiServlet.java:86)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:617)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:723)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
at
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
at
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
at
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:555)
at
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
at
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:299)
at
org.apache.coyote.http11.Http11NioProcessor.process(Http11NioProcessor.java:889)
at
org.apache.coyote.http11.Http11NioProtocol$Http11ConnectionHandler.process(Http11NioProtocol.java:732)
at
org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEndpoint.java:2274)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)


The stack trace comes from this code [2]:
Project project = ApiDBUtils.findProjectByProjectAccountId(account.getId());
response.setProjectId(project.getUuid());  // <-- Null Pointer
response.setProjectName(project.getName());

In this case, the flow is coming from [3], which comes from [4].

What would be the right way to fix this issue?

Thanks...

[1]
https://cloudstack.apache.org/api/apidocs-4.7/root_admin/listPublicIpAddresses.html
[2]
https://github.com/apache/cloudstack/blob/master/server/src/com/cloud/api/ApiResponseHelper.java#L2303
[3]
https://github.com/apache/cloudstack/blob/master/server/src/com/cloud/api/ApiResponseHelper.java#L761
[4]
https://github.com/apache/cloudstack/blob/master/api/src/org/apache/cloudstack/api/command/admin/address/ListPublicIpAddressesCmdByAdmin.java#L44

*Will Stevens*

rohit.ya...@shapeblue.com 
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue
  
 

Null Pointer listing public ips for a project

[Will Stevens]

Hey All,
Looking for the best way to resolve this issue.

My line numbers in the stack trace will not match the line numbers I
reference because I am running 4.7 and I am linking the master files.  From
what I can tell by reviewing the code, this has not been fixed in master.
So here goes.

When making a call to listPublicIpAddresses [1] with 'listall=true' and
'projectid=-1', I get the following stacktrace.

java.lang.NullPointerException
at
com.cloud.api.ApiResponseHelper.populateOwner(ApiResponseHelper.java:2258)
at
com.cloud.api.ApiResponseHelper.createIPAddressResponse(ApiResponseHelper.java:718)
at
org.apache.cloudstack.api.command.admin.address.ListPublicIpAddressesCmdByAdmin.execute(ListPublicIpAddressesCmdByAdmin.java:44)
at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:150)
at com.cloud.api.ApiServer.queueCommand(ApiServer.java:698)
at com.cloud.api.ApiServer.handleRequest(ApiServer.java:529)
at com.cloud.api.ApiServlet.processRequestInContext(ApiServlet.java:297)
at com.cloud.api.ApiServlet$1.run(ApiServlet.java:127)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at com.cloud.api.ApiServlet.processRequest(ApiServlet.java:124)
at com.cloud.api.ApiServlet.doGet(ApiServlet.java:86)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:617)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:723)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
at
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
at
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
at
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:555)
at
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
at
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:299)
at
org.apache.coyote.http11.Http11NioProcessor.process(Http11NioProcessor.java:889)
at
org.apache.coyote.http11.Http11NioProtocol$Http11ConnectionHandler.process(Http11NioProtocol.java:732)
at
org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEndpoint.java:2274)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)


The stack trace comes from this code [2]:
Project project = ApiDBUtils.findProjectByProjectAccountId(account.getId());
response.setProjectId(project.getUuid());  // <-- Null Pointer
response.setProjectName(project.getName());

In this case, the flow is coming from [3], which comes from [4].

What would be the right way to fix this issue?

Thanks...

[1]
https://cloudstack.apache.org/api/apidocs-4.7/root_admin/listPublicIpAddresses.html
[2]
https://github.com/apache/cloudstack/blob/master/server/src/com/cloud/api/ApiResponseHelper.java#L2303
[3]
https://github.com/apache/cloudstack/blob/master/server/src/com/cloud/api/ApiResponseHelper.java#L761
[4]
https://github.com/apache/cloudstack/blob/master/api/src/org/apache/cloudstack/api/command/admin/address/ListPublicIpAddressesCmdByAdmin.java#L44

*Will Stevens*

[GitHub] cloudstack issue #1836: [4.10/master] Smoketest Health

[serg38]

Github user serg38 commented on the issue:

https://github.com/apache/cloudstack/pull/1836
  
@rhtyd @karuturi This is a new  improvement introduced in PR1941 that 
allows volume and VM snapshots to coexist. Now, test 
test_01_test_vm_volume_snapshot in test_vm_snapshots.py needs to be reversed

 @Desc: Test that Volume snapshot for root volume is not allowed
when VM snapshot is present for the VM
@Steps:
1: Deploy a VM and create a VM snapshot for VM
2: Try to create snapshot for the root volume of the VM,
It should expect Exception
"""


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

Re: CloudStack related changes in Ansible 2.3

[Dag Sonstebo]

Brilliant – thanks for the continued good work on this René.

Regards,
Dag Sonstebo
Cloud Architect
ShapeBlue

On 12/04/2017, 16:12, "Rene Moser"  wrote:

Hi CloudStack users

Ansible 2.3 is about to be released, I would like to summarize the
CloudStack related features and changes in this release.


New modules
---

- cs_host
- cs_nic
- cs_region
- cs_role
- cs_vpc

Examples and usage for these modules can be found in the docs,
http://docs.ansible.com/ansible/list_of_cloud_modules.html#cloudstack as
usual.


Docs


The CloudStack guide
http://docs.ansible.com/ansible/guide_cloudstack.html has been updated,
note the new feature "Environment Variables"
http://docs.ansible.com/ansible/guide_cloudstack.html#environment-variables


VPC
---

The VPC support has been improved in the related modules, but there is
still some work to do.


Integration tests
-

Soon, CloudStack related new Ansible PRs will be automatically tested
(~1.000 tasks) on a CI against a CloudStack Simulator running 4.9.x.


Future Module Development
-

Due some other side projects of mine (writing books takes more time than
one would might think), development of new modules is lagging a bit. One
module (cs_serviceoffer) is currently WIP
https://github.com/ansible/ansible/pull/19041.

But no worries, new modules are planed:
- cs_diskoffer
- modules for VPN setup


Cloud Role
--

At SWISS TXT, we created a Ansible role for setting up VMs in a
cloudstack cloud with advanced networking for different customer
projects, The role is open source (BSD) and can be found on GitHub
https://github.com/swisstxt/ansible-role-cloud-infra

Feel free to fork and improve it.


Goal of my Ansible CloudStack Project
-

I often get ask, why I am doing it.

My goal is to not only install and upgrade CloudStack by Ansible (that
is relatively easy... and can even be done without that much cloudstack
api interaction) but configure _and_ maintaining a cloud (basic or
advanced networking) in a reliable way!

It will install the OS and install cloudstack management server, install
the OS on the hosts, setup hypversisors, create zones, pods, clusters,
accounts, users, add configured hosts to cloudstack all this by a single
run and the best of it, you can re-run it safely again and again,
without fear breaking anything.

Have to add a new host? No problem, put the hardware in the rack and
connect it to the net, ansible will take care on the next run: it can be
that simple.

Also note, ansible can manage your network switches, routers and
firewalls too! http://docs.ansible.com/ansible/list_of_network_modules.html

The possibilities are endless...

Thanks
René



















dag.sonst...@shapeblue.com 
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue
  
 

[GitHub] cloudstack issue #2041: CLOUDSTACK-9873: VR related periodic jobs are schedu...

[Slair1]

Github user Slair1 commented on the issue:

https://github.com/apache/cloudstack/pull/2041
  
Any reason that wasn't back-ported to 4.9?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] cloudstack pull request #914: BUG-ID CLOUDSTACK-8939 VM Snapshot size with m...

[sudhansu7]

Github user sudhansu7 commented on a diff in the pull request:

https://github.com/apache/cloudstack/pull/914#discussion_r111375928
  
--- Diff: 
plugins/hypervisors/xenserver/src/com/cloud/hypervisor/xenserver/resource/CitrixResourceBase.java
 ---
@@ -3206,25 +3206,33 @@ public long getVMSnapshotChainSize(final Connection 
conn, final VolumeObjectTO v
 }
 }
 if (volumeTo.getVolumeType() == Volume.Type.ROOT) {
-final Map allVMs = VM.getAllRecords(conn);
-// add size of memory snapshot vdi
-if (allVMs != null && allVMs.size() > 0) {
-for (final VM vmr : allVMs.keySet()) {
-try {
-final String vName = vmr.getNameLabel(conn);
-if (vName != null && vName.contains(vmName) && 
vmr.getIsASnapshot(conn)) {
-final VDI memoryVDI = vmr.getSuspendVDI(conn);
-if (!isRefNull(memoryVDI)) {
-size = size + 
memoryVDI.getPhysicalUtilisation(conn);
-final VDI pMemoryVDI = 
memoryVDI.getParent(conn);
-if (!isRefNull(pMemoryVDI)) {
-size = size + 
pMemoryVDI.getPhysicalUtilisation(conn);
+VM vm = getVM(conn, vmName);
--- End diff --

LGTM for code change


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] cloudstack issue #1759: CLOUDSTACK-9589 vmName entries from host_details tab...

[yvsubhash]

Github user yvsubhash commented on the issue:

https://github.com/apache/cloudstack/pull/1759
  
tag:mergeready


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] cloudstack issue #899: BUG-ID:CLOUDSTACK-8921 snapshot_store_ref table shoul...

[yvsubhash]

Github user yvsubhash commented on the issue:

https://github.com/apache/cloudstack/pull/899
  
tag:mergeready


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

Re: [VOTE] Apache Cloudstack should join the gitbox experiment.

[Daan Hoogland]

Thanks Wido

On 13/04/17 11:06, "Wido den Hollander"  wrote:

Hi All,

As there were no objections from committers nor PMC members I went ahead 
and filed a ticket with Infra: https://issues.apache.org/jira/browse/INFRA-13885

Waiting for their response and will update if I have more information 
regarding this move.

Wido

> Op 10 april 2017 om 18:22 schreef Daan Hoogland :
> 
> 
> In the Apache foundation an experiment has been going on to host
> mirrors of Apache project on github with more write access then just
> to the mirror-bot. For those projects committers can merge on github
> and put labels on PRs.
> 
> I move to have the project added to the gitbox experiment
> please cast your votes
> 
> +1 CloudStack should be added to the gitbox experiment
> +-0 I don't care
> -1 CloudStack shouldn't be added to the gitbox experiment and give your 
reasons
> 
> thanks,
> -- 
> Daan



daan.hoogl...@shapeblue.com 
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue
  
 

[GitHub] cloudstack issue #1875: CLOUDSTACK-8608: [VMware] System VMs failed to start...

[rhtyd]

Github user rhtyd commented on the issue:

https://github.com/apache/cloudstack/pull/1875
  
LGTM.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] cloudstack issue #555: CLOUDSTACK-8608. System VM's failed to start due to p...

[sureshanaparti]

Github user sureshanaparti commented on the issue:

https://github.com/apache/cloudstack/pull/555
  
Continuing with the code changes here in a new PR #1875. This PR will be 
closed when PR #1875 is merged.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

Two week interval developer standup/meeting

[Wido den Hollander]

Hi,

With our move to Github/Gitbox [0] I would like to propose a online meeting 
with a two week interval.

Our backlog of PRs on Github is growing and keeps growing. With labeling PRs on 
Github after moving to the Gitbox project I hope this improves, but I think 
that a quick call (<1h) every two weeks would help.

My proposal would be:

- A calendar with meetings planned up to 12 months in advance
- Every meeting should take place at a different time so that we all have to 
work early or late at some point
- During the meeting people can bring up questions about anything dev related:
  - PRs to be merged/closed
  - Release status
  - Other discussions

The meeting is not intended for questions, it should be a developer meeting 
only.

People who want a PR to be merged are encouraged to join the meeting so they 
can explain a bit more about the PR if other developers want more information.

After each meeting the notes are send to the dev-list so that everybody who 
couldn't attend can read what was discussed.

It has to be clear, no decisions can be made as they all have to be voted for 
according to the ASF rules.

Even if only 2 developers join the meeting it can be successful as they can 
make progress.

It is not my intention to moderate every meeting. A meeting can also take place 
without a dedicated moderator. Although it is preferred that somebody takes the 
lead in every meeting.

I don't know which conferencing tool to use yet. BlueJeans [1] seems nice and 
is being used for a few projects.

Comments? Objections? Suggestions?

Otherwise I'll go ahead and draft a schedule which can also be published on the 
CloudStack website.

My intention would be to have the first meeting in May.

Wido


[0]: https://issues.apache.org/jira/browse/INFRA-13885
[1]: https://www.bluejeans.com/

Re: [VOTE] Apache Cloudstack should join the gitbox experiment.

[Wido den Hollander]

Hi All,

As there were no objections from committers nor PMC members I went ahead and 
filed a ticket with Infra: https://issues.apache.org/jira/browse/INFRA-13885

Waiting for their response and will update if I have more information regarding 
this move.

Wido

> Op 10 april 2017 om 18:22 schreef Daan Hoogland :
> 
> 
> In the Apache foundation an experiment has been going on to host
> mirrors of Apache project on github with more write access then just
> to the mirror-bot. For those projects committers can merge on github
> and put labels on PRs.
> 
> I move to have the project added to the gitbox experiment
> please cast your votes
> 
> +1 CloudStack should be added to the gitbox experiment
> +-0 I don't care
> -1 CloudStack shouldn't be added to the gitbox experiment and give your 
> reasons
> 
> thanks,
> -- 
> Daan

Re: CloudStack related changes in Ansible 2.3

[Jan-Arve Nygård]

Great work!

-thinktwo

ons. 12. apr. 2017 kl. 17.13 skrev Rene Moser :

> Hi CloudStack users
>
> Ansible 2.3 is about to be released, I would like to summarize the
> CloudStack related features and changes in this release.
>
>
> New modules
> ---
>
> - cs_host
> - cs_nic
> - cs_region
> - cs_role
> - cs_vpc
>
> Examples and usage for these modules can be found in the docs,
> http://docs.ansible.com/ansible/list_of_cloud_modules.html#cloudstack as
> usual.
>
>
> Docs
> 
>
> The CloudStack guide
> http://docs.ansible.com/ansible/guide_cloudstack.html has been updated,
> note the new feature "Environment Variables"
> http://docs.ansible.com/ansible/guide_cloudstack.html#environment-variables
>
>
> VPC
> ---
>
> The VPC support has been improved in the related modules, but there is
> still some work to do.
>
>
> Integration tests
> -
>
> Soon, CloudStack related new Ansible PRs will be automatically tested
> (~1.000 tasks) on a CI against a CloudStack Simulator running 4.9.x.
>
>
> Future Module Development
> -
>
> Due some other side projects of mine (writing books takes more time than
> one would might think), development of new modules is lagging a bit. One
> module (cs_serviceoffer) is currently WIP
> https://github.com/ansible/ansible/pull/19041.
>
> But no worries, new modules are planed:
> - cs_diskoffer
> - modules for VPN setup
>
>
> Cloud Role
> --
>
> At SWISS TXT, we created a Ansible role for setting up VMs in a
> cloudstack cloud with advanced networking for different customer
> projects, The role is open source (BSD) and can be found on GitHub
> https://github.com/swisstxt/ansible-role-cloud-infra
>
> Feel free to fork and improve it.
>
>
> Goal of my Ansible CloudStack Project
> -
>
> I often get ask, why I am doing it.
>
> My goal is to not only install and upgrade CloudStack by Ansible (that
> is relatively easy... and can even be done without that much cloudstack
> api interaction) but configure _and_ maintaining a cloud (basic or
> advanced networking) in a reliable way!
>
> It will install the OS and install cloudstack management server, install
> the OS on the hosts, setup hypversisors, create zones, pods, clusters,
> accounts, users, add configured hosts to cloudstack all this by a single
> run and the best of it, you can re-run it safely again and again,
> without fear breaking anything.
>
> Have to add a new host? No problem, put the hardware in the rack and
> connect it to the net, ansible will take care on the next run: it can be
> that simple.
>
> Also note, ansible can manage your network switches, routers and
> firewalls too!
> http://docs.ansible.com/ansible/list_of_network_modules.html
>
> The possibilities are endless...
>
> Thanks
> René
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>

[GitHub] cloudstack issue #1836: [4.10/master] Smoketest Health

[rhtyd]

Github user rhtyd commented on the issue:

https://github.com/apache/cloudstack/pull/1836
  
@karuturi based on the latest Trillian tests on current master, I see a 
regression in vmware env for:

==
FAIL: @Desc: Test that Volume snapshot for root volume is not allowed
--
Traceback (most recent call last):
  File "/marvin/tests/smoke/test_vm_snapshots.py", line 408, in 
test_01_test_vm_volume_snapshot
volume_id=volume.id)
AssertionError: Exception not raised
 >> begin captured stdout << -
=== TestName: test_01_test_vm_volume_snapshot | Status : FAILED ===

Otherwise, LGTM.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

Re: CloudStack related changes in Ansible 2.3

[Rohit Yadav]

Thank you for your work Rene!


BlueOrangutan with Trillian [1] uses the CloudStack ansible modules for 
deploying environments and testing CloudStack (PRs, packages etc).


[1] https://github.com/shapeblue/Trillian


Regards.


From: Rene Moser 
Sent: 12 April 2017 20:42:44
To: us...@cloudstack.apache.org; dev
Subject: CloudStack related changes in Ansible 2.3

Hi CloudStack users

Ansible 2.3 is about to be released, I would like to summarize the
CloudStack related features and changes in this release.


New modules
---

- cs_host
- cs_nic
- cs_region
- cs_role
- cs_vpc

Examples and usage for these modules can be found in the docs,
http://docs.ansible.com/ansible/list_of_cloud_modules.html#cloudstack as
usual.


Docs


The CloudStack guide
http://docs.ansible.com/ansible/guide_cloudstack.html has been updated,
note the new feature "Environment Variables"
http://docs.ansible.com/ansible/guide_cloudstack.html#environment-variables


VPC
---

The VPC support has been improved in the related modules, but there is
still some work to do.


Integration tests
-

Soon, CloudStack related new Ansible PRs will be automatically tested
(~1.000 tasks) on a CI against a CloudStack Simulator running 4.9.x.


Future Module Development
-

Due some other side projects of mine (writing books takes more time than
one would might think), development of new modules is lagging a bit. One
module (cs_serviceoffer) is currently WIP
https://github.com/ansible/ansible/pull/19041.

But no worries, new modules are planed:
- cs_diskoffer
- modules for VPN setup


Cloud Role
--

At SWISS TXT, we created a Ansible role for setting up VMs in a
cloudstack cloud with advanced networking for different customer
projects, The role is open source (BSD) and can be found on GitHub
https://github.com/swisstxt/ansible-role-cloud-infra

Feel free to fork and improve it.


Goal of my Ansible CloudStack Project
-

I often get ask, why I am doing it.

My goal is to not only install and upgrade CloudStack by Ansible (that
is relatively easy... and can even be done without that much cloudstack
api interaction) but configure _and_ maintaining a cloud (basic or
advanced networking) in a reliable way!

It will install the OS and install cloudstack management server, install
the OS on the hosts, setup hypversisors, create zones, pods, clusters,
accounts, users, add configured hosts to cloudstack all this by a single
run and the best of it, you can re-run it safely again and again,
without fear breaking anything.

Have to add a new host? No problem, put the hardware in the rack and
connect it to the net, ansible will take care on the next run: it can be
that simple.

Also note, ansible can manage your network switches, routers and
firewalls too! http://docs.ansible.com/ansible/list_of_network_modules.html

The possibilities are endless...

Thanks
René

















rohit.ya...@shapeblue.com 
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue
  
 

[GitHub] cloudstack issue #1837: [4.9] Smoketest Health

[blueorangutan]

Github user blueorangutan commented on the issue:

https://github.com/apache/cloudstack/pull/1837
  
@rhtyd a Trillian-Jenkins matrix job (centos6 mgmt + xs65sp1, centos7 mgmt 
+ vmware55u3, centos7 mgmt + kvmcentos7) has been kicked to run smoke tests


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] cloudstack issue #1837: [4.9] Smoketest Health

[rhtyd]

Github user rhtyd commented on the issue:

https://github.com/apache/cloudstack/pull/1837
  
@blueorangutan test matrix


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] cloudstack issue #1836: [4.10/master] Smoketest Health

[blueorangutan]

Github user blueorangutan commented on the issue:

https://github.com/apache/cloudstack/pull/1836
  
Trillian test result (tid-994)
Environment: vmware-55u3 (x2), Advanced Networking with Mgmt server 7
Total time taken: 51552 seconds
Marvin logs: 
https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1836-t994-vmware-55u3.zip
Intermitten failure detected: /marvin/tests/smoke/test_privategw_acl.py
Intermitten failure detected: 
/marvin/tests/smoke/test_routers_network_ops.py
Intermitten failure detected: /marvin/tests/smoke/test_vm_snapshots.py
Intermitten failure detected: /marvin/tests/smoke/test_vpc_redundant.py
Intermitten failure detected: /marvin/tests/smoke/test_vpc_router_nics.py
Intermitten failure detected: /marvin/tests/smoke/test_vpc_vpn.py
Test completed. 46 look ok, 4 have error(s)


Test | Result | Time (s) | Test File
--- | --- | --- | ---
test_01_redundant_vpc_site2site_vpn | `Failure` | 392.10 | test_vpc_vpn.py
test_01_test_vm_volume_snapshot | `Failure` | 346.91 | test_vm_snapshots.py
test_04_rvpc_privategw_static_routes | `Failure` | 412.52 | 
test_privategw_acl.py
ContextSuite context=TestVPCRedundancy>:teardown | `Error` | 659.63 | 
test_vpc_redundant.py
test_01_vpc_site2site_vpn | Success | 365.55 | test_vpc_vpn.py
test_01_vpc_remote_access_vpn | Success | 166.25 | test_vpc_vpn.py
test_02_VPC_default_routes | Success | 399.91 | test_vpc_router_nics.py
test_01_VPC_nics_after_destroy | Success | 689.69 | test_vpc_router_nics.py
test_05_rvpc_multi_tiers | Success | 654.55 | test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics | Success | 1567.60 | 
test_vpc_redundant.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers | 
Success | 686.57 | test_vpc_redundant.py
test_02_redundant_VPC_default_routes | Success | 671.88 | 
test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL | Success | 1397.68 | 
test_vpc_redundant.py
test_09_delete_detached_volume | Success | 25.76 | test_volumes.py
test_06_download_detached_volume | Success | 50.39 | test_volumes.py
test_05_detach_volume | Success | 100.17 | test_volumes.py
test_04_delete_attached_volume | Success | 10.14 | test_volumes.py
test_03_download_attached_volume | Success | 20.23 | test_volumes.py
test_02_attach_volume | Success | 53.65 | test_volumes.py
test_01_create_volume | Success | 514.45 | test_volumes.py
test_change_service_offering_for_vm_with_snapshots | Success | 541.63 | 
test_vm_snapshots.py
test_03_delete_vm_snapshots | Success | 275.16 | test_vm_snapshots.py
test_02_revert_vm_snapshots | Success | 194.02 | test_vm_snapshots.py
test_01_create_vm_snapshots | Success | 161.68 | test_vm_snapshots.py
test_deploy_vm_multiple | Success | 276.99 | test_vm_life_cycle.py
test_deploy_vm | Success | 0.02 | test_vm_life_cycle.py
test_advZoneVirtualRouter | Success | 0.02 | test_vm_life_cycle.py
test_10_attachAndDetach_iso | Success | 26.71 | test_vm_life_cycle.py
test_09_expunge_vm | Success | 125.17 | test_vm_life_cycle.py
test_08_migrate_vm | Success | 60.72 | test_vm_life_cycle.py
test_07_restore_vm | Success | 0.07 | test_vm_life_cycle.py
test_06_destroy_vm | Success | 5.09 | test_vm_life_cycle.py
test_03_reboot_vm | Success | 5.11 | test_vm_life_cycle.py
test_02_start_vm | Success | 20.18 | test_vm_life_cycle.py
test_01_stop_vm | Success | 10.11 | test_vm_life_cycle.py
test_CreateTemplateWithDuplicateName | Success | 231.43 | test_templates.py
test_08_list_system_templates | Success | 0.02 | test_templates.py
test_07_list_public_templates | Success | 0.03 | test_templates.py
test_05_template_permissions | Success | 0.04 | test_templates.py
test_04_extract_template | Success | 10.17 | test_templates.py
test_03_delete_template | Success | 5.08 | test_templates.py
test_02_edit_template | Success | 90.15 | test_templates.py
test_01_create_template | Success | 110.61 | test_templates.py
test_10_destroy_cpvm | Success | 261.55 | test_ssvm.py
test_09_destroy_ssvm | Success | 243.44 | test_ssvm.py
test_08_reboot_cpvm | Success | 156.35 | test_ssvm.py
test_07_reboot_ssvm | Success | 158.18 | test_ssvm.py
test_06_stop_cpvm | Success | 206.55 | test_ssvm.py
test_05_stop_ssvm | Success | 208.44 | test_ssvm.py
test_04_cpvm_internals | Success | 1.01 | test_ssvm.py
test_03_ssvm_internals | Success | 3.51 | test_ssvm.py
test_02_list_cpvm_vm | Success | 0.09 | test_ssvm.py
test_01_list_sec_storage_vm | Success | 0.09 | test_ssvm.py
test_02_list_snapshots_with_removed_data_store | Success | 171.97 | 
test_snapshots.py
test_01_snapshot_root_disk | Success | 66.16 | test_snapshots.py
test_04_change_offering_small | Success | 97.33 | test_service_offerings.py
test_03_delete_service_offering | Success |

[GitHub] cloudstack issue #1908: CLOUDSTACK-9317: Fixed disable static nat on leaving...

[jayapalu]

Github user jayapalu commented on the issue:

https://github.com/apache/cloudstack/pull/1908
  
@ProjectMoon  Jenkins and CI is passed, Can you please give LGTM


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---