Re: Known trillian test failures
While cleaning up the tests is there any value in splitting out tests that are redundant - test that test low level functions whose failures will be picked up in other tests of higher level functions - tests that are run on modules that "never" change. The lower level test may still be useful for testing a change to a low level function or for tracking down a failure in a higher level function that uses a low level routine but may not add much value to a test suite that is run frequently. Would this reduce the amount of time taken to do a full test at the expense of some increased risk that an edge case might be missed? Would setting aside the clutter allow the team to focus on the tests that really matter? Ron On 20/12/2017 1:21 PM, Paul Angus wrote: Hi Marc-Aurèle, (and everyone else) The title probably is slightly incorrect. It should really say known Marvin test failures. Trillian is the automation that creates the environments to run the tests in, the tests are purely those that are in Marvin codebase so anyone can repeat them. In fact we would like to see other people running the tests in their environments and comparing the results. With regard to the failing tests, I agree, that it would be dangerous to hide failures. I would like to see however, a matrix of known good and known bad tests, and any PR that then fails known good tests has a problem. With a visible list of known bad tests we can 'not fail' a PR due to failing a bad test, and also there would be a list of bad tests which the community can attack and whittle down the list until all tests *should* pass. That way we can make clear (automated) decisions on pass/fail. Rather than get a list of pass/fails that we then have to interpret. Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Marc-Aurèle Brothier [mailto:ma...@exoscale.ch] Sent: 20 December 2017 12:56 To: dev@cloudstack.apache.org Subject: Known trillian test failures @rhtyd Could something be done to avoid confusing people pushing PR to have trillian test failures, which apparently are know to fail all the time or often? I know it's hard to keep the tests in good shape and make them run smoothly but I find it very disturbing and therefore I have to admit I'm not paying attention to those outputs, sadly. Skipping them adds the high risk of never getting fixed... I would hope that someone having full access the the management & agent's logs could fix them, since AFAIK they aren't available. Cheers -- Ron Wheeler President Artifact Software Inc email: rwhee...@artifact-software.com skype: ronaldmwheeler phone: 866-970-2435, ext 102
RE: Known trillian test failures
Hi Marc-Aurèle, (and everyone else) The title probably is slightly incorrect. It should really say known Marvin test failures. Trillian is the automation that creates the environments to run the tests in, the tests are purely those that are in Marvin codebase so anyone can repeat them. In fact we would like to see other people running the tests in their environments and comparing the results. With regard to the failing tests, I agree, that it would be dangerous to hide failures. I would like to see however, a matrix of known good and known bad tests, and any PR that then fails known good tests has a problem. With a visible list of known bad tests we can 'not fail' a PR due to failing a bad test, and also there would be a list of bad tests which the community can attack and whittle down the list until all tests *should* pass. That way we can make clear (automated) decisions on pass/fail. Rather than get a list of pass/fails that we then have to interpret. Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Marc-Aurèle Brothier [mailto:ma...@exoscale.ch] Sent: 20 December 2017 12:56 To: dev@cloudstack.apache.org Subject: Known trillian test failures @rhtyd Could something be done to avoid confusing people pushing PR to have trillian test failures, which apparently are know to fail all the time or often? I know it's hard to keep the tests in good shape and make them run smoothly but I find it very disturbing and therefore I have to admit I'm not paying attention to those outputs, sadly. Skipping them adds the high risk of never getting fixed... I would hope that someone having full access the the management & agent's logs could fix them, since AFAIK they aren't available. Cheers
Re: Known trillian test failures
Hi Marc, You've raised a very valid concern. When we've known list of smoketest failures, it's understandable that most people may not understand how to interpret them and ignore them. Access to the Trillian environment is another issue. I don't have all the answers and a solution ot these problems at the moment but let me discuss that internally and get back to you. Can you and others help review PR 2211 where I've tried to address that? I ask this because this PR not only tries to migrate us to a newer Debian systemvmtemplate but focuses on stabilizing master by getting almost 100% smoketest pass rate on VMware/KVM/XenServer, to get there I had to fix some tests as well. Once we can have such a pass rate on master, it will be easier to verify test results on other PRs against the baseline. I'll see if we can improvement Trillian test runs to include management server (and agent) logs in the marvin log zip that is put as part of the result on the github pr. - Rohit From: Marc-Aur?le Brothier <ma...@exoscale.ch> Sent: Wednesday, December 20, 2017 6:26:05 PM To: dev@cloudstack.apache.org Subject: Known trillian test failures @rhtyd Could something be done to avoid confusing people pushing PR to have trillian test failures, which apparently are know to fail all the time or often? I know it's hard to keep the tests in good shape and make them run smoothly but I find it very disturbing and therefore I have to admit I'm not paying attention to those outputs, sadly. Skipping them adds the high risk of never getting fixed... I would hope that someone having full access the the management & agent's logs could fix them, since AFAIK they aren't available. Cheers rohit.ya...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue
Known trillian test failures
@rhtyd Could something be done to avoid confusing people pushing PR to have trillian test failures, which apparently are know to fail all the time or often? I know it's hard to keep the tests in good shape and make them run smoothly but I find it very disturbing and therefore I have to admit I'm not paying attention to those outputs, sadly. Skipping them adds the high risk of never getting fixed... I would hope that someone having full access the the management & agent's logs could fix them, since AFAIK they aren't available. Cheers
[GitHub] cloudstack pull request #1692: Fix Smoke Test Failures
Github user asfgit closed the pull request at: https://github.com/apache/cloudstack/pull/1692 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user rhtyd commented on the issue: https://github.com/apache/cloudstack/pull/1692 Thanks @serg38 @syed @mlsorensen @pdion891 for your feedback, comments, review and tests. I think we've enough reviews, tests/lgtms for merging the PRs now. I'll proceed with merging this PR, based subsequently fwd-merge this on 4.9, master branch based on results/discussions/review from PR #1703 #1708. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user rhtyd commented on the issue: https://github.com/apache/cloudstack/pull/1692 @serg38 Thanks, both of them are environment related failure and ignore-able. I'm not sure about the first error, most like environment related. The second one could be related to ping timeout (the timeout used to check mgmt server health by others in the cluster), you can reduce them in the global settings, restart mgmt server based on following: --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user serg38 commented on the issue:
https://github.com/apache/cloudstack/pull/1692
Thanks @rhtyd It didi it. Now two of them still fail but the rest are
successful
```
Tests out-of-band management ownership expiry across multi-mgmt server ...
=== TestName: test_oobm_multiple_mgmt_server_ownership | Status : FAILED ===
FAIL
Tests out-of-band management change password feature ... === TestName:
test_oobm_zchange_password | Status : EXCEPTION ===
ERROR
==
ERROR: Tests out-of-band management change password feature
--
Traceback (most recent call last):
File
"/home/t_vazqnadmin/cloudstack/test/integration/smoke/test_outofbandmanagement.py",
line 593, in test_oobm_zchange_password
self.assertTrue((len(alerts) - alertCount) > 0)
TypeError: object of type 'NoneType' has no len()
==
FAIL: Tests out-of-band management ownership expiry across multi-mgmt server
--
Traceback (most recent call last):
File
"/home/t_vazqnadmin/cloudstack/test/integration/smoke/test_outofbandmanagement.py",
line 524, in test_oobm_multiple_mgmt_server_ownership
self.fail("Management server failed to turn down or remove fake mgmt
server")
AssertionError: Management server failed to turn down or remove fake mgmt
server
--
Ran 16 tests in 1553.771s
FAILED (SKIP=1, errors=1, failures=1)
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user rhtyd commented on the issue: https://github.com/apache/cloudstack/pull/1692 @serg38 okay I see, the issue is that the marvin you've installed is old and does not have the necessary API definitions (cmd, response classes). I recommend doing a clean build of the branch you're testing and then install the generated marvin, something like: rm -f tools/marvin/dist mvn clean install -Dnoredist -Dsimulator -P developer,systemvm sudo pip install --upgrade tools/marvin/dist/Marvin-*.tar.gz --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1692 @rhtyd We run marvin tests on management server. Do we need any special configuration in test data for out-of-band-managment ? The errors seem to point at missing methods in CloudStackAPIClient == ERROR: Tests out-of-band management issue power soft action -- Traceback (most recent call last): File "/home/t_vazqnadmin/cloudstack/test/integration/smoke/test_outofbandmanagement.py", line 440, in test_oobm_issue_power_soft self.configureAndStartIpmiServer() File "/home/t_vazqnadmin/cloudstack/test/integration/smoke/test_outofbandmanagement.py", line 373, in configureAndStartIpmiServer self.configureAndEnableOobm() File "/home/t_vazqnadmin/cloudstack/test/integration/smoke/test_outofbandmanagement.py", line 157, in configureAndEnableOobm self.apiclient.configureOutOfBandManagement(self.getOobmConfigCmd()) **AttributeError: 'CloudStackAPIClient' object has no attribute 'configureOutOfBandManagement'** == ERROR: Tests out-of-band management issue power action -- Traceback (most recent call last): File "/home/t_vazqnadmin/cloudstack/test/integration/smoke/test_outofbandmanagement.py", line 395, in test_oobm_issue_power_status self.configureAndStartIpmiServer(power_state='on') File "/home/t_vazqnadmin/cloudstack/test/integration/smoke/test_outofbandmanagement.py", line 373, in configureAndStartIpmiServer self.configureAndEnableOobm() File "/home/t_vazqnadmin/cloudstack/test/integration/smoke/test_outofbandmanagement.py", line 157, in configureAndEnableOobm self.apiclient.configureOutOfBandManagement(self.getOobmConfigCmd()) **AttributeError: 'CloudStackAPIClient' object has no attribute 'configureOutOfBandManagement'** --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user rhtyd commented on the issue: https://github.com/apache/cloudstack/pull/1692 @serg38 thanks for sharing the test results. I can see why all the out-of-band management tests may fail, these tests require that the mgmt server is able to send/receive UDP traffic from/to the management server to the server where you're running the marvin tests. In case of any iptables rules dropping UDP packets, most/all the oobm tests will fail as they launch a `ipmisim` (ipmi-simulator) server that listens on random UDP port. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1692 Failed tests ``` test_02_vpc_privategw_static_routes (integration.smoke.test_privategw_acl.TestPrivateGwACL) ... === TestName: test_02_vpc_privategw_static_routes | Status : FAILED === test_03_vpc_privategw_restart_vpc_cleanup (integration.smoke.test_privategw_acl.TestPrivateGwACL) ... === TestName: test_03_vpc_privategw_restart_vpc_cleanup | Status : FAILED === test_04_rvpc_privategw_static_routes (integration.smoke.test_privategw_acl.TestPrivateGwACL) ... === TestName: test_04_rvpc_privategw_static_routes | Status : FAILED === Test redundant router internals ... === TestName: test_02_isolate_network_FW_PF_default_routes_egress_false | Status : FAILED === Create a redundant VPC with two networks with two VMs in each network ... === TestName: test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL | Status : FAILED === Create a VPC with two networks with one VM in each network and test nics after destroy ... === TestName: test_01_VPC_nics_after_destroy | Status : FAILED === ``` Exceptions: ``` Tests out-of-band management background powerstate sync ... === TestName: test_oobm_background_powerstate_sync | Status : EXCEPTION === Tests out-of-band management configuration with valid data ... === TestName: test_oobm_configure_default_driver | Status : EXCEPTION === Tests out-of-band management configuration with invalid driver ... === TestName: test_oobm_configure_invalid_driver | Status : EXCEPTION === Tests out-of-band management host disable feature with ... === TestName: test_oobm_disable_feature_invalid | Status : EXCEPTION === Tests out-of-band management host disable feature with ... === TestName: test_oobm_disable_feature_valid | Status : EXCEPTION === Tests out-of-band management host enable feature with ... === TestName: test_oobm_enable_feature_invalid | Status : EXCEPTION === Tests out-of-band management host enable feature with ... === TestName: test_oobm_enable_feature_valid | Status : EXCEPTION === Tests out-of-band management enable/disable feature at cluster ... === TestName: test_oobm_enabledisable_across_clusterzones | Status : EXCEPTION === Tests out-of-band management issue power cycle action ... === TestName: test_oobm_issue_power_cycle | Status : EXCEPTION === Tests out-of-band management issue power off action ... === TestName: test_oobm_issue_power_off | Status : EXCEPTION === Tests out-of-band management issue power on action ... === TestName: test_oobm_issue_power_on | Status : EXCEPTION === Tests out-of-band management issue power reset action ... === TestName: test_oobm_issue_power_reset | Status : EXCEPTION === Tests out-of-band management issue power soft action ... === TestName: test_oobm_issue_power_soft | Status : EXCEPTION === Tests out-of-band management issue power action ... === TestName: test_oobm_issue_power_status | Status : EXCEPTION === Tests out-of-band management ownership expiry across multi-mgmt server ... === TestName: test_oobm_multiple_mgmt_server_ownership | Status : EXCEPTION === Tests out-of-band management change password feature ... === TestName: test_oobm_zchange_password | Status : EXCEPTION === ``` --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1692 Successful tests. RHEL 6 management server, advanced networking, Vmware 5.5/6 hypervisors ``` test DeployVM in anti-affinity groups for project ... === TestName: test_DeployVmAntiAffinityGroup_in_project | Status : SUCCESS === test DeployVM in anti-affinity groups ... === TestName: test_DeployVmAntiAffinityGroup | Status : SUCCESS === Test Deploy Virtual Machine from ISO ... === TestName: test_deploy_vm_from_iso | Status : SUCCESS === Test deploy virtual machine with root resize ... === TestName: test_00_deploy_vm_root_resize | Status : SUCCESS === Test proper failure to deploy virtual machine with rootdisksize of 0 ... === TestName: test_01_deploy_vm_root_resize | Status : SUCCESS === Test proper failure to deploy virtual machine with rootdisksize less than template size ... === TestName: test_02_deploy_vm_root_resize | Status : SUCCESS === Test to deploy vm with a first fit offering ... === TestName: test_deployvm_firstfit | Status : SUCCESS === Test deploy VMs using user concentrated planner ... === TestName: test_deployvm_userconcentrated | Status : SUCCESS === Test deploy VMs using user dispersion planner ... === TestName: test_deployvm_userdispersing | Status : SUCCESS === Test userdata as GET, size > 2k ... === TestName: test_deployvm_userdata | Status : SUCCESS === Test userdata as POST, size > 2k ... === TestName: test_deployvm_userdata_post | Status : SUCCESS === Test to create disk offering ... === TestName: test_01_create_disk_offering | Status : SUCCESS === Test to create a sparse type disk offering ... === TestName: test_02_create_sparse_type_disk_offering | Status : SUCCESS === Test to create a sparse type disk offering ... === TestName: test_04_create_fat_type_disk_offering | Status : SUCCESS === Test to update existing disk offering ... === TestName: test_02_edit_disk_offering | Status : SUCCESS === Test to delete disk offering ... === TestName: test_03_delete_disk_offering | Status : SUCCESS === test update configuration setting at zone level scope ... === TestName: test_UpdateConfigParamWithScope | Status : SUCCESS === Test guest vlan range dedication ... === TestName: test_dedicateGuestVlanRange | Status : SUCCESS === Test create, assign, remove of an Internal LB with roundrobin http traffic to 3 vm's in a Single VPC ... === TestName: test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 | Status : SUCCESS === Test create, assign, remove of an Internal LB with roundrobin http traffic to 3 vm's in a Redundant VPC ... === TestName: test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 | Status : SUCCESS === Test to verify access to loadbalancer haproxy admin stats page ... === TestName: test_03_vpc_internallb_haproxy_stats_on_all_interfaces | Status : SUCCESS === Test to verify access to loadbalancer haproxy admin stats page ... === TestName: test_04_rvpc_internallb_haproxy_stats_on_all_interfaces | Status : SUCCESS === Test create public & private ISO ... === TestName: test_01_create_iso | Status : SUCCESS === Test Edit ISO ... === TestName: test_02_edit_iso | Status : SUCCESS === Test delete ISO ... === TestName: test_03_delete_iso | Status : SUCCESS === Test for extract ISO ... === TestName: test_04_extract_Iso | Status : SUCCESS === Update & Test for ISO permissions ... === TestName: test_05_iso_permissions | Status : SUCCESS === Test delete ISO ... === TestName: test_07_list_default_iso | Status : SUCCESS === Test listing Volumes using 'ids' parameter ... === TestName: test_01_list_volumes | Status : SUCCESS === Test listing Templates using 'ids' parameter ... === TestName: test_02_list_templates | Status : SUCCESS === Test listing Snapshots using 'ids' parameter ... === TestName: test_03_list_snapshots | Status : SUCCESS === Test to create Load balancing rule with source NAT ... === TestName: test_01_create_lb_rule_src_nat | Status : SUCCESS === Test to create Load balancing rule with non source NAT ... === TestName: test_02_create_lb_rule_non_nat | Status : SUCCESS === Test for assign & removing load balancing rule ... === TestName: test_assign_and_removal_lb | Status : SUCCESS === Tests that SAML users are not allowed CloudStack local log in ... === TestName: login_test_saml_user | Status : SUCCESS === test_nic_secondaryip_add_remove (integration.smoke.test_multipleips_per_nic.TestDeployVM) ... === TestName: test_nic_secondaryip_add_remove | Status : SUCCESS === Test network ACL lists and items in VPC ... === TestName: test_network_acl | Status : SUCCESS === Test for delete account ... === TestName: test_delete_account | Status : SUCCESS === Test for port forwarding on source NAT ... === TestName: test_01_port_fwd_on_src_nat | Status : SUCCESS === Test for port forwarding on non
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1692 We finished testing on vmware 5.5 and 6. Overall much better state. We have still failure in execution of the following tests: test_privategw_acl test_routers_network_ops test_vpc_redundant test_vpc_router_nics All of the failure seem to be either environmental or due to incorrect ACL order . Also out-of-band management test give a lot of exceptions but this is as expected. We had to make one change that I propose to include. In test_service_offereing.py line 389 switch from range=20 to range=40 . In our tests variation in available RAM in CentOs was larger than 20 Mb so test_service_offereing fails. So this is another testing LGTM for vmware 5.5 and 6. I will post test results in few min. Let's get all related PRs merged ASAP now. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user syed commented on the issue: https://github.com/apache/cloudstack/pull/1692 Thanks @murali-reddy for confirming this. Based on that this PR LGTM. Thank you guys for fixing the smoke tests. This is a very needed requirement for getting stable releases :+1: --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user rhtyd commented on the issue: https://github.com/apache/cloudstack/pull/1692 @pdion891 thanks, this PR fixes marvin tests. Blueorangutan (bo) is just a bot that facilitates running the marvin tests and sharing the results. It uses Trillian to deploy an environment and run smoke tests using this script: https://github.com/shapeblue/Trillian/blob/master/Ansible/roles/marvin/templates/smoketests.sh.j2 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user pdion891 commented on the issue: https://github.com/apache/cloudstack/pull/1692 Could it be possible this PR is specific to blueorangutan tests or they are to fix marvin tests too? we could be able to test if marvin, need to know how for blueorangutan. Since it fix test I'm all for this PR including #1708 and #1703. I did quickly review the code and don't see any issues. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user murali-reddy commented on the issue: https://github.com/apache/cloudstack/pull/1692 @syed Thanks for testing out. Tests related VPC private gateway, redundant VPC are still failing as noted [1]. I am working on fix. We want to proceed with this PR with those failing tests are known issues. If the rest of the tests are passing can we have LGTM? [1]http://markmail.org/message/n2p2jziywo7kjzx7#query:+page:1+mid:rvv4kqkim2nme35h+state:results --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user syed commented on the issue: https://github.com/apache/cloudstack/pull/1692 @PaulAngus were there any tests that were expected to fail? If so I can exclude them and try to debug the ones that were supposed to run correctly. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user syed commented on the issue: https://github.com/apache/cloudstack/pull/1692 My tests have finished. I had run into some issues where one of the tests got stuck when cleaning everything. I have yet to determine the root cause. I've had 8 test cases. Here is the list of the tests ``` PASS BUT CLEANUP FAILED smoke/test_internal_lb.py FAIL smoke/test_privategw_acl.py test_02_vpc_privategw_static_routes (integration.smoke.test_privategw_acl.TestPrivateGwACL) ... === TestName: test_02_vpc_privategw_static_routes | Status : FAILED === FAIL test_03_vpc_privategw_restart_vpc_cleanup (integration.smoke.test_privategw_acl.TestPrivateGwACL) ... === TestName: test_03_vpc_privategw_restart_vpc_cleanup | Status : FAILED === FAIL test_04_rvpc_privategw_static_routes (integration.smoke.test_privategw_acl.TestPrivateGwACL) ... === TestName: test_04_rvpc_privategw_static_routes | Status : FAILED === FAIL FAIL smoke/test_vpc_redundant.py Create a redundant VPC with two networks with two VMs in each network ... === TestName: test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL | Status : FAILED === FAIL Create a redundant VPC with two networks with two VMs in each network and check default routes ... === TestName: test_02_redundant_VPC_default_routes | Status : FAILED === FAIL Create a redundant VPC with 1 Tier, 1 VM, 1 ACL, 1 PF and test Network GC Nics ... === TestName: test_04_rvpc_network_garbage_collector_nics | Status : FAILED === FAIL Create a redundant VPC with 1 Tier, 1 VM, 1 ACL, 1 PF and test Network GC Nics ... === TestName: test_05_rvpc_multi_tiers | Status : FAILED === FAIL PASS smoke/test_network_acl.py PASS smoke/test_password_server.py PASS smoke/test_vpc_router_nics.py PASS smoke/test_vpc_vpn.py ``` --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user syed commented on the issue: https://github.com/apache/cloudstack/pull/1692 I'm running the smoke tests on my setup. I will post the results as soon as they have completed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user mlsorensen commented on the issue: https://github.com/apache/cloudstack/pull/1692 If the three test failures don't represent regressions, we should probably get this merged per Rohit's suggestion. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1692 We will post results later today for Vmware 5.5/6 tests --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user syed commented on the issue: https://github.com/apache/cloudstack/pull/1692 @PaulAngus I will test this out on my XenServer7 setup. I would need some help to understand how you are running these. I'll PM you on Slack --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user rhtyd commented on the issue: https://github.com/apache/cloudstack/pull/1692 @NuxRo np, I was pinging most of the active people on the list who may have the time/motivation to contribute towards next releases. Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user NuxRo commented on the issue: https://github.com/apache/cloudstack/pull/1692 Sorry guys, am unable to test currently and cannot LGTM code that I obviously don't understand. Hopefully a coder will step up shortly. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user rhtyd commented on the issue: https://github.com/apache/cloudstack/pull/1692 All, we need a LGTM on this one to get the ball moving on release work. Pinging several -- @karuturi @swill @wido @NuxRo @nvazquez @serg38 @GaborApatiNagy @harikrishna-patnala @JayapalUradi @K0zka @rafaelweingartner @terbolous @pyr @syed Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user rhtyd commented on the issue: https://github.com/apache/cloudstack/pull/1692 @karuturi can you help run BVT tests on this PR? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user jburwell commented on the issue: https://github.com/apache/cloudstack/pull/1692 @karuturi @swill @wido @NuxRo @nvazquez we believe this PR is ready to merge. However, we need to cross check the test results. Would one (or more of you) be able to test this PR in order to move it forward? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user jburwell commented on the issue: https://github.com/apache/cloudstack/pull/1692 @karuturi can you provide a test LGTM from CloudMonger? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1692 Yes +1 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user rhtyd commented on the issue: https://github.com/apache/cloudstack/pull/1692 Thanks @serg38 so does that mean a +1/LGTM on this one? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1692 @rhtyd Yes I totally agree. It could take a while to flash out the remaining issues and we should complete the release and allow merging outstanding PRs in the meantime. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user rhtyd commented on the issue: https://github.com/apache/cloudstack/pull/1692 @jburwell @PaulAngus @serg38 @abhinandanprateek @murali-reddy @borisstoyanov and others -- we've made some progress in this PR and since there are some merge/review activity on other PRs does it make sense to merge this on 4.8, 4.9+ (PR #1703 confirm similar test results as seen here) so that Trillian can be used on other PRs? After the merge, we'll still continue to work on outstanding test failures on vmware and xenserver that are restricted to only following three test suites/files: test_vpc_vpn.py test_vpc_redundant.py test_privategw_acl.py --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user blueorangutan commented on the issue: https://github.com/apache/cloudstack/pull/1692 Trillian test result (tid-140) Environment: xenserver-65sp1 (x2), Advanced Networking with Mgmt server 7 Total time taken: 2051 seconds Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1692-t140-xenserver-65sp1.zip Test completed. 47 look ok, 0 have error(s) Test | Result | Time (s) | Test File --- | --- | --- | --- --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user blueorangutan commented on the issue: https://github.com/apache/cloudstack/pull/1692 Trillian test result (tid-138) Environment: xenserver-65sp1 (x2), Advanced Networking with Mgmt server 7 Total time taken: 27408 seconds Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1692-t138-xenserver-65sp1.zip Test completed. 41 look ok, 2 have error(s) Test | Result | Time (s) | Test File --- | --- | --- | --- test_05_rvpc_multi_tiers | `Failure` | 457.17 | test_vpc_redundant.py test_04_rvpc_network_garbage_collector_nics | `Failure` | 419.38 | test_vpc_redundant.py test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL | `Failure` | 480.84 | test_vpc_redundant.py test_04_rvpc_privategw_static_routes | `Failure` | 637.30 | test_privategw_acl.py test_03_vpc_privategw_restart_vpc_cleanup | `Failure` | 414.51 | test_privategw_acl.py test_02_vpc_privategw_static_routes | `Failure` | 425.52 | test_privategw_acl.py test_01_vpc_site2site_vpn | Success | 312.12 | test_vpc_vpn.py test_01_vpc_remote_access_vpn | Success | 126.83 | test_vpc_vpn.py test_01_redundant_vpc_site2site_vpn | Success | 503.76 | test_vpc_vpn.py test_02_VPC_default_routes | Success | 271.81 | test_vpc_router_nics.py test_01_VPC_nics_after_destroy | Success | 633.57 | test_vpc_router_nics.py test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers | Success | 864.61 | test_vpc_redundant.py test_02_redundant_VPC_default_routes | Success | 1000.70 | test_vpc_redundant.py test_09_delete_detached_volume | Success | 15.73 | test_volumes.py test_08_resize_volume | Success | 86.12 | test_volumes.py test_07_resize_fail | Success | 91.11 | test_volumes.py test_06_download_detached_volume | Success | 25.46 | test_volumes.py test_05_detach_volume | Success | 100.30 | test_volumes.py test_04_delete_attached_volume | Success | 10.36 | test_volumes.py test_03_download_attached_volume | Success | 15.38 | test_volumes.py test_02_attach_volume | Success | 40.82 | test_volumes.py test_01_create_volume | Success | 392.78 | test_volumes.py test_03_delete_vm_snapshots | Success | 280.33 | test_vm_snapshots.py test_02_revert_vm_snapshots | Success | 191.41 | test_vm_snapshots.py test_01_create_vm_snapshots | Success | 133.78 | test_vm_snapshots.py test_deploy_vm_multiple | Success | 203.83 | test_vm_life_cycle.py test_deploy_vm | Success | 0.03 | test_vm_life_cycle.py test_advZoneVirtualRouter | Success | 0.02 | test_vm_life_cycle.py test_10_attachAndDetach_iso | Success | 37.27 | test_vm_life_cycle.py test_09_expunge_vm | Success | 125.31 | test_vm_life_cycle.py test_08_migrate_vm | Success | 66.66 | test_vm_life_cycle.py test_07_restore_vm | Success | 0.10 | test_vm_life_cycle.py test_06_destroy_vm | Success | 10.17 | test_vm_life_cycle.py test_03_reboot_vm | Success | 10.26 | test_vm_life_cycle.py test_02_start_vm | Success | 15.27 | test_vm_life_cycle.py test_01_stop_vm | Success | 30.58 | test_vm_life_cycle.py test_CreateTemplateWithDuplicateName | Success | 91.00 | test_templates.py test_08_list_system_templates | Success | 0.03 | test_templates.py test_07_list_public_templates | Success | 0.04 | test_templates.py test_05_template_permissions | Success | 0.10 | test_templates.py test_04_extract_template | Success | 5.18 | test_templates.py test_03_delete_template | Success | 5.13 | test_templates.py test_02_edit_template | Success | 90.09 | test_templates.py test_01_create_template | Success | 50.68 | test_templates.py test_10_destroy_cpvm | Success | 226.99 | test_ssvm.py test_09_destroy_ssvm | Success | 199.36 | test_ssvm.py test_08_reboot_cpvm | Success | 146.75 | test_ssvm.py test_07_reboot_ssvm | Success | 148.70 | test_ssvm.py test_06_stop_cpvm | Success | 166.86 | test_ssvm.py test_05_stop_ssvm | Success | 139.03 | test_ssvm.py test_04_cpvm_internals | Success | 1.11 | test_ssvm.py test_03_ssvm_internals | Success | 3.39 | test_ssvm.py test_02_list_cpvm_vm | Success | 0.28 | test_ssvm.py test_01_list_sec_storage_vm | Success | 0.26 | test_ssvm.py test_01_snapshot_root_disk | Success | 21.43 | test_snapshots.py test_04_change_offering_small | Success | 64.08 | test_service_offerings.py test_03_delete_service_offering | Success | 0.05 | test_service_offerings.py test_02_edit_service_offering | Success | 0.05 | test_service_offerings.py test_01_create_service_offering | Success | 0.08 | test_service_offerings.py test_02_sys_template_ready | Success | 0.12 | test_secondary_storage.py test_01_sys_vm_start | Success | 0.17 | test_secondary_storage.py test_01_scale_vm | Success | 5.24 | test_scale_vm.py test_09_reboot_router | Success | 50.61 | test_routers.py test_08_start_router | Success | 45.45 |
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user blueorangutan commented on the issue: https://github.com/apache/cloudstack/pull/1692 Trillian test result (tid-137) Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7 Total time taken: 22765 seconds Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1692-t137-kvm-centos7.zip Test completed. 42 look ok, 1 have error(s) Test | Result | Time (s) | Test File --- | --- | --- | --- test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL | `Failure` | 365.31 | test_vpc_redundant.py test_01_vpc_site2site_vpn | Success | 145.68 | test_vpc_vpn.py test_01_vpc_remote_access_vpn | Success | 56.20 | test_vpc_vpn.py test_01_redundant_vpc_site2site_vpn | Success | 241.86 | test_vpc_vpn.py test_02_VPC_default_routes | Success | 289.82 | test_vpc_router_nics.py test_01_VPC_nics_after_destroy | Success | 533.44 | test_vpc_router_nics.py test_05_rvpc_multi_tiers | Success | 495.01 | test_vpc_redundant.py test_04_rvpc_network_garbage_collector_nics | Success | 1431.63 | test_vpc_redundant.py test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers | Success | 529.74 | test_vpc_redundant.py test_02_redundant_VPC_default_routes | Success | 744.38 | test_vpc_redundant.py test_09_delete_detached_volume | Success | 15.58 | test_volumes.py test_08_resize_volume | Success | 15.45 | test_volumes.py test_07_resize_fail | Success | 20.57 | test_volumes.py test_06_download_detached_volume | Success | 15.44 | test_volumes.py test_05_detach_volume | Success | 100.39 | test_volumes.py test_04_delete_attached_volume | Success | 10.46 | test_volumes.py test_03_download_attached_volume | Success | 15.47 | test_volumes.py test_02_attach_volume | Success | 43.76 | test_volumes.py test_01_create_volume | Success | 711.73 | test_volumes.py test_deploy_vm_multiple | Success | 228.78 | test_vm_life_cycle.py test_deploy_vm | Success | 0.03 | test_vm_life_cycle.py test_advZoneVirtualRouter | Success | 0.02 | test_vm_life_cycle.py test_10_attachAndDetach_iso | Success | 26.63 | test_vm_life_cycle.py test_09_expunge_vm | Success | 125.34 | test_vm_life_cycle.py test_08_migrate_vm | Success | 36.08 | test_vm_life_cycle.py test_07_restore_vm | Success | 0.14 | test_vm_life_cycle.py test_06_destroy_vm | Success | 125.98 | test_vm_life_cycle.py test_03_reboot_vm | Success | 126.17 | test_vm_life_cycle.py test_02_start_vm | Success | 10.25 | test_vm_life_cycle.py test_01_stop_vm | Success | 40.42 | test_vm_life_cycle.py test_CreateTemplateWithDuplicateName | Success | 60.95 | test_templates.py test_08_list_system_templates | Success | 0.07 | test_templates.py test_07_list_public_templates | Success | 0.05 | test_templates.py test_05_template_permissions | Success | 0.10 | test_templates.py test_04_extract_template | Success | 5.16 | test_templates.py test_03_delete_template | Success | 5.13 | test_templates.py test_02_edit_template | Success | 90.15 | test_templates.py test_01_create_template | Success | 30.82 | test_templates.py test_10_destroy_cpvm | Success | 161.66 | test_ssvm.py test_09_destroy_ssvm | Success | 133.35 | test_ssvm.py test_08_reboot_cpvm | Success | 101.75 | test_ssvm.py test_07_reboot_ssvm | Success | 103.24 | test_ssvm.py test_06_stop_cpvm | Success | 136.86 | test_ssvm.py test_05_stop_ssvm | Success | 133.38 | test_ssvm.py test_04_cpvm_internals | Success | 1.32 | test_ssvm.py test_03_ssvm_internals | Success | 2.94 | test_ssvm.py test_02_list_cpvm_vm | Success | 0.12 | test_ssvm.py test_01_list_sec_storage_vm | Success | 0.12 | test_ssvm.py test_01_snapshot_root_disk | Success | 11.51 | test_snapshots.py test_04_change_offering_small | Success | 210.92 | test_service_offerings.py test_03_delete_service_offering | Success | 0.04 | test_service_offerings.py test_02_edit_service_offering | Success | 0.05 | test_service_offerings.py test_01_create_service_offering | Success | 0.12 | test_service_offerings.py test_02_sys_template_ready | Success | 0.12 | test_secondary_storage.py test_01_sys_vm_start | Success | 0.17 | test_secondary_storage.py test_09_reboot_router | Success | 35.50 | test_routers.py test_08_start_router | Success | 30.48 | test_routers.py test_07_stop_router | Success | 10.20 | test_routers.py test_06_router_advanced | Success | 0.05 | test_routers.py test_05_router_basic | Success | 0.04 | test_routers.py test_04_restart_network_wo_cleanup | Success | 5.95 | test_routers.py test_03_restart_network_cleanup | Success | 60.63 | test_routers.py test_02_router_internal_adv | Success | 1.16 | test_routers.py test_01_router_internal_basic | Success | 0.64 | test_routers.py test_router_dhcphosts | Success | 272.26 | test_router_dhcphosts.py
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user blueorangutan commented on the issue: https://github.com/apache/cloudstack/pull/1692 Trillian test result (tid-136) Environment: xenserver-65sp1 (x2), Advanced Networking Total time taken: 28652 seconds Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1692-t136-xenserver-65sp1.zip Test completed. 40 look ok, 3 have error(s) Test | Result | Time (s) --- | --- | --- test_05_rvpc_multi_tiers | `Failure` | 437.000 test_04_rvpc_network_garbage_collector_nics | `Failure` | 1327.344 test_03_vpc_privategw_restart_vpc_cleanup | `Failure` | 636.128 test_02_vpc_privategw_static_routes | `Failure` | 321.357 test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL | `Failure` | 496.343 test_01_nic | `Error` | 566.507 ContextSuite context=TestVPCRedundancy>:teardown | `Error` | 755.362 test_router_dhcphosts | Success | 169.694 test_releaseIP | Success | 249.624 test_reboot_router | Success | 535.697 test_public_ip_user_account | Success | 10.307 test_public_ip_admin_account | Success | 40.419 test_nic_secondaryip_add_remove | Success | 219.827 test_network_rules_acquired_public_ip_3_Load_Balancer_Rule | Success | 76.724 test_network_rules_acquired_public_ip_2_nat_rule | Success | 61.668 test_network_rules_acquired_public_ip_1_static_nat_rule | Success | 91.958 test_isolate_network_password_server | Success | 31.564 test_extendPhysicalNetworkVlan | Success | 15.496 test_deployvm_userdispersing | Success | 45.971 test_deployvm_userdata_post | Success | 15.740 test_deployvm_userdata | Success | 101.173 test_deployvm_userconcentrated | Success | 96.627 test_deployvm_firstfit | Success | 136.838 test_deploy_vm_multiple | Success | 203.645 test_deploy_vm_from_iso | Success | 144.410 test_deploy_vm | Success | 0.027 test_delete_account | Success | 249.164 test_dedicatePublicIpRange | Success | 0.385 test_dedicateGuestVlanRange | Success | 10.441 test_create_pvlan_network | Success | 5.249 test_createRegion | Success | 0.030 test_createPortablePublicIPRange | Success | 10.358 test_createPortablePublicIPAcquire | Success | 15.592 test_assign_and_removal_lb | Success | 143.933 test_advZoneVirtualRouter | Success | 0.021 test_UpdateStorageOverProvisioningFactor | Success | 0.116 test_UpdateConfigParamWithScope | Success | 0.119 test_DeployVmAntiAffinityGroup | Success | 121.474 test_CreateTemplateWithDuplicateName | Success | 91.087 test_10_destroy_cpvm | Success | 196.719 test_10_attachAndDetach_iso | Success | 27.142 test_09_reboot_router | Success | 50.407 test_09_expunge_vm | Success | 125.250 test_09_destroy_ssvm | Success | 199.437 test_09_delete_detached_volume | Success | 15.729 test_08_start_router | Success | 40.407 test_08_resize_volume | Success | 86.215 test_08_reboot_cpvm | Success | 141.628 test_08_migrate_vm | Success | 66.361 test_08_list_system_templates | Success | 0.026 test_07_stop_router | Success | 10.209 test_07_restore_vm | Success | 0.094 test_07_resize_fail | Success | 96.069 test_07_reboot_ssvm | Success | 144.841 test_07_list_public_templates | Success | 0.042 test_07_list_default_iso | Success | 0.056 test_06_stop_cpvm | Success | 136.770 test_06_router_advanced | Success | 0.052 test_06_download_detached_volume | Success | 20.453 test_06_destroy_vm | Success | 15.222 test_05_template_permissions | Success | 0.055 test_05_stop_ssvm | Success | 139.122 test_05_router_basic | Success | 0.036 test_05_iso_permissions | Success | 0.056 test_05_detach_volume | Success | 100.421 test_04_rvpc_privategw_static_routes | Success | 902.157 test_04_rvpc_internallb_haproxy_stats_on_all_interfaces | Success | 491.738 test_04_restart_network_wo_cleanup | Success | 5.574 test_04_extract_template | Success | 5.128 test_04_extract_Iso | Success | 5.161 test_04_delete_attached_volume | Success | 10.307 test_04_create_fat_type_disk_offering | Success | 0.062 test_04_cpvm_internals | Success | 1.350 test_04_change_offering_small | Success | 91.079 test_03_vpc_internallb_haproxy_stats_on_all_interfaces | Success | 334.894 test_03_ssvm_internals | Success | 3.357 test_03_restart_network_cleanup | Success | 105.923 test_03_reboot_vm | Success | 20.331 test_03_download_attached_volume | Success | 15.354 test_03_delete_vm_snapshots | Success | 280.317 test_03_delete_template | Success | 5.149 test_03_delete_service_offering | Success | 0.035 test_03_delete_iso | Success | 95.215 test_03_delete_disk_offering | Success | 0.041 test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers | Success | 836.097 test_02_sys_template_ready | Success | 0.119 test_02_start_vm | Success | 25.282
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user blueorangutan commented on the issue: https://github.com/apache/cloudstack/pull/1692 Trillian test result (tid-134) Environment: xenserver-65sp1 (x2), Advanced Networking Total time taken: 36954 seconds Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1692-t134-xenserver-65sp1.zip Tested twice for intermitten failure: /marvin/tests/smoke/test_privategw_acl.py Tested twice for intermitten failure: /marvin/tests/smoke/test_routers_network_ops.py Tested twice for intermitten failure: /marvin/tests/smoke/test_vpc_redundant.py Test completed. 41 look ok, 2 have error(s) Test | Result | Time (s) --- | --- | --- test_05_rvpc_multi_tiers | `Failure` | 434.816 test_04_rvpc_privategw_static_routes | `Failure` | 607.297 test_04_rvpc_network_garbage_collector_nics | `Failure` | 1335.550 test_03_vpc_privategw_restart_vpc_cleanup | `Failure` | 661.522 test_02_vpc_privategw_static_routes | `Failure` | 385.742 test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL | `Failure` | 457.450 test_router_dhcphosts | Success | 122.339 test_releaseIP | Success | 222.972 test_reboot_router | Success | 514.734 test_public_ip_user_account | Success | 10.300 test_public_ip_admin_account | Success | 40.245 test_nic_secondaryip_add_remove | Success | 147.266 test_network_rules_acquired_public_ip_3_Load_Balancer_Rule | Success | 71.548 test_network_rules_acquired_public_ip_2_nat_rule | Success | 61.487 test_network_rules_acquired_public_ip_1_static_nat_rule | Success | 91.716 test_isolate_network_password_server | Success | 60.940 test_extendPhysicalNetworkVlan | Success | 15.273 test_deployvm_userdispersing | Success | 40.699 test_deployvm_userdata_post | Success | 25.480 test_deployvm_userdata | Success | 110.805 test_deployvm_userconcentrated | Success | 81.124 test_deployvm_firstfit | Success | 140.982 test_deploy_vm_multiple | Success | 212.549 test_deploy_vm_from_iso | Success | 147.436 test_deploy_vm | Success | 0.021 test_delete_account | Success | 222.637 test_dedicatePublicIpRange | Success | 0.294 test_dedicateGuestVlanRange | Success | 10.187 test_create_pvlan_network | Success | 5.142 test_createRegion | Success | 0.027 test_createPortablePublicIPRange | Success | 15.147 test_createPortablePublicIPAcquire | Success | 15.278 test_assign_and_removal_lb | Success | 138.791 test_advZoneVirtualRouter | Success | 0.016 test_UpdateStorageOverProvisioningFactor | Success | 0.094 test_UpdateConfigParamWithScope | Success | 0.103 test_DeployVmAntiAffinityGroup | Success | 115.982 test_CreateTemplateWithDuplicateName | Success | 85.568 test_10_destroy_cpvm | Success | 221.495 test_10_attachAndDetach_iso | Success | 41.709 test_09_reboot_router | Success | 60.439 test_09_expunge_vm | Success | 125.226 test_09_destroy_ssvm | Success | 233.703 test_09_delete_detached_volume | Success | 15.568 test_08_start_router | Success | 45.307 test_08_resize_volume | Success | 85.709 test_08_reboot_cpvm | Success | 111.610 test_08_migrate_vm | Success | 60.968 test_08_list_system_templates | Success | 0.017 test_07_stop_router | Success | 15.188 test_07_restore_vm | Success | 0.094 test_07_resize_fail | Success | 95.807 test_07_reboot_ssvm | Success | 153.618 test_07_list_public_templates | Success | 0.021 test_07_list_default_iso | Success | 0.036 test_06_stop_cpvm | Success | 136.677 test_06_router_advanced | Success | 0.036 test_06_download_detached_volume | Success | 25.359 test_06_destroy_vm | Success | 10.131 test_05_template_permissions | Success | 0.035 test_05_stop_ssvm | Success | 168.734 test_05_router_basic | Success | 0.026 test_05_iso_permissions | Success | 0.039 test_05_detach_volume | Success | 100.229 test_04_rvpc_internallb_haproxy_stats_on_all_interfaces | Success | 444.256 test_04_restart_network_wo_cleanup | Success | 5.467 test_04_extract_template | Success | 5.109 test_04_extract_Iso | Success | 5.086 test_04_delete_attached_volume | Success | 10.159 test_04_create_fat_type_disk_offering | Success | 0.046 test_04_cpvm_internals | Success | 1.009 test_04_change_offering_small | Success | 63.799 test_03_vpc_internallb_haproxy_stats_on_all_interfaces | Success | 323.848 test_03_ssvm_internals | Success | 3.666 test_03_restart_network_cleanup | Success | 115.694 test_03_reboot_vm | Success | 10.118 test_03_download_attached_volume | Success | 15.317 test_03_delete_vm_snapshots | Success | 280.185 test_03_delete_template | Success | 5.077 test_03_delete_service_offering | Success | 0.040 test_03_delete_iso | Success | 95.221 test_03_delete_disk_offering | Success | 0.025
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user blueorangutan commented on the issue: https://github.com/apache/cloudstack/pull/1692 Trillian test result (tid-133) Environment: vmware-55u3 (x2), Advanced Networking Total time taken: 32364 seconds Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1692-t133-vmware-55u3.zip Tested twice for intermitten failure: /marvin/tests/smoke/test_vpc_vpn.py Test completed. 42 look ok, 1 have error(s) Test | Result | Time (s) --- | --- | --- test_01_vpc_site2site_vpn | `Error` | 447.709 ContextSuite context=TestRVPCSite2SiteVpn>:setup | `Error` | 0.000 test_router_dhcphosts | Success | 165.128 test_releaseIP | Success | 250.252 test_reboot_router | Success | 626.507 test_public_ip_user_account | Success | 10.283 test_public_ip_admin_account | Success | 40.406 test_nic_secondaryip_add_remove | Success | 179.626 test_network_rules_acquired_public_ip_3_Load_Balancer_Rule | Success | 67.372 test_network_rules_acquired_public_ip_2_nat_rule | Success | 62.263 test_network_rules_acquired_public_ip_1_static_nat_rule | Success | 124.534 test_isolate_network_password_server | Success | 92.496 test_extendPhysicalNetworkVlan | Success | 15.381 test_deployvm_userdispersing | Success | 86.160 test_deployvm_userdata_post | Success | 20.624 test_deployvm_userdata | Success | 141.780 test_deployvm_userconcentrated | Success | 55.969 test_deployvm_firstfit | Success | 166.604 test_deploy_vm_multiple | Success | 209.824 test_deploy_vm_from_iso | Success | 193.668 test_deploy_vm | Success | 0.060 test_delete_account | Success | 284.567 test_dedicatePublicIpRange | Success | 0.480 test_dedicateGuestVlanRange | Success | 10.284 test_create_pvlan_network | Success | 5.213 test_createRegion | Success | 0.034 test_createPortablePublicIPRange | Success | 15.482 test_createPortablePublicIPAcquire | Success | 15.498 test_assign_and_removal_lb | Success | 133.755 test_advZoneVirtualRouter | Success | 0.029 test_UpdateStorageOverProvisioningFactor | Success | 0.142 test_UpdateConfigParamWithScope | Success | 0.153 test_DeployVmAntiAffinityGroup | Success | 242.530 test_CreateTemplateWithDuplicateName | Success | 216.710 test_10_destroy_cpvm | Success | 236.895 test_10_attachAndDetach_iso | Success | 27.357 test_09_reboot_router | Success | 166.273 test_09_expunge_vm | Success | 125.302 test_09_destroy_ssvm | Success | 238.939 test_09_delete_detached_volume | Success | 31.564 test_08_start_router | Success | 111.070 test_08_reboot_cpvm | Success | 156.717 test_08_migrate_vm | Success | 71.392 test_08_list_system_templates | Success | 0.026 test_07_stop_router | Success | 25.409 test_07_restore_vm | Success | 0.149 test_07_reboot_ssvm | Success | 158.583 test_07_list_public_templates | Success | 0.032 test_07_list_default_iso | Success | 0.079 test_06_stop_cpvm | Success | 177.172 test_06_router_advanced | Success | 0.075 test_06_download_detached_volume | Success | 50.541 test_06_destroy_vm | Success | 10.158 test_05_template_permissions | Success | 0.053 test_05_stop_ssvm | Success | 179.815 test_05_rvpc_multi_tiers | Success | 519.576 test_05_router_basic | Success | 0.052 test_05_iso_permissions | Success | 0.093 test_05_detach_volume | Success | 105.404 test_04_rvpc_privategw_static_routes | Success | 836.749 test_04_rvpc_network_garbage_collector_nics | Success | 1561.864 test_04_rvpc_internallb_haproxy_stats_on_all_interfaces | Success | 490.988 test_04_restart_network_wo_cleanup | Success | 6.195 test_04_extract_template | Success | 10.297 test_04_extract_Iso | Success | 5.176 test_04_delete_attached_volume | Success | 15.295 test_04_create_fat_type_disk_offering | Success | 0.180 test_04_cpvm_internals | Success | 1.957 test_04_change_offering_small | Success | 97.071 test_03_vpc_privategw_restart_vpc_cleanup | Success | 779.114 test_03_vpc_internallb_haproxy_stats_on_all_interfaces | Success | 360.342 test_03_ssvm_internals | Success | 3.838 test_03_restart_network_cleanup | Success | 141.136 test_03_reboot_vm | Success | 5.135 test_03_download_attached_volume | Success | 15.376 test_03_delete_vm_snapshots | Success | 275.229 test_03_delete_template | Success | 5.159 test_03_delete_service_offering | Success | 0.037 test_03_delete_iso | Success | 95.153 test_03_delete_disk_offering | Success | 0.095 test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers | Success | 658.181 test_02_vpc_privategw_static_routes | Success | 559.786 test_02_sys_template_ready | Success | 0.121 test_02_start_vm | Success | 15.279 test_02_router_internal_adv | Success | 1.317 test_02_revert_vm_snapshots | Success |
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user blueorangutan commented on the issue: https://github.com/apache/cloudstack/pull/1692 Trillian test result (tid-132) Environment: vmware-55u3 (x2), Advanced Networking Total time taken: 35553 seconds Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1692-t132-vmware-55u3.zip Tested twice for intermitten failure: /marvin/tests/smoke/test_routers_network_ops.py Tested twice for intermitten failure: /marvin/tests/smoke/test_templates.py Tested twice for intermitten failure: /marvin/tests/smoke/test_volumes.py Tested twice for intermitten failure: /marvin/tests/smoke/test_vpc_vpn.py Test completed. 41 look ok, 2 have error(s) Test | Result | Time (s) --- | --- | --- test_CreateTemplateWithDuplicateName | `Error` | 181.209 test_01_vpc_site2site_vpn | `Error` | 431.015 test_01_redundant_vpc_site2site_vpn | `Error` | 687.758 test_01_create_template | `Error` | 15.167 ContextSuite context=TestTemplates>:setup | `Error` | 542.176 test_router_dhcphosts | Success | 168.740 test_releaseIP | Success | 268.327 test_reboot_router | Success | 554.663 test_public_ip_user_account | Success | 10.179 test_public_ip_admin_account | Success | 40.377 test_nic_secondaryip_add_remove | Success | 253.017 test_network_rules_acquired_public_ip_3_Load_Balancer_Rule | Success | 66.659 test_network_rules_acquired_public_ip_2_nat_rule | Success | 61.597 test_network_rules_acquired_public_ip_1_static_nat_rule | Success | 124.001 test_isolate_network_password_server | Success | 94.711 test_extendPhysicalNetworkVlan | Success | 15.397 test_deployvm_userdispersing | Success | 50.718 test_deployvm_userdata_post | Success | 55.514 test_deployvm_userdata | Success | 136.703 test_deployvm_userconcentrated | Success | 96.194 test_deployvm_firstfit | Success | 156.582 test_deploy_vm_multiple | Success | 232.634 test_deploy_vm_from_iso | Success | 252.757 test_deploy_vm | Success | 0.020 test_delete_account | Success | 262.809 test_dedicatePublicIpRange | Success | 0.284 test_dedicateGuestVlanRange | Success | 10.178 test_create_pvlan_network | Success | 5.148 test_createRegion | Success | 0.024 test_createPortablePublicIPRange | Success | 15.139 test_createPortablePublicIPAcquire | Success | 15.730 test_assign_and_removal_lb | Success | 133.809 test_advZoneVirtualRouter | Success | 0.015 test_UpdateStorageOverProvisioningFactor | Success | 0.100 test_UpdateConfigParamWithScope | Success | 0.096 test_DeployVmAntiAffinityGroup | Success | 166.300 test_10_destroy_cpvm | Success | 231.595 test_10_attachAndDetach_iso | Success | 46.823 test_09_reboot_router | Success | 130.871 test_09_expunge_vm | Success | 125.286 test_09_destroy_ssvm | Success | 268.824 test_09_delete_detached_volume | Success | 25.782 test_08_start_router | Success | 110.778 test_08_reboot_cpvm | Success | 156.445 test_08_migrate_vm | Success | 71.116 test_07_stop_router | Success | 20.154 test_07_restore_vm | Success | 0.067 test_07_reboot_ssvm | Success | 188.250 test_07_list_default_iso | Success | 0.037 test_06_stop_cpvm | Success | 201.609 test_06_router_advanced | Success | 0.035 test_06_download_detached_volume | Success | 60.613 test_06_destroy_vm | Success | 10.154 test_05_stop_ssvm | Success | 203.653 test_05_rvpc_multi_tiers | Success | 531.706 test_05_router_basic | Success | 0.026 test_05_iso_permissions | Success | 0.040 test_05_detach_volume | Success | 110.334 test_04_rvpc_privategw_static_routes | Success | 823.263 test_04_rvpc_network_garbage_collector_nics | Success | 1516.887 test_04_rvpc_internallb_haproxy_stats_on_all_interfaces | Success | 556.043 test_04_restart_network_wo_cleanup | Success | 5.561 test_04_extract_Iso | Success | 5.189 test_04_delete_attached_volume | Success | 10.143 test_04_create_fat_type_disk_offering | Success | 0.053 test_04_cpvm_internals | Success | 1.089 test_04_change_offering_small | Success | 96.933 test_03_vpc_privategw_restart_vpc_cleanup | Success | 841.963 test_03_vpc_internallb_haproxy_stats_on_all_interfaces | Success | 418.759 test_03_ssvm_internals | Success | 3.171 test_03_restart_network_cleanup | Success | 150.911 test_03_reboot_vm | Success | 5.113 test_03_download_attached_volume | Success | 20.336 test_03_delete_vm_snapshots | Success | 275.147 test_03_delete_service_offering | Success | 0.025 test_03_delete_iso | Success | 95.186 test_03_delete_disk_offering | Success | 0.028 test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers | Success | 624.588 test_02_vpc_privategw_static_routes | Success | 566.609 test_02_sys_template_ready | Success | 0.082 test_02_start_vm | Success |
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user blueorangutan commented on the issue: https://github.com/apache/cloudstack/pull/1692 Trillian test result (tid-131) Environment: xenserver-65sp1 (x2), Advanced Networking Total time taken: 38763 seconds Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1692-t131-xenserver-65sp1.zip Tested twice for intermitten failure: /marvin/tests/smoke/test_privategw_acl.py Tested twice for intermitten failure: /marvin/tests/smoke/test_routers_network_ops.py Tested twice for intermitten failure: /marvin/tests/smoke/test_vpc_redundant.py Test completed. 41 look ok, 2 have error(s) Test | Result | Time (s) --- | --- | --- test_05_rvpc_multi_tiers | `Failure` | 488.075 test_04_rvpc_privategw_static_routes | `Failure` | 1273.453 test_04_rvpc_network_garbage_collector_nics | `Failure` | 1342.588 test_02_vpc_privategw_static_routes | `Failure` | 439.296 test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL | `Failure` | 454.733 test_router_dhcphosts | Success | 103.527 test_releaseIP | Success | 270.071 test_reboot_router | Success | 486.058 test_public_ip_user_account | Success | 10.373 test_public_ip_admin_account | Success | 40.680 test_nic_secondaryip_add_remove | Success | 154.018 test_network_rules_acquired_public_ip_3_Load_Balancer_Rule | Success | 77.474 test_network_rules_acquired_public_ip_2_nat_rule | Success | 61.668 test_network_rules_acquired_public_ip_1_static_nat_rule | Success | 92.442 test_isolate_network_password_server | Success | 36.404 test_extendPhysicalNetworkVlan | Success | 15.578 test_deployvm_userdispersing | Success | 101.307 test_deployvm_userdata_post | Success | 15.796 test_deployvm_userdata | Success | 121.676 test_deployvm_userconcentrated | Success | 41.136 test_deployvm_firstfit | Success | 166.984 test_deploy_vm_multiple | Success | 244.149 test_deploy_vm_from_iso | Success | 159.486 test_deploy_vm | Success | 0.028 test_delete_account | Success | 218.605 test_dedicatePublicIpRange | Success | 0.906 test_dedicateGuestVlanRange | Success | 10.339 test_create_pvlan_network | Success | 5.307 test_createRegion | Success | 0.036 test_createPortablePublicIPRange | Success | 15.387 test_createPortablePublicIPAcquire | Success | 15.498 test_assign_and_removal_lb | Success | 149.256 test_advZoneVirtualRouter | Success | 0.022 test_UpdateStorageOverProvisioningFactor | Success | 0.133 test_UpdateConfigParamWithScope | Success | 0.129 test_DeployVmAntiAffinityGroup | Success | 191.889 test_CreateTemplateWithDuplicateName | Success | 95.934 test_10_destroy_cpvm | Success | 196.985 test_10_attachAndDetach_iso | Success | 31.909 test_09_reboot_router | Success | 60.511 test_09_expunge_vm | Success | 125.262 test_09_destroy_ssvm | Success | 198.908 test_09_delete_detached_volume | Success | 16.053 test_08_start_router | Success | 50.465 test_08_resize_volume | Success | 91.072 test_08_reboot_cpvm | Success | 121.662 test_08_migrate_vm | Success | 61.469 test_08_list_system_templates | Success | 0.040 test_07_stop_router | Success | 15.426 test_07_restore_vm | Success | 0.091 test_07_resize_fail | Success | 95.907 test_07_reboot_ssvm | Success | 143.857 test_07_list_public_templates | Success | 0.041 test_07_list_default_iso | Success | 0.055 test_06_stop_cpvm | Success | 166.680 test_06_router_advanced | Success | 0.051 test_06_download_detached_volume | Success | 35.418 test_06_destroy_vm | Success | 10.181 test_05_template_permissions | Success | 0.084 test_05_stop_ssvm | Success | 138.953 test_05_router_basic | Success | 0.036 test_05_iso_permissions | Success | 0.066 test_05_detach_volume | Success | 100.260 test_04_rvpc_internallb_haproxy_stats_on_all_interfaces | Success | 446.389 test_04_restart_network_wo_cleanup | Success | 5.529 test_04_extract_template | Success | 5.147 test_04_extract_Iso | Success | 5.147 test_04_delete_attached_volume | Success | 10.238 test_04_create_fat_type_disk_offering | Success | 0.063 test_04_cpvm_internals | Success | 1.120 test_04_change_offering_small | Success | 79.297 test_03_vpc_privategw_restart_vpc_cleanup | Success | 770.184 test_03_vpc_internallb_haproxy_stats_on_all_interfaces | Success | 324.886 test_03_ssvm_internals | Success | 3.401 test_03_restart_network_cleanup | Success | 121.076 test_03_reboot_vm | Success | 15.372 test_03_download_attached_volume | Success | 15.341 test_03_delete_vm_snapshots | Success | 280.219 test_03_delete_template | Success | 5.159 test_03_delete_service_offering | Success | 0.049 test_03_delete_iso | Success | 95.201 test_03_delete_disk_offering | Success | 0.038
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1692 @rhtyd Vmsnapshot tests fail on vmware 6.0 due to issue resolved in PR1677. 1677 is targeted for 4.9 so I agree on removing that test for ACS 4.8 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user rhtyd commented on the issue: https://github.com/apache/cloudstack/pull/1692 Common intermittent failure issues: (1) unable to contact ssvm/agent, times out, (2) unable to ssh into guest VM possibly due to vm's nic not up/available: 1. Re-ran tests on `pr1692-t120-xenserver-65sp1`: Test | Result | Time (s) --- | --- | --- test_01_snapshot_root_disk | Success | 21.040 We're investigating redundant vpc/vr related failures on the xenserver environment. 2. I'm re-running tests on vmware 5.5 u3, the failures are thought as intermittent issues. 3. All vm_snapshot related tests on vmware 6.0 are failing, since vmware 6.0 is not supported on 4.8, I'll skip them to reduce testing scope but we should consider vmware 6.0 env for 4.9/lts+. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user blueorangutan commented on the issue: https://github.com/apache/cloudstack/pull/1692 Packaging result: âcentos6 âcentos7 âdebian. JID-58 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user blueorangutan commented on the issue: https://github.com/apache/cloudstack/pull/1692 Trillian test result (tid-120) Environment: xenserver-65sp1 (x2), Advanced Networking Total time taken: 36521 seconds Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1692-t120-xenserver-65sp1.zip Test completed. 44 look ok, 8 have errors Test | Result | Time (s) --- | --- | --- test_05_rvpc_multi_tiers | `Failure` | 464.957 test_04_rvpc_privategw_static_routes | `Failure` | 646.393 test_04_rvpc_network_garbage_collector_nics | `Failure` | 1370.589 test_03_vpc_privategw_restart_vpc_cleanup | `Failure` | 651.388 test_02_vpc_privategw_static_routes | `Failure` | 410.656 test_02_RVR_Network_FW_PF_SSH_default_routes_egress_false | `Failure` | 396.116 test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL | `Failure` | 473.487 test_01_RVR_Network_FW_PF_SSH_default_routes_egress_true | `Failure` | 411.794 ContextSuite context=TestSnapshotRootDisk>:teardown | `Error` | 71.254 test_router_dhcphosts | Success | 127.014 test_releaseIP | Success | 257.840 test_reboot_router | Success | 564.414 test_public_ip_user_account | Success | 10.180 test_public_ip_admin_account | Success | 40.189 test_nic_secondaryip_add_remove | Success | 132.307 test_network_rules_acquired_public_ip_3_Load_Balancer_Rule | Success | 71.406 test_network_rules_acquired_public_ip_2_nat_rule | Success | 61.168 test_network_rules_acquired_public_ip_1_static_nat_rule | Success | 91.749 test_network_acl | Success | 141.308 test_isolate_network_password_server | Success | 60.970 test_extendPhysicalNetworkVlan | Success | 15.221 test_deployvm_userdispersing | Success | 40.505 test_deployvm_userdata_post | Success | 25.325 test_deployvm_userdata | Success | 95.748 test_deployvm_userconcentrated | Success | 95.801 test_deployvm_firstfit | Success | 161.083 test_deploy_vm_multiple | Success | 217.453 test_deploy_vm_from_iso | Success | 383.693 test_deploy_vm | Success | 0.018 test_delete_account | Success | 273.068 test_dedicatePublicIpRange | Success | 0.268 test_dedicateGuestVlanRange | Success | 10.434 test_create_pvlan_network | Success | 5.161 test_createRegion | Success | 0.035 test_createPortablePublicIPRange | Success | 15.129 test_createPortablePublicIPAcquire | Success | 20.420 test_assign_and_removal_lb | Success | 138.558 test_advZoneVirtualRouter | Success | 0.013 test_UpdateStorageOverProvisioningFactor | Success | 0.187 test_UpdateConfigParamWithScope | Success | 0.087 test_DeployVmAntiAffinityGroup_in_project | Success | 317.440 test_DeployVmAntiAffinityGroup | Success | 126.106 test_CreateTemplateWithDuplicateName | Success | 95.899 test_10_destroy_cpvm | Success | 191.517 test_10_attachAndDetach_iso | Success | 31.568 test_09_reboot_router | Success | 60.440 test_09_expunge_vm | Success | 125.121 test_09_destroy_ssvm | Success | 173.678 test_09_delete_detached_volume | Success | 15.663 test_08_start_router | Success | 40.338 test_08_resize_volume | Success | 90.734 test_08_reboot_cpvm | Success | 111.373 test_08_migrate_vm | Success | 65.994 test_08_list_system_templates | Success | 0.016 test_07_stop_router | Success | 15.167 test_07_restore_vm | Success | 0.059 test_07_resize_fail | Success | 95.779 test_07_reboot_ssvm | Success | 154.100 test_07_list_public_templates | Success | 0.020 test_07_list_default_iso | Success | 0.033 test_06_stop_cpvm | Success | 136.551 test_06_router_advanced | Success | 0.031 test_06_download_detached_volume | Success | 20.226 test_06_destroy_vm | Success | 10.146 test_05_template_permissions | Success | 0.031 test_05_stop_ssvm | Success | 204.167 test_05_router_basic | Success | 0.022 test_05_iso_permissions | Success | 0.036 test_05_detach_volume | Success | 100.176 test_04_rvpc_internallb_haproxy_stats_on_all_interfaces | Success | 478.870 test_04_restart_network_wo_cleanup | Success | 5.456 test_04_extract_template | Success | 5.100 test_04_extract_Iso | Success | 5.147 test_04_delete_attached_volume | Success | 10.196 test_04_create_fat_type_disk_offering | Success | 0.040 test_04_cpvm_internals | Success | 1.097 test_04_change_offering_small | Success | 63.850 test_03_vpc_internallb_haproxy_stats_on_all_interfaces | Success | 293.520 test_03_ssvm_internals | Success | 3.385 test_03_restart_network_cleanup | Success | 100.542 test_03_reboot_vm | Success | 20.184 test_03_download_attached_volume | Success | 15.207 test_03_delete_vm_snapshots | Success | 280.213 test_03_delete_template | Success | 5.072 test_03_delete_service_offering | Success | 0.024 test_03_delete_iso | Success |
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user blueorangutan commented on the issue: https://github.com/apache/cloudstack/pull/1692 Trillian test result (tid-121) Environment: vmware-55u3 (x2), Advanced Networking Total time taken: 32085 seconds Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1692-t121-vmware-55u3.zip Test completed. 46 look ok, 4 have errors Test | Result | Time (s) --- | --- | --- test_CreateTemplateWithDuplicateName | `Error` | 15.216 test_01_vpc_site2site_vpn | `Error` | 447.132 test_01_redundant_vpc_site2site_vpn | `Error` | 653.900 ContextSuite context=TestTemplates>:setup | `Error` | 256.395 test_router_dhcphosts | Success | 142.722 test_releaseIP | Success | 244.344 test_reboot_router | Success | 581.096 test_public_ip_user_account | Success | 10.291 test_public_ip_admin_account | Success | 40.302 test_nic_secondaryip_add_remove | Success | 178.656 test_network_rules_acquired_public_ip_3_Load_Balancer_Rule | Success | 67.010 test_network_rules_acquired_public_ip_2_nat_rule | Success | 61.903 test_network_rules_acquired_public_ip_1_static_nat_rule | Success | 124.537 test_network_acl | Success | 192.072 test_isolate_network_password_server | Success | 95.209 test_extendPhysicalNetworkVlan | Success | 15.450 test_deployvm_userdispersing | Success | 50.925 test_deployvm_userdata_post | Success | 25.611 test_deployvm_userdata | Success | 146.547 test_deployvm_userconcentrated | Success | 102.033 test_deployvm_firstfit | Success | 166.561 test_deploy_vm_multiple | Success | 199.148 test_deploy_vm_from_iso | Success | 400.813 test_deploy_vm | Success | 0.027 test_delete_account | Success | 264.317 test_dedicatePublicIpRange | Success | 0.549 test_dedicateGuestVlanRange | Success | 10.332 test_create_pvlan_network | Success | 5.251 test_createRegion | Success | 0.084 test_createPortablePublicIPRange | Success | 15.231 test_createPortablePublicIPAcquire | Success | 15.601 test_assign_and_removal_lb | Success | 133.638 test_advZoneVirtualRouter | Success | 0.022 test_UpdateStorageOverProvisioningFactor | Success | 0.224 test_UpdateConfigParamWithScope | Success | 0.223 test_DeployVmAntiAffinityGroup_in_project | Success | 304.744 test_DeployVmAntiAffinityGroup | Success | 193.631 test_10_destroy_cpvm | Success | 237.212 test_10_attachAndDetach_iso | Success | 77.410 test_09_reboot_router | Success | 136.007 test_09_expunge_vm | Success | 125.258 test_09_destroy_ssvm | Success | 239.567 test_09_delete_detached_volume | Success | 30.974 test_08_start_router | Success | 116.052 test_08_reboot_cpvm | Success | 186.920 test_08_migrate_vm | Success | 61.249 test_07_stop_router | Success | 25.280 test_07_restore_vm | Success | 0.182 test_07_reboot_ssvm | Success | 159.093 test_07_list_default_iso | Success | 0.054 test_06_stop_cpvm | Success | 177.229 test_06_router_advanced | Success | 0.057 test_06_download_detached_volume | Success | 60.670 test_06_destroy_vm | Success | 10.180 test_05_stop_ssvm | Success | 174.149 test_05_rvpc_multi_tiers | Success | 523.307 test_05_router_basic | Success | 0.045 test_05_iso_permissions | Success | 0.067 test_05_detach_volume | Success | 105.290 test_04_rvpc_privategw_static_routes | Success | 800.633 test_04_rvpc_network_garbage_collector_nics | Success | 1523.465 test_04_rvpc_internallb_haproxy_stats_on_all_interfaces | Success | 481.184 test_04_restart_network_wo_cleanup | Success | 5.698 test_04_extract_Iso | Success | 5.302 test_04_delete_attached_volume | Success | 15.280 test_04_create_fat_type_disk_offering | Success | 0.205 test_04_cpvm_internals | Success | 1.433 test_04_change_offering_small | Success | 92.979 test_03_vpc_privategw_restart_vpc_cleanup | Success | 870.854 test_03_vpc_internallb_haproxy_stats_on_all_interfaces | Success | 374.523 test_03_ssvm_internals | Success | 3.850 test_03_restart_network_cleanup | Success | 126.065 test_03_reboot_vm | Success | 5.162 test_03_download_attached_volume | Success | 15.414 test_03_delete_vm_snapshots | Success | 275.311 test_03_delete_service_offering | Success | 0.044 test_03_delete_iso | Success | 95.218 test_03_delete_disk_offering | Success | 0.045 test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers | Success | 651.599 test_03_RVR_Network_check_router_state | Success | 308.076 test_02_vpc_privategw_static_routes | Success | 599.275 test_02_sys_template_ready | Success | 0.128 test_02_start_vm | Success | 15.217 test_02_routervm_iptables_policies | Success | 182.836 test_02_router_internal_adv | Success | 1.139 test_02_revert_vm_snapshots | Success | 194.207
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user blueorangutan commented on the issue: https://github.com/apache/cloudstack/pull/1692 Trillian test result (tid-122) Environment: vmware-60u2 (x2), Advanced Networking Total time taken: 29791 seconds Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1692-t122-vmware-60u2.zip Test completed. 46 look ok, 4 have errors Test | Result | Time (s) --- | --- | --- test_02_revert_vm_snapshots | `Failure` | 90.317 test_01_vpc_site2site_vpn | `Error` | 417.698 test_01_test_vm_volume_snapshot | `Error` | 136.365 test_01_redundant_vpc_site2site_vpn | `Error` | 594.074 test_01_create_vm_snapshots | `Error` | 161.718 test_router_dhcphosts | Success | 106.810 test_releaseIP | Success | 234.113 test_reboot_router | Success | 538.235 test_public_ip_user_account | Success | 10.295 test_public_ip_admin_account | Success | 40.464 test_nic_secondaryip_add_remove | Success | 178.431 test_network_rules_acquired_public_ip_3_Load_Balancer_Rule | Success | 67.306 test_network_rules_acquired_public_ip_2_nat_rule | Success | 61.868 test_network_rules_acquired_public_ip_1_static_nat_rule | Success | 124.449 test_network_acl | Success | 167.082 test_isolate_network_password_server | Success | 92.418 test_extendPhysicalNetworkVlan | Success | 15.379 test_deployvm_userdispersing | Success | 35.895 test_deployvm_userdata_post | Success | 20.951 test_deployvm_userdata | Success | 146.700 test_deployvm_userconcentrated | Success | 71.648 test_deployvm_firstfit | Success | 156.712 test_deploy_vm_multiple | Success | 198.748 test_deploy_vm_from_iso | Success | 405.297 test_deploy_vm | Success | 0.027 test_delete_account | Success | 229.939 test_dedicatePublicIpRange | Success | 0.434 test_dedicateGuestVlanRange | Success | 10.388 test_create_pvlan_network | Success | 5.428 test_createRegion | Success | 0.051 test_createPortablePublicIPRange | Success | 15.414 test_createPortablePublicIPAcquire | Success | 15.553 test_assign_and_removal_lb | Success | 133.586 test_advZoneVirtualRouter | Success | 0.021 test_UpdateStorageOverProvisioningFactor | Success | 0.196 test_UpdateConfigParamWithScope | Success | 0.150 test_DeployVmAntiAffinityGroup_in_project | Success | 232.401 test_DeployVmAntiAffinityGroup | Success | 156.745 test_CreateTemplateWithDuplicateName | Success | 247.272 test_10_destroy_cpvm | Success | 201.938 test_10_attachAndDetach_iso | Success | 27.010 test_09_reboot_router | Success | 116.015 test_09_expunge_vm | Success | 125.234 test_09_destroy_ssvm | Success | 234.433 test_09_delete_detached_volume | Success | 20.886 test_08_start_router | Success | 96.125 test_08_reboot_cpvm | Success | 126.748 test_08_migrate_vm | Success | 51.632 test_08_list_system_templates | Success | 0.046 test_07_stop_router | Success | 25.322 test_07_restore_vm | Success | 0.093 test_07_reboot_ssvm | Success | 128.924 test_07_list_public_templates | Success | 0.053 test_07_list_default_iso | Success | 0.096 test_06_stop_cpvm | Success | 146.840 test_06_router_advanced | Success | 0.051 test_06_download_detached_volume | Success | 50.618 test_06_destroy_vm | Success | 10.217 test_05_template_permissions | Success | 0.100 test_05_stop_ssvm | Success | 208.672 test_05_rvpc_multi_tiers | Success | 448.749 test_05_router_basic | Success | 0.036 test_05_iso_permissions | Success | 0.126 test_05_detach_volume | Success | 100.422 test_04_rvpc_privategw_static_routes | Success | 731.451 test_04_rvpc_network_garbage_collector_nics | Success | 1479.031 test_04_rvpc_internallb_haproxy_stats_on_all_interfaces | Success | 450.772 test_04_restart_network_wo_cleanup | Success | 5.734 test_04_extract_template | Success | 16.399 test_04_extract_Iso | Success | 5.169 test_04_delete_attached_volume | Success | 10.195 test_04_create_fat_type_disk_offering | Success | 0.103 test_04_cpvm_internals | Success | 1.167 test_04_change_offering_small | Success | 116.838 test_03_vpc_privategw_restart_vpc_cleanup | Success | 660.027 test_03_vpc_internallb_haproxy_stats_on_all_interfaces | Success | 365.482 test_03_ssvm_internals | Success | 3.470 test_03_restart_network_cleanup | Success | 116.507 test_03_reboot_vm | Success | 5.249 test_03_download_attached_volume | Success | 15.367 test_03_delete_vm_snapshots | Success | 275.194 test_03_delete_template | Success | 5.174 test_03_delete_service_offering | Success | 0.065 test_03_delete_iso | Success | 95.197 test_03_delete_disk_offering | Success | 0.118 test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers | Success | 601.208 test_03_RVR_Network_check_router_state | Success | 278.639
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user blueorangutan commented on the issue: https://github.com/apache/cloudstack/pull/1692 Trillian test result (tid-119) Environment: kvm-centos7 (x2), Advanced Networking Total time taken: 26964 seconds Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1692-t119-kvm-centos7.zip Test completed. 48 look ok, 1 have errors Test | Result | Time (s) --- | --- | --- test_router_dhcphosts | Success | 271.502 test_releaseIP | Success | 248.106 test_reboot_router | Success | 413.573 test_public_ip_user_account | Success | 10.237 test_public_ip_admin_account | Success | 40.192 test_nic_secondaryip_add_remove | Success | 187.585 test_network_rules_acquired_public_ip_3_Load_Balancer_Rule | Success | 66.740 test_network_rules_acquired_public_ip_2_nat_rule | Success | 61.778 test_network_rules_acquired_public_ip_1_static_nat_rule | Success | 124.201 test_network_acl | Success | 60.819 test_isolate_network_password_server | Success | 56.211 test_extendPhysicalNetworkVlan | Success | 15.236 test_deployvm_userdispersing | Success | 20.395 test_deployvm_userdata_post | Success | 10.301 test_deployvm_userdata | Success | 55.554 test_deployvm_userconcentrated | Success | 20.532 test_deployvm_firstfit | Success | 55.835 test_deploy_vm_multiple | Success | 248.437 test_deploy_vm_from_iso | Success | 202.874 test_deploy_vm | Success | 0.041 test_delete_account | Success | 267.942 test_dedicatePublicIpRange | Success | 0.808 test_dedicateGuestVlanRange | Success | 10.226 test_create_pvlan_network | Success | 5.186 test_createRegion | Success | 0.026 test_createPortablePublicIPRange | Success | 15.274 test_createPortablePublicIPAcquire | Success | 15.323 test_assign_and_removal_lb | Success | 133.388 test_advZoneVirtualRouter | Success | 0.066 test_UpdateStorageOverProvisioningFactor | Success | 0.106 test_UpdateConfigParamWithScope | Success | 0.096 test_DeployVmAntiAffinityGroup_in_project | Success | 96.109 test_DeployVmAntiAffinityGroup | Success | 80.831 test_CreateTemplateWithDuplicateName | Success | 45.460 test_10_destroy_cpvm | Success | 161.393 test_10_attachAndDetach_iso | Success | 26.564 test_09_reboot_router | Success | 30.234 test_09_expunge_vm | Success | 125.235 test_09_destroy_ssvm | Success | 163.675 test_09_delete_detached_volume | Success | 15.507 test_08_start_router | Success | 25.240 test_08_resize_volume | Success | 15.294 test_08_reboot_cpvm | Success | 101.277 test_08_migrate_vm | Success | 36.032 test_08_list_system_templates | Success | 0.021 test_07_stop_router | Success | 10.122 test_07_restore_vm | Success | 0.076 test_07_resize_fail | Success | 20.402 test_07_reboot_ssvm | Success | 103.096 test_07_list_public_templates | Success | 0.025 test_07_list_default_iso | Success | 0.037 test_06_stop_cpvm | Success | 131.513 test_06_router_advanced | Success | 0.035 test_06_download_detached_volume | Success | 15.289 test_06_destroy_vm | Success | 125.713 test_05_template_permissions | Success | 0.041 test_05_stop_ssvm | Success | 133.080 test_05_rvpc_multi_tiers | Success | 522.390 test_05_router_basic | Success | 0.025 test_05_iso_permissions | Success | 0.042 test_05_detach_volume | Success | 100.229 test_04_rvpc_privategw_static_routes | Success | 441.110 test_04_rvpc_network_garbage_collector_nics | Success | 1417.521 test_04_rvpc_internallb_haproxy_stats_on_all_interfaces | Success | 237.815 test_04_restart_network_wo_cleanup | Success | 5.554 test_04_extract_template | Success | 5.163 test_04_extract_Iso | Success | 5.133 test_04_delete_attached_volume | Success | 10.236 test_04_create_fat_type_disk_offering | Success | 0.048 test_04_cpvm_internals | Success | 1.001 test_04_change_offering_small | Success | 204.469 test_03_vpc_privategw_restart_vpc_cleanup | Success | 464.503 test_03_vpc_internallb_haproxy_stats_on_all_interfaces | Success | 183.485 test_03_ssvm_internals | Success | 2.893 test_03_restart_network_cleanup | Success | 50.348 test_03_reboot_vm | Success | 125.811 test_03_download_attached_volume | Success | 15.246 test_03_delete_template | Success | 5.270 test_03_delete_service_offering | Success | 0.027 test_03_delete_iso | Success | 95.175 test_03_delete_disk_offering | Success | 0.027 test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers | Success | 528.423 test_03_RVR_Network_check_router_state | Success | 245.563 test_02_vpc_privategw_static_routes | Success | 349.617 test_02_sys_template_ready | Success | 0.079 test_02_start_vm | Success | 10.137 test_02_routervm_iptables_policies | Success | 197.450 test_02_router_internal_adv |
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user blueorangutan commented on the issue: https://github.com/apache/cloudstack/pull/1692 Packaging result: âcentos6 âcentos7 âdebian. JID-57 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user blueorangutan commented on the issue: https://github.com/apache/cloudstack/pull/1692 Packaging result: âcentos6 âcentos7 âdebian. JID-56 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user rhtyd commented on the issue: https://github.com/apache/cloudstack/pull/1692 While all smoke tests are running okay on kvm, based on recent runs, the outstanding issue seem to be with vpc/vpn and redundant virtual routers in xenserver and vmware based environments: test_privategw_acl.py test_vpc_redundant.py test_vpc_vpn.py --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user blueorangutan commented on the issue: https://github.com/apache/cloudstack/pull/1692 Packaging result: âcentos6 âcentos7 âdebian. JID-55 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user rhtyd commented on the issue: https://github.com/apache/cloudstack/pull/1692 Re-ran failed tests on env `pr1692-t115-kvm-centos7`, all okay (previous failures were due to (1) failed to ssh into vm, (2) ssvm communication failures/timing issue, (3) ): Test | Result | Time (s) --- | --- | --- test_01_vpc_site2site_vpn | Success | 160.807 test_01_vpc_remote_access_vpn | Success | 66.538 test_01_redundant_vpc_site2site_vpn | Success | 322.023 test_CreateTemplateWithDuplicateName | Success | 66.190 test_08_list_system_templates | Success | 0.040 test_07_list_public_templates | Success | 0.040 test_05_template_permissions | Success | 0.062 test_04_extract_template | Success | 5.137 test_03_delete_template | Success | 5.103 test_02_edit_template | Success | 90.073 test_01_create_template | Success | 45.731 test_06_copy_template | Skipped | 0.000 test_09_delete_detached_volume | Success | 15.509 test_08_resize_volume | Success | 15.365 test_07_resize_fail | Success | 20.532 test_06_download_detached_volume | Success | 15.414 test_05_detach_volume | Success | 100.458 test_04_delete_attached_volume | Success | 10.261 test_03_download_attached_volume | Success | 15.330 test_02_attach_volume | Success | 73.887 test_01_create_volume | Success | 712.779 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user blueorangutan commented on the issue: https://github.com/apache/cloudstack/pull/1692 Trillian test result (tid-114) Environment: vmware-55u3 (x2), Advanced Networking Total time taken: 29116 seconds Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1692-t114-vmware-55u3.zip Test completed. 44 look ok, 4 have errors Test | Result | Time (s) --- | --- | --- test_reboot_router | `Error` | 581.281 test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 | `Error` | 771.709 test_01_vpc_site2site_vpn | `Error` | 437.781 test_01_snapshot_root_disk | `Error` | 50.566 test_01_redundant_vpc_site2site_vpn | `Error` | 633.877 test_router_dhcphosts | Success | 161.635 test_releaseIP | Success | 214.175 test_public_ip_user_account | Success | 10.276 test_public_ip_admin_account | Success | 40.301 test_nic_secondaryip_add_remove | Success | 219.404 test_network_rules_acquired_public_ip_3_Load_Balancer_Rule | Success | 67.528 test_network_rules_acquired_public_ip_2_nat_rule | Success | 61.895 test_network_rules_acquired_public_ip_1_static_nat_rule | Success | 125.141 test_network_acl | Success | 182.352 test_isolate_network_password_server | Success | 60.329 test_extendPhysicalNetworkVlan | Success | 15.751 test_deployvm_userdispersing | Success | 45.877 test_deployvm_userdata_post | Success | 46.155 test_deployvm_userdata | Success | 152.063 test_deployvm_userconcentrated | Success | 81.503 test_deployvm_firstfit | Success | 156.783 test_deploy_vm_multiple | Success | 173.505 test_deploy_vm_from_iso | Success | 361.075 test_deploy_vm | Success | 0.029 test_delete_account | Success | 254.340 test_dedicatePublicIpRange | Success | 0.409 test_dedicateGuestVlanRange | Success | 10.298 test_create_pvlan_network | Success | 5.214 test_createRegion | Success | 0.104 test_createPortablePublicIPRange | Success | 15.425 test_createPortablePublicIPAcquire | Success | 15.648 test_assign_and_removal_lb | Success | 133.719 test_advZoneVirtualRouter | Success | 0.022 test_UpdateStorageOverProvisioningFactor | Success | 0.153 test_UpdateConfigParamWithScope | Success | 0.136 test_DeployVmAntiAffinityGroup_in_project | Success | 243.720 test_DeployVmAntiAffinityGroup | Success | 172.454 test_CreateTemplateWithDuplicateName | Success | 176.492 test_10_destroy_cpvm | Success | 242.859 test_10_attachAndDetach_iso | Success | 27.009 test_09_reboot_router | Success | 121.368 test_09_expunge_vm | Success | 125.366 test_09_destroy_ssvm | Success | 203.789 test_09_delete_detached_volume | Success | 26.093 test_08_start_router | Success | 101.031 test_08_reboot_cpvm | Success | 156.704 test_08_migrate_vm | Success | 69.378 test_08_list_system_templates | Success | 0.056 test_07_stop_router | Success | 25.325 test_07_restore_vm | Success | 0.093 test_07_reboot_ssvm | Success | 158.814 test_07_list_public_templates | Success | 0.097 test_07_list_default_iso | Success | 0.083 test_06_stop_cpvm | Success | 207.978 test_06_router_advanced | Success | 0.050 test_06_download_detached_volume | Success | 45.655 test_06_destroy_vm | Success | 10.167 test_05_template_permissions | Success | 0.103 test_05_stop_ssvm | Success | 208.989 test_05_rvpc_multi_tiers | Success | 488.907 test_05_router_basic | Success | 0.036 test_05_iso_permissions | Success | 0.094 test_05_detach_volume | Success | 100.306 test_04_rvpc_privategw_static_routes | Success | 801.800 test_04_rvpc_network_garbage_collector_nics | Success | 1536.900 test_04_rvpc_internallb_haproxy_stats_on_all_interfaces | Success | 480.940 test_04_restart_network_wo_cleanup | Success | 5.651 test_04_extract_template | Success | 10.220 test_04_extract_Iso | Success | 5.194 test_04_delete_attached_volume | Success | 15.395 test_04_create_fat_type_disk_offering | Success | 0.064 test_04_cpvm_internals | Success | 1.224 test_04_change_offering_small | Success | 97.422 test_03_vpc_privategw_restart_vpc_cleanup | Success | 800.427 test_03_vpc_internallb_haproxy_stats_on_all_interfaces | Success | 335.023 test_03_ssvm_internals | Success | 3.763 test_03_restart_network_cleanup | Success | 126.025 test_03_reboot_vm | Success | 5.162 test_03_download_attached_volume | Success | 20.310 test_03_delete_vm_snapshots | Success | 275.161 test_03_delete_template | Success | 5.266 test_03_delete_service_offering | Success | 0.090 test_03_delete_iso | Success | 95.190 test_03_delete_disk_offering | Success | 0.036 test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers | Success | 613.301 test_03_RVR_Network_check_router_state | Success | 338.180
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user blueorangutan commented on the issue: https://github.com/apache/cloudstack/pull/1692 Trillian test result (tid-113) Environment: xenserver-65sp1 (x2), Advanced Networking Total time taken: 25631 seconds Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1692-t113-xenserver-65sp1.zip Test completed. 44 look ok, 4 have errors Test | Result | Time (s) --- | --- | --- test_05_rvpc_multi_tiers | `Failure` | 418.440 test_04_rvpc_privategw_static_routes | `Failure` | 1194.758 test_04_rvpc_network_garbage_collector_nics | `Failure` | 1306.827 test_03_vpc_privategw_restart_vpc_cleanup | `Failure` | 380.830 test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL | `Failure` | 462.823 test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers | `Error` | 2.984 test_02_redundant_VPC_default_routes | `Error` | 440.560 test_02_redundant_VPC_default_routes | `Error` | 437.524 test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 | `Error` | 714.105 ContextSuite context=TestVpcSite2SiteVpn>:setup | `Error` | 0.000 ContextSuite context=TestVpcRemoteAccessVpn>:setup | `Error` | 0.000 ContextSuite context=TestRVPCSite2SiteVpn>:setup | `Error` | 0.000 test_router_dhcphosts | Success | 127.504 test_releaseIP | Success | 228.197 test_reboot_router | Success | 509.285 test_public_ip_user_account | Success | 10.199 test_public_ip_admin_account | Success | 40.197 test_nic_secondaryip_add_remove | Success | 137.302 test_network_rules_acquired_public_ip_3_Load_Balancer_Rule | Success | 71.524 test_network_rules_acquired_public_ip_2_nat_rule | Success | 61.304 test_network_rules_acquired_public_ip_1_static_nat_rule | Success | 91.691 test_network_acl | Success | 146.359 test_isolate_network_password_server | Success | 30.868 test_extendPhysicalNetworkVlan | Success | 15.254 test_deployvm_userdispersing | Success | 50.916 test_deployvm_userdata_post | Success | 20.357 test_deployvm_userdata | Success | 106.086 test_deployvm_userconcentrated | Success | 86.302 test_deployvm_firstfit | Success | 166.328 test_deploy_vm_multiple | Success | 207.652 test_deploy_vm_from_iso | Success | 439.355 test_deploy_vm | Success | 0.021 test_delete_account | Success | 268.297 test_dedicatePublicIpRange | Success | 0.928 test_dedicateGuestVlanRange | Success | 10.253 test_create_pvlan_network | Success | 5.185 test_createRegion | Success | 0.026 test_createPortablePublicIPRange | Success | 15.149 test_createPortablePublicIPAcquire | Success | 15.271 test_assign_and_removal_lb | Success | 138.601 test_advZoneVirtualRouter | Success | 0.018 test_UpdateStorageOverProvisioningFactor | Success | 0.088 test_UpdateConfigParamWithScope | Success | 0.109 test_DeployVmAntiAffinityGroup_in_project | Success | 232.390 test_DeployVmAntiAffinityGroup | Success | 141.336 test_CreateTemplateWithDuplicateName | Success | 90.849 test_10_destroy_cpvm | Success | 196.533 test_10_attachAndDetach_iso | Success | 26.609 test_09_reboot_router | Success | 50.400 test_09_expunge_vm | Success | 125.206 test_09_destroy_ssvm | Success | 229.075 test_09_delete_detached_volume | Success | 15.647 test_08_start_router | Success | 40.329 test_08_resize_volume | Success | 85.665 test_08_reboot_cpvm | Success | 141.843 test_08_migrate_vm | Success | 61.035 test_08_list_system_templates | Success | 0.020 test_07_stop_router | Success | 10.111 test_07_restore_vm | Success | 0.058 test_07_resize_fail | Success | 95.842 test_07_reboot_ssvm | Success | 143.825 test_07_list_public_templates | Success | 0.025 test_07_list_default_iso | Success | 0.045 test_06_stop_cpvm | Success | 166.678 test_06_router_advanced | Success | 0.036 test_06_download_detached_volume | Success | 20.380 test_06_destroy_vm | Success | 10.103 test_05_template_permissions | Success | 0.042 test_05_stop_ssvm | Success | 139.018 test_05_router_basic | Success | 0.024 test_05_iso_permissions | Success | 0.041 test_05_detach_volume | Success | 100.426 test_04_rvpc_internallb_haproxy_stats_on_all_interfaces | Success | 535.029 test_04_restart_network_wo_cleanup | Success | 5.479 test_04_extract_template | Success | 5.130 test_04_extract_Iso | Success | 5.101 test_04_delete_attached_volume | Success | 10.139 test_04_create_fat_type_disk_offering | Success | 0.169 test_04_cpvm_internals | Success | 1.335 test_04_change_offering_small | Success | 86.068 test_03_vpc_internallb_haproxy_stats_on_all_interfaces | Success | 278.293 test_03_ssvm_internals | Success | 3.567 test_03_restart_network_cleanup | Success | 100.638 test_03_reboot_vm | Success | 10.165 test_03_download_attached_volume | Success
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user blueorangutan commented on the issue: https://github.com/apache/cloudstack/pull/1692 Trillian test result (tid-115) Environment: kvm-centos7 (x2), Advanced Networking Total time taken: 23189 seconds Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1692-t115-kvm-centos7.zip Test completed. 45 look ok, 3 have errors Test | Result | Time (s) --- | --- | --- test_06_download_detached_volume | `Error` | 15.298 test_04_extract_template | `Error` | 5.115 test_01_redundant_vpc_site2site_vpn | `Error` | 433.889 test_router_dhcphosts | Success | 241.752 test_releaseIP | Success | 148.162 test_reboot_router | Success | 399.954 test_public_ip_user_account | Success | 10.414 test_public_ip_admin_account | Success | 40.599 test_nic_secondaryip_add_remove | Success | 199.565 test_network_rules_acquired_public_ip_3_Load_Balancer_Rule | Success | 66.949 test_network_rules_acquired_public_ip_2_nat_rule | Success | 61.987 test_network_rules_acquired_public_ip_1_static_nat_rule | Success | 121.102 test_network_acl | Success | 56.503 test_isolate_network_password_server | Success | 89.421 test_extendPhysicalNetworkVlan | Success | 15.373 test_deployvm_userdispersing | Success | 30.988 test_deployvm_userdata_post | Success | 31.030 test_deployvm_userdata | Success | 40.655 test_deployvm_userconcentrated | Success | 20.621 test_deployvm_firstfit | Success | 40.857 test_deploy_vm_multiple | Success | 249.359 test_deploy_vm_from_iso | Success | 355.062 test_deploy_vm | Success | 0.028 test_delete_account | Success | 253.890 test_dedicatePublicIpRange | Success | 0.399 test_dedicateGuestVlanRange | Success | 10.293 test_create_pvlan_network | Success | 5.493 test_createRegion | Success | 0.127 test_createPortablePublicIPRange | Success | 15.213 test_createPortablePublicIPAcquire | Success | 15.543 test_assign_and_removal_lb | Success | 133.672 test_advZoneVirtualRouter | Success | 0.022 test_UpdateStorageOverProvisioningFactor | Success | 0.145 test_UpdateConfigParamWithScope | Success | 0.147 test_DeployVmAntiAffinityGroup_in_project | Success | 76.327 test_DeployVmAntiAffinityGroup | Success | 81.850 test_CreateTemplateWithDuplicateName | Success | 50.660 test_10_destroy_cpvm | Success | 161.493 test_10_attachAndDetach_iso | Success | 26.753 test_09_reboot_router | Success | 35.323 test_09_expunge_vm | Success | 125.651 test_09_destroy_ssvm | Success | 168.317 test_09_delete_detached_volume | Success | 15.613 test_08_start_router | Success | 25.253 test_08_resize_volume | Success | 15.525 test_08_reboot_cpvm | Success | 101.475 test_08_migrate_vm | Success | 51.409 test_08_list_system_templates | Success | 0.066 test_07_stop_router | Success | 10.236 test_07_restore_vm | Success | 0.116 test_07_resize_fail | Success | 20.944 test_07_reboot_ssvm | Success | 103.551 test_07_list_public_templates | Success | 0.055 test_07_list_default_iso | Success | 0.053 test_06_stop_cpvm | Success | 131.773 test_06_router_advanced | Success | 0.106 test_06_destroy_vm | Success | 125.913 test_05_template_permissions | Success | 0.053 test_05_stop_ssvm | Success | 163.898 test_05_rvpc_multi_tiers | Success | 499.708 test_05_router_basic | Success | 0.051 test_05_iso_permissions | Success | 0.061 test_05_detach_volume | Success | 100.316 test_04_rvpc_privategw_static_routes | Success | 437.700 test_04_rvpc_network_garbage_collector_nics | Success | 1425.407 test_04_rvpc_internallb_haproxy_stats_on_all_interfaces | Success | 224.552 test_04_restart_network_wo_cleanup | Success | 5.646 test_04_extract_Iso | Success | 5.192 test_04_delete_attached_volume | Success | 10.227 test_04_create_fat_type_disk_offering | Success | 0.187 test_04_cpvm_internals | Success | 1.130 test_04_change_offering_small | Success | 209.709 test_03_vpc_privategw_restart_vpc_cleanup | Success | 467.025 test_03_vpc_internallb_haproxy_stats_on_all_interfaces | Success | 172.906 test_03_ssvm_internals | Success | 3.575 test_03_restart_network_cleanup | Success | 45.583 test_03_reboot_vm | Success | 126.197 test_03_download_attached_volume | Success | 15.332 test_03_delete_template | Success | 5.201 test_03_delete_service_offering | Success | 0.171 test_03_delete_iso | Success | 95.246 test_03_delete_disk_offering | Success | 0.092 test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers | Success | 541.791 test_03_RVR_Network_check_router_state | Success | 251.491 test_02_vpc_privategw_static_routes | Success | 342.608 test_02_sys_template_ready | Success | 0.157 test_02_start_vm | Success | 10.195
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user blueorangutan commented on the issue: https://github.com/apache/cloudstack/pull/1692 Packaging result: âcentos6 âcentos7 âdebian. JID-50 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user blueorangutan commented on the issue: https://github.com/apache/cloudstack/pull/1692 Packaging result: âcentos6 âcentos7 âdebian. JID-49 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user rhtyd commented on the issue: https://github.com/apache/cloudstack/pull/1692 Re-ran tests in env `pr1692-t108-kvm-centos7`, all pass. The test failures were due to (1) heisenbug and occurred due to issues with the api response lacking a status key when the template/iso is downloaded/transition-phase, a suitable workaround has been added to Marvin's `lib/base.py`; (2) the `test_03_vpc_privategw_restart_vpc_cleanup` failed due to the guest VM's nic not accessible. Test | Result | Time (s) --- | --- | --- test_deploy_vm_from_iso | Success | 386.439 Re-ran tests in env `pr1692-t110-vmware-55u3`, with @murali-reddy 's new fix: --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user PaulAngus commented on the issue: https://github.com/apache/cloudstack/pull/1692 To be accurate the tests failed due to CLOUDSTACK-9529 [3]: Marvin Tests Do Not Clean Up Properly As the environment ran out of public IP addresses VRs to use. This only highlights the importance of tests properly cleaning up after themselves. Kind regards, Paul Angus VP Technology paul.an...@shapeblue.com www.shapeblue.com From: Rohit Yadav [mailto:notificati...@github.com] Sent: 05 October 2016 09:23 To: apache/cloudstack <cloudst...@noreply.github.com> Cc: Paul Angus <paul.an...@shapeblue.com>; Mention <ment...@noreply.github.com> Subject: Re: [apache/cloudstack] Fix Smoke Test Failures (#1692) Tests from xenserver failed due to an environmental issue, I'll rekick another round once outstanding issues are resolved. Tests on kvm failed due to corner case/env specific cleanup/setup issues. Tests on vmware are mostly passing now. â You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub<https://github.com/apache/cloudstack/pull/1692#issuecomment-251612450>, or mute the thread<https://github.com/notifications/unsubscribe-auth/AEll7Eo91vk40NIUCxJK0fhnZwmSbV-xks5qw153gaJpZM4KGZx8>. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user rhtyd commented on the issue: https://github.com/apache/cloudstack/pull/1692 Tests from xenserver failed due to an environmental issue, I'll rekick another round once outstanding issues are resolved. Tests on kvm failed due to corner case/env specific cleanup/setup issues. Tests on vmware are mostly passing now. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user blueorangutan commented on the issue: https://github.com/apache/cloudstack/pull/1692 Trillian test result (tid-110) Environment: vmware-55u3 (x2), Advanced Networking Total time taken: 30353 seconds Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1692-t110-vmware-55u3.zip Test completed. 46 look ok, 2 have errors Test | Result | Time (s) --- | --- | --- test_02_RVR_Network_FW_PF_SSH_default_routes_egress_false | `Failure` | 425.300 test_01_RVR_Network_FW_PF_SSH_default_routes_egress_true | `Failure` | 497.403 ContextSuite context=TestVpcSite2SiteVpn>:setup | `Error` | 204.559 ContextSuite context=TestRVPCSite2SiteVpn>:setup | `Error` | 0.000 test_router_dhcphosts | Success | 150.297 test_releaseIP | Success | 260.413 test_reboot_router | Success | 576.262 test_public_ip_user_account | Success | 10.306 test_public_ip_admin_account | Success | 40.372 test_nic_secondaryip_add_remove | Success | 184.583 test_network_rules_acquired_public_ip_3_Load_Balancer_Rule | Success | 67.214 test_network_rules_acquired_public_ip_2_nat_rule | Success | 62.688 test_network_rules_acquired_public_ip_1_static_nat_rule | Success | 124.456 test_network_acl | Success | 217.609 test_isolate_network_password_server | Success | 92.617 test_extendPhysicalNetworkVlan | Success | 15.388 test_deployvm_userdispersing | Success | 46.123 test_deployvm_userdata_post | Success | 25.573 test_deployvm_userdata | Success | 151.770 test_deployvm_userconcentrated | Success | 86.475 test_deployvm_firstfit | Success | 191.948 test_deploy_vm_multiple | Success | 279.897 test_deploy_vm_from_iso | Success | 410.258 test_deploy_vm | Success | 0.047 test_delete_account | Success | 254.128 test_dedicatePublicIpRange | Success | 0.726 test_dedicateGuestVlanRange | Success | 10.283 test_create_pvlan_network | Success | 5.260 test_createRegion | Success | 0.036 test_createPortablePublicIPRange | Success | 15.259 test_createPortablePublicIPAcquire | Success | 15.773 test_assign_and_removal_lb | Success | 133.670 test_advZoneVirtualRouter | Success | 0.085 test_UpdateStorageOverProvisioningFactor | Success | 0.158 test_UpdateConfigParamWithScope | Success | 0.314 test_DeployVmAntiAffinityGroup_in_project | Success | 354.431 test_DeployVmAntiAffinityGroup | Success | 197.152 test_CreateTemplateWithDuplicateName | Success | 216.891 test_10_destroy_cpvm | Success | 232.052 test_10_attachAndDetach_iso | Success | 27.058 test_09_reboot_router | Success | 166.599 test_09_expunge_vm | Success | 125.262 test_09_destroy_ssvm | Success | 234.508 test_09_delete_detached_volume | Success | 26.157 test_08_start_router | Success | 111.111 test_08_reboot_cpvm | Success | 156.681 test_08_migrate_vm | Success | 71.334 test_08_list_system_templates | Success | 0.032 test_07_stop_router | Success | 20.278 test_07_restore_vm | Success | 0.152 test_07_reboot_ssvm | Success | 158.811 test_07_list_public_templates | Success | 0.040 test_07_list_default_iso | Success | 0.097 test_06_stop_cpvm | Success | 231.941 test_06_router_advanced | Success | 0.051 test_06_download_detached_volume | Success | 60.751 test_06_destroy_vm | Success | 10.160 test_05_template_permissions | Success | 0.060 test_05_stop_ssvm | Success | 214.078 test_05_rvpc_multi_tiers | Success | 539.209 test_05_router_basic | Success | 0.036 test_05_iso_permissions | Success | 0.111 test_05_detach_volume | Success | 100.523 test_04_rvpc_privategw_static_routes | Success | 822.795 test_04_rvpc_network_garbage_collector_nics | Success | 1533.048 test_04_rvpc_internallb_haproxy_stats_on_all_interfaces | Success | 577.640 test_04_restart_network_wo_cleanup | Success | 5.667 test_04_extract_template | Success | 10.273 test_04_extract_Iso | Success | 5.175 test_04_delete_attached_volume | Success | 10.232 test_04_create_fat_type_disk_offering | Success | 0.070 test_04_cpvm_internals | Success | 1.215 test_04_change_offering_small | Success | 97.146 test_03_vpc_privategw_restart_vpc_cleanup | Success | 855.842 test_03_vpc_internallb_haproxy_stats_on_all_interfaces | Success | 360.729 test_03_ssvm_internals | Success | 3.421 test_03_restart_network_cleanup | Success | 191.877 test_03_reboot_vm | Success | 5.163 test_03_download_attached_volume | Success | 15.401 test_03_delete_vm_snapshots | Success | 275.162 test_03_delete_template | Success | 5.105 test_03_delete_service_offering | Success | 0.109 test_03_delete_iso | Success | 95.135 test_03_delete_disk_offering | Success | 0.038 test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers | Success | 642.972
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user blueorangutan commented on the issue: https://github.com/apache/cloudstack/pull/1692 Trillian test result (tid-108) Environment: kvm-centos7 (x2), Advanced Networking Total time taken: 24485 seconds Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1692-t108-kvm-centos7.zip Test completed. 46 look ok, 2 have errors Test | Result | Time (s) --- | --- | --- test_03_vpc_privategw_restart_vpc_cleanup | `Failure` | 866.171 test_deploy_vm_from_iso | `Error` | 102.371 test_router_dhcphosts | Success | 277.976 test_releaseIP | Success | 254.666 test_reboot_router | Success | 396.507 test_public_ip_user_account | Success | 10.294 test_public_ip_admin_account | Success | 40.293 test_nic_secondaryip_add_remove | Success | 209.514 test_network_rules_acquired_public_ip_3_Load_Balancer_Rule | Success | 67.307 test_network_rules_acquired_public_ip_2_nat_rule | Success | 61.928 test_network_rules_acquired_public_ip_1_static_nat_rule | Success | 124.337 test_network_acl | Success | 56.400 test_isolate_network_password_server | Success | 90.758 test_extendPhysicalNetworkVlan | Success | 15.367 test_deployvm_userdispersing | Success | 20.726 test_deployvm_userdata_post | Success | 10.513 test_deployvm_userdata | Success | 71.087 test_deployvm_userconcentrated | Success | 20.767 test_deployvm_firstfit | Success | 60.764 test_deploy_vm_multiple | Success | 238.776 test_deploy_vm | Success | 0.031 test_delete_account | Success | 279.155 test_dedicatePublicIpRange | Success | 0.405 test_dedicateGuestVlanRange | Success | 10.262 test_create_pvlan_network | Success | 5.211 test_createRegion | Success | 0.035 test_createPortablePublicIPRange | Success | 15.295 test_createPortablePublicIPAcquire | Success | 20.676 test_assign_and_removal_lb | Success | 134.007 test_advZoneVirtualRouter | Success | 0.023 test_UpdateStorageOverProvisioningFactor | Success | 0.232 test_UpdateConfigParamWithScope | Success | 0.262 test_DeployVmAntiAffinityGroup_in_project | Success | 136.846 test_DeployVmAntiAffinityGroup | Success | 81.593 test_CreateTemplateWithDuplicateName | Success | 45.547 test_10_destroy_cpvm | Success | 161.758 test_10_attachAndDetach_iso | Success | 16.864 test_09_reboot_router | Success | 35.461 test_09_expunge_vm | Success | 125.316 test_09_destroy_ssvm | Success | 163.839 test_09_delete_detached_volume | Success | 15.609 test_08_start_router | Success | 35.738 test_08_resize_volume | Success | 15.508 test_08_reboot_cpvm | Success | 101.778 test_08_migrate_vm | Success | 41.465 test_08_list_system_templates | Success | 0.028 test_07_stop_router | Success | 10.199 test_07_restore_vm | Success | 0.201 test_07_resize_fail | Success | 20.621 test_07_reboot_ssvm | Success | 163.801 test_07_list_public_templates | Success | 0.037 test_07_list_default_iso | Success | 0.118 test_06_stop_cpvm | Success | 131.767 test_06_router_advanced | Success | 0.068 test_06_download_detached_volume | Success | 15.402 test_06_destroy_vm | Success | 126.021 test_05_template_permissions | Success | 0.058 test_05_stop_ssvm | Success | 138.806 test_05_rvpc_multi_tiers | Success | 507.693 test_05_router_basic | Success | 0.045 test_05_iso_permissions | Success | 0.113 test_05_detach_volume | Success | 100.339 test_04_rvpc_privategw_static_routes | Success | 478.590 test_04_rvpc_network_garbage_collector_nics | Success | 1435.444 test_04_rvpc_internallb_haproxy_stats_on_all_interfaces | Success | 249.029 test_04_restart_network_wo_cleanup | Success | 5.749 test_04_extract_template | Success | 5.166 test_04_extract_Iso | Success | 5.200 test_04_delete_attached_volume | Success | 10.265 test_04_create_fat_type_disk_offering | Success | 0.072 test_04_cpvm_internals | Success | 1.259 test_04_change_offering_small | Success | 209.992 test_03_vpc_internallb_haproxy_stats_on_all_interfaces | Success | 189.379 test_03_ssvm_internals | Success | 3.337 test_03_restart_network_cleanup | Success | 55.641 test_03_reboot_vm | Success | 126.001 test_03_download_attached_volume | Success | 15.419 test_03_delete_template | Success | 5.100 test_03_delete_service_offering | Success | 0.062 test_03_delete_iso | Success | 95.189 test_03_delete_disk_offering | Success | 0.034 test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers | Success | 561.238 test_03_RVR_Network_check_router_state | Success | 258.349 test_02_vpc_privategw_static_routes | Success | 362.568 test_02_sys_template_ready | Success | 0.194 test_02_start_vm | Success | 10.166 test_02_routervm_iptables_policies | Success | 183.161 test_02_router_internal_adv |
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user blueorangutan commented on the issue: https://github.com/apache/cloudstack/pull/1692 Trillian test result (tid-109) Environment: xenserver-65sp1 (x2), Advanced Networking Total time taken: 11075 seconds Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1692-t109-xenserver-65sp1.zip Test completed. 22 look ok, 26 have errors Test | Result | Time (s) --- | --- | --- test_04_rvpc_privategw_static_routes | `Failure` | 410.582 test_03_vpc_privategw_restart_vpc_cleanup | `Failure` | 189.091 test_02_vpc_privategw_static_routes | `Failure` | 199.066 test_01_vpc_site2site_vpn | `Failure` | 10.423 test_01_vpc_remote_access_vpn | `Failure` | 5.259 test_01_redundant_vpc_site2site_vpn | `Failure` | 10.437 test_releaseIP | `Error` | 127.904 test_reboot_router | `Error` | 107.990 test_nic_secondaryip_add_remove | `Error` | 107.742 test_network_acl | `Error` | 122.021 test_deployvm_userdispersing | `Error` | 35.626 test_deployvm_userdata_post | `Error` | 30.567 test_deployvm_userdata | `Error` | 116.340 test_deployvm_userconcentrated | `Error` | 30.609 test_deployvm_firstfit | `Error` | 121.438 test_delete_account | `Error` | 128.016 test_DeployVmAntiAffinityGroup_in_project | `Error` | 162.386 test_DeployVmAntiAffinityGroup | `Error` | 121.721 test_05_rvpc_multi_tiers | `Error` | 12.051 test_04_rvpc_privategw_static_routes | `Error` | 420.837 test_04_rvpc_network_garbage_collector_nics | `Error` | 12.133 test_03_vpc_privategw_restart_vpc_cleanup | `Error` | 199.322 test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers | `Error` | 12.026 test_02_vpc_privategw_static_routes | `Error` | 209.362 test_02_routervm_iptables_policies | `Error` | 111.091 test_02_redundant_VPC_default_routes | `Error` | 12.160 test_02_isolate_network_FW_PF_default_routes_egress_false | `Error` | 101.097 test_02_VPC_default_routes | `Error` | 17.305 test_01_single_VPC_iptables_policies | `Error` | 152.217 test_01_single_VPC_iptables_policies | `Error` | 126.741 test_01_nic | `Error` | 118.266 test_01_isolate_network_FW_PF_default_routes_egress_true | `Error` | 116.361 test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL | `Error` | 17.071 test_01_VPC_nics_after_destroy | `Error` | 11.923 ContextSuite context=TestVolumes>:setup | `Error` | 0.000 ContextSuite context=TestVmSnapshot>:setup | `Error` | 7.068 ContextSuite context=TestVMLifeCycle>:setup | `Error` | 0.000 ContextSuite context=TestTemplates>:setup | `Error` | 0.000 ContextSuite context=TestSnapshotRootDisk>:setup | `Error` | 0.000 ContextSuite context=TestServiceOfferings>:setup | `Error` | 7.475 ContextSuite context=TestScaleVm>:setup | `Error` | 0.000 ContextSuite context=TestRouterServices>:setup | `Error` | 0.000 ContextSuite context=TestRouterRules>:setup | `Error` | 255.752 ContextSuite context=TestRouterDHCPHosts>:setup | `Error` | 0.000 ContextSuite context=TestResetVmOnReboot>:setup | `Error` | 0.000 ContextSuite context=TestPortForwarding>:setup | `Error` | 250.804 ContextSuite context=TestLoadBalance>:setup | `Error` | 0.000 ContextSuite context=TestIsolatedNetworksPasswdServer>:setup | `Error` | 0.000 ContextSuite context=TestDeployVM>:setup | `Error` | 0.000 ContextSuite context=TestCreateVolume>:setup | `Error` | 0.000 test_public_ip_user_account | Success | 10.346 test_public_ip_admin_account | Success | 40.488 test_extendPhysicalNetworkVlan | Success | 15.371 test_deploy_vm_from_iso | Success | 415.469 test_dedicatePublicIpRange | Success | 0.534 test_dedicateGuestVlanRange | Success | 10.391 test_create_pvlan_network | Success | 5.246 test_createRegion | Success | 0.052 test_createPortablePublicIPRange | Success | 15.250 test_createPortablePublicIPAcquire | Success | 15.976 test_UpdateStorageOverProvisioningFactor | Success | 0.156 test_UpdateConfigParamWithScope | Success | 0.223 test_10_destroy_cpvm | Success | 196.771 test_09_destroy_ssvm | Success | 199.291 test_08_reboot_cpvm | Success | 111.559 test_07_reboot_ssvm | Success | 149.973 test_07_list_default_iso | Success | 0.061 test_06_stop_cpvm | Success | 136.764 test_05_stop_ssvm | Success | 138.973 test_05_iso_permissions | Success | 0.075 test_04_rvpc_internallb_haproxy_stats_on_all_interfaces | Success | 435.423 test_04_extract_Iso | Success | 5.162 test_04_create_fat_type_disk_offering | Success | 0.092 test_04_cpvm_internals | Success | 1.105 test_03_vpc_internallb_haproxy_stats_on_all_interfaces | Success | 310.219 test_03_ssvm_internals | Success | 3.505 test_03_delete_iso | Success | 95.252 test_03_delete_disk_offering | Success | 0.049 test_03_RVR_Network_check_router_state | Success |
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user rhtyd commented on the issue: https://github.com/apache/cloudstack/pull/1692 With new changes, I'll kick three trillian env for xenserver, vmware and kvm and see what the test results look like. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user blueorangutan commented on the issue: https://github.com/apache/cloudstack/pull/1692 Packaging result: âcentos6 âcentos7 âdebian. JID-48 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user rhtyd commented on the issue: https://github.com/apache/cloudstack/pull/1692 @serg38 @NuxRo Thanks for your suggestions, I've incorporated those changes and tweaked few failing tests to use macchinina template. One of the causes for failures we've found was that nics on VM fail to come up when default built-in template was used. After applying new fixes, these are the only tests failures seen on `pr1692-t100-xenserver-65sp1-marvin`: (test failures have significantly gone down, the failures are due to nic/IP on the VM not reachable) Test | Result | Time (s) --- | --- | --- test_01_RVR_Network_FW_PF_SSH_default_routes_egress_true | `Failure` | 429.498 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user NuxRo commented on the issue: https://github.com/apache/cloudstack/pull/1692 @serg38 Macchinina is 64bit. In KVM I add it as "Other PV (64bit)", though adding it as CentOS or Debian should also work. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1692 @NuxRo Then 'Other Linux (64-bit)' will be appropriate. It works for the time being as PV with current vmware but could fail at some point. For example when we were testing @rhtyd tiny template it was going into the kernel lock with PV OS type but was working fine when ostype was changed to Linux. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1692 @jburwell @rhtyd @borisstoyanov Do you have to do anything to make test_lb_internal to pass on Vmware? No matter what we try we get 3 exceptions 2016-10-04 07:18:24,897 - CRITICAL - EXCEPTION: execute_internallb_haproxy_tests: ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python2.7/unittest/case.py", line 331, in run\n testMethod()\n', 'TypeError: execute_internallb_haproxy_tests() takes exactly 2 arguments (1 given)\n'] 2016-10-04 07:18:24,898 - CRITICAL - EXCEPTION: execute_internallb_roundrobin_tests: ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python2.7/unittest/case.py", line 331, in run\n testMethod()\n', 'TypeError: execute_internallb_roundrobin_tests() takes exactly 2 arguments (1 given)\n'] 2016-10-04 07:18:24,899 - CRITICAL - EXCEPTION: run_ssh_test_accross_hosts: ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python2.7/unittest/case.py", line 331, in run\n testMethod()\n', 'TypeError: run_ssh_test_accross_hosts() takes at least 3 arguments (1 given)\n'] --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user blueorangutan commented on the issue: https://github.com/apache/cloudstack/pull/1692 Trillian test result (tid-105) Environment: vmware-55u3 (x2), Advanced Networking Total time taken: 30998 seconds Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1692-t105-vmware-55u3.zip Test completed. 43 look ok, 5 have errors Test | Result | Time (s) --- | --- | --- test_02_RVR_Network_FW_PF_SSH_default_routes_egress_false | `Failure` | 376.423 test_01_RVR_Network_FW_PF_SSH_default_routes_egress_true | `Failure` | 370.404 test_08_migrate_vm | `Error` | 50.762 test_06_download_detached_volume | `Error` | 45.382 test_01_vpc_site2site_vpn | `Error` | 415.952 test_01_test_vm_volume_snapshot | `Error` | 131.023 test_01_redundant_vpc_site2site_vpn | `Error` | 637.168 test_router_dhcphosts | Success | 110.784 test_releaseIP | Success | 248.118 test_reboot_router | Success | 614.826 test_public_ip_user_account | Success | 10.208 test_public_ip_admin_account | Success | 40.242 test_nic_secondaryip_add_remove | Success | 207.770 test_network_rules_acquired_public_ip_3_Load_Balancer_Rule | Success | 66.551 test_network_rules_acquired_public_ip_2_nat_rule | Success | 61.572 test_network_rules_acquired_public_ip_1_static_nat_rule | Success | 124.045 test_network_acl | Success | 116.209 test_isolate_network_password_server | Success | 92.171 test_extendPhysicalNetworkVlan | Success | 15.288 test_deployvm_userdispersing | Success | 60.845 test_deployvm_userdata_post | Success | 20.373 test_deployvm_userdata | Success | 131.047 test_deployvm_userconcentrated | Success | 90.977 test_deployvm_firstfit | Success | 166.225 test_deploy_vm_multiple | Success | 172.394 test_deploy_vm_from_iso | Success | 412.569 test_deploy_vm | Success | 0.017 test_delete_account | Success | 222.714 test_dedicatePublicIpRange | Success | 0.407 test_dedicateGuestVlanRange | Success | 10.254 test_create_pvlan_network | Success | 5.195 test_createRegion | Success | 0.029 test_createPortablePublicIPRange | Success | 15.160 test_createPortablePublicIPAcquire | Success | 15.379 test_assign_and_removal_lb | Success | 133.295 test_advZoneVirtualRouter | Success | 0.013 test_UpdateStorageOverProvisioningFactor | Success | 0.132 test_UpdateConfigParamWithScope | Success | 0.145 test_DeployVmAntiAffinityGroup_in_project | Success | 242.462 test_DeployVmAntiAffinityGroup | Success | 206.935 test_CreateTemplateWithDuplicateName | Success | 221.350 test_10_destroy_cpvm | Success | 236.678 test_10_attachAndDetach_iso | Success | 71.666 test_09_reboot_router | Success | 125.726 test_09_expunge_vm | Success | 125.197 test_09_destroy_ssvm | Success | 238.541 test_09_delete_detached_volume | Success | 20.804 test_08_start_router | Success | 110.892 test_08_reboot_cpvm | Success | 156.550 test_08_list_system_templates | Success | 0.016 test_07_stop_router | Success | 25.222 test_07_restore_vm | Success | 0.084 test_07_reboot_ssvm | Success | 158.502 test_07_list_public_templates | Success | 0.020 test_07_list_default_iso | Success | 0.032 test_06_stop_cpvm | Success | 176.663 test_06_router_advanced | Success | 0.043 test_06_destroy_vm | Success | 10.121 test_05_template_permissions | Success | 0.040 test_05_stop_ssvm | Success | 173.725 test_05_rvpc_multi_tiers | Success | 507.090 test_05_router_basic | Success | 0.035 test_05_iso_permissions | Success | 0.039 test_05_detach_volume | Success | 105.284 test_04_rvpc_privategw_static_routes | Success | 827.647 test_04_rvpc_network_garbage_collector_nics | Success | 1568.552 test_04_rvpc_internallb_haproxy_stats_on_all_interfaces | Success | 469.594 test_04_restart_network_wo_cleanup | Success | 5.544 test_04_extract_template | Success | 10.276 test_04_extract_Iso | Success | 5.130 test_04_delete_attached_volume | Success | 15.204 test_04_create_fat_type_disk_offering | Success | 0.058 test_04_cpvm_internals | Success | 1.163 test_04_change_offering_small | Success | 91.867 test_03_vpc_privategw_restart_vpc_cleanup | Success | 878.875 test_03_vpc_internallb_haproxy_stats_on_all_interfaces | Success | 394.072 test_03_ssvm_internals | Success | 3.322 test_03_restart_network_cleanup | Success | 130.955 test_03_reboot_vm | Success | 5.108 test_03_download_attached_volume | Success | 20.266 test_03_delete_vm_snapshots | Success | 275.143 test_03_delete_template | Success | 5.108 test_03_delete_service_offering | Success | 0.031 test_03_delete_iso | Success | 95.107 test_03_delete_disk_offering | Success | 0.031 test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers | Success | 656.715
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1692 I suggest also to change OS type in test_internal_lb.py and test_vpc_vpn for "macchinina vmware" from "ostype": "Other PV (64-bit)", to "ostype": "Other Linux (32-bit)" Macchinina is a Linux so there is no guarantee PV implementation in vmware won't break it at some point if left as it is. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user rhtyd commented on the issue: https://github.com/apache/cloudstack/pull/1692 All tests have passed against CentOS6 environment, though there is a tearDown/cleanup issue with one of the tests (test_vpc_vpn.py) that I'm investigating. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user blueorangutan commented on the issue: https://github.com/apache/cloudstack/pull/1692 Trillian test result (tid-103) Environment: kvm-centos6 (x2), Advanced Networking Total time taken: 26470 seconds Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1692-t103-kvm-centos6.zip Test completed. 47 look ok, 1 have errors Test | Result | Time (s) --- | --- | --- ContextSuite context=TestVpcSite2SiteVpn>:teardown | `Error` | 165.069 test_router_dhcphosts | Success | 291.009 test_releaseIP | Success | 263.955 test_reboot_router | Success | 445.159 test_public_ip_user_account | Success | 10.262 test_public_ip_admin_account | Success | 40.372 test_nic_secondaryip_add_remove | Success | 218.614 test_network_rules_acquired_public_ip_3_Load_Balancer_Rule | Success | 67.216 test_network_rules_acquired_public_ip_2_nat_rule | Success | 61.844 test_network_rules_acquired_public_ip_1_static_nat_rule | Success | 154.464 test_network_acl | Success | 81.311 test_isolate_network_password_server | Success | 92.781 test_extendPhysicalNetworkVlan | Success | 15.311 test_deployvm_userdispersing | Success | 20.720 test_deployvm_userdata_post | Success | 10.496 test_deployvm_userdata | Success | 65.906 test_deployvm_userconcentrated | Success | 35.905 test_deployvm_firstfit | Success | 61.075 test_deploy_vm_multiple | Success | 274.345 test_deploy_vm_from_iso | Success | 374.294 test_deploy_vm | Success | 0.024 test_delete_account | Success | 278.762 test_dedicatePublicIpRange | Success | 0.536 test_dedicateGuestVlanRange | Success | 10.325 test_create_pvlan_network | Success | 5.227 test_createRegion | Success | 0.051 test_createPortablePublicIPRange | Success | 15.216 test_createPortablePublicIPAcquire | Success | 15.493 test_assign_and_removal_lb | Success | 133.783 test_advZoneVirtualRouter | Success | 0.019 test_UpdateStorageOverProvisioningFactor | Success | 0.180 test_UpdateConfigParamWithScope | Success | 0.220 test_DeployVmAntiAffinityGroup_in_project | Success | 111.729 test_DeployVmAntiAffinityGroup | Success | 66.032 test_CreateTemplateWithDuplicateName | Success | 50.945 test_10_destroy_cpvm | Success | 166.831 test_10_attachAndDetach_iso | Success | 71.673 test_09_reboot_router | Success | 35.325 test_09_expunge_vm | Success | 125.245 test_09_destroy_ssvm | Success | 164.214 test_09_delete_detached_volume | Success | 15.550 test_08_start_router | Success | 30.302 test_08_resize_volume | Success | 15.422 test_08_reboot_cpvm | Success | 101.878 test_08_migrate_vm | Success | 40.943 test_08_list_system_templates | Success | 0.029 test_07_stop_router | Success | 10.174 test_07_restore_vm | Success | 0.124 test_07_resize_fail | Success | 20.519 test_07_reboot_ssvm | Success | 134.301 test_07_list_public_templates | Success | 0.029 test_07_list_default_iso | Success | 0.053 test_06_stop_cpvm | Success | 132.089 test_06_router_advanced | Success | 0.042 test_06_download_detached_volume | Success | 15.307 test_06_destroy_vm | Success | 126.490 test_05_template_permissions | Success | 0.065 test_05_stop_ssvm | Success | 134.121 test_05_rvpc_multi_tiers | Success | 501.825 test_05_router_basic | Success | 0.032 test_05_iso_permissions | Success | 0.060 test_05_detach_volume | Success | 100.287 test_04_rvpc_privategw_static_routes | Success | 502.427 test_04_rvpc_network_garbage_collector_nics | Success | 1600.901 test_04_rvpc_internallb_haproxy_stats_on_all_interfaces | Success | 263.793 test_04_restart_network_wo_cleanup | Success | 5.891 test_04_extract_template | Success | 5.180 test_04_extract_Iso | Success | 5.167 test_04_delete_attached_volume | Success | 10.217 test_04_create_fat_type_disk_offering | Success | 0.075 test_04_cpvm_internals | Success | 1.537 test_04_change_offering_small | Success | 240.043 test_03_vpc_privategw_restart_vpc_cleanup | Success | 522.098 test_03_vpc_internallb_haproxy_stats_on_all_interfaces | Success | 193.007 test_03_ssvm_internals | Success | 3.825 test_03_restart_network_cleanup | Success | 60.531 test_03_reboot_vm | Success | 125.861 test_03_download_attached_volume | Success | 15.333 test_03_delete_template | Success | 5.099 test_03_delete_service_offering | Success | 0.100 test_03_delete_iso | Success | 95.216 test_03_delete_disk_offering | Success | 0.041 test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers | Success | 512.755 test_03_RVR_Network_check_router_state | Success | 285.135 test_02_vpc_privategw_static_routes | Success | 397.456 test_02_sys_template_ready | Success | 0.101 test_02_start_vm | Success | 10.165
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user rhtyd commented on the issue: https://github.com/apache/cloudstack/pull/1692 Fixed and re-ran tests on Env `pr1692-t100-xenserver-65sp1-marvin`: Test | Result | Time (s) --- | --- | --- test_03_delete_vm_snapshots | Success | 280.317 test_02_revert_vm_snapshots | Success | 186.515 test_01_create_vm_snapshots | Success | 130.998 test_01_test_vm_volume_snapshot | Skipped | 0.001 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user blueorangutan commented on the issue: https://github.com/apache/cloudstack/pull/1692 @jburwell a Trillian-Jenkins test job (centos6 mgmt + kvm-centos6) has been kicked to run smoke tests --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user jburwell commented on the issue: https://github.com/apache/cloudstack/pull/1692 @blueorangutan test centos6 kvm-centos6 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user jburwell commented on the issue: https://github.com/apache/cloudstack/pull/1692 @serg38 @abhinandanprateek diagnosed the same issue earlier today. Reviewing #871, it is composed of commits fbc2e2e983938e6a16b7e44eb19db9e659b7a570 and 7147627aa2756c21d28560c1d126c2cdc5cfe771 which are in both in the 4.8 branch according to the following `git branch` checks: ``` â cloudstack git:(master) â git branch --contains fbc2e2e983938e6a16b7e44eb19db9e659b7a570 4.8 4.9 jsb/4.8.2.0-version jsb/4.9.1.0-version jsb/maven-parent-version * master â cloudstack git:(master) â git branch --contains 7147627aa2756c21d28560c1d126c2cdc5cfe771 4.8 4.9 jsb/4.8.2.0-version jsb/4.9.1.0-version jsb/maven-parent-version * master ``` Since the `test_01_test_vm_volume_snapshot` continues to fail with this changes from #871 included, it appears we need to do some work on this test case. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user serg38 commented on the issue:
https://github.com/apache/cloudstack/pull/1692
@jburwell Sorry my bad. It is PR 871 . The reason the test fails is:
```
After running test_vm_snapshots.py we're getting exception on
test_01_test_vm_volume_snapshot as it was expected before your changes in this
PR.
We're getting: 'CloudstackAPIException: Execute cmd: createsnapshot failed,
due to: errorCode: 431, errorText:Volume snapshot is not allowed, please detach
it from VM with VM Snapshots\n']
This is consistent with VolumeApiServiceImpl.allocSnapshot method, in which
it is:
if (volume.getInstanceId() != null) {
// Check that Vm to which this volume is attached does not have
VM Snapshots
if (_vmSnapshotDao.findByVm(volume.getInstanceId()).size() > 0)
{
throw new InvalidParameterValueException("Volume snapshot
is not allowed, please detach it from VM with VM Snapshots");
}
}
```
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user jburwell commented on the issue: https://github.com/apache/cloudstack/pull/1692 @serg38 #571 has no Marvin test case changes and fixes the CPVM. How does it address the `test_01_test_vm_volume_snapshot` error? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1692 BTW failure of test_01_test_vm_volume_snapshot is due to PR571 which modified marvin test to succeed against incorrect functionality. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user blueorangutan commented on the issue: https://github.com/apache/cloudstack/pull/1692 Trillian test result (tid-100) Environment: xenserver-65sp1 (x2), Advanced Networking Total time taken: 30113 seconds Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1692-t100-xenserver-65sp1.zip Test completed. 43 look ok, 5 have errors Test | Result | Time (s) --- | --- | --- test_05_rvpc_multi_tiers | `Failure` | 560.613 test_04_rvpc_network_garbage_collector_nics | `Failure` | 1420.469 test_03_vpc_privategw_restart_vpc_cleanup | `Failure` | 689.397 test_02_vpc_privategw_static_routes | `Failure` | 392.860 test_02_RVR_Network_FW_PF_SSH_default_routes_egress_false | `Failure` | 446.690 test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL | `Failure` | 517.580 test_01_RVR_Network_FW_PF_SSH_default_routes_egress_true | `Failure` | 440.841 test_01_test_vm_volume_snapshot | `Error` | 121.233 ContextSuite context=TestVpcRemoteAccessVpn>:teardown | `Error` | 157.028 test_router_dhcphosts | Success | 137.914 test_releaseIP | Success | 264.236 test_reboot_router | Success | 537.166 test_public_ip_user_account | Success | 10.305 test_public_ip_admin_account | Success | 40.807 test_nic_secondaryip_add_remove | Success | 249.124 test_network_rules_acquired_public_ip_3_Load_Balancer_Rule | Success | 71.875 test_network_rules_acquired_public_ip_2_nat_rule | Success | 61.559 test_network_rules_acquired_public_ip_1_static_nat_rule | Success | 92.022 test_network_acl | Success | 161.886 test_isolate_network_password_server | Success | 61.212 test_extendPhysicalNetworkVlan | Success | 15.376 test_deployvm_userdispersing | Success | 91.504 test_deployvm_userdata_post | Success | 15.644 test_deployvm_userdata | Success | 106.238 test_deployvm_userconcentrated | Success | 30.966 test_deployvm_firstfit | Success | 153.922 test_deploy_vm_multiple | Success | 218.580 test_deploy_vm_from_iso | Success | 378.307 test_deploy_vm | Success | 0.027 test_delete_account | Success | 208.596 test_dedicatePublicIpRange | Success | 0.526 test_dedicateGuestVlanRange | Success | 10.347 test_create_pvlan_network | Success | 5.241 test_createRegion | Success | 0.036 test_createPortablePublicIPRange | Success | 15.242 test_createPortablePublicIPAcquire | Success | 15.576 test_assign_and_removal_lb | Success | 149.243 test_advZoneVirtualRouter | Success | 0.021 test_UpdateStorageOverProvisioningFactor | Success | 0.170 test_UpdateConfigParamWithScope | Success | 0.158 test_DeployVmAntiAffinityGroup_in_project | Success | 182.046 test_DeployVmAntiAffinityGroup | Success | 181.965 test_CreateTemplateWithDuplicateName | Success | 80.811 test_10_destroy_cpvm | Success | 196.642 test_10_attachAndDetach_iso | Success | 76.787 test_09_reboot_router | Success | 60.515 test_09_expunge_vm | Success | 125.266 test_09_destroy_ssvm | Success | 203.895 test_09_delete_detached_volume | Success | 20.757 test_08_start_router | Success | 45.463 test_08_resize_volume | Success | 111.107 test_08_reboot_cpvm | Success | 111.583 test_08_migrate_vm | Success | 61.173 test_08_list_system_templates | Success | 0.028 test_07_stop_router | Success | 15.201 test_07_restore_vm | Success | 0.134 test_07_resize_fail | Success | 111.232 test_07_reboot_ssvm | Success | 153.886 test_07_list_public_templates | Success | 0.035 test_07_list_default_iso | Success | 0.058 test_06_stop_cpvm | Success | 166.696 test_06_router_advanced | Success | 0.061 test_06_download_detached_volume | Success | 25.446 test_06_destroy_vm | Success | 10.157 test_05_template_permissions | Success | 0.066 test_05_stop_ssvm | Success | 168.918 test_05_router_basic | Success | 0.040 test_05_iso_permissions | Success | 0.068 test_05_detach_volume | Success | 100.254 test_04_rvpc_privategw_static_routes | Success | 896.132 test_04_rvpc_internallb_haproxy_stats_on_all_interfaces | Success | 465.229 test_04_restart_network_wo_cleanup | Success | 5.532 test_04_extract_template | Success | 5.153 test_04_extract_Iso | Success | 5.223 test_04_delete_attached_volume | Success | 10.220 test_04_create_fat_type_disk_offering | Success | 0.085 test_04_cpvm_internals | Success | 1.167 test_04_change_offering_small | Success | 63.994 test_03_vpc_internallb_haproxy_stats_on_all_interfaces | Success | 329.454 test_03_ssvm_internals | Success | 3.438 test_03_restart_network_cleanup | Success | 115.906 test_03_reboot_vm | Success | 15.214 test_03_download_attached_volume | Success | 15.376 test_03_delete_vm_snapshots | Success | 280.201 test_03_delete_template | Success | 5.117
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user blueorangutan commented on the issue: https://github.com/apache/cloudstack/pull/1692 Trillian test result (tid-98) Environment: vmware-55u3 (x2), Advanced Networking Total time taken: 30313 seconds Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1692-t98-vmware-55u3.zip Test completed. 41 look ok, 7 have errors Test | Result | Time (s) --- | --- | --- test_04_rvpc_privategw_static_routes | `Failure` | 674.889 test_04_rvpc_network_garbage_collector_nics | `Failure` | 449.734 test_03_vpc_privategw_restart_vpc_cleanup | `Failure` | 673.393 test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 | `Failure` | 538.579 test_02_RVR_Network_FW_PF_SSH_default_routes_egress_false | `Failure` | 383.715 test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 | `Failure` | 372.002 test_01_RVR_Network_FW_PF_SSH_default_routes_egress_true | `Failure` | 381.385 test_08_migrate_vm | `Error` | 56.056 test_04_rvpc_internallb_haproxy_stats_on_all_interfaces | `Error` | 412.314 test_03_vpc_internallb_haproxy_stats_on_all_interfaces | `Error` | 321.618 test_02_vpc_privategw_static_routes | `Error` | 474.586 test_01_vpc_site2site_vpn | `Error` | 422.538 test_01_test_vm_volume_snapshot | `Error` | 121.438 test_01_redundant_vpc_site2site_vpn | `Error` | 648.885 test_router_dhcphosts | Success | 154.610 test_releaseIP | Success | 269.285 test_reboot_router | Success | 556.647 test_public_ip_user_account | Success | 10.301 test_public_ip_admin_account | Success | 40.349 test_nic_secondaryip_add_remove | Success | 239.169 test_network_rules_acquired_public_ip_3_Load_Balancer_Rule | Success | 67.627 test_network_rules_acquired_public_ip_2_nat_rule | Success | 61.760 test_network_rules_acquired_public_ip_1_static_nat_rule | Success | 124.902 test_network_acl | Success | 182.207 test_isolate_network_password_server | Success | 59.526 test_extendPhysicalNetworkVlan | Success | 10.613 test_deployvm_userdispersing | Success | 126.629 test_deployvm_userdata_post | Success | 25.504 test_deployvm_userdata | Success | 146.459 test_deployvm_userconcentrated | Success | 56.277 test_deployvm_firstfit | Success | 171.742 test_deploy_vm_multiple | Success | 198.708 test_deploy_vm_from_iso | Success | 393.624 test_deploy_vm | Success | 0.029 test_delete_account | Success | 243.911 test_dedicatePublicIpRange | Success | 0.424 test_dedicateGuestVlanRange | Success | 10.292 test_create_pvlan_network | Success | 5.204 test_createRegion | Success | 0.092 test_createPortablePublicIPRange | Success | 10.283 test_createPortablePublicIPAcquire | Success | 15.530 test_assign_and_removal_lb | Success | 133.543 test_advZoneVirtualRouter | Success | 0.023 test_UpdateStorageOverProvisioningFactor | Success | 0.203 test_UpdateConfigParamWithScope | Success | 0.144 test_DeployVmAntiAffinityGroup_in_project | Success | 267.698 test_DeployVmAntiAffinityGroup | Success | 197.439 test_CreateTemplateWithDuplicateName | Success | 226.983 test_10_destroy_cpvm | Success | 242.181 test_10_attachAndDetach_iso | Success | 71.816 test_09_reboot_router | Success | 156.155 test_09_expunge_vm | Success | 125.231 test_09_destroy_ssvm | Success | 264.169 test_09_delete_detached_volume | Success | 30.919 test_08_start_router | Success | 110.831 test_08_reboot_cpvm | Success | 157.200 test_08_list_system_templates | Success | 0.030 test_07_stop_router | Success | 25.508 test_07_restore_vm | Success | 0.101 test_07_reboot_ssvm | Success | 158.606 test_07_list_public_templates | Success | 0.032 test_07_list_default_iso | Success | 0.063 test_06_stop_cpvm | Success | 177.301 test_06_router_advanced | Success | 0.099 test_06_download_detached_volume | Success | 55.748 test_06_destroy_vm | Success | 10.240 test_05_template_permissions | Success | 0.057 test_05_stop_ssvm | Success | 179.679 test_05_rvpc_multi_tiers | Success | 608.510 test_05_router_basic | Success | 0.084 test_05_iso_permissions | Success | 0.064 test_05_detach_volume | Success | 105.314 test_04_restart_network_wo_cleanup | Success | 5.923 test_04_extract_template | Success | 15.228 test_04_extract_Iso | Success | 5.181 test_04_delete_attached_volume | Success | 15.438 test_04_create_fat_type_disk_offering | Success | 0.061 test_04_cpvm_internals | Success | 1.890 test_04_change_offering_small | Success | 97.482 test_03_ssvm_internals | Success | 4.355 test_03_restart_network_cleanup | Success | 176.610 test_03_reboot_vm | Success | 5.186 test_03_download_attached_volume | Success | 20.364 test_03_delete_vm_snapshots | Success | 275.162 test_03_delete_template | Success | 5.139
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1692 I am LGTM on this now. Thanks @NuxRo @PaulAngus @rhtyd for fixing maccinina template. VPN_VPC and INTERNAL_LB test work for Vmware --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user blueorangutan commented on the issue: https://github.com/apache/cloudstack/pull/1692 Trillian test result (tid-96) Environment: xenserver-65sp1 (x2), Advanced Networking Total time taken: 12351 seconds Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1692-t96-xenserver-65sp1.zip Test completed. 22 look ok, 26 have errors Test | Result | Time (s) --- | --- | --- test_04_rvpc_privategw_static_routes | `Failure` | 375.113 test_03_vpc_privategw_restart_vpc_cleanup | `Failure` | 204.070 test_02_vpc_privategw_static_routes | `Failure` | 204.037 test_01_vpc_site2site_vpn | `Failure` | 10.389 test_01_vpc_remote_access_vpn | `Failure` | 5.204 test_01_redundant_vpc_site2site_vpn | `Failure` | 10.508 test_releaseIP | `Error` | 127.726 test_reboot_router | `Error` | 127.721 test_nic_secondaryip_add_remove | `Error` | 127.739 test_network_acl | `Error` | 121.544 test_deployvm_userdispersing | `Error` | 30.473 test_deployvm_userdata_post | `Error` | 30.565 test_deployvm_userdata | `Error` | 126.759 test_deployvm_userconcentrated | `Error` | 30.468 test_deployvm_firstfit | `Error` | 116.225 test_delete_account | `Error` | 127.768 test_DeployVmAntiAffinityGroup_in_project | `Error` | 126.384 test_DeployVmAntiAffinityGroup | `Error` | 111.126 test_05_rvpc_multi_tiers | `Error` | 11.920 test_04_rvpc_privategw_static_routes | `Error` | 385.340 test_04_rvpc_network_garbage_collector_nics | `Error` | 11.910 test_03_vpc_privategw_restart_vpc_cleanup | `Error` | 214.287 test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers | `Error` | 12.112 test_03_RVR_Network_check_router_state | `Error` | 0.293 test_02_vpc_privategw_static_routes | `Error` | 214.273 test_02_routervm_iptables_policies | `Error` | 126.061 test_02_redundant_VPC_default_routes | `Error` | 11.965 test_02_isolate_network_FW_PF_default_routes_egress_false | `Error` | 111.119 test_02_VPC_default_routes | `Error` | 11.909 test_02_RVR_Network_FW_PF_SSH_default_routes_egress_false | `Error` | 241.136 test_01_test_vm_volume_snapshot | `Error` | 5.322 test_01_single_VPC_iptables_policies | `Error` | 152.069 test_01_single_VPC_iptables_policies | `Error` | 131.683 test_01_nic | `Error` | 118.061 test_01_isolate_network_FW_PF_default_routes_egress_true | `Error` | 116.090 test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL | `Error` | 11.963 test_01_VPC_nics_after_destroy | `Error` | 17.013 test_01_RVR_Network_FW_PF_SSH_default_routes_egress_true | `Error` | 241.746 ContextSuite context=TestVolumes>:setup | `Error` | 0.000 ContextSuite context=TestVmSnapshot>:setup | `Error` | 17.454 ContextSuite context=TestVMLifeCycle>:setup | `Error` | 0.000 ContextSuite context=TestTemplates>:setup | `Error` | 0.000 ContextSuite context=TestSnapshotRootDisk>:setup | `Error` | 0.000 ContextSuite context=TestServiceOfferings>:setup | `Error` | 7.171 ContextSuite context=TestScaleVm>:setup | `Error` | 0.000 ContextSuite context=TestRouterServices>:setup | `Error` | 0.000 ContextSuite context=TestRouterRules>:setup | `Error` | 240.410 ContextSuite context=TestRouterDHCPHosts>:setup | `Error` | 0.000 ContextSuite context=TestResetVmOnReboot>:setup | `Error` | 0.000 ContextSuite context=TestPortForwarding>:setup | `Error` | 255.502 ContextSuite context=TestLoadBalance>:setup | `Error` | 0.000 ContextSuite context=TestIsolatedNetworksPasswdServer>:setup | `Error` | 0.000 ContextSuite context=TestDeployVM>:setup | `Error` | 0.000 ContextSuite context=TestCreateVolume>:setup | `Error` | 0.000 test_public_ip_user_account | Success | 10.277 test_public_ip_admin_account | Success | 40.384 test_extendPhysicalNetworkVlan | Success | 15.334 test_deploy_vm_from_iso | Success | 323.758 test_dedicatePublicIpRange | Success | 0.526 test_dedicateGuestVlanRange | Success | 10.299 test_create_pvlan_network | Success | 5.235 test_createRegion | Success | 0.041 test_createPortablePublicIPRange | Success | 15.217 test_createPortablePublicIPAcquire | Success | 15.487 test_UpdateStorageOverProvisioningFactor | Success | 0.156 test_UpdateConfigParamWithScope | Success | 0.214 test_10_destroy_cpvm | Success | 196.487 test_09_destroy_ssvm | Success | 198.897 test_08_reboot_cpvm | Success | 111.557 test_07_reboot_ssvm | Success | 148.835 test_07_list_default_iso | Success | 0.052 test_06_stop_cpvm | Success | 136.587 test_05_stop_ssvm | Success | 168.845 test_05_iso_permissions | Success | 0.063 test_04_rvpc_internallb_haproxy_stats_on_all_interfaces | Success | 455.064 test_04_extract_Iso | Success | 5.175 test_04_create_fat_type_disk_offering | Success | 0.075 test_04_cpvm_internals | Success |
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user blueorangutan commented on the issue: https://github.com/apache/cloudstack/pull/1692 Trillian test result (tid-91) Environment: kvm-centos7 (x2), Advanced Networking Total time taken: 22521 seconds Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1692-t91-kvm-centos7.zip Test completed. 48 look ok, 1 have errors Test | Result | Time (s) --- | --- | --- test_router_dhcphosts | Success | 277.260 test_releaseIP | Success | 253.181 test_reboot_router | Success | 409.184 test_public_ip_user_account | Success | 10.203 test_public_ip_admin_account | Success | 40.377 test_nic_secondaryip_add_remove | Success | 197.692 test_network_rules_acquired_public_ip_3_Load_Balancer_Rule | Success | 66.760 test_network_rules_acquired_public_ip_2_nat_rule | Success | 61.910 test_network_rules_acquired_public_ip_1_static_nat_rule | Success | 124.158 test_network_acl | Success | 65.880 test_isolate_network_password_server | Success | 89.796 test_extendPhysicalNetworkVlan | Success | 15.229 test_deployvm_userdispersing | Success | 20.533 test_deployvm_userdata_post | Success | 10.490 test_deployvm_userdata | Success | 50.956 test_deployvm_userconcentrated | Success | 20.463 test_deployvm_firstfit | Success | 60.846 test_deploy_vm_multiple | Success | 248.035 test_deploy_vm_from_iso | Success | 433.027 test_deploy_vm | Success | 0.020 test_delete_account | Success | 267.940 test_dedicatePublicIpRange | Success | 0.294 test_dedicateGuestVlanRange | Success | 10.375 test_create_pvlan_network | Success | 5.154 test_createRegion | Success | 0.033 test_createPortablePublicIPRange | Success | 15.210 test_createPortablePublicIPAcquire | Success | 15.446 test_assign_and_removal_lb | Success | 133.908 test_advZoneVirtualRouter | Success | 0.016 test_UpdateStorageOverProvisioningFactor | Success | 0.103 test_UpdateConfigParamWithScope | Success | 0.114 test_DeployVmAntiAffinityGroup_in_project | Success | 126.266 test_DeployVmAntiAffinityGroup | Success | 75.802 test_CreateTemplateWithDuplicateName | Success | 35.368 test_10_destroy_cpvm | Success | 161.551 test_10_attachAndDetach_iso | Success | 71.540 test_09_reboot_router | Success | 35.283 test_09_expunge_vm | Success | 125.118 test_09_destroy_ssvm | Success | 163.940 test_09_delete_detached_volume | Success | 15.380 test_08_start_router | Success | 30.311 test_08_resize_volume | Success | 15.280 test_08_reboot_cpvm | Success | 101.761 test_08_migrate_vm | Success | 40.803 test_08_list_system_templates | Success | 0.033 test_07_stop_router | Success | 10.127 test_07_restore_vm | Success | 0.080 test_07_resize_fail | Success | 15.400 test_07_reboot_ssvm | Success | 103.810 test_07_list_public_templates | Success | 0.038 test_07_list_default_iso | Success | 0.045 test_06_stop_cpvm | Success | 131.566 test_06_router_advanced | Success | 0.040 test_06_download_detached_volume | Success | 15.250 test_06_destroy_vm | Success | 125.818 test_05_template_permissions | Success | 0.115 test_05_stop_ssvm | Success | 163.679 test_05_rvpc_multi_tiers | Success | 438.274 test_05_router_basic | Success | 0.025 test_05_iso_permissions | Success | 0.039 test_05_detach_volume | Success | 100.183 test_04_rvpc_privategw_static_routes | Success | 470.923 test_04_rvpc_network_garbage_collector_nics | Success | 839.940 test_04_rvpc_internallb_haproxy_stats_on_all_interfaces | Success | 267.973 test_04_restart_network_wo_cleanup | Success | 5.718 test_04_extract_template | Success | 5.172 test_04_extract_Iso | Success | 5.348 test_04_delete_attached_volume | Success | 10.224 test_04_create_fat_type_disk_offering | Success | 0.045 test_04_cpvm_internals | Success | 1.296 test_04_change_offering_small | Success | 209.687 test_03_vpc_privategw_restart_vpc_cleanup | Success | 474.958 test_03_vpc_internallb_haproxy_stats_on_all_interfaces | Success | 194.469 test_03_ssvm_internals | Success | 3.400 test_03_restart_network_cleanup | Success | 55.553 test_03_reboot_vm | Success | 125.857 test_03_download_attached_volume | Success | 15.289 test_03_delete_template | Success | 5.076 test_03_delete_service_offering | Success | 0.172 test_03_delete_iso | Success | 95.188 test_03_delete_disk_offering | Success | 0.025 test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers | Success | 457.025 test_03_RVR_Network_check_router_state | Success | 283.029 test_02_vpc_privategw_static_routes | Success | 375.241 test_02_sys_template_ready | Success | 0.214 test_02_start_vm | Success | 10.133 test_02_routervm_iptables_policies | Success | 197.527 test_02_router_internal_adv |
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user NuxRo commented on the issue: https://github.com/apache/cloudstack/pull/1692 Sure, though I may not have the time to do it today, but soon. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user rhtyd commented on the issue: https://github.com/apache/cloudstack/pull/1692 @NuxRo Thanks, I'll test and confirm for xen and kvm in few hours. Can you also update the repo on how anyone can build the templates from source? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user PaulAngus commented on the issue: https://github.com/apache/cloudstack/pull/1692 VMWare LGTM Kind regards, Paul Angus VP Technology paul.an...@shapeblue.com www.shapeblue.com From: NuxRo [mailto:notificati...@github.com] Sent: 03 October 2016 14:11 To: apache/cloudstack <cloudst...@noreply.github.com> Cc: Paul Angus <paul.an...@shapeblue.com>; Mention <ment...@noreply.github.com> Subject: Re: [apache/cloudstack] Fix Smoke Test Failures (#1692) Can you guys let me know if this runs OK on all your HVs? I've rebuilt the kernel http://dl.openvm.eu/cloudstack/macchinina/x86_64/testing/ â You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub<https://github.com/apache/cloudstack/pull/1692#issuecomment-251101576>, or mute the thread<https://github.com/notifications/unsubscribe-auth/AEll7KlDg3CMfNOpQUgIVQv6pN70ochNks5qwP7GgaJpZM4KGZx8>. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user NuxRo commented on the issue: https://github.com/apache/cloudstack/pull/1692 Can you guys let me know if this runs OK on all your HVs? I've rebuilt the kernel http://dl.openvm.eu/cloudstack/macchinina/x86_64/testing/ --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user blueorangutan commented on the issue: https://github.com/apache/cloudstack/pull/1692 Packaging result: âcentos6 âcentos7 âdebian. JID-46 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user rhtyd commented on the issue: https://github.com/apache/cloudstack/pull/1692 Based on today's test runs and fixes, most tests run fine on kvm. At the moment, several fixes were done to several tests to ensure they run on vmware and xenserver as well. I've kicked a new pkg job, the result of which we should get in next 8 hours. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user blueorangutan commented on the issue: https://github.com/apache/cloudstack/pull/1692 Packaging result: âcentos6 âcentos7 âdebian. JID-45 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user blueorangutan commented on the issue: https://github.com/apache/cloudstack/pull/1692 Packaging result: âcentos6 âcentos7 âdebian. JID-44 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user rhtyd commented on the issue: https://github.com/apache/cloudstack/pull/1692 I've tested my TinyLinux templates against vmware, xenserver and kvm and they are working alright. On VMware, the networking worked with the loaded e1000/e1000e kernel module. Wrt failure, an issue was found with env where common.py from Marvin failed to patch correctly causing some test failures. Re-ran the tests manually to get them working: Env: pr1692-t88-kvm-centos7-marvin Test | Result | Time (s) --- | --- | --- test_extendPhysicalNetworkVlan | Success | 15.418 test_dedicateGuestVlanRange | Success | 10.271 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user rhtyd commented on the issue: https://github.com/apache/cloudstack/pull/1692 Thanks @NuxRo --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user blueorangutan commented on the issue: https://github.com/apache/cloudstack/pull/1692 Trillian test result (tid-90) Environment: xenserver-65sp1 (x2), Advanced Networking Total time taken: 29144 seconds Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1692-t90-xenserver-65sp1.zip Test completed. 40 look ok, 8 have errors Test | Result | Time (s) --- | --- | --- test_05_rvpc_multi_tiers | `Failure` | 469.519 test_04_rvpc_privategw_static_routes | `Failure` | 1221.849 test_04_rvpc_network_garbage_collector_nics | `Failure` | 674.420 test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL | `Failure` | 466.911 test_network_rules_acquired_public_ip_3_Load_Balancer_Rule | `Error` | 747.060 test_network_rules_acquired_public_ip_2_nat_rule | `Error` | 740.620 test_network_rules_acquired_public_ip_1_static_nat_rule | `Error` | 738.588 test_extendPhysicalNetworkVlan | `Error` | 0.030 test_01_test_vm_volume_snapshot | `Error` | 126.213 test_01_primary_storage_iscsi | `Error` | 0.096 ContextSuite context=TestDeployvGPUenabledVM>:setup | `Error` | 0.000 ContextSuite context=TestDedicateGuestVlanRange>:setup | `Error` | 0.000 test_router_dhcphosts | Success | 122.488 test_releaseIP | Success | 244.033 test_reboot_router | Success | 510.691 test_public_ip_user_account | Success | 10.350 test_public_ip_admin_account | Success | 40.317 test_nic_secondaryip_add_remove | Success | 133.297 test_network_acl | Success | 156.761 test_isolate_network_password_server | Success | 61.953 test_deployvm_userdispersing | Success | 30.729 test_deployvm_userdata_post | Success | 20.552 test_deployvm_userdata | Success | 101.179 test_deployvm_userconcentrated | Success | 71.017 test_deployvm_firstfit | Success | 146.381 test_deploy_vm_multiple | Success | 188.195 test_deploy_vm_from_iso | Success | 333.430 test_deploy_vm | Success | 0.024 test_delete_account | Success | 198.398 test_dedicatePublicIpRange | Success | 0.502 test_create_pvlan_network | Success | 5.248 test_createRegion | Success | 0.047 test_createPortablePublicIPRange | Success | 15.226 test_createPortablePublicIPAcquire | Success | 15.517 test_assign_and_removal_lb | Success | 133.425 test_advZoneVirtualRouter | Success | 0.020 test_UpdateStorageOverProvisioningFactor | Success | 0.143 test_UpdateConfigParamWithScope | Success | 0.206 test_DeployVmAntiAffinityGroup_in_project | Success | 192.447 test_DeployVmAntiAffinityGroup | Success | 131.617 test_CreateTemplateWithDuplicateName | Success | 80.844 test_10_destroy_cpvm | Success | 196.460 test_10_attachAndDetach_iso | Success | 71.796 test_09_reboot_router | Success | 60.478 test_09_expunge_vm | Success | 125.224 test_09_destroy_ssvm | Success | 198.693 test_09_delete_detached_volume | Success | 20.751 test_08_start_router | Success | 45.420 test_08_resize_volume | Success | 96.015 test_08_reboot_cpvm | Success | 121.641 test_08_migrate_vm | Success | 66.140 test_08_list_system_templates | Success | 0.024 test_07_stop_router | Success | 15.197 test_07_restore_vm | Success | 0.141 test_07_resize_fail | Success | 106.129 test_07_reboot_ssvm | Success | 148.635 test_07_list_public_templates | Success | 0.032 test_07_list_default_iso | Success | 0.063 test_06_stop_cpvm | Success | 166.653 test_06_router_advanced | Success | 0.051 test_06_download_detached_volume | Success | 25.416 test_06_destroy_vm | Success | 10.156 test_05_template_permissions | Success | 0.054 test_05_stop_ssvm | Success | 138.759 test_05_router_basic | Success | 0.033 test_05_iso_permissions | Success | 0.068 test_05_detach_volume | Success | 100.253 test_04_rvpc_internallb_haproxy_stats_on_all_interfaces | Success | 490.866 test_04_restart_network_wo_cleanup | Success | 5.516 test_04_extract_template | Success | 5.183 test_04_extract_Iso | Success | 5.149 test_04_delete_attached_volume | Success | 10.222 test_04_create_fat_type_disk_offering | Success | 0.075 test_04_cpvm_internals | Success | 1.095 test_04_change_offering_small | Success | 63.887 test_03_vpc_privategw_restart_vpc_cleanup | Success | 733.369 test_03_vpc_internallb_haproxy_stats_on_all_interfaces | Success | 308.952 test_03_ssvm_internals | Success | 3.467 test_03_restart_network_cleanup | Success | 115.904 test_03_reboot_vm | Success | 15.203 test_03_download_attached_volume | Success | 15.366 test_03_delete_vm_snapshots | Success | 280.275 test_03_delete_template | Success | 5.118 test_03_delete_service_offering | Success | 0.038 test_03_delete_iso | Success | 95.137 test_03_delete_disk_offering | Success | 0.043
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user NuxRo commented on the issue: https://github.com/apache/cloudstack/pull/1692 Hi guys, sorry this has caught me in my holidays so no ability to do anything about it. In the following week I'll work on a new minimal kernel with improved support for VMware stuff. I'll try to make the process of building Macchinina more open so everyone can modify stuf, it's based on BuildRoot.org, no great mystery there. Also I'll have a look at TinyCore or Alpine; it's something I meant to do for a long time since people asked for more features (ipsec), but meh.. time. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user rhtyd commented on the issue: https://github.com/apache/cloudstack/pull/1692 @jburwell based on the latest result results, the errors have significantly gone down. We will still need to re-investigate some of the error (which I thought were fixed, but still failed). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
