blueorangutan commented on issue #2018: CLOUDSTACK-9848: Added exit status checking for the iptables commands URL: https://github.com/apache/cloudstack/pull/2018#issuecomment-299279867 <b>Trillian test result (tid-1056)</b> Environment: vmware-55u3 (x2), Advanced Networking with Mgmt server 7 Total time taken: 47514 seconds Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr2018-t1056-vmware-55u3.zip Intermitten failure detected: /marvin/tests/smoke/test_deploy_virtio_scsi_vm.py Intermitten failure detected: /marvin/tests/smoke/test_internal_lb.py Intermitten failure detected: /marvin/tests/smoke/test_loadbalance.py Intermitten failure detected: /marvin/tests/smoke/test_network_acl.py Intermitten failure detected: /marvin/tests/smoke/test_network.py Intermitten failure detected: /marvin/tests/smoke/test_privategw_acl.py Intermitten failure detected: /marvin/tests/smoke/test_router_dhcphosts.py Intermitten failure detected: /marvin/tests/smoke/test_routers_iptables_default_policy.py Intermitten failure detected: /marvin/tests/smoke/test_routers_network_ops.py Intermitten failure detected: /marvin/tests/smoke/test_vpc_redundant.py Intermitten failure detected: /marvin/tests/smoke/test_vpc_router_nics.py Intermitten failure detected: /marvin/tests/smoke/test_vpc_vpn.py Test completed. 43 look ok, 8 have error(s) Test | Result | Time (s) | Test File --- | --- | --- | --- test_01_vpc_site2site_vpn | `Failure` | 347.95 | test_vpc_vpn.py test_01_redundant_vpc_site2site_vpn | `Failure` | 246.74 | test_vpc_vpn.py test_05_rvpc_multi_tiers | `Failure` | 546.33 | test_vpc_redundant.py test_04_rvpc_network_garbage_collector_nics | `Failure` | 284.05 | test_vpc_redundant.py test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers | `Failure` | 319.56 | test_vpc_redundant.py test_04_rvpc_privategw_static_routes | `Failure` | 121.68 | test_privategw_acl.py test_03_vpc_privategw_restart_vpc_cleanup | `Failure` | 116.56 | test_privategw_acl.py test_02_vpc_privategw_static_routes | `Failure` | 510.23 | test_privategw_acl.py test_01_vpc_privategw_acl | `Failure` | 207.79 | test_privategw_acl.py test_01_vpc_remote_access_vpn | `Error` | 236.92 | test_vpc_vpn.py ContextSuite context=TestVpcSite2SiteVpn>:teardown | `Error` | 373.36 | test_vpc_vpn.py test_02_VPC_default_routes | `Error` | 228.28 | test_vpc_router_nics.py test_01_VPC_nics_after_destroy | `Error` | 349.19 | test_vpc_router_nics.py test_05_rvpc_multi_tiers | `Error` | 637.44 | test_vpc_redundant.py test_02_redundant_VPC_default_routes | `Error` | 237.36 | test_vpc_redundant.py test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL | `Error` | 111.57 | test_vpc_redundant.py test_02_vpc_privategw_static_routes | `Error` | 540.62 | test_privategw_acl.py test_01_vpc_privategw_acl | `Error` | 218.00 | test_privategw_acl.py test_releaseIP | `Error` | 197.62 | test_network.py test_assign_and_removal_lb | `Error` | 5.19 | test_loadbalance.py test_02_create_lb_rule_non_nat | `Error` | 5.14 | test_loadbalance.py test_04_rvpc_internallb_haproxy_stats_on_all_interfaces | `Error` | 307.69 | test_internal_lb.py test_04_rvpc_internallb_haproxy_stats_on_all_interfaces | `Error` | 312.79 | test_internal_lb.py test_03_vpc_internallb_haproxy_stats_on_all_interfaces | `Error` | 176.97 | test_internal_lb.py test_03_vpc_internallb_haproxy_stats_on_all_interfaces | `Error` | 182.07 | test_internal_lb.py test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 | `Error` | 328.20 | test_internal_lb.py test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 | `Error` | 338.42 | test_internal_lb.py test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 | `Error` | 187.22 | test_internal_lb.py test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 | `Error` | 197.45 | test_internal_lb.py test_06_verify_guest_lspci_again | `Error` | 0.00 | test_deploy_virtio_scsi_vm.py test_05_change_vm_ostype_restart | `Error` | 0.00 | test_deploy_virtio_scsi_vm.py test_04_verify_guest_lspci | `Error` | 0.00 | test_deploy_virtio_scsi_vm.py test_03_verify_libvirt_attach_disk | `Error` | 0.00 | test_deploy_virtio_scsi_vm.py test_02_verify_libvirt_after_restart | `Error` | 0.00 | test_deploy_virtio_scsi_vm.py test_01_verify_libvirt | `Error` | 0.00 | test_deploy_virtio_scsi_vm.py ContextSuite context=TestDeployVirtioSCSIVM>:teardown | `Error` | 0.00 | test_deploy_virtio_scsi_vm.py test_09_delete_detached_volume | Success | 31.00 | test_volumes.py test_06_download_detached_volume | Success | 110.86 | test_volumes.py test_05_detach_volume | Success | 100.25 | test_volumes.py test_04_delete_attached_volume | Success | 15.25 | test_volumes.py test_03_download_attached_volume | Success | 25.37 | test_volumes.py test_02_attach_volume | Success | 64.08 | test_volumes.py test_01_create_volume | Success | 515.69 | test_volumes.py test_change_service_offering_for_vm_with_snapshots | Success | 592.35 | test_vm_snapshots.py test_03_delete_vm_snapshots | Success | 275.22 | test_vm_snapshots.py test_02_revert_vm_snapshots | Success | 227.28 | test_vm_snapshots.py test_01_create_vm_snapshots | Success | 161.69 | test_vm_snapshots.py test_deploy_vm_multiple | Success | 318.02 | test_vm_life_cycle.py test_deploy_vm | Success | 0.03 | test_vm_life_cycle.py test_advZoneVirtualRouter | Success | 0.02 | test_vm_life_cycle.py test_10_attachAndDetach_iso | Success | 26.93 | test_vm_life_cycle.py test_09_expunge_vm | Success | 125.25 | test_vm_life_cycle.py test_08_migrate_vm | Success | 66.06 | test_vm_life_cycle.py test_07_restore_vm | Success | 0.10 | test_vm_life_cycle.py test_06_destroy_vm | Success | 10.16 | test_vm_life_cycle.py test_03_reboot_vm | Success | 5.15 | test_vm_life_cycle.py test_02_start_vm | Success | 25.28 | test_vm_life_cycle.py test_01_stop_vm | Success | 10.16 | test_vm_life_cycle.py test_CreateTemplateWithDuplicateName | Success | 347.26 | test_templates.py test_08_list_system_templates | Success | 0.04 | test_templates.py test_07_list_public_templates | Success | 0.05 | test_templates.py test_05_template_permissions | Success | 0.06 | test_templates.py test_04_extract_template | Success | 15.27 | test_templates.py test_03_delete_template | Success | 5.11 | test_templates.py test_02_edit_template | Success | 90.14 | test_templates.py test_01_create_template | Success | 211.41 | test_templates.py test_10_destroy_cpvm | Success | 266.98 | test_ssvm.py test_09_destroy_ssvm | Success | 268.91 | test_ssvm.py test_08_reboot_cpvm | Success | 186.59 | test_ssvm.py test_07_reboot_ssvm | Success | 158.56 | test_ssvm.py test_06_stop_cpvm | Success | 237.05 | test_ssvm.py test_05_stop_ssvm | Success | 274.23 | test_ssvm.py test_04_cpvm_internals | Success | 1.22 | test_ssvm.py test_03_ssvm_internals | Success | 3.76 | test_ssvm.py test_02_list_cpvm_vm | Success | 0.13 | test_ssvm.py test_01_list_sec_storage_vm | Success | 0.14 | test_ssvm.py test_02_list_snapshots_with_removed_data_store | Success | 262.94 | test_snapshots.py test_01_snapshot_root_disk | Success | 36.32 | test_snapshots.py test_04_change_offering_small | Success | 97.08 | test_service_offerings.py test_03_delete_service_offering | Success | 0.04 | test_service_offerings.py test_02_edit_service_offering | Success | 0.08 | test_service_offerings.py test_01_create_service_offering | Success | 0.12 | test_service_offerings.py test_02_sys_template_ready | Success | 0.14 | test_secondary_storage.py test_01_sys_vm_start | Success | 0.19 | test_secondary_storage.py test_09_reboot_router | Success | 156.03 | test_routers.py test_08_start_router | Success | 135.94 | test_routers.py test_07_stop_router | Success | 20.21 | test_routers.py test_06_router_advanced | Success | 0.06 | test_routers.py test_05_router_basic | Success | 0.04 | test_routers.py test_04_restart_network_wo_cleanup | Success | 5.66 | test_routers.py test_03_restart_network_cleanup | Success | 186.39 | test_routers.py test_02_router_internal_adv | Success | 1.10 | test_routers.py test_01_router_internal_basic | Success | 0.59 | test_routers.py test_router_dns_guestipquery | Success | 76.79 | test_router_dns.py test_router_dns_externalipquery | Success | 0.07 | test_router_dns.py test_router_dhcphosts | Success | 143.97 | test_router_dhcphosts.py test_router_dhcp_opts | Success | 21.77 | test_router_dhcphosts.py test_01_updatevolumedetail | Success | 0.17 | test_resource_detail.py test_01_reset_vm_on_reboot | Success | 85.71 | test_reset_vm_on_reboot.py test_createRegion | Success | 0.05 | test_regions.py test_create_pvlan_network | Success | 5.23 | test_pvlan.py test_dedicatePublicIpRange | Success | 0.42 | test_public_ip_range.py test_03_migration_options_storage_tags | Success | 36.74 | test_primary_storage.py test_02_edit_primary_storage_tags | Success | 0.10 | test_primary_storage.py test_01_primary_storage_nfs | Success | 36.76 | test_primary_storage.py test_01_deploy_vms_storage_tags | Success | 46.79 | test_primary_storage.py test_createPortablePublicIPRange | Success | 15.19 | test_portable_publicip.py test_createPortablePublicIPAcquire | Success | 15.52 | test_portable_publicip.py test_isolate_network_password_server | Success | 89.31 | test_password_server.py test_UpdateStorageOverProvisioningFactor | Success | 0.13 | test_over_provisioning.py test_oobm_zchange_password | Success | 30.74 | test_outofbandmanagement.py test_oobm_multiple_mgmt_server_ownership | Success | 16.36 | test_outofbandmanagement.py test_oobm_issue_power_status | Success | 10.28 | test_outofbandmanagement.py test_oobm_issue_power_soft | Success | 10.31 | test_outofbandmanagement.py test_oobm_issue_power_reset | Success | 15.41 | test_outofbandmanagement.py test_oobm_issue_power_on | Success | 15.35 | test_outofbandmanagement.py test_oobm_issue_power_off | Success | 15.38 | test_outofbandmanagement.py test_oobm_issue_power_cycle | Success | 15.34 | test_outofbandmanagement.py test_oobm_enabledisable_across_clusterzones | Success | 82.69 | test_outofbandmanagement.py test_oobm_enable_feature_valid | Success | 5.17 | test_outofbandmanagement.py test_oobm_enable_feature_invalid | Success | 0.10 | test_outofbandmanagement.py test_oobm_disable_feature_valid | Success | 0.16 | test_outofbandmanagement.py test_oobm_disable_feature_invalid | Success | 0.17 | test_outofbandmanagement.py test_oobm_configure_invalid_driver | Success | 0.07 | test_outofbandmanagement.py test_oobm_configure_default_driver | Success | 0.08 | test_outofbandmanagement.py test_oobm_background_powerstate_sync | Success | 23.43 | test_outofbandmanagement.py test_extendPhysicalNetworkVlan | Success | 15.31 | test_non_contigiousvlan.py test_01_nic | Success | 540.26 | test_nic.py test_reboot_router | Success | 680.20 | test_network.py test_public_ip_user_account | Success | 10.44 | test_network.py test_public_ip_admin_account | Success | 40.34 | test_network.py test_network_rules_acquired_public_ip_3_Load_Balancer_Rule | Success | 76.91 | test_network.py test_network_rules_acquired_public_ip_2_nat_rule | Success | 61.73 | test_network.py test_network_rules_acquired_public_ip_1_static_nat_rule | Success | 124.82 | test_network.py test_delete_account | Success | 318.14 | test_network.py test_02_port_fwd_on_non_src_nat | Success | 55.70 | test_network.py test_01_port_fwd_on_src_nat | Success | 111.80 | test_network.py test_nested_virtualization_vmware | Success | 379.06 | test_nested_virtualization.py test_nic_secondaryip_add_remove | Success | 273.29 | test_multipleips_per_nic.py test_list_zones_metrics | Success | 0.31 | test_metrics_api.py test_list_volumes_metrics | Success | 0.54 | test_metrics_api.py test_list_vms_metrics | Success | 418.16 | test_metrics_api.py test_list_pstorage_metrics | Success | 0.36 | test_metrics_api.py test_list_infrastructure_metrics | Success | 0.40 | test_metrics_api.py test_list_hosts_metrics | Success | 0.50 | test_metrics_api.py test_list_clusters_metrics | Success | 0.36 | test_metrics_api.py login_test_saml_user | Success | 19.53 | test_login.py test_01_create_lb_rule_src_nat | Success | 207.94 | test_loadbalance.py test_03_list_snapshots | Success | 0.08 | test_list_ids_parameter.py test_02_list_templates | Success | 0.04 | test_list_ids_parameter.py test_01_list_volumes | Success | 0.03 | test_list_ids_parameter.py test_07_list_default_iso | Success | 0.07 | test_iso.py test_05_iso_permissions | Success | 0.06 | test_iso.py test_04_extract_Iso | Success | 5.20 | test_iso.py test_03_delete_iso | Success | 95.18 | test_iso.py test_02_edit_iso | Success | 0.06 | test_iso.py test_01_create_iso | Success | 21.07 | test_iso.py test_dedicateGuestVlanRange | Success | 10.30 | test_guest_vlan_range.py test_UpdateConfigParamWithScope | Success | 0.14 | test_global_settings.py test_rolepermission_lifecycle_update | Success | 6.21 | test_dynamicroles.py test_rolepermission_lifecycle_list | Success | 6.01 | test_dynamicroles.py test_rolepermission_lifecycle_delete | Success | 5.88 | test_dynamicroles.py test_rolepermission_lifecycle_create | Success | 5.92 | test_dynamicroles.py test_rolepermission_lifecycle_concurrent_updates | Success | 6.12 | test_dynamicroles.py test_role_lifecycle_update_role_inuse | Success | 5.92 | test_dynamicroles.py test_role_lifecycle_update | Success | 5.99 | test_dynamicroles.py test_role_lifecycle_list | Success | 5.92 | test_dynamicroles.py test_role_lifecycle_delete | Success | 10.97 | test_dynamicroles.py test_role_lifecycle_create | Success | 5.92 | test_dynamicroles.py test_role_inuse_deletion | Success | 5.91 | test_dynamicroles.py test_role_account_acls_multiple_mgmt_servers | Success | 8.19 | test_dynamicroles.py test_role_account_acls | Success | 8.41 | test_dynamicroles.py test_default_role_deletion | Success | 6.08 | test_dynamicroles.py test_04_create_fat_type_disk_offering | Success | 0.08 | test_disk_offerings.py test_03_delete_disk_offering | Success | 0.05 | test_disk_offerings.py test_02_edit_disk_offering | Success | 0.09 | test_disk_offerings.py test_02_create_sparse_type_disk_offering | Success | 0.14 | test_disk_offerings.py test_01_create_disk_offering | Success | 0.11 | test_disk_offerings.py test_deployvm_userdispersing | Success | 131.53 | test_deploy_vms_with_varied_deploymentplanners.py test_deployvm_userconcentrated | Success | 60.88 | test_deploy_vms_with_varied_deploymentplanners.py test_deployvm_firstfit | Success | 231.93 | test_deploy_vms_with_varied_deploymentplanners.py test_deployvm_userdata_post | Success | 35.80 | test_deploy_vm_with_userdata.py test_deployvm_userdata | Success | 171.53 | test_deploy_vm_with_userdata.py test_02_deploy_vm_root_resize | Success | 5.92 | test_deploy_vm_root_resize.py test_01_deploy_vm_root_resize | Success | 5.95 | test_deploy_vm_root_resize.py test_00_deploy_vm_root_resize | Success | 6.03 | test_deploy_vm_root_resize.py test_deploy_vm_from_iso | Success | 227.78 | test_deploy_vm_iso.py test_3d_gpu_support | Success | 505.44 | test_deploy_vgpu_enabled_vm.py test_DeployVmAntiAffinityGroup | Success | 287.41 | test_affinity_groups.py test_08_resize_volume | Skipped | 10.14 | test_volumes.py test_07_resize_fail | Skipped | 10.33 | test_volumes.py test_06_copy_template | Skipped | 0.00 | test_templates.py test_static_role_account_acls | Skipped | 0.03 | test_staticroles.py test_11_ss_nfs_version_on_ssvm | Skipped | 0.02 | test_ssvm.py test_01_scale_vm | Skipped | 66.36 | test_scale_vm.py test_01_primary_storage_iscsi | Skipped | 0.04 | test_primary_storage.py test_06_copy_iso | Skipped | 0.00 | test_iso.py test_deploy_vgpu_enabled_vm | Skipped | 1.16 | test_deploy_vgpu_enabled_vm.py ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
With regards, Apache Git Services
