Github user cloudmonger commented on the issue:
https://github.com/apache/cloudstack/pull/1908
### ACS CI BVT Run
**Sumarry:**
Build Number 3
Hypervisor xenserver
NetworkType Advanced
Passed=623
Failed=290
Skipped=58
_Link to logs Folder (search by build_no):_
https://www.dropbox.com/sh/yj3wnzbceo9uef2/AAB6u-Iap-xztdm6jHX9SjPja?dl=0
**Failed tests:**
* test_dhcp_dns_offload.py
* ContextSuite context=TestDeployVMs>:setup Failed
* test_affinity_groups_projects.py
* test_01_deploy_vm_anti_affinity_group Failed
* test_02_deploy_vm_anti_affinity_group_fail_on_not_enough_hosts Failed
* test_01_list_aff_grps_for_vm Failed
* test_02_list_multiple_aff_grps_for_vm Failed
* test_01_update_aff_grp_by_ids Failed
* test_ps_domain_limits.py
* test_04_create_template_snapshot Failed
* test_ss_domain_limits.py
* test_04_create_template_delete_account Failed
* test_04_create_template_delete_account Failing since 2 runs
* test_01_multiple_domains_secondary_storage_limits Failed
* test_01_multiple_domains_secondary_storage_limits Failing since 2 runs
* test_02_multiple_domains_secondary_storage_counts Failed
* test_deploy_vm_userdata_multi_nic.py
* test_deployvm_multinic Failed
* test_vpn_service.py
* test_01_VPN_service Failed
* test_organization_states.py
* ContextSuite context=TestOrganizationStates>:setup Failed
* test_escalations_snapshots.py
* ContextSuite context=TestSnapshots>:setup Failed
* test_dynamic_compute_offering.py
* test_max_account_memory_scale_VM_1_ADMIN_ACCOUNT Failed
* test_max_account_memory_scale_VM_2_USER_ACCOUNT Failed
* test_deploy_VM_with_affinity_group_1_ADMIN_ACCOUNT Failed
* test_deploy_VM_with_affinity_group_2_USER_ACCOUNT Failed
* ContextSuite context=TestDynamicServiceOffering>:setup Failed
* test_change_so_running_vm_dynamic_to_dynamic_1_ADMIN_ACCOUNT Failed
* test_change_so_running_vm_dynamic_to_dynamic_2_USER_ACCOUNT Failed
* test_change_so_running_vm_dynamic_to_static_1_ADMIN_ACCOUNT Failed
* test_change_so_running_vm_dynamic_to_static_2_USER_ACCOUNT Failed
* test_change_so_running_vm_static_to_dynamic_1_ADMIN_ACCOUNT Failed
* test_change_so_running_vm_static_to_dynamic_2_USER_ACCOUNT Failed
* test_change_so_running_vm_static_to_static_1_ADMIN_ACCOUNT Failed
* test_change_so_running_vm_static_to_static_2_USER_ACCOUNT Failed
* test_change_so_stopped_vm_dynamic_to_dynamic_1_ADMIN_ACCOUNT Failed
* test_change_so_stopped_vm_dynamic_to_dynamic_2_USER_ACCOUNT Failed
* test_change_so_stopped_vm_dynamic_to_static_1_ADMIN_ACCOUNT Failed
* test_change_so_stopped_vm_dynamic_to_static_2_USER_ACCOUNT Failed
* test_change_so_stopped_vm_static_to_dynamic_1_ADMIN_ACCOUNT Failed
* test_change_so_stopped_vm_static_to_dynamic_2_USER_ACCOUNT Failed
* test_change_so_stopped_vm_static_to_static_1_ADMIN_ACCOUNT Failed
* test_ps_resource_limits_volume.py
* test_attach_volume_exceeding_primary_limits Failed
* test_vpc.py
* test_07_restart_network_vm_running Failed
* test_08_delete_vpc Failed
* test_11_deploy_vm_wo_network_netdomain Failed
* test_13_deploy_vm_with_vpc_netdomain Failed
* test_14_deploy_vm_1 Failed
* test_15_deploy_vm_2 Failed
* test_16_deploy_vm_for_user_by_admin Failed
* test_21_deploy_vm_with_gateway_ip Failed
* test_22_vpn_customer_gw_with_hostname Failed
* test_non_contiguous_vlan.py
* test_01_add_non_contiguous_ranges Failed
* test_project_usage.py
* ContextSuite context=TestLBRuleUsage>:setup Failed
* ContextSuite context=TestNatRuleUsage>:setup Failed
* ContextSuite context=TestPublicIPUsage>:setup Failed
* ContextSuite context=TestSnapshotUsage>:setup Failed
* ContextSuite context=TestVmUsage>:setup Failed
* ContextSuite context=TestVolumeUsage>:setup Failed
* ContextSuite context=TestVpnUsage>:setup Failed
* test_ps_max_limits.py
* test_01_deploy_vm_domain_limit_reached Failed
* test_02_deploy_vm_account_limit_reached Failed
* test_03_deploy_vm_project_limit_reached Failed
* test_project_resources.py
* test_07_associate_public_ip Failed
* test_vpc_network_staticnatrule.py
* test_01_VPC_StaticNatRuleCreateStoppedState Failed
* test_03_VPC_StopCreateMultipleStaticNatRuleStopppedState Failed
* test_04_VPC_CreateMultipleStaticNatRule Failed
* test_05_network_services_VPC_DeleteAllPF Failed
* test_06_network_services_VPC_DeleteAllMultiplePF Failed
* test_redundant_router_services.py
* test_enableVPNOverRvR Failed
* test_resource_limits.py
* test_01_vm_per_account Failed
* test_02_publicip_per_account Failed
* test_03_snapshots_per_account Failed
* test_04_volumes_per_account Failed
* test_05_templates_per_account Failed
* test_escalations_vpncustomergateways.py
* test_01_list_vpncustomergateways_pagination Failed
* test_02_update_vpncustomergateways Failed
* test_multiple_public_interfaces.py
* test_iptable_rules Failed
* ContextSuite context=TestPortForwarding>:setup Failing since 8 runs
* ContextSuite context=TestRouting>:setup Failed
* ContextSuite context=TestStaticNat>:setup Failed
* test_network_services_VPC_CreatePF Failed
* test_network_services_VPC_CreatePF Failing since 2 runs
* test_cpu_project_limits.py
* test_01_project_counts_start_stop_instance Failed
* test_02_project_counts_migrate_instance Failed
* test_03_project_counts_delete_instance Failed
* test_routers.py
* test_01_RouterStopCreateFW Failed
* test_overcommit.py
* test_01_cluster_settings Failed
* test_02_Overcommit_factor Failed
* test_03_cluste_capacity_check Failed
* test_04_zone_capacity_check Failed
* test_custom_hostname.py
* test_01_custom_hostname_instancename_false Failed
* test_snapshots.py
* test_01_createVM_snapshotTemplate Failed
* ContextSuite context=TestSnapshotEvents>:setup Failed
* test_01_volume_from_snapshot Failed
* test_02_snapshot_data_disk Failed
* test_03_snapshot_detachedDisk Failed
* test_04_delete_snapshot Failed
* test_07_template_from_snapshot Failed
* test_egress_fw_rules.py
* test_01_1_egress_fr1 Failed
* test_01_2_egress_fr1 Failed
* test_01_egress_fr1 Failed
* test_02_1_egress_fr2 Failed
* test_02_2_egress_fr2 Failed
* test_02_egress_fr2 Failed
* test_03_1_egress_fr3 Failed
* test_03_egress_fr3 Failed
* test_04_1_egress_fr4 Failed
* test_04_egress_fr4 Failed
* test_06_1_egress_fr6 Failed
* test_06_egress_fr6 Failed
* test_07_1_egress_fr7 Failed
* test_07_egress_fr7 Failed
* test_09_1_egress_fr9 Failed
* test_redundant_router_cleanups.py
* test_restart_network_with_destroyed_masterVR Failed
* test_ss_max_limits.py
* test_01_deploy_vm_domain_limit_reached Failing since 2 runs
* test_02_deploy_vm_account_limit_reached Failing since 2 runs
* test_03_deploy_vm_project_limit_reached Failing since 2 runs
* test_ss_project_limits.py
* test_01_register_template_with_project Failed
* test_memory_limits.py
* test_01_stop_start_instance Failed
* test_02_migrate_instance Failed
* test_03_delete_instance Failed
* test_01_stop_start_instance Failing since 2 runs
* test_02_migrate_instance Failing since 2 runs
* test_vpc_network_pfrules.py
* test_01_network_services_VPC_StopCreatePF Failed
* test_02_network_services_VPC_CreatePF Failed
* test_03_network_services_VPC_StopCreateMultiplePF Failed
* test_04_network_services_VPC_CreateMultiplePF Failed
* test_05_network_services_VPC_StopDeletePF Failed
* test_06_network_services_VPC_DeletePF Failed
* test_07_network_services_VPC_StopDeleteAllPF Failed
* test_08_network_services_VPC_DeleteAllPF Failed
* test_09_network_services_VPC_StopDeleteAllMultiplePF Failed
* test_10_network_services_VPC_DeleteAllMultiplePF Failed
* test_ip_reservation.py
* test_reservation_after_router_restart Failed
* test_vm_create_after_reservation Failed
* test_vm_create_outside_cidr_after_reservation Failed
* test_ip_reservation_in_multiple_networks_same_account Failed
* test_nat_rules_1_nat_rule Failed
* test_nat_rules_2_static_nat_rule Failed
* test_update_cidr_multiple_vms_not_all_inclusive Failed
* test_update_cidr_single_vm_not_inclusive Failed
* test_vm_create_after_reservation Failing since 2 runs
* test_vm_create_outside_cidr_after_reservation Failing since 2 runs
* test_restart_network_with_cleanup_1_True Failed
* test_vpc_vms_deployment.py
* test_01_deploy_vms_in_network Failed
* test_02_deploy_vms_delete_network Failed
* test_03_deploy_vms_delete_add_network Failed
* test_04_deploy_vms_delete_add_network_noLb Failed
* test_05_create_network_max_limit Failed
* test_06_delete_network_vm_running Failed
* test_07_delete_network_with_rules Failed
* test_vpc_network.py
* ContextSuite context=TestVPCNetworkGc>:setup Failed
* test_mm_project_limits.py
* test_01_project_vmlifecycle_start_stop_instance Failed
* test_02_project_vmlifecycle_migrate_instance Failed
* test_03_project_vmlifecycle_delete_instance Failed
* test_escalations_instances.py
* test_13_attach_detach_iso Failed
* test_14_vm_snapshot_pagination Failed
* test_15_revert_vm_to_snapshot Failed
* test_16_list_vm_volumes_pagination Failed
* test_18_stopped_vm_change_service Failed
* test_19_create_reset_vm_sshkey Failed
* test_20_update_vm_displayname_group Failed
* test_21_restore_vm Failed
* test_22_deploy_vm_multiple_networks Failed
* test_24_deploy_vm_with_static_ip_ES1662 Failed
* test_25_ip_reallocation_ES1377 Failed
* test_27_VM_restore_ES3467 Failed
* test_28_VM_restore_ES3467 Failed
* test_01_list_instances_pagination Failed
* test_02_list_Running_vm Failed
* test_03_list_Stopped_vm Failed
* test_04_list_Destroyed_vm Failed
* test_05_list_vm_by_id Failed
* test_06_list_vm_by_name Failed
* test_07_list_vm_by_name_state Failed
* test_10_list_vm_by_zone_name_state Failed
* test_11_register_reset_vm_sshkey Failed
* test_12_running_vm_change_service Failed
* test_13_vm_nics Failed
* test_acl_isolatednetwork.py
* ContextSuite context=TestIsolatedNetwork>:setup Failed
* test_cpu_domain_limits.py
* test_01_multiple_core_vm_start_stop_instance Failed
* test_02_multiple_core_vm_migrate_instance Failed
* test_03_multiple_core_vm_delete_instance Failed
* test_04_deploy_multiple_vm_with_multiple_core Failed
* test_01_multiple_child_domains Failed
* test_escalations_networks.py
* test_03_list_vpc_pagination Failed
* test_04_create_vpc_with_networkdomain Failed
* test_06_create_network_in_vpc Failed
* test_10_list_networks_in_vpc Failed
* test_11_update_vpc Failed
* test_12_list_create_delete_networkACL Failed
* test_19_create_list_reset_delete_vpnconnections Failed
* test_accounts.py
* ContextSuite context=TestAddVmToSubDomain>:setup Failed
* test_DeleteDomain Failed
* test_forceDeleteDomain Failed
* test_01_user_remove_VM_running Failed
* ContextSuite context=TestTemplateHierarchy>:setup Failed
* test_LoginApiDomain Failed
* test_LoginApiUuidResponse Failed
* test_ps_limits.py
* test_create_template_snapshot_1_root_domain_admin Failed
* test_create_template_snapshot_2_child_domain_admin Failed
* test_mm_max_limits.py
* test_02_deploy_vm_account_limit_reached Failing since 3 runs
* test_04_deployVm__account_limit_reached Failed
* test_cpu_max_limits.py
* test_02_deploy_vm_account_limit_reached Failing since 4 runs
* test_04_deployVm__account_limit_reached Failing since 2 runs
* test_escalation_listTemplateDomainAdmin.py
* test_listtemplate Failed
* test_portable_ip.py
* test_associate_ip_address_services_enable_disable Failed
* test_list_portable_ip_range_non_root_admin Failed
* test_affinity_groups.py
* test_03_delete_aff_grp_with_vms Failed
* test_01_deploy_vm_without_aff_grp Failed
* test_02_deploy_vm_by_aff_grp_name Failed
* test_03_deploy_vm_by_aff_grp_id Failed
* test_04_deploy_vm_anti_affinity_group Failed
* test_05_deploy_vm_by_id Failed
* test_08_deploy_vm_multiple_aff_grps Failed
* test_09_deploy_vm_multiple_aff_grps Failed
* test_01_list_aff_grps_for_vm Failing since 2 runs
* test_02_list_multiple_aff_grps_for_vm Failing since 2 runs
* test_07_list_all_vms_in_aff_grp Failed
* test_02_update_aff_grp_by_names Failed
* test_03_update_aff_grp_for_vm_with_no_aff_grp Failed
* test_05_update_aff_grp_on_running_vm Failed
* test_acl_listvolume.py
* ContextSuite context=TestVolumeList>:setup Failed
* test_mm_domain_limits.py
* test_01_change_service_offering Failed
* test_02_migrate_vm Failed
* test_03_delete_vm Failed
* test_04_deploy_multiple_vm Failed
* test_01_multiple_child_domains Failing since 2 runs
* test_blocker_bugs.py
* ContextSuite context=TestDataPersistency>:setup Failed
* ContextSuite context=TestNATRules>:setup Failed
* ContextSuite context=TestRouterRestart>:setup Failed
* test_01_list_routers_admin Failed
* test_01_create_template Failed
* test_vpc_network_internal_lbrules.py
* test_02_internallb_rules_traffic Failed
* test_03_internallb_rules_vpc_network_restarts_traffic Failed
* test_04_internallb_appliance_operations_traffic Failed
* test_add_remove_network.py
* ContextSuite context=TestAddNetworkToVirtualMachine>:setup Failed
* ContextSuite context=TestFailureScenariosAddNetworkToVM>:setup Failed
* ContextSuite context=TestFailureScenariosRemoveNicFromVM>:setup Failed
* ContextSuite context=TestFailureScenariosUpdateVirtualMachineNIC>:setup
Failed
* ContextSuite context=TestRemoveNetworkFromVirtualMachine>:setup Failed
* ContextSuite context=TestUpdateVirtualMachineNIC>:setup Failed
* test_escalations_ipaddresses.py
* test_11_create_delete_firewallrule Failed
* test_lb_secondary_ip.py
* test_01_lb_rule_for_primary_ip Failed
* test_02_lb_rule_for_primary_ip Failed
* test_03_lb_rule_for_primary_and_secondary_ip Failed
* test_04_lb_rule_primary_secondary_multiple_vms Failed
* test_05_lb_rule_wrong_vm_id Failed
* test_06_lb_rule_wrong_vm_ip Failed
* test_08_lb_rule_remove_used_ip Failed
* test_11_ssh_to_secondary_ip Failed
* test_13_delete_lb_rule Failed
* test_14_remove_lb_rule_secondary_ip Failed
* test_15_remove_lb_rule_primary_ip Failed
* test_16_delete_vm_from_lb_rule Failed
* test_20_destroy_recover_vm Failed
* test_21_modify_lb_rule_algorithm Failed
* test_09_lbvmips_true Failed
* test_10_lbvmips_false Failed
* test_17_restart_router Failed
* test_18_restart_network_cleanup_true Failed
* test_19_restart_network_cleanup_false Failed
* test_22_network_gc Failed
* test_volumes.py
* test_01_volume_attach_detach Failed
* test_01_volume_attach_detach Failing since 2 runs
* test_02_root_volume_attach_detach Failed
* ContextSuite context=TestAttachVolume>:setup Failed
* ContextSuite context=TestAttachVolumeISO>:setup Failed
* ContextSuite context=TestMigrateVolume>:setup Failed
* ContextSuite context=TestVolumes>:setup Failing since 12 runs
* test_acl_listsnapshot.py
* ContextSuite context=TestSnapshotList>:setup Failed
* test_stopped_vm.py
* test_deploy_vm_password_enabled Failed
* test_snapshot_limits.py
* ContextSuite context=TestSnapshotLimit>:setup Failed
* test_escalations_templates.py
* test_01_list_templates_pagination Failed
* test_02_download_template Failed
* test_03_edit_template_details Failed
* test_ss_limits.py
* test_01_register_template_1_root_domain_admin Failed
* test_01_register_template_2_child_domain_admin Failed
* test_ps_resize_volume.py
* test_02_increase_volume_size_above_account_limit Failed
* test_03_increase_volume_size_above_domain_limit Failed
* test_usage.py
* ContextSuite context=TestLBRuleUsage>:setup Failing since 2 runs
* ContextSuite context=TestNatRuleUsage>:setup Failing since 2 runs
* ContextSuite context=TestPublicIPUsage>:setup Failing since 2 runs
* ContextSuite context=TestSnapshotUsage>:setup Failing since 2 runs
* ContextSuite context=TestVmUsage>:setup Failing since 2 runs
* ContextSuite context=TestVolumeUsage>:setup Failing since 2 runs
* ContextSuite context=TestVpnUsage>:setup Failing since 2 runs
* test_vpc_vm_life_cycle.py
* test_06_migrate_instance_in_network Failed
* test_07_migrate_instance_in_network Failed
* test_project_limits.py
* test_06_volumes_per_project Failed
* test_07_templates_per_project Failed
* test_templates.py
* test_01_create_template Failing since 2 runs
* test_assign_vm.py
* test_13_move_across_subdomain_vm_snapshot Failed
* test_15_move_across_subdomain_account_limit Failed
* test_16_move_across_subdomain_volume_and_account_limit Failed
**Skipped tests:**
test_03_copy_template
ContextSuite context=TestvGPUWindowsVm>:setup
ContextSuite context=TestTemplateUsage>:setup
test_02_create_vpc_from_offering_with_regionlevelvpc_service_capability
test_03_deploy_vms_in_vpc_with_regionlevelvpc
test_02_cancel_host_maintenace_with_migration_jobs
ContextSuite context=TestInstanceNameFlagTrue>:setup
test_04_deploy_multiple_vm_with_multiple_cpus
test_05_1_egress_fr5
test_05_egress_fr5
test_08_1_egress_fr8
test_08_egress_fr8
test_04_vpn_tag
ContextSuite context=TestAffinityRules>:setup
ContextSuite context=TestAntiAffinityRules>:setup
test_02_create_vpc_from_offering_with_distributedrouter_service_capability
test_03_deploy_vms_in_vpc_with_distributedrouter
test_04_deploy_multiple_vm
ContextSuite context=TestProjectCreationNegative>:setup
ContextSuite context=TestProjectInviteRequiredTrue>:setup
ContextSuite context=TestProjectInviteTimeout>:setup
test_RVR_network
test_01_create_network_2_network_offering_vpcns
test_02_create_network_fail_2_network_offering_vpcns
test_04_create_multiple_networks_with_lb_1_network_offering
test_04_create_multiple_networks_with_lb_2_network_offering_vpcns
test_06_create_network_with_rvr
test_09_create_network_shared_nwoff_2_network_offering_vpcns
test_01_create_network_outside_range_2_network_offering_vpcns
test_03_create_network_inside_range_2_network_offering_vpcns
test_04_create_network_overlapping_range_2_network_offering_vpcns
test_05_create_network_diff_account_2_network_offering_vpcns
test_02_concurrent_snapshot_global_limit
test_01_migrate_vm_with_volume
test_02_migrate_volume
test_02_migrate_vm
test_03_delete_vm
test_01_deploy_vm_with_implicit_planner
test_destroy_recover_vm_1_root_domain_admin
test_destroy_recover_vm_2_child_domain_admin
test_04_copy_iso
test_04_update_aff_grp_remove_all
test_01_host_ha_with_nfs_storagepool_with_vm
test_02_host_ha_with_local_storage_and_nfs
test_03_host_ha_with_only_local_storage
ContextSuite context=TestTemplates>:setup
test_07_lb_rule_used_ip
test_12_ssh_to_primary_secondary_ip
test_09_stop_vm_migrate_vol
test_04_copy_template
test_04_copy_template_1_root_domain_admin
test_04_copy_template_2_child_domain_admin
test1_attach_volume_ide
test2_attach_ISO_in_CentOSVM
ContextSuite context=TestTemplateUsage>:setup
test_createSharedNetwork_usedVlan
test_01_addLdapConfiguration
ContextSuite context=TestTemplates>:setup
**Passed test suits:**
None
test_redundant_router_upgrades.py
test_VirtualRouter_alerts.py
test_regions_accounts.py
test_acl_isolatednetwork_delete.py
test_invalid_gw_nm.py
test_haproxy.py
test_vpc_offerings.py
test_snapshots_improvement.py
test_vpn_users.py
test_vpc_routers.py
test_acl_listvm.py
test_simultaneous_volume_attach.py
test_deploy_vm_userdata_reg.py
test_escalations_routers.py
test_vpc_network_lbrules.py
test_update_vm.py
test_escalations_volumes.py
test_regions.py
test_projects.py
test_acl_sharednetwork.py
test_allocation_states.py
test_snapshot_gc.py
test_vm_passwdenabled.py
test_network_offering.py
None
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
