[GitHub] cloudstack issue #1846: CLOUDSTACK-9688: Fix failing smoke tests
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1846 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1844: CLOUDSTACK-9668 : disksizeallocated of PrimaryStorag...
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1844 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1838: CLOUDSTACK-9682: Block VM migration to a storage whi...
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1838 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1833: BUG-ID:CLOUDSTACK-9678
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1833 Why this is a bug? Most of ACS searches using name field work exactly this way to bring list of VMs, templates etc when partial name is specified. If exact name match is expected it needs to be processed on a client side. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1828: CLOUDSTACK-9676 Start instance fails after reverting...
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1828 LGTM on code review --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1615: CLOUDSTACK-9438: Fix for CLOUDSTACK-9252 - Make NFS ...
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1615 @rhtyd @jburwell @karuturi What is the easiest way to resolve this merge conflict? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1615: CLOUDSTACK-9438: Fix for CLOUDSTACK-9252 - Make NFS ...
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1615 @milamberspace Can you check if file /usr/share/cloudstack-management/setup/db/schema-481to490.sql in your installation has the SQL alter image_store_details table line ? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1615: CLOUDSTACK-9438: Fix for CLOUDSTACK-9252 - Make NFS ...
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1615 @milamberspace Column details is supposed to be added during 4.8 to 4.9 schema upgrade. Most likely when you upgraded to 4.9 this PR hadn't been merged yet. You can simply apply this statement before starting the 4.9 to 4.10 upgrade: ALTER TABLE `cloud`.`image_store_details` CHANGE COLUMN `value` `value` VARCHAR(255) NULL DEFAULT NULL COMMENT 'value of the detail', ADD COLUMN `display` tinyint(1) NOT NULL DEFAULT '1' COMMENT 'True if the detail can be displayed to the end user' AFTER `value`; --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1754: [4.10] Latest health test run
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1754 @rhtyd We seem to have consistently more tests failing lately --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1807: CLOUDSTACK-9633: Revert addition of `vhd` extention ...
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1807 @syed @rhtyd @abhinandanprateek Why cant we simply rename all install paths in DB for existing snapshots instead. It can be as simple as adding this query to schema upgrade path UPDATE cloud.snapshots s JOIN cloud.snapshot_store_ref ssr ON ssr.snapshot_id = s.id SET ssr.install_path = CONCAT(ssr.install_path, '.vhd') WHERE s.hypervisor_type = 'XenServer' AND RIGHT(ssr.install_path, 4) != '.vhd'; --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1807: CLOUDSTACK-9633: Revert addition of `vhd` extention ...
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1807 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #828: CLOUDSTACK-8854: Apple Mac OS/X VM get created withou...
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/828 LGTM. This patch has been working well in production for over a year now. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1762: CLOUDSTACK-9595 Transactions are not getting retried...
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1762 @rafaelweingartner Thanks a lot. I totally agree that resetting hosts doesn't really need to be a part of transaction and should be extracted to a new method. The same is for lines 527-546, and then another one after 551 My understanding of agent LB is that is handled separately from reconnect part. I might be wrong but it is done in ClusteredAgentManagerImpl by scheduling rebalancing task every 60 sec getAgentRebalanceScanTask which takes care of transferring of connected agents. @rhtyd @jburwell @koushik-das @karuturi Do you agree that we can split a transaction in findAndUpdateDirectAgentToLoad into 3 non transactional methods and thus eliminate a one side of a repeated deadlock? This is a very core of agent management that is very hard if ever possible to write smoke test. If so @nvazquez might be able to work on refactoring this method later this month --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1753: [4.9] Latest health test run
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1753 @rhtyd Only 2 PRs were merged in the interval between last successful run and failure: PR1766 and PR1545 1766 was merged to 4.8 and was hypervisor agnostic so all points at PR1545 'Add channel to Instances for Qemu Guest Agent' which was conveniently KVM specific. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1753: [4.9] Latest health test run
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1753 @rhtyd 4.10 tests started failing after 11/23 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1753: [4.9] Latest health test run
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1753 @rhtyd Both 4.9 and 4.10 now fail as well as PR based on 4.9 e.g. PR 1659 with 13 tests on KVM but PRs based on 4.8 succeed e.g. PR1710 and PR1753. Might be some interference from one of the last merges. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1762: CLOUDSTACK-9595 Transactions are not getting retried...
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1762 @rafaelweingartner I might be wrong but 2d came from findAndUpdateDirectAgentToLoad in HostDaoImpl which also creates a large transaction. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1762: CLOUDSTACK-9595 Transactions are not getting retried...
Github user serg38 commented on the issue:
https://github.com/apache/cloudstack/pull/1762
@rafaelweingartner You might be right that pod_vlan_map should be in the
join. May be I didn't find the correct methods after all. @jburwell @rhtyd What
do you think?
I was able to find management serve log for Deadlock 1. Looks like one of
transaction came from findAndUpdateDirectAgentToLoad method in HostDaoImpl
which creates rather complex transaction:
2016-11-24 15:04:39,284 DEBUG [host.dao.HostDaoImpl] (ClusteredAgentManager
Timer:ctx-a8e9449c) Resetting hosts suitable for reconnect
2016-11-24 15:04:39,320 DEBUG [db.Transaction.Transaction]
(ClusteredAgentManager Timer:ctx-a8e9449c) Rolling back the transaction: Time =
36 Name = ClusteredAgentManager Timer; called by
-TransactionLegacy.rollback:879-TransactionLegacy.removeUpTo:822-TransactionLegacy.close:646-TransactionContextInterceptor.invoke:36-ReflectiveMethodInvocation.proceed:161-ExposeInvocationInterceptor.invoke:91-ReflectiveMethodInvocation.proceed:172-JdkDynamicAopProxy.invoke:204-$Proxy48.findAndUpdateDirectAgentToLoad:-1-ClusteredAgentManagerImpl.scanDirectAgentToLoad:195-ClusteredAgentManagerImpl.runDirectAgentScanTimerTask:185-ClusteredAgentManagerImpl.access$100:99
2016-11-24 15:04:39,322 ERROR [agent.manager.ClusteredAgentManagerImpl]
(ClusteredAgentManager Timer:ctx-a8e9449c) Unexpected exception DB Exception
on: com.mysql.jdbc.JDBC4PreparedStatement@1e58727c: SELECT host.id,
host.disconnected, host.name, host.status, host.type, host.private_ip_address,
host.private_mac_address, host.private_netmask, host.public_netmask,
host.public_ip_address, host.public_mac_address, host.storage_ip_address,
host.cluster_id, host.storage_netmask, host.storage_mac_address,
host.storage_ip_address_2, host.storage_netmask_2, host.storage_mac_address_2,
host.hypervisor_type, host.proxy_port, host.resource, host.fs_type,
host.available, host.setup, host.resource_state, host.hypervisor_version,
host.update_count, host.uuid, host.data_center_id, host.pod_id,
host.cpu_sockets, host.cpus, host.url, host.speed, host.ram, host.parent,
host.guid, host.capabilities, host.total_size, host.last_ping,
host.mgmt_server_id, host.dom0_memory, host.version, host.created, h
ost.removed FROM host WHERE host.resource IS NOT NULL AND host.mgmt_server_id
= 345048964870 AND host.last_ping <= 1445339907 AND host.cluster_id IS NOT
NULL AND host.status IN ('Disconnected','Down','Alert') AND host.removed IS
NULL FOR UPDATE
Caused by:
com.mysql.jdbc.exceptions.jdbc4.MySQLTransactionRollbackException: Deadlock
found when trying to get lock; try restarting transaction
Beginning of second transaction was
SELECT host.id, host.disconnected, host.name, host.status, host.type,
host.private_ip_address, host.private_mac_address, host.private_netmask,
host.public_netmask, host.public_ip_address, host.public_mac_address,
host.storage_ip_address, host.cluster_id, host.storage_netmask,
host.storage_mac_address, host.storage_ip_address_2, host.storage_netmask_2,
host.storage_mac_address_2, host.hypervisor_type, host.proxy_port,
host.resource, host.fs_type, host.available, host.setup, host.resource_state,
host.hypervisor_version, host.update_count, host.uuid, host.data_center_id,
host.pod_id, host.cpu_sockets, host.cpus, host.url, host.speed, host.ram,
host.parent, host.guid, host.capabilities, host.total_size, host.last_ping,
host.mgmt_server_id, host.dom0_memory, host.version, host.created, host.removed
FROM host LEFT OUTER JOIN op_host_transfer ON host.id=op_host_transfer.id IN
I will try to trace it to the ACS method.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] cloudstack issue #1753: [4.9] Latest health test run
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1753 @rhtyd All the new failures are due to inability to SSH to VMs. Can we re-run this to filter environmental issue or recent PR merge? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1738: CLOUDSTACK-9566 instance-id metadata for baremetal V...
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1738 LGTM as well --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1762: CLOUDSTACK-9595 Transactions are not getting retried...
Github user serg38 commented on the issue:
https://github.com/apache/cloudstack/pull/1762
@rafaelweingartner Tried tracing where deadlock 5 originated. It seems
both transactions are part of the same method fetchNewPublicIp in
IpAddressManagerImpl . Transactions are executed on different management
servers.
Update is triggered through markPublicIpAsAllocated method
Select seems to come from there as well fetchNewPublicIp in
IpAddressManagerImpl
AssignIpAddressFromPodVlanSearch =
_ipAddressDao.createSearchBuilder();
AssignIpAddressFromPodVlanSearch.and("dc",
AssignIpAddressFromPodVlanSearch.entity().getDataCenterId(), Op.EQ);
AssignIpAddressFromPodVlanSearch.and("allocated",
AssignIpAddressFromPodVlanSearch.entity().getAllocatedTime(), Op.NULL);
SearchBuilder podVlanSearch =
_vlanDao.createSearchBuilder();
podVlanSearch.and("type", podVlanSearch.entity().getVlanType(),
Op.EQ);
podVlanSearch.and("networkId",
podVlanSearch.entity().getNetworkId(), Op.EQ);
SearchBuilder podVlanMapSB =
_podVlanMapDao.createSearchBuilder();
podVlanMapSB.and("podId", podVlanMapSB.entity().getPodId(), Op.EQ);
AssignIpAddressFromPodVlanSearch.join("podVlanMapSB", podVlanMapSB,
podVlanMapSB.entity().getVlanDbId(),
AssignIpAddressFromPodVlanSearch.entity().getVlanId(),
JoinType.INNER);
AssignIpAddressFromPodVlanSearch.join("vlan", podVlanSearch,
podVlanSearch.entity().getId(),
AssignIpAddressFromPodVlanSearch.entity().getVlanId(), JoinType.INNER);
AssignIpAddressFromPodVlanSearch.done();
public IPAddressVO doInTransaction(TransactionStatus status) throws
InsufficientAddressCapacityException {
StringBuilder errorMessage = new StringBuilder("Unable to
get ip adress in ");
boolean fetchFromDedicatedRange = false;
List dedicatedVlanDbIds = new ArrayList();
List nonDedicatedVlanDbIds = new ArrayList();
SearchCriteria sc = null;
if (podId != null) {
sc = **AssignIpAddressFromPodVlanSearch**.create();
sc.setJoinParameters("podVlanMapSB", "podId", podId);
errorMessage.append(" pod id=" + podId);
} else {
sc = AssignIpAddressSearch.create();
errorMessage.append(" zone id=" + dcId);
}
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] cloudstack issue #1762: CLOUDSTACK-9595 Transactions are not getting retried...
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1762 @rafaelweingartner Looks like the deadlocks 2 and 3 are the same. I scanned our production log and since last December we had 6400 deadlocks. Out of them close to 6000 were Deadlock 1 20 were Deadlock 2 and 700 of a different Deadlock 5. The other deadlocks were in negligible numbers. I think if we figure out Deadlock 1 and Deadlock 5 this will be good start. I will try to find the source of transactions for them. In production we run a commercial distribution based in most part on 4.7 branch of ACS. Deadlock 5 *** (1) TRANSACTION: TRANSACTION D518886F8, ACTIVE 2 sec fetching rows mysql tables in use 4, locked 4 LOCK WAIT 24 lock struct(s), heap size 3112, 8 row lock(s), undo log entries 17 MySQL thread id 29781, OS thread handle 0x7f9df36db700, query id 3625404021 ussclpdcsmgt012.autodesk.com 10.41.13.14 cloud Sorting result SELECT user_ip_address.id, user_ip_address.account_id, user_ip_address.domain_id, user_ip_address.public_ip_address, user_ip_address.data_center_id, user_ip_address.source_n at, user_ip_address.allocated, user_ip_address.vlan_db_id, user_ip_address.one_to_one_nat, user_ip_address.vm_id, user_ip_address.state, user_ip_address.mac_address, user_ip _address.source_network_id, user_ip_address.network_id, user_ip_address.uuid, user_ip_address.physical_network_id, user_ip_address.is_system, user_ip_address.vpc_id, user_ip _address.dnat_vmip, user_ip_address.is_portable, user_ip_address.display, user_ip_address.removed, user_ip_address.created FROM user_ip_address INNER JOIN vlan ON user_ip_a ddress.vlan_db_id=vlan.id WHERE user_ip_address.data_center_id = 6 AND user_ip_address.allocated IS NULL AND user_ip_address.vlan_db_id IN (32,33,36,37,41,61,62,91,92,93,9 4,106,107,108,109,11 *** (1) WAITING FOR THIS LOCK TO BE GRANTED: *** (2) TRANSACTION: TRANSACTION D5188582B, ACTIVE 17 sec updating or deleting, thread declared inside InnoDB 499 mysql tables in use 1, locked 1 25 lock struct(s), heap size 3112, 13 row lock(s), undo log entries 18 MySQL thread id 29820, OS thread handle 0x7fa35a868700, query id 3625417999 ussclpdcsmgt013.autodesk.com 10.41.13.15 cloud Updating UPDATE user_ip_address SET user_ip_address.source_nat=0, user_ip_address.is_system=0, user_ip_address.account_id=3309, user_ip_address.allocated='2016-03-25 15:36:39', user_ip_address.state='Allocated', user_ip_address.domain_id=335 WHERE user_ip_address.id = 3284 *** (2) HOLDS THE LOCK(S): --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1762: CLOUDSTACK-9595 Transactions are not getting retried...
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1762 Here it is few samples of deadlocks we observe in high transaction volume environment with multiple management servers. As you can see most of them are concurrent operations from different management servers and either select or select for update statements. The following 4 types account for the majority of deadlock s we saw so far ( 80-90% of all deadlocks). Deadlock 1-3 happens much more often than deadlock 4. It is next to impossible to reproduce since they occur one in few days with 4 management servers and average VM deployment volume of 3000 a day. Deadlock type 1: InnoDB: transactions deadlock detected, dumping detailed information. 151217 3:08:20 *** (1) TRANSACTION: TRANSACTION BB4D4C91D, ACTIVE 0 sec fetching rows mysql tables in use 1, locked 1 LOCK WAIT 11 lock struct(s), heap size 3112, 5 row lock(s) MySQL thread id 47654, OS thread handle 0x7f0475bdd700, query id 3821358107 ussclpdcsmgt012.autodesk.com 10.41.13.14 cloud Sending data SELECT host.id, host.disconnected, host.name, host.status, host.type, host.private_ip_address, host.private_mac_address, host.private_netmask, host.public_netmask, host.public_ip_address, host.public_mac_address, host.storage_ip_address, host.cluster_id, host.storage_netmask, host.storage_mac_address, host.storage_ip_address_2, host.storage_netmask_2, host.storage_mac_address_2, host.hypervisor_type, host.proxy_port, host.resource, host.fs_type, host.available, host.setup, host.resource_state, host.hypervisor_version, host.update_count, host.uuid, host.data_center_id, host.pod_id, host.cpu_sockets, host.cpus, host.url, host.speed, host.ram, host.parent, host.guid, host.capabilities, host.total_size, host.last_ping, host.mgmt_server_id, host.dom0_memory, host.version, host.created, host.removed FROM host WHERE host.resource IS NOT NULL AND host.mgmt_server_id = 345048964870 *** (1) WAITING FOR THIS LOCK TO BE GRANTED: *** (2) TRANSACTION: TRANSACTION BB4D4C915, ACTIVE 1 sec fetching rows, thread declared inside InnoDB 449 mysql tables in use 3, locked 3 29 lock struct(s), heap size 6960, 15 row lock(s), undo log entries 1 MySQL thread id 47623, OS thread handle 0x7f0a47074700, query id 3821724056 ussclpdcsmgt013.autodesk.com 10.41.13.15 cloud Copying to tmp table SELECT host.id, host.disconnected, host.name, host.status, host.type, host.private_ip_address, host.private_mac_address, host.private_netmask, host.public_netmask, host.public_ip_address, host.public_mac_address, host.storage_ip_address, host.cluster_id, host.storage_netmask, host.storage_mac_address, host.storage_ip_address_2, host.storage_netmask_2, host.storage_mac_address_2, host.hypervisor_type, host.proxy_port, host.resource, host.fs_type, host.available, host.setup, host.resource_state, host.hypervisor_version, host.update_count, host.uuid, host.data_center_id, host.pod_id, host.cpu_sockets, host.cpus, host.url, host.speed, host.ram, host.parent, host.guid, host.capabilities, host.total_size, host.last_ping, host.mgmt_server_id, host.dom0_memory, host.version, host.created, host.removed FROM host LEFT OUTER JOIN op_host_transfer ON host.id=op_host_transfer.id *** (2) HOLDS THE LOCK(S): RECORD LOCKS space id 0 page no 147488 n bits 840 index `i_host__removed` of table `cloud`.`host` trx id BB4D4C915 lock_mode X locks rec but not gap Deadlock 2: InnoDB: transactions deadlock detected, dumping detailed information. 151218 11:03:00 *** (1) TRANSACTION: TRANSACTION BBB232C81, ACTIVE 51 sec starting index read mysql tables in use 1, locked 1 LOCK WAIT 3 lock struct(s), heap size 1248, 2 row lock(s) MySQL thread id 57308, OS thread handle 0x7f0a45c24700, query id 5217973695 ussclpdcsmgt013.autodesk.com 10.41.13.15 cloud Sending data SELECT resource_count.id, resource_count.type, resource_count.account_id, resource_count.domain_id, resource_count.count FROM resource_count WHERE resource_count.id IN (5083,4867,5079,33652,5077) FOR UPDATE *** (1) WAITING FOR THIS LOCK TO BE GRANTED: *** (2) TRANSACTION: TRANSACTION BBB2254AC, ACTIVE 116 sec starting index read, thread declared inside InnoDB 500 mysql tables in use 1, locked 1 207 lock struct(s), heap size 31160, 1650 row lock(s), undo log entries 2 MySQL thread id 56926, OS thread handle 0x7f04756c9700, query id 5218549710 ussclpdcsmgt014.autodesk.com 10.41.13.16 cloud Sending data SELECT resource_count.id, resource_count.type, resource_count.account_id, resource_count.domain_id, resource_count.count FROM resource_count WHERE resource_count.id IN (5083,4867,5079,33652,5077) FOR UPDATE Deadlock 3: ** (1) TRANSACTION: TRANSACTION BBB232C81, ACTIVE 51 sec starting index read mysql tables in use 1, locked 1 LOCK WAIT 3 lock
[GitHub] cloudstack issue #1762: CLOUDSTACK-9595 Transactions are not getting retried...
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1762 @rafaelweingartner @swill @wido @koushik-das @karuturi @rhtyd @jburwell Let's ask a different question. If we are to try to implement a general way of dealing with deadlocks in ACS how could it be done to ensure DB consistency and correct transaction retry? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1754: [4.10] Latest health test run
Github user serg38 commented on the issue:
https://github.com/apache/cloudstack/pull/1754
@rhtyd I quickly checked. test_06_download_detached_volume failed only on
last run due to
errorcode : 530, errortext : u'Unable to create a link for entity at
volumes/76/141/e19cdd3c-201b-442a-9563-020f35d9e6c3.vhd on ssvm,No remote
endpoint to send command, check if host or ssvm is down?'
It is either environmental or introduced in the every recent merges. We
need to confimr if it shows up in the next test run
test_01_snapshot_root_disk consistently fails on 'is_snapshot_on_nfs'
method on test for existence of snapshot. It seems a bug was introduced that
adds second suffix vhd to the snapshot entry in DB that wouldnt match the file
name
aramiko.transport: DEBUG: [chan 2] EOF received (2)
paramiko.transport: DEBUG: [chan 2] EOF sent (2)
sshClient: DEBUG: {Cmd: test -f
/mnt/tmp/snapshots/66/120/db18ffda-1ab1-4843-95fe-cb134d1ae4b5.**vhd.vhd** &&
echo 'snapshot exists' via Host: 10.2.2.27} {returns: []}
paramiko.transport: DEBUG: [chan 3] Max packet in: 32768 bytes
paramiko.transport: DEBUG: [chan 3] Max packet out: 32768 bytes
paramiko.transport: DEBUG: Secsh channel 3 opened.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] cloudstack issue #1686: CLOUDSTACK-9507: ListVM response's guest_os id shoul...
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1686 I am -1 in the current form --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1762: CLOUDSTACK-9595 Transactions are not getting retried...
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1762 What about if the author can figure out a way to identify all part of transaction being cancelled and retry all parts? Or retry the whole transaction? It would be nice to open a path for the author to implement this --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1762: CLOUDSTACK-9595 Transactions are not getting retried...
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1762 @jburwell We've been running this fix as a part of proprietary CS for several weeks now. We are observing elimination of deadlocks and no DB corruption. Retry seems to be the only realistic way of dealing with deadlocks in complex environment like ACS. Can we come up with a limited scope/conditions of this PR to move forward ? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1767: CLOUDSTACK-9457: Allow retrieval and modification of...
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1767 @nvazquez @koushik-das If we go this route we might want to change update API to behave consistently. It would make sense to allow overriding any details. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1767: CLOUDSTACK-9457: Allow retrieval and modification of...
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1767 @koushik-das No I don't. I tend to agree with you but obviously the implementation will be messier since configs are random. @nvazquez Do you think it can be changes so that modification is done via detail tag of updateVirtuaMachine and updateTemplate APIs. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1727: CLOUDSTACK-9539: Support changing Service offering f...
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1727 @koushik-das Good catch. Thanks. I think there are 2 options. Either not allow changing service offering for VM with VM snapshot if current offering is Custom. Or save custom offering details to vm_snaphsot details and apply them during the snapshot reversion. Which option do you think is more applicable? I think option 2 is better. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1767: CLOUDSTACK-9457: Allow retrieval and modification of...
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1767 @koushik-das @ustcweizhou Just want to add on the use case. There is growing need to change template/VM details for after the deployment e.g. to switch root disk controller or change ratio of cores/socket with cpuid.coresPerSocket or with adding vGPU startup parameters or switch boot firmware from bios to efi as required by some OS. Currently users are unable to easily do it with API and/or UI. As implemented now, all settings with display=1 in user_vm_details and vm_template_details will be returned by API and allowed to changed. If desired we can open another PR to switch details created by other API in automatic fashion to have display=0 so they will not show up in the response of these APIs and users wont be able to edit/delete them. We thought this to be out of scope for now. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1542: CLOUDSTACK-9379: Support nested virtualization at VM...
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1542 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1542: CLOUDSTACK-9379: Support nested virtualization at VM...
Github user serg38 commented on the issue:
https://github.com/apache/cloudstack/pull/1542
@rhytd @jburwell @karuturi test_nested_virtualization_vmware
Success 305.03
The other tests fail due to environmental issues e.g. below. I think it is
ready for merging now.
2016-11-20 16:32:00,324 - CRITICAL - EXCEPTION: test_3d_gpu_support:
['Traceback (most recent call last):\n', ' File
"/usr/lib64/python2.7/unittest/case.py", line 369, in run\ntestMethod()\n',
' File "/marvin/tests/smoke/test_deploy_vgpu_enabled_vm.py", line 316, in
test_3d_gpu_support\nself.virtual_machine.add_nic(self.apiclient,
self.isolated_network.id)\n', ' File
"/usr/lib/python2.7/site-packages/marvin/lib/base.py", line 784, in add_nic\n
return apiclient.addNicToVirtualMachine(cmd)\n', ' File
"/usr/lib/python2.7/site-packages/marvin/cloudstackAPI/cloudstackAPIClient.py",
line 637, in addNicToVirtualMachine\nresponse =
self.connection.marvinRequest(command, response_type=response,
method=method)\n', ' File
"/usr/lib/python2.7/site-packages/marvin/cloudstackConnection.py", line 379, in
marvinRequest\nraise e\n', "Exception: Job failed: {jobprocstatus : 0,
created : u'2016-11-20T16:29:43+', cmd :
u'org.apache.cloudstack.api.command.admin.vm.AddNicTo
VMCmdByAdmin', userid : u'1575bde5-af3a-11e6-b333-06aa7801071a', jobstatus :
2, jobid : u'78b21bfa-bc82-4df6-ad54-67ef0899ceeb', jobresultcode : 530,
jobresulttype : u'object', jobresult : {errorcode : 530, errortext : u'Unable
to add NIC to VM[User|i-7-9-VM]: com.cloud.exception.AgentUnavailableException:
**Resource [Host:1] is unreachable:** Host 1: Unable to start instance due to
Unable to start VM:a42c5549-c3c4-47b3-8e49-0785d1c2ef44 due to error in
finalizeStart, not retrying'}, accountid :
u'1575a6c7-af3a-11e6-b333-06aa7801071a'}\n"]
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] cloudstack issue #1542: CLOUDSTACK-9379: Support nested virtualization at VM...
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1542 @jburwell @rhtyd Looks like blueorangutain vmware side has issues on hypervisor. Can you take a look and then re-kick the tests? Some errors were due to that. 530, errortext : u'Unable to add NIC to VM[User|i-39-54-VM]: com.cloud.exception.AgentUnavailableException: Resource [Host:1] is unreachable: Host 1: Unable to start instance due to Unable to start VM:f22d93f6-e197-46e4-8e0c-0a926fece518 due to error in finalizeStart, not retrying'}, --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1676: CLOUDSTACK-9502: DS template copies don’t get dele...
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1676 @jburwell @rhtyd @karuturi This PR also seems to be ready for merging . --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1542: CLOUDSTACK-9379: Support nested virtualization at VM...
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1542 @karuturi @jburwell As per @rhtyd we can run additional tests with blueorangutan . Can we execute them and merge this PR since it passes the standard test suite just fine? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1677: CLOUDSTACK-8830 - [Vmware] VM snapshot fails for 12 ...
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1677 @rhtyd @karuturi All LGTM are in order. Can we merge this one? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1762: CLOUDSTACK-9595 Transactions are not getting retried...
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1762 @jburwell I concur but if @yvsubhash verified that those methods don't participate in complex DML transactions this might be still a good start. If so this approach might be expanded later to multi DML transaction so that each piece can be retired individually. I myself traced few deadlocks in ACS using native mysql deadlock logging and it doesn't seem there would be a viable alternative to retires due to well known complexity of ACS DB operations. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1762: CLOUDSTACK-9595 Transactions are not getting retried...
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1762 @jburwell @yvsubhash I might be wrong but this PR will retry on deadlock for only 2 DAO methods searchIncludingRemoved and customSearchIncludingRemoved. No update methods are set with this retry mechanism. If that's the case there is no risk of corrupting DB. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1762: CLOUDSTACK-9595 Transactions are not getting retried...
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1762 @jburwell I thought that most if not all of ACS interaction through DAO is rather atomic transactions. Do we have cases of multiple DML statements as a part of the same transaction? We have been seeing quite a few deadlock in a high transaction volume environments where multiple management servers are employed. This causes quite a pain for users due to the randomness and no good recourse/explanation. I would argue that proper retry is a better choice should we cover all the cases including all cases with complex transactions. We have been successful leveraging this approach in systems built on the top of ACS. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1762: CLOUDSTACK-9595 Transactions are not getting retried...
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1762 @jburwell @yvsubhash My understanding that all roll back statements will receive MYSQL_DEADLOCK_ERROR_CODE and will be retired as a part of this patch. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1762: CLOUDSTACK-9595 Transactions are not getting retried...
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1762 LGTM. Finally !!! We have been seeing occasional deadlocks in environments with high level transaction rate. @rhtyd @jburwell This could be a good add to 4.8/4.9. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1749: Updates for SAN-assisted snapshots
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1749 @rhtyd @PaulAngus Can we re-run test again to see if it was one time issue? On a general note it would be extremely helpful that during blueorangutain runs we rotate management server log before and after PR execution and include it with Marvin tests results. In many cases it would allow PR author to see and investigate right away the root cause of the failure. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1749: Updates for SAN-assisted snapshots
Github user serg38 commented on the issue:
https://github.com/apache/cloudstack/pull/1749
Trillian failures might be environmental. As if NFS share lost proper
permissions. E.g template test failed due to that:
Exception: Job failed: {jobprocstatus : 0, created :
u'2016-11-08T17:45:28+', jobresult : {errorcode : 530, errortext : u'Failed
to create templatecreate template from volume exception: Exception:
java.lang.Exception\\nMessage: unable to prepare template directory:
template/tmpl/2/214, storage:
NFS://10.2.0.16/acs/secondary/pr1749-t307-vmware-55u3/pr1749-t307-vmware-55u3-sec1,
error msg: mkdir: cannot create directory
\\u2018/var/cloudstack/mnt/VM/6814905206562.ca65d71/template/tmpl/2/214\\u2019:
Permission denied\\n'
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] cloudstack issue #1735: CLOUDSTACK-9570: Bug in listSnapshots for snapshots ...
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1735 @ustcweizhou Not necessary. The issue affects removal of primary storage DS where there are snapshot copies. After that the snapshot could remain on secondary storage. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1735: CLOUDSTACK-9570: Bug in listSnapshots for snapshots ...
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1735 @rhtyd @jburwell The tests didn't kick in last time. Can we fire matrix again? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1676: CLOUDSTACK-9502: DS template copies don’t get dele...
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1676 @jburwell Non-VPC tests on VmWare passed this time. This one seems to be ready for merging. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1676: CLOUDSTACK-9502: DS template copies don’t get dele...
Github user serg38 commented on the issue:
https://github.com/apache/cloudstack/pull/1676
@jburwell PR1560. At this point it might be make sense to leave it for 4.10
and not to forward merge it. I checked blueorangutan log and without
management server log it is impossible to determine exact reason for the
exception. Most likely you had a hypervisor in a failed/disconnected state
during the test
"Exception: Job failed: {jobprocstatus : 0, created :
u'2016-11-01T16:12:54+', jobresult : {errorcode : 530, errortext :
u'**Resource [Host:2] is unreachable:** Host 2: Unable to start instance due to
Unable to start VM:529663de-7158-4303-9948-5c3ea9f939cc due to error in
finalizeStart, not retrying'}, cmd :
u'org.apache.cloudstack.api.command.admin.router.RebootRouterCmd', userid :
u'896fea80-a00e-11e6-a5b5-0629ca010832', jobstatus : 2, jobid :
u'ff89481d-9894-480f-8b15-b678b91baf27', jobresultcode : 530, jobinstanceid :
Can we kick off test again?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] cloudstack issue #1676: CLOUDSTACK-9502: DS template copies don’t get dele...
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1676 @blueorangutan test vmware-55u3 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1676: CLOUDSTACK-9502: DS template copies don’t get dele...
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1676 @jburwell This is most likely blueorangutan issue. This code is already merged into Master via PR1560. We can even cancel this PR and leave it in 4.10 only. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1677: CLOUDSTACK-8830 - [Vmware] VM snapshot fails for 12 ...
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1677 LGTM for testing ``` 2016-10-24 20:52:55 47 test files ro run 2016-10-24 20:52:55 Running test file: test/integration/smoke/test_affinity_groups_projects.py 2016-10-24 20:56:07 Running test file: test/integration/smoke/test_affinity_groups.py 2016-10-24 20:59:18 Running test file: test/integration/smoke/test_deploy_vgpu_enabled_vm.py 2016-10-24 20:59:19 Running test file: test/integration/smoke/test_deploy_vm_iso.py 2016-10-24 21:16:20 Running test file: test/integration/smoke/test_deploy_vm_root_resize.py 2016-10-24 21:16:44 Running test file: test/integration/smoke/test_deploy_vms_with_varied_deploymentplanners.py 2016-10-24 21:21:22 Running test file: test/integration/smoke/test_deploy_vm_with_userdata.py 2016-10-24 21:24:32 Running test file: test/integration/smoke/test_disk_offerings.py 2016-10-24 21:24:33 Running test file: test/integration/smoke/test_dynamicroles.py 2016-10-24 21:24:34 Running test file: test/integration/smoke/test_global_settings.py 2016-10-24 21:24:35 Running test file: test/integration/smoke/test_guest_vlan_range.py 2016-10-24 21:24:59 Running test file: test/integration/smoke/test_hosts.py 2016-10-24 21:25:00 Running test file: test/integration/smoke/test_internal_lb.py 2016-10-24 22:05:15 Running test file: test/integration/smoke/test_iso.py 2016-10-24 22:10:16 Running test file: test/integration/smoke/test_list_ids_parameter.py 2016-10-24 22:24:18 Running test file: test/integration/smoke/test_loadbalance.py 2016-10-24 22:45:45 Running test file: test/integration/smoke/test_login.py 2016-10-24 22:46:09 Running test file: test/integration/smoke/test_multipleips_per_nic.py 2016-10-24 22:48:45 Running test file: test/integration/smoke/test_network_acl.py 2016-10-24 22:51:21 Running test file: test/integration/smoke/test_network.py 2016-10-24 23:23:44 Running test file: test/integration/smoke/test_nic_adapter_type.py 2016-10-24 23:23:52 Running test file: test/integration/smoke/test_nic.py 2016-10-24 23:33:13 Running test file: test/integration/smoke/test_non_contigiousvlan.py 2016-10-24 23:33:30 Running test file: test/integration/smoke/test_over_provisioning.py 2016-10-24 23:33:31 Running test file: test/integration/smoke/test_password_server.py 2016-10-24 23:37:44 Running test file: test/integration/smoke/test_portable_publicip.py 2016-10-24 23:39:07 Running test file: test/integration/smoke/test_primary_storage.py 2016-10-24 23:39:08 Running test file: test/integration/smoke/test_public_ip_range.py 2016-10-24 23:39:17 Running test file: test/integration/smoke/test_pvlan.py 2016-10-24 23:39:23 Running test file: test/integration/smoke/test_regions.py 2016-10-24 23:39:25 Running test file: test/integration/smoke/test_reset_vm_on_reboot.py 2016-10-24 23:42:47 Running test file: test/integration/smoke/test_resource_detail.py 2016-10-24 23:43:00 Running test file: test/integration/smoke/test_router_dhcphosts.py 2016-10-24 23:47:42 Running test file: test/integration/smoke/test_routers_iptables_default_policy.py 2016-10-24 23:54:49 Running test file: test/integration/smoke/test_routers.py 2016-10-25 00:02:55 Running test file: test/integration/smoke/test_scale_vm.py 2016-10-25 00:06:15 Running test file: test/integration/smoke/test_secondary_storage.py 2016-10-25 00:06:18 Running test file: test/integration/smoke/test_service_offerings.py 2016-10-25 00:10:42 Running test file: test/integration/smoke/test_snapshots.py 2016-10-25 00:15:15 Running test file: test/integration/smoke/test_ssvm.py 2016-10-25 00:33:50 Running test file: test/integration/smoke/test_staticroles.py 2016-10-25 00:34:31 Running test file: test/integration/smoke/test_templates.py 2016-10-25 00:50:07 Running test file: test/integration/smoke/test_usage_events.py 2016-10-25 00:50:08 Running test file: test/integration/smoke/test_vm_life_cycle.py 2016-10-25 01:05:18 Running test file: test/integration/smoke/test_vm_snapshots.py 2016-10-25 01:20:58 Running test file: test/integration/smoke/test_volumes.py 2016-10-25 01:38:21 Running test file: test/integration/smoke/test_vpc_vpn.py Test to update a physical network and extend its vlan ... === TestName: test_extendPhysicalNetworkVlan | Status : SUCCESS === ok Test Site 2 Site VPN Across redundant VPCs ... === TestName: test_01_redundant_vpc_site2site_vpn | Status : SUCCESS === ok Test Remote Access VPN in VPC ... === TestName: test_01_vpc_remote_access_vpn | Status : SUCCESS === ok Test Site 2 Site VPN Across VPCs ... === TestName: test_01_vpc_site2site_vpn | Status : SUCCESS === ok Test to create service offering ... === TestName: test_01_create_service_offering | Status : SUCCESS
[GitHub] cloudstack issue #1677: CLOUDSTACK-8830 - [Vmware] VM snapshot fails for 12 ...
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1677 @rhtyd @murali-reddy @PaulAngus @jburwell Thanks for fixing all outstanding Marvin test issues. We have now 100% passing score on Marvin integration tests on RHEL 6 management server , advanced networking, Vmware 5.5/6.0 hypervisors. Please find results for this PR --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1686: CLOUDSTACK-9507: ListVM response's guest_os id shoul...
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1686 @rhtyd This clearly a bug. os_type_id was always supposed to be a OS type as per: @SerializedName(ApiConstants.OS_TYPE_ID) @Param(description = "OS type id of the vm", since = "4.4") private String osTypeId; Currently it returns an OS Id. Guest OS UUID is already part of response as guestosid . Basically there are 3 options: 1. Fix current bug and correctly return OS type ID as os_type_id 2. Fix current bug but return OS type UUID as os_type_id 3. Fix current bug and correctly return OS type ID as os_type_id plus add a new response os_type_uuid that would be returning UUID of the guest Os category. I think #3 is overkill. I am for #2. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user serg38 commented on the issue:
https://github.com/apache/cloudstack/pull/1692
Thanks @rhtyd It didi it. Now two of them still fail but the rest are
successful
```
Tests out-of-band management ownership expiry across multi-mgmt server ...
=== TestName: test_oobm_multiple_mgmt_server_ownership | Status : FAILED ===
FAIL
Tests out-of-band management change password feature ... === TestName:
test_oobm_zchange_password | Status : EXCEPTION ===
ERROR
==
ERROR: Tests out-of-band management change password feature
--
Traceback (most recent call last):
File
"/home/t_vazqnadmin/cloudstack/test/integration/smoke/test_outofbandmanagement.py",
line 593, in test_oobm_zchange_password
self.assertTrue((len(alerts) - alertCount) > 0)
TypeError: object of type 'NoneType' has no len()
==
FAIL: Tests out-of-band management ownership expiry across multi-mgmt server
--
Traceback (most recent call last):
File
"/home/t_vazqnadmin/cloudstack/test/integration/smoke/test_outofbandmanagement.py",
line 524, in test_oobm_multiple_mgmt_server_ownership
self.fail("Management server failed to turn down or remove fake mgmt
server")
AssertionError: Management server failed to turn down or remove fake mgmt
server
--
Ran 16 tests in 1553.771s
FAILED (SKIP=1, errors=1, failures=1)
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1692 @rhtyd We run marvin tests on management server. Do we need any special configuration in test data for out-of-band-managment ? The errors seem to point at missing methods in CloudStackAPIClient == ERROR: Tests out-of-band management issue power soft action -- Traceback (most recent call last): File "/home/t_vazqnadmin/cloudstack/test/integration/smoke/test_outofbandmanagement.py", line 440, in test_oobm_issue_power_soft self.configureAndStartIpmiServer() File "/home/t_vazqnadmin/cloudstack/test/integration/smoke/test_outofbandmanagement.py", line 373, in configureAndStartIpmiServer self.configureAndEnableOobm() File "/home/t_vazqnadmin/cloudstack/test/integration/smoke/test_outofbandmanagement.py", line 157, in configureAndEnableOobm self.apiclient.configureOutOfBandManagement(self.getOobmConfigCmd()) **AttributeError: 'CloudStackAPIClient' object has no attribute 'configureOutOfBandManagement'** == ERROR: Tests out-of-band management issue power action -- Traceback (most recent call last): File "/home/t_vazqnadmin/cloudstack/test/integration/smoke/test_outofbandmanagement.py", line 395, in test_oobm_issue_power_status self.configureAndStartIpmiServer(power_state='on') File "/home/t_vazqnadmin/cloudstack/test/integration/smoke/test_outofbandmanagement.py", line 373, in configureAndStartIpmiServer self.configureAndEnableOobm() File "/home/t_vazqnadmin/cloudstack/test/integration/smoke/test_outofbandmanagement.py", line 157, in configureAndEnableOobm self.apiclient.configureOutOfBandManagement(self.getOobmConfigCmd()) **AttributeError: 'CloudStackAPIClient' object has no attribute 'configureOutOfBandManagement'** --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1703: Trillian testrun on PR-1692 fwd-merged on 4.9 branch
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1703 The same results as 1692. Overall much better state. We have still failure in execution of the following tests: test_privategw_acl test_routers_network_ops test_vpc_redundant test_vpc_router_nics All of the failure seem to be either environmental or due to incorrect ACL order . Also out-of-band management test give a lot of exceptions but this is as expected. We had to make one change that I propose to include. In test_service_offereing.py line 389 switch from range=20 to range=40 . In our tests variation in available RAM in CentOs was larger than 20 Mb so test_service_offereing fails. Let's merge this !!! Successful tests. RHEL 6 management server, advanced networking, Vmware 5.5/6 hypervisors ``` test DeployVM in anti-affinity groups for project ... === TestName: test_DeployVmAntiAffinityGroup_in_project | Status : SUCCESS === test DeployVM in anti-affinity groups ... === TestName: test_DeployVmAntiAffinityGroup | Status : SUCCESS === Test Deploy Virtual Machine from ISO ... === TestName: test_deploy_vm_from_iso | Status : SUCCESS === Test deploy virtual machine with root resize ... === TestName: test_00_deploy_vm_root_resize | Status : SUCCESS === Test proper failure to deploy virtual machine with rootdisksize of 0 ... === TestName: test_01_deploy_vm_root_resize | Status : SUCCESS === Test proper failure to deploy virtual machine with rootdisksize less than template size ... === TestName: test_02_deploy_vm_root_resize | Status : SUCCESS === Test to deploy vm with a first fit offering ... === TestName: test_deployvm_firstfit | Status : SUCCESS === Test deploy VMs using user concentrated planner ... === TestName: test_deployvm_userconcentrated | Status : SUCCESS === Test deploy VMs using user dispersion planner ... === TestName: test_deployvm_userdispersing | Status : SUCCESS === Test userdata as GET, size > 2k ... === TestName: test_deployvm_userdata | Status : SUCCESS === Test userdata as POST, size > 2k ... === TestName: test_deployvm_userdata_post | Status : SUCCESS === Test to create disk offering ... === TestName: test_01_create_disk_offering | Status : SUCCESS === Test to create a sparse type disk offering ... === TestName: test_02_create_sparse_type_disk_offering | Status : SUCCESS === Test to create a sparse type disk offering ... === TestName: test_04_create_fat_type_disk_offering | Status : SUCCESS === Test to update existing disk offering ... === TestName: test_02_edit_disk_offering | Status : SUCCESS === Test to delete disk offering ... === TestName: test_03_delete_disk_offering | Status : SUCCESS === test update configuration setting at zone level scope ... === TestName: test_UpdateConfigParamWithScope | Status : SUCCESS === Test guest vlan range dedication ... === TestName: test_dedicateGuestVlanRange | Status : SUCCESS === Test create, assign, remove of an Internal LB with roundrobin http traffic to 3 vm's in a Single VPC ... === TestName: test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 | Status : SUCCESS === Test create, assign, remove of an Internal LB with roundrobin http traffic to 3 vm's in a Redundant VPC ... === TestName: test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 | Status : SUCCESS === Test to verify access to loadbalancer haproxy admin stats page ... === TestName: test_03_vpc_internallb_haproxy_stats_on_all_interfaces | Status : SUCCESS === Test to verify access to loadbalancer haproxy admin stats page ... === TestName: test_04_rvpc_internallb_haproxy_stats_on_all_interfaces | Status : SUCCESS === Test create public & private ISO ... === TestName: test_01_create_iso | Status : SUCCESS === Test Edit ISO ... === TestName: test_02_edit_iso | Status : SUCCESS === Test delete ISO ... === TestName: test_03_delete_iso | Status : SUCCESS === Test for extract ISO ... === TestName: test_04_extract_Iso | Status : SUCCESS === Update & Test for ISO permissions ... === TestName: test_05_iso_permissions | Status : SUCCESS === Test delete ISO ... === TestName: test_07_list_default_iso | Status : SUCCESS === Test listing Volumes using 'ids' parameter ... === TestName: test_01_list_volumes | Status : SUCCESS === Test listing Templates using 'ids' parameter ... === TestName: test_02_list_templates | Status : SUCCESS === Test listing Snapshots using 'ids' parameter ... === TestName: test_03_list_snapshots | Status : SUCCESS === Test to create Load balancing rule with source NAT ... === TestName: test_01_create_lb_rule_src_nat | Status : SUCCESS === Test to create Load balancing rule with non source NAT ... === TestName: test_02_create_lb_rule_non_nat | Status : SUCCESS === Test
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1692 Failed tests ``` test_02_vpc_privategw_static_routes (integration.smoke.test_privategw_acl.TestPrivateGwACL) ... === TestName: test_02_vpc_privategw_static_routes | Status : FAILED === test_03_vpc_privategw_restart_vpc_cleanup (integration.smoke.test_privategw_acl.TestPrivateGwACL) ... === TestName: test_03_vpc_privategw_restart_vpc_cleanup | Status : FAILED === test_04_rvpc_privategw_static_routes (integration.smoke.test_privategw_acl.TestPrivateGwACL) ... === TestName: test_04_rvpc_privategw_static_routes | Status : FAILED === Test redundant router internals ... === TestName: test_02_isolate_network_FW_PF_default_routes_egress_false | Status : FAILED === Create a redundant VPC with two networks with two VMs in each network ... === TestName: test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL | Status : FAILED === Create a VPC with two networks with one VM in each network and test nics after destroy ... === TestName: test_01_VPC_nics_after_destroy | Status : FAILED === ``` Exceptions: ``` Tests out-of-band management background powerstate sync ... === TestName: test_oobm_background_powerstate_sync | Status : EXCEPTION === Tests out-of-band management configuration with valid data ... === TestName: test_oobm_configure_default_driver | Status : EXCEPTION === Tests out-of-band management configuration with invalid driver ... === TestName: test_oobm_configure_invalid_driver | Status : EXCEPTION === Tests out-of-band management host disable feature with ... === TestName: test_oobm_disable_feature_invalid | Status : EXCEPTION === Tests out-of-band management host disable feature with ... === TestName: test_oobm_disable_feature_valid | Status : EXCEPTION === Tests out-of-band management host enable feature with ... === TestName: test_oobm_enable_feature_invalid | Status : EXCEPTION === Tests out-of-band management host enable feature with ... === TestName: test_oobm_enable_feature_valid | Status : EXCEPTION === Tests out-of-band management enable/disable feature at cluster ... === TestName: test_oobm_enabledisable_across_clusterzones | Status : EXCEPTION === Tests out-of-band management issue power cycle action ... === TestName: test_oobm_issue_power_cycle | Status : EXCEPTION === Tests out-of-band management issue power off action ... === TestName: test_oobm_issue_power_off | Status : EXCEPTION === Tests out-of-band management issue power on action ... === TestName: test_oobm_issue_power_on | Status : EXCEPTION === Tests out-of-band management issue power reset action ... === TestName: test_oobm_issue_power_reset | Status : EXCEPTION === Tests out-of-band management issue power soft action ... === TestName: test_oobm_issue_power_soft | Status : EXCEPTION === Tests out-of-band management issue power action ... === TestName: test_oobm_issue_power_status | Status : EXCEPTION === Tests out-of-band management ownership expiry across multi-mgmt server ... === TestName: test_oobm_multiple_mgmt_server_ownership | Status : EXCEPTION === Tests out-of-band management change password feature ... === TestName: test_oobm_zchange_password | Status : EXCEPTION === ``` --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1692 Successful tests. RHEL 6 management server, advanced networking, Vmware 5.5/6 hypervisors ``` test DeployVM in anti-affinity groups for project ... === TestName: test_DeployVmAntiAffinityGroup_in_project | Status : SUCCESS === test DeployVM in anti-affinity groups ... === TestName: test_DeployVmAntiAffinityGroup | Status : SUCCESS === Test Deploy Virtual Machine from ISO ... === TestName: test_deploy_vm_from_iso | Status : SUCCESS === Test deploy virtual machine with root resize ... === TestName: test_00_deploy_vm_root_resize | Status : SUCCESS === Test proper failure to deploy virtual machine with rootdisksize of 0 ... === TestName: test_01_deploy_vm_root_resize | Status : SUCCESS === Test proper failure to deploy virtual machine with rootdisksize less than template size ... === TestName: test_02_deploy_vm_root_resize | Status : SUCCESS === Test to deploy vm with a first fit offering ... === TestName: test_deployvm_firstfit | Status : SUCCESS === Test deploy VMs using user concentrated planner ... === TestName: test_deployvm_userconcentrated | Status : SUCCESS === Test deploy VMs using user dispersion planner ... === TestName: test_deployvm_userdispersing | Status : SUCCESS === Test userdata as GET, size > 2k ... === TestName: test_deployvm_userdata | Status : SUCCESS === Test userdata as POST, size > 2k ... === TestName: test_deployvm_userdata_post | Status : SUCCESS === Test to create disk offering ... === TestName: test_01_create_disk_offering | Status : SUCCESS === Test to create a sparse type disk offering ... === TestName: test_02_create_sparse_type_disk_offering | Status : SUCCESS === Test to create a sparse type disk offering ... === TestName: test_04_create_fat_type_disk_offering | Status : SUCCESS === Test to update existing disk offering ... === TestName: test_02_edit_disk_offering | Status : SUCCESS === Test to delete disk offering ... === TestName: test_03_delete_disk_offering | Status : SUCCESS === test update configuration setting at zone level scope ... === TestName: test_UpdateConfigParamWithScope | Status : SUCCESS === Test guest vlan range dedication ... === TestName: test_dedicateGuestVlanRange | Status : SUCCESS === Test create, assign, remove of an Internal LB with roundrobin http traffic to 3 vm's in a Single VPC ... === TestName: test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 | Status : SUCCESS === Test create, assign, remove of an Internal LB with roundrobin http traffic to 3 vm's in a Redundant VPC ... === TestName: test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 | Status : SUCCESS === Test to verify access to loadbalancer haproxy admin stats page ... === TestName: test_03_vpc_internallb_haproxy_stats_on_all_interfaces | Status : SUCCESS === Test to verify access to loadbalancer haproxy admin stats page ... === TestName: test_04_rvpc_internallb_haproxy_stats_on_all_interfaces | Status : SUCCESS === Test create public & private ISO ... === TestName: test_01_create_iso | Status : SUCCESS === Test Edit ISO ... === TestName: test_02_edit_iso | Status : SUCCESS === Test delete ISO ... === TestName: test_03_delete_iso | Status : SUCCESS === Test for extract ISO ... === TestName: test_04_extract_Iso | Status : SUCCESS === Update & Test for ISO permissions ... === TestName: test_05_iso_permissions | Status : SUCCESS === Test delete ISO ... === TestName: test_07_list_default_iso | Status : SUCCESS === Test listing Volumes using 'ids' parameter ... === TestName: test_01_list_volumes | Status : SUCCESS === Test listing Templates using 'ids' parameter ... === TestName: test_02_list_templates | Status : SUCCESS === Test listing Snapshots using 'ids' parameter ... === TestName: test_03_list_snapshots | Status : SUCCESS === Test to create Load balancing rule with source NAT ... === TestName: test_01_create_lb_rule_src_nat | Status : SUCCESS === Test to create Load balancing rule with non source NAT ... === TestName: test_02_create_lb_rule_non_nat | Status : SUCCESS === Test for assign & removing load balancing rule ... === TestName: test_assign_and_removal_lb | Status : SUCCESS === Tests that SAML users are not allowed CloudStack local log in ... === TestName: login_test_saml_user | Status : SUCCESS === test_nic_secondaryip_add_remove (integration.smoke.test_multipleips_per_nic.TestDeployVM) ... === TestName: test_nic_secondaryip_add_remove | Status : SUCCESS === Test network ACL lists and items in VPC ... === TestName: test_network_acl | Status : SUCCESS === Test for delete account ... === TestName: test_delete_account | Status : SUCCESS === Test for port forwarding on source NAT ... === TestName: test_01_port_fwd_on_src_nat
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1692 We finished testing on vmware 5.5 and 6. Overall much better state. We have still failure in execution of the following tests: test_privategw_acl test_routers_network_ops test_vpc_redundant test_vpc_router_nics All of the failure seem to be either environmental or due to incorrect ACL order . Also out-of-band management test give a lot of exceptions but this is as expected. We had to make one change that I propose to include. In test_service_offereing.py line 389 switch from range=20 to range=40 . In our tests variation in available RAM in CentOs was larger than 20 Mb so test_service_offereing fails. So this is another testing LGTM for vmware 5.5 and 6. I will post test results in few min. Let's get all related PRs merged ASAP now. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1692 We will post results later today for Vmware 5.5/6 tests --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1692 Yes +1 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1692 @rhtyd Yes I totally agree. It could take a while to flash out the remaining issues and we should complete the release and allow merging outstanding PRs in the meantime. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #872: Strongswan vpn feature
Github user serg38 commented on the issue:
https://github.com/apache/cloudstack/pull/872
@swill Can you try changing in ipsec.conf
plutostart=no
keyexchange=ikev2
and adding
ike=aes256-sha1-modp1024!
esp=aes256-sha1!
From: Will Stevens
Reply-To: apache/cloudstack
Date: Friday, October 7, 2016 at 12:27 PM
To: apache/cloudstack
Cc: Sergey Levitskiy , Mention
Subject: Re: [apache/cloudstack] Strongswan vpn feature (#872)
At @serg38<https://github.com/serg38>'s request, here are the current
configs...
# cat /etc/strongswan.conf
# strongswan.conf - strongSwan configuration file
#
# Refer to the strongswan.conf(5) manpage for details
#
# Configuration changes should be made in the included files
charon {
load_modular = yes
plugins {
include strongswan.d/charon/*.conf
}
}
include strongswan.d/*.conf
# cat /etc/strongswan.d/charon/*.conf
addrblock {
# Whether to load the plugin. Can also be an integer to increase the
# priority of this plugin.
load = yes
}
aes {
# Whether to load the plugin. Can also be an integer to increase the
# priority of this plugin.
load = yes
}
af-alg {
# Whether to load the plugin. Can also be an integer to increase the
# priority of this plugin.
load = yes
}
# Section to specify arbitrary attributes that are assigned to a peer via
# configuration payload (CP).
attr {
# is an attribute name or an integer, values can be an IP
address,
# subnet or arbitrary value.
# =
# Whether to load the plugin. Can also be an integer to increase the
# priority of this plugin.
load = yes
}
ccm {
# Whether to load the plugin. Can also be an integer to increase the
# priority of this plugin.
load = yes
}
certexpire {
# Whether to load the plugin. Can also be an integer to increase the
# priority of this plugin.
load = yes
csv {
# Cron style string specifying CSV export times.
# cron =
# String to use in empty intermediate CA fields.
# empty_string =
# Use a fixed intermediate CA field count.
# fixed_fields = yes
# Force export of all trustchains we have a private key for.
# force = yes
# strftime(3) format string to export expiration dates as.
# format = %d:%m:%Y
# strftime(3) format string for the CSV file name to export local
# certificates to.
# local =
# strftime(3) format string for the CSV file name to export remote
# certificates to.
# remote =
# CSV field separator.
# separator = ,
}
}
cmac {
# Whether to load the plugin. Can also be an integer to increase the
# priority of this plugin.
load = yes
}
constraints {
# Whether to load the plugin. Can also be an integer to increase the
# priority of this plugin.
load = yes
}
ctr {
# Whether to load the plugin. Can also be an integer to increase the
# priority of this plugin.
load = yes
}
curl {
# Whether to load the plugin. Can also be an integer to increase the
# priority of this plugin.
load = yes
}
dhcp {
# Always use the configured server address.
# force_server_address = no
# Derive user-defined MAC address from hash of IKE identity.
# identity_lease = no
# Interface name the plugin uses for address allocation.
# interface =
# Whether to load the plugin. Can also be an integer to increase the
# priority of this plugin.
load = yes
# DHCP server
[GitHub] cloudstack issue #1702: CLOUDSTACK-9535: [API] listVMSnapshots improvement
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1702 Testing LGTM. Vmware 5.5. and 6.0 , advanced networking, RHEL 6 management servers ``` test DeployVM in anti-affinity groups for project ... === TestName: test_DeployVmAntiAffinityGroup_in_project | Status : SUCCESS === test DeployVM in anti-affinity groups ... === TestName: test_DeployVmAntiAffinityGroup | Status : SUCCESS === Test Deploy Virtual Machine ... SKIP: Skipping test because suitable hypervisor/host notpresent Test Deploy Virtual Machine from ISO ... === TestName: test_deploy_vm_from_iso | Status : SUCCESS === Test deploy virtual machine with root resize ... === TestName: test_00_deploy_vm_root_resize | Status : SUCCESS === Test proper failure to deploy virtual machine with rootdisksize of 0 ... === TestName: test_01_deploy_vm_root_resize | Status : SUCCESS === Test proper failure to deploy virtual machine with rootdisksize less than template size ... === TestName: test_02_deploy_vm_root_resize | Status : SUCCESS === Test to deploy vm with a first fit offering ... === TestName: test_deployvm_firstfit | Status : SUCCESS === Test deploy VMs using user concentrated planner ... === TestName: test_deployvm_userconcentrated | Status : SUCCESS === Test deploy VMs using user dispersion planner ... === TestName: test_deployvm_userdispersing | Status : SUCCESS === Test userdata as GET, size > 2k ... === TestName: test_deployvm_userdata | Status : SUCCESS === Test userdata as POST, size > 2k ... === TestName: test_deployvm_userdata_post | Status : SUCCESS === Test to create disk offering ... === TestName: test_01_create_disk_offering | Status : SUCCESS === Test to create a sparse type disk offering ... === TestName: test_02_create_sparse_type_disk_offering | Status : SUCCESS === Test to create a sparse type disk offering ... === TestName: test_04_create_fat_type_disk_offering | Status : SUCCESS === Test to update existing disk offering ... === TestName: test_02_edit_disk_offering | Status : SUCCESS === Test to delete disk offering ... === TestName: test_03_delete_disk_offering | Status : SUCCESS === Test to ensure 4 default roles cannot be deleted ... SKIP: Dynamic Role-Based API checker not enabled, skipping test Test to check role, role permissions and account life cycles ... SKIP: Dynamic Role-Based API checker not enabled, skipping test Test for role-rule enforcement in case of multiple mgmt servers ... SKIP: Dynamic Role-Based API checker not enabled, skipping test Test to ensure role in use cannot be deleted ... SKIP: Dynamic Role-Based API checker not enabled, skipping test Tests normal lifecycle operations for roles ... SKIP: Dynamic Role-Based API checker not enabled, skipping test Tests role update ... SKIP: Dynamic Role-Based API checker not enabled, skipping test Tests that default four roles exist ... SKIP: Dynamic Role-Based API checker not enabled, skipping test Tests role update ... SKIP: Dynamic Role-Based API checker not enabled, skipping test Tests role update when role is in use by an account ... SKIP: Dynamic Role-Based API checker not enabled, skipping test Tests concurrent order updation of role permission ... SKIP: Dynamic Role-Based API checker not enabled, skipping test Tests creation of role permission ... SKIP: Dynamic Role-Based API checker not enabled, skipping test Tests deletion of role permission ... SKIP: Dynamic Role-Based API checker not enabled, skipping test Tests listing of default role's permission ... SKIP: Dynamic Role-Based API checker not enabled, skipping test Tests order updation of role permission ... SKIP: Dynamic Role-Based API checker not enabled, skipping test test update configuration setting at zone level scope ... === TestName: test_UpdateConfigParamWithScope | Status : SUCCESS === Test guest vlan range dedication ... === TestName: test_dedicateGuestVlanRange | Status : SUCCESS === Test create public & private ISO ... === TestName: test_01_create_iso | Status : SUCCESS === Test Edit ISO ... === TestName: test_02_edit_iso | Status : SUCCESS === Test delete ISO ... === TestName: test_03_delete_iso | Status : SUCCESS === Test for extract ISO ... === TestName: test_04_extract_Iso | Status : SUCCESS === Update & Test for ISO permissions ... === TestName: test_05_iso_permissions | Status : SUCCESS === Test for copy ISO from one zone to another ... SKIP: Not enough zones available to perform copy template Test delete ISO ... === TestName: test_07_list_default_iso | Status : SUCCESS === Test listing Volumes using 'ids' parameter ... === TestName: test_01_list_volumes | Status : SUCCESS === Test listing Templates using 'ids' parameter ... === TestName: test_02_list_templates | Status :
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1692 @rhtyd Vmsnapshot tests fail on vmware 6.0 due to issue resolved in PR1677. 1677 is targeted for 4.9 so I agree on removing that test for ACS 4.8 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #872: Strongswan vpn feature
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/872 @swill The default way is using integrated VPN client in Windows. For windows 8.1 the guide is here https://blogs.technet.microsoft.com/networking/2014/01/13/configuring-native-vpn-client-through-pc-settings/ For Windows 7 a pretty good step by step instruction here: http://www.databasemart.com/HowTo/Cisco_VPN_Remote_Access_Setup_Windows_7.aspx And here it is for Windows 10 but I never tried it there http://www.simplehelp.net/2015/08/02/how-to-set-up-a-vpn-in-windows-10/ --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1698: CLOUDSTACK-9525 add support for windows 10 guest os ...
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1698 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1696: [4.9/lts] CLOUDSTACK-9364: Add Ubuntu 16.04 as a gue...
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1696 @rhtyd @jburwell Please don't forget to close loop on this PR. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1698: CLOUDSTACK-9525 add support for windows 10 guest os ...
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1698 On Vmware they are Windows 10 is supported only starting ESX 6 so only 3 extra lines would be needed. I will help with testing on vmware: INSERT IGNORE INTO `cloud`.`guest_os_hypervisor` (uuid,hypervisor_type, hypervisor_version, guest_os_name, guest_os_id, created) VALUES (UUID(),'VMware', '6.0', 'windows9_64Guest', 258, utc_timestamp()); INSERT IGNORE INTO `cloud`.`guest_os_hypervisor` (uuid,hypervisor_type, hypervisor_version, guest_os_name, guest_os_id, created) VALUES (UUID(),'VMware', '6.0', 'windows9Guest', 257, utc_timestamp()); INSERT IGNORE INTO `cloud`.`guest_os_hypervisor` (uuid,hypervisor_type, hypervisor_version, guest_os_name, guest_os_id, created) VALUES (UUID(),'VMware', '6.0', 'windows9Server64Guest', 259, utc_timestamp()) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1692 @NuxRo Then 'Other Linux (64-bit)' will be appropriate. It works for the time being as PV with current vmware but could fail at some point. For example when we were testing @rhtyd tiny template it was going into the kernel lock with PV OS type but was working fine when ostype was changed to Linux. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1692 @jburwell @rhtyd @borisstoyanov Do you have to do anything to make test_lb_internal to pass on Vmware? No matter what we try we get 3 exceptions 2016-10-04 07:18:24,897 - CRITICAL - EXCEPTION: execute_internallb_haproxy_tests: ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python2.7/unittest/case.py", line 331, in run\n testMethod()\n', 'TypeError: execute_internallb_haproxy_tests() takes exactly 2 arguments (1 given)\n'] 2016-10-04 07:18:24,898 - CRITICAL - EXCEPTION: execute_internallb_roundrobin_tests: ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python2.7/unittest/case.py", line 331, in run\n testMethod()\n', 'TypeError: execute_internallb_roundrobin_tests() takes exactly 2 arguments (1 given)\n'] 2016-10-04 07:18:24,899 - CRITICAL - EXCEPTION: run_ssh_test_accross_hosts: ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python2.7/unittest/case.py", line 331, in run\n testMethod()\n', 'TypeError: run_ssh_test_accross_hosts() takes at least 3 arguments (1 given)\n'] --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1692 I suggest also to change OS type in test_internal_lb.py and test_vpc_vpn for "macchinina vmware" from "ostype": "Other PV (64-bit)", to "ostype": "Other Linux (32-bit)" Macchinina is a Linux so there is no guarantee PV implementation in vmware won't break it at some point if left as it is. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user serg38 commented on the issue:
https://github.com/apache/cloudstack/pull/1692
@jburwell Sorry my bad. It is PR 871 . The reason the test fails is:
```
After running test_vm_snapshots.py we're getting exception on
test_01_test_vm_volume_snapshot as it was expected before your changes in this
PR.
We're getting: 'CloudstackAPIException: Execute cmd: createsnapshot failed,
due to: errorCode: 431, errorText:Volume snapshot is not allowed, please detach
it from VM with VM Snapshots\n']
This is consistent with VolumeApiServiceImpl.allocSnapshot method, in which
it is:
if (volume.getInstanceId() != null) {
// Check that Vm to which this volume is attached does not have
VM Snapshots
if (_vmSnapshotDao.findByVm(volume.getInstanceId()).size() > 0)
{
throw new InvalidParameterValueException("Volume snapshot
is not allowed, please detach it from VM with VM Snapshots");
}
}
```
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1692 BTW failure of test_01_test_vm_volume_snapshot is due to PR571 which modified marvin test to succeed against incorrect functionality. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1692 I am LGTM on this now. Thanks @NuxRo @PaulAngus @rhtyd for fixing maccinina template. VPN_VPC and INTERNAL_LB test work for Vmware --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1696: [4.9/lts] CLOUDSTACK-9364: Add Ubuntu 16.04 as a gue...
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1696 @rhtyd @jburwell Actually ESX 6 mapping are here schema-461to470.sql INSERT IGNORE INTO `cloud`.`hypervisor_capabilities` values (25,UUID(),'VMware','6.0',128,0,13,32,1,1); INSERT IGNORE INTO `cloud`.`guest_os_hypervisor` (uuid,hypervisor_type, hypervisor_version, guest_os_name, guest_os_id, created, is_user_defined) SELECT UUID(),'VMware', '6.0', guest_os_name, guest_os_id, utc_timestamp(), 0 FROM `cloud`.`guest_os_hypervisor` WHERE hypervisor_type='VMware' AND hypervisor_version='5.5' AND (guest_os_id NOT IN (1,2,3,4,62,63,64,65,156,157,221,222) AND guest_os_id NOT BETWEEN 121 AND 130); --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1698: CLOUDSTACK-9525 add support for windows 10 guest os ...
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1698 @karuturi Can we add mappings for Windows 10 for Vmware hypervisors as well? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1696: [4.9/lts] CLOUDSTACK-9364: Add Ubuntu 16.04 as a gue...
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1696 @jburwell @rhtyd I apologies. The issue in our environment was due to using ESX v6. Once I added new mapping for it Vmware properly assigned Os type. It would be nice to officially certify ESX6 for ACS. It has been a supported platform for one of the commercial distribution for some time already. INSERT IGNORE INTO `cloud`.`guest_os_hypervisor` (uuid,hypervisor_type, hypervisor_version, guest_os_name, guest_os_id, created, is_user_defined) VALUES (UUID(),'VMware', '6.0', 'ubuntuGuest', 255, utc_timestamp(), 0); INSERT IGNORE INTO `cloud`.`guest_os_hypervisor` (uuid,hypervisor_type, hypervisor_version, guest_os_name, guest_os_id, created, is_user_defined) VALUES (UUID(),'VMware', '6.0', 'ubuntu64Guest', 256, utc_timestamp(), 0); --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1696: [4.9/lts] CLOUDSTACK-9364: Add Ubuntu 16.04 as a gue...
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1696 @jburwell @rhtyd Sorry for a flood of messages. I checked and we do have mapping for all OS for Vmware 6 in ACS. It was introduced in 4.7 so that means this PR needs to have those 2 lines added (or a new PR created for this) INSERT IGNORE INTO cloud.guest_os_hypervisor (uuid,hypervisor_type, hypervisor_version, guest_os_name, guest_os_id, created, is_user_defined) VALUES (UUID(),'VMware', '6.0', 'ubuntuGuest', 255, utc_timestamp(), 0); INSERT IGNORE INTO cloud.guest_os_hypervisor (uuid,hypervisor_type, hypervisor_version, guest_os_name, guest_os_id, created, is_user_defined) VALUES (UUID(),'VMware', '6.0', 'ubuntu64Guest', 256, utc_timestamp(), 0); --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1696: [4.9/lts] CLOUDSTACK-9364: Add Ubuntu 16.04 as a gue...
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1696 @rhtyd @jburwell @karuturi I confirm the same issue with this PR as with 'CLOUDSTACK-5922:Incorrect handling RHEL guests for 5.5 to 5.9 When Os type is specified as Ubuntu 16.04  and VM is started on VmWare it actually creates VM with OS type 'Other (64-bit)'  The fix was to put a respective entry into vmware-base/src/com/cloud/hypervisor/vmware/util/VmwareGuestOsMapper.java https://github.com/apache/cloudstack/commit/05c6b455ae89480d84ba5dfa4dc79d3336ebd458 Can we roll back this PR and make it right? An alternative path wold be to figure out why adding entries into tables is not good enough and why changes in the code is still required. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1698: CLOUDSTACK-9525 add support for windows 10 guest os ...
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1698 @karuturi @rhtyd I might be mistaken but we also need to add mapping into cloudstack/vmware-base/src/com/cloud/hypervisor/vmware/util/VmwareGuestOsMapper and/or plugins/hypervisors/kvm/src/com/cloud/hypervisor/kvm/resource/KVMGuestOsMapper In the past if not added on vmware it would create VM with 'Other-64 bit' OS type instead e.g. this Jira ticket 'CLOUDSTACK-5922:Incorrect handling RHEL guests for 5.5 to 5.9' The same concern is for recently merged PR1696. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1696: [4.9/lts] CLOUDSTACK-9364: Add Ubuntu 16.04 as a gue...
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1696 @rhtyd I might be mistaken but you also need to add mapping into cloudstack/vmware-base/src/com/cloud/hypervisor/vmware/util/VmwareGuestOsMapper In the past if not added on vmware it would create VM with 'Other-64 bit' OS type e.g. CLOUDSTACK-5922:Incorrect handling RHEL guests for 5.5 to 5.9 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1692 I agree with @PaulAngus on URL fix. So if we want to have this PR to get in asap I am on board but some smoke tests will continue failing until driver issue in the template is addressed --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1692: Fix Smoke Test Failures
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1692 The same concerns about macchinina template remains. Since it doesn't have correct E1000/vmxnet3 driver embedded any smoke test in Vmware environment will continue failing. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1676: CLOUDSTACK-9502: DS template copies don’t get dele...
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1676 @jburwell This is already in master. @nvazquez opened this to target 4.9 and forward merge. It is completely fine for fix to be 4.10 only since it only affects rather special circumstances. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1542: CLOUDSTACK-9379: Support nested virtualization at VM...
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1542 @jburwell This sounds like a good idea. In this PR all abstraction work is done so the things to do would be to implement support in respective hypervisor resources as well as strip "vmware." prefix from conjuration items. @nvazquez is preparing intragrtion test based on @rhtyd idea --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1542: CLOUDSTACK-9379: Support nested virtualization at VM...
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1542 Great tip, @rhtyd This way it is actually very straightforward. We should be able to come up with integration test for this PR shortly --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1542: CLOUDSTACK-9379: Support nested virtualization at VM...
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1542 @jburwell @rhtyd Thanks in advance --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1542: CLOUDSTACK-9379: Support nested virtualization at VM...
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1542 @jburwell The only BUILTIN Centos template for Vmware is 5.3 that doesn't have KVM support to my knowledge. Are you proposing to introduce another BUILTIN template so that it is available for anyone to use during the integration testing? We don't have any KVM expertise at this point so this will be next to mission impossible. The only option for us would be to package vSphere python SDK and try to talk to vCenter directly. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1693: CLOUDSTACK-9505: Fix test_deploy_vgpu_enabled tests ...
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1693 LGTM on the testing ``` test DeployVM in anti-affinity groups for project ... === TestName: test_DeployVmAntiAffinityGroup_in_project | Status : SUCCESS === test DeployVM in anti-affinity groups ... === TestName: test_DeployVmAntiAffinityGroup | Status : SUCCESS === Test 3D GPU support ... === TestName: test_3d_gpu_support | Status : SUCCESS === Test Deploy Virtual Machine ... SKIP: This test case is written specificallyfor XenServer hypervisor Test Deploy Virtual Machine from ISO ... === TestName: test_deploy_vm_from_iso | Status : SUCCESS === Test deploy virtual machine with root resize ... === TestName: test_00_deploy_vm_root_resize | Status : SUCCESS === Test proper failure to deploy virtual machine with rootdisksize of 0 ... === TestName: test_01_deploy_vm_root_resize | Status : SUCCESS === Test proper failure to deploy virtual machine with rootdisksize less than template size ... === TestName: test_02_deploy_vm_root_resize | Status : SUCCESS === Test to deploy vm with a first fit offering ... === TestName: test_deployvm_firstfit | Status : SUCCESS === Test deploy VMs using user concentrated planner ... === TestName: test_deployvm_userconcentrated | Status : SUCCESS === Test deploy VMs using user dispersion planner ... === TestName: test_deployvm_userdispersing | Status : SUCCESS === Test userdata as GET, size > 2k ... === TestName: test_deployvm_userdata | Status : SUCCESS === Test userdata as POST, size > 2k ... === TestName: test_deployvm_userdata_post | Status : SUCCESS === Test to create disk offering ... === TestName: test_01_create_disk_offering | Status : SUCCESS === Test to create a sparse type disk offering ... === TestName: test_02_create_sparse_type_disk_offering | Status : SUCCESS === Test to create a sparse type disk offering ... === TestName: test_04_create_fat_type_disk_offering | Status : SUCCESS === Test to update existing disk offering ... === TestName: test_02_edit_disk_offering | Status : SUCCESS === Test to delete disk offering ... === TestName: test_03_delete_disk_offering | Status : SUCCESS === Test to ensure 4 default roles cannot be deleted ... SKIP: Dynamic Role-Based API checker not enabled, skipping test Test to check role, role permissions and account life cycles ... SKIP: Dynamic Role-Based API checker not enabled, skipping test Test for role-rule enforcement in case of multiple mgmt servers ... SKIP: Dynamic Role-Based API checker not enabled, skipping test Test to ensure role in use cannot be deleted ... SKIP: Dynamic Role-Based API checker not enabled, skipping test Tests normal lifecycle operations for roles ... SKIP: Dynamic Role-Based API checker not enabled, skipping test Tests role update ... SKIP: Dynamic Role-Based API checker not enabled, skipping test Tests that default four roles exist ... SKIP: Dynamic Role-Based API checker not enabled, skipping test Tests role update ... SKIP: Dynamic Role-Based API checker not enabled, skipping test Tests role update when role is in use by an account ... SKIP: Dynamic Role-Based API checker not enabled, skipping test Tests concurrent order updation of role permission ... SKIP: Dynamic Role-Based API checker not enabled, skipping test Tests creation of role permission ... SKIP: Dynamic Role-Based API checker not enabled, skipping test Tests deletion of role permission ... SKIP: Dynamic Role-Based API checker not enabled, skipping test Tests listing of default role's permission ... SKIP: Dynamic Role-Based API checker not enabled, skipping test Tests order updation of role permission ... SKIP: Dynamic Role-Based API checker not enabled, skipping test test update configuration setting at zone level scope ... === TestName: test_UpdateConfigParamWithScope | Status : SUCCESS === Test guest vlan range dedication ... === TestName: test_dedicateGuestVlanRange | Status : SUCCESS === Test create public & private ISO ... === TestName: test_01_create_iso | Status : SUCCESS === Test Edit ISO ... === TestName: test_02_edit_iso | Status : SUCCESS === Test delete ISO ... === TestName: test_03_delete_iso | Status : SUCCESS === Test for extract ISO ... === TestName: test_04_extract_Iso | Status : SUCCESS === Update & Test for ISO permissions ... === TestName: test_05_iso_permissions | Status : SUCCESS === Test for copy ISO from one zone to another ... SKIP: Not enough zones available to perform copy template Test delete ISO ... === TestName: test_07_list_default_iso | Status : SUCCESS === Test listing Volumes using 'ids' parameter ... === TestName: test_01_list_volumes | Status : SUCCESS === Test listing Templates using 'ids' parameter ... === TestName: te
[GitHub] cloudstack issue #1542: CLOUDSTACK-9379: Support nested virtualization at VM...
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1542 @jburwell Creating Marvin test for this PR will be a huge undertaking. It would require building and configuring a hypervisor in a deployed VM and then creating VM in VM. Considering storage, environmental and network implication the test will be complicated and error prone. An alternative approach would require integrating vSphere SDK with Marvin python libraries and query vSphere for the actual nested virtualization settings from a deployed VM. The effort doesn't seem to be warranted for such a minor change. As long as standard integration suite is passing this shouldn't affect any existing functionality. What do you think? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1593: CLOUDSTACK-9417: Usage module refactoring
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1593 @rafaelweingartner @rhtyd Do we make any decision on this? The scope of this PR was very limited initially. It would be much easier if we don't expand it too far. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1615: CLOUDSTACK-9438: Fix for CLOUDSTACK-9252 - Make NFS ...
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1615 @jburwell @karuturi @rafaelweingartner Can you check if this PR can be merged by the upcoming release? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1677: CLOUDSTACK-8830 - [Vmware] VM snapshot fails for 12 ...
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1677 @jburwell It would be nice to include this PR to the upcoming release. Are there anything else needed ? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1542: CLOUDSTACK-9379: Support nested virtualization at VM...
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1542 @rafaelweingartner @jburwell @karuturi Looks like this PR has everything to get merged. Can we do it by the release freeze? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1686: CLOUDSTACK-9507: ListVM response's guest_os id shoul...
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1686 @rhytd Current implementation has a bug as well that returns GuestOsId in place of GuestOsTypeId. I am for not only switching to UUID but also for fixing it and returning correct output. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1677: CLOUDSTACK-8830 - [Vmware] VM snapshot fails for 12 ...
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1677 @jburwell test_vm_snaphot only. Originally all 4 tests inside it would fail. With the fix one test still fails but it is unrelated to this issue and a conversation started in PR871. We would need either revert PR871 or open a new PR to resolve 4th test failure. Test to create VM snapshots ... === TestName: test_01_create_vm_snapshots | Status : SUCCESS === Test to revert VM snapshots ... === TestName: test_02_revert_vm_snapshots | Status : SUCCESS === Test to delete vm snapshots ... === TestName: test_03_delete_vm_snapshots | Status : SUCCESS === === TestName: test_01_test_vm_volume_snapshot | Status : EXCEPTION === --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1677: CLOUDSTACK-8830 - [Vmware] VM snapshot fails for 12 ...
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1677 @jburwell This issue doesn't manifest on ESX 5.5. We already confirmed it resolves the issue to up to 4.5 branch. test_vm_snapshot which fails on ESX 6 now works fine. I can post test suite results shortly --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cloudstack issue #1686: CLOUDSTACK-9507: ListVM response's guest_os id shoul...
Github user serg38 commented on the issue: https://github.com/apache/cloudstack/pull/1686 @rhtyd I think you meant guest_os_type not guest_os_id. In this case the issue is not only that it returns ID instead of UUID but also that it doesn't return ID of os type. In the sample output ostypeid":12 is not correct OS type which is supposed to be 1 ( CentOs). The right response seems to be userVmResponse.setOsTypeId(userVm.getGuestType().toString()); vs userVmResponse.setOsTypeId(userVm.getGuestOsUuid()); --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
