This is an automated email from the ASF dual-hosted git repository.
shwstppr pushed a change to branch scalability-improvements
in repository https://gitbox.apache.org/repos/asf/cloudstack.git
was 0fbdbca10f3 test fix
This change permanently discards the following revisions:
discard 0fbdbca10f3 test fix
discard 1aaf2ae6cdb scaleio fix
discard 3dccebce77d make dynamicapichecker cache confgurable, fix test
discard fd424d55f45 move adding indexes to java class
discard bb5a2966b1e restore missing log
discard 895c6175923 remove unused method
discard 6a84ec36ef2 restore dependency
discard 5c379fd7fcc refactor
discard eaf17ddbb97 renamed storage.pool.host.connect.workers
discard f6c16d9cfc0 refactor capacity calculation
discard 16a541cd71d changes for timertask to runnable for agent self tasks
discard 62ce43c2d5f agent: refactoring fixes for connection
discard aae3a0a0b8d refactor to retrieve host count and cpu sockets in single
query
discard c885464c71c storage pool host connection improvements
discard 91920279738 ui: use *metrics apis only when metrics enabled for list
discard e548d3b1365 revert change to fix implicit tags
discard c33aa960258 refactor, improve startuptask
discard 290f7a944f3 agent: allow not to exit on failure if serverresource has
flag
discard b178946dbff allow serverresource flag to not exit on failures
discard 4b2c5734dbd fix npe
discard ad4c56a11f1 minor refactor for executor min-max
discard 053a19f551b refactor
discard 79c257c4546 minor change for ssl handshake pool factory
discard a932a9c2bb5 refactor agent hostname retrieval
discard 99e630370c5 revert min threads for AgentTaskPool
discard 4e413940883 refactor
discard 8038b28b1c3 server: indirectagentlb hypervisor type fix
discard 38765f327cf fix Transaction error
discard d7bfa276b9c remove unused
discard 3ff2d81976d fix Transaction.finalize error for updatePowerState
discard d85dd6d7820 make default for powersync for transitioning vms as true
discard 47333a70771 Merge remote-tracking branch 'apple/apple-base418' into
scalability-improvements
discard af32bcf4ca8 Merge pull request #478 from
shapeblue/scalability-improvements-fixes
discard 42111d8e837 fix EOF
discard bc42264b342 Restore listNetworks behavior & clean up the code (#9461)
discard 52c483d91de revert to constant backoff
discard 7ecc173187f changes
discard d0fc91ab2a6 build fix
discard 3ebc6c3d1ee agent ssl handshake timeout
discard 0b8ebb08d66 increase expiry
discard 85076cb0f8f Resize volume: add pool capacity disablethreshold for
resize and allow volume auto migration (#492)
discard 5f86dad4cb0 improve cluster overcommit value cache
discard 1589cde4e40 check for empty ids
discard 3e830252aba fix invalid range
discard 864afda9351 backoff changes
discard f85ac6adf90 add a todo
discard a3ea8603a9e during resource calculation directly return ids for
service offering, templates
discard 3f6b7b930aa during resourcecalculation select specific fields for
uservmjoinvo
discard a069e14cf9d directly return count for systemvms used in listInfra
discard c6cc136ce6e changes in pools for agent executors
discard 3fa9334954b limits changes for listing accounts and domains
discard 56d8ae371c1 minor test revert
discard c859f8ba807 changes in vm powerstate sync
discard a9661f45877 changes in statscollection
discard a5d02665b4e changes for host reqrieval from db
discard d2075415ac6 remove logs from DynamicRoleBasedAPIAccessChecker
discard b4fb97c886a change in account role caching
discard a74403bd971 revert logging changes
discard 9afb25a9699 fix
discard f7f9249be5b fix
discard d9269842d0e changes
discard adae7c88b8d changes
discard fa50740514a wip
discard 1652086ff9d wip changes for agent reconnection
discard 7068a6ebebe Fix root disk resize validation - don't lookup with disk
offering id of the root disk in service offering view (#9428) (#489)
discard 0151f125aa9 improvement
discard 0ca8722c38a Merge remote-tracking branch
'apple/scalability-improvements' into scalability-improvements-fixes
discard 1d0b90f9840 Merge remote-tracking branch 'apple/apple-base418' into
scalability-improvements
discard a05a3f94b4a Updated powerflex connect on demand config description
(#486)
discard 9f3380c4be2 Add Functionality Enum to HypervisorType (#481)
discard 0728e9ffdba Merge branch 'scalability-improvements' into
scalability-improvements-fixes
discard 8941fa550ca build fix
discard 11767637555 fix unused imports
discard 0dd09344839 backport https://github.com/apache/cloudstack/pull/9518
discard 35ed30bd519 continuation of 1d47e4d4ae177e4a9f41c12b6d72c0ca011a3f1a
discard 33321f00ce6 template list fix
discard 99115b9f09b server: cache cluster host type retrievals during
connections
discard 97ddd17f948 fix related to 38d6c4e7e7d7535e08f1e45dad0f4e5fd1eb2239
discard 1d47e4d4ae1 engine-schema,server,plugins: list host IDs instead whole
row where applicable
discard fe4ef05053c server,engine-schema: use single query to to list host
capacities while host capacity update
discard 98b27a409dd engine-schema: fix get host type count searchcriteria
discard 38d6c4e7e7d optimize finding ready systemvm template for zone
discard e1a5bd9ef2d improve agentlb sort when host list not needed
discard a1ee64344df address host/cluster dao listall
discard ad275e7a36b remove dead code
discard eb749746853 more test fix
discard 9e5c99ef9eb fix tests from a78a2508e955fa8c08b62e56c3440ca58bad3e77
discard 51fea012ef4 NPE fix, for test_hostha_kvm_host_fencing (#479)
discard a78a2508e95 server: refactor MS list retrieval for agent connect
discard 68bab20d249 VMInstanceDao.updatePowerState refactor
discard 1d116057878 remove todo as configkey caching is implemented
discard d5a774c7361 import fix
discard de60fb64e84 fix
discard 9074c4b6ad9 address process vm power state report for transitioning VMs
discard 3e098b87a96 fix
discard df137fc3876 refactor
discard 31229e770b4 Merge pull request #476 from
shapeblue/update_host_capacity_vm_update_time_fix
discard 2755e338d85 Merge pull request #477 from
shapeblue/list_events_sql_error
discard fc79a870508 Fixed code review comments
discard 97b07dbaae9 Fixed code review comments
discard 61764aba1f7 cache and executors refactoring
discard 75f39cddc9c Merge pull request #473 from
shapeblue/powerflex_on_demand_disable_config_key
discard e798ab30b35 cache api permission in DynamicRoleBasedAPIAccessChecker
discard 8f6c657159b optimize scanStalledVms procedure
discard cf8dd76d4c2 renamed created_exists to created_column_not_exists in sql
migration script
discard af53644a0b4 utils: add wrapper for the loading cache
discard a15fe4f1f43 Added logs for on-demand connect/disconnect config
discard 22227b0d010 ui: refactor config update/reset notification
discard 9f072f2f1c3 Revert "Changed ConnectOnDemand order"
discard 8cabccdbaea Fixed listEvents intermittent exception:
com.mysql.cj.jdbc.ClientPreparedStatement: SELECT event_view.id,
event_view.uuid, event_view.type, event_view.state, event_view.description,
event_view.created, event_view.user_id, event_view.user_name, event_view.level,
event_view.start_id, event_view.start_uuid, event_view.parameters,
event_view.account_id, event_view.account_uuid, event_view.account_name,
event_view.account_type, event_view.domain_id, event_view.domain_uuid, [...]
discard b9946c28e7c CapacityManagementImpl.updateCapacityForHost(..) use VM
update time in capacity calculation. VM update time is nullable in DB and can
cause NullPointerException if record in vm_instance has defined last_host_id
and undefined update_time.
discard 05db34bf445 Changed ConnectOnDemand order
discard 8ee5e6a99ae refactor transitioning vm process report
discard 07218b8c3d1 Moved ConnectOnDemand logic to ScaleIO SDC Manager and
made ConnectOnDemand of Zone-aware
discard 060a8ca623c fix
discard 4f1eeae9f73 server: DownloadListener - add caching for processConnect
StartupCommand
discard 1be848da250 server: PingRoutingCommand - enable scanStalledVm
discard 337add8fb9b server: PingRoutingCommand - apply some optimizations
discard 013ebfaf463 Merge remote-tracking branch 'apple/apple-base418' into
scalability-improvements
discard 4400e02a1b2 framework/config,server: configkey caching (#472)
discard 1ec11a14825 removed insert of powerflex.connect.on.demand as it taken
care by commit 0d553332 already
discard 74ceba1f008 Merge pull request #474 from
shapeblue/powerflex_cross_cluster_data_volume_migration
discard 0d553332d95 Implemented Configurable methods in
ScaleIOPrimaryDataStoreDriver.
discard 3f80cd3c66a optimize db list.size() cases
discard e1c74927686 - added resource_reservation.mgmt_server_id - added
resource_reservation.created to migration script
discard 8136db637aa Added configuration key powerflex.connect.on.demand to DB
and resource_reservation DDL
discard e0d60669357 Bumped pom version to 4.18.1.2 (to add migration SQL
script)
discard 422f3ba7fef Introduced configuration key "powerflex.connect.on.demand"
to enable/disable PowerFlex on-demand connection from Host to Storage Pool
feature.
discard 8890e710528 Provide encryption key for DATA volume type (in addition
to ROOT) to copy volume.
discard a794462da19 server, api: account and api entity access improvements
(#470)
discard a7516bbd552 test: improve purge expunged resources b/g task testcase
(#467)
discard e676b800526 revert fc2e4ffd12c8a9888bf52955e0582fcd87d1ffc9
discard fc2e4ffd12c server: refactor listNetworks api database retrievals
(#9184)
discard 5e98405b38b Merge remote-tracking branch 'apple/apple-base418' into
scalability-improvements
discard d1faa596777 Back port fixes from upstream 4.19 (#466)
discard 5c682677fc7 Support resource name / displaytext with unicode / emoji
chars, and SQL exception msg improvements (#460)
discard a142359784b saml: make default signature check mandatory
discard b46e4d4bbf3 framework/cluster: improve cluster service and integration
API service (#465)
discard c6d35b31ca3 Log stdout to a file (#399)
discard 23a0faf729f Apply upstream SAML sig check from #9219 (#463)
discard 08246e05ed8 server,test: fix resourceid for VOLUME.DETROY in restore
VM (#9032) (#454)
discard be87b1a6688 FR74: Mitigation for non-scalable ScaleIO clients (#447)
discard c2de75744e9 kvm: Add support for cgroupv2 (#8252) (#459)
discard 7ed43e3e435 Let network guru decide if ipv6 cidr size can't be equal
to 64 (#462)
discard 8be18e587f3 FR75 Enforce strict host tag checking (#421)
discard 8f88103a293 FR72 - api,server: purge expunged resources (#405)
discard 04091abc0d5 User data content size validation, register managed user
data using POST call from UI, and related code improvements (#361)
discard bda0543dd0d ScaleIO volume live migration - use usable bytes from
source disk to format the destination disk (#452)
discard 256051af1d1 server: fix resource reservation leakage (#456)
discard e065c93c3fc Apple FR76: Implicit host tags (#427)
discard 07097849d4d add more missing indexes to lower table scans
discard b03d1382e63 fix unit tests failures
discard 0f44a7f9007 .python-version: bump to v3.10
discard 2f0f0e9ebcf engine/schema: call initDB before creating app context bean
discard 3883dbe9a0f schema: force index on user_view_view
discard f57f2448635 schema: speed up network offering created table scans
discard c3867a941f2 more fixmes and todos
discard 7a7f1e2b6ed FIXME/TODO: CPU and DB hotspot found
discard 5603bf9c1af engine: optimise CPU and DB hotspot to return enabled
hypervisors in the zone
discard 8a320b807d0 engine/schema: cluster dao method query optimisation
discard 696927455ff framework/db: use HikariCP instead of dbcp2
discard f21a00b2de7 framework/db: use lightweight-ping
discard 1c02166d29f framework/db: dont' use validation query as connector is
JDBC4 compliant
discard 90afcf2f857 metrics: optimise code and query to get summed cpu sockets
discard 35462dc96dc server: fix full table scanning for listHosts API
discard 076a712fbe5 schema: add indexes that save DB from too many scans
discard 54accfdc0aa schema: add missing index to reduce table scans
discard 5750e56be5e server: improve DB optimisation, indexing and reduce table
scans
discard 3a0927a5689 server: trace logs for security groups listener
discard 607911562ec server: fix NPE, compare known versus unknown in equals()
discard 807cd6a830e metrics: speed up list zones and cluster metrics APIs
discard 72b841567ef ui: add disconnected hosts filter and improve admin
dashboard
discard 5484d3c7e66 orchestartion: optimise vm list fetching excluding that
reported
discard de82aa8e91c engine/orchestartion: wrap db txn in try-with, only fetch
id
discard c01aad6ba85 server: count hosts than get all hosts in capacity scans
discard 2a48d71909b server: don't go into O(n^2) loop for non-XenServer hosts
discard 47163df2ff2 framework/config: make logic in ::value() defensive (#449)
discard c3eba5e213e Fix exceeding of resource limits with powerflex (#443)
discard 2f4cea6dca5 Fix message publish in transaction (#438)
discard 04a589d0136 Fixup e2e test_restore_vm (#445)
discard 7fae1fc7477 Fix restore VM with allocated root disk (#441)
discard 9ab786c18a5 Fix: Update rootdisksize detail on restore VM (#440)
discard 1b54edd9de4 Fix resource limit checks and increment/decrements for
different operations (#430)
discard c21b6d8b522 Update volume's passphrase to null if diskOffering doesn't
support encryption (#428)
discard 93e66c52dc7 Fix null pointer exception in restore VM (#431)
discard e630d7afea1 Update netty version for compatibility/staying current
(#433)
discard 1b52bebd08a Fix error message for checkVolume command (#409)
discard 3a058f3a187 Introduce scheduled executor wrapper with dynamic interval
(#424)
discard fd9325a86d6 Speed up resource count calculation (#425)
discard 26c1741af5f Fix listStoragePoolsMetricsCmd (#419)
discard 1b7f33d0e1a This PR fixes the build issue on apple-base418 (#429)
discard 0501678478c Allow overriding root diskoffering id & size, and expunge
old root disk while restoring VM (#401)
discard 8d0915c4c9c Change iops on offering change (#416)
discard 227dc5e86aa Add ability to set cpu.threadspercore similar to existing
cpu.corespersocket (#411)
discard 631b0960f3f Allow kvm storage plugin to customize diskdef, add
geometry (#402)
discard f8965869255 Update version to 4.18.1.1 (#417)
discard 0c23820c7cb Merge pull request #414 from shapeblue/security-backport418
discard ac4b0307591 Mark libvirt events experimental, add properties flag
(#404)
discard c09cea5d866 Fix: check root disk offering tagged limits during VM
deploy (#415)
discard 21a03ae4da7 upgrade: fix upgrade from 4.18.1.0 to 4.18.2.0-SNAPSHOT
(#7959)
discard 8eee0ec2134 Fix getRepair method in checkVolume command (#408)
discard 5137c196c2e HypervisorType as a class (#393)
discard 292c0eb291b fix test failure
discard 996ae9a9599 engine-storage: control download redirection
discard cfaac2a67e1 api: client verification in servlet
discard 2b93886934e server: fix security issues caused by extraconfig on KVM
discard 98d021faed5 server: skip password policies check on empty password
(#8370) (#396)
discard 6a28cb33ff0 update mysql dependency version (#394)
discard a1122d175e4 Add missing indexes for vmstats (#391)
discard 5b3a81c2a3e Fix failing test (#400)
discard 98dda22a83a Support KVM storage implementations controlling
logical/physical block size (#390)
discard 4c6c8216d5b Use join instead of views (#365)
discard bf4ea0d59f0 Storage drivers to decide if they need data motion for
zone-wide use (#392)
discard ba3284bdc51 Fix resource count discrepancies (#376)
discard 1510b44f038 backport: add more unit tests and fix related to #327
(#378)
discard ae6d0fb2d62 Storage pool stats update (#383)
discard 747d1101c11 New API "checkVolume" to check and repair any leaks or
repair all issues (#362)
discard 2df750c2f46 Fixed query param for getDomainReservation. (#388)
discard f30e07b3128 Fix host stuck in connecting state (#375)
discard 89f93746aca Storage plugin support to check if volume on datastore
requires access for migration (#380)
discard 8b01c0aa628 Update VM's state if powerstate & state are not in sync
(#368)
discard 30d908c580b Added vm uuid as part of error response when vm create
fails after vm entity is persisted. (#350)
discard 6a9cdedda4e api,server,ui: tagged resource limits (#327)
discard f49265c14cb Fix missing code from backport of 4.16 version of dom0 CPU
reserve (#374)
discard b44710c8a9e Pass StoragePoolType object for poolType dao attribute -
fixes conversion to DB column (#371)
discard e610d2c54cd Fix libvirt domain event listener by properly processing
events (#364)
discard 0201e0af95f Allocate new ROOT volume (on restore virtual machine
operation) only when resource count increment succeeds (#367)
discard 40dd8671986 Apple base418 storagepooltype as class (#351)
discard 47e53eceeda E2e test resource listing (#363)
discard 7fef1556218 Remove sensitive params (VmPassword, etc) from VMWork log
(#369)
discard e704b6e4923 Fix reorder/list pools when cluster details are not set
(#358)
discard 99939d22a76 CleanUp Async Jobs after mgmt server maintenance (#356)
discard 6f4cf60fab5 Updated jetty maxFormContentSize value to 1048576 bytes
(default is 200000 bytes), to support user data upto 1048576 bytes (#360)
discard 28be74e0b90 Add lock mechanism considering template id, pool id, host
id (#345)
discard af4e657aeed Clear pool id if volume in allocated state (#341)
discard 63a4efa4c9f Use UserVmDao for listVirtualMachines API to increase
performance (#343)
discard c32d2fa9909 CKS: fix wrong format of cluster size on UI (#8182)
discard 7260204447c ui: Admin, account and project dashboard improvements
discard b9c3752ce08 Fix: Select another pod if all hosts in the pod becomes
unavailable (#339)
discard a7c7a331313 Apple base418 agent lock during reconnect (#340)
discard 42131fdd169 ui: fix bulk delete template from zones (#8118)
discard bf3dff2f57b marvin,test: fix directdownload template checksum test
(#8096)
discard 0c96202c7dd ui: correctly show volume physical size (#8119)
discard 8875a94242c linstor: fix template copy on non hyperconverged setups
(#8114)
discard f4b9e6c9881 test: add test for standalone snapshot (#8104)
discard 198e48c7c5c Fix VM snapshot size during storage capacity check (#8101)
discard 4c7a81bd82b Fix UUID for child datastores in all cases (#8057)
discard d49b0c4253b linstor: Fix template volume missing on copy node (#8082)
discard 03fa5799e64 test,refactor: fix test_project_resources cleanup (#8097)
discard 6f925f00225 kvm: fix direct download template size (#8093)
discard d1849a40333 Fix NPE if global setting implicit.host.tags is set to
null (#8066)
discard a768c96a6da Create snapshot from VM snapshot without memory for
NFS/Local storage (#8117)
discard 3e2717424de Address review comments (#338)
discard 84fee7b8963 ui: Fix non admin logouts (#8065)
discard f570934482b .github: run Sonar Check only on PRs from
apache/cloudstack branches (#8058)
discard db54a098604 Default value of force should be false for template delete
operation (#7731)
discard 846cc2f26c8 systemvm: remove config in /etc/pam.d/systemd-user to fix
[email protected] (#8048)
discard 18e7276df0a storage: allow VM snapshots without memory for KVM when
global setting allows (#8062)
discard fe3cf817390 Fix #303: Run recalculation recurrent task only in the
longest running management server (#335)
discard a54f37890c6 Merge pull request #322 from
shapeblue/4.18-migration-issue320
discard 81f9da037b7 ldap trust map cleanup on domain delete (#7915)
discard 73c86b8a301 VR live patching: Allow live patch of VPC VRs even if
networks are in allocated / shutdown state (#7958)
discard 4f86c452de0 Fix 2FA becoming enabled when the user inputs the wrong
code during setup (#7972)
discard 1fdaec5c907 linstor: resize root disk on offerings with different size
(#7952)
discard 24346b5d656 server: fix mysql error when list Shared templates for
project (#8020)
discard 4498c7807b4 systemvm: check if patchfile exists and is valid tarball
before patching (#7953)
discard 5b7837eae18 Fix: Convert volume to another directory instead of
copying it while taking volume snapshots on KVM (#8041)
discard 832995abd69 Improve template download error message (#8029)
discard 1b36cd9210b test: fix test_vm_autoscaling.py which does not work due
to userdata improvement (#7921)
discard 1b35a5aa1c5 Fix build, missing imports
discard 160a13a0296 userdata: fix append scenarios (#7741)
discard c01ed905696 Trigger out of band VM state update via libvirt event when
VM stops (#7963)
discard e77107819b3 kvm: skip KVMHostInfoTest when build OS isn't Linux
discard 33a5c159a35 KVM Agent config to reserve dom0 CPUs (#326)
discard d083df504d2 LibvirtServerDiscoverer should only process added KVM
hosts (#324)
discard 7ed872c1d69 Use direct download timeout configs for URL check (#316)
discard 62fce862346 Generate cloud-init multipart user data for template
append policy (#7643)
discard c6c32776b52 UI: Fix user role login due to missing API access on
custom hypervisor name (#7939)
discard 4dfa38aae97 plugins: Add Custom hypervisor minimal changes (#7692)
discard fe50018fba7 Allow configkey to set 'cloud-name' cloud-init metadata
(#7964)
discard be2bea64a9e fix units label (#325)
discard a571cde7a9e Increase reserve on ScaleIO disk formatting for
fragmentation (#317)
discard d8db09ac58f Publish event for VM.STOP when out of band stop is detected
discard 0d9aa70edd1 test: enable and fix scaleio unit tests (#289)
discard 5604638b84e Apple base416 passphrase enc (#240) * Move PassphraseVO to
use String instead of byte[] to support Encrypt annotation
discard a9fb36174de Skip volume resize during service offering change when no
size exists (#200)
discard 20952b48424 Auto Enable/Disable KVM hosts (#7170)
discard 8597758ed8d Support Jetty's live cert reload on HTTPS frontend (#7355)
discard c8f02a8b34f engine/orchestartion: fix/refactor to Account.Type.ADMIN
discard 0c192f36095 When VM start fails at host for admin, report error (#208)
