[
https://issues.apache.org/jira/browse/KNOX-3444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tamás Marcinkovics resolved KNOX-3444.
--------------------------------------
Fix Version/s: 3.1.0
Resolution: Fixed
> Optimize CM discovery memory usage by only caching role configurations that
> ServiceModelGenerators actually use
> ---------------------------------------------------------------------------------------------------------------
>
> Key: KNOX-3444
> URL: https://issues.apache.org/jira/browse/KNOX-3444
> Project: Apache Knox
> Issue Type: Task
> Components: cm-discovery
> Reporter: Tamás Marcinkovics
> Assignee: Tamás Marcinkovics
> Priority: Major
> Fix For: 3.1.0
>
> Time Spent: 0.5h
> Remaining Estimate: 0h
>
> Currently CM auto discovery fetches role configurations for every service
> role that is not explicitly excluded, using full view.
> The response role config items include a lot of metadata, such as description
> and validation, for every role instance in the service.
> For some role types that currently no ServiceModelGenerators use (DATANODE,
> GATEWAY, NODEMANAGER, REGIONSERVER) the role config items list in the
> response takes up around 200KB memory; for large clusters with 500+ nodes,
> this will result in a heap usage of 40-100 MB per role type, and the
> in-memory discovery cache can exceed 1GB.
> We should not cache the role config items not used by ServiceModelGenerators.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
