[
https://issues.apache.org/jira/browse/YARN-8402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chandni Singh updated YARN-8402:
--------------------------------
Description:
RM slows down considerably when multiple services are destroyed simultaneously.
1. Started approx 1000 services
2. Destroyed all the 1000 services.
Observed considerable slowness in RM after this.
The {{ServiceClient}} in RM uses the {{CuratorClient}} to delete zookeeper
entries.
The zookeeper client is the bottleneck and this could be avoided if the
zookeeper entry can be deleted from the AM and then the {{ServiceClient}} can
kill the app.
was:
The overwrite of service definition during flex is done from the ServiceClient.
During auto finalization of upgrade, the current service definition gets
overwritten as well by the service master. This creates a potential conflict.
Need to move the overwrite of service definition during flex to the
ServiceClient.
Discussed on YARN-8018.
> Yarn Service Destroy: Delete service entries from Zookeeper in the
> ServiceMaster instead of ServiceClient in the RM
> -------------------------------------------------------------------------------------------------------------------
>
> Key: YARN-8402
> URL: https://issues.apache.org/jira/browse/YARN-8402
> Project: Hadoop YARN
> Issue Type: Sub-task
> Reporter: Chandni Singh
> Assignee: Chandni Singh
> Priority: Major
>
> RM slows down considerably when multiple services are destroyed
> simultaneously.
> 1. Started approx 1000 services
> 2. Destroyed all the 1000 services.
> Observed considerable slowness in RM after this.
> The {{ServiceClient}} in RM uses the {{CuratorClient}} to delete zookeeper
> entries.
> The zookeeper client is the bottleneck and this could be avoided if the
> zookeeper entry can be deleted from the AM and then the {{ServiceClient}} can
> kill the app.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
