[ https://issues.apache.org/jira/browse/YARN-220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15782062#comment-15782062 ]
Wilfred Spiegelenburg commented on YARN-220: -------------------------------------------- Should this be marked as fixed now that we have YARN-4697 (limit to the threadpool for uploads) and YARN-4766 (do not upload files older than the retention policy). It does not solve the case of falling behind but at least we have limits on what we upload now. > NM should limit number of applications who's logs are being aggregated > ---------------------------------------------------------------------- > > Key: YARN-220 > URL: https://issues.apache.org/jira/browse/YARN-220 > Project: Hadoop YARN > Issue Type: Sub-task > Components: nodemanager > Affects Versions: 0.23.4 > Reporter: Robert Joseph Evans > > The NodeManager should limit the number of applications that have their logs > being aggregated in parallel. This will reduce the load on the NN. We need > to ensure that the RM will continue to renew the token while this is > happening. We also should look if the NM starts to fall behind if it can > delete some of the logs or not. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org