[ https://issues.apache.org/jira/browse/YARN-7679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16301611#comment-16301611 ]
Arun Suresh commented on YARN-7679: ----------------------------------- Thanks for starting the discussion. We actually introduced YARN-6355 to solve a similar problem. Essentially, we can use the pre-processing framework to add a processor that limits requests from misbehaving apps. This can be done in the RM. In production, we actually use an AMRMProxy plugin, introduced in YARN-2884, installed on the NM to intercept AM calls to RM to perform the job limiting. Since we are using the AMRMProxy anyway for federation. > Application blacklist to drop misbehave AM requests > --------------------------------------------------- > > Key: YARN-7679 > URL: https://issues.apache.org/jira/browse/YARN-7679 > Project: Hadoop YARN > Issue Type: New Feature > Components: client, RM > Reporter: Weiwei Yang > Labels: admin, command-line > > Sometimes there might be some malicious or mis-behave AMs that keep sending > invalid resource requests to RM, this causes resource wastes. If such > application provides online services, we cannot simply KILL them. Instead it > will be extremely useful if RM can black list such applications, drop their > requests. So admin could have time to check and then decide how to process. > Propose to add an admin command to blacklist applications. > Open this JIRA for discussion, will upload a design doc shortly. -- This message was sent by Atlassian JIRA (v6.4.14#64029) --------------------------------------------------------------------- To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org