[ https://issues.apache.org/jira/browse/YARN-9790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16917970#comment-16917970 ]
Prabhu Joseph commented on YARN-9790: ------------------------------------- [~kyungwan nam] Default app lifetime will be used when app does not specify the lifetime. Max app lifetime is used to limit the user specified lifetime. If we set Default to some value and Max to -1, then there is no limit and so any user can specify any higher lifetime. The below check is needed to prevent the same. {code} if (defaultApplicationLifetime > maxApplicationLifetime) { {code} Check {{CapacityScheduler#checkAndGetApplicationLifetime}} which considers max is > default and does limit on user specified lifetime. > Failed to set default-application-lifetime if maximum-application-lifetime is > less than or equal to zero > -------------------------------------------------------------------------------------------------------- > > Key: YARN-9790 > URL: https://issues.apache.org/jira/browse/YARN-9790 > Project: Hadoop YARN > Issue Type: Bug > Reporter: kyungwan nam > Assignee: kyungwan nam > Priority: Major > Attachments: YARN-9790.001.patch, YARN-9790.002.patch > > > capacity-scheduler > {code} > ... > yarn.scheduler.capacity.root.dev.maximum-application-lifetime=-1 > yarn.scheduler.capacity.root.dev.default-application-lifetime=604800 > {code} > refreshQueue was failed as follows > {code} > 2019-08-28 15:21:57,423 WARN resourcemanager.AdminService > (AdminService.java:logAndWrapException(910)) - Exception refresh queues. > java.io.IOException: Failed to re-init queues : Default lifetime604800 can't > exceed maximum lifetime -1 > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.reinitialize(CapacityScheduler.java:477) > at > org.apache.hadoop.yarn.server.resourcemanager.AdminService.refreshQueues(AdminService.java:423) > at > org.apache.hadoop.yarn.server.resourcemanager.AdminService.refreshQueues(AdminService.java:394) > at > org.apache.hadoop.yarn.server.api.impl.pb.service.ResourceManagerAdministrationProtocolPBServiceImpl.refreshQueues(ResourceManagerAdministrationProtocolPBServiceImpl.java:114) > at > org.apache.hadoop.yarn.proto.ResourceManagerAdministrationProtocol$ResourceManagerAdministrationProtocolService$2.callBlockingMethod(ResourceManagerAdministrationProtocol.java:271) > at > org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) > at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) > at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) > at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:422) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1729) > at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) > Caused by: org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Default > lifetime604800 can't exceed maximum lifetime -1 > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue.setupQueueConfigs(LeafQueue.java:268) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue.<init>(LeafQueue.java:162) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue.<init>(LeafQueue.java:141) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacitySchedulerQueueManager.parseQueue(CapacitySchedulerQueueManager.java:259) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacitySchedulerQueueManager.parseQueue(CapacitySchedulerQueueManager.java:283) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacitySchedulerQueueManager.reinitializeQueues(CapacitySchedulerQueueManager.java:171) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.reinitializeQueues(CapacityScheduler.java:726) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.reinitialize(CapacityScheduler.java:472) > ... 12 more > {code} -- This message was sent by Atlassian Jira (v8.3.2#803003) --------------------------------------------------------------------- To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org