[ https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sunil G updated YARN-4945: -------------------------- Attachment: YARN-2009.v3.patch Thanks [~leftnoteasy] and [~eepayne] LeafQueue#getAllApplications impl had that bug pointed by Eric. Fixed the same. Nice catch. bq.Instead of have a separate SELECT_CANDIDATES_FOR_INTRAQUEUE_PREEMPTION, should we only have a "queue.intra-queue-preemption-enabled"? Could we have something like {{select_based_on_intra_queue_policies}} ? bq.partitionToUnderServedQueues can be kept in AbstractPreemptableResourceCalculator. Actually i update list to this map from Inter queue policy, and use it in intra queue. So we are having 2 objects from 2 types of calculator. So sharing from PCPP makes more sense rt? bq.Map<String, LinkedHashSet<String>> could be Map<String, List<String>>. (LinkedHashSet is not necessarily needed, because we won't have two TempQueuePerPartition with the same queueName and same partition) Here I think we needed LinkedHashSet. Reason is that {{computeFixpointAllocation}} from AbsPreemptCalc class, same queue can be added back to {{orderedByNeed}} priority queue. bq.better to move to Intellij? Yup. definitely in my todo’s :) bq.Move getTotalPendingRequestsPerPartition to ResourceUsage? Its really helpful to have. But interestingly we need to add to resourceUsage#pending from {{AppSchedulingInfo}} rather than {{FiCaSchedulerApp}}. Also we have {{attemptResourceUsage}} present in app level (for used and reserve), and another {{resourceUsage}} present in AppSchedulingInfo (for pending). I think we need some refactoring there . we can do that in separate ticket. thoughts? bq.All non-abstract methods can be static, correct? All TODOs in comments are done, correct? Yes. Done. bq.how about call it something like IntraQueuePreemptionComputePlugin? Make sense to me. bq.Is it better to rename Temp- to something like AppPartitionSnapshot or QueuePartitionSnapshot? Yes. will handle in separate ticket. > [Umbrella] Capacity Scheduler Preemption Within a queue > ------------------------------------------------------- > > Key: YARN-4945 > URL: https://issues.apache.org/jira/browse/YARN-4945 > Project: Hadoop YARN > Issue Type: Bug > Reporter: Wangda Tan > Attachments: Intra-Queue Preemption Use Cases.pdf, > IntraQueuepreemption-CapacityScheduler (Design).pdf, YARN-2009-wip.2.patch, > YARN-2009-wip.patch, YARN-2009-wip.v3.patch, YARN-2009.v0.patch, > YARN-2009.v1.patch, YARN-2009.v2.patch, YARN-2009.v3.patch > > > This is umbrella ticket to track efforts of preemption within a queue to > support features like: > YARN-2009. YARN-2113. YARN-4781. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org