[jira] [Assigned] (YARN-1184) ClassCastException is thrown during preemption When a huge job is submitted to a queue B whose resources is used by a job in queueA
[ https://issues.apache.org/jira/browse/YARN-1184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj K reassigned YARN-1184: --- Assignee: Chris Douglas (was: Devaraj K) > ClassCastException is thrown during preemption When a huge job is submitted > to a queue B whose resources is used by a job in queueA > --- > > Key: YARN-1184 > URL: https://issues.apache.org/jira/browse/YARN-1184 > Project: Hadoop YARN > Issue Type: Bug > Components: capacityscheduler, resourcemanager >Affects Versions: 2.1.0-beta >Reporter: J.Andreina >Assignee: Chris Douglas > Fix For: 2.1.1-beta > > Attachments: Y1184-0.patch > > > preemption is enabled. > Queue = a,b > a capacity = 30% > b capacity = 70% > Step 1: Assign a big job to queue a ( so that job_a will utilize some > resources from queue b) > Step 2: Assigne a big job to queue b. > Following exception is thrown at Resource Manager > {noformat} > 2013-09-12 10:42:32,535 ERROR [SchedulingMonitor > (ProportionalCapacityPreemptionPolicy)] yarn.YarnUncaughtExceptionHandler > (YarnUncaughtExceptionHandler.java:uncaughtException(68)) - Thread > Thread[SchedulingMonitor (ProportionalCapacityPreemptionPolicy),5,main] threw > an Exception. > java.lang.ClassCastException: java.util.Collections$UnmodifiableSet cannot be > cast to java.util.NavigableSet > at > org.apache.hadoop.yarn.server.resourcemanager.monitor.capacity.ProportionalCapacityPreemptionPolicy.getContainersToPreempt(ProportionalCapacityPreemptionPolicy.java:403) > at > org.apache.hadoop.yarn.server.resourcemanager.monitor.capacity.ProportionalCapacityPreemptionPolicy.containerBasedPreemptOrKill(ProportionalCapacityPreemptionPolicy.java:202) > at > org.apache.hadoop.yarn.server.resourcemanager.monitor.capacity.ProportionalCapacityPreemptionPolicy.editSchedule(ProportionalCapacityPreemptionPolicy.java:173) > at > org.apache.hadoop.yarn.server.resourcemanager.monitor.SchedulingMonitor.invokePolicy(SchedulingMonitor.java:72) > at > org.apache.hadoop.yarn.server.resourcemanager.monitor.SchedulingMonitor$PreemptionChecker.run(SchedulingMonitor.java:82) > at java.lang.Thread.run(Thread.java:662) > {noformat} -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (YARN-1184) ClassCastException is thrown during preemption When a huge job is submitted to a queue B whose resources is used by a job in queueA
[ https://issues.apache.org/jira/browse/YARN-1184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj K reassigned YARN-1184: --- Assignee: Devaraj K > ClassCastException is thrown during preemption When a huge job is submitted > to a queue B whose resources is used by a job in queueA > --- > > Key: YARN-1184 > URL: https://issues.apache.org/jira/browse/YARN-1184 > Project: Hadoop YARN > Issue Type: Bug > Components: resourcemanager >Affects Versions: 2.1.0-beta >Reporter: J.Andreina >Assignee: Devaraj K > > preemption is enabled. > Queue = a,b > a capacity = 30% > b capacity = 70% > Step 1: Assign a big job to queue a ( so that job_a will utilize some > resources from queue b) > Step 2: Assigne a big job to queue b. > Following exception is thrown at Resource Manager > {noformat} > 2013-09-12 10:42:32,535 ERROR [SchedulingMonitor > (ProportionalCapacityPreemptionPolicy)] yarn.YarnUncaughtExceptionHandler > (YarnUncaughtExceptionHandler.java:uncaughtException(68)) - Thread > Thread[SchedulingMonitor (ProportionalCapacityPreemptionPolicy),5,main] threw > an Exception. > java.lang.ClassCastException: java.util.Collections$UnmodifiableSet cannot be > cast to java.util.NavigableSet > at > org.apache.hadoop.yarn.server.resourcemanager.monitor.capacity.ProportionalCapacityPreemptionPolicy.getContainersToPreempt(ProportionalCapacityPreemptionPolicy.java:403) > at > org.apache.hadoop.yarn.server.resourcemanager.monitor.capacity.ProportionalCapacityPreemptionPolicy.containerBasedPreemptOrKill(ProportionalCapacityPreemptionPolicy.java:202) > at > org.apache.hadoop.yarn.server.resourcemanager.monitor.capacity.ProportionalCapacityPreemptionPolicy.editSchedule(ProportionalCapacityPreemptionPolicy.java:173) > at > org.apache.hadoop.yarn.server.resourcemanager.monitor.SchedulingMonitor.invokePolicy(SchedulingMonitor.java:72) > at > org.apache.hadoop.yarn.server.resourcemanager.monitor.SchedulingMonitor$PreemptionChecker.run(SchedulingMonitor.java:82) > at java.lang.Thread.run(Thread.java:662) > {noformat} -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira