[jira] [Updated] (YARN-3969) Allow jobs to be submitted to reservation that is active but does not have any allocations
[ https://issues.apache.org/jira/browse/YARN-3969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-3969: - Fix Version/s: 2.8.0 > Allow jobs to be submitted to reservation that is active but does not have > any allocations > -- > > Key: YARN-3969 > URL: https://issues.apache.org/jira/browse/YARN-3969 > Project: Hadoop YARN > Issue Type: Sub-task > Components: capacityscheduler, fairscheduler, resourcemanager >Reporter: Subru Krishnan >Assignee: Subru Krishnan > Fix For: 2.8.0, 2.7.2, 3.0.0-alpha1 > > Attachments: YARN-3969-v1.patch, YARN-3969-v2.patch > > > YARN-1051 introduces the notion of reserving resources prior to job > submission. A reservation is active from its arrival time to deadline but in > the interim there can be instances of time when it does not have any > resources allocated. We reject jobs that are submitted when the reservation > allocation is zero. Instead we should accept & queue the jobs till the > resources become available. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Updated] (YARN-3969) Allow jobs to be submitted to reservation that is active but does not have any allocations
[ https://issues.apache.org/jira/browse/YARN-3969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-3969: -- Fix Version/s: (was: 2.8.0) > Allow jobs to be submitted to reservation that is active but does not have > any allocations > -- > > Key: YARN-3969 > URL: https://issues.apache.org/jira/browse/YARN-3969 > Project: Hadoop YARN > Issue Type: Sub-task > Components: capacityscheduler, fairscheduler, resourcemanager >Reporter: Subru Krishnan >Assignee: Subru Krishnan > Fix For: 2.7.2 > > Attachments: YARN-3969-v1.patch, YARN-3969-v2.patch > > > YARN-1051 introduces the notion of reserving resources prior to job > submission. A reservation is active from its arrival time to deadline but in > the interim there can be instances of time when it does not have any > resources allocated. We reject jobs that are submitted when the reservation > allocation is zero. Instead we should accept & queue the jobs till the > resources become available. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (YARN-3969) Allow jobs to be submitted to reservation that is active but does not have any allocations
[ https://issues.apache.org/jira/browse/YARN-3969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-3969: --- Fix Version/s: (was: 2.7.1) 2.7.2 > Allow jobs to be submitted to reservation that is active but does not have > any allocations > -- > > Key: YARN-3969 > URL: https://issues.apache.org/jira/browse/YARN-3969 > Project: Hadoop YARN > Issue Type: Sub-task > Components: capacityscheduler, fairscheduler, resourcemanager >Reporter: Subru Krishnan >Assignee: Subru Krishnan > Fix For: 2.8.0, 2.7.2 > > Attachments: YARN-3969-v1.patch, YARN-3969-v2.patch > > > YARN-1051 introduces the notion of reserving resources prior to job > submission. A reservation is active from its arrival time to deadline but in > the interim there can be instances of time when it does not have any > resources allocated. We reject jobs that are submitted when the reservation > allocation is zero. Instead we should accept & queue the jobs till the > resources become available. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (YARN-3969) Allow jobs to be submitted to reservation that is active but does not have any allocations
[ https://issues.apache.org/jira/browse/YARN-3969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-3969: - Attachment: YARN-3969-v2.patch Thanks [~curino] for reviewing the patch. I am uploading a new patch that adds a check to the _maxApps_ in _ReservationQueue_ post invocations of _setEntitlement()_ > Allow jobs to be submitted to reservation that is active but does not have > any allocations > -- > > Key: YARN-3969 > URL: https://issues.apache.org/jira/browse/YARN-3969 > Project: Hadoop YARN > Issue Type: Sub-task > Components: capacityscheduler, fairscheduler, resourcemanager >Reporter: Subru Krishnan >Assignee: Subru Krishnan > Attachments: YARN-3969-v1.patch, YARN-3969-v2.patch > > > YARN-1051 introduces the notion of reserving resources prior to job > submission. A reservation is active from its arrival time to deadline but in > the interim there can be instances of time when it does not have any > resources allocated. We reject jobs that are submitted when the reservation > allocation is zero. Instead we should accept & queue the jobs till the > resources become available. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (YARN-3969) Allow jobs to be submitted to reservation that is active but does not have any allocations
[ https://issues.apache.org/jira/browse/YARN-3969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-3969: - Attachment: YARN-3969-v1.patch Attaching a simple patch that skips the overriding of max system apps for dynamic ReservationQueues based on their absolute capacity to allow accepting & queuing jobs against the reservation till resources are allocated. > Allow jobs to be submitted to reservation that is active but does not have > any allocations > -- > > Key: YARN-3969 > URL: https://issues.apache.org/jira/browse/YARN-3969 > Project: Hadoop YARN > Issue Type: Sub-task > Components: capacityscheduler, fairscheduler, resourcemanager >Reporter: Subru Krishnan >Assignee: Subru Krishnan > Attachments: YARN-3969-v1.patch > > > YARN-1051 introduces the notion of reserving resources prior to job > submission. A reservation is active from its arrival time to deadline but in > the interim there can be instances of time when it does not have any > resources allocated. We reject jobs that are submitted when the reservation > allocation is zero. Instead we should accept & queue the jobs till the > resources become available. -- This message was sent by Atlassian JIRA (v6.3.4#6332)