[jira] [Created] (YARN-4691) Cache resource usage at FSLeafQueue level

Ming Ma created YARN-4691: - Summary: Cache resource usage at FSLeafQueue level Key: YARN-4691 URL: https://issues.apache.org/jira/browse/YARN-4691 Project: Hadoop YARN Issue Type: Improvement

[jira] [Created] (YARN-4690) Skip object allocation in FSAppAttempt#getResourceUsage when possible

Ming Ma created YARN-4690: - Summary: Skip object allocation in FSAppAttempt#getResourceUsage when possible Key: YARN-4690 URL: https://issues.apache.org/jira/browse/YARN-4690 Project: Hadoop YARN Is

[jira] [Commented] (YARN-4684) TestYarnCLI#testGetContainers failing in CN locale

[ https://issues.apache.org/jira/browse/YARN-4684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15144176#comment-15144176 ] Hudson commented on YARN-4684: -- FAILURE: Integrated in Hadoop-trunk-Commit #9291 (See [https:

[jira] [Commented] (YARN-2768) Avoid cloning Resource in FSAppAttempt#updateDemand

[ https://issues.apache.org/jira/browse/YARN-2768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15144100#comment-15144100 ] Sangjin Lee commented on YARN-2768: --- This looks like a great candidate to backport to 2.7

[jira] [Commented] (YARN-2046) Out of band heartbeats are sent only on container kill and possibly too early

[ https://issues.apache.org/jira/browse/YARN-2046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15144093#comment-15144093 ] Hadoop QA commented on YARN-2046: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-2046) Out of band heartbeats are sent only on container kill and possibly too early

[ https://issues.apache.org/jira/browse/YARN-2046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated YARN-2046: -- Attachment: YARN-2046-5.patch Thanks [~jlowe]! Here is the updated patch with your suggestion. > Out of band hea

[jira] [Commented] (YARN-4676) Automatic and Asynchronous Decommissioning Nodes Status Tracking

[ https://issues.apache.org/jira/browse/YARN-4676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15144045#comment-15144045 ] Hadoop QA commented on YARN-4676: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-4205) Add a service for monitoring application life time out

[ https://issues.apache.org/jira/browse/YARN-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15144003#comment-15144003 ] Hadoop QA commented on YARN-4205: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-4205) Add a service for monitoring application life time out

[ https://issues.apache.org/jira/browse/YARN-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-4205: Target Version/s: 2.9.0 > Add a service for monitoring application life time out > --

[jira] [Commented] (YARN-4205) Add a service for monitoring application life time out

[ https://issues.apache.org/jira/browse/YARN-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15143996#comment-15143996 ] Rohith Sharma K S commented on YARN-4205: - Hi [~nijel] the patch appears to be requ

[jira] [Updated] (YARN-3813) Support Application timeout feature in YARN.

[ https://issues.apache.org/jira/browse/YARN-3813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-3813: Target Version/s: 2.9.0 > Support Application timeout feature in YARN. > ---

[jira] [Commented] (YARN-2266) Add an application timeout service in RM to kill applications which are not getting resources

[ https://issues.apache.org/jira/browse/YARN-2266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15143985#comment-15143985 ] Rohith Sharma K S commented on YARN-2266: - Apologies for not observing this JIRA be

[jira] [Created] (YARN-4689) FairScheduler: Cleanup preemptContainer to be more readable

Karthik Kambatla created YARN-4689: -- Summary: FairScheduler: Cleanup preemptContainer to be more readable Key: YARN-4689 URL: https://issues.apache.org/jira/browse/YARN-4689 Project: Hadoop YARN

[jira] [Commented] (YARN-4062) Add the flush and compaction functionality via coprocessors and scanners for flow run table

[ https://issues.apache.org/jira/browse/YARN-4062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15143909#comment-15143909 ] Joep Rottinghuis commented on YARN-4062: Been slow to make progress on review mainl

[jira] [Commented] (YARN-4687) Document Reservation ACLs

[ https://issues.apache.org/jira/browse/YARN-4687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15143905#comment-15143905 ] Hadoop QA commented on YARN-4687: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

[jira] [Updated] (YARN-2830) Add backwords compatible ContainerId.newInstance constructor for use within Tez Local Mode

[ https://issues.apache.org/jira/browse/YARN-2830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated YARN-2830: --- Release Note: (was: I just committed this. Thanks [~jeagles] for the patch and [~ozawa] for t

[jira] [Updated] (YARN-4687) Document Reservation ACLs

[ https://issues.apache.org/jira/browse/YARN-4687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Po updated YARN-4687: -- Attachment: YARN-4687.v1.patch This patch YARN-4687.v1.patch documents the Reservation ACLs for the CapacitySche

[jira] [Updated] (YARN-2336) Fair scheduler REST api returns a missing '[' bracket JSON for deep queue tree

[ https://issues.apache.org/jira/browse/YARN-2336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated YARN-2336: --- Release Note: (was: This incompatible change should be fixed on branch-2 because the API is b

[jira] [Updated] (YARN-3587) Fix the javadoc of DelegationTokenSecretManager in projects of yarn, etc.

[ https://issues.apache.org/jira/browse/YARN-3587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated YARN-3587: --- Release Note: (was: Update DelegationTokenSecretManager Javadoc (milliseconds)) > Fix the ja

[jira] [Commented] (YARN-4683) Document the List Reservations REST API

[ https://issues.apache.org/jira/browse/YARN-4683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15143854#comment-15143854 ] Hadoop QA commented on YARN-4683: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

[jira] [Updated] (YARN-2575) Create separate ACLs for Reservation create/update/delete/list ops

[ https://issues.apache.org/jira/browse/YARN-2575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-2575: - Fix Version/s: 2.8.0 > Create separate ACLs for Reservation create/update/delete/list ops > ---

[jira] [Commented] (YARN-4577) Enable aux services to have their own custom classpath/jar file

[ https://issues.apache.org/jira/browse/YARN-4577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15143841#comment-15143841 ] Sangjin Lee commented on YARN-4577: --- My apologies [~xgong]! I must have looked at the las

[jira] [Updated] (YARN-4683) Document the List Reservations REST API

[ https://issues.apache.org/jira/browse/YARN-4683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Po updated YARN-4683: -- Attachment: YARN-4683.v1.patch YARN-4683.v1.patch documents the REST API for list reservations from YARN-4420. >

[jira] [Commented] (YARN-2575) Create separate ACLs for Reservation create/update/delete/list ops

[ https://issues.apache.org/jira/browse/YARN-2575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15143803#comment-15143803 ] Sean Po commented on YARN-2575: --- Thanks [~asuresh] and [~subru] for reviewing and [~asuresh]

[jira] [Commented] (YARN-2575) Create separate ACLs for Reservation create/update/delete/list ops

[ https://issues.apache.org/jira/browse/YARN-2575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15143719#comment-15143719 ] Arun Suresh commented on YARN-2575: --- The {{TestFifoScheduler}} failure is unrelated. Comm

[jira] [Commented] (YARN-2575) Create separate ACLs for Reservation create/update/delete/list ops

[ https://issues.apache.org/jira/browse/YARN-2575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15143704#comment-15143704 ] Hadoop QA commented on YARN-2575: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-1904) Uniform the XXXXNotFound messages from ClientRMService and ApplicationHistoryClientService

[ https://issues.apache.org/jira/browse/YARN-1904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated YARN-1904: --- Release Note: (was: I just committed this. Thanks Zhijie!) > Uniform the NotFound message

[jira] [Updated] (YARN-2230) Fix description of yarn.scheduler.maximum-allocation-vcores in yarn-default.xml (or code)

[ https://issues.apache.org/jira/browse/YARN-2230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated YARN-2230: --- Release Note: (was: I have modified the description of the yarn.scheduler.maximum-allocation-

[jira] [Commented] (YARN-4648) Move preemption related tests from TestFairScheduler to TestFairSchedulerPreemption

[ https://issues.apache.org/jira/browse/YARN-4648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15143676#comment-15143676 ] Tsuyoshi Ozawa commented on YARN-4648: -- [~lewuathe], sure, I'll check this on this wee

[jira] [Updated] (YARN-4676) Automatic and Asynchronous Decommissioning Nodes Status Tracking

[ https://issues.apache.org/jira/browse/YARN-4676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Zhi updated YARN-4676: - Attachment: HADOOP-4676.004.patch > Automatic and Asynchronous Decommissioning Nodes Status Tracking >

[jira] [Created] (YARN-4688) Allow YARN system metrics publisher to use ATS v1.5 APIs

Li Lu created YARN-4688: --- Summary: Allow YARN system metrics publisher to use ATS v1.5 APIs Key: YARN-4688 URL: https://issues.apache.org/jira/browse/YARN-4688 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-1515) Provide ContainerManagementProtocol#signalContainer processing a batch of signals

[ https://issues.apache.org/jira/browse/YARN-1515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15143523#comment-15143523 ] Eric Payne commented on YARN-1515: -- Hi [~jira.shegalov]. I would like to see this function

[jira] [Commented] (YARN-4624) NPE in PartitionQueueCapacitiesInfo while accessing Schduler UI

[ https://issues.apache.org/jira/browse/YARN-4624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15143450#comment-15143450 ] Hadoop QA commented on YARN-4624: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-2575) Create separate ACLs for Reservation create/update/delete/list ops

[ https://issues.apache.org/jira/browse/YARN-2575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Po updated YARN-2575: -- Attachment: YARN-2575-branch-2.8.v11.patch [~asuresh], thanks for reviewing. YARN-2575-branch-2.8.v11.patch is th

[jira] [Commented] (YARN-4525) Bug in RLESparseResourceAllocation.getRangeOverlapping(...)

[ https://issues.apache.org/jira/browse/YARN-4525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15143392#comment-15143392 ] Ishai Menache commented on YARN-4525: - Added the patch that fixes this issue. [~curino]

[jira] [Updated] (YARN-4525) Bug in RLESparseResourceAllocation.getRangeOverlapping(...)

[ https://issues.apache.org/jira/browse/YARN-4525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ishai Menache updated YARN-4525: Attachment: YARN-4525.patch > Bug in RLESparseResourceAllocation.getRangeOverlapping(...) > -

[jira] [Commented] (YARN-2575) Create separate ACLs for Reservation create/update/delete/list ops

[ https://issues.apache.org/jira/browse/YARN-2575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15143296#comment-15143296 ] Hudson commented on YARN-2575: -- FAILURE: Integrated in Hadoop-trunk-Commit #9285 (See [https:

[jira] [Commented] (YARN-2575) Create separate ACLs for Reservation create/update/delete/list ops

[ https://issues.apache.org/jira/browse/YARN-2575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15143294#comment-15143294 ] Arun Suresh commented on YARN-2575: --- Committed totrunk and branch-2, but the patch did no

[jira] [Updated] (YARN-2575) Create separate ACLs for Reservation create/update/delete/list ops

[ https://issues.apache.org/jira/browse/YARN-2575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-2575: -- Summary: Create separate ACLs for Reservation create/update/delete/list ops (was: Consider creating sepa

[jira] [Commented] (YARN-2575) Consider creating separate ACLs for Reservation create/update/delete/list ops

[ https://issues.apache.org/jira/browse/YARN-2575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15143236#comment-15143236 ] Arun Suresh commented on YARN-2575: --- +1 Thanks for all the work on this [~seanpo03] and f

[jira] [Commented] (YARN-4577) Enable aux services to have their own custom classpath/jar file

[ https://issues.apache.org/jira/browse/YARN-4577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15143207#comment-15143207 ] Xuan Gong commented on YARN-4577: - [~sjlee0] Thanks for the review. Looks like we reviewed

[jira] [Commented] (YARN-4624) NPE in PartitionQueueCapacitiesInfo while accessing Schduler UI

[ https://issues.apache.org/jira/browse/YARN-4624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15143175#comment-15143175 ] Devaraj K commented on YARN-4624: - Thanks [~brahmareddy] for the updated patch. {code:xml}

[jira] [Commented] (YARN-2266) Add an application timeout service in RM to kill applications which are not getting resources

[ https://issues.apache.org/jira/browse/YARN-2266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15143169#comment-15143169 ] Devaraj K commented on YARN-2266: - Duplicate of YARN-3813 > Add an application timeout ser

[jira] [Commented] (YARN-4686) MiniYARNCluster.start() returns before cluster is completely started

[ https://issues.apache.org/jira/browse/YARN-4686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15143158#comment-15143158 ] Karthik Kambatla commented on YARN-4686: It makes sense to ensure the mini-cluster

[jira] [Commented] (YARN-2575) Consider creating separate ACLs for Reservation create/update/delete/list ops

[ https://issues.apache.org/jira/browse/YARN-2575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15143145#comment-15143145 ] Sean Po commented on YARN-2575: --- I double checked the hadoop.yarn.server.resourcemanager.Tes

[jira] [Commented] (YARN-4624) NPE in PartitionQueueCapacitiesInfo while accessing Schduler UI

[ https://issues.apache.org/jira/browse/YARN-4624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15143140#comment-15143140 ] Brahma Reddy Battula commented on YARN-4624: [~sunilg] and [~devaraj.k] kindly

[jira] [Assigned] (YARN-4686) MiniYARNCluster.start() returns before cluster is completely started

[ https://issues.apache.org/jira/browse/YARN-4686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reassigned YARN-4686: Assignee: Eric Badger I'd really like to see the minicluster not startup by default with a race con

[jira] [Commented] (YARN-4682) AMRM client to log when AMRM token updated

[ https://issues.apache.org/jira/browse/YARN-4682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15143066#comment-15143066 ] Hadoop QA commented on YARN-4682: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-4501) Document new put APIs in TimelineClient for ATS 1.5

[ https://issues.apache.org/jira/browse/YARN-4501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15142817#comment-15142817 ] Steve Loughran commented on YARN-4501: -- s/give/r/given/ > Document new put APIs in Ti

[jira] [Commented] (YARN-4501) Document new put APIs in TimelineClient for ATS 1.5

[ https://issues.apache.org/jira/browse/YARN-4501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15142815#comment-15142815 ] Steve Loughran commented on YARN-4501: -- give the imminent release of Hadoop 2.8, are t

[jira] [Updated] (YARN-4684) TestYarnCLI#testGetContainers failing in CN locale

[ https://issues.apache.org/jira/browse/YARN-4684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-4684: Summary: TestYarnCLI#testGetContainers failing in CN locale (was: TestYarnCLI#testGetContainers fail

[jira] [Commented] (YARN-4684) TestYarnCLI#testGetContainers failing in trunk

[ https://issues.apache.org/jira/browse/YARN-4684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15142731#comment-15142731 ] Varun Vasudev commented on YARN-4684: - +1. I'll commit this tomorrow if no one objects.

[jira] [Commented] (YARN-4684) TestYarnCLI#testGetContainers failing in trunk

[ https://issues.apache.org/jira/browse/YARN-4684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15142660#comment-15142660 ] Hadoop QA commented on YARN-4684: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-2885) Create AMRMProxy request interceptor for distributed scheduling decisions for queueable containers

[ https://issues.apache.org/jira/browse/YARN-2885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15142636#comment-15142636 ] Hadoop QA commented on YARN-2885: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-2885) Create AMRMProxy request interceptor for distributed scheduling decisions for queueable containers

[ https://issues.apache.org/jira/browse/YARN-2885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15142632#comment-15142632 ] Hadoop QA commented on YARN-2885: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-4682) AMRM client to log when AMRM token updated

[ https://issues.apache.org/jira/browse/YARN-4682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-4682: - Attachment: YARN-4682-002.patch the issue is just that the lines of code above your patch had chang

[jira] [Commented] (YARN-4684) TestYarnCLI#testGetContainers failing in trunk

[ https://issues.apache.org/jira/browse/YARN-4684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15142516#comment-15142516 ] Bibin A Chundatt commented on YARN-4684: [~vvasudev] Thank you for review. Attachi

[jira] [Updated] (YARN-4684) TestYarnCLI#testGetContainers failing in trunk

[ https://issues.apache.org/jira/browse/YARN-4684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-4684: --- Attachment: 0002-YARN-4684.patch > TestYarnCLI#testGetContainers failing in trunk > --

[jira] [Commented] (YARN-4684) TestYarnCLI#testGetContainers failing in trunk

[ https://issues.apache.org/jira/browse/YARN-4684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15142398#comment-15142398 ] Varun Vasudev commented on YARN-4684: - Thanks for the patch [~bibinchundatt]. One minor

[jira] [Commented] (YARN-2266) Add an application timeout service in RM to kill applications which are not getting resources

[ https://issues.apache.org/jira/browse/YARN-2266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15142399#comment-15142399 ] Sudip Hazra Choudhury commented on YARN-2266: - Surely, we are interested in thi

[jira] [Updated] (YARN-2885) Create AMRMProxy request interceptor for distributed scheduling decisions for queueable containers

[ https://issues.apache.org/jira/browse/YARN-2885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-2885: -- Attachment: YARN-2885-yarn-2877.v9.patch Rebasing patch against the branch > Create AMRMProxy request in