[jira] [Commented] (YARN-1639) YARM RM HA requires different configs on different RM hosts

[ https://issues.apache.org/jira/browse/YARN-1639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13883864#comment-13883864 ] Xuan Gong commented on YARN-1639: - Tested the patch in a two-node HA cluster > YARM RM HA

[jira] [Updated] (YARN-1639) YARM RM HA requires different configs on different RM hosts

[ https://issues.apache.org/jira/browse/YARN-1639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-1639: Attachment: YARN-1639.1.patch > YARM RM HA requires different configs on different RM hosts > --

[jira] [Commented] (YARN-1639) YARM RM HA requires different configs on different RM hosts

[ https://issues.apache.org/jira/browse/YARN-1639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13883863#comment-13883863 ] Xuan Gong commented on YARN-1639: - My proposal: 1. yarn.resourcemanager.ha.id will become o

[jira] [Created] (YARN-1662) Capacity Scheduler reservation issue cause Job Hang

Sunil G created YARN-1662: - Summary: Capacity Scheduler reservation issue cause Job Hang Key: YARN-1662 URL: https://issues.apache.org/jira/browse/YARN-1662 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-925) Augment HistoryStorage Reader Interface to Support Filters When Getting Applications

[ https://issues.apache.org/jira/browse/YARN-925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-925: - Assignee: Shinichi Yamashita (was: Mayank Bansal) > Augment HistoryStorage Reader Interface to Support Fil

[jira] [Commented] (YARN-925) Augment HistoryStorage Reader Interface to Support Filters When Getting Applications

[ https://issues.apache.org/jira/browse/YARN-925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13883828#comment-13883828 ] Zhijie Shen commented on YARN-925: -- [~sinchii], thanks for taking care of the filters. I ha

[jira] [Commented] (YARN-1578) Fix how to handle ApplicationHistory about the container

[ https://issues.apache.org/jira/browse/YARN-1578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13883816#comment-13883816 ] Zhijie Shen commented on YARN-1578: --- It should be fine if the container is not finished.

[jira] [Updated] (YARN-1618) Applications transition from NEW to FINAL_SAVING, and try to update non-existing entries in the state-store

[ https://issues.apache.org/jira/browse/YARN-1618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-1618: --- Attachment: yarn-1618-3.patch The patch that retains receiving APP_REJECTED on NEW. Fixed test

[jira] [Created] (YARN-1661) AppMaster logs says failing even if an application does succeed.

Tassapol Athiapinya created YARN-1661: - Summary: AppMaster logs says failing even if an application does succeed. Key: YARN-1661 URL: https://issues.apache.org/jira/browse/YARN-1661 Project: Hadoo

[jira] [Updated] (YARN-1660) add the ability to set yarn.resourcemanager.hostname.rm-id instead of setting all the various host:port properties for RM

[ https://issues.apache.org/jira/browse/YARN-1660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Gupta updated YARN-1660: -- Assignee: Xuan Gong > add the ability to set yarn.resourcemanager.hostname.rm-id instead of setting > a

[jira] [Commented] (YARN-1660) add the ability to set yarn.resourcemanager.hostname.rm-id instead of setting all the various host:port properties for RM

[ https://issues.apache.org/jira/browse/YARN-1660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13883660#comment-13883660 ] Karthik Kambatla commented on YARN-1660: +1 to doing this. Thanks for filing this,

[jira] [Commented] (YARN-1618) Applications transition from NEW to FINAL_SAVING, and try to update non-existing entries in the state-store

[ https://issues.apache.org/jira/browse/YARN-1618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13883659#comment-13883659 ] Karthik Kambatla commented on YARN-1618: bq. I am not sure this would happen in rea

[jira] [Commented] (YARN-1660) add the ability to set yarn.resourcemanager.hostname.rm-id instead of setting all the various host:port properties for RM

[ https://issues.apache.org/jira/browse/YARN-1660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13883658#comment-13883658 ] Arpit Gupta commented on YARN-1660: --- Here is a list of properties that one needs to set f

[jira] [Created] (YARN-1660) add the ability to set yarn.resourcemanager.hostname.rm-id instead of setting all the various host:port properties for RM

Arpit Gupta created YARN-1660: - Summary: add the ability to set yarn.resourcemanager.hostname.rm-id instead of setting all the various host:port properties for RM Key: YARN-1660 URL: https://issues.apache.org/jira/br

[jira] [Commented] (YARN-1630) Unbounded waiting for response in YarnClientImpl.java causes thread to hang forever

[ https://issues.apache.org/jira/browse/YARN-1630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13883614#comment-13883614 ] Hadoop QA commented on YARN-1630: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Assigned] (YARN-1655) [YARN-1197] Add implementations to FairScheduler to support increase/decrease container resource

[ https://issues.apache.org/jira/browse/YARN-1655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza reassigned YARN-1655: Assignee: Sandy Ryza > [YARN-1197] Add implementations to FairScheduler to support increase/decrease

[jira] [Commented] (YARN-1618) Applications transition from NEW to FINAL_SAVING, and try to update non-existing entries in the state-store

[ https://issues.apache.org/jira/browse/YARN-1618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13883598#comment-13883598 ] Karthik Kambatla commented on YARN-1618: bq. Is this related? Does not look like a

[jira] [Commented] (YARN-1618) Applications transition from NEW to FINAL_SAVING, and try to update non-existing entries in the state-store

[ https://issues.apache.org/jira/browse/YARN-1618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13883587#comment-13883587 ] Bikas Saha commented on YARN-1618: -- Is this related? Does not look like a compatible chang

[jira] [Commented] (YARN-1630) Unbounded waiting for response in YarnClientImpl.java causes thread to hang forever

[ https://issues.apache.org/jira/browse/YARN-1630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13883585#comment-13883585 ] Aditya Acharya commented on YARN-1630: -- Updated patch, including a unit test this tim

[jira] [Updated] (YARN-1630) Unbounded waiting for response in YarnClientImpl.java causes thread to hang forever

[ https://issues.apache.org/jira/browse/YARN-1630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aditya Acharya updated YARN-1630: - Attachment: diff-1.txt > Unbounded waiting for response in YarnClientImpl.java causes thread to ha

[jira] [Updated] (YARN-1630) Unbounded waiting for response in YarnClientImpl.java causes thread to hang forever

[ https://issues.apache.org/jira/browse/YARN-1630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aditya Acharya updated YARN-1630: - Attachment: (was: diff-1.txt) > Unbounded waiting for response in YarnClientImpl.java causes t

[jira] [Updated] (YARN-1618) Applications transition from NEW to FINAL_SAVING, and try to update non-existing entries in the state-store

[ https://issues.apache.org/jira/browse/YARN-1618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-1618: --- Target Version/s: 2.3.0 (was: 2.4.0) > Applications transition from NEW to FINAL_SAVING, and

[jira] [Commented] (YARN-1618) Applications transition from NEW to FINAL_SAVING, and try to update non-existing entries in the state-store

[ https://issues.apache.org/jira/browse/YARN-1618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13883536#comment-13883536 ] Karthik Kambatla commented on YARN-1618: Made this a blocker for 2.3, as this leads

[jira] [Commented] (YARN-1600) RM does not startup when security is enabled without spnego configured

[ https://issues.apache.org/jira/browse/YARN-1600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13883470#comment-13883470 ] Hadoop QA commented on YARN-1600: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (YARN-1600) RM does not startup when security is enabled without spnego configured

[ https://issues.apache.org/jira/browse/YARN-1600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-1600: - Target Version/s: 2.3.0 (was: 2.4.0) Affects Version/s: (was: 2.4.0) 2.3.0

[jira] [Commented] (YARN-1642) RMDTRenewer#getRMClient should use ClientRMProxy

[ https://issues.apache.org/jira/browse/YARN-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13883392#comment-13883392 ] Sandy Ryza commented on YARN-1642: -- +1 > RMDTRenewer#getRMClient should use ClientRMProxy

[jira] [Commented] (YARN-1600) RM does not startup when security is enabled without spnego configured

[ https://issues.apache.org/jira/browse/YARN-1600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13883390#comment-13883390 ] Jason Lowe commented on YARN-1600: -- On second thought, holding off the commit until the re

[jira] [Commented] (YARN-1600) RM does not startup when security is enabled without spnego configured

[ https://issues.apache.org/jira/browse/YARN-1600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13883388#comment-13883388 ] Jason Lowe commented on YARN-1600: -- +1, lgtm. Will commit this shortly. > RM does not st

[jira] [Updated] (YARN-1629) IndexOutOfBoundsException in Fair Scheduler MaxRunningAppsEnforcer

[ https://issues.apache.org/jira/browse/YARN-1629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1629: - Target Version/s: 2.3.0 > IndexOutOfBoundsException in Fair Scheduler MaxRunningAppsEnforcer > ---

[jira] [Commented] (YARN-950) Ability to limit or avoid aggregating logs beyond a certain size

[ https://issues.apache.org/jira/browse/YARN-950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13883294#comment-13883294 ] Jason Lowe commented on YARN-950: - Ran into another case where a user filled a disk with a l

[jira] [Created] (YARN-1659) Define store-facing entity, entity-info and event objects

Billie Rinaldi created YARN-1659: Summary: Define store-facing entity, entity-info and event objects Key: YARN-1659 URL: https://issues.apache.org/jira/browse/YARN-1659 Project: Hadoop YARN I

[jira] [Assigned] (YARN-1635) Implement a Leveldb based ApplicationTimelineStore

[ https://issues.apache.org/jira/browse/YARN-1635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi reassigned YARN-1635: Assignee: Billie Rinaldi (was: Vinod Kumar Vavilapalli) > Implement a Leveldb based Applica

[jira] [Commented] (YARN-1630) Unbounded waiting for response in YarnClientImpl.java causes thread to hang forever

[ https://issues.apache.org/jira/browse/YARN-1630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13883269#comment-13883269 ] Hadoop QA commented on YARN-1630: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Assigned] (YARN-1633) Define the entity, entity-info and event objects

[ https://issues.apache.org/jira/browse/YARN-1633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen reassigned YARN-1633: - Assignee: Zhijie Shen (was: Vinod Kumar Vavilapalli) > Define the entity, entity-info and event o

[jira] [Updated] (YARN-1633) Define user-faced entity, entity-info and event objects

[ https://issues.apache.org/jira/browse/YARN-1633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-1633: -- Summary: Define user-faced entity, entity-info and event objects (was: Define the entity, entity-info a

[jira] [Assigned] (YARN-1635) Implement a Leveldb based ApplicationTimelineStore

[ https://issues.apache.org/jira/browse/YARN-1635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen reassigned YARN-1635: - Assignee: Zhijie Shen (was: Vinod Kumar Vavilapalli) > Implement a Leveldb based ApplicationTimel

[jira] [Updated] (YARN-1634) Define a ApplicationTimelineStore interface and an in-memory implementation

[ https://issues.apache.org/jira/browse/YARN-1634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-1634: -- Assignee: Zhijie Shen (was: Vinod Kumar Vavilapalli) > Define a ApplicationTimelineStore interface and

[jira] [Updated] (YARN-1635) Implement a Leveldb based ApplicationTimelineStore

[ https://issues.apache.org/jira/browse/YARN-1635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-1635: -- Assignee: Vinod Kumar Vavilapalli (was: Zhijie Shen) > Implement a Leveldb based ApplicationTimelineSto

[jira] [Updated] (YARN-1636) Implement timeline related web-services inside AHS for storing and retrieving entities+eventies

[ https://issues.apache.org/jira/browse/YARN-1636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-1636: -- Assignee: Zhijie Shen (was: Vinod Kumar Vavilapalli) > Implement timeline related web-services inside A

[jira] [Assigned] (YARN-1637) Implement a client library for java users to post entities+events

[ https://issues.apache.org/jira/browse/YARN-1637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen reassigned YARN-1637: - Assignee: Zhijie Shen (was: Vinod Kumar Vavilapalli) > Implement a client library for java users

[jira] [Commented] (YARN-1658) Webservice should redirect to active RM when HA is enabled.

[ https://issues.apache.org/jira/browse/YARN-1658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13883262#comment-13883262 ] Cindy Li commented on YARN-1658: Talked with Vinod@hortonworks offline. We would like to do

[jira] [Updated] (YARN-1630) Unbounded waiting for response in YarnClientImpl.java causes thread to hang forever

[ https://issues.apache.org/jira/browse/YARN-1630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aditya Acharya updated YARN-1630: - Attachment: diff-1.txt > Unbounded waiting for response in YarnClientImpl.java causes thread to ha

[jira] [Commented] (YARN-1630) Unbounded waiting for response in YarnClientImpl.java causes thread to hang forever

[ https://issues.apache.org/jira/browse/YARN-1630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13883242#comment-13883242 ] Aditya Acharya commented on YARN-1630: -- Added updated diff with requested changes. >

[jira] [Commented] (YARN-1582) Capacity Scheduler: add a maximum-allocation-mb setting per queue

[ https://issues.apache.org/jira/browse/YARN-1582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13883238#comment-13883238 ] Thomas Graves commented on YARN-1582: - Note the patch attached leave the cluster level

[jira] [Updated] (YARN-1582) Capacity Scheduler: add a maximum-allocation-mb setting per queue

[ https://issues.apache.org/jira/browse/YARN-1582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated YARN-1582: Attachment: YARN-1582-branch-0.23.patch Preliminary patch for branch23. The downside to this is tha

[jira] [Commented] (YARN-1658) Webservice should redirect to active RM when HA is enabled.

[ https://issues.apache.org/jira/browse/YARN-1658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13883230#comment-13883230 ] Karthik Kambatla commented on YARN-1658: Shouldn't this be a part of YARN-1525? IOW

[jira] [Created] (YARN-1658) Webservice should redirect to active RM when HA is enabled.

Cindy Li created YARN-1658: -- Summary: Webservice should redirect to active RM when HA is enabled. Key: YARN-1658 URL: https://issues.apache.org/jira/browse/YARN-1658 Project: Hadoop YARN Issue Type

[jira] [Commented] (YARN-745) Move UnmanagedAMLauncher to yarn client package

[ https://issues.apache.org/jira/browse/YARN-745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13883018#comment-13883018 ] Bikas Saha commented on YARN-745: - That was the original plan of action for the unmanaged AM

[jira] [Commented] (YARN-1618) Applications transition from NEW to FINAL_SAVING, and try to update non-existing entries in the state-store

[ https://issues.apache.org/jira/browse/YARN-1618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13882997#comment-13882997 ] Karthik Kambatla commented on YARN-1618: [~bikassaha], [~vinodkv] - will you be abl

[jira] [Commented] (YARN-1632) TestApplicationMasterServices should be under org.apache.hadoop.yarn.server.resourcemanager package

[ https://issues.apache.org/jira/browse/YARN-1632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13882965#comment-13882965 ] Hadoop QA commented on YARN-1632: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (YARN-1632) TestApplicationMasterServices should be under org.apache.hadoop.yarn.server.resourcemanager package

[ https://issues.apache.org/jira/browse/YARN-1632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He updated YARN-1632: -- Attachment: yarn-1632v2.patch > TestApplicationMasterServices should be under > org.apache.hadoop.yarn.server.r

[jira] [Created] (YARN-1657) Timeout occurs in TestNMClient

Akira AJISAKA created YARN-1657: --- Summary: Timeout occurs in TestNMClient Key: YARN-1657 URL: https://issues.apache.org/jira/browse/YARN-1657 Project: Hadoop YARN Issue Type: Bug Affects Ve

[jira] [Commented] (YARN-1480) RM web services getApps() accepts many more filters than ApplicationCLI "list" command

[ https://issues.apache.org/jira/browse/YARN-1480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13882798#comment-13882798 ] Akira AJISAKA commented on YARN-1480: - +1, the timeout in TestNMClient is not related t

[jira] [Updated] (YARN-1480) RM web services getApps() accepts many more filters than ApplicationCLI "list" command

[ https://issues.apache.org/jira/browse/YARN-1480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated YARN-1480: Hadoop Flags: Reviewed > RM web services getApps() accepts many more filters than ApplicationCLI >

[jira] [Updated] (YARN-1656) Return type of YarnRPC.getProxy() should be the given protocol class instead of Object

[ https://issues.apache.org/jira/browse/YARN-1656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hiroshi Ikeda updated YARN-1656: Attachment: YARN-1656.patch Added a sample patch for 2.2.0, which also fixes some similar issues for

[jira] [Created] (YARN-1656) Return type of YarnRPC.getProxy() should be the given protocol class instead of Object

Hiroshi Ikeda created YARN-1656: --- Summary: Return type of YarnRPC.getProxy() should be the given protocol class instead of Object Key: YARN-1656 URL: https://issues.apache.org/jira/browse/YARN-1656 Proj

[jira] [Updated] (YARN-1656) Return type of YarnRPC.getProxy() should be the given protocol class instead of Object

[ https://issues.apache.org/jira/browse/YARN-1656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hiroshi Ikeda updated YARN-1656: Environment: (was: Writing code with explicit cast such as: {code} ((ApplicationClientProtocol) r

[jira] [Updated] (YARN-1656) Return type of YarnRPC.getProxy() should be the given protocol class instead of Object

[ https://issues.apache.org/jira/browse/YARN-1656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hiroshi Ikeda updated YARN-1656: Description: Writing code with explicit cast such as: {code} ((ApplicationClientProtocol) rpc.getPro

[jira] [Commented] (YARN-1480) RM web services getApps() accepts many more filters than ApplicationCLI "list" command

[ https://issues.apache.org/jira/browse/YARN-1480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13882636#comment-13882636 ] Kenji Kikushima commented on YARN-1480: --- I tried "mvn test -Dtest=org.apache.hadoop.y