[jira] [Commented] (YARN-5953) Create CLI for changing YARN configurations

2017-06-05 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16038248#comment-16038248 ] Jonathan Hung commented on YARN-5953: - Uploaded 002 patch containing SchedConfCLI as a

[jira] [Updated] (YARN-5953) Create CLI for changing YARN configurations

2017-06-05 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-5953: Attachment: YARN-5953-YARN-5734.002.patch > Create CLI for changing YARN configurations > ---

[jira] [Commented] (YARN-6693) Regression: YARN minicluster NodeManager fails to start on a Mac

2017-06-05 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16038068#comment-16038068 ] Gopal V commented on YARN-6693: --- This works in 2.7.3 and currently the only thing that breaks

[jira] [Created] (YARN-6693) Regression: YARN minicluster NodeManager fails to start on a Mac

2017-06-05 Thread Gopal V (JIRA)
Gopal V created YARN-6693: - Summary: Regression: YARN minicluster NodeManager fails to start on a Mac Key: YARN-6693 URL: https://issues.apache.org/jira/browse/YARN-6693 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-6691) Update YARN daemon startup/shutdown scripts to include Router service

2017-06-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037984#comment-16037984 ] Hadoop QA commented on YARN-6691: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-6691) Update YARN daemon startup/shutdown scripts to include Router service

2017-06-05 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-6691: --- Attachment: YARN-6691-YARN-2915.v1.patch > Update YARN daemon startup/shutdown

[jira] [Commented] (YARN-6634) [API] Define an API for ResourceManager WebServices

2017-06-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037932#comment-16037932 ] Hadoop QA commented on YARN-6634: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-6634) [API] Define an API for ResourceManager WebServices

2017-06-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037927#comment-16037927 ] Hadoop QA commented on YARN-6634: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-6634) [API] Define an API for ResourceManager WebServices

2017-06-05 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037881#comment-16037881 ] Giovanni Matteo Fumarola commented on YARN-6634: After an offline conversat

[jira] [Updated] (YARN-6634) [API] Define an API for ResourceManager WebServices

2017-06-05 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-6634: --- Attachment: YARN-6634.v8.patch > [API] Define an API for ResourceManager WebSer

[jira] [Updated] (YARN-6634) [API] Define an API for ResourceManager WebServices

2017-06-05 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-6634: --- Attachment: (was: YARN-6634.v8.patch) > [API] Define an API for ResourceMan

[jira] [Updated] (YARN-6634) [API] Define an API for ResourceManager WebServices

2017-06-05 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-6634: --- Attachment: YARN-6634.v8.patch > [API] Define an API for ResourceManager WebSer

[jira] [Commented] (YARN-6692) Delay pause when container is localizing

2017-06-05 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037865#comment-16037865 ] Arun Suresh commented on YARN-6692: --- This situation cannot really happen, since, after YA

[jira] [Comment Edited] (YARN-6692) Delay pause when container is localizing

2017-06-05 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037865#comment-16037865 ] Arun Suresh edited comment on YARN-6692 at 6/5/17 11:53 PM: Thi

[jira] [Commented] (YARN-6547) Enhance SLS-based tests leveraging invariant checker

2017-06-05 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037866#comment-16037866 ] Carlo Curino commented on YARN-6547: Addressing checkstyles (findbugs are unrelated) >

[jira] [Updated] (YARN-6547) Enhance SLS-based tests leveraging invariant checker

2017-06-05 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-6547: --- Attachment: YARN-6547.v3.patch > Enhance SLS-based tests leveraging invariant checker > ---

[jira] [Commented] (YARN-6585) RM fails to start when upgrading from 2.7 to 2.8 for clusters with node labels.

2017-06-05 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037860#comment-16037860 ] Eric Payne commented on YARN-6585: -- Hi [~sunilg], I have come up with a unit test for thi

[jira] [Commented] (YARN-6575) Support global configuration mutation in MutableConfProvider

2017-06-05 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037857#comment-16037857 ] Jonathan Hung commented on YARN-6575: - Awesome, thanks [~xgong]! > Support global conf

[jira] [Updated] (YARN-6575) Support global configuration mutation in MutableConfProvider

2017-06-05 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-6575: Fix Version/s: YARN-5734 > Support global configuration mutation in MutableConfProvider > ---

[jira] [Commented] (YARN-5953) Create CLI for changing YARN configurations

2017-06-05 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037854#comment-16037854 ] Jonathan Hung commented on YARN-5953: - Ah, I forgot about the toJson method...thanks. W

[jira] [Updated] (YARN-1471) The SLS simulator is not running the preemption policy for CapacityScheduler

2017-06-05 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated YARN-1471: -- Labels: (was: release-blocker) Fix Version/s: 2.8.2 2.7.4

[jira] [Commented] (YARN-6692) Delay pause when container is localizing

2017-06-05 Thread Jose Miguel Arreola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037846#comment-16037846 ] Jose Miguel Arreola commented on YARN-6692: --- We want to let the container finish

[jira] [Commented] (YARN-5953) Create CLI for changing YARN configurations

2017-06-05 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037835#comment-16037835 ] Xuan Gong commented on YARN-5953: - [~jhung] In TestRMWebServicesConfigurationMutation#testU

[jira] [Commented] (YARN-6575) Support global configuration mutation in MutableConfProvider

2017-06-05 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037843#comment-16037843 ] Xuan Gong commented on YARN-6575: - Committed. Thanks for the fix, Jonathan. > Support glob

[jira] [Created] (YARN-6692) Delay pause when container is localizing

2017-06-05 Thread Jose Miguel Arreola (JIRA)
Jose Miguel Arreola created YARN-6692: - Summary: Delay pause when container is localizing Key: YARN-6692 URL: https://issues.apache.org/jira/browse/YARN-6692 Project: Hadoop YARN Issue Ty

[jira] [Commented] (YARN-6670) Add separate NM overallocation thresholds for cpu and memory

2017-06-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037814#comment-16037814 ] Hadoop QA commented on YARN-6670: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Comment Edited] (YARN-6670) Add separate NM overallocation thresholds for cpu and memory

2017-06-05 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037812#comment-16037812 ] Konstantinos Karanasos edited comment on YARN-6670 at 6/5/17 11:03 PM: --

[jira] [Commented] (YARN-6670) Add separate NM overallocation thresholds for cpu and memory

2017-06-05 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037812#comment-16037812 ] Konstantinos Karanasos commented on YARN-6670: -- Thanks for the patch, [~haiboc

[jira] [Commented] (YARN-6575) Support global configuration mutation in MutableConfProvider

2017-06-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037807#comment-16037807 ] Hadoop QA commented on YARN-6575: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

[jira] [Commented] (YARN-6687) Validate that the duration of the periodic reservation is less than the periodicity

2017-06-05 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037799#comment-16037799 ] Subru Krishnan commented on YARN-6687: -- The test case failure is unrelated and tracked

[jira] [Updated] (YARN-5333) Some recovered apps are put into default queue when RM HA

2017-06-05 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated YARN-5333: -- Labels: (was: release-blocker) > Some recovered apps are put into default queue when RM

[jira] [Commented] (YARN-5520) [Capacity Scheduler] Change the logic for when to trigger user/group mappings to queues

2017-06-05 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037681#comment-16037681 ] Jonathan Hung commented on YARN-5520: - I opened YARN-6689 for configurable queue placem

[jira] [Created] (YARN-6691) Update YARN daemon startup/shutdown scripts to include Router service

2017-06-05 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-6691: Summary: Update YARN daemon startup/shutdown scripts to include Router service Key: YARN-6691 URL: https://issues.apache.org/jira/browse/YARN-6691 Project: Hadoop YAR

[jira] [Commented] (YARN-6689) PlacementRule should be configurable

2017-06-05 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037674#comment-16037674 ] Jonathan Hung commented on YARN-6689: - Here's an initial patch which reads from yarn.sc

[jira] [Updated] (YARN-6689) PlacementRule should be configurable

2017-06-05 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-6689: Attachment: YARN-6689.001.patch > PlacementRule should be configurable >

[jira] [Commented] (YARN-6575) Support global configuration mutation in MutableConfProvider

2017-06-05 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037660#comment-16037660 ] Xuan Gong commented on YARN-6575: - The patch looks good. Will commit shortly > Support glo

[jira] [Updated] (YARN-6575) Support global configuration mutation in MutableConfProvider

2017-06-05 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-6575: Attachment: YARN-6575-YARN-5734.003.patch rebase the patch and fix the compilation issue. > Support global c

[jira] [Commented] (YARN-6679) Reduce Resource instance overhead via non-PBImpl

2017-06-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037645#comment-16037645 ] Hadoop QA commented on YARN-6679: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Assigned] (YARN-6689) PlacementRule should be configurable

2017-06-05 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung reassigned YARN-6689: --- Assignee: Jonathan Hung > PlacementRule should be configurable > -

[jira] [Commented] (YARN-6670) Add separate NM overallocation thresholds for cpu and memory

2017-06-05 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037632#comment-16037632 ] Haibo Chen commented on YARN-6670: -- Filed YARN-6690 to consolidate the configs with Resour

[jira] [Updated] (YARN-6670) Add separate NM overallocation thresholds for cpu and memory

2017-06-05 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6670: - Attachment: YARN-6670-YARN-1011.01.patch > Add separate NM overallocation thresholds for cpu and memory > -

[jira] [Commented] (YARN-6683) Invalid event: COLLECTOR_UPDATE at KILLED

2017-06-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037555#comment-16037555 ] Hudson commented on YARN-6683: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1182

[jira] [Commented] (YARN-6682) Improve performance of AssignmentInformation datastructures

2017-06-05 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037513#comment-16037513 ] Daryn Sharp commented on YARN-6682: --- Test failures are completely unrelated. Ex. RPC cli

[jira] [Commented] (YARN-6683) Invalid event: COLLECTOR_UPDATE at KILLED

2017-06-05 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037507#comment-16037507 ] Jian He commented on YARN-6683: --- committed to trunk, thanks [~rohithsharma] ! > Invalid even

[jira] [Commented] (YARN-6683) Invalid event: COLLECTOR_UPDATE at KILLED

2017-06-05 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037497#comment-16037497 ] Jian He commented on YARN-6683: --- lgtm, committing > Invalid event: COLLECTOR_UPDATE at KILLE

[jira] [Updated] (YARN-6690) Consolidate NM overallocation thresholds with ResourceTypes

2017-06-05 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6690: - Issue Type: Sub-task (was: Improvement) Parent: YARN-1011 > Consolidate NM overallocation thresho

[jira] [Created] (YARN-6690) Consolidate NM overallocation thresholds with ResourceTypes

2017-06-05 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-6690: Summary: Consolidate NM overallocation thresholds with ResourceTypes Key: YARN-6690 URL: https://issues.apache.org/jira/browse/YARN-6690 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-1471) The SLS simulator is not running the preemption policy for CapacityScheduler

2017-06-05 Thread Ye Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037488#comment-16037488 ] Ye Zhou commented on YARN-1471: --- [~shv]Patches for branch 2.7, branch 2.8 and branch 2 build

[jira] [Commented] (YARN-6670) Add separate NM overallocation thresholds for cpu and memory

2017-06-05 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037483#comment-16037483 ] Haibo Chen commented on YARN-6670: -- Thanks [~kasha] for your review ! In ResourceTypes, a

[jira] [Commented] (YARN-5647) [Security] Collector side changes for loading auth filters and principals

2017-06-05 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037482#comment-16037482 ] Jian He commented on YARN-5647: --- bq. Intention was not to support it temporarily. Because eve

[jira] [Commented] (YARN-6511) Federation Intercepting and propagating AM-RM communications (part two: secondary subclusters added)

2017-06-05 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037471#comment-16037471 ] Jian He commented on YARN-6511: --- i see, thanks for the explanation > Federation Intercepting

[jira] [Updated] (YARN-6679) Reduce Resource instance overhead via non-PBImpl

2017-06-05 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated YARN-6679: -- Attachment: YARN-6679.3.branch-2.patch YARN-6679.3.trunk.patch Findbugs not related to th

[jira] [Comment Edited] (YARN-6511) Federation Intercepting and propagating AM-RM communications (part two: secondary subclusters added)

2017-06-05 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037364#comment-16037364 ] Botong Huang edited comment on YARN-6511 at 6/5/17 6:55 PM: Hi

[jira] [Commented] (YARN-6634) [API] Define an API for ResourceManager WebServices

2017-06-05 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037392#comment-16037392 ] Giovanni Matteo Fumarola commented on YARN-6634: [~curino]/[~subru] in the

[jira] [Updated] (YARN-6634) [API] Define an API for ResourceManager WebServices

2017-06-05 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-6634: --- Attachment: YARN-6634.v7.patch > [API] Define an API for ResourceManager WebSer

[jira] [Commented] (YARN-6511) Federation Intercepting and propagating AM-RM communications (part two: secondary subclusters added)

2017-06-05 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037364#comment-16037364 ] Botong Huang commented on YARN-6511: Hi [~jianhe], thanks for the review! We only regis

[jira] [Commented] (YARN-6511) Federation Intercepting and propagating AM-RM communications (part two: secondary subclusters added)

2017-06-05 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037341#comment-16037341 ] Jian He commented on YARN-6511: --- thanks [~botong], not sure I'm reading it right: Looks like

[jira] [Created] (YARN-6689) PlacementRule should be configurable

2017-06-05 Thread Jonathan Hung (JIRA)
Jonathan Hung created YARN-6689: --- Summary: PlacementRule should be configurable Key: YARN-6689 URL: https://issues.apache.org/jira/browse/YARN-6689 Project: Hadoop YARN Issue Type: Improvement

[jira] [Commented] (YARN-6682) Improve performance of AssignmentInformation datastructures

2017-06-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037256#comment-16037256 ] Hadoop QA commented on YARN-6682: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-6654) RollingLevelDBTimelineStore backwards incompatible after fst upgrade

2017-06-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037225#comment-16037225 ] Hadoop QA commented on YARN-6654: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-6654) RollingLevelDBTimelineStore backwards incompatible after fst upgrade

2017-06-05 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated YARN-6654: -- Attachment: YARN-6654.3.patch Cleaning up the checkstyle warnings in v3 patch. > RollingLevelDBT

[jira] [Commented] (YARN-6683) Invalid event: COLLECTOR_UPDATE at KILLED

2017-06-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037182#comment-16037182 ] Hadoop QA commented on YARN-6683: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-6679) Reduce Resource instance overhead via non-PBImpl

2017-06-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037155#comment-16037155 ] Hadoop QA commented on YARN-6679: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-6663) Backport YARN-5333 to branch-2.8, branch-2.7

2017-06-05 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037156#comment-16037156 ] Sunil G commented on YARN-6663: --- YARN-4927 is now backported. Thank you. > Backport YARN-533

[jira] [Commented] (YARN-4927) TestRMHA#testTransitionedToActiveRefreshFail fails with FairScheduler

2017-06-05 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037154#comment-16037154 ] Sunil G commented on YARN-4927: --- committed to branch-2.7 and branch-2.8. > TestRMHA#testTran

[jira] [Updated] (YARN-4927) TestRMHA#testTransitionedToActiveRefreshFail fails with FairScheduler

2017-06-05 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-4927: -- Fix Version/s: 2.8.2 2.7.4 > TestRMHA#testTransitionedToActiveRefreshFail fails with FairSched

[jira] [Commented] (YARN-6654) RollingLevelDBTimelineStore backwards incompatible after fst upgrade

2017-06-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037147#comment-16037147 ] Hadoop QA commented on YARN-6654: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-4927) TestRMHA#testTransitionedToActiveRefreshFail fails with FairScheduler

2017-06-05 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037139#comment-16037139 ] Sunil G commented on YARN-4927: --- Backporting to branch-2.8 and branch-2.7 as it fixes some te

[jira] [Commented] (YARN-6663) Backport YARN-5333 to branch-2.8, branch-2.7

2017-06-05 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037138#comment-16037138 ] Eric Badger commented on YARN-6663: --- Thanks, [~sunilg]! > Backport YARN-5333 to branch-2

[jira] [Commented] (YARN-5333) Some recovered apps are put into default queue when RM HA

2017-06-05 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037135#comment-16037135 ] Sunil G commented on YARN-5333: --- Yes [~ebadger]. I will make sure necessary comments are also

[jira] [Commented] (YARN-6663) Backport YARN-5333 to branch-2.8, branch-2.7

2017-06-05 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037130#comment-16037130 ] Sunil G commented on YARN-6663: --- Thanks [~ebadger] and [~rohithsharma] I ll backport YARN-492

[jira] [Commented] (YARN-6681) Eliminate double-copy of child queues in canAssignToThisQueue

2017-06-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037123#comment-16037123 ] Hadoop QA commented on YARN-6681: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-6280) Add a query parameter in ResourceManager Cluster Applications REST API to control whether or not returns ResourceRequest

2017-06-05 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037114#comment-16037114 ] Rohith Sharma K S commented on YARN-6280: - Ahh, I see. I am +1 for existing patch.

[jira] [Updated] (YARN-6654) RollingLevelDBTimelineStore backwards incompatible after fst upgrade

2017-06-05 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated YARN-6654: -- Attachment: YARN-6654.2.patch > RollingLevelDBTimelineStore backwards incompatible after fst upgr

[jira] [Commented] (YARN-6663) Backport YARN-5333 to branch-2.8, branch-2.7

2017-06-05 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037089#comment-16037089 ] Rohith Sharma K S commented on YARN-6663: - I just ran back porting YARN-4927 into b

[jira] [Commented] (YARN-6663) Backport YARN-5333 to branch-2.8, branch-2.7

2017-06-05 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037078#comment-16037078 ] Rohith Sharma K S commented on YARN-6663: - It looks in trunk YARN-4927 fixes this i

[jira] [Commented] (YARN-6663) Backport YARN-5333 to branch-2.8, branch-2.7

2017-06-05 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037065#comment-16037065 ] Eric Badger commented on YARN-6663: --- bq. test failures are unrelated to this patch. This

[jira] [Commented] (YARN-5333) Some recovered apps are put into default queue when RM HA

2017-06-05 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037054#comment-16037054 ] Eric Badger commented on YARN-5333: --- [~sunilg], backporting this to 2.8 broke a unit test

[jira] [Updated] (YARN-6681) Eliminate double-copy of child queues in canAssignToThisQueue

2017-06-05 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated YARN-6681: -- Attachment: YARN-6681.2.trunk.patch YARN-6681.2.branch-2.patch YARN-6681.2

[jira] [Updated] (YARN-6679) Reduce Resource instance overhead via non-PBImpl

2017-06-05 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated YARN-6679: -- Attachment: YARN-6679.2.trunk.patch YARN-6679.2.branch-2.patch [~dan...@cloudera.com], I'

[jira] [Comment Edited] (YARN-5647) [Security] Collector side changes for loading auth filters and principals

2017-06-05 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037029#comment-16037029 ] Varun Saxena edited comment on YARN-5647 at 6/5/17 2:25 PM: Tha

[jira] [Commented] (YARN-5647) [Security] Collector side changes for loading auth filters and principals

2017-06-05 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037030#comment-16037030 ] Varun Saxena commented on YARN-5647: BTW findbugs warnings seem to be carried over from

[jira] [Commented] (YARN-5647) [Security] Collector side changes for loading auth filters and principals

2017-06-05 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037029#comment-16037029 ] Varun Saxena commented on YARN-5647: Thanks [~jianhe] and [~rohithsharma] for the revie

[jira] [Commented] (YARN-6280) Add a query parameter in ResourceManager Cluster Applications REST API to control whether or not returns ResourceRequest

2017-06-05 Thread Lantao Jin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16036954#comment-16036954 ] Lantao Jin commented on YARN-6280: -- [~rohithsharma] I don't think it's friendly if user qu

[jira] [Commented] (YARN-5647) [Security] Collector side changes for loading auth filters and principals

2017-06-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16036948#comment-16036948 ] Hadoop QA commented on YARN-5647: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-6428) Queue AM limit is not honored in CS always

2017-06-05 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16036918#comment-16036918 ] Naganarasimha G R commented on YARN-6428: - Hi [~bibinchundatt], Also we can have th

[jira] [Updated] (YARN-6683) Invalid event: COLLECTOR_UPDATE at KILLED

2017-06-05 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-6683: Attachment: YARN-6683.001.patch > Invalid event: COLLECTOR_UPDATE at KILLED > ---

[jira] [Comment Edited] (YARN-6428) Queue AM limit is not honored in CS always

2017-06-05 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16036779#comment-16036779 ] Bibin A Chundatt edited comment on YARN-6428 at 6/5/17 10:28 AM:

[jira] [Commented] (YARN-6428) Queue AM limit is not honored in CS always

2017-06-05 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16036779#comment-16036779 ] Bibin A Chundatt commented on YARN-6428: Adding point we had in offline discussion

[jira] [Commented] (YARN-6467) CSQueueMetrics needs to update the current metrics for default partition only

2017-06-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16036706#comment-16036706 ] Hadoop QA commented on YARN-6467: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-6467) CSQueueMetrics needs to update the current metrics for default partition only

2017-06-05 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1603#comment-1603 ] Manikandan R commented on YARN-6467: Fixed checkstyle and whitespace issues. > CSQueue

[jira] [Updated] (YARN-6467) CSQueueMetrics needs to update the current metrics for default partition only

2017-06-05 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikandan R updated YARN-6467: --- Attachment: YARN-6467.004.patch > CSQueueMetrics needs to update the current metrics for default partit

[jira] [Commented] (YARN-6683) Invalid event: COLLECTOR_UPDATE at KILLED

2017-06-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16036629#comment-16036629 ] Hadoop QA commented on YARN-6683: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-6683) Invalid event: COLLECTOR_UPDATE at KILLED

2017-06-05 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-6683: Attachment: YARN-6683.001.patch updated the patch with directly updating collector address. T