[jira] [Created] (YARN-7092) [YARN-3368] Log viewer in application page in yarn-ui-v2

2017-08-23 Thread Akhil PB (JIRA)
Akhil PB created YARN-7092: -- Summary: [YARN-3368] Log viewer in application page in yarn-ui-v2 Key: YARN-7092 URL: https://issues.apache.org/jira/browse/YARN-7092 Project: Hadoop YARN Issue Type: Su

[jira] [Commented] (YARN-7079) to support nodemanager ports management

2017-08-23 Thread Feng Yuan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16139603#comment-16139603 ] Feng Yuan commented on YARN-7079: - [~tianjuan],Thanks your work on this very much. > to s

[jira] [Reopened] (YARN-4227) FairScheduler: RM quits processing expired container from a removed node

2017-08-23 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg reopened YARN-4227: - [~Steven Rand] looks like you are correct, lets re-open this issue. The {{containerComp

[jira] [Created] (YARN-7091) Some rename changes in yarn-native-services

2017-08-23 Thread Jian He (JIRA)
Jian He created YARN-7091: - Summary: Some rename changes in yarn-native-services Key: YARN-7091 URL: https://issues.apache.org/jira/browse/YARN-7091 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Resolved] (YARN-7011) yarn-daemon.sh is not respecting --config option

2017-08-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved YARN-7011. Resolution: Not A Problem Closing this again given the behavior is actually the same given th

[jira] [Commented] (YARN-6712) Moving logging APIs over to slf4j in hadoop-yarn

2017-08-23 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16139539#comment-16139539 ] Akira Ajisaka commented on YARN-6712: - Hi [~vinodkv], now I filed MAPREDUCE-6946. > Mo

[jira] [Commented] (YARN-7047) Moving logging APIs over to slf4j in hadoop-yarn-server-nodemanager

2017-08-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16139516#comment-16139516 ] Hadoop QA commented on YARN-7047: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-7047) Moving logging APIs over to slf4j in hadoop-yarn-server-nodemanager

2017-08-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16139506#comment-16139506 ] Hadoop QA commented on YARN-7047: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-7047) Moving logging APIs over to slf4j in hadoop-yarn-server-nodemanager

2017-08-23 Thread Yeliang Cang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yeliang Cang updated YARN-7047: --- Attachment: YARN-7047-branch-2.004.patch > Moving logging APIs over to slf4j in hadoop-yarn-server-node

[jira] [Commented] (YARN-7047) Moving logging APIs over to slf4j in hadoop-yarn-server-nodemanager

2017-08-23 Thread Yeliang Cang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16139476#comment-16139476 ] Yeliang Cang commented on YARN-7047: Sorry, I forgot NavBlock.java. Submit branch-2 pat

[jira] [Updated] (YARN-7047) Moving logging APIs over to slf4j in hadoop-yarn-server-nodemanager

2017-08-23 Thread Yeliang Cang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yeliang Cang updated YARN-7047: --- Attachment: YARN-7047-branch-2.003.patch > Moving logging APIs over to slf4j in hadoop-yarn-server-node

[jira] [Commented] (YARN-7010) Federation: routing REST invocations transparently to multiple RMs (part 2 - getApps)

2017-08-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16139463#comment-16139463 ] Hadoop QA commented on YARN-7010: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-6712) Moving logging APIs over to slf4j in hadoop-yarn

2017-08-23 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16139460#comment-16139460 ] Vinod Kumar Vavilapalli commented on YARN-6712: --- [~ajisakaa], is there a MapR

[jira] [Commented] (YARN-7077) TestAMSimulator and TestNMSimulator fail

2017-08-23 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16139459#comment-16139459 ] Akira Ajisaka commented on YARN-7077: - My patch removes these properties in {{.hadoop-

[jira] [Commented] (YARN-7047) Moving logging APIs over to slf4j in hadoop-yarn-server-nodemanager

2017-08-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16139453#comment-16139453 ] Hadoop QA commented on YARN-7047: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-7090) testRMRestartAfterNodeLabelDisabled get failed when CapacityScheduler is configured

2017-08-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16139444#comment-16139444 ] Hudson commented on YARN-7090: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1223

[jira] [Updated] (YARN-7090) testRMRestartAfterNodeLabelDisabled get failed when CapacityScheduler is configured

2017-08-23 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-7090: - Summary: testRMRestartAfterNodeLabelDisabled get failed when CapacityScheduler is configured (was: Only ru

[jira] [Commented] (YARN-7090) Only run testRMRestartAfterNodeLabelDisabled when CapacityScheduler is configured

2017-08-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16139407#comment-16139407 ] Hadoop QA commented on YARN-7090: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-7047) Moving logging APIs over to slf4j in hadoop-yarn-server-nodemanager

2017-08-23 Thread Yeliang Cang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yeliang Cang updated YARN-7047: --- Attachment: YARN-7047-branch-2.002.patch > Moving logging APIs over to slf4j in hadoop-yarn-server-node

[jira] [Updated] (YARN-7047) Moving logging APIs over to slf4j in hadoop-yarn-server-nodemanager

2017-08-23 Thread Yeliang Cang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yeliang Cang updated YARN-7047: --- Attachment: (was: YARN-7047-branch-2.002.patch) > Moving logging APIs over to slf4j in hadoop-yarn-

[jira] [Commented] (YARN-7019) Ability for applications to notify YARN about container reuse

2017-08-23 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16139397#comment-16139397 ] Joep Rottinghuis commented on YARN-7019: Agreed that we should generalize this to a

[jira] [Commented] (YARN-7010) Federation: routing REST invocations transparently to multiple RMs (part 2 - getApps)

2017-08-23 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16139389#comment-16139389 ] Giovanni Matteo Fumarola commented on YARN-7010: In V2 I added metrics and

[jira] [Updated] (YARN-7010) Federation: routing REST invocations transparently to multiple RMs (part 2 - getApps)

2017-08-23 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-7010: --- Attachment: YARN-7010.v2.patch > Federation: routing REST invocations transpare

[jira] [Commented] (YARN-6876) Create an abstract log writer for extendability

2017-08-23 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16139376#comment-16139376 ] Junping Du commented on YARN-6876: -- 006 patch LGTM. The findbugs issue and unit test failu

[jira] [Commented] (YARN-7090) Only run testRMRestartAfterNodeLabelDisabled when CapacityScheduler is configured

2017-08-23 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16139374#comment-16139374 ] Junping Du commented on YARN-7090: -- 002 patch LGTM. +1 pending on Jenkins report. > Only

[jira] [Updated] (YARN-7090) Only run testRMRestartAfterNodeLabelDisabled when CapacityScheduler is configured

2017-08-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7090: - Attachment: YARN-7090.002.patch Fixed another potential issue as well (002). > Only run testRMRestartAfter

[jira] [Commented] (YARN-7090) Only run testRMRestartAfterNodeLabelDisabled when CapacityScheduler is configured

2017-08-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16139330#comment-16139330 ] Hadoop QA commented on YARN-7090: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-7010) Federation: routing REST invocations transparently to multiple RMs (part 2 - getApps)

2017-08-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16139317#comment-16139317 ] Hadoop QA commented on YARN-7010: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-6876) Create an abstract log writer for extendability

2017-08-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16139307#comment-16139307 ] Hadoop QA commented on YARN-6876: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-6550) Capture launch_container.sh logs

2017-08-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16139291#comment-16139291 ] Hadoop QA commented on YARN-6550: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Assigned] (YARN-4090) Make Collections.sort() more efficient by caching resource usage

2017-08-23 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu reassigned YARN-4090: -- Assignee: Yufei Gu (was: zhangshilong) > Make Collections.sort() more efficient by caching resource usa

[jira] [Commented] (YARN-4090) Make Collections.sort() more efficient by caching resource usage

2017-08-23 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16139276#comment-16139276 ] Yufei Gu commented on YARN-4090: Thanks [~zsl2007]. > Make Collections.sort() more efficie

[jira] [Commented] (YARN-7077) TestAMSimulator and TestNMSimulator fail

2017-08-23 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16139268#comment-16139268 ] Yufei Gu commented on YARN-7077: Thanks [~ajisakaa] for filing this. It makes more sense to

[jira] [Updated] (YARN-7090) Only run testRMRestartAfterNodeLabelDisabled when CapacityScheduler is configured

2017-08-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7090: - Attachment: YARN-7090.001.patch Attached ver.1 patch > Only run testRMRestartAfterNodeLabelDisabled when C

[jira] [Updated] (YARN-7090) Only run testRMRestartAfterNodeLabelDisabled when CapacityScheduler is configured

2017-08-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7090: - Summary: Only run testRMRestartAfterNodeLabelDisabled when CapacityScheduler is configured (was: testRMRes

[jira] [Assigned] (YARN-7090) testRMRestartAfterNodeLabelDisabled[1] UT Fails

2017-08-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned YARN-7090: Assignee: Wangda Tan > testRMRestartAfterNodeLabelDisabled[1] UT Fails > ---

[jira] [Commented] (YARN-7086) Release all containers aynchronously

2017-08-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16139241#comment-16139241 ] Wangda Tan commented on YARN-7086: -- The only potential issue I can see is: prior to this c

[jira] [Created] (YARN-7090) testRMRestartAfterNodeLabelDisabled[1] UT Fails

2017-08-23 Thread Yesha Vora (JIRA)
Yesha Vora created YARN-7090: Summary: testRMRestartAfterNodeLabelDisabled[1] UT Fails Key: YARN-7090 URL: https://issues.apache.org/jira/browse/YARN-7090 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-7066) Add ability to specify volumes to mount for DockerContainerRuntime

2017-08-23 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16139233#comment-16139233 ] Eric Yang commented on YARN-7066: - The findbug warning is false positive for mounting /sys/

[jira] [Updated] (YARN-6550) Capture launch_container.sh logs

2017-08-23 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-6550: --- Attachment: YARN-6550.008.patch Fixed Container Launch UT failures which read from prelaunch.st

[jira] [Commented] (YARN-7073) Rest API site documentation

2017-08-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16139224#comment-16139224 ] Hadoop QA commented on YARN-7073: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

[jira] [Commented] (YARN-7089) Mark the log-aggregation-controller APIs as public

2017-08-23 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16139218#comment-16139218 ] Junping Du commented on YARN-7089: -- This is from: https://issues.apache.org/jira/browse/Y

[jira] [Commented] (YARN-7066) Add ability to specify volumes to mount for DockerContainerRuntime

2017-08-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16139206#comment-16139206 ] Hadoop QA commented on YARN-7066: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-7037) Optimize data transfer with zero-copy approach for containerlogs REST API in NMWebServices

2017-08-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16139197#comment-16139197 ] Hadoop QA commented on YARN-7037: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Assigned] (YARN-7087) NM failed to perform log aggregation due to absent container

2017-08-23 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reassigned YARN-7087: Assignee: Jason Lowe > NM failed to perform log aggregation due to absent container > --

[jira] [Comment Edited] (YARN-7010) Federation: routing REST invocations transparently to multiple RMs (part 2 - getApps)

2017-08-23 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16139177#comment-16139177 ] Giovanni Matteo Fumarola edited comment on YARN-7010 at 8/23/17 9:39 PM:

[jira] [Commented] (YARN-7010) Federation: routing REST invocations transparently to multiple RMs (part 2 - getApps)

2017-08-23 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16139177#comment-16139177 ] Giovanni Matteo Fumarola commented on YARN-7010: Thanks [~curino] for the f

[jira] [Commented] (YARN-7066) Add ability to specify volumes to mount for DockerContainerRuntime

2017-08-23 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16139165#comment-16139165 ] Eric Yang commented on YARN-7066: - [~miklos.szeg...@cloudera.com] This is designed to work

[jira] [Updated] (YARN-6876) Create an abstract log writer for extendability

2017-08-23 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-6876: Attachment: YARN-6876-trunk.006.patch > Create an abstract log writer for extendability > ---

[jira] [Commented] (YARN-6876) Create an abstract log writer for extendability

2017-08-23 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16139157#comment-16139157 ] Xuan Gong commented on YARN-6876: - Thanks for the review. [~djp] bq. LogAggregationFileCon

[jira] [Created] (YARN-7089) Mark the log-aggregation-controller APIs as public

2017-08-23 Thread Xuan Gong (JIRA)
Xuan Gong created YARN-7089: --- Summary: Mark the log-aggregation-controller APIs as public Key: YARN-7089 URL: https://issues.apache.org/jira/browse/YARN-7089 Project: Hadoop YARN Issue Type: Sub-ta

[jira] [Commented] (YARN-6550) Capture launch_container.sh logs

2017-08-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16139152#comment-16139152 ] Hadoop QA commented on YARN-6550: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-7010) Federation: routing REST invocations transparently to multiple RMs (part 2 - getApps)

2017-08-23 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-7010: --- Attachment: YARN-7010.v1.patch > Federation: routing REST invocations transpare

[jira] [Commented] (YARN-7073) Rest API site documentation

2017-08-23 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16139144#comment-16139144 ] Gour Saha commented on YARN-7073: - Uploading 002 with whitespace fix. > Rest API site docu

[jira] [Updated] (YARN-7073) Rest API site documentation

2017-08-23 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gour Saha updated YARN-7073: Attachment: YARN-7073-yarn-native-services.002.patch > Rest API site documentation >

[jira] [Commented] (YARN-5464) Server-Side NM Graceful Decommissioning with RM HA

2017-08-23 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16139142#comment-16139142 ] Junping Du commented on YARN-5464: -- Nope. I haven't find any slot yet. May be we should go

[jira] [Commented] (YARN-7066) Add ability to specify volumes to mount for DockerContainerRuntime

2017-08-23 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16139138#comment-16139138 ] Miklos Szegedi commented on YARN-7066: -- [~eyang], is not this a security issue? What p

[jira] [Commented] (YARN-4266) Allow users to enter containers as UID:GID pair instead of by username

2017-08-23 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16139136#comment-16139136 ] Eric Yang commented on YARN-4266: - [~templedf] GroupMappingServiceProvider contains only st

[jira] [Commented] (YARN-7083) Log aggregation deletes/renames while file is open

2017-08-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16139127#comment-16139127 ] Hadoop QA commented on YARN-7083: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-5464) Server-Side NM Graceful Decommissioning with RM HA

2017-08-23 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16139123#comment-16139123 ] Robert Kanter commented on YARN-5464: - [~djp], have you been able to make any progress

[jira] [Updated] (YARN-7037) Optimize data transfer with zero-copy approach for containerlogs REST API in NMWebServices

2017-08-23 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-7037: - Target Version/s: 2.8.2 > Optimize data transfer with zero-copy approach for containerlogs REST API in > N

[jira] [Commented] (YARN-7037) Optimize data transfer with zero-copy approach for containerlogs REST API in NMWebServices

2017-08-23 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16139117#comment-16139117 ] Junping Du commented on YARN-7037: -- Thanks [~Tao Yang] for delivering the patch. The appro

[jira] [Commented] (YARN-6640) AM heartbeat stuck when responseId overflows MAX_INT

2017-08-23 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16139055#comment-16139055 ] Botong Huang commented on YARN-6640: Unit test failure is irrelevant and being tracked

[jira] [Updated] (YARN-7066) Add ability to specify volumes to mount for DockerContainerRuntime

2017-08-23 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7066: Attachment: YARN-7066.001.patch > Add ability to specify volumes to mount for DockerContainerRuntime > --

[jira] [Updated] (YARN-6550) Capture launch_container.sh logs

2017-08-23 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-6550: --- Attachment: YARN-6550.007.patch The previous patch had portability issues on Ubuntu. Attaching

[jira] [Assigned] (YARN-7083) Log aggregation deletes/renames while file is open

2017-08-23 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reassigned YARN-7083: Assignee: Jason Lowe > Log aggregation deletes/renames while file is open >

[jira] [Updated] (YARN-7083) Log aggregation deletes/renames while file is open

2017-08-23 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-7083: - Attachment: YARN-7083.001.patch Here's a patch that should fix the issue, since it closes the try-with-res

[jira] [Created] (YARN-7088) Fix application start time and add submit time to UIs

2017-08-23 Thread Abdullah Yousufi (JIRA)
Abdullah Yousufi created YARN-7088: -- Summary: Fix application start time and add submit time to UIs Key: YARN-7088 URL: https://issues.apache.org/jira/browse/YARN-7088 Project: Hadoop YARN I

[jira] [Updated] (YARN-7037) Optimize data transfer with zero-copy approach for containerlogs REST API in NMWebServices

2017-08-23 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-7037: - Affects Version/s: (was: 2.8.3) 2.8.0 > Optimize data transfer with zero-copy ap

[jira] [Commented] (YARN-6876) Create an abstract log writer for extendability

2017-08-23 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16139039#comment-16139039 ] Junping Du commented on YARN-6876: -- Thanks [~xgong] for updating the patch. The latest pat

[jira] [Commented] (YARN-7074) Fix NM state store update comment

2017-08-23 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16139038#comment-16139038 ] Botong Huang commented on YARN-7074: Hi [~kasha], can you help me commit this one? Than

[jira] [Commented] (YARN-7073) Rest API site documentation

2017-08-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16139032#comment-16139032 ] Hadoop QA commented on YARN-7073: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-7087) NM failed to perform log aggregation due to absent container

2017-08-23 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16139030#comment-16139030 ] Jason Lowe commented on YARN-7087: -- Looks like this is related to YARN-221 and YARN-4152.

[jira] [Commented] (YARN-6736) Consider writing to both ats v1 & v2 from RM for smoother upgrades

2017-08-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16139020#comment-16139020 ] Hadoop QA commented on YARN-6736: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Created] (YARN-7087) NM failed to perform log aggregation due to absent container

2017-08-23 Thread Jason Lowe (JIRA)
Jason Lowe created YARN-7087: Summary: NM failed to perform log aggregation due to absent container Key: YARN-7087 URL: https://issues.apache.org/jira/browse/YARN-7087 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-7086) Release all containers aynchronously

2017-08-23 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16138947#comment-16138947 ] Karthik Kambatla commented on YARN-7086: I like Jason's idea. > Release all conta

[jira] [Updated] (YARN-7050) Post cleanup after YARN-6903, removal of org.apache.slider package

2017-08-23 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi updated YARN-7050: - Summary: Post cleanup after YARN-6903, removal of org.apache.slider package (was: Post cleanup aft

[jira] [Commented] (YARN-7050) Post cleanup after YARN-6903

2017-08-23 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16138925#comment-16138925 ] Billie Rinaldi commented on YARN-7050: -- Patch 08 looks good. (The unit test failures a

[jira] [Commented] (YARN-7086) Release all containers aynchronously

2017-08-23 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16138915#comment-16138915 ] Jason Lowe commented on YARN-7086: -- We've noticed container release is particularly painfu

[jira] [Updated] (YARN-7052) RM SchedulingMonitor gives no indication why the spawned thread crashed.

2017-08-23 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-7052: - Description: In YARN-7051, we ran into a case where the preemption monitor thread hung with no indication

[jira] [Commented] (YARN-7079) to support nodemanager ports management

2017-08-23 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16138895#comment-16138895 ] Devaraj K commented on YARN-7079: - [~tianjuan428], Thanks for the patch, patch seems to be

[jira] [Commented] (YARN-7056) Document Resource Profiles feature

2017-08-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16138880#comment-16138880 ] Hadoop QA commented on YARN-7056: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

[jira] [Updated] (YARN-5355) YARN Timeline Service v.2: alpha 2

2017-08-23 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-5355: --- Attachment: Documentation - The YARN Timeline Service v2.pdf > YARN Timeline Service v.2: alpha 2 > ---

[jira] [Comment Edited] (YARN-7066) Add ability to specify volumes to mount for DockerContainerRuntime

2017-08-23 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16138862#comment-16138862 ] Eric Yang edited comment on YARN-7066 at 8/23/17 6:43 PM: -- The cur

[jira] [Commented] (YARN-7066) Add ability to specify volumes to mount for DockerContainerRuntime

2017-08-23 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16138862#comment-16138862 ] Eric Yang commented on YARN-7066: - The current proposed syntax looks like this: {code} {

[jira] [Updated] (YARN-5592) Add support for dynamic resource updates with multiple resource types

2017-08-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-5592: -- Issue Type: Bug (was: Sub-task) Parent: (was: YARN-3926) > Add support for dynamic resource updates

[jira] [Updated] (YARN-5592) Add support for dynamic resource updates with multiple resource types

2017-08-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-5592: -- Issue Type: Sub-task (was: Bug) Parent: YARN-7069 > Add support for dynamic resource updates with multip

[jira] [Updated] (YARN-5591) Update web UIs to reflect multiple resource types

2017-08-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-5591: -- Issue Type: Sub-task (was: Bug) Parent: YARN-7069 > Update web UIs to reflect multiple resource types >

[jira] [Updated] (YARN-5590) Add support for increase and decrease of container resources with resource profiles

2017-08-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-5590: -- Issue Type: Sub-task (was: Bug) Parent: YARN-7069 > Add support for increase and decrease of container r

[jira] [Updated] (YARN-5590) Add support for increase and decrease of container resources with resource profiles

2017-08-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-5590: -- Issue Type: Bug (was: Sub-task) Parent: (was: YARN-3926) > Add support for increase and decrease of

[jira] [Updated] (YARN-5591) Update web UIs to reflect multiple resource types

2017-08-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-5591: -- Issue Type: Bug (was: Sub-task) Parent: (was: YARN-3926) > Update web UIs to reflect multiple resour

[jira] [Updated] (YARN-5589) Update CapacitySchedulerConfiguration minimum and maximum calculations to consider all resource types

2017-08-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-5589: -- Issue Type: Sub-task (was: Bug) Parent: YARN-7069 > Update CapacitySchedulerConfiguration minimum and ma

[jira] [Updated] (YARN-5589) Update CapacitySchedulerConfiguration minimum and maximum calculations to consider all resource types

2017-08-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-5589: -- Issue Type: Bug (was: Sub-task) Parent: (was: YARN-3926) > Update CapacitySchedulerConfiguration min

[jira] [Assigned] (YARN-7056) Document Resource Profiles feature

2017-08-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G reassigned YARN-7056: - Assignee: Sunil G > Document Resource Profiles feature > -- > >

[jira] [Updated] (YARN-7056) Document Resource Profiles feature

2017-08-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7056: -- Attachment: YARN-7056.YARN-3926.001.patch Attaching an initial patch to add basic documentation for resource prof

[jira] [Created] (YARN-7086) Release all containers aynchronously

2017-08-23 Thread Arun Suresh (JIRA)
Arun Suresh created YARN-7086: - Summary: Release all containers aynchronously Key: YARN-7086 URL: https://issues.apache.org/jira/browse/YARN-7086 Project: Hadoop YARN Issue Type: Bug Co

[jira] [Commented] (YARN-7024) Fix issues on recovery in LevelDB store

2017-08-23 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16138816#comment-16138816 ] Xuan Gong commented on YARN-7024: - +1 lgtm. Committed into YARN-5734 branch. Thanks, Jona

[jira] [Updated] (YARN-7085) Application.schedule(), Application.getResources(), and Application.assign() appear to only be used via test code

2017-08-23 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-7085: --- Summary: Application.schedule(), Application.getResources(), and Application.assign() appear to

[jira] [Created] (YARN-7085) Application.schedule() and Application.assign() appear to only be used in test code

2017-08-23 Thread Daniel Templeton (JIRA)
Daniel Templeton created YARN-7085: -- Summary: Application.schedule() and Application.assign() appear to only be used in test code Key: YARN-7085 URL: https://issues.apache.org/jira/browse/YARN-7085 P

[jira] [Updated] (YARN-6736) Consider writing to both ats v1 & v2 from RM for smoother upgrades

2017-08-23 Thread Aaron Gresch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Gresch updated YARN-6736: --- Attachment: YARN-6736-YARN-5355.005.patch > Consider writing to both ats v1 & v2 from RM for smoother u

  1   2   >