[jira] [Commented] (YARN-5375) invoke MockRM#drainEvents implicitly in MockRM methods to reduce test failures

2016-11-15 Thread sandflee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15669662#comment-15669662 ] sandflee commented on YARN-5375: update YARN-5375.12.new.patch to trigger jenkins > invoke

[jira] [Updated] (YARN-5888) Add test cases in new YARN UI

2016-11-15 Thread Akhil PB (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akhil PB updated YARN-5888: --- Description: Add missing test cases in new YARN UI Fix test cases errors in new YARN UI was: Add missing te

[jira] [Created] (YARN-5888) Add test cases in new YARN UI

2016-11-15 Thread Akhil PB (JIRA)
Akhil PB created YARN-5888: -- Summary: Add test cases in new YARN UI Key: YARN-5888 URL: https://issues.apache.org/jira/browse/YARN-5888 Project: Hadoop YARN Issue Type: Sub-task Components

[jira] [Commented] (YARN-5877) Allow all nm-whitelist-env to get overridden during launch

2016-11-15 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15669571#comment-15669571 ] Varun Saxena commented on YARN-5877: [~bibinchundatt], I was leaning towards the same.

[jira] [Commented] (YARN-5375) invoke MockRM#drainEvents implicitly in MockRM methods to reduce test failures

2016-11-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15669348#comment-15669348 ] Hadoop QA commented on YARN-5375: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-5877) Allow all nm-whitelist-env to get overridden during launch

2016-11-15 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-5877: --- Attachment: yarn-site.xml bootstrap.sh Dockerfile Attaching doc

[jira] [Commented] (YARN-5877) Allow all nm-whitelist-env to get overridden during launch

2016-11-15 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15669254#comment-15669254 ] Bibin A Chundatt commented on YARN-5877: [~sunilg] {quote} Ideally a mismatch may

[jira] [Updated] (YARN-5375) invoke MockRM#drainEvents implicitly in MockRM methods to reduce test failures

2016-11-15 Thread sandflee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sandflee updated YARN-5375: --- Attachment: YARN-5375.12.new.patch > invoke MockRM#drainEvents implicitly in MockRM methods to reduce test fail

[jira] [Commented] (YARN-5600) Add a parameter to ContainerLaunchContext to emulate yarn.nodemanager.delete.debug-delay-sec on a per-application basis

2016-11-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15669156#comment-15669156 ] Hadoop QA commented on YARN-5600: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

[jira] [Commented] (YARN-5670) Add support for Docker image clean up

2016-11-15 Thread luhuichun (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15669111#comment-15669111 ] luhuichun commented on YARN-5670: - [~sidharta-s] Hi Sidharta, we have some issue for this

[jira] [Commented] (YARN-5375) invoke MockRM#drainEvents implicitly in MockRM methods to reduce test failures

2016-11-15 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15669107#comment-15669107 ] Rohith Sharma K S commented on YARN-5375: - [~sandflee] latest patch *YARN-5375.12.p

[jira] [Commented] (YARN-5669) Add support for Docker pull

2016-11-15 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15669088#comment-15669088 ] Sidharta Seethana commented on YARN-5669: - Thanks for the clarification. YARN-3854

[jira] [Commented] (YARN-5885) Cleanup YARN-4752 for merge

2016-11-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15669084#comment-15669084 ] Hadoop QA commented on YARN-5885: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-5669) Add support for Docker pull

2016-11-15 Thread luhuichun (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15669064#comment-15669064 ] luhuichun commented on YARN-5669: - [~sidharta-s] we divide the localization support for th

[jira] [Commented] (YARN-5762) Summarize ApplicationNotFoundException in the RM log

2016-11-15 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15669054#comment-15669054 ] Ravi Prakash commented on YARN-5762: Hi Jian He! I did notice the {{ApplicationBaseProt

[jira] [Commented] (YARN-5864) Capacity Scheduler preemption for fragmented cluster

2016-11-15 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15669047#comment-15669047 ] Carlo Curino commented on YARN-5864: [~wangda] I think we are on the same page on the p

[jira] [Updated] (YARN-5885) Cleanup YARN-4752 for merge

2016-11-15 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5885: --- Attachment: yarn-5885.2.patch > Cleanup YARN-4752 for merge > --- > >

[jira] [Updated] (YARN-5600) Add a parameter to ContainerLaunchContext to emulate yarn.nodemanager.delete.debug-delay-sec on a per-application basis

2016-11-15 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-5600: - Attachment: YARN-5600.014.patch Fixing checkstyle and unit test > Add a parameter to ContainerLaun

[jira] [Commented] (YARN-5669) Add support for Docker pull

2016-11-15 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15668968#comment-15668968 ] Zhankun Tang commented on YARN-5669: [~sidharta-s], The YARN-3854, YARN-5669 and YARN-5

[jira] [Commented] (YARN-5881) Enable configuration of queue capacity in terms of absolute resources

2016-11-15 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15668964#comment-15668964 ] Carlo Curino commented on YARN-5881: [~seanpo03] thanks for raising this JIRA. This is

[jira] [Commented] (YARN-5292) Support for PAUSED container state

2016-11-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15668940#comment-15668940 ] Hadoop QA commented on YARN-5292: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-5669) Add support for Docker pull

2016-11-15 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15668932#comment-15668932 ] Sidharta Seethana commented on YARN-5669: - Hi [~luhuichun], Isn't the scope of this

[jira] [Commented] (YARN-5885) Cleanup YARN-4752 for merge

2016-11-15 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15668920#comment-15668920 ] Daniel Templeton commented on YARN-5885: Patch looks good. On the first pass, I on

[jira] [Commented] (YARN-1593) support out-of-proc AuxiliaryServices

2016-11-15 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15668916#comment-15668916 ] Konstantinos Karanasos commented on YARN-1593: -- Thanks for starting this! As [

[jira] [Commented] (YARN-5600) Add a parameter to ContainerLaunchContext to emulate yarn.nodemanager.delete.debug-delay-sec on a per-application basis

2016-11-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15668813#comment-15668813 ] Hadoop QA commented on YARN-5600: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-5836) Malicious AM can kill containers of other apps running in any node its containers are running

2016-11-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15668811#comment-15668811 ] Hadoop QA commented on YARN-5836: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

[jira] [Commented] (YARN-5634) Simplify initialization/use of RouterPolicy via a RouterPolicyFacade

2016-11-15 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15668732#comment-15668732 ] Subru Krishnan commented on YARN-5634: -- Thanks [~curino] for addressing my feedback. T

[jira] [Commented] (YARN-5287) LinuxContainerExecutor fails to set proper permission

2016-11-15 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15668690#comment-15668690 ] Andrew Wang commented on YARN-5287: --- Thanks for the ping Brahma, seems like we're all on

[jira] [Updated] (YARN-5836) Malicious AM can kill containers of other apps running in any node its containers are running

2016-11-15 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-5836: --- Attachment: YARN-5836.v2.patch > Malicious AM can kill containers of other apps running in any node its

[jira] [Commented] (YARN-5136) Error in handling event type APP_ATTEMPT_REMOVED to the scheduler

2016-11-15 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15668678#comment-15668678 ] Wilfred Spiegelenburg commented on YARN-5136: - I was thrown of track a bit with

[jira] [Commented] (YARN-1593) support out-of-proc AuxiliaryServices

2016-11-15 Thread Hitesh Sharma (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15668649#comment-15668649 ] Hitesh Sharma commented on YARN-1593: - Thanks [~asuresh] for pointing to [YARN-5501]. A

[jira] [Updated] (YARN-5836) Malicious AM can kill containers of other apps running in any node its containers are running

2016-11-15 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-5836: --- Attachment: (was: YARN-5836.v2.patch) > Malicious AM can kill containers of other apps running in a

[jira] [Updated] (YARN-5600) Add a parameter to ContainerLaunchContext to emulate yarn.nodemanager.delete.debug-delay-sec on a per-application basis

2016-11-15 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-5600: - Attachment: YARN-5600.013.patch Rebasing patch. > Add a parameter to ContainerLaunchContext to emu

[jira] [Commented] (YARN-5280) Allow YARN containers to run with Java Security Manager

2016-11-15 Thread Greg Phillips (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15668629#comment-15668629 ] Greg Phillips commented on YARN-5280: - [~vvasudev] - thanks for the guidance. I have d

[jira] [Commented] (YARN-5836) Malicious AM can kill containers of other apps running in any node its containers are running

2016-11-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15668632#comment-15668632 ] Hadoop QA commented on YARN-5836: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-5836) Malicious AM can kill containers of other apps running in any node its containers are running

2016-11-15 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-5836: --- Attachment: YARN-5836.v2.patch > Malicious AM can kill containers of other apps running in any node its

[jira] [Commented] (YARN-5814) Add druid as storage backend in YARN Timeline Service

2016-11-15 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15668610#comment-15668610 ] Sangjin Lee commented on YARN-5814: --- Thanks [~BINGXUE QIU] for adding more details. It so

[jira] [Commented] (YARN-5875) TestTokenClientRMService#testTokenRenewalWrongUser fails

2016-11-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15668575#comment-15668575 ] Hudson commented on YARN-5875: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1084

[jira] [Commented] (YARN-5600) Add a parameter to ContainerLaunchContext to emulate yarn.nodemanager.delete.debug-delay-sec on a per-application basis

2016-11-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15668543#comment-15668543 ] Hadoop QA commented on YARN-5600: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-5600) Add a parameter to ContainerLaunchContext to emulate yarn.nodemanager.delete.debug-delay-sec on a per-application basis

2016-11-15 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-5600: - Attachment: YARN-5600.012.patch Patch addressing comments of [~vvasudev] > Add a parameter to Cont

[jira] [Commented] (YARN-5713) Update jackson from 1.9.13 to 2.x in hadoop-yarn

2016-11-15 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15668520#comment-15668520 ] Akira Ajisaka commented on YARN-5713: - Sure! > Update jackson from 1.9.13 to 2.x in ha

[jira] [Updated] (YARN-5875) TestTokenClientRMService#testTokenRenewalWrongUser fails

2016-11-15 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated YARN-5875: Summary: TestTokenClientRMService#testTokenRenewalWrongUser fails (was: TestTokenClientRMService#testTokenRe

[jira] [Commented] (YARN-1593) support out-of-proc AuxiliaryServices

2016-11-15 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15668499#comment-15668499 ] Sangjin Lee commented on YARN-1593: --- Thanks for starting the proposal! I took a quick lo

[jira] [Commented] (YARN-5875) TestTokenClientRMService#testTokenRenewalWrongUser fails on trunk

2016-11-15 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15668500#comment-15668500 ] Xiao Chen commented on YARN-5875: - +1 committing this. Thanks [~varun_saxena] for reporting

[jira] [Commented] (YARN-5600) Add a parameter to ContainerLaunchContext to emulate yarn.nodemanager.delete.debug-delay-sec on a per-application basis

2016-11-15 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15668474#comment-15668474 ] Miklos Szegedi commented on YARN-5600: -- Thank you, [~vvasudev] for the comments! I add

[jira] [Commented] (YARN-3053) [Security] Review and implement security in ATS v.2

2016-11-15 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15668416#comment-15668416 ] Li Lu commented on YARN-3053: - bq. Can we capture that aspect as a future work as part of imple

[jira] [Commented] (YARN-5736) YARN container executor config does not handle white space

2016-11-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15668391#comment-15668391 ] Hudson commented on YARN-5736: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1084

[jira] [Commented] (YARN-5836) Malicious AM can kill containers of other apps running in any node its containers are running

2016-11-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15668353#comment-15668353 ] Hadoop QA commented on YARN-5836: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-5736) YARN container executor config does not handle white space

2016-11-15 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15668308#comment-15668308 ] Daniel Templeton commented on YARN-5736: +1 Checking in. > YARN container executo

[jira] [Commented] (YARN-5836) Malicious AM can kill containers of other apps running in any node its containers are running

2016-11-15 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15668274#comment-15668274 ] Botong Huang commented on YARN-5836: [~jlowe] You are right, it turns out that the RPC

[jira] [Commented] (YARN-5736) YARN container executor config does not handle white space

2016-11-15 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15668259#comment-15668259 ] Shane Kumpf commented on YARN-5736: --- Thanks [~miklos.szeg...@cloudera.com] for the quick

[jira] [Updated] (YARN-5836) Malicious AM can kill containers of other apps running in any node its containers are running

2016-11-15 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-5836: - Summary: Malicious AM can kill containers of other apps running in any node its containers are running (wa

[jira] [Commented] (YARN-5736) YARN container executor config does not handle white space

2016-11-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15668186#comment-15668186 ] Hadoop QA commented on YARN-5736: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-5870) Expose getApplications API in YarnClient with GetApplicationsRequest parameter

2016-11-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15668172#comment-15668172 ] Hadoop QA commented on YARN-5870: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-5836) ContainerManagerImpl not throwing exception when AppId in NMTokenIdentifier does not match containerId to kill. Malicious AM can kill containers of other apps running in a

2016-11-15 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-5836: --- Attachment: YARN-5836.v1.patch > ContainerManagerImpl not throwing exception when AppId in NMTokenIdent

[jira] [Updated] (YARN-5836) ContainerManagerImpl not throwing exception when AppId in NMTokenIdentifier does not match containerId to kill. Malicious AM can kill containers of other apps running in a

2016-11-15 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-5836: --- Summary: ContainerManagerImpl not throwing exception when AppId in NMTokenIdentifier does not match con

[jira] [Updated] (YARN-5836) NMToken passwd not checked in ContainerManagerImpl, malicious AM can fake the Token and kill containers of other apps at will

2016-11-15 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-5836: --- Description: When AM calls NM via {{ContainerManagementProtocol}}, the NMToken is suppied for authenti

[jira] [Commented] (YARN-4355) NPE while processing localizer heartbeat

2016-11-15 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15668084#comment-15668084 ] Naganarasimha G R commented on YARN-4355: - Its not exactly a contributor's responsi

[jira] [Commented] (YARN-5736) YARN container executor config does not handle white space

2016-11-15 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15668081#comment-15668081 ] Miklos Szegedi commented on YARN-5736: -- Thank you, [~shaneku...@gmail.com], for report

[jira] [Assigned] (YARN-4355) NPE while processing localizer heartbeat

2016-11-15 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R reassigned YARN-4355: --- Assignee: Naganarasimha G R (was: Varun Saxena) > NPE while processing localizer hear

[jira] [Updated] (YARN-4355) NPE while processing localizer heartbeat

2016-11-15 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-4355: Assignee: Varun Saxena (was: Naganarasimha G R) > NPE while processing localizer heartbeat >

[jira] [Commented] (YARN-3053) [Security] Review and implement security in ATS v.2

2016-11-15 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15668066#comment-15668066 ] Sangjin Lee commented on YARN-3053: --- {quote} A real challenge is to provide a general app

[jira] [Updated] (YARN-5736) YARN container executor config does not handle white space

2016-11-15 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-5736: - Attachment: YARN-5736.addendum.000.patch Adding addendum patch > YARN container executor config do

[jira] [Commented] (YARN-4752) [Umbrella] FairScheduler: Improve preemption

2016-11-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15668053#comment-15668053 ] Hadoop QA commented on YARN-4752: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-5885) Cleanup YARN-4752 for merge

2016-11-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15668035#comment-15668035 ] Hadoop QA commented on YARN-5885: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-5870) Expose getApplications API in YarnClient with GetApplicationsRequest parameter

2016-11-15 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5870: -- Attachment: YARN-5870.1.patch > Expose getApplications API in YarnClient with GetApplicationsRequest parameter >

[jira] [Commented] (YARN-5870) Expose getApplications API in YarnClient with GetApplicationsRequest parameter

2016-11-15 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15668020#comment-15668020 ] Jian He commented on YARN-5870: --- Good catch, Rohith ! I updated the patch to fix that. > E

[jira] [Created] (YARN-5887) Policies for choosing which opportunistic containers to kill

2016-11-15 Thread Konstantinos Karanasos (JIRA)
Konstantinos Karanasos created YARN-5887: Summary: Policies for choosing which opportunistic containers to kill Key: YARN-5887 URL: https://issues.apache.org/jira/browse/YARN-5887 Project: Had

[jira] [Commented] (YARN-5713) Update jackson from 1.9.13 to 2.x in hadoop-yarn

2016-11-15 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15667936#comment-15667936 ] Steve Loughran commented on YARN-5713: -- I'm @ apachecon right now; not looking @ code.

[jira] [Assigned] (YARN-5886) Dynamically prioritize execution of opportunistic containers (NM queue reordering)

2016-11-15 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantinos Karanasos reassigned YARN-5886: Assignee: Konstantinos Karanasos > Dynamically prioritize execution of oppor

[jira] [Created] (YARN-5886) Dynamically prioritize execution of opportunistic containers (NM queue reordering)

2016-11-15 Thread Konstantinos Karanasos (JIRA)
Konstantinos Karanasos created YARN-5886: Summary: Dynamically prioritize execution of opportunistic containers (NM queue reordering) Key: YARN-5886 URL: https://issues.apache.org/jira/browse/YARN-5886

[jira] [Updated] (YARN-4972) Cleanup ContainerScheduler tests to remove long sleep times

2016-11-15 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantinos Karanasos updated YARN-4972: - Parent Issue: YARN-5541 (was: YARN-4742) > Cleanup ContainerScheduler tests to rem

[jira] [Updated] (YARN-4972) Cleanup ContainerScheduler tests to remove long sleep times

2016-11-15 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantinos Karanasos updated YARN-4972: - Summary: Cleanup ContainerScheduler tests to remove long sleep times (was: Cleanup

[jira] [Commented] (YARN-4828) Create a pull request template for github

2016-11-15 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15667897#comment-15667897 ] Sangjin Lee commented on YARN-4828: --- If my understanding is correct, we should place the

[jira] [Updated] (YARN-2889) Limit in the number of opportunistic container requests per AM

2016-11-15 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantinos Karanasos updated YARN-2889: - Parent Issue: YARN-5542 (was: YARN-4742) > Limit in the number of opportunistic co

[jira] [Updated] (YARN-2889) Limit in the number of opportunistic container requests per AM

2016-11-15 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantinos Karanasos updated YARN-2889: - Summary: Limit in the number of opportunistic container requests per AM (was: Limi

[jira] [Updated] (YARN-5216) Expose configurable preemption policy for OPPORTUNISTIC containers running on the NM

2016-11-15 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantinos Karanasos updated YARN-5216: - Issue Type: Sub-task (was: Bug) Parent: YARN-5541 > Expose configurable pr

[jira] [Updated] (YARN-5415) Add support for NodeLocal and RackLocal OPPORTUNISTIC requests

2016-11-15 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantinos Karanasos updated YARN-5415: - Parent Issue: YARN-5542 (was: YARN-4742) > Add support for NodeLocal and RackLocal

[jira] [Updated] (YARN-2886) Estimating waiting time in NM container queues

2016-11-15 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantinos Karanasos updated YARN-2886: - Parent Issue: YARN-5542 (was: YARN-4742) > Estimating waiting time in NM container

[jira] [Updated] (YARN-5414) Integrate NodeQueueLoadMonitor with ClusterNodeTracker

2016-11-15 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantinos Karanasos updated YARN-5414: - Parent Issue: YARN-5542 (was: YARN-4742) > Integrate NodeQueueLoadMonitor with Clu

[jira] [Updated] (YARN-5688) Make allocation of opportunistic containers asynchronous

2016-11-15 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantinos Karanasos updated YARN-5688: - Issue Type: Sub-task (was: Improvement) Parent: YARN-5542 > Make allocatio

[jira] [Commented] (YARN-5885) Cleanup YARN-4752 for merge

2016-11-15 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15667812#comment-15667812 ] Karthik Kambatla commented on YARN-5885: Also, posted the [cumulative patch|https:

[jira] [Updated] (YARN-4752) [Umbrella] FairScheduler: Improve preemption

2016-11-15 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4752: --- Attachment: yarn-4752.3.patch > [Umbrella] FairScheduler: Improve preemption >

[jira] [Assigned] (YARN-5769) Integrate update app lifetime using feature implemented in YARN-5611

2016-11-15 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He reassigned YARN-5769: - Assignee: Jian He > Integrate update app lifetime using feature implemented in YARN-5611 > ---

[jira] [Commented] (YARN-5884) TestTokenClientRMService#testTokenRenewalWrongUser Fails after HADOOP-13720

2016-11-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15667794#comment-15667794 ] Hadoop QA commented on YARN-5884: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

[jira] [Updated] (YARN-5885) Cleanup YARN-4752 for merge

2016-11-15 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5885: --- Attachment: yarn-5885.1.patch > Cleanup YARN-4752 for merge > --- > >

[jira] [Created] (YARN-5885) Cleanup YARN-4752 for merge

2016-11-15 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created YARN-5885: -- Summary: Cleanup YARN-4752 for merge Key: YARN-5885 URL: https://issues.apache.org/jira/browse/YARN-5885 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Reopened] (YARN-5736) YARN container executor config does not handle white space

2016-11-15 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf reopened YARN-5736: --- > YARN container executor config does not handle white space >

[jira] [Commented] (YARN-5736) YARN container executor config does not handle white space

2016-11-15 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15667770#comment-15667770 ] Shane Kumpf commented on YARN-5736: --- Parsing of container-executor.cfg appears to have be

[jira] [Commented] (YARN-4355) NPE while processing localizer heartbeat

2016-11-15 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15667768#comment-15667768 ] Jonathan Hung commented on YARN-4355: - Thanks everyone! Also I missed the CHANGES.txt a

[jira] [Created] (YARN-5884) TestTokenClientRMService#testTokenRenewalWrongUser Fails after HADOOP-13720

2016-11-15 Thread Brahma Reddy Battula (JIRA)
Brahma Reddy Battula created YARN-5884: -- Summary: TestTokenClientRMService#testTokenRenewalWrongUser Fails after HADOOP-13720 Key: YARN-5884 URL: https://issues.apache.org/jira/browse/YARN-5884 P

[jira] [Commented] (YARN-5884) TestTokenClientRMService#testTokenRenewalWrongUser Fails after HADOOP-13720

2016-11-15 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15667654#comment-15667654 ] Brahma Reddy Battula commented on YARN-5884: Yes..thanks [~sunilg] > TestToken

[jira] [Commented] (YARN-5884) TestTokenClientRMService#testTokenRenewalWrongUser Fails after HADOOP-13720

2016-11-15 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15667643#comment-15667643 ] Sunil G commented on YARN-5884: --- Possible duplicate of YARN-5875 ? > TestTokenClientRMServic

[jira] [Updated] (YARN-5884) TestTokenClientRMService#testTokenRenewalWrongUser Fails after HADOOP-13720

2016-11-15 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated YARN-5884: --- Attachment: YARN-5884.patch Uploaded the patch..Kindly review. > TestTokenClientRMServ

[jira] [Commented] (YARN-1593) support out-of-proc AuxiliaryServices

2016-11-15 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15667638#comment-15667638 ] Varun Vasudev commented on YARN-1593: - [~asuresh] - {quote} Thanks for driving this Va

[jira] [Commented] (YARN-1593) support out-of-proc AuxiliaryServices

2016-11-15 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15667624#comment-15667624 ] Varun Vasudev commented on YARN-1593: - [~hitesh] - {quote} My concern is around the fe

[jira] [Commented] (YARN-4597) Introduce ContainerScheduler and a SCHEDULED state to NodeManager container lifecycle

2016-11-15 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15667562#comment-15667562 ] Brahma Reddy Battula commented on YARN-4597: It's worked after clean compile..S

[jira] [Commented] (YARN-4597) Introduce ContainerScheduler and a SCHEDULED state to NodeManager container lifecycle

2016-11-15 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15667557#comment-15667557 ] Arun Suresh commented on YARN-4597: --- Looks like the build passed too : https://builds.a

[jira] [Commented] (YARN-4597) Introduce ContainerScheduler and a SCHEDULED state to NodeManager container lifecycle

2016-11-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15667554#comment-15667554 ] Hudson commented on YARN-4597: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1083

[jira] [Commented] (YARN-4597) Introduce ContainerScheduler and a SCHEDULED state to NodeManager container lifecycle

2016-11-15 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15667539#comment-15667539 ] Arun Suresh commented on YARN-4597: --- [~brahmareddy], can you try a mvn clean compile ? It

  1   2   >