[jira] [Commented] (YARN-7277) Container Launch expand environment needs to consider bracket matching

2018-11-12 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16684793#comment-16684793 ] Akira Ajisaka commented on YARN-7277: - If we run this test in hadoop-yarn-server-nodem

[jira] [Comment Edited] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

2018-11-12 Thread Xun Liu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16684794#comment-16684794 ] Xun Liu edited comment on YARN-8714 at 11/13/18 7:01 AM: - # Suppor

***UNCHECKED*** [jira] [Commented] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

2018-11-12 Thread Xun Liu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16684794#comment-16684794 ] Xun Liu commented on YARN-8714: --- # Support files and folders # HDFS type and local file typ

[jira] [Comment Edited] (YARN-8960) [Submarine] Can't get submarine service status using the command of "yarn app -status" under security environment

2018-11-12 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16684788#comment-16684788 ] Zac Zhou edited comment on YARN-8960 at 11/13/18 6:53 AM: -- As dis

[jira] [Commented] (YARN-5168) Add port mapping handling when docker container use bridge network

2018-11-12 Thread Xun Liu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16684791#comment-16684791 ] Xun Liu commented on YARN-5168: --- [~eyang],We really need to map this feature to the port. Ma

[jira] [Commented] (YARN-8960) [Submarine] Can't get submarine service status using the command of "yarn app -status" under security environment

2018-11-12 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16684788#comment-16684788 ] Zac Zhou commented on YARN-8960: As discussion offline, we can use the same kerberos keyta

[jira] [Comment Edited] (YARN-8960) [Submarine] Can't get submarine service status using the command of "yarn app -status" under security environment

2018-11-12 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16684788#comment-16684788 ] Zac Zhou edited comment on YARN-8960 at 11/13/18 6:50 AM: -- As dis

[jira] [Commented] (YARN-9013) [GPG] fix order of steps cleaning Registry entries in ApplicationCleaner

2018-11-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16684780#comment-16684780 ] Hadoop QA commented on YARN-9013: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (YARN-9013) [GPG] fix order of steps cleaning Registry entries in ApplicationCleaner

2018-11-12 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-9013: --- Attachment: YARN-9013-YARN-7402.v2.patch > [GPG] fix order of steps cleaning Registry entries in Appli

[jira] [Commented] (YARN-6523) Newly retrieved security Tokens are sent as part of each heartbeat to each node from RM which is not desirable in large cluster

2018-11-12 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16684714#comment-16684714 ] Manikandan R commented on YARN-6523: Crash error. Not related to this patch. Re-run sh

[jira] [Updated] (YARN-8885) Support NM APIs to query device resource allocation

2018-11-12 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8885: --- Attachment: YARN-8885-trunk.001.patch > Support NM APIs to query device resource allocation >

[jira] [Issue Comment Deleted] (YARN-2823) NullPointerException in RM HA enabled 3-node cluster

2018-11-12 Thread Paul Lin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Lin updated YARN-2823: --- Comment: was deleted (was: [~imstefanlee] Hi, I'm facing the same issue with Flink applications. I tried expl

[jira] [Comment Edited] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

2018-11-12 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16684664#comment-16684664 ] Zac Zhou edited comment on YARN-8714 at 11/13/18 3:14 AM: -- Looks

[jira] [Comment Edited] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

2018-11-12 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16684664#comment-16684664 ] Zac Zhou edited comment on YARN-8714 at 11/13/18 3:14 AM: -- Looks

[jira] [Comment Edited] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

2018-11-12 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16684664#comment-16684664 ] Zac Zhou edited comment on YARN-8714 at 11/13/18 3:13 AM: -- Looks

[jira] [Commented] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

2018-11-12 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16684664#comment-16684664 ] Zac Zhou commented on YARN-8714: Looks great, it would be convenient for notebook app, lik

[jira] [Commented] (YARN-8672) TestContainerManager#testLocalingResourceWhileContainerRunning occasionally times out

2018-11-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16684662#comment-16684662 ] Hadoop QA commented on YARN-8672: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-8672) TestContainerManager#testLocalingResourceWhileContainerRunning occasionally times out

2018-11-12 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16684652#comment-16684652 ] Chandni Singh commented on YARN-8672: - [~eyang] Please take a look at patch 6. I teste

[jira] [Updated] (YARN-8672) TestContainerManager#testLocalingResourceWhileContainerRunning occasionally times out

2018-11-12 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-8672: Attachment: YARN-8672.006.patch > TestContainerManager#testLocalingResourceWhileContainerRunning occ

[jira] [Commented] (YARN-9001) [Submarine] Use AppAdminClient instead of ServiceClient to sumbit jobs

2018-11-12 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16684639#comment-16684639 ] Zac Zhou commented on YARN-9001: Sure, Wangda The following test cases have been executed

[jira] [Commented] (YARN-8898) Fix FederationInterceptor#allocate to set application priority in allocateResponse

2018-11-12 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16684634#comment-16684634 ] Subru Krishnan commented on YARN-8898: -- Thanks [~bibinchundatt] and [~botong] for pro

[jira] [Commented] (YARN-8997) [Submarine] Small refactors of modifier, condition check and redundant local variables

2018-11-12 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16684610#comment-16684610 ] Zhankun Tang commented on YARN-8997: [~giovanni.fumarola] . Thanks for the review! >

[jira] [Commented] (YARN-9013) [GPG] fix order of steps cleaning Registry entries in ApplicationCleaner

2018-11-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16684607#comment-16684607 ] Hadoop QA commented on YARN-9013: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (YARN-8761) Service AM support for decommissioning component instances

2018-11-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16684593#comment-16684593 ] Hudson commented on YARN-8761: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #154

[jira] [Commented] (YARN-8982) [Router] Add locality policy

2018-11-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16684591#comment-16684591 ] Hadoop QA commented on YARN-8982: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (YARN-8761) Service AM support for decommissioning component instances

2018-11-12 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16684581#comment-16684581 ] Eric Yang commented on YARN-8761: - This feature will allow decommission of containers. Th

[jira] [Commented] (YARN-8761) Service AM support for decommissioning component instances

2018-11-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16684564#comment-16684564 ] Hadoop QA commented on YARN-8761: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (YARN-7898) [FederationStateStore] Create a proxy chain for FederationStateStore API in the Router

2018-11-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16684535#comment-16684535 ] Hadoop QA commented on YARN-7898: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-8982) [Router] Add locality policy

2018-11-12 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-8982: --- Attachment: YARN-8982.v2.patch > [Router] Add locality policy > -

[jira] [Commented] (YARN-8986) publish all exposed ports to random ports when using bridge network

2018-11-12 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16684529#comment-16684529 ] Eric Yang commented on YARN-8986: - [~Charo Zhang] User can define their own bridge network

[jira] [Assigned] (YARN-8986) publish all exposed ports to random ports when using bridge network

2018-11-12 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang reassigned YARN-8986: --- Assignee: Charo Zhang > publish all exposed ports to random ports when using bridge network > ---

[jira] [Assigned] (YARN-5168) Add port mapping handling when docker container use bridge network

2018-11-12 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang reassigned YARN-5168: --- Assignee: Eric Yang > Add port mapping handling when docker container use bridge network > --

[jira] [Commented] (YARN-9014) OCI/squashfs container runtime

2018-11-12 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16684493#comment-16684493 ] Jason Lowe commented on YARN-9014: -- Attached a rough draft of the document. There's quit

[jira] [Updated] (YARN-9014) OCI/squashfs container runtime

2018-11-12 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-9014: - Attachment: OciSquashfsRuntime.v001.pdf > OCI/squashfs container runtime > --

[jira] [Commented] (YARN-8997) [Submarine] Small refactors of modifier, condition check and redundant local variables

2018-11-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16684476#comment-16684476 ] Hudson commented on YARN-8997: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #154

[jira] [Commented] (YARN-9001) [Submarine] Use AppAdminClient instead of ServiceClient to sumbit jobs

2018-11-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16684468#comment-16684468 ] Wangda Tan commented on YARN-9001: -- [~yuan_zac], checked the patch, in general patch look

[jira] [Updated] (YARN-8997) [Submarine] Small refactors of modifier, condition check and redundant local variables

2018-11-12 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-8997: --- Fix Version/s: 3.3.0 > [Submarine] Small refactors of modifier, condition chec

[jira] [Updated] (YARN-9014) OCI/squashfs container runtime

2018-11-12 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-9014: -- Labels: Docker (was: ) > OCI/squashfs container runtime > -- > >

[jira] [Commented] (YARN-9003) Support multi-homed network for docker container

2018-11-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16684454#comment-16684454 ] Hadoop QA commented on YARN-9003: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote

[jira] [Created] (YARN-9014) OCI/squashfs container runtime

2018-11-12 Thread Jason Lowe (JIRA)
Jason Lowe created YARN-9014: Summary: OCI/squashfs container runtime Key: YARN-9014 URL: https://issues.apache.org/jira/browse/YARN-9014 Project: Hadoop YARN Issue Type: New Feature

[jira] [Commented] (YARN-8761) Service AM support for decommissioning component instances

2018-11-12 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16684436#comment-16684436 ] Billie Rinaldi commented on YARN-8761: -- Rebased to trunk. > Service AM support for d

[jira] [Updated] (YARN-8761) Service AM support for decommissioning component instances

2018-11-12 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi updated YARN-8761: - Attachment: YARN-8761.05.patch > Service AM support for decommissioning component instances >

[jira] [Updated] (YARN-7898) [FederationStateStore] Create a proxy chain for FederationStateStore API in the Router

2018-11-12 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-7898: --- Attachment: YARN-7898-YARN-7402.v6.patch > [FederationStateStore] Create a pro

[jira] [Commented] (YARN-7898) [FederationStateStore] Create a proxy chain for FederationStateStore API in the Router

2018-11-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16684387#comment-16684387 ] Hadoop QA commented on YARN-7898: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-9013) [GPG] fix order of steps cleaning Registry entries in ApplicationCleaner

2018-11-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16684369#comment-16684369 ] Hadoop QA commented on YARN-9013: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-8992) Fair scheduler can delete a dynamic queue while an application attempt is being added to the queue

2018-11-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16684362#comment-16684362 ] Hadoop QA commented on YARN-8992: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-9003) Support multi-homed network for docker container

2018-11-12 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-9003: Attachment: YARN-9003.001.patch > Support multi-homed network for docker container > ---

[jira] [Commented] (YARN-6523) Newly retrieved security Tokens are sent as part of each heartbeat to each node from RM which is not desirable in large cluster

2018-11-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16684343#comment-16684343 ] Hadoop QA commented on YARN-6523: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-9013) [GPG] fix order of steps cleaning Registry entries in ApplicationCleaner

2018-11-12 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-9013: --- Attachment: YARN-9013-YARN-7402.v1.patch > [GPG] fix order of steps cleaning Registry entries in Appli

[jira] [Updated] (YARN-7898) [FederationStateStore] Create a proxy chain for FederationStateStore API in the Router

2018-11-12 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-7898: --- Attachment: YARN-7898-YARN-7402.v5.patch > [FederationStateStore] Create a pro

[jira] [Commented] (YARN-9008) Extend YARN distributed shell with file localization feature

2018-11-12 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16684249#comment-16684249 ] Peter Bacsko commented on YARN-9008: Also inviting [~haibochen] for a review. > Exten

[jira] [Commented] (YARN-8776) Container Executor change to create stdin/stdout pipeline

2018-11-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16684248#comment-16684248 ] Hudson commented on YARN-8776: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #154

[jira] [Commented] (YARN-8898) Fix FederationInterceptor#allocate to set application priority in allocateResponse

2018-11-12 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16684243#comment-16684243 ] Bibin A Chundatt commented on YARN-8898: [~botong] Attached patch based on soluti

[jira] [Commented] (YARN-8672) TestContainerManager#testLocalingResourceWhileContainerRunning occasionally times out

2018-11-12 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16684242#comment-16684242 ] Eric Yang commented on YARN-8672: - [~csingh] The token file is used in two purposes. One

[jira] [Updated] (YARN-8898) Fix FederationInterceptor#allocate to set application priority in allocateResponse

2018-11-12 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-8898: --- Attachment: YARN-8898.wip.patch > Fix FederationInterceptor#allocate to set application priori

[jira] [Assigned] (YARN-8776) Container Executor change to create stdin/stdout pipeline

2018-11-12 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi reassigned YARN-8776: Assignee: Eric Yang (was: Zian Chen) > Container Executor change to create stdin/stdout pi

[jira] [Commented] (YARN-8776) Container Executor change to create stdin/stdout pipeline

2018-11-12 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16684228#comment-16684228 ] Billie Rinaldi commented on YARN-8776: -- +1 for patch 7. Thanks [~eyang] and [~Zian Ch

[jira] [Updated] (YARN-9013) [GPG] fix order of steps cleaning Registry entries in ApplicationCleaner

2018-11-12 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-9013: --- Parent Issue: YARN-7402 (was: YARN-5597) > [GPG] fix order of steps cleaning Registry entries in Appl

[jira] [Updated] (YARN-9013) [GPG] fix order of steps cleaning Registry entries in ApplicationCleaner

2018-11-12 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-9013: --- Issue Type: Sub-task (was: Task) Parent: YARN-5597 > [GPG] fix order of steps cleaning Regist

[jira] [Created] (YARN-9013) [GPG] fix order of steps cleaning Registry entries in ApplicationCleaner

2018-11-12 Thread Botong Huang (JIRA)
Botong Huang created YARN-9013: -- Summary: [GPG] fix order of steps cleaning Registry entries in ApplicationCleaner Key: YARN-9013 URL: https://issues.apache.org/jira/browse/YARN-9013 Project: Hadoop YARN

[jira] [Commented] (YARN-8991) nodemanager not cleaning blockmgr directories inside appcache

2018-11-12 Thread Hidayat Teonadi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16684192#comment-16684192 ] Hidayat Teonadi commented on YARN-8991: --- thanks, I filed SPARK-26020   > nodemanag

[jira] [Commented] (YARN-8986) publish all exposed ports to random ports when using bridge network

2018-11-12 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16684144#comment-16684144 ] Eric Yang commented on YARN-8986: - [~Charo Zhang] This task looks like a duplicate of YARN

[jira] [Updated] (YARN-8986) publish all exposed ports to random ports when using bridge network

2018-11-12 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8986: Issue Type: Sub-task (was: Improvement) Parent: YARN-8472 > publish all exposed ports to random por

[jira] [Updated] (YARN-6523) Newly retrieved security Tokens are sent as part of each heartbeat to each node from RM which is not desirable in large cluster

2018-11-12 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikandan R updated YARN-6523: --- Attachment: YARN-6523.006.patch > Newly retrieved security Tokens are sent as part of each heartbeat t

[jira] [Commented] (YARN-6523) Newly retrieved security Tokens are sent as part of each heartbeat to each node from RM which is not desirable in large cluster

2018-11-12 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16684104#comment-16684104 ] Manikandan R commented on YARN-6523: {quote}Does the registration request and response

[jira] [Commented] (YARN-9008) Extend YARN distributed shell with file localization feature

2018-11-12 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16684001#comment-16684001 ] Peter Bacsko commented on YARN-9008: All tests passed locally. > Extend YARN distribu

[jira] [Commented] (YARN-8877) [CSI] Extend service spec to allow setting resource attributes

2018-11-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16683986#comment-16683986 ] Hudson commented on YARN-8877: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #154

[jira] [Commented] (YARN-9008) Extend YARN distributed shell with file localization feature

2018-11-12 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16683964#comment-16683964 ] Peter Bacsko commented on YARN-9008: 1. ASF warnings - can be ignored 2. Checkstyle -

[jira] [Comment Edited] (YARN-8948) PlacementRule interface should be for all YarnSchedulers

2018-11-12 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16681647#comment-16681647 ] Bibin A Chundatt edited comment on YARN-8948 at 11/12/18 3:40 PM: --

[jira] [Commented] (YARN-8877) [CSI] Extend service spec to allow setting resource attributes

2018-11-12 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16683959#comment-16683959 ] Sunil Govindan commented on YARN-8877: -- Thanks [~cheersyang]. Committed to trunk. Th

[jira] [Comment Edited] (YARN-8948) PlacementRule interface should be for all YarnSchedulers

2018-11-12 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16681647#comment-16681647 ] Bibin A Chundatt edited comment on YARN-8948 at 11/12/18 3:39 PM: --

[jira] [Updated] (YARN-8877) [CSI] Extend service spec to allow setting resource attributes

2018-11-12 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-8877: - Summary: [CSI] Extend service spec to allow setting resource attributes (was: Extend service spec

[jira] [Commented] (YARN-8987) Usability improvements node-attributes CLI

2018-11-12 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16683955#comment-16683955 ] Bibin A Chundatt commented on YARN-8987: Thank you [~cheersyang] for review and co

[jira] [Commented] (YARN-8991) nodemanager not cleaning blockmgr directories inside appcache

2018-11-12 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16683946#comment-16683946 ] Thomas Graves commented on YARN-8991: - if its while its running then you should file t

[jira] [Updated] (YARN-8882) Add a shared device mapping manager for device plugin to use

2018-11-12 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8882: --- Attachment: YARN-8882-trunk.003.patch > Add a shared device mapping manager for device plugin to use >

[jira] [Updated] (YARN-8882) Add a shared device mapping manager for device plugin to use

2018-11-12 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8882: --- Attachment: YARN-8882-trunk.002.patch > Add a shared device mapping manager for device plugin to use >

[jira] [Commented] (YARN-9008) Extend YARN distributed shell with file localization feature

2018-11-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16683792#comment-16683792 ] Hadoop QA commented on YARN-9008: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-9001) [Submarine] Use AppAdminClient instead of ServiceClient to sumbit jobs

2018-11-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16683791#comment-16683791 ] Hadoop QA commented on YARN-9001: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (YARN-9008) Extend YARN distributed shell with file localization feature

2018-11-12 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9008: --- Attachment: YARN-9008-003.patch > Extend YARN distributed shell with file localization feature > -

[jira] [Commented] (YARN-9001) [Submarine] Use AppAdminClient instead of ServiceClient to sumbit jobs

2018-11-12 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16683661#comment-16683661 ] Zac Zhou commented on YARN-9001: The ut error seems is not related to the patch, resubmit

[jira] [Updated] (YARN-9001) [Submarine] Use AppAdminClient instead of ServiceClient to sumbit jobs

2018-11-12 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-9001: --- Attachment: YARN-9001.004.patch > [Submarine] Use AppAdminClient instead of ServiceClient to sumbit jobs > ---

[jira] [Assigned] (YARN-8964) UI2 should use clusters/{cluster name} for all ATSv2 REST APIs

2018-11-12 Thread Akhil PB (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akhil PB reassigned YARN-8964: -- Assignee: Akhil PB > UI2 should use clusters/{cluster name} for all ATSv2 REST APIs > -

[jira] [Commented] (YARN-8958) Schedulable entities leak in fair ordering policy when recovering containers between remove app attempt and remove app

2018-11-12 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16683566#comment-16683566 ] Weiwei Yang commented on YARN-8958: --- Hi [~Tao Yang] When invoke FairOrderingPolicy#cont

[jira] [Commented] (YARN-8987) Usability improvements node-attributes CLI

2018-11-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16683538#comment-16683538 ] Hudson commented on YARN-8987: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #154

[jira] [Assigned] (YARN-9012) NPE in scheduler UI when min-capacity is not configured

2018-11-12 Thread tianjuan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] tianjuan reassigned YARN-9012: -- Assignee: tianjuan > NPE in scheduler UI when min-capacity is not configured >

[jira] [Updated] (YARN-9012) NPE in scheduler UI when min-capacity is not configured

2018-11-12 Thread tianjuan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] tianjuan updated YARN-9012: --- Description: I encountered the following while reviewing and testing branch YARN-5881. The design document fr

[jira] [Created] (YARN-9012) NPE in scheduler UI when min-capacity is not configured

2018-11-12 Thread tianjuan (JIRA)
tianjuan created YARN-9012: -- Summary: NPE in scheduler UI when min-capacity is not configured Key: YARN-9012 URL: https://issues.apache.org/jira/browse/YARN-9012 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-9008) Extend YARN distributed shell with file localization feature

2018-11-12 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16683529#comment-16683529 ] Peter Bacsko commented on YARN-9008: Will soon upload patch v3 which includes some tes

[jira] [Created] (YARN-9011) Race condition during decommissioning

2018-11-12 Thread Peter Bacsko (JIRA)
Peter Bacsko created YARN-9011: -- Summary: Race condition during decommissioning Key: YARN-9011 URL: https://issues.apache.org/jira/browse/YARN-9011 Project: Hadoop YARN Issue Type: Bug Affec

[jira] [Assigned] (YARN-8987) Usability improvements node-attributes CLI

2018-11-12 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reassigned YARN-8987: - Assignee: Bibin A Chundatt > Usability improvements node-attributes CLI > ---

[jira] [Commented] (YARN-8987) Usability improvements node-attributes CLI

2018-11-12 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16683509#comment-16683509 ] Weiwei Yang commented on YARN-8987: --- Thanks [~bibinchundatt], the latest patch looks goo

[jira] [Updated] (YARN-8882) Add a shared device mapping manager for device plugin to use

2018-11-12 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8882: --- Attachment: YARN-8882-trunk.001.patch > Add a shared device mapping manager for device plugin to use >

[jira] [Updated] (YARN-8882) Add a shared device mapping manager for device plugin to use

2018-11-12 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8882: --- Attachment: (was: YARN-8882-trunk.001.patch) > Add a shared device mapping manager for device plug

[jira] [Updated] (YARN-8882) Add a shared device mapping manager for device plugin to use

2018-11-12 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8882: --- Attachment: YARN-8882-trunk.001.patch > Add a shared device mapping manager for device plugin to use >

[jira] [Updated] (YARN-8882) Add a shared device mapping manager for device plugin to use

2018-11-12 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8882: --- Attachment: YARN-8882-trunk.001.path > Add a shared device mapping manager for device plugin to use >

[jira] [Updated] (YARN-8882) Add a shared device mapping manager for device plugin to use

2018-11-12 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8882: --- Attachment: (was: YARN-8882-trunk.001.path) > Add a shared device mapping manager for device plugi

[jira] [Commented] (YARN-9008) Extend YARN distributed shell with file localization feature

2018-11-12 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16683476#comment-16683476 ] Peter Bacsko commented on YARN-9008: [~snemeth] [~bsteinbach] [~templedf] please revie

[jira] [Updated] (YARN-8986) publish all exposed ports to random ports when using bridge network

2018-11-12 Thread Charo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charo Zhang updated YARN-8986: -- Labels: Docker (was: ) > publish all exposed ports to random ports when using bridge network >

[jira] [Commented] (YARN-8303) YarnClient should contact TimelineReader for application/attempt/container report

2018-11-12 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16683440#comment-16683440 ] Rohith Sharma K S commented on YARN-8303: - [~abmodi] Could you update the patch ?

[jira] [Updated] (YARN-8986) publish all exposed ports to random ports when using bridge network

2018-11-12 Thread Charo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charo Zhang updated YARN-8986: -- Description: it's better to publish all exposed ports to random ports or support port mapping for bridg

  1   2   >