[jira] [Comment Edited] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

2018-11-13 Thread Xun Liu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16684794#comment-16684794 ] Xun Liu edited comment on YARN-8714 at 11/14/18 7:52 AM: - 1) Suppo

[jira] [Comment Edited] (YARN-8898) Fix FederationInterceptor#allocate to set application priority in allocateResponse

2018-11-13 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16686081#comment-16686081 ] Bibin A Chundatt edited comment on YARN-8898 at 11/14/18 7:16 AM: --

[jira] [Assigned] (YARN-8898) Fix FederationInterceptor#allocate to set application priority in allocateResponse

2018-11-13 Thread Bilwa S T (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bilwa S T reassigned YARN-8898: --- Assignee: (was: Bilwa S T) > Fix FederationInterceptor#allocate to set application priority in >

[jira] [Commented] (YARN-8972) [Router] Add support to prevent DoS attack over ApplicationSubmissionContext size

2018-11-13 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16686130#comment-16686130 ] Bibin A Chundatt commented on YARN-8972: Over all the patch looks good to me . On

[jira] [Updated] (YARN-8953) Add CSI driver adaptor module

2018-11-13 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8953: -- Attachment: YARN-8953.004.patch > Add CSI driver adaptor module > - > >

[jira] [Updated] (YARN-9016) DocumentStore as a backend for ATSv2

2018-11-13 Thread Sushil Ks (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sushil Ks updated YARN-9016: Attachment: (was: YARN-9016.001.patch) > DocumentStore as a backend for ATSv2 >

[jira] [Updated] (YARN-9016) DocumentStore as a backend for ATSv2

2018-11-13 Thread Sushil Ks (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sushil Ks updated YARN-9016: Attachment: (was: YARN-9016.001.patch) > DocumentStore as a backend for ATSv2 >

[jira] [Updated] (YARN-9016) DocumentStore as a backend for ATSv2

2018-11-13 Thread Sushil Ks (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sushil Ks updated YARN-9016: Attachment: YARN-9016.001.patch > DocumentStore as a backend for ATSv2 > ---

[jira] [Commented] (YARN-8937) TestLeaderElectorService hangs

2018-11-13 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16686098#comment-16686098 ] Akira Ajisaka commented on YARN-8937: - We asked ZooKeeper and Curator communities and

[jira] [Commented] (YARN-9001) [Submarine] Use AppAdminClient instead of ServiceClient to sumbit jobs

2018-11-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16686089#comment-16686089 ] Hadoop QA commented on YARN-9001: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote

[jira] [Assigned] (YARN-9017) PlacementRule order is not maintained in CS

2018-11-13 Thread Bilwa S T (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bilwa S T reassigned YARN-9017: --- Assignee: Bilwa S T > PlacementRule order is not maintained in CS > -

[jira] [Commented] (YARN-8898) Fix FederationInterceptor#allocate to set application priority in allocateResponse

2018-11-13 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16686081#comment-16686081 ] Bibin A Chundatt commented on YARN-8898: [~subru] are you suggesting add the _Appl

[jira] [Commented] (YARN-9001) [Submarine] Use AppAdminClient instead of ServiceClient to sumbit jobs

2018-11-13 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16686076#comment-16686076 ] Zac Zhou commented on YARN-9001: Thanks, [~leftnoteasy] I checked the code and found ther

[jira] [Updated] (YARN-9001) [Submarine] Use AppAdminClient instead of ServiceClient to sumbit jobs

2018-11-13 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-9001: --- Attachment: YARN-9001-branch-3.2.001.patch > [Submarine] Use AppAdminClient instead of ServiceClient to sumbit

[jira] [Updated] (YARN-9016) DocumentStore as a backend for ATSv2

2018-11-13 Thread Sushil Ks (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sushil Ks updated YARN-9016: Description: h1. Document Store for ATSv2                The Document Store for ATSv2 is a framework for pl

[jira] [Commented] (YARN-8299) Yarn Service Upgrade: Add GET APIs that returns instances matching query params

2018-11-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16686017#comment-16686017 ] Hadoop QA commented on YARN-8299: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (YARN-8898) Fix FederationInterceptor#allocate to set application priority in allocateResponse

2018-11-13 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16686009#comment-16686009 ] Subru Krishnan commented on YARN-8898: -- Thanks [~bibinchundatt] for the detailed clar

[jira] [Commented] (YARN-8881) Phase 1 - Add basic pluggable device plugin framework

2018-11-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685965#comment-16685965 ] Hadoop QA commented on YARN-8881: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-9018) Add functionality to AuxiliaryLocalPathHandler to return all locations to read for a given path

2018-11-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685925#comment-16685925 ] Hadoop QA commented on YARN-9018: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (YARN-8299) Yarn Service Upgrade: Add GET APIs that returns instances matching query params

2018-11-13 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-8299: Attachment: YARN-8299-branch-3.1.001.patch > Yarn Service Upgrade: Add GET APIs that returns instanc

[jira] [Updated] (YARN-8881) Phase 1 - Add basic pluggable device plugin framework

2018-11-13 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8881: --- Attachment: YARN-8881-trunk.009.patch > Phase 1 - Add basic pluggable device plugin framework > --

[jira] [Reopened] (YARN-8299) Yarn Service Upgrade: Add GET APIs that returns instances matching query params

2018-11-13 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh reopened YARN-8299: - reopening to backport the patch to branch 3.1 > Yarn Service Upgrade: Add GET APIs that returns insta

[jira] [Commented] (YARN-9016) DocumentStore as a backend for ATSv2

2018-11-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685913#comment-16685913 ] Hadoop QA commented on YARN-9016: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-8898) Fix FederationInterceptor#allocate to set application priority in allocateResponse

2018-11-13 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685911#comment-16685911 ] Botong Huang commented on YARN-8898: +[~giovanni.fumarola] as well > Fix FederationIn

[jira] [Commented] (YARN-8881) Phase 1 - Add basic pluggable device plugin framework

2018-11-13 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685868#comment-16685868 ] Zhankun Tang commented on YARN-8881: [~leftnoteasy], [~sunilg] . Ok. Will change the t

[jira] [Commented] (YARN-8918) [Submarine] Correct method usage of str.subString in CliUtils

2018-11-13 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685866#comment-16685866 ] Zhankun Tang commented on YARN-8918: Thanks a lot! [~leftnoteasy] > [Submarine] Corre

[jira] [Commented] (YARN-9019) Ratio calculation of ResourceCalculator implementations could return NaN

2018-11-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685837#comment-16685837 ] Hadoop QA commented on YARN-9019: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-8672) TestContainerManager#testLocalingResourceWhileContainerRunning occasionally times out

2018-11-13 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685832#comment-16685832 ] Chandni Singh commented on YARN-8672: - The failures are not related to this change. >

[jira] [Commented] (YARN-8672) TestContainerManager#testLocalingResourceWhileContainerRunning occasionally times out

2018-11-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685821#comment-16685821 ] Hadoop QA commented on YARN-8672: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-9018) Add functionality to AuxiliaryLocalPathHandler to return all locations to read for a given path

2018-11-13 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated YARN-9018: -- Attachment: YARN-9018.001.patch > Add functionality to AuxiliaryLocalPathHandler to return all locations

[jira] [Assigned] (YARN-9018) Add functionality to AuxiliaryLocalPathHandler to return all locations to read for a given path

2018-11-13 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla reassigned YARN-9018: - Assignee: Kuhu Shukla > Add functionality to AuxiliaryLocalPathHandler to return all locations to

[jira] [Commented] (YARN-9001) [Submarine] Use AppAdminClient instead of ServiceClient to sumbit jobs

2018-11-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685760#comment-16685760 ] Hudson commented on YARN-9001: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #154

[jira] [Updated] (YARN-9019) Ratio calculation of ResourceCalculator implementations could return NaN

2018-11-13 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9019: - Summary: Ratio calculation of ResourceCalculator implementations could return NaN (was: Ratio cal

[jira] [Commented] (YARN-9001) [Submarine] Use AppAdminClient instead of ServiceClient to sumbit jobs

2018-11-13 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685750#comment-16685750 ] Wangda Tan commented on YARN-9001: -- Pushed to trunk, but backport to branch-3.2 failed, [

[jira] [Updated] (YARN-9019) Ratio calculation of ResourceCaculator implementations could return NaN

2018-11-13 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9019: - Attachment: YARN-9019.001.patch > Ratio calculation of ResourceCaculator implementations could ret

[jira] [Updated] (YARN-9001) [Submarine] Use AppAdminClient instead of ServiceClient to sumbit jobs

2018-11-13 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-9001: - Fix Version/s: 3.3.0 > [Submarine] Use AppAdminClient instead of ServiceClient to sumbit jobs > --

[jira] [Updated] (YARN-9019) Ratio calculation of ResourceCaculator implementations could return NaN

2018-11-13 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9019: - Summary: Ratio calculation of ResourceCaculator implementations could return NaN (was: Ratio of R

[jira] [Commented] (YARN-8672) TestContainerManager#testLocalingResourceWhileContainerRunning occasionally times out

2018-11-13 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685743#comment-16685743 ] Chandni Singh commented on YARN-8672: - Fixed the test case in patch 8. Checkstyle is c

[jira] [Updated] (YARN-9019) Ratio of ResourceCaculator implementations could return NaN

2018-11-13 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9019: - Description: Found out that ResourceCalculator.ratio (with implementors DefaultResourceCalculator

[jira] [Updated] (YARN-9019) Ratio of ResourceCaculator implementations could return NaN

2018-11-13 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9019: - Description: Found out that ResourceCalculator.ratio (with implementors DefaultResourceCalculator

[jira] [Created] (YARN-9019) Ratio of ResourceCaculator implementations could return NaN

2018-11-13 Thread Szilard Nemeth (JIRA)
Szilard Nemeth created YARN-9019: Summary: Ratio of ResourceCaculator implementations could return NaN Key: YARN-9019 URL: https://issues.apache.org/jira/browse/YARN-9019 Project: Hadoop YARN

[jira] [Updated] (YARN-8672) TestContainerManager#testLocalingResourceWhileContainerRunning occasionally times out

2018-11-13 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-8672: Attachment: YARN-8672.008.patch > TestContainerManager#testLocalingResourceWhileContainerRunning occ

[jira] [Commented] (YARN-9001) [Submarine] Use AppAdminClient instead of ServiceClient to sumbit jobs

2018-11-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685733#comment-16685733 ] Hadoop QA commented on YARN-9001: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (YARN-5168) Add port mapping handling when docker container use bridge network

2018-11-13 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685724#comment-16685724 ] Shane Kumpf commented on YARN-5168: --- Great, thanks for validating, that is inline. +1 fr

[jira] [Comment Edited] (YARN-5168) Add port mapping handling when docker container use bridge network

2018-11-13 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685611#comment-16685611 ] Eric Yang edited comment on YARN-5168 at 11/13/18 8:39 PM: --- The

[jira] [Comment Edited] (YARN-5168) Add port mapping handling when docker container use bridge network

2018-11-13 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685611#comment-16685611 ] Eric Yang edited comment on YARN-5168 at 11/13/18 8:33 PM: --- The

[jira] [Commented] (YARN-5168) Add port mapping handling when docker container use bridge network

2018-11-13 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685712#comment-16685712 ] Eric Yang commented on YARN-5168: - [~shaneku...@gmail.com] {quote}I believe supporting -P

[jira] [Commented] (YARN-8898) Fix FederationInterceptor#allocate to set application priority in allocateResponse

2018-11-13 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685683#comment-16685683 ] Bibin A Chundatt commented on YARN-8898: {quote} In FederationStateStore there's

[jira] [Comment Edited] (YARN-8960) [Submarine] Can't get submarine service status using the command of "yarn app -status" under security environment

2018-11-13 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685618#comment-16685618 ] Wangda Tan edited comment on YARN-8960 at 11/13/18 7:50 PM: Th

[jira] [Commented] (YARN-8918) [Submarine] Correct method usage of str.subString in CliUtils

2018-11-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685668#comment-16685668 ] Hudson commented on YARN-8918: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #154

[jira] [Commented] (YARN-8953) Add CSI driver adaptor module

2018-11-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685667#comment-16685667 ] Hadoop QA commented on YARN-8953: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Comment Edited] (YARN-5168) Add port mapping handling when docker container use bridge network

2018-11-13 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685660#comment-16685660 ] Shane Kumpf edited comment on YARN-5168 at 11/13/18 7:46 PM: -

[jira] [Commented] (YARN-5168) Add port mapping handling when docker container use bridge network

2018-11-13 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685660#comment-16685660 ] Shane Kumpf commented on YARN-5168: --- I believe supporting -P will lead to port conflicts

[jira] [Comment Edited] (YARN-5168) Add port mapping handling when docker container use bridge network

2018-11-13 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685611#comment-16685611 ] Eric Yang edited comment on YARN-5168 at 11/13/18 7:33 PM: --- The

[jira] [Commented] (YARN-8898) Fix FederationInterceptor#allocate to set application priority in allocateResponse

2018-11-13 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685637#comment-16685637 ] Botong Huang commented on YARN-8898: For the record, I was leaning towards Solution 2

[jira] [Commented] (YARN-9001) [Submarine] Use AppAdminClient instead of ServiceClient to sumbit jobs

2018-11-13 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685635#comment-16685635 ] Wangda Tan commented on YARN-9001: -- Rebased to latest trunk to run Jenkins. > [Submarine

[jira] [Updated] (YARN-9001) [Submarine] Use AppAdminClient instead of ServiceClient to sumbit jobs

2018-11-13 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-9001: - Attachment: YARN-9001.005.patch > [Submarine] Use AppAdminClient instead of ServiceClient to sumbit jobs >

[jira] [Commented] (YARN-9001) [Submarine] Use AppAdminClient instead of ServiceClient to sumbit jobs

2018-11-13 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685631#comment-16685631 ] Wangda Tan commented on YARN-9001: -- Thanks [~yuan_zac], +1, committing the patch. > [Su

[jira] [Created] (YARN-9018) Add functionality to AuxiliaryLocalPathHandler to return all locations to read for a given path

2018-11-13 Thread Kuhu Shukla (JIRA)
Kuhu Shukla created YARN-9018: - Summary: Add functionality to AuxiliaryLocalPathHandler to return all locations to read for a given path Key: YARN-9018 URL: https://issues.apache.org/jira/browse/YARN-9018

[jira] [Commented] (YARN-8898) Fix FederationInterceptor#allocate to set application priority in allocateResponse

2018-11-13 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685619#comment-16685619 ] Bibin A Chundatt commented on YARN-8898: Thank you [~subru] for providing your vie

[jira] [Commented] (YARN-5168) Add port mapping handling when docker container use bridge network

2018-11-13 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685611#comment-16685611 ] Eric Yang commented on YARN-5168: - The current plan is to expose this information through

[jira] [Commented] (YARN-8960) [Submarine] Can't get submarine service status using the command of "yarn app -status" under security environment

2018-11-13 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685618#comment-16685618 ] Wangda Tan commented on YARN-8960: -- Thanks [~yuan_zac], Some comments: 1) doLoginIfSec

[jira] [Commented] (YARN-8672) TestContainerManager#testLocalingResourceWhileContainerRunning occasionally times out

2018-11-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685608#comment-16685608 ] Hadoop QA commented on YARN-8672: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-9016) DocumentStore as a backend for ATSv2

2018-11-13 Thread Sushil Ks (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sushil Ks updated YARN-9016: Description: h1. Document Store for ATSv2                The Document Store for ATSv2 is a framework for pl

[jira] [Updated] (YARN-8960) [Submarine] Can't get submarine service status using the command of "yarn app -status" under security environment

2018-11-13 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8960: - Description: After submitting a submarine job, we tried to get service status using the following command

[jira] [Commented] (YARN-8881) Phase 1 - Add basic pluggable device plugin framework

2018-11-13 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685605#comment-16685605 ] Wangda Tan commented on YARN-8881: -- Thanks [~tangzhankun], Regarding Integer vs. int, I

[jira] [Commented] (YARN-8972) [Router] Add support to prevent DoS attack over ApplicationSubmissionContext size

2018-11-13 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685600#comment-16685600 ] Giovanni Matteo Fumarola commented on YARN-8972: [~bibinchundatt]  can you

[jira] [Updated] (YARN-9016) DocumentStore as a backend for ATSv2

2018-11-13 Thread Sushil Ks (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sushil Ks updated YARN-9016: Description: h1. Document Store for ATSv2                The Document Store for ATSv2 is a framework for pl

[jira] [Commented] (YARN-9003) Support multi-homed network for docker container

2018-11-13 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685594#comment-16685594 ] Eric Yang commented on YARN-9003: - Docker can only work with one bridge network + one over

[jira] [Updated] (YARN-9016) DocumentStore as a backend for ATSv2

2018-11-13 Thread Sushil Ks (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sushil Ks updated YARN-9016: Attachment: (was: YARN-9016.patch) > DocumentStore as a backend for ATSv2 >

[jira] [Commented] (YARN-8672) TestContainerManager#testLocalingResourceWhileContainerRunning occasionally times out

2018-11-13 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685537#comment-16685537 ] Eric Yang commented on YARN-8672: - [~csingh] Thanks for the explanation. It makes sense f

[jira] [Commented] (YARN-8672) TestContainerManager#testLocalingResourceWhileContainerRunning occasionally times out

2018-11-13 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685526#comment-16685526 ] Chandni Singh commented on YARN-8672: - Thanks [~eyang] for reviewing. {{TOKEN_FILE_NAM

[jira] [Commented] (YARN-8672) TestContainerManager#testLocalingResourceWhileContainerRunning occasionally times out

2018-11-13 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685528#comment-16685528 ] Chandni Singh commented on YARN-8672: - Added patch 7 after rebasing to trunk. > TestC

[jira] [Updated] (YARN-8672) TestContainerManager#testLocalingResourceWhileContainerRunning occasionally times out

2018-11-13 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-8672: Attachment: YARN-8672.007.patch > TestContainerManager#testLocalingResourceWhileContainerRunning occ

[jira] [Commented] (YARN-5168) Add port mapping handling when docker container use bridge network

2018-11-13 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685525#comment-16685525 ] Eric Yang commented on YARN-5168: - [~liuxun323] The actual coding doesn't take long. Hado

[jira] [Commented] (YARN-8672) TestContainerManager#testLocalingResourceWhileContainerRunning occasionally times out

2018-11-13 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685502#comment-16685502 ] Eric Yang commented on YARN-8672: - [~csingh] Thank you for the patch. Patch 006 looks lik

[jira] [Updated] (YARN-8953) Add CSI driver adaptor module

2018-11-13 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8953: -- Attachment: YARN-8953.003.patch > Add CSI driver adaptor module > - > >

[jira] [Commented] (YARN-8953) Add CSI driver adaptor module

2018-11-13 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685448#comment-16685448 ] Weiwei Yang commented on YARN-8953: --- During the testing, I found it is not a wise decisi

[jira] [Commented] (YARN-8303) YarnClient should contact TimelineReader for application/attempt/container report

2018-11-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685430#comment-16685430 ] Hadoop QA commented on YARN-8303: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote

[jira] [Created] (YARN-9017) PlacementRule order is not maintained in CS

2018-11-13 Thread Bibin A Chundatt (JIRA)
Bibin A Chundatt created YARN-9017: -- Summary: PlacementRule order is not maintained in CS Key: YARN-9017 URL: https://issues.apache.org/jira/browse/YARN-9017 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-8948) PlacementRule interface should be for all YarnSchedulers

2018-11-13 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-8948: --- Description: *Issue 1:* YARN-3635 intention was to add PlacementRule interface common for all

[jira] [Updated] (YARN-9016) DocumentStore as a backend for ATSv2

2018-11-13 Thread Sushil Ks (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sushil Ks updated YARN-9016: Description: h1. Document Store for ATSv2                The Document Store for ATSv2 is a framework for pl

[jira] [Created] (YARN-9016) DocumentStore as a backend for ATSv2

2018-11-13 Thread Sushil Ks (JIRA)
Sushil Ks created YARN-9016: --- Summary: DocumentStore as a backend for ATSv2 Key: YARN-9016 URL: https://issues.apache.org/jira/browse/YARN-9016 Project: Hadoop YARN Issue Type: New Feature

[jira] [Comment Edited] (YARN-8881) Phase 1 - Add basic pluggable device plugin framework

2018-11-13 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685355#comment-16685355 ] Zhankun Tang edited comment on YARN-8881 at 11/13/18 3:20 PM: --

[jira] [Commented] (YARN-8881) Phase 1 - Add basic pluggable device plugin framework

2018-11-13 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685355#comment-16685355 ] Zhankun Tang commented on YARN-8881: [~sunilg], Many thanks for the review! {quote}In 

[jira] [Commented] (YARN-6523) Newly retrieved security Tokens are sent as part of each heartbeat to each node from RM which is not desirable in large cluster

2018-11-13 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685353#comment-16685353 ] Jason Lowe commented on YARN-6523: -- Thanks for updating the patch! The unit test failure

[jira] [Commented] (YARN-9008) Extend YARN distributed shell with file localization feature

2018-11-13 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685276#comment-16685276 ] Peter Bacsko commented on YARN-9008: Thanks for the comments [~snemeth], most of the n

[jira] [Comment Edited] (YARN-9008) Extend YARN distributed shell with file localization feature

2018-11-13 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685266#comment-16685266 ] Szilard Nemeth edited comment on YARN-9008 at 11/13/18 2:15 PM:

[jira] [Commented] (YARN-9008) Extend YARN distributed shell with file localization feature

2018-11-13 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685266#comment-16685266 ] Szilard Nemeth commented on YARN-9008: -- Thanks [~pbacsko] for uploading this patch!

[jira] [Commented] (YARN-8881) Phase 1 - Add basic pluggable device plugin framework

2018-11-13 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685247#comment-16685247 ] Sunil Govindan commented on YARN-8881: -- Thanks [~tangzhankun] Few comments # In Dev

[jira] [Updated] (YARN-8303) YarnClient should contact TimelineReader for application/attempt/container report

2018-11-13 Thread Abhishek Modi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Modi updated YARN-8303: Attachment: YARN-8303.003.patch > YarnClient should contact TimelineReader for application/attempt/c

[jira] [Commented] (YARN-8960) [Submarine] Can't get submarine service status using the command of "yarn app -status" under security environment

2018-11-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685169#comment-16685169 ] Hadoop QA commented on YARN-8960: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (YARN-8960) [Submarine] Can't get submarine service status using the command of "yarn app -status" under security environment

2018-11-13 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-8960: --- Attachment: YARN-8960.004.patch > [Submarine] Can't get submarine service status using the command of "yarn ap

[jira] [Updated] (YARN-7810) TestDockerContainerRuntime test failures due to UID lookup of a non-existent user

2018-11-13 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated YARN-7810: Fix Version/s: (was: 2.9.1) 2.9.2 > TestDockerContainerRuntime test failures

[jira] [Updated] (YARN-9015) Phase 1 - Add an interface for device plugin to provide customized scheduler

2018-11-13 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-9015: --- Summary: Phase 1 - Add an interface for device plugin to provide customized scheduler (was: Add an in

[jira] [Updated] (YARN-8883) Phase 1 - Provide an example of fake vendor plugin

2018-11-13 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8883: --- Summary: Phase 1 - Provide an example of fake vendor plugin (was: Provide an example of fake vendor p

[jira] [Updated] (YARN-8885) Phase 1 - Support NM APIs to query device resource allocation

2018-11-13 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8885: --- Summary: Phase 1 - Support NM APIs to query device resource allocation (was: Support NM APIs to query

[jira] [Updated] (YARN-8881) Phase 1 - Add basic pluggable device plugin framework

2018-11-13 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8881: --- Summary: Phase 1 - Add basic pluggable device plugin framework (was: Add basic pluggable device plugi

[jira] [Updated] (YARN-8882) Phase 1 - Add a shared device mapping manager for device plugin to use

2018-11-13 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8882: --- Summary: Phase 1 - Add a shared device mapping manager for device plugin to use (was: Add a shared de

[jira] [Updated] (YARN-8880) Phase 1 - Add configurations for pluggable plugin framework

2018-11-13 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8880: --- Summary: Phase 1 - Add configurations for pluggable plugin framework (was: Phase1 - Add configuration

  1   2   >