[jira] [Commented] (YARN-8833) Avoid potential integer overflow when computing fair shares

2019-01-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736842#comment-16736842 ] Hadoop QA commented on YARN-8833: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9037) [CSI] Ignore volume resource in resource calculators based on tags

2019-01-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736819#comment-16736819 ] Hudson commented on YARN-9037: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15743 (See

[jira] [Commented] (YARN-9037) [CSI] Ignore volume resource in resource calculators based on tags

2019-01-07 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736808#comment-16736808 ] Weiwei Yang commented on YARN-9037: --- I have committed this to trunk, thanks [~sunilg]. > [CSI] Ignore

[jira] [Commented] (YARN-6695) Race condition in RM for publishing container events vs appFinished events causes NPE

2019-01-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736803#comment-16736803 ] Wangda Tan commented on YARN-6695: -- Thanks [~eyang]/[~rohithsharma], I'm going to update target version

[jira] [Updated] (YARN-6695) Race condition in RM for publishing container events vs appFinished events causes NPE

2019-01-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-6695: - Target Version/s: 3.2.1, 3.1.3 (was: 3.2.0, 3.1.2) > Race condition in RM for publishing container

[jira] [Commented] (YARN-9037) [CSI] Ignore volume resource in resource calculators based on tags

2019-01-07 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736792#comment-16736792 ] Weiwei Yang commented on YARN-9037: --- Thanks [~sunilg], I will commit this shortly today. > [CSI] Ignore

[jira] [Updated] (YARN-9173) FairShare calculation broken for large values after YARN-8833

2019-01-07 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-9173: -- Fix Version/s: 3.0.4 > FairShare calculation broken for large values after YARN-8833 >

[jira] [Commented] (YARN-9173) FairShare calculation broken for large values after YARN-8833

2019-01-07 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736780#comment-16736780 ] Wilfred Spiegelenburg commented on YARN-9173: - Sorry for the typo in the patch name, I did not

[jira] [Commented] (YARN-9037) [CSI] Ignore volume resource in resource calculators based on tags

2019-01-07 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736781#comment-16736781 ] Sunil Govindan commented on YARN-9037: -- Yes. [~cheersyang].  Let's get this in. Please commit this

[jira] [Updated] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-01-07 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-9161: --- Attachment: YARN-9161.002.patch > Absolute resources of capacity scheduler doesn't support GPU and FPGA >

[jira] [Updated] (YARN-8833) Avoid potential integer overflow when computing fair shares

2019-01-07 Thread liyakun (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyakun updated YARN-8833: -- Attachment: (was: YARN-8833-branch-2.002.patch) > Avoid potential integer overflow when computing fair

[jira] [Updated] (YARN-8833) Avoid potential integer overflow when computing fair shares

2019-01-07 Thread liyakun (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyakun updated YARN-8833: -- Attachment: (was: YARN-8833-02-branch-2.patch) > Avoid potential integer overflow when computing fair

[jira] [Updated] (YARN-9173) FairShare calculation broken for large values after YARN-8833

2019-01-07 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-9173: -- Fix Version/s: 3.1.3 > FairShare calculation broken for large values after YARN-8833 >

[jira] [Updated] (YARN-8833) Avoid potential integer overflow when computing fair shares

2019-01-07 Thread liyakun (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyakun updated YARN-8833: -- Attachment: (was: YARN-YARN-8833-branch-2.003.patch) > Avoid potential integer overflow when computing fair

[jira] [Commented] (YARN-9173) FairShare calculation broken for large values after YARN-8833

2019-01-07 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736762#comment-16736762 ] Weiwei Yang commented on YARN-9173: --- +1, committing to branch-3.1 and lower versions shortly. >

[jira] [Commented] (YARN-8833) Avoid potential integer overflow when computing fair shares

2019-01-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736758#comment-16736758 ] Hadoop QA commented on YARN-8833: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9173) FairShare calculation broken for large values after YARN-8833

2019-01-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736748#comment-16736748 ] Hadoop QA commented on YARN-9173: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9146) REST API to trigger storing auxiliary manifest file and publish to NMs

2019-01-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736741#comment-16736741 ] Hadoop QA commented on YARN-9146: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6695) Race condition in RM for publishing container events vs appFinished events causes NPE

2019-01-07 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736729#comment-16736729 ] Eric Yang commented on YARN-6695: - [~rohithsharma] I copied the configuration from Ambari deployed

[jira] [Commented] (YARN-8833) Avoid potential integer overflow when computing fair shares

2019-01-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736718#comment-16736718 ] Hadoop QA commented on YARN-8833: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6695) Race condition in RM for publishing container events vs appFinished events causes NPE

2019-01-07 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736704#comment-16736704 ] Rohith Sharma K S commented on YARN-6695: - [~eyang] Publishing container events from RM is

[jira] [Commented] (YARN-8927) Support trust top-level image like "centos" when "library" is configured in "docker.trusted.registries"

2019-01-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736696#comment-16736696 ] Hadoop QA commented on YARN-8927: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8833) Avoid potential integer overflow when computing fair shares

2019-01-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736695#comment-16736695 ] Hadoop QA commented on YARN-8833: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (YARN-9146) REST API to trigger storing auxiliary manifest file and publish to NMs

2019-01-07 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi reassigned YARN-9146: Assignee: Billie Rinaldi > REST API to trigger storing auxiliary manifest file and publish

[jira] [Commented] (YARN-8833) Avoid potential integer overflow when computing fair shares

2019-01-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736688#comment-16736688 ] Hadoop QA commented on YARN-8833: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-9146) REST API to trigger storing auxiliary manifest file and publish to NMs

2019-01-07 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi updated YARN-9146: - Attachment: YARN-9146.01.patch > REST API to trigger storing auxiliary manifest file and publish

[jira] [Updated] (YARN-9173) FairShare calculation broken for large values after YARN-8833

2019-01-07 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-9173: -- Attachment: YARN-9137-branch-3.1.001.patch > FairShare calculation broken for large values after

[jira] [Assigned] (YARN-9183) TestAMRMTokens fails

2019-01-07 Thread Abhishek Modi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Modi reassigned YARN-9183: --- Assignee: Abhishek Modi > TestAMRMTokens fails > > >

[jira] [Commented] (YARN-9173) FairShare calculation broken for large values after YARN-8833

2019-01-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736668#comment-16736668 ] Hadoop QA commented on YARN-9173: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-9184) Docker run doesn't pull down latest image if the image exists locally

2019-01-07 Thread Zhaohui Xin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaohui Xin updated YARN-9184: -- Description: see [docker run doesn't pull down latest image if the image exists locally 

[jira] [Updated] (YARN-9184) Docker run doesn't pull down latest image if the image exists locally

2019-01-07 Thread Zhaohui Xin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaohui Xin updated YARN-9184: -- Description: See [docker run doesn't pull down latest image if the image exists

[jira] [Updated] (YARN-9184) Docker run doesn't pull down latest image if the image exists locally

2019-01-07 Thread Zhaohui Xin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaohui Xin updated YARN-9184: -- Description: See [docker run doesn't pull down latest image if the image exists

[jira] [Updated] (YARN-9184) Docker run doesn't pull down latest image if the image exists locally

2019-01-07 Thread Zhaohui Xin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaohui Xin updated YARN-9184: -- Description: See [docker run doesn't pull down latest image if the image exists

[jira] [Updated] (YARN-9184) Docker run doesn't pull down latest image if the image exists locally

2019-01-07 Thread Zhaohui Xin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaohui Xin updated YARN-9184: -- Description: see [docker run doesn't pull down latest image if the image exists locally 

[jira] [Updated] (YARN-9184) Docker run doesn't pull down latest image if the image exists locally

2019-01-07 Thread Zhaohui Xin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaohui Xin updated YARN-9184: -- Description: see [docker run doesn't pull down latest image if the image exists locally 

[jira] [Updated] (YARN-9184) Docker run doesn't pull down latest image if the image exists locally

2019-01-07 Thread Zhaohui Xin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaohui Xin updated YARN-9184: -- Description: see [docker run doesn't pull down latest image if the image exists locally 

[jira] [Created] (YARN-9184) Docker run doesn't pull down latest image if the image exists locally

2019-01-07 Thread Zhaohui Xin (JIRA)
Zhaohui Xin created YARN-9184: - Summary: Docker run doesn't pull down latest image if the image exists locally Key: YARN-9184 URL: https://issues.apache.org/jira/browse/YARN-9184 Project: Hadoop YARN

[jira] [Updated] (YARN-8927) Support trust top-level image like "centos" when "library" is configured in "docker.trusted.registries"

2019-01-07 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8927: --- Attachment: YARN-8927-trunk.002.patch > Support trust top-level image like "centos" when "library" is

[jira] [Commented] (YARN-8927) Support trust top-level image like "centos" when "library" is configured in "docker.trusted.registries"

2019-01-07 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736650#comment-16736650 ] Zhankun Tang commented on YARN-8927: [~eyang] , Thanks for the review! Yeah, it doesn't consider the

[jira] [Commented] (YARN-9179) TestAMRMClient crashes

2019-01-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736649#comment-16736649 ] Hadoop QA commented on YARN-9179: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9183) TestAMRMTokens fails

2019-01-07 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736573#comment-16736573 ] Akira Ajisaka commented on YARN-9183: - Using binary search, found that this test was broken by

[jira] [Commented] (YARN-8822) Nvidia-docker v2 support for YARN GPU feature

2019-01-07 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736567#comment-16736567 ] Sunil Govindan commented on YARN-8822: -- Test case failure is unrelated. Committing to branch-3.2.0

[jira] [Commented] (YARN-9116) Capacity Scheduler: add the default maximum-allocation-mb and maximum-allocation-vcores for the queues

2019-01-07 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736552#comment-16736552 ] Weiwei Yang commented on YARN-9116: --- Hi [~aihuaxu] {quote}we are still introducing the incompatibility

[jira] [Commented] (YARN-8822) Nvidia-docker v2 support for YARN GPU feature

2019-01-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736546#comment-16736546 ] Hadoop QA commented on YARN-8822: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6695) Race condition in RM for publishing container events vs appFinished events causes NPE

2019-01-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736545#comment-16736545 ] Hadoop QA commented on YARN-6695: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9182) Backport YARN-6445 resource profile performance improvements to branch-2

2019-01-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736517#comment-16736517 ] Hadoop QA commented on YARN-9182: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9183) TestAMRMTokens fails

2019-01-07 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736509#comment-16736509 ] Akira Ajisaka commented on YARN-9183: - Stacktrace {noformat} [ERROR] Tests run: 6, Failures: 0,

[jira] [Created] (YARN-9183) TestAMRMTokens fails

2019-01-07 Thread Akira Ajisaka (JIRA)
Akira Ajisaka created YARN-9183: --- Summary: TestAMRMTokens fails Key: YARN-9183 URL: https://issues.apache.org/jira/browse/YARN-9183 Project: Hadoop YARN Issue Type: Bug Reporter:

[jira] [Created] (YARN-9182) Backport YARN-6445 resource profile performance improvements to branch-2

2019-01-07 Thread Jonathan Hung (JIRA)
Jonathan Hung created YARN-9182: --- Summary: Backport YARN-6445 resource profile performance improvements to branch-2 Key: YARN-9182 URL: https://issues.apache.org/jira/browse/YARN-9182 Project: Hadoop

[jira] [Commented] (YARN-9179) TestAMRMClient crashes

2019-01-07 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736504#comment-16736504 ] Akira Ajisaka commented on YARN-9179: - TestAMRMTokens is failing on trunk, so the patch is unrelated.

[jira] [Updated] (YARN-9179) TestAMRMClient crashes

2019-01-07 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated YARN-9179: Attachment: YARN-9179.02.patch > TestAMRMClient crashes > -- > >

[jira] [Comment Edited] (YARN-9182) Backport YARN-6445 resource profile performance improvements to branch-2

2019-01-07 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736501#comment-16736501 ] Jonathan Hung edited comment on YARN-9182 at 1/7/19 11:59 PM: -- Attached 001

[jira] [Comment Edited] (YARN-9182) Backport YARN-6445 resource profile performance improvements to branch-2

2019-01-07 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736501#comment-16736501 ] Jonathan Hung edited comment on YARN-9182 at 1/7/19 11:59 PM: -- Attached 001

[jira] [Comment Edited] (YARN-9182) Backport YARN-6445 resource profile performance improvements to branch-2

2019-01-07 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736501#comment-16736501 ] Jonathan Hung edited comment on YARN-9182 at 1/7/19 11:56 PM: -- Attached 001

[jira] [Commented] (YARN-9182) Backport YARN-6445 resource profile performance improvements to branch-2

2019-01-07 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736501#comment-16736501 ] Jonathan Hung commented on YARN-9182: - Attached 001 patch. The backport is clean, except for

[jira] [Assigned] (YARN-9182) Backport YARN-6445 resource profile performance improvements to branch-2

2019-01-07 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung reassigned YARN-9182: --- Assignee: Jonathan Hung > Backport YARN-6445 resource profile performance improvements to

[jira] [Updated] (YARN-9182) Backport YARN-6445 resource profile performance improvements to branch-2

2019-01-07 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-9182: Attachment: YARN-9182-YARN-8200.001.patch > Backport YARN-6445 resource profile performance

[jira] [Comment Edited] (YARN-9181) Backport YARN-6232 for generic resource type usage to branch-2

2019-01-07 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736494#comment-16736494 ] Jonathan Hung edited comment on YARN-9181 at 1/7/19 11:51 PM: -- Note, the

[jira] [Comment Edited] (YARN-9181) Backport YARN-6232 for generic resource type usage to branch-2

2019-01-07 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736494#comment-16736494 ] Jonathan Hung edited comment on YARN-9181 at 1/7/19 11:50 PM: -- Note, the

[jira] [Commented] (YARN-9181) Backport YARN-6232 for generic resource type usage to branch-2

2019-01-07 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736494#comment-16736494 ] Jonathan Hung commented on YARN-9181: - Note, the compilation errors are expected. (It will be fixed by

[jira] [Commented] (YARN-9181) Backport YARN-6232 for generic resource type usage to branch-2

2019-01-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736492#comment-16736492 ] Hadoop QA commented on YARN-9181: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9173) FairShare calculation broken for large values after YARN-8833

2019-01-07 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736490#comment-16736490 ] Wilfred Spiegelenburg commented on YARN-9173: - [~cheersyang] I have added a patch for branch

[jira] [Commented] (YARN-9169) Add metrics for queued opportunistic and guaranteed containers.

2019-01-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736486#comment-16736486 ] Hudson commented on YARN-9169: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15740 (See

[jira] [Created] (YARN-9181) Backport YARN-6232 for generic resource type usage to branch-2

2019-01-07 Thread Jonathan Hung (JIRA)
Jonathan Hung created YARN-9181: --- Summary: Backport YARN-6232 for generic resource type usage to branch-2 Key: YARN-9181 URL: https://issues.apache.org/jira/browse/YARN-9181 Project: Hadoop YARN

[jira] [Commented] (YARN-8927) Support trust top-level image like "centos" when "library" is configured in "docker.trusted.registries"

2019-01-07 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736478#comment-16736478 ] Eric Yang commented on YARN-8927: - [~tangzhankun] thank you for the patch. The handling of top level

[jira] [Commented] (YARN-9181) Backport YARN-6232 for generic resource type usage to branch-2

2019-01-07 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736474#comment-16736474 ] Jonathan Hung commented on YARN-9181: - Attached 001 patch for branch-2 backport of YARN-6232. >

[jira] [Updated] (YARN-9181) Backport YARN-6232 for generic resource type usage to branch-2

2019-01-07 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-9181: Attachment: YARN-9181-YARN-8200.001.patch > Backport YARN-6232 for generic resource type usage to

[jira] [Commented] (YARN-9169) Add metrics for queued opportunistic and guaranteed containers.

2019-01-07 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736471#comment-16736471 ] Giovanni Matteo Fumarola commented on YARN-9169: +1. Thanks [~abmodi] . Committed to

[jira] [Updated] (YARN-9169) Add metrics for queued opportunistic and guaranteed containers.

2019-01-07 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-9169: --- Fix Version/s: 3.3.0 > Add metrics for queued opportunistic and guaranteed

[jira] [Assigned] (YARN-9181) Backport YARN-6232 for generic resource type usage to branch-2

2019-01-07 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung reassigned YARN-9181: --- Assignee: Jonathan Hung > Backport YARN-6232 for generic resource type usage to branch-2 >

[jira] [Updated] (YARN-9173) FairShare calculation broken for large values after YARN-8833

2019-01-07 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg updated YARN-9173: Attachment: YARN-9137-branch3.1.001.patch > FairShare calculation broken for large

[jira] [Commented] (YARN-8822) Nvidia-docker v2 support for YARN GPU feature

2019-01-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736451#comment-16736451 ] Hadoop QA commented on YARN-8822: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6695) Race condition in RM for publishing container events vs appFinished events causes NPE

2019-01-07 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736436#comment-16736436 ] Eric Yang commented on YARN-6695: - YARN service encounter this bug frequently because the application does

[jira] [Updated] (YARN-6695) Race condition in RM for publishing container events vs appFinished events causes NPE

2019-01-07 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-6695: Attachment: YARN-6695.001.patch > Race condition in RM for publishing container events vs appFinished

[jira] [Updated] (YARN-6695) Race condition in RM for publishing container events vs appFinished events causes NPE

2019-01-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-6695: - Target Version/s: 3.2.0, 3.1.2 > Race condition in RM for publishing container events vs appFinished

[jira] [Comment Edited] (YARN-9174) Backport YARN-7224 for refactoring of GpuDevice class

2019-01-07 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736146#comment-16736146 ] Jonathan Hung edited comment on YARN-9174 at 1/7/19 10:06 PM: -- Thanks Arun.

[jira] [Updated] (YARN-9174) Backport YARN-7224 for refactoring of GpuDevice class

2019-01-07 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-9174: Summary: Backport YARN-7224 for refactoring of GpuDevice class (was: branch-3.0/branch-2

[jira] [Commented] (YARN-9180) Port YARN-7033 NM recovery of assigned resources to branch-3.0/branch-2

2019-01-07 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736409#comment-16736409 ] Jonathan Hung commented on YARN-9180: - Thanks [~asuresh], yes it will be committed before YARN-9174.

[jira] [Commented] (YARN-9180) Port YARN-7033 NM recovery of assigned resources to branch-3.0/branch-2

2019-01-07 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736376#comment-16736376 ] Arun Suresh commented on YARN-9180: --- Thanks for the patch [~jhung] Looks strightforward.. am guessing

[jira] [Commented] (YARN-8822) Nvidia-docker v2 support for YARN GPU feature

2019-01-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736374#comment-16736374 ] Hudson commented on YARN-8822: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15739 (See

[jira] [Commented] (YARN-9180) Port YARN-7033 NM recovery of assigned resources to branch-3.0/branch-2

2019-01-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736327#comment-16736327 ] Hadoop QA commented on YARN-9180: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8822) Nvidia-docker v2 support for YARN GPU feature

2019-01-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736322#comment-16736322 ] Wangda Tan commented on YARN-8822: -- Thanks [~Charo Zhang] for the patch and [~tangzhankun] for

[jira] [Updated] (YARN-8822) Nvidia-docker v2 support for YARN GPU feature

2019-01-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8822: - Target Version/s: 3.2.0 (was: 3.1.2, 3.3.0, 3.2.1) > Nvidia-docker v2 support for YARN GPU feature >

[jira] [Updated] (YARN-8822) Nvidia-docker v2 support for YARN GPU feature

2019-01-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8822: - Fix Version/s: 3.2.1 3.3.0 3.1.2 > Nvidia-docker v2 support for

[jira] [Updated] (YARN-8822) Nvidia-docker v2 support for YARN GPU feature

2019-01-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8822: - Attachment: YARN-8822-branch-3.2.0-001.patch > Nvidia-docker v2 support for YARN GPU feature >

[jira] [Updated] (YARN-8822) Nvidia-docker v2 support for YARN GPU feature

2019-01-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8822: - Summary: Nvidia-docker v2 support for YARN GPU feature (was: Nvidia-docker v2 support) > Nvidia-docker

[jira] [Updated] (YARN-9180) Port YARN-7033 NM recovery of assigned resources to branch-3.0/branch-2

2019-01-07 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-9180: Attachment: YARN-9180-YARN-8200.branch3.001.patch > Port YARN-7033 NM recovery of assigned

[jira] [Updated] (YARN-9180) Port YARN-7033 NM recovery of assigned resources to branch-3.0/branch-2

2019-01-07 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-9180: Attachment: (was: YARN-9180-YARN-8200.branch3wc.001.patch) > Port YARN-7033 NM recovery of

[jira] [Commented] (YARN-9180) Port YARN-7033 NM recovery of assigned resources to branch-3.0/branch-2

2019-01-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736191#comment-16736191 ] Hadoop QA commented on YARN-9180: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6523) Newly retrieved security Tokens are sent as part of each heartbeat to each node from RM which is not desirable in large cluster

2019-01-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736171#comment-16736171 ] Hadoop QA commented on YARN-6523: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8822) Nvidia-docker v2 support

2019-01-07 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736169#comment-16736169 ] Sunil Govindan commented on YARN-8822: -- [~leftnoteasy] pls help to get into 3.2.0 as well. I will

[jira] [Commented] (YARN-9174) branch-3.0/branch-2 refactoring of GpuDevice class

2019-01-07 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736146#comment-16736146 ] Jonathan Hung commented on YARN-9174: - Thanks Arun. [~erwaman], yes, e.g. YARN-7330 depends on this

[jira] [Commented] (YARN-9174) branch-3.0/branch-2 refactoring of GpuDevice class

2019-01-07 Thread Anthony Hsu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736133#comment-16736133 ] Anthony Hsu commented on YARN-9174: --- What is the motivation for backporting the GpuDevice class

[jira] [Updated] (YARN-9180) Port YARN-7033 NM recovery of assigned resources to branch-3.0/branch-2

2019-01-07 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-9180: Attachment: (was: YARN-9180-YARN-8200.branch3.001.patch) > Port YARN-7033 NM recovery of

[jira] [Updated] (YARN-9180) Port YARN-7033 NM recovery of assigned resources to branch-3.0/branch-2

2019-01-07 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-9180: Attachment: YARN-9180-YARN-8200.branch3wc.001.patch > Port YARN-7033 NM recovery of assigned

[jira] [Commented] (YARN-8822) Nvidia-docker v2 support

2019-01-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736107#comment-16736107 ] Wangda Tan commented on YARN-8822: -- Thanks [~Charo Zhang],   Latest patches LGTM, will get them

[jira] [Updated] (YARN-9053) Support set environment variables for Docker Containers In nonEntryPoint mode

2019-01-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-9053: - Target Version/s: 3.1.3 (was: 3.1.2) > Support set environment variables for Docker Containers In

[jira] [Updated] (YARN-8822) Nvidia-docker v2 support

2019-01-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8822: - Target Version/s: 3.1.2, 3.3.0, 3.2.1 (was: 3.3.0, 3.2.1, 3.1.3) > Nvidia-docker v2 support >

[jira] [Commented] (YARN-9180) Port YARN-7033 NM recovery of assigned resources to branch-3.0/branch-2

2019-01-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736096#comment-16736096 ] Hadoop QA commented on YARN-9180: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9116) Capacity Scheduler: add the default maximum-allocation-mb and maximum-allocation-vcores for the queues

2019-01-07 Thread Aihua Xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736083#comment-16736083 ] Aihua Xu commented on YARN-9116: [~cheersyang] In the example above, we are still introducing the

  1   2   >