[jira] [Updated] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-9161: --- Attachment: YARN-9161.003.patch > Absolute resources of capacity scheduler doesn't support GPU and FPGA >

[jira] [Updated] (YARN-8833) Avoid potential integer overflow when computing fair shares

[ https://issues.apache.org/jira/browse/YARN-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8833: -- Fix Version/s: 2.9.3 > Avoid potential integer overflow when computing fair shares >

[jira] [Updated] (YARN-8833) Avoid potential integer overflow when computing fair shares

[ https://issues.apache.org/jira/browse/YARN-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8833: -- Fix Version/s: 2.10.0 > Avoid potential integer overflow when computing fair shares >

[jira] [Commented] (YARN-9116) Capacity Scheduler: add the default maximum-allocation-mb and maximum-allocation-vcores for the queues

[ https://issues.apache.org/jira/browse/YARN-9116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16737856#comment-16737856 ] Wangda Tan commented on YARN-9116: -- Maybe we can support maximum-allocation-mb/vcores to parent queues

[jira] [Commented] (YARN-9116) Capacity Scheduler: add the default maximum-allocation-mb and maximum-allocation-vcores for the queues

[ https://issues.apache.org/jira/browse/YARN-9116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16737855#comment-16737855 ] Wangda Tan commented on YARN-9116: -- [~cheersyang], [~aihuaxu],  The proposal from Weiwei sounds good to

[jira] [Commented] (YARN-8833) Avoid potential integer overflow when computing fair shares

[ https://issues.apache.org/jira/browse/YARN-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16737851#comment-16737851 ] Wilfred Spiegelenburg commented on YARN-8833: - The patch looks good +1. The check implemented

[jira] [Commented] (YARN-8489) Need to support "dominant" component concept inside YARN service

[ https://issues.apache.org/jira/browse/YARN-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16737841#comment-16737841 ] Hadoop QA commented on YARN-8489: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9185) TimelineServiceV2Publisher throws NPE when app is finished before container metrics updated

[ https://issues.apache.org/jira/browse/YARN-9185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16737830#comment-16737830 ] Zac Zhou commented on YARN-9185: [~eyang] Thanks a lot for fixing it~ > TimelineServiceV2Publisher

[jira] [Commented] (YARN-9150) Making TimelineSchemaCreator support different backends for Timeline Schema Creation in ATSv2

[ https://issues.apache.org/jira/browse/YARN-9150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16737813#comment-16737813 ] Vrushali C commented on YARN-9150: -- Hi Sushil The patch looks fine to me. I am trying to find the old

[jira] [Commented] (YARN-9116) Capacity Scheduler: add the default maximum-allocation-mb and maximum-allocation-vcores for the queues

[ https://issues.apache.org/jira/browse/YARN-9116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16737807#comment-16737807 ] Weiwei Yang commented on YARN-9116: --- Hi [~aihuaxu], [~tgraves] Absolutely we should always respect the

[jira] [Commented] (YARN-8489) Need to support "dominant" component concept inside YARN service

[ https://issues.apache.org/jira/browse/YARN-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16737791#comment-16737791 ] Zac Zhou commented on YARN-8489: [~suma.shivaprasad] Thanks a lot for your comments~ > Need to support

[jira] [Updated] (YARN-8489) Need to support "dominant" component concept inside YARN service

[ https://issues.apache.org/jira/browse/YARN-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-8489: --- Attachment: YARN-8489.005.patch > Need to support "dominant" component concept inside YARN service >

[jira] [Commented] (YARN-9187) Backport YARN-6852 for GPU-specific native changes to branch-2

[ https://issues.apache.org/jira/browse/YARN-9187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16737720#comment-16737720 ] Hadoop QA commented on YARN-9187: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9187) Backport YARN-6852 for GPU-specific native changes to branch-2

[ https://issues.apache.org/jira/browse/YARN-9187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16737634#comment-16737634 ] Hadoop QA commented on YARN-9187: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6523) Optimize system credentials sent in node heartbeat responses

[ https://issues.apache.org/jira/browse/YARN-6523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16737629#comment-16737629 ] Hudson commented on YARN-6523: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15748 (See

[jira] [Commented] (YARN-6523) Newly retrieved security Tokens are sent as part of each heartbeat to each node from RM which is not desirable in large cluster

[ https://issues.apache.org/jira/browse/YARN-6523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16737610#comment-16737610 ] Jason Lowe commented on YARN-6523: -- Thanks for updating the patch! The unit test failure is unrelated

[jira] [Commented] (YARN-9187) Backport YARN-6852 for GPU-specific native changes to branch-2

[ https://issues.apache.org/jira/browse/YARN-9187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16737621#comment-16737621 ] Jonathan Hung commented on YARN-9187: - Attached 001 patch. This patch + YARN-7321 = YARN-6852 from

[jira] [Updated] (YARN-9187) Backport YARN-6852 for GPU-specific native changes to branch-2

[ https://issues.apache.org/jira/browse/YARN-9187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-9187: Attachment: YARN-9187-YARN-8200.001.patch > Backport YARN-6852 for GPU-specific native changes to

[jira] [Created] (YARN-9187) Backport YARN-6852 for GPU-specific native changes to branch-2

Jonathan Hung created YARN-9187: --- Summary: Backport YARN-6852 for GPU-specific native changes to branch-2 Key: YARN-9187 URL: https://issues.apache.org/jira/browse/YARN-9187 Project: Hadoop YARN

[jira] [Updated] (YARN-6523) Optimize system credentials sent in node heartbeat responses

[ https://issues.apache.org/jira/browse/YARN-6523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-6523: - Summary: Optimize system credentials sent in node heartbeat responses (was: Newly retrieved security

[jira] [Commented] (YARN-6523) Newly retrieved security Tokens are sent as part of each heartbeat to each node from RM which is not desirable in large cluster

[ https://issues.apache.org/jira/browse/YARN-6523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16737500#comment-16737500 ] Hadoop QA commented on YARN-6523: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9182) Backport YARN-6445 resource profile performance improvements to branch-2

[ https://issues.apache.org/jira/browse/YARN-9182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16737499#comment-16737499 ] Jonathan Hung commented on YARN-9182: - Thanks Arun, committed to YARN-8200 > Backport YARN-6445

[jira] [Commented] (YARN-9181) Backport YARN-6232 for generic resource type usage to branch-2

[ https://issues.apache.org/jira/browse/YARN-9181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16737488#comment-16737488 ] Jonathan Hung commented on YARN-9181: - Thanks Arun, committed this to YARN-8200 together with

[jira] [Commented] (YARN-8489) Need to support "dominant" component concept inside YARN service

[ https://issues.apache.org/jira/browse/YARN-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16737446#comment-16737446 ] Suma Shivaprasad commented on YARN-8489: Thanks for updating the patch [~yuan_zac] A few minor

[jira] [Commented] (YARN-9182) Backport YARN-6445 resource profile performance improvements to branch-2

[ https://issues.apache.org/jira/browse/YARN-9182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16737433#comment-16737433 ] Arun Suresh commented on YARN-9182: --- Looks good +1 Thanks [~jhung] > Backport YARN-6445 resource

[jira] [Commented] (YARN-9181) Backport YARN-6232 for generic resource type usage to branch-2

[ https://issues.apache.org/jira/browse/YARN-9181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16737434#comment-16737434 ] Arun Suresh commented on YARN-9181: --- +1 pending jenkins after youve committed YARN-9177 > Backport

[jira] [Commented] (YARN-9177) Use resource map for app metrics in TestCombinedSystemMetricsPublisher for branch-2

[ https://issues.apache.org/jira/browse/YARN-9177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16737393#comment-16737393 ] Arun Suresh commented on YARN-9177: --- Looks good +1 Thanks [~jhung] > Use resource map for app metrics

[jira] [Commented] (YARN-9116) Capacity Scheduler: add the default maximum-allocation-mb and maximum-allocation-vcores for the queues

[ https://issues.apache.org/jira/browse/YARN-9116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16737392#comment-16737392 ] Thomas Graves commented on YARN-9116: - Yes so you want to keep the behavior that the cluster level

[jira] [Updated] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-9161: - Component/s: capacity scheduler > Absolute resources of capacity scheduler doesn't support GPU and FPGA >

[jira] [Commented] (YARN-9116) Capacity Scheduler: add the default maximum-allocation-mb and maximum-allocation-vcores for the queues

[ https://issues.apache.org/jira/browse/YARN-9116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16737351#comment-16737351 ] Aihua Xu commented on YARN-9116: [~cheersyang] As I understand currently you can only set

[jira] [Commented] (YARN-8489) Need to support "dominant" component concept inside YARN service

[ https://issues.apache.org/jira/browse/YARN-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16737314#comment-16737314 ] Hadoop QA commented on YARN-8489: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-9183) TestAMRMTokens fails

[ https://issues.apache.org/jira/browse/YARN-9183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-9183: - Target Version/s: 3.0.4, 3.1.2, 3.3.0, 3.2.1 > TestAMRMTokens fails > > >

[jira] [Resolved] (YARN-9185) TimelineServiceV2Publisher throws NPE when app is finished before container metrics updated

[ https://issues.apache.org/jira/browse/YARN-9185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang resolved YARN-9185. - Resolution: Duplicate > TimelineServiceV2Publisher throws NPE when app is finished before container >

[jira] [Assigned] (YARN-9094) Remove unused interface method: NodeResourceUpdaterPlugin#handleUpdatedResourceFromRM

[ https://issues.apache.org/jira/browse/YARN-9094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-9094: Assignee: Gergely Pollak (was: Szilard Nemeth) > Remove unused interface method: >

[jira] [Assigned] (YARN-9119) Extract nvidia-smi binary lookup logic from GpuDiscoverer

[ https://issues.apache.org/jira/browse/YARN-9119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-9119: Assignee: Gergely Pollak (was: Szilard Nemeth) > Extract nvidia-smi binary lookup logic

[jira] [Assigned] (YARN-9094) Remove unused interface method: NodeResourceUpdaterPlugin#handleUpdatedResourceFromRM

[ https://issues.apache.org/jira/browse/YARN-9094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-9094: Assignee: Szilard Nemeth (was: Alex Bodo) > Remove unused interface method: >

[jira] [Commented] (YARN-9184) Docker run doesn't pull down latest image if the image exists locally

[ https://issues.apache.org/jira/browse/YARN-9184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16737234#comment-16737234 ] Eric Badger commented on YARN-9184: --- I think this would be a nice option to have, but should definitely

[jira] [Updated] (YARN-8489) Need to support "dominant" component concept inside YARN service

[ https://issues.apache.org/jira/browse/YARN-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-8489: --- Attachment: YARN-8489.004.patch > Need to support "dominant" component concept inside YARN service >

[jira] [Created] (YARN-9186) [CSI] Upgrade CSI proto to v1.0

Weiwei Yang created YARN-9186: - Summary: [CSI] Upgrade CSI proto to v1.0 Key: YARN-9186 URL: https://issues.apache.org/jira/browse/YARN-9186 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-8489) Need to support "dominant" component concept inside YARN service

[ https://issues.apache.org/jira/browse/YARN-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16737084#comment-16737084 ] Zac Zhou commented on YARN-8489: [~leftnoteasy], [~suma.shivaprasad] Thanks a lot for your comments.

[jira] [Commented] (YARN-9185) TimelineServiceV2Publisher throws NPE when app is finished before container metrics updated

[ https://issues.apache.org/jira/browse/YARN-9185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16737091#comment-16737091 ] Zac Zhou commented on YARN-9185: When the following configuration is specified:

[jira] [Updated] (YARN-9185) TimelineServiceV2Publisher throws NPE when app is finished before container metrics updated

[ https://issues.apache.org/jira/browse/YARN-9185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-9185: --- Issue Type: Sub-task (was: Bug) Parent: YARN-8489 > TimelineServiceV2Publisher throws NPE when app

[jira] [Created] (YARN-9185) TimelineServiceV2Publisher throws NPE when app is finished before container metrics updated

Zac Zhou created YARN-9185: -- Summary: TimelineServiceV2Publisher throws NPE when app is finished before container metrics updated Key: YARN-9185 URL: https://issues.apache.org/jira/browse/YARN-9185 Project:

[jira] [Assigned] (YARN-8498) Yarn NodeManager OOM Listener Fails Compilation on Ubuntu 18.04

[ https://issues.apache.org/jira/browse/YARN-8498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena reassigned YARN-8498: -- Assignee: Ayush Saxena > Yarn NodeManager OOM Listener Fails Compilation on Ubuntu 18.04 >

[jira] [Commented] (YARN-6523) Newly retrieved security Tokens are sent as part of each heartbeat to each node from RM which is not desirable in large cluster

[ https://issues.apache.org/jira/browse/YARN-6523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16737037#comment-16737037 ] Hadoop QA commented on YARN-6523: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8833) Avoid potential integer overflow when computing fair shares

[ https://issues.apache.org/jira/browse/YARN-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736977#comment-16736977 ] Weiwei Yang commented on YARN-8833: --- Looks good to me, thanks [~yoelee]. [~wilfreds], do you want to

[jira] [Commented] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736910#comment-16736910 ] Hadoop QA commented on YARN-9161: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8833) Avoid potential integer overflow when computing fair shares

[ https://issues.apache.org/jira/browse/YARN-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736896#comment-16736896 ] liyakun commented on YARN-8833: --- [~cheersyang], [~wilfreds], pls help me with code review, thanks. > Avoid

[jira] [Updated] (YARN-6523) Newly retrieved security Tokens are sent as part of each heartbeat to each node from RM which is not desirable in large cluster

[ https://issues.apache.org/jira/browse/YARN-6523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikandan R updated YARN-6523: --- Attachment: YARN-6523.015.patch > Newly retrieved security Tokens are sent as part of each heartbeat

[jira] [Commented] (YARN-6523) Newly retrieved security Tokens are sent as part of each heartbeat to each node from RM which is not desirable in large cluster

[ https://issues.apache.org/jira/browse/YARN-6523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736865#comment-16736865 ] Manikandan R commented on YARN-6523: Fixed imports issue. > Newly retrieved security Tokens are sent