[jira] [Updated] (YARN-8881) [YARN-8851] Add basic pluggable device plugin framework

[ https://issues.apache.org/jira/browse/YARN-8881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8881: - Fix Version/s: 3.3.0 > [YARN-8851] Add basic pluggable device plugin framework > -

[jira] [Updated] (YARN-8881) [YARN-8851] Add basic pluggable device plugin framework

[ https://issues.apache.org/jira/browse/YARN-8881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8881: - Summary: [YARN-8851] Add basic pluggable device plugin framework (was: Phase 1 - Add basic pluggable devi

[jira] [Commented] (YARN-8960) [Submarine] Can't get submarine service status using the command of "yarn app -status" under security environment

[ https://issues.apache.org/jira/browse/YARN-8960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16691972#comment-16691972 ] Wangda Tan commented on YARN-8960: -- +1, committing, thanks [~yuan_zac]. > [Submarine] Ca

[jira] [Updated] (YARN-8299) Yarn Service Upgrade: Add GET APIs that returns instances matching query params

[ https://issues.apache.org/jira/browse/YARN-8299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8299: - Target Version/s: (was: 3.1.2) > Yarn Service Upgrade: Add GET APIs that returns instances matching quer

[jira] [Updated] (YARN-8299) Yarn Service Upgrade: Add GET APIs that returns instances matching query params

[ https://issues.apache.org/jira/browse/YARN-8299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8299: - Fix Version/s: 3.1.2 > Yarn Service Upgrade: Add GET APIs that returns instances matching query > params

[jira] [Commented] (YARN-8299) Yarn Service Upgrade: Add GET APIs that returns instances matching query params

[ https://issues.apache.org/jira/browse/YARN-8299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16689823#comment-16689823 ] Wangda Tan commented on YARN-8299: -- Committing to branch-3.1 now .. > Yarn Service Upgra

[jira] [Updated] (YARN-8299) Yarn Service Upgrade: Add GET APIs that returns instances matching query params

[ https://issues.apache.org/jira/browse/YARN-8299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8299: - Priority: Critical (was: Major) > Yarn Service Upgrade: Add GET APIs that returns instances matching quer

[jira] [Commented] (YARN-8299) Yarn Service Upgrade: Add GET APIs that returns instances matching query params

[ https://issues.apache.org/jira/browse/YARN-8299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16689805#comment-16689805 ] Wangda Tan commented on YARN-8299: -- Reopened to backport to 3.1.2 > Yarn Service Upgrade

[jira] [Updated] (YARN-8299) Yarn Service Upgrade: Add GET APIs that returns instances matching query params

[ https://issues.apache.org/jira/browse/YARN-8299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8299: - Target Version/s: 3.1.2 > Yarn Service Upgrade: Add GET APIs that returns instances matching query > para

[jira] [Reopened] (YARN-8299) Yarn Service Upgrade: Add GET APIs that returns instances matching query params

[ https://issues.apache.org/jira/browse/YARN-8299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reopened YARN-8299: -- > Yarn Service Upgrade: Add GET APIs that returns instances matching query > params > -

[jira] [Updated] (YARN-8779) Fix few discrepancies between YARN Service swagger spec and code

[ https://issues.apache.org/jira/browse/YARN-8779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8779: - Target Version/s: 3.2.0, 3.1.3 (was: 3.2.0, 3.1.2) > Fix few discrepancies between YARN Service swagger s

[jira] [Updated] (YARN-8161) ServiceState FLEX should be removed

[ https://issues.apache.org/jira/browse/YARN-8161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8161: - Target Version/s: 3.2.0, 3.1.3 (was: 3.2.0, 3.1.2) > ServiceState FLEX should be removed > --

[jira] [Updated] (YARN-8366) Expose debug log information when user intend to enable GPU without setting nvidia-smi path

[ https://issues.apache.org/jira/browse/YARN-8366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8366: - Target Version/s: 3.2.0, 3.1.3 (was: 3.2.0, 3.1.2) > Expose debug log information when user intend to ena

[jira] [Updated] (YARN-8986) publish all exposed ports to random ports when using bridge network

[ https://issues.apache.org/jira/browse/YARN-8986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8986: - Fix Version/s: (was: 3.1.2) > publish all exposed ports to random ports when using bridge network > --

[jira] [Updated] (YARN-8986) publish all exposed ports to random ports when using bridge network

[ https://issues.apache.org/jira/browse/YARN-8986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8986: - Target Version/s: 3.1.3 (was: 3.1.2) > publish all exposed ports to random ports when using bridge networ

[jira] [Updated] (YARN-8552) [DS] Container report fails for distributed containers

[ https://issues.apache.org/jira/browse/YARN-8552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8552: - Target Version/s: 3.1.3 (was: 3.1.2) > [DS] Container report fails for distributed containers >

[jira] [Updated] (YARN-8509) Total pending resource calculation in preemption should use user-limit factor instead of minimum-user-limit-percent

[ https://issues.apache.org/jira/browse/YARN-8509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8509: - Target Version/s: 3.2.0, 3.1.3 (was: 3.2.0, 3.1.2) > Total pending resource calculation in preemption sho

[jira] [Updated] (YARN-8453) Additional Unit tests to verify queue limit and max-limit with multiple resource types

[ https://issues.apache.org/jira/browse/YARN-8453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8453: - Target Version/s: 3.0.4, 3.1.3 (was: 3.0.4, 3.1.2) > Additional Unit tests to verify queue limit and max

[jira] [Updated] (YARN-8052) Move overwriting of service definition during flex to service master

[ https://issues.apache.org/jira/browse/YARN-8052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8052: - Target Version/s: 3.1.3 (was: 3.1.2) > Move overwriting of service definition during flex to service mast

[jira] [Updated] (YARN-8417) Should skip passing HDFS_HOME, HADOOP_CONF_DIR, JAVA_HOME, etc. to Docker container.

[ https://issues.apache.org/jira/browse/YARN-8417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8417: - Target Version/s: 3.1.3 (was: 3.1.2) > Should skip passing HDFS_HOME, HADOOP_CONF_DIR, JAVA_HOME, etc. to

[jira] [Updated] (YARN-8657) User limit calculation should be read-lock-protected within LeafQueue

[ https://issues.apache.org/jira/browse/YARN-8657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8657: - Target Version/s: 3.2.1, 3.1.3 (was: 3.1.2, 3.2.1) > User limit calculation should be read-lock-protected

[jira] [Updated] (YARN-8234) Improve RM system metrics publisher's performance by pushing events to timeline server in batch

[ https://issues.apache.org/jira/browse/YARN-8234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8234: - Target Version/s: 3.1.3 (was: 3.1.2) > Improve RM system metrics publisher's performance by pushing event

[jira] [Updated] (YARN-8257) Native service should automatically adding escapes for environment/launch cmd before sending to YARN

[ https://issues.apache.org/jira/browse/YARN-8257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8257: - Target Version/s: 3.1.3 (was: 3.1.2) > Native service should automatically adding escapes for environment

[jira] [Commented] (YARN-9030) Log aggregation changes to handle filesystems which do not support permissions

[ https://issues.apache.org/jira/browse/YARN-9030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16689755#comment-16689755 ] Wangda Tan commented on YARN-9030: -- [~suma.shivaprasad], it seems the logic of verifyAndC

[jira] [Commented] (YARN-8881) Phase 1 - Add basic pluggable device plugin framework

[ https://issues.apache.org/jira/browse/YARN-8881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16689699#comment-16689699 ] Wangda Tan commented on YARN-8881: -- +1 to the latest patch, will commit later today if no

[jira] [Updated] (YARN-8917) Absolute (maximum) capacity of level3+ queues is wrongly calculated for absolute resource

[ https://issues.apache.org/jira/browse/YARN-8917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8917: - Target Version/s: 3.2.1 > Absolute (maximum) capacity of level3+ queues is wrongly calculated for > absol

[jira] [Updated] (YARN-8917) Absolute (maximum) capacity of level3+ queues is wrongly calculated for absolute resource

[ https://issues.apache.org/jira/browse/YARN-8917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8917: - Priority: Critical (was: Major) > Absolute (maximum) capacity of level3+ queues is wrongly calculated for

[jira] [Resolved] (YARN-9020) set a wrong AbsoluteCapacity when call ParentQueue#setAbsoluteCapacity

[ https://issues.apache.org/jira/browse/YARN-9020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan resolved YARN-9020. -- Resolution: Duplicate Thanks [~jutia] for reporting this. It is a valid issue. This is dup of YARN-8917

[jira] [Commented] (YARN-8917) Absolute (maximum) capacity of level3+ queues is wrongly calculated for absolute resource

[ https://issues.apache.org/jira/browse/YARN-8917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16686903#comment-16686903 ] Wangda Tan commented on YARN-8917: -- This JIRA somehow dropped from our radar, retriggerin

[jira] [Assigned] (YARN-6223) [Umbrella] Natively support GPU configuration/discovery/scheduling/isolation on YARN

[ https://issues.apache.org/jira/browse/YARN-6223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned YARN-6223: Assignee: Wangda Tan (was: Antal Bálint Steinbach) > [Umbrella] Natively support GPU configuration

[jira] [Commented] (YARN-9001) [Submarine] Use AppAdminClient instead of ServiceClient to sumbit jobs

[ https://issues.apache.org/jira/browse/YARN-9001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685750#comment-16685750 ] Wangda Tan commented on YARN-9001: -- Pushed to trunk, but backport to branch-3.2 failed, [

[jira] [Updated] (YARN-9001) [Submarine] Use AppAdminClient instead of ServiceClient to sumbit jobs

[ https://issues.apache.org/jira/browse/YARN-9001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-9001: - Fix Version/s: 3.3.0 > [Submarine] Use AppAdminClient instead of ServiceClient to sumbit jobs > --

[jira] [Comment Edited] (YARN-8960) [Submarine] Can't get submarine service status using the command of "yarn app -status" under security environment

[ https://issues.apache.org/jira/browse/YARN-8960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685618#comment-16685618 ] Wangda Tan edited comment on YARN-8960 at 11/13/18 7:50 PM: Th

[jira] [Commented] (YARN-9001) [Submarine] Use AppAdminClient instead of ServiceClient to sumbit jobs

[ https://issues.apache.org/jira/browse/YARN-9001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685635#comment-16685635 ] Wangda Tan commented on YARN-9001: -- Rebased to latest trunk to run Jenkins. > [Submarine

[jira] [Updated] (YARN-9001) [Submarine] Use AppAdminClient instead of ServiceClient to sumbit jobs

[ https://issues.apache.org/jira/browse/YARN-9001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-9001: - Attachment: YARN-9001.005.patch > [Submarine] Use AppAdminClient instead of ServiceClient to sumbit jobs >

[jira] [Commented] (YARN-9001) [Submarine] Use AppAdminClient instead of ServiceClient to sumbit jobs

[ https://issues.apache.org/jira/browse/YARN-9001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685631#comment-16685631 ] Wangda Tan commented on YARN-9001: -- Thanks [~yuan_zac], +1, committing the patch. > [Su

[jira] [Commented] (YARN-8960) [Submarine] Can't get submarine service status using the command of "yarn app -status" under security environment

[ https://issues.apache.org/jira/browse/YARN-8960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685618#comment-16685618 ] Wangda Tan commented on YARN-8960: -- Thanks [~yuan_zac], Some comments: 1) doLoginIfSec

[jira] [Updated] (YARN-8960) [Submarine] Can't get submarine service status using the command of "yarn app -status" under security environment

[ https://issues.apache.org/jira/browse/YARN-8960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8960: - Description: After submitting a submarine job, we tried to get service status using the following command

[jira] [Commented] (YARN-8881) Phase 1 - Add basic pluggable device plugin framework

[ https://issues.apache.org/jira/browse/YARN-8881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685605#comment-16685605 ] Wangda Tan commented on YARN-8881: -- Thanks [~tangzhankun], Regarding Integer vs. int, I

[jira] [Commented] (YARN-9001) [Submarine] Use AppAdminClient instead of ServiceClient to sumbit jobs

[ https://issues.apache.org/jira/browse/YARN-9001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16684468#comment-16684468 ] Wangda Tan commented on YARN-9001: -- [~yuan_zac], checked the patch, in general patch look

[jira] [Created] (YARN-8993) [Submarine] Add support to run deep learning workload in non-Docker containers

Wangda Tan created YARN-8993: Summary: [Submarine] Add support to run deep learning workload in non-Docker containers Key: YARN-8993 URL: https://issues.apache.org/jira/browse/YARN-8993 Project: Hadoop YA

[jira] [Commented] (YARN-8877) Extend service spec to allow setting resource attributes

[ https://issues.apache.org/jira/browse/YARN-8877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16680617#comment-16680617 ] Wangda Tan commented on YARN-8877: -- [~cheersyang], make sense to me. > Extend service sp

[jira] [Commented] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16680615#comment-16680615 ] Wangda Tan commented on YARN-8714: -- [~tangzhankun] , I'm still not quite sure about: {cod

[jira] [Commented] (YARN-8960) [Submarine] Can't get submarine service status using the command of "yarn app -status" under security environment

[ https://issues.apache.org/jira/browse/YARN-8960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16680601#comment-16680601 ] Wangda Tan commented on YARN-8960: -- [~yuan_zac] , as we discussed offline, do we still ne

[jira] [Updated] (YARN-8135) Hadoop {Submarine} Project: Simple and scalable deployment of deep learning training / serving jobs on Hadoop

[ https://issues.apache.org/jira/browse/YARN-8135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8135: - Description: Description: *Goals:* - Allow infra engineer / data scientist to run *unmodified* Tensorflo

[jira] [Commented] (YARN-8763) Add WebSocket logic to the Node Manager web server to establish servlet

[ https://issues.apache.org/jira/browse/YARN-8763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16680570#comment-16680570 ] Wangda Tan commented on YARN-8763: -- [~sunilg] , I highly suggest reverting this from bran

[jira] [Updated] (YARN-8220) Running Tensorflow on YARN with GPU and Docker - Examples

[ https://issues.apache.org/jira/browse/YARN-8220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8220: - Description: -Tensorflow could be run on YARN and could leverage YARN's distributed features.- -This spe

[jira] [Updated] (YARN-8237) mxnet yarn spec file to add to native service examples

[ https://issues.apache.org/jira/browse/YARN-8237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8237: - Description: Mxnet -could be run on YARN. This- jira -will help to add examples,- yarnfile-, docker files

[jira] [Updated] (YARN-8238) [Umbrella] YARN deep learning framework examples to run on native service

[ https://issues.apache.org/jira/browse/YARN-8238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8238: - Description: -Umbrella- jira -to track various deep learning frameworks which can run on yarn native serv

[jira] [Resolved] (YARN-8237) mxnet yarn spec file to add to native service examples

[ https://issues.apache.org/jira/browse/YARN-8237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan resolved YARN-8237. -- Resolution: Duplicate > mxnet yarn spec file to add to native service examples > ---

[jira] [Resolved] (YARN-8238) [Umbrella] YARN deep learning framework examples to run on native service

[ https://issues.apache.org/jira/browse/YARN-8238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan resolved YARN-8238. -- Resolution: Fixed Closing as dup of YARN-8135.  > [Umbrella] YARN deep learning framework examples to r

[jira] [Commented] (YARN-8877) Extend service spec to allow setting resource attributes

[ https://issues.apache.org/jira/browse/YARN-8877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16677039#comment-16677039 ] Wangda Tan commented on YARN-8877: -- [~cheersyang],  If YARN-8940 will satisfy all needs

[jira] [Commented] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16677029#comment-16677029 ] Wangda Tan commented on YARN-8714: -- [~tangzhankun] , could u please explain a little bit

[jira] [Commented] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16677030#comment-16677030 ] Wangda Tan commented on YARN-8714: -- + [~liuxun323] / [~yuan_zac] to take a look at this a

[jira] [Commented] (YARN-8902) Add volume manager that manages CSI volume lifecycle

[ https://issues.apache.org/jira/browse/YARN-8902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16677027#comment-16677027 ] Wangda Tan commented on YARN-8902: -- {quote}I prefer not to do this rename. As the package

[jira] [Commented] (YARN-8858) CapacityScheduler should respect maximum node resource when per-queue maximum-allocation is being used.

[ https://issues.apache.org/jira/browse/YARN-8858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16676232#comment-16676232 ] Wangda Tan commented on YARN-8858: -- Thanks [~cheersyang] / [~ajisakaa] for rebasing and c

[jira] [Commented] (YARN-8867) Retrieve the status of resource localization

[ https://issues.apache.org/jira/browse/YARN-8867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16675664#comment-16675664 ] Wangda Tan commented on YARN-8867: -- Thanks [~csingh] for working on this, from high-level

[jira] [Commented] (YARN-8851) [Umbrella] A new pluggable device plugin framework to ease vendor plugin development

[ https://issues.apache.org/jira/browse/YARN-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16675606#comment-16675606 ] Wangda Tan commented on YARN-8851: -- Thanks [~tangzhankun] ,  1) Regarding to the NM_PLUG

[jira] [Commented] (YARN-8858) CapacityScheduler should respect maximum node resource when per-queue maximum-allocation is being used.

[ https://issues.apache.org/jira/browse/YARN-8858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16675572#comment-16675572 ] Wangda Tan commented on YARN-8858: -- Triggered Jenkins build to find flaky tests.  > Capa

[jira] [Commented] (YARN-8902) Add volume manager that manages CSI volume lifecycle

[ https://issues.apache.org/jira/browse/YARN-8902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16675532#comment-16675532 ] Wangda Tan commented on YARN-8902: -- Thanks [~cheersyang] , a couple of high-level questio

[jira] [Commented] (YARN-8877) Extend service spec to allow setting resource attributes

[ https://issues.apache.org/jira/browse/YARN-8877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16675496#comment-16675496 ] Wangda Tan commented on YARN-8877: -- Thanks [~cheersyang],  In general patch looks good,

[jira] [Commented] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16669392#comment-16669392 ] Wangda Tan commented on YARN-8714: -- [~tangzhankun] , sure, please go ahead. > [Submarine

[jira] [Commented] (YARN-8944) TestContainerAllocation.testUserLimitAllocationMultipleContainers failure after YARN-8896

[ https://issues.apache.org/jira/browse/YARN-8944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16665445#comment-16665445 ] Wangda Tan commented on YARN-8944: -- Thanks [~wilfreds] , Patch LGTM, will commit today.

[jira] [Commented] (YARN-8866) Fix a parsing error for crossdomain.xml

[ https://issues.apache.org/jira/browse/YARN-8866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16665444#comment-16665444 ] Wangda Tan commented on YARN-8866: -- Thanks [~tasanuma0829],  Patch LGTM, will commit tod

[jira] [Resolved] (YARN-8513) CapacityScheduler infinite loop when queue is near fully utilized

[ https://issues.apache.org/jira/browse/YARN-8513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan resolved YARN-8513. -- Resolution: Duplicate Fix Version/s: (was: 3.2.1) (was: 3.1.2) Reopen

[jira] [Reopened] (YARN-8513) CapacityScheduler infinite loop when queue is near fully utilized

[ https://issues.apache.org/jira/browse/YARN-8513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reopened YARN-8513: -- > CapacityScheduler infinite loop when queue is near fully utilized > --

[jira] [Commented] (YARN-8895) Improve YARN Error diagnostics

[ https://issues.apache.org/jira/browse/YARN-8895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16662914#comment-16662914 ] Wangda Tan commented on YARN-8895: -- [~youchen] , Thanks, I believe this will be a very us

[jira] [Commented] (YARN-8927) Better handling of "docker.trusted.registries" in container-executor's "trusted_image_check" function

[ https://issues.apache.org/jira/browse/YARN-8927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16660904#comment-16660904 ] Wangda Tan commented on YARN-8927: -- [~tangzhankun], thanks for filing the Jira, I encount

[jira] [Commented] (YARN-8851) [Umbrella] A new pluggable device plugin framework to ease vendor plugin development

[ https://issues.apache.org/jira/browse/YARN-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16659747#comment-16659747 ] Wangda Tan commented on YARN-8851: -- [~tangzhankun], Thanks for updating the patch, the l

[jira] [Commented] (YARN-8918) [Submarine] Correct method usage of str.subString in CliUtils

[ https://issues.apache.org/jira/browse/YARN-8918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16659725#comment-16659725 ] Wangda Tan commented on YARN-8918: -- +1, thanks [~tangzhankun]. > [Submarine] Correct met

[jira] [Commented] (YARN-8924) Refine the document or code related to legacy CPU isolation/enforcement

[ https://issues.apache.org/jira/browse/YARN-8924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16659723#comment-16659723 ] Wangda Tan commented on YARN-8924: -- Thanks [~tangzhankun] for filing and Jira and put ana

[jira] [Commented] (YARN-6167) RM option to delegate NM loss container action to AM

[ https://issues.apache.org/jira/browse/YARN-6167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16659719#comment-16659719 ] Wangda Tan commented on YARN-6167: -- Thanks [~billie.rinaldi], 1) Inside releaseContainer

[jira] [Commented] (YARN-8920) LogAggregation should be configurable to allow writing to underlying storage as appOwner or yarn user

[ https://issues.apache.org/jira/browse/YARN-8920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16657413#comment-16657413 ] Wangda Tan commented on YARN-8920: -- Thanks [~suma.shivaprasad], 1) Inside YarnConfigurat

[jira] [Commented] (YARN-8917) Absolute (maximum) capacity of level3+ queues is wrongly calculated for absolute resource

[ https://issues.apache.org/jira/browse/YARN-8917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16657113#comment-16657113 ] Wangda Tan commented on YARN-8917: -- Nice catch [~Tao Yang]! Fix makes sense to me. [~sun

[jira] [Updated] (YARN-8916) Define a constant "docker" string in "ContainerRuntimeConstants.java" for better maintainability

[ https://issues.apache.org/jira/browse/YARN-8916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8916: - Fix Version/s: 3.3.0 > Define a constant "docker" string in "ContainerRuntimeConstants.java" for > better

[jira] [Updated] (YARN-8918) [Submarine] Remove redundant method of str.subString(0, str.length())

[ https://issues.apache.org/jira/browse/YARN-8918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8918: - Fix Version/s: (was: 3.2.1) (was: 3.3.0) (was: 3.1.2) >

[jira] [Updated] (YARN-8918) [Submarine] Remove redundant method of str.subString(0, str.length())

[ https://issues.apache.org/jira/browse/YARN-8918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8918: - Fix Version/s: 3.2.1 3.3.0 3.1.2 > [Submarine] Remove redundant meth

[jira] [Updated] (YARN-8908) Fix errors in yarn-default.xml related to GPU/FPGA

[ https://issues.apache.org/jira/browse/YARN-8908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8908: - Fix Version/s: 3.2.1 3.3.0 3.1.2 > Fix errors in yarn-default.xml re

[jira] [Updated] (YARN-8916) Define a constant "docker" string in "ContainerRuntimeConstants.java" for better maintainability

[ https://issues.apache.org/jira/browse/YARN-8916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8916: - Fix Version/s: (was: 3.2.0) 3.2.1 > Define a constant "docker" string in "Container

[jira] [Commented] (YARN-8916) Define a constant "docker" string in "ContainerRuntimeConstants.java" for better maintainability

[ https://issues.apache.org/jira/browse/YARN-8916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16657057#comment-16657057 ] Wangda Tan commented on YARN-8916: -- +1, thanks [~tangzhankun]. > Define a constant "dock

[jira] [Commented] (YARN-8908) Fix errors in yarn-default.xml related to GPU/FPGA

[ https://issues.apache.org/jira/browse/YARN-8908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16657005#comment-16657005 ] Wangda Tan commented on YARN-8908: -- +1, thanks [~tangzhankun].  > Fix errors in yarn-def

[jira] [Commented] (YARN-8918) [Submarine] Remove redundant method of str.subString(0, str.length())

[ https://issues.apache.org/jira/browse/YARN-8918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16657004#comment-16657004 ] Wangda Tan commented on YARN-8918: -- [~tangzhankun],  I think the correct logic should be

[jira] [Commented] (YARN-6098) Add documentation for Delete Queue

[ https://issues.apache.org/jira/browse/YARN-6098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16655793#comment-16655793 ] Wangda Tan commented on YARN-6098: -- Backported to branch-3.1 as well. > Add documentatio

[jira] [Updated] (YARN-6098) Add documentation for Delete Queue

[ https://issues.apache.org/jira/browse/YARN-6098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-6098: - Fix Version/s: 3.1.2 > Add documentation for Delete Queue > -- > >

[jira] [Commented] (YARN-8896) Limit the maximum number of container assignments per heartbeat

[ https://issues.apache.org/jira/browse/YARN-8896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16655790#comment-16655790 ] Wangda Tan commented on YARN-8896: -- Committed to trunk/branch-3.1/branch-3.2. > Limit th

[jira] [Updated] (YARN-8896) Limit the maximum number of container assignments per heartbeat

[ https://issues.apache.org/jira/browse/YARN-8896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8896: - Fix Version/s: 3.2.1 3.1.2 > Limit the maximum number of container assignments per hear

[jira] [Resolved] (YARN-8896) Limit the maximum number of container assignments per heartbeat

[ https://issues.apache.org/jira/browse/YARN-8896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan resolved YARN-8896. -- Resolution: Fixed > Limit the maximum number of container assignments per heartbeat > --

[jira] [Commented] (YARN-8489) Need to support "dominant" component concept inside YARN service

[ https://issues.apache.org/jira/browse/YARN-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16655670#comment-16655670 ] Wangda Tan commented on YARN-8489: -- [~billie.rinaldi]/[~eyang],  Suggestions make sense

[jira] [Commented] (YARN-8456) Fix a configuration handling bug when user leave FPGA discover executable path configuration default but set OpenCL SDK path environment variable

[ https://issues.apache.org/jira/browse/YARN-8456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16655664#comment-16655664 ] Wangda Tan commented on YARN-8456: -- +1, thanks [~tangzhankun].  > Fix a configuration ha

[jira] [Updated] (YARN-8870) [Submarine] Add submarine installation scripts

[ https://issues.apache.org/jira/browse/YARN-8870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8870: - Fix Version/s: 3.2.0 > [Submarine] Add submarine installation scripts > --

[jira] [Commented] (YARN-8896) Limit the maximum number of container assignments per heartbeat

[ https://issues.apache.org/jira/browse/YARN-8896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16655577#comment-16655577 ] Wangda Tan commented on YARN-8896: -- +1, patch LGTM, thanks [~tangzhankun].  > Limit the

[jira] [Commented] (YARN-8908) Fix errors in yarn-default.xml related to GPU/FPGA

[ https://issues.apache.org/jira/browse/YARN-8908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16655575#comment-16655575 ] Wangda Tan commented on YARN-8908: -- +1, patch LGMT.  Thanks [~tangzhankun]. > Fix error

[jira] [Commented] (YARN-8851) [Umbrella] A new pluggable device plugin framework to ease vendor plugin development

[ https://issues.apache.org/jira/browse/YARN-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16654192#comment-16654192 ] Wangda Tan commented on YARN-8851: -- Thanks [~tangzhankun],  mostly high level comments.  

[jira] [Commented] (YARN-8489) Need to support "dominant" component concept inside YARN service

[ https://issues.apache.org/jira/browse/YARN-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16652717#comment-16652717 ] Wangda Tan commented on YARN-8489: -- [~eyang],  {quote} A safer approach to enable this lo

[jira] [Commented] (YARN-8513) CapacityScheduler infinite loop when queue is near fully utilized

[ https://issues.apache.org/jira/browse/YARN-8513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16652645#comment-16652645 ] Wangda Tan commented on YARN-8513: -- Sounds like a plan, default value set to 100 may make

[jira] [Commented] (YARN-8489) Need to support "dominant" component concept inside YARN service

[ https://issues.apache.org/jira/browse/YARN-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16652606#comment-16652606 ] Wangda Tan commented on YARN-8489: -- [~eyang], let me try to answer your questions:  {quo

[jira] [Updated] (YARN-8892) YARN UI2 doc changes to update security status (verified under security environment)

[ https://issues.apache.org/jira/browse/YARN-8892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8892: - Target Version/s: 3.2.0, 3.1.2 (was: 3.2.0) > YARN UI2 doc changes to update security status (verified un

[jira] [Commented] (YARN-8489) Need to support "dominant" component concept inside YARN service

[ https://issues.apache.org/jira/browse/YARN-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16652453#comment-16652453 ] Wangda Tan commented on YARN-8489: -- [~eyang],  This is bit different from Spark executor

[jira] [Updated] (YARN-8892) YARN UI2 doc changes to update security status (verified under security environment)

[ https://issues.apache.org/jira/browse/YARN-8892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8892: - Summary: YARN UI2 doc changes to update security status (verified under security environment) (was: YARN

[jira] [Commented] (YARN-8892) YARN UI2 doc improvement to update security status

[ https://issues.apache.org/jira/browse/YARN-8892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16652405#comment-16652405 ] Wangda Tan commented on YARN-8892: -- +1, committing, thanks [~sunilg]. > YARN UI2 doc imp

<    1   2   3   4   5   6   7   8   9   10   >