[jira] [Resolved] (YARN-8756) [Submarine] Properly handle relative path for staging area

2018-11-06 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan resolved YARN-8756. -- Resolution: Duplicate > [Submarine] Properly handle relative path for staging area >

[jira] [Updated] (YARN-8108) RM metrics rest API throws GSSException in kerberized environment

2018-11-05 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-8108: - Fix Version/s: 3.3.0 3.1.2 3.2.0 > RM metrics rest API

[jira] [Commented] (YARN-8108) RM metrics rest API throws GSSException in kerberized environment

2018-11-05 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16676227#comment-16676227 ] Sunil Govindan commented on YARN-8108: -- Updated Fixed Versions. [~eyang] cud u pls confirm whether

[jira] [Updated] (YARN-8809) Refactor AbstractYarnScheduler and CapacityScheduler OPPORTUNISTIC container completion codepaths

2018-11-06 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-8809: - Fix Version/s: YARN-1011 > Refactor AbstractYarnScheduler and CapacityScheduler OPPORTUNISTIC

[jira] [Commented] (YARN-8809) Refactor AbstractYarnScheduler and CapacityScheduler OPPORTUNISTIC container completion codepaths

2018-11-06 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16676349#comment-16676349 ] Sunil Govindan commented on YARN-8809: -- Updated to  Fixed version to 

[jira] [Reopened] (YARN-8718) Merge related work for YARN-3409

2018-11-06 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan reopened YARN-8718: -- reopening to close correctly  > Merge related work for YARN-3409 >

[jira] [Reopened] (YARN-8756) [Submarine] Properly handle relative path for staging area

2018-11-06 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan reopened YARN-8756: -- Opening to mark as dup of YARN-8757 > [Submarine] Properly handle relative path for staging area >

[jira] [Resolved] (YARN-8718) Merge related work for YARN-3409

2018-11-06 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan resolved YARN-8718. -- Resolution: Information Provided > Merge related work for YARN-3409 >

[jira] [Commented] (YARN-8226) Improve anti-affinity section description in YARN Service API doc

2018-11-06 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16676743#comment-16676743 ] Sunil Govindan commented on YARN-8226: -- Updated Fixed version. [~eyang] pls help to check whether

[jira] [Updated] (YARN-8226) Improve anti-affinity section description in YARN Service API doc

2018-11-06 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-8226: - Fix Version/s: 3.3.0 3.1.2 3.2.0 > Improve anti-affinity

[jira] [Updated] (YARN-8035) Uncaught exception in ContainersMonitorImpl during relaunch due to the process ID changing

2018-11-06 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-8035: - Fix Version/s: 3.3.0 3.2.0 > Uncaught exception in ContainersMonitorImpl

[jira] [Commented] (YARN-8960) [Submarine] Can't get submarine service status using the command of "yarn app -status" under security environment

2018-11-06 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16676781#comment-16676781 ] Sunil Govindan commented on YARN-8960: -- Approach looks fine to me. If there are no objections, i can

[jira] [Commented] (YARN-8953) Add CSI driver adaptor module

2018-11-14 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16687561#comment-16687561 ] Sunil Govindan commented on YARN-8953: -- Hi [~cheersyang] Thanks for working on this patch. Few

[jira] [Assigned] (YARN-8953) Add CSI driver adaptor module

2018-11-14 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan reassigned YARN-8953: Assignee: Weiwei Yang (was: Sunil Govindan) > Add CSI driver adaptor module >

[jira] [Assigned] (YARN-8953) Add CSI driver adaptor module

2018-11-14 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan reassigned YARN-8953: Assignee: Sunil Govindan (was: Weiwei Yang) > Add CSI driver adaptor module >

[jira] [Commented] (YARN-8881) Phase 1 - Add basic pluggable device plugin framework

2018-11-15 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16687619#comment-16687619 ] Sunil Govindan commented on YARN-8881: -- Thanks [~tangzhankun]  Few more minor comments # In Device

[jira] [Commented] (YARN-8902) Add volume manager that manages CSI volume lifecycle

2018-11-08 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680952#comment-16680952 ] Sunil Govindan commented on YARN-8902: -- Few more comments 5. {code:java} try {

[jira] [Commented] (YARN-8902) Add volume manager that manages CSI volume lifecycle

2018-11-09 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16681349#comment-16681349 ] Sunil Govindan commented on YARN-8902: -- Hi [~cheersyang] Thanks for the patch. We are almost there.

[jira] [Commented] (YARN-8990) Fix fair scheduler race condition in app submit and queue cleanup

2018-11-09 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16681750#comment-16681750 ] Sunil Govindan commented on YARN-8990: -- Back ported to 3.2.0 Re spinning RC with this. Thanks

[jira] [Updated] (YARN-8990) Fix fair scheduler race condition in app submit and queue cleanup

2018-11-09 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-8990: - Fix Version/s: 3.2.0 > Fix fair scheduler race condition in app submit and queue cleanup >

[jira] [Updated] (YARN-7957) [UI2] YARN service delete option disappears after stopping application

2018-10-05 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-7957: - Summary: [UI2] YARN service delete option disappears after stopping application (was: [UI2] Yarn

[jira] [Updated] (YARN-8797) [UI2] Improve error pages in new YARN UI

2018-10-05 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-8797: - Summary: [UI2] Improve error pages in new YARN UI (was: [UI2] Fix YARN UI2 error pages) > [UI2]

[jira] [Commented] (YARN-7957) [UI2] YARN service delete option disappears after stopping application

2018-10-05 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16639482#comment-16639482 ] Sunil Govindan commented on YARN-7957: -- There was a n/w issue cause some pblm in 3.1 commit. hence i

[jira] [Commented] (YARN-7957) [UI2] Yarn service delete option disappears after stopping application

2018-10-05 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16639335#comment-16639335 ] Sunil Govindan commented on YARN-7957: --  +1. Committing shortly. > [UI2] Yarn service delete option

[jira] [Commented] (YARN-8797) [UI2] Fix YARN UI2 error pages

2018-10-05 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16639493#comment-16639493 ] Sunil Govindan commented on YARN-8797: -- Patch looks straight forward. Committing shortly. > [UI2]

[jira] [Commented] (YARN-8843) updateNodeResource does not support units for memory

2018-10-05 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16639614#comment-16639614 ] Sunil Govindan commented on YARN-8843: -- updateNodeResource api is not handling this resource

[jira] [Commented] (YARN-8830) SLS tool not working in trunk

2018-10-09 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16642932#comment-16642932 ] Sunil Govindan commented on YARN-8830: -- Thanks [~bibinchundatt]. Cud u pls help to do a dry run of

[jira] [Commented] (YARN-8853) Application Attempts tab not shown correctly when there are no attempts

2018-10-09 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16643595#comment-16643595 ] Sunil Govindan commented on YARN-8853: -- Straight forward patch. Getting in shortly. > Application

[jira] [Updated] (YARN-8853) [UI2] Application Attempts tab is not shown correctly when there are no attempts

2018-10-09 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-8853: - Summary: [UI2] Application Attempts tab is not shown correctly when there are no attempts (was:

[jira] [Updated] (YARN-8800) Updated documentation of Submarine with latest examples.

2018-09-28 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-8800: - Attachment: YARN-8800.006.patch > Updated documentation of Submarine with latest examples. >

[jira] [Commented] (YARN-8759) Copy of "resource-types.xml" is not deleted if test fails, causes other test failures

2018-09-28 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16631664#comment-16631664 ] Sunil Govindan commented on YARN-8759: -- Thanks [~bsteinbach]. Patch seems fine to me. No other

[jira] [Commented] (YARN-8800) Updated documentation of Submarine with latest examples.

2018-09-28 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16631642#comment-16631642 ] Sunil Govindan commented on YARN-8800: -- [~leftnoteasy] [~rohithsharma] pls check once. If its ok, i

[jira] [Updated] (YARN-8800) Updated documentation of Submarine with latest examples.

2018-09-28 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-8800: - Attachment: Screen Shot 2018-09-28 at 3.17.44 PM.png > Updated documentation of Submarine with

[jira] [Commented] (YARN-8800) Updated documentation of Submarine with latest examples.

2018-09-28 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16631632#comment-16631632 ] Sunil Govindan commented on YARN-8800: -- Hi [~leftnoteasy] Me and Rohith found a way to change image

[jira] [Updated] (YARN-8869) YARN client might not work correctly with RM Rest API for Kerberos authentication

2018-10-10 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-8869: - Priority: Blocker (was: Major) > YARN client might not work correctly with RM Rest API for

[jira] [Commented] (YARN-8468) Enable the use of queue based maximum container allocation limit and implement it in FairScheduler

2018-10-11 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16646045#comment-16646045 ] Sunil Govindan commented on YARN-8468: -- Tests timing out seems to be pblm. I ll try dig more. >

[jira] [Commented] (YARN-8869) YARN client might not work correctly with RM Rest API for Kerberos authentication

2018-10-11 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16646107#comment-16646107 ] Sunil Govindan commented on YARN-8869: -- Hi [~eyang] Change looks fine to me. However any way to

[jira] [Commented] (YARN-8868) Set HTTPOnly attribute to Cookie

2018-10-11 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16646116#comment-16646116 ] Sunil Govindan commented on YARN-8868: -- Thanks [~csingh]. Patch looks fine. Could you please check

[jira] [Commented] (YARN-8836) Add tags and attributes in resource definition

2018-10-11 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16646140#comment-16646140 ] Sunil Govindan commented on YARN-8836: -- Thanks [~cheersyang] for the patch. Few comments: # In

[jira] [Commented] (YARN-8836) Add tags and attributes in resource definition

2018-10-11 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16646141#comment-16646141 ] Sunil Govindan commented on YARN-8836: -- And another major point. This Jira is unrelated to CSI and

[jira] [Commented] (YARN-8666) [UI2] Remove application tab from Yarn Queue Page

2018-10-11 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16646144#comment-16646144 ] Sunil Govindan commented on YARN-8666: -- Looks good to me as well. Committing shortly. > [UI2] Remove

[jira] [Updated] (YARN-8666) [UI2] Remove application tab from YARN Queue Page

2018-10-11 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-8666: - Summary: [UI2] Remove application tab from YARN Queue Page (was: [UI2] Remove application tab

[jira] [Commented] (YARN-8870) Add submarine installation scripts

2018-10-11 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16646262#comment-16646262 ] Sunil Govindan commented on YARN-8870: -- Thanks [~liuxun323]. Really appreciate the effort. If its

[jira] [Commented] (YARN-8843) updateNodeResource does not support units for memory

2018-10-04 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16638329#comment-16638329 ] Sunil Govindan commented on YARN-8843: -- [~elgoiri] is this change needed? Internally while we use

[jira] [Commented] (YARN-8843) updateNodeResource does not support units for memory

2018-10-04 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16638350#comment-16638350 ] Sunil Govindan commented on YARN-8843: -- Thanks. As per my understanding, this should ideally not

[jira] [Commented] (YARN-8830) SLS tool not working in trunk

2018-09-28 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16632765#comment-16632765 ] Sunil Govindan commented on YARN-8830: -- Thanks [~bibinchundatt] Few comments. # Checkstyle issues

[jira] [Commented] (YARN-8468) Limit container sizes per queue in FairScheduler

2018-08-30 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16597503#comment-16597503 ] Sunil Govindan commented on YARN-8468: -- Sure. I ll take a look on this today. > Limit container

[jira] [Commented] (YARN-8718) Merge related work for YARN-3409

2018-09-03 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16601814#comment-16601814 ] Sunil Govindan commented on YARN-8718: -- Updating v5 patch from latest of the branch. > Merge related

[jira] [Commented] (YARN-8740) Clear node attribute path after each test run

2018-09-03 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16601812#comment-16601812 ] Sunil Govindan commented on YARN-8740: -- Thanks [~bibinchundatt]. Committed to branch. > Clear node

[jira] [Updated] (YARN-8740) Clear node attribute path after each test run

2018-09-03 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-8740: - Summary: Clear node attribute path after each test run (was: Fix TestRMHA testcase failure) >

[jira] [Commented] (YARN-8740) Fix TestRMHA testcase failure

2018-09-03 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16601806#comment-16601806 ] Sunil Govindan commented on YARN-8740: -- +1. looks good. Committing shortly. > Fix TestRMHA testcase

[jira] [Updated] (YARN-8718) Merge related work for YARN-3409

2018-09-03 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-8718: - Attachment: YARN-8718.005.patch > Merge related work for YARN-3409 >

[jira] [Commented] (YARN-8740) Fix TestRMHA testcase failure

2018-09-02 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16601785#comment-16601785 ] Sunil Govindan commented on YARN-8740: -- Thanks [~bibinchundatt]. v4 patch looks good. Pending

[jira] [Assigned] (YARN-8811) Support Container Storage Interface (CSI) in YARN

2018-09-21 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan reassigned YARN-8811: Assignee: Weiwei Yang > Support Container Storage Interface (CSI) in YARN >

[jira] [Updated] (YARN-8742) [UI2] Container logs on Application / Service pages on UI2 are not available many case, improve error messages in such cases.

2018-09-24 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-8742: - Summary: [UI2] Container logs on Application / Service pages on UI2 are not available many case,

[jira] [Commented] (YARN-8468) Enable the use of queue based maximum container allocation limit and implement it in FairScheduler

2018-09-24 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16625439#comment-16625439 ] Sunil Govindan commented on YARN-8468: -- Given the complexity and the ongoing review, I am deferring

[jira] [Updated] (YARN-8468) Enable the use of queue based maximum container allocation limit and implement it in FairScheduler

2018-09-24 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-8468: - Target Version/s: 3.3.0 (was: 3.2.0) > Enable the use of queue based maximum container

[jira] [Commented] (YARN-8657) User limit calculation should be read-lock-protected within LeafQueue

2018-09-24 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16625443#comment-16625443 ] Sunil Govindan commented on YARN-8657: -- Thanks [~cheersyang]. I will help to rebase this patch. >

[jira] [Commented] (YARN-8804) resourceLimits may be wrongly calculated when leaf-queue is blocked in cluster with 3+ level queues

2018-09-24 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16625441#comment-16625441 ] Sunil Govindan commented on YARN-8804: -- As this is one of the last Critical one for 3.2, [~jlowe] and

[jira] [Commented] (YARN-7957) [UI2] Yarn service delete option disappears after stopping application

2018-09-24 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16625431#comment-16625431 ] Sunil Govindan commented on YARN-7957: -- I think we can rephrase this like below. 1. Show both Stop

[jira] [Updated] (YARN-8657) User limit calculation should be read-lock-protected within LeafQueue

2018-09-24 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-8657: - Attachment: YARN-8657.002.patch > User limit calculation should be read-lock-protected within

[jira] [Commented] (YARN-8815) Both RM in standby after restart(restart failure)

2018-09-24 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16625793#comment-16625793 ] Sunil Govindan commented on YARN-8815: -- Thanks [~Rakesh_Shah] and [~bibinchundatt] I just saw this

[jira] [Commented] (YARN-8657) User limit calculation should be read-lock-protected within LeafQueue

2018-09-24 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16625623#comment-16625623 ] Sunil Govindan commented on YARN-8657: -- [~cheersyang] cud u pls check latest patch > User limit

[jira] [Commented] (YARN-8657) User limit calculation should be read-lock-protected within LeafQueue

2018-09-24 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16625814#comment-16625814 ] Sunil Govindan commented on YARN-8657: -- {code:java} } finally {    readLock.unlock();   }{code} We

[jira] [Updated] (YARN-8817) [Submarine] In cases when user doesn't ask HDFS path while submitting job but framework requires user to set HDFS related environments

2018-09-24 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-8817: - Summary: [Submarine] In cases when user doesn't ask HDFS path while submitting job but framework

[jira] [Commented] (YARN-8817) [Submarine] In some cases HDFS is not asked by user when submit job but framework requires user to set HDFS related environments

2018-09-24 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626694#comment-16626694 ] Sunil Govindan commented on YARN-8817: -- Thanks [~leftnoteasy]. Fix looks straight forward.

[jira] [Updated] (YARN-8657) User limit calculation should be read-lock-protected within LeafQueue

2018-09-25 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-8657: - Target Version/s: 3.1.2, 3.2.1 (was: 3.2.0, 3.1.2) > User limit calculation should be

[jira] [Commented] (YARN-5939) FSDownload leaks FileSystem resources

2018-09-25 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626984#comment-16626984 ] Sunil Govindan commented on YARN-5939: -- Thanks. Latest patch seems fine to me. [~cheersyang]

[jira] [Commented] (YARN-5939) FSDownload leaks FileSystem resources

2018-09-25 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16628195#comment-16628195 ] Sunil Govindan commented on YARN-5939: -- Committing shorty. Thank you > FSDownload leaks FileSystem

[jira] [Commented] (YARN-8757) [Submarine] Add Tensorboard component when --tensorboard is specified

2018-09-19 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16620833#comment-16620833 ] Sunil Govindan commented on YARN-8757: -- +1. Looks good to me. Committing shortly if no objections.

[jira] [Commented] (YARN-8769) [Submarine] Allow user to specify customized quicklink(s) when submit Submarine job

2018-09-19 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16620839#comment-16620839 ] Sunil Govindan commented on YARN-8769: -- This patch doesnt apply posy YARN-8757. [~leftnoteasy] could

[jira] [Commented] (YARN-8769) [Submarine] Allow user to specify customized quicklink(s) when submit Submarine job

2018-09-20 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622108#comment-16622108 ] Sunil Govindan commented on YARN-8769: -- +1. Committing shortly. > [Submarine] Allow user to specify

[jira] [Commented] (YARN-8800) Updated documentation of Submarine with latest examples.

2018-09-20 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622110#comment-16622110 ] Sunil Govindan commented on YARN-8800: -- Hi [~leftnoteasy] Cud u pls help in this ticket as its

[jira] [Commented] (YARN-8829) Cluster metrics can fail with IndexOutOfBound Exception

2018-09-27 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16630209#comment-16630209 ] Sunil Govindan commented on YARN-8829: -- [~akki261001] In which case "no sub clusters are available

[jira] [Comment Edited] (YARN-8800) Updated documentation of Submarine with latest examples.

2018-09-27 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16630553#comment-16630553 ] Sunil Govindan edited comment on YARN-8800 at 9/27/18 2:52 PM: --- Yes. I was

[jira] [Commented] (YARN-8800) Updated documentation of Submarine with latest examples.

2018-09-27 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16630553#comment-16630553 ] Sunil Govindan commented on YARN-8800: -- Yes. I was also seeing that. Images were not coming.

[jira] [Commented] (YARN-8800) Updated documentation of Submarine with latest examples.

2018-09-25 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16627712#comment-16627712 ] Sunil Govindan commented on YARN-8800: -- Thanks [~leftnoteasy]. Tested locally using {{mvn clean site

[jira] [Commented] (YARN-8953) Add CSI driver adaptor module

2018-11-16 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16689707#comment-16689707 ] Sunil Govindan commented on YARN-8953: -- +1 > Add CSI driver adaptor module >

[jira] [Commented] (YARN-8953) Add CSI driver adaptor module

2018-11-16 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16689710#comment-16689710 ] Sunil Govindan commented on YARN-8953: -- I ll commit tomorrow if no objections > Add CSI driver

[jira] [Commented] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-01-02 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16732594#comment-16732594 ] Sunil Govindan commented on YARN-9161: -- Yes [~leftnoteasy]. By design, there are no such limits. It

[jira] [Commented] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-01-03 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16732780#comment-16732780 ] Sunil Govindan commented on YARN-9161: -- Thanks [~yuan_zac] If we could add a new test case in any of

[jira] [Commented] (YARN-9038) [CSI] Add ability to publish/unpublish volumes on node managers

2019-01-03 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16732792#comment-16732792 ] Sunil Govindan commented on YARN-9038: -- Latest patch seems ok to me. [~cheersyang] cud u pls

[jira] [Updated] (YARN-8193) YARN RM hangs abruptly (stops allocating resources) when running successive applications.

2019-01-16 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-8193: - Fix Version/s: (was: 3.2.1) 3.2.0 > YARN RM hangs abruptly (stops

[jira] [Updated] (YARN-8193) YARN RM hangs abruptly (stops allocating resources) when running successive applications.

2019-01-16 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-8193: - Fix Version/s: (was: 3.2.0) 3.2.1 > YARN RM hangs abruptly (stops

[jira] [Commented] (YARN-9190) [Submarine] Submarine job will fail to run as a first job on a new created Hadoop 3.2.0 RC1 cluster

2019-01-15 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16743244#comment-16743244 ] Sunil Govindan commented on YARN-9190: -- [~leftnoteasy] could you please help in this. Thanks.   >

[jira] [Commented] (YARN-9190) [Submarine] Submarine job will fail to run as a first job on a new created Hadoop 3.2.0 RC1 cluster

2019-01-15 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16743243#comment-16743243 ] Sunil Govindan commented on YARN-9190: -- Hi [~tangzhankun] Is there any work around for this problem

[jira] [Commented] (YARN-9205) When using custom resource type, application will fail to run due to the CapacityScheduler throws InvalidResourceRequestException(GREATER_THEN_MAX_ALLOCATION)

2019-01-21 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16748429#comment-16748429 ] Sunil Govindan commented on YARN-9205: -- Looks good to me v5. Waiting for jenkins. [~cheersyang] cud

[jira] [Commented] (YARN-9205) When using custom resource type, application will fail to run due to the CapacityScheduler throws InvalidResourceRequestException(GREATER_THEN_MAX_ALLOCATION)

2019-01-22 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16748683#comment-16748683 ] Sunil Govindan commented on YARN-9205: -- Hi [~cheersyang] [~tangzhankun] This latest change caused

[jira] [Commented] (YARN-8961) [UI2] Flow Run End Time shows 'Invalid date'

2019-01-23 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16749638#comment-16749638 ] Sunil Govindan commented on YARN-8961: -- Path looks good to me. Kicking jenkins again. > [UI2] Flow

[jira] [Commented] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-01-22 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16749502#comment-16749502 ] Sunil Govindan commented on YARN-9161: -- Hi [~yuan_zac], post YARN-9205, will there be any impacts for

[jira] [Commented] (YARN-9206) RMServerUtils does not count SHUTDOWN as an accepted state

2019-01-22 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16749507#comment-16749507 ] Sunil Govindan commented on YARN-9206: -- Thanks [~kshukla] I am kind of more leaning towards v2 patch

[jira] [Commented] (YARN-6695) Race condition in RM for publishing container events vs appFinished events causes NPE

2019-01-22 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16749506#comment-16749506 ] Sunil Govindan commented on YARN-6695: -- [~rohithsharma] I think we need to check on documentation as

[jira] [Commented] (YARN-9205) When using custom resource type, application will fail to run due to the CapacityScheduler throws InvalidResourceRequestException(GREATER_THEN_MAX_ALLOCATION)

2019-01-22 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16749505#comment-16749505 ] Sunil Govindan commented on YARN-9205: -- [~tangzhankun] I can see a lot of failure for v8 patch

[jira] [Commented] (YARN-9205) When using custom resource type, application will fail to run due to the CapacityScheduler throws InvalidResourceRequestException(GREATER_THEN_MAX_ALLOCATION)

2019-01-22 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16749546#comment-16749546 ] Sunil Govindan commented on YARN-9205: -- Yes. This seems good now.  [~cheersyang] cud you please

[jira] [Commented] (YARN-9206) RMServerUtils does not count SHUTDOWN as an accepted state

2019-01-22 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16749358#comment-16749358 ] Sunil Govindan commented on YARN-9206: -- Hi [~kshukla] Thanks for the patch. I think we could think

[jira] [Commented] (YARN-9125) Carriage Return character in launch command cause node manager to become unhealthy

2018-12-17 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16723627#comment-16723627 ] Sunil Govindan commented on YARN-9125: -- Thanks [~eyang]. I ll pull this to 3.2.0. Is it needed in

[jira] [Comment Edited] (YARN-9038) [CSI] Add ability to publish/unpublish volumes on node managers

2018-12-17 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16723696#comment-16723696 ] Sunil Govindan edited comment on YARN-9038 at 12/18/18 5:01 AM: Thanks

[jira] [Commented] (YARN-9038) [CSI] Add ability to publish/unpublish volumes on node managers

2018-12-17 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16723696#comment-16723696 ] Sunil Govindan commented on YARN-9038: -- Thanks [~cheersyang] Few comments: # Could u pls add

[jira] [Commented] (YARN-9090) [Submarine] Adjust the submarine installation script document

2018-12-18 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16723932#comment-16723932 ] Sunil Govindan commented on YARN-9090: -- Thanks for the refactoring. If there are no objections, then

[jira] [Commented] (YARN-9038) [CSI] Add ability to publish/unpublish volumes on node managers

2018-12-21 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16726610#comment-16726610 ] Sunil Govindan commented on YARN-9038: -- Thanks [~cheersyang]. Some more comments # In

<    1   2   3   4   5   6   7   8   9   10   >