[jira] [Updated] (YARN-8499) ATS v2 should handle connection issues in general for all storages

2019-02-27 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-8499: Attachment: YARN-8499-003.patch > ATS v2 should handle connection issues in general for all storages

[jira] [Commented] (YARN-9224) TimelineDelegationTokenIdentifier.Renewer contacts KDC for every renew/cancel token operation

2019-02-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16780188#comment-16780188 ] Hadoop QA commented on YARN-9224: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-7266) Timeline Server event handler threads locked

2019-02-27 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16780186#comment-16780186 ] Eric Yang commented on YARN-7266: - Volatile keyword means all read/write of the variable m

[jira] [Assigned] (YARN-9224) TimelineDelegationTokenIdentifier.Renewer contacts KDC for every renew/cancel token operation

2019-02-27 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tarun Parimi reassigned YARN-9224: -- Assignee: Tarun Parimi > TimelineDelegationTokenIdentifier.Renewer contacts KDC for every renew

[jira] [Commented] (YARN-9139) Simplify initializer code of GpuDiscoverer

2019-02-27 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16780168#comment-16780168 ] Szilard Nemeth commented on YARN-9139: -- Hi [~sunilg]! It was a conflict resolution is

[jira] [Commented] (YARN-9224) TimelineDelegationTokenIdentifier.Renewer contacts KDC for every renew/cancel token operation

2019-02-27 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16780172#comment-16780172 ] Tarun Parimi commented on YARN-9224: [~rohithsharma], attached a new patch which synch

[jira] [Updated] (YARN-9139) Simplify initializer code of GpuDiscoverer

2019-02-27 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9139: - Attachment: YARN-9139.branch-3.1.004.patch > Simplify initializer code of GpuDiscoverer >

[jira] [Updated] (YARN-9224) TimelineDelegationTokenIdentifier.Renewer contacts KDC for every renew/cancel token operation

2019-02-27 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tarun Parimi updated YARN-9224: --- Attachment: YARN-9224.003.patch > TimelineDelegationTokenIdentifier.Renewer contacts KDC for every ren

[jira] [Commented] (YARN-9332) RackResolver tool should accept multiple hosts

2019-02-27 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16780150#comment-16780150 ] Weiwei Yang commented on YARN-9332: --- Hi [~cltlfcjin] Thanks, that sounds good to me. R

[jira] [Comment Edited] (YARN-9121) Replace GpuDiscoverer.getInstance() to a readable object for easy access control

2019-02-27 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779152#comment-16779152 ] Szilard Nemeth edited comment on YARN-9121 at 2/28/19 6:08 AM: -

[jira] [Commented] (YARN-9334) YARN Service Client does not work with SPNEGO when knox is configured

2019-02-27 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16780134#comment-16780134 ] Eric Yang commented on YARN-9334: - [~billie.rinaldi] No objections. > YARN Service Client

[jira] [Commented] (YARN-7266) Timeline Server event handler threads locked

2019-02-27 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16780132#comment-16780132 ] Prabhu Joseph commented on YARN-7266: - [~eyang] Have one more doubt that this will mak

[jira] [Comment Edited] (YARN-9332) RackResolver tool should accept multiple hosts

2019-02-27 Thread Lantao Jin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16780125#comment-16780125 ] Lantao Jin edited comment on YARN-9332 at 2/28/19 5:39 AM: --- [~ch

[jira] [Commented] (YARN-9332) RackResolver tool should accept multiple hosts

2019-02-27 Thread Lantao Jin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16780125#comment-16780125 ] Lantao Jin commented on YARN-9332: -- [~cheersyang] Yes, Spark has to invoke this method in

[jira] [Commented] (YARN-6487) FairScheduler: remove continuous scheduling (YARN-1010)

2019-02-27 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16780108#comment-16780108 ] Wilfred Spiegelenburg commented on YARN-6487: - The removal of continuous sched

[jira] [Commented] (YARN-9278) Shuffle nodes when selecting to be preempted nodes

2019-02-27 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16780101#comment-16780101 ] Wilfred Spiegelenburg commented on YARN-9278: - Two things: * I still think lim

[jira] [Commented] (YARN-9324) TestSchedulingRequestContainerAllocation(Async) fails with junit-4.11

2019-02-27 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16780099#comment-16780099 ] Prabhu Joseph commented on YARN-9324: - Thanks [~cheersyang]! > TestSchedulingRequestC

[jira] [Commented] (YARN-9323) FSLeafQueue#computeMaxAMResource does not override zero values for custom resources

2019-02-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16780083#comment-16780083 ] Hudson commented on YARN-9323: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #160

[jira] [Commented] (YARN-9323) FSLeafQueue#computeMaxAMResource does not override zero values for custom resources

2019-02-27 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16780077#comment-16780077 ] Szilard Nemeth commented on YARN-9323: -- As mentioned on YARN-9322, I executed the tes

[jira] [Commented] (YARN-9322) Store metrics for custom resource types into FSQueueMetrics and query them in FairSchedulerQueueInfo

2019-02-27 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16780073#comment-16780073 ] Szilard Nemeth commented on YARN-9322: -- Thanks [~templedf] for the commit! Just out o

[jira] [Commented] (YARN-9322) Store metrics for custom resource types into FSQueueMetrics and query them in FairSchedulerQueueInfo

2019-02-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16780070#comment-16780070 ] Hudson commented on YARN-9322: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #160

[jira] [Commented] (YARN-9322) Store metrics for custom resource types into FSQueueMetrics and query them in FairSchedulerQueueInfo

2019-02-27 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16780068#comment-16780068 ] Daniel Templeton commented on YARN-9322: And thanks to [~sunilg] for the review!

[jira] [Commented] (YARN-9322) Store metrics for custom resource types into FSQueueMetrics and query them in FairSchedulerQueueInfo

2019-02-27 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16780059#comment-16780059 ] Daniel Templeton commented on YARN-9322: OK, then. +1 and let's commit. > Store

[jira] [Commented] (YARN-9323) FSLeafQueue#computeMaxAMResource does not override zero values for custom resources

2019-02-27 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16780056#comment-16780056 ] Szilard Nemeth commented on YARN-9323: -- The UT failure is tracked by this jira: http

[jira] [Commented] (YARN-9322) Store metrics for custom resource types into FSQueueMetrics and query them in FairSchedulerQueueInfo

2019-02-27 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16780055#comment-16780055 ] Szilard Nemeth commented on YARN-9322: -- The UT failure is tracked by this jira: http

[jira] [Commented] (YARN-9334) YARN Service Client does not work with SPNEGO when knox is configured

2019-02-27 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16780053#comment-16780053 ] Billie Rinaldi commented on YARN-9334: -- Thanks for the review, [~eyang]! Any objectio

[jira] [Commented] (YARN-9139) Simplify initializer code of GpuDiscoverer

2019-02-27 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16780029#comment-16780029 ] Sunil Govindan commented on YARN-9139: -- Failed test case looks related > Simplify in

[jira] [Commented] (YARN-9324) TestSchedulingRequestContainerAllocation(Async) fails with junit-4.11

2019-02-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16780018#comment-16780018 ] Hudson commented on YARN-9324: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #160

[jira] [Comment Edited] (YARN-9298) Implement FS placement rules using PlacementRule interface

2019-02-27 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779358#comment-16779358 ] Wilfred Spiegelenburg edited comment on YARN-9298 at 2/28/19 2:11 AM: --

[jira] [Commented] (YARN-9326) Fair Scheduler configuration defaults are not documented in case of min and maxResources

2019-02-27 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16780015#comment-16780015 ] Wilfred Spiegelenburg commented on YARN-9326: - Thank you for the updated patch

[jira] [Commented] (YARN-999) In case of long running tasks, reduce node resource should balloon out resource quickly by calling preemption API and suspending running task.

2019-02-27 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16780009#comment-16780009 ] Íñigo Goiri commented on YARN-999: -- [~djp], can you take a look to [^YARN-999.007.patch]?

[jira] [Commented] (YARN-9324) TestSchedulingRequestContainerAllocation(Async) fails with junit-4.11

2019-02-27 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779982#comment-16779982 ] Weiwei Yang commented on YARN-9324: --- LGTM, +1. Committing now > TestSchedulingRequestCo

[jira] [Commented] (YARN-7904) Privileged, trusted containers need all of their bind-mounted directories to be read-only

2019-02-27 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779964#comment-16779964 ] Suma Shivaprasad commented on YARN-7904: Thanks for the patch [~eyang] . Can we al

[jira] [Commented] (YARN-9322) Store metrics for custom resource types into FSQueueMetrics and query them in FairSchedulerQueueInfo

2019-02-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779953#comment-16779953 ] Hadoop QA commented on YARN-9322: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-9323) FSLeafQueue#computeMaxAMResource does not override zero values for custom resources

2019-02-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779940#comment-16779940 ] Hadoop QA commented on YARN-9323: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-9334) YARN Service Client does not work with SPNEGO when knox is configured

2019-02-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779931#comment-16779931 ] Hudson commented on YARN-9334: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #160

[jira] [Commented] (YARN-9139) Simplify initializer code of GpuDiscoverer

2019-02-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779912#comment-16779912 ] Hadoop QA commented on YARN-9139: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-3841) [Storage implementation] Adding retry semantics to HDFS backing storage

2019-02-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779874#comment-16779874 ] Hudson commented on YARN-3841: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #160

[jira] [Commented] (YARN-9334) YARN Service Client does not work with SPNEGO when knox is configured

2019-02-27 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779924#comment-16779924 ] Eric Yang commented on YARN-9334: - Thank you [~billie.rinaldi] for the patch. I committed

[jira] [Commented] (YARN-8218) Add application launch time to ATSV1

2019-02-27 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779894#comment-16779894 ] Vrushali C commented on YARN-8218: -- Thanks Abhishek! Patch 001 LGTM. > Add application

[jira] [Commented] (YARN-9323) FSLeafQueue#computeMaxAMResource does not override zero values for custom resources

2019-02-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779891#comment-16779891 ] Hadoop QA commented on YARN-9323: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-9323) FSLeafQueue#computeMaxAMResource does not override zero values for custom resources

2019-02-27 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779861#comment-16779861 ] Daniel Templeton commented on YARN-9323: Looking at {{FSLeafQueue.computeMaxAMReso

[jira] [Updated] (YARN-3841) [Storage implementation] Adding retry semantics to HDFS backing storage

2019-02-27 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-3841: - Labels: YARN-5355 atsv2 (was: YARN-5355) > [Storage implementation] Adding retry semantics to HDFS backin

[jira] [Commented] (YARN-9150) Making TimelineSchemaCreator support different backends for Timeline Schema Creation in ATSv2

2019-02-27 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779865#comment-16779865 ] Vrushali C commented on YARN-9150: -- Unable to apply patch to branch-2, I have reached out

[jira] [Commented] (YARN-5336) Limit the flow name size & consider cleanup for hex chars

2019-02-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779864#comment-16779864 ] Hudson commented on YARN-5336: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #160

[jira] [Commented] (YARN-9334) YARN Service Client does not work with SPNEGO when knox is configured

2019-02-27 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779859#comment-16779859 ] Eric Yang commented on YARN-9334: - +1 for patch 1. > YARN Service Client does not work wi

[jira] [Commented] (YARN-3841) [Storage implementation] Adding retry semantics to HDFS backing storage

2019-02-27 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779857#comment-16779857 ] Vrushali C commented on YARN-3841: -- Thanks for the patch v009 [~abmodi]! I have committed

[jira] [Comment Edited] (YARN-9323) FSLeafQueue#computeMaxAMResource does not override zero values for custom resources

2019-02-27 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779851#comment-16779851 ] Szilard Nemeth edited comment on YARN-9323 at 2/27/19 10:46 PM:

[jira] [Updated] (YARN-5336) Limit the flow name size & consider cleanup for hex chars

2019-02-27 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-5336: - Labels: YARN-5355 atsv2 (was: YARN-5355) > Limit the flow name size & consider cleanup for hex chars > --

[jira] [Commented] (YARN-9323) FSLeafQueue#computeMaxAMResource does not override zero values for custom resources

2019-02-27 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779851#comment-16779851 ] Szilard Nemeth commented on YARN-9323: -- Hi [~templedf]! I added patch005, this only c

[jira] [Commented] (YARN-5336) Limit the flow name size & consider cleanup for hex chars

2019-02-27 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779848#comment-16779848 ] Vrushali C commented on YARN-5336: -- Thanks for the patch Sushil, I have committed it to t

[jira] [Updated] (YARN-9323) FSLeafQueue#computeMaxAMResource does not override zero values for custom resources

2019-02-27 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9323: - Attachment: YARN-9323.005.patch > FSLeafQueue#computeMaxAMResource does not override zero values f

[jira] [Updated] (YARN-9323) FSLeafQueue#computeMaxAMResource does not override zero values for custom resources

2019-02-27 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9323: - Attachment: YARN-9323.005.patch > FSLeafQueue#computeMaxAMResource does not override zero values f

[jira] [Updated] (YARN-9323) FSLeafQueue#computeMaxAMResource does not override zero values for custom resources

2019-02-27 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9323: - Attachment: (was: YARN-9323.005.patch) > FSLeafQueue#computeMaxAMResource does not override ze

[jira] [Commented] (YARN-9322) Store metrics for custom resource types into FSQueueMetrics and query them in FairSchedulerQueueInfo

2019-02-27 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779831#comment-16779831 ] Szilard Nemeth commented on YARN-9322: -- Thanks! This is a good idea, will file the fo

[jira] [Commented] (YARN-8805) Automatically convert the launch command to the exec form when using entrypoint support

2019-02-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779822#comment-16779822 ] Hadoop QA commented on YARN-8805: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (YARN-9322) Store metrics for custom resource types into FSQueueMetrics and query them in FairSchedulerQueueInfo

2019-02-27 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779827#comment-16779827 ] Daniel Templeton commented on YARN-9322: OK, +1 from me.  Please file a follow-up

[jira] [Commented] (YARN-9150) Making TimelineSchemaCreator support different backends for Timeline Schema Creation in ATSv2

2019-02-27 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779819#comment-16779819 ] Vrushali C commented on YARN-9150: -- Thanks for the patch Sushil! I think the ASF license

[jira] [Updated] (YARN-9139) Simplify initializer code of GpuDiscoverer

2019-02-27 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9139: - Attachment: YARN-9139.branch-3.1.003.patch > Simplify initializer code of GpuDiscoverer >

[jira] [Commented] (YARN-9139) Simplify initializer code of GpuDiscoverer

2019-02-27 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779812#comment-16779812 ] Szilard Nemeth commented on YARN-9139: -- Trunk and Branch-3.2 are green. Added 003 pa

[jira] [Commented] (YARN-9139) Simplify initializer code of GpuDiscoverer

2019-02-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779811#comment-16779811 ] Hadoop QA commented on YARN-9139: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (YARN-9139) Simplify initializer code of GpuDiscoverer

2019-02-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779796#comment-16779796 ] Hadoop QA commented on YARN-9139: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (YARN-9139) Simplify initializer code of GpuDiscoverer

2019-02-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779797#comment-16779797 ] Hadoop QA commented on YARN-9139: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-9323) FSLeafQueue#computeMaxAMResource does not override zero values for custom resources

2019-02-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779772#comment-16779772 ] Hadoop QA commented on YARN-9323: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (YARN-8805) Automatically convert the launch command to the exec form when using entrypoint support

2019-02-27 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8805: Attachment: YARN-8805.005.patch > Automatically convert the launch command to the exec form when using > en

[jira] [Commented] (YARN-9273) Flexing a component of YARN service does not work as documented when using relative number

2019-02-27 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779744#comment-16779744 ] Chandni Singh commented on YARN-9273: - [~masatana] Thanks for reporting this bug and w

[jira] [Commented] (YARN-8805) Automatically convert the launch command to the exec form when using entrypoint support

2019-02-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779748#comment-16779748 ] Hadoop QA commented on YARN-8805: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (YARN-9139) Simplify initializer code of GpuDiscoverer

2019-02-27 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9139: - Attachment: YARN-9139.branch-3.1.002.patch > Simplify initializer code of GpuDiscoverer >

[jira] [Commented] (YARN-9245) Add support for Docker Images command

2019-02-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779737#comment-16779737 ] Hudson commented on YARN-9245: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #160

[jira] [Commented] (YARN-9139) Simplify initializer code of GpuDiscoverer

2019-02-27 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779734#comment-16779734 ] Szilard Nemeth commented on YARN-9139: -- Hi [~sunilg]! Added new patches for branch-3.

[jira] [Commented] (YARN-9139) Simplify initializer code of GpuDiscoverer

2019-02-27 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779722#comment-16779722 ] Szilard Nemeth commented on YARN-9139: -- Added patch008 to fix the checkstyle issues (

[jira] [Updated] (YARN-9139) Simplify initializer code of GpuDiscoverer

2019-02-27 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9139: - Attachment: YARN-9139.branch-3.2.002.patch > Simplify initializer code of GpuDiscoverer >

[jira] [Commented] (YARN-9323) FSLeafQueue#computeMaxAMResource does not override zero values for custom resources

2019-02-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779713#comment-16779713 ] Hadoop QA commented on YARN-9323: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (YARN-9245) Add support for Docker Images command

2019-02-27 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779726#comment-16779726 ] Chandni Singh commented on YARN-9245: - Thanks [~eyang] > Add support for Docker Image

[jira] [Updated] (YARN-9139) Simplify initializer code of GpuDiscoverer

2019-02-27 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9139: - Attachment: YARN-9139.008.patch > Simplify initializer code of GpuDiscoverer > ---

[jira] [Commented] (YARN-9273) Flexing a component of YARN service does not work as documented when using relative number

2019-02-27 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779714#comment-16779714 ] Eric Yang commented on YARN-9273: - [~masatana] Patch 004 looks good with two minor nitpick

[jira] [Updated] (YARN-8805) Automatically convert the launch command to the exec form when using entrypoint support

2019-02-27 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8805: Attachment: YARN-8805.004.patch > Automatically convert the launch command to the exec form when using > en

[jira] [Comment Edited] (YARN-8805) Automatically convert the launch command to the exec form when using entrypoint support

2019-02-27 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779693#comment-16779693 ] Eric Yang edited comment on YARN-8805 at 2/27/19 7:36 PM: -- Patch

[jira] [Commented] (YARN-8805) Automatically convert the launch command to the exec form when using entrypoint support

2019-02-27 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779693#comment-16779693 ] Eric Yang commented on YARN-8805: - Patch 004 resolves: * Multiple spaces * Allow spaces in

[jira] [Commented] (YARN-9324) TestSchedulingRequestContainerAllocation(Async) fails with junit-4.11

2019-02-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779691#comment-16779691 ] Hadoop QA commented on YARN-9324: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (YARN-9330) Add support to query scheduler endpoint filtered via queue (/scheduler/queue=abc)

2019-02-27 Thread Prashant Golash (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779675#comment-16779675 ] Prashant Golash commented on YARN-9330: --- |hadoop.yarn.server.resourcemanager.schedul

[jira] [Commented] (YARN-9322) Store metrics for custom resource types into FSQueueMetrics and query them in FairSchedulerQueueInfo

2019-02-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779664#comment-16779664 ] Hadoop QA commented on YARN-9322: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (YARN-9323) FSLeafQueue#computeMaxAMResource does not override zero values for custom resources

2019-02-27 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779646#comment-16779646 ] Szilard Nemeth commented on YARN-9323: -- Rebased again to trunk and keeping as close a

[jira] [Updated] (YARN-9323) FSLeafQueue#computeMaxAMResource does not override zero values for custom resources

2019-02-27 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9323: - Attachment: YARN-9323.004.patch > FSLeafQueue#computeMaxAMResource does not override zero values f

[jira] [Commented] (YARN-9318) Resources#multiplyAndRoundUp does not consider Resource Types

2019-02-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779635#comment-16779635 ] Hudson commented on YARN-9318: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #160

[jira] [Commented] (YARN-9322) Store metrics for custom resource types into FSQueueMetrics and query them in FairSchedulerQueueInfo

2019-02-27 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779641#comment-16779641 ] Szilard Nemeth commented on YARN-9322: -- Hi [~templedf]! Patch006 is rebased to trunk.

[jira] [Updated] (YARN-9322) Store metrics for custom resource types into FSQueueMetrics and query them in FairSchedulerQueueInfo

2019-02-27 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9322: - Attachment: YARN-9322.006.patch > Store metrics for custom resource types into FSQueueMetrics and

[jira] [Commented] (YARN-9318) Resources#multiplyAndRoundUp does not consider Resource Types

2019-02-27 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779621#comment-16779621 ] Szilard Nemeth commented on YARN-9318: -- Thanks [~templedf]! Sorry about the colons!

[jira] [Commented] (YARN-7266) Timeline Server event handler threads locked

2019-02-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779607#comment-16779607 ] Hadoop QA commented on YARN-7266: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (YARN-9322) Store metrics for custom resource types into FSQueueMetrics and query them in FairSchedulerQueueInfo

2019-02-27 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779614#comment-16779614 ] Daniel Templeton commented on YARN-9322: YARN-9318 is in, so let's rebase this and

[jira] [Commented] (YARN-9334) YARN Service Client does not work with SPNEGO when knox is configured

2019-02-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779611#comment-16779611 ] Hadoop QA commented on YARN-9334: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-7266) Timeline Server event handler threads locked

2019-02-27 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779609#comment-16779609 ] Eric Yang commented on YARN-7266: - Without using volatile , the code can be revised to: {

[jira] [Commented] (YARN-9139) Simplify initializer code of GpuDiscoverer

2019-02-27 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779594#comment-16779594 ] Sunil Govindan commented on YARN-9139: -- [~snemeth] pls rebase this patch if necessary

[jira] [Commented] (YARN-9318) Resources#multiplyAndRoundUp does not consider Resource Types

2019-02-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779591#comment-16779591 ] Hadoop QA commented on YARN-9318: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-8499) ATS v2 should handle connection issues in general for all storages

2019-02-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779584#comment-16779584 ] Hadoop QA commented on YARN-8499: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-9318) Resources#multiplyAndRoundUp does not consider Resource Types

2019-02-27 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779582#comment-16779582 ] Daniel Templeton commented on YARN-9318: The @param tag shouldn't have a colon aft

[jira] [Commented] (YARN-9326) Fair Scheduler configuration defaults are not documented in case of min and maxResources

2019-02-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779573#comment-16779573 ] Hadoop QA commented on YARN-9326: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (YARN-9334) YARN Service Client does not work with SPNEGO when knox is configured

2019-02-27 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi updated YARN-9334: - Attachment: YARN-9334.01.patch > YARN Service Client does not work with SPNEGO when knox is config

[jira] [Assigned] (YARN-9334) YARN Service Client does not work with SPNEGO when knox is configured

2019-02-27 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi reassigned YARN-9334: Assignee: Billie Rinaldi > YARN Service Client does not work with SPNEGO when knox is confi

[jira] [Commented] (YARN-9318) Resources#multiplyAndRoundUp does not consider Resource Types

2019-02-27 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779539#comment-16779539 ] Szilard Nemeth commented on YARN-9318: -- Updated the patch with javadocs. Please check

  1   2   >