[jira] [Updated] (YARN-7394) Merge code paths for Reservation/Plan queues and Auto Created queues

2017-10-31 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-7394: --- Attachment: YARN-7394.8.patch Rebased with trunk > Merge code paths for Reservation/Plan queue

[jira] [Commented] (YARN-7394) Merge code paths for Reservation/Plan queues and Auto Created queues

2017-10-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16233677#comment-16233677 ] Hadoop QA commented on YARN-7394: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-6128) Add support for AMRMProxy HA

2017-10-31 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-6128: --- Attachment: YARN-6128.v1.patch > Add support for AMRMProxy HA > > >

[jira] [Updated] (YARN-7394) Merge code paths for Reservation/Plan queues and Auto Created queues

2017-10-31 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-7394: --- Attachment: YARN-7394.7.patch Fixed checkstyle issues > Merge code paths for Reservation/Plan

[jira] [Updated] (YARN-6507) Add support in NodeManager to isolate FPGA devices with CGroups

2017-10-31 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-6507: --- Attachment: YARN-6507-trunk.003.patch > Add support in NodeManager to isolate FPGA devices with CGroups

[jira] [Commented] (YARN-6394) Support specifying YARN related params in the service REST API

2017-10-31 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227808#comment-16227808 ] Jian He commented on YARN-6394: --- Thanks Billie for the review. as discussed, removed ENV typ

[jira] [Updated] (YARN-6394) Support specifying YARN related params in the service REST API

2017-10-31 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-6394: -- Attachment: YARN-6394.yarn-native-services.04.patch > Support specifying YARN related params in the service REST

[jira] [Commented] (YARN-6387) Provide a flag in Rest API GET response to notify if the app launch delay is due to docker image download.

2017-10-31 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227789#comment-16227789 ] Eric Yang commented on YARN-6387: - Do we still need this? There is no description. The cu

[jira] [Commented] (YARN-6187) Auto-generate REST API resources and server side stubs from swagger definition

2017-10-31 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227785#comment-16227785 ] Eric Yang commented on YARN-6187: - [~gsaha] Swagger is good for generating initial classes

[jira] [Commented] (YARN-6940) FairScheduler: Enable Container update CodePaths and container resize testcase

2017-10-31 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227756#comment-16227756 ] Haibo Chen commented on YARN-6940: -- Never mind. Talked with [~rkanter] offline. This is th

[jira] [Resolved] (YARN-7218) ApiServer REST API naming convention /ws/v1 is already used in Hadoop v2

2017-10-31 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang resolved YARN-7218. - Resolution: Won't Fix It looks like v1 of YARN rest api is still evolving. The name space used by service

[jira] [Commented] (YARN-7146) Many RM unit tests failing with FairScheduler

2017-10-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227754#comment-16227754 ] Hadoop QA commented on YARN-7146: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-7330) Add support to show GPU on UI/metrics

2017-10-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227751#comment-16227751 ] Hadoop QA commented on YARN-7330: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-7197) Add support for a volume blacklist for docker containers

2017-10-31 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7197: Attachment: YARN-7197.003.patch [~jlowe], [~ebadger], [~shaneku...@gmail.com] Thank you for the review. I i

[jira] [Commented] (YARN-6940) FairScheduler: Enable Container update CodePaths and container resize testcase

2017-10-31 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227721#comment-16227721 ] Haibo Chen commented on YARN-6940: -- Do we mean the warning message? I changed the relaxLoc

[jira] [Commented] (YARN-6413) FileSystem based Yarn Registry implementation

2017-10-31 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227702#comment-16227702 ] Botong Huang commented on YARN-6413: I will add the registry configuration in YARN-6128

[jira] [Commented] (YARN-6128) Add support for AMRMProxy HA

2017-10-31 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227701#comment-16227701 ] Botong Huang commented on YARN-6128: Following up on [~subru]'s suggestion in https://

[jira] [Commented] (YARN-7403) Compute global and local preemption

2017-10-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227697#comment-16227697 ] Hadoop QA commented on YARN-7403: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-7240) Add more states and transitions to stabilize the NM Container state machine

2017-10-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227662#comment-16227662 ] Andrew Wang commented on YARN-7240: --- Woops, my bad. I had the wrong base revision in my v

[jira] [Commented] (YARN-7411) Inter-Queue preemption's computeFixpointAllocation need to handle absolute resources while computing normalizedGuarantee

2017-10-31 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227652#comment-16227652 ] Wangda Tan commented on YARN-7411: -- Thanks [~sunilg] for working on this, approach looks g

[jira] [Commented] (YARN-7240) Add more states and transitions to stabilize the NM Container state machine

2017-10-31 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227648#comment-16227648 ] Arun Suresh commented on YARN-7240: --- [~andrew.wang], looks like I had already cherry-pick

[jira] [Updated] (YARN-7410) Cleanup FixedValueResource to avoid dependency to ResourceUtils

2017-10-31 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7410: - Attachment: YARN-7410.003.patch Attached ver.3 patch addressed comments from [~templedf]. > Cleanup FixedV

[jira] [Commented] (YARN-6940) FairScheduler: Enable Container update CodePaths and container resize testcase

2017-10-31 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227626#comment-16227626 ] Arun Suresh commented on YARN-6940: --- bq. what is the reason to set relaxLocality to true

[jira] [Commented] (YARN-7102) NM heartbeat stuck when responseId overflows MAX_INT

2017-10-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227625#comment-16227625 ] Hadoop QA commented on YARN-7102: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-7381) Enable the configuration: yarn.nodemanager.log-container-debug-info.enabled

2017-10-31 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-7381: Attachment: YARN-7381.1.patch > Enable the configuration: yarn.nodemanager.log-container-debug-info.enabled >

[jira] [Updated] (YARN-7276) Federation Router Web Service fixes

2017-10-31 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-7276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated YARN-7276: -- Attachment: YARN-7276-branch-2.010.patch Adding the timeline service as a dependency. > Federation Route

[jira] [Commented] (YARN-6909) The performance advantages of YARN-6679 are lost when resource types are used

2017-10-31 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227603#comment-16227603 ] Wangda Tan commented on YARN-6909: -- Thanks [~sunilg], thanks for working on this patch, si

[jira] [Commented] (YARN-7381) Enable the configuration: yarn.nodemanager.log-container-debug-info.enabled

2017-10-31 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227593#comment-16227593 ] Xuan Gong commented on YARN-7381: - Enable this configuration "yarn.nodemanager.log-containe

[jira] [Commented] (YARN-6394) Support specifying YARN related params in the service REST API

2017-10-31 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227552#comment-16227552 ] Billie Rinaldi commented on YARN-6394: -- Forgot one: * change the user and domain in th

[jira] [Comment Edited] (YARN-6394) Support specifying YARN related params in the service REST API

2017-10-31 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227552#comment-16227552 ] Billie Rinaldi edited comment on YARN-6394 at 10/31/17 8:59 PM: -

[jira] [Updated] (YARN-7276) Federation Router Web Service fixes

2017-10-31 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-7276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated YARN-7276: -- Attachment: YARN-7276-branch-2.009.patch > Federation Router Web Service fixes >

[jira] [Assigned] (YARN-7424) Capacity Scheduler Intra-queue preemption: add property to only preempt up to configured MULP

2017-10-31 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne reassigned YARN-7424: Assignee: Eric Payne > Capacity Scheduler Intra-queue preemption: add property to only preempt up to

[jira] [Commented] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-10-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227526#comment-16227526 ] Andrew Wang commented on YARN-6623: --- Hi Varun, do you mind adding a release note for this

[jira] [Commented] (YARN-7424) Capacity Scheduler Intra-queue preemption: add property to only preempt up to configured MULP

2017-10-31 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227528#comment-16227528 ] Eric Payne commented on YARN-7424: -- In a large, multi-tenant queue with MULP of 1%, after

[jira] [Commented] (YARN-7389) Make TestResourceManager Scheduler agnostic

2017-10-31 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227524#comment-16227524 ] Haibo Chen commented on YARN-7389: -- Thanks for doing that! > Make TestResourceManager Sch

[jira] [Comment Edited] (YARN-6940) FairScheduler: Enable Container update CodePaths and container resize testcase

2017-10-31 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227519#comment-16227519 ] Haibo Chen edited comment on YARN-6940 at 10/31/17 8:48 PM: [~a

[jira] [Commented] (YARN-6394) Support specifying YARN related params in the service REST API

2017-10-31 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227523#comment-16227523 ] Billie Rinaldi commented on YARN-6394: -- Looks good overall. Comments on the new docume

[jira] [Commented] (YARN-6940) FairScheduler: Enable Container update CodePaths and container resize testcase

2017-10-31 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227519#comment-16227519 ] Haibo Chen commented on YARN-6940: -- [~asuresh] A quick question. If we only do node-local

[jira] [Commented] (YARN-3661) Basic Federation UI

2017-10-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227509#comment-16227509 ] Andrew Wang commented on YARN-3661: --- I think this was meant for branch-3.0 as well, I bac

[jira] [Commented] (YARN-7400) incorrect log preview displayed in jobhistory server ui

2017-10-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227508#comment-16227508 ] Junping Du commented on YARN-7400: -- Thanks [~xgong] for delivering the fix. The fix is str

[jira] [Updated] (YARN-7424) Capacity Scheduler Intra-queue preemption: add property to only preempt up to configured MULP

2017-10-31 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-7424: - Description: If the queue's configured minimum user limit percent (MULP) is something small like 1%, all u

[jira] [Commented] (YARN-7403) Compute global and local preemption

2017-10-31 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227507#comment-16227507 ] Carlo Curino commented on YARN-7403: The attached screenshot shows an example of "globa

[jira] [Commented] (YARN-7389) Make TestResourceManager Scheduler agnostic

2017-10-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227500#comment-16227500 ] Andrew Wang commented on YARN-7389: --- Great, I backported it to branch-3.0. > Make TestRe

[jira] [Created] (YARN-7424) Capacity Scheduler Intra-queue preemption: add property to only preempt up to configured MULP

2017-10-31 Thread Eric Payne (JIRA)
Eric Payne created YARN-7424: Summary: Capacity Scheduler Intra-queue preemption: add property to only preempt up to configured MULP Key: YARN-7424 URL: https://issues.apache.org/jira/browse/YARN-7424 Pro

[jira] [Commented] (YARN-6394) Support specifying YARN related params in the service REST API

2017-10-31 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227498#comment-16227498 ] Jian He commented on YARN-6394: --- - containersFailed is not incremented on Flex by user, becau

[jira] [Updated] (YARN-7403) Compute global and local preemption

2017-10-31 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-7403: --- Attachment: global-queues-preemption.PNG > Compute global and local preemption > --

[jira] [Updated] (YARN-7403) Compute global and local preemption

2017-10-31 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-7403: --- Attachment: YARN-7403.draft3.patch > Compute global and local preemption >

[jira] [Updated] (YARN-6509) Add a size threshold beyond which yarn logs will require a force option

2017-10-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-6509: -- Fix Version/s: 3.0.0 > Add a size threshold beyond which yarn logs will require a force option >

[jira] [Updated] (YARN-7194) Log aggregation status is always Failed with the newly added log aggregation IndexedFileFormat

2017-10-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-7194: -- Fix Version/s: (was: 3.0.0-beta1) 3.0.0 > Log aggregation status is always Failed

[jira] [Updated] (YARN-7072) Add a new log aggregation file format controller

2017-10-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-7072: -- Fix Version/s: (was: 3.0.0-beta1) 3.0.0 > Add a new log aggregation file format co

[jira] [Updated] (YARN-7259) Add size-based rolling policy to LogAggregationIndexedFileController

2017-10-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-7259: -- Fix Version/s: (was: 3.0.0-beta1) 3.0.0 > Add size-based rolling policy to LogAggr

[jira] [Updated] (YARN-7308) TestApplicationACLs fails with FairScheduler

2017-10-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-7308: -- Fix Version/s: 3.0.0 > TestApplicationACLs fails with FairScheduler > ---

[jira] [Updated] (YARN-7269) Tracking URL in the app state does not get redirected to ApplicationMaster for Running applications

2017-10-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-7269: -- Fix Version/s: (was: 3.0.0-beta1) 3.0.0 > Tracking URL in the app state does not g

[jira] [Commented] (YARN-7159) Normalize unit of resource objects in RM and avoid to do unit conversion in critical path

2017-10-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227430#comment-16227430 ] Hadoop QA commented on YARN-7159: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-7389) Make TestResourceManager Scheduler agnostic

2017-10-31 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227429#comment-16227429 ] Haibo Chen commented on YARN-7389: -- Yes. Forgot to cherry-pick into branch-3.0. > Make T

[jira] [Commented] (YARN-6394) Support specifying YARN related params in the service REST API

2017-10-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227425#comment-16227425 ] Hadoop QA commented on YARN-6394: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

[jira] [Updated] (YARN-7339) LocalityMulticastAMRMProxyPolicy should handle cancel request properly

2017-10-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-7339: -- Fix Version/s: (was: 3.0) 3.0.0 > LocalityMulticastAMRMProxyPolicy should handle c

[jira] [Updated] (YARN-6128) Add support for AMRMProxy HA

2017-10-31 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-6128: --- Attachment: YARN-6128.v1.patch > Add support for AMRMProxy HA > > >

[jira] [Commented] (YARN-7159) Normalize unit of resource objects in RM and avoid to do unit conversion in critical path

2017-10-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227390#comment-16227390 ] Hadoop QA commented on YARN-7159: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-3813) Support Application timeout feature in YARN.

2017-10-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227388#comment-16227388 ] Andrew Wang commented on YARN-3813: --- Hi, could someone add a release note for this new fe

[jira] [Commented] (YARN-7240) Add more states and transitions to stabilize the NM Container state machine

2017-10-31 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227383#comment-16227383 ] Arun Suresh commented on YARN-7240: --- Yup, I was waiting for 3.0.0-beta1 to be cut before

[jira] [Updated] (YARN-7330) Add support to show GPU on UI/metrics

2017-10-31 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7330: - Attachment: YARN-7330.003.patch Uploaded ver.003 patch. > Add support to show GPU on UI/metrics > ---

[jira] [Commented] (YARN-6413) FileSystem based Yarn Registry implementation

2017-10-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227381#comment-16227381 ] Hudson commented on YARN-6413: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1317

[jira] [Commented] (YARN-7240) Add more states and transitions to stabilize the NM Container state machine

2017-10-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227379#comment-16227379 ] Andrew Wang commented on YARN-7240: --- Hi Arun, did you mean for this to go into branch-3.0

[jira] [Resolved] (YARN-7365) ResourceLocalization cache cleanup thread stuck

2017-10-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved YARN-7365. --- Resolution: Duplicate Fix Version/s: (was: 3.1.0) (was: 3.0.0)

[jira] [Reopened] (YARN-7365) ResourceLocalization cache cleanup thread stuck

2017-10-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang reopened YARN-7365: --- > ResourceLocalization cache cleanup thread stuck > --- > >

[jira] [Commented] (YARN-7389) Make TestResourceManager Scheduler agnostic

2017-10-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227378#comment-16227378 ] Andrew Wang commented on YARN-7389: --- Hey Haibo, did you mean for this to go into branch-3

[jira] [Updated] (YARN-6128) Add support for AMRMProxy HA

2017-10-31 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-6128: - Target Version/s: 2.9.0 (was: YARN-2915) > Add support for AMRMProxy HA >

[jira] [Updated] (YARN-6704) Add Federation Interceptor restart when work preserving NM is enabled

2017-10-31 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-6704: - Target Version/s: 2.9.0 > Add Federation Interceptor restart when work preserving NM is enabled > -

[jira] [Updated] (YARN-7276) Federation Router Web Service fixes

2017-10-31 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-7276: - Target Version/s: 2.9.0 > Federation Router Web Service fixes > ---

[jira] [Commented] (YARN-7394) Merge code paths for Reservation/Plan queues and Auto Created queues

2017-10-31 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227365#comment-16227365 ] Wangda Tan commented on YARN-7394: -- [~suma.shivaprasad], Thanks for updating the patch,

[jira] [Commented] (YARN-7394) Merge code paths for Reservation/Plan queues and Auto Created queues

2017-10-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227356#comment-16227356 ] Hadoop QA commented on YARN-7394: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-2497) Changes for fair scheduler to support allocate resource respect labels

2017-10-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227342#comment-16227342 ] Hadoop QA commented on YARN-2497: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-7276) Federation Router Web Service fixes

2017-10-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227335#comment-16227335 ] Hadoop QA commented on YARN-7276: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-6413) FileSystem based Yarn Registry implementation

2017-10-31 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227331#comment-16227331 ] Botong Huang commented on YARN-6413: Can we add some configuration that specifies which

[jira] [Updated] (YARN-6413) FileSystem based Yarn Registry implementation

2017-10-31 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-6413: - Summary: FileSystem based Yarn Registry implementation (was: Yarn Registry FS implementation) > F

[jira] [Resolved] (YARN-7421) Preserve execution type for containers to be increased by AM post YARN-1015

2017-10-31 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen resolved YARN-7421. -- Resolution: Not A Problem Based on, https://issues.apache.org/jira/browse/YARN-7178?focusedCommentId=162

[jira] [Commented] (YARN-7178) Add documentation for Container Update API

2017-10-31 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227320#comment-16227320 ] Haibo Chen commented on YARN-7178: -- bq. it is not really used right now - and was put in t

[jira] [Updated] (YARN-7400) incorrect log preview displayed in jobhistory server ui

2017-10-31 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-7400: - Priority: Major (was: Blocker) > incorrect log preview displayed in jobhistory server ui > ---

[jira] [Created] (YARN-7423) Improve service client loggings

2017-10-31 Thread Jian He (JIRA)
Jian He created YARN-7423: - Summary: Improve service client loggings Key: YARN-7423 URL: https://issues.apache.org/jira/browse/YARN-7423 Project: Hadoop YARN Issue Type: Sub-task Reporter

[jira] [Commented] (YARN-7178) Add documentation for Container Update API

2017-10-31 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227306#comment-16227306 ] Arun Suresh commented on YARN-7178: --- Yup, good catch.. we don't support resizing of Opp c

[jira] [Comment Edited] (YARN-7102) NM heartbeat stuck when responseId overflows MAX_INT

2017-10-31 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227297#comment-16227297 ] Botong Huang edited comment on YARN-7102 at 10/31/17 6:42 PM: --

[jira] [Updated] (YARN-7276) Federation Router Web Service fixes

2017-10-31 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-7276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated YARN-7276: -- Attachment: YARN-7276-branch-2.008.patch Trying to debug the issue with the classpath. > Federation Rout

[jira] [Commented] (YARN-7421) Preserve execution type for containers to be increased by AM post YARN-1015

2017-10-31 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227299#comment-16227299 ] Haibo Chen commented on YARN-7421: -- Looks like ResourceRequests for container increase/pro

[jira] [Commented] (YARN-7102) NM heartbeat stuck when responseId overflows MAX_INT

2017-10-31 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227297#comment-16227297 ] Botong Huang commented on YARN-7102: [~jlowe] you are right, it is indeed a race condit

[jira] [Updated] (YARN-7102) NM heartbeat stuck when responseId overflows MAX_INT

2017-10-31 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-7102: --- Attachment: YARN-7102.v12.patch > NM heartbeat stuck when responseId overflows MAX_INT > --

[jira] [Comment Edited] (YARN-7178) Add documentation for Container Update API

2017-10-31 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227291#comment-16227291 ] Haibo Chen edited comment on YARN-7178 at 10/31/17 6:36 PM: [~a

[jira] [Commented] (YARN-5447) Consider including allocationRequestId in NMContainerStatus to allow recovery in case of RM failover

2017-10-31 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227295#comment-16227295 ] Jian He commented on YARN-5447: --- yeah, we run into case 2, AM is not persisting the mapping,

[jira] [Commented] (YARN-7178) Add documentation for Container Update API

2017-10-31 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227291#comment-16227291 ] Haibo Chen commented on YARN-7178: -- [~asuresh] While looking at YARN-7421, it seems that t

[jira] [Commented] (YARN-6413) Yarn Registry FS implementation

2017-10-31 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227283#comment-16227283 ] Jian He commented on YARN-6413: --- The new patch looks good to me > Yarn Registry FS implement

[jira] [Commented] (YARN-7218) ApiServer REST API naming convention /ws/v1 is already used in Hadoop v2

2017-10-31 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227280#comment-16227280 ] Jian He commented on YARN-7218: --- Given that YARN-6626 is done, should this be closed ? > Api

[jira] [Commented] (YARN-7370) Preemption properties should be refreshable

2017-10-31 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227276#comment-16227276 ] Eric Payne commented on YARN-7370: -- [~GergelyNovak], Thanks for the updated patch. Just a

[jira] [Updated] (YARN-6394) Support specifying YARN related params in the service REST API

2017-10-31 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-6394: -- Attachment: YARN-6394.yarn-native-services.03.patch updated the patch again to include some fix for the metrics

[jira] [Created] (YARN-7422) Application History Server URL does not direct to the appropriate UI for failed/killed jobs

2017-10-31 Thread Kuhu Shukla (JIRA)
Kuhu Shukla created YARN-7422: - Summary: Application History Server URL does not direct to the appropriate UI for failed/killed jobs Key: YARN-7422 URL: https://issues.apache.org/jira/browse/YARN-7422 Pro

[jira] [Updated] (YARN-7421) Preserve execution type for containers to be increased by AM post YARN-1015

2017-10-31 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7421: - Issue Type: Sub-task (was: Bug) Parent: YARN-1011 > Preserve execution type for containers to be i

[jira] [Created] (YARN-7421) Preserve execution type for containers to be promoted by AM post YARN-1015

2017-10-31 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-7421: Summary: Preserve execution type for containers to be promoted by AM post YARN-1015 Key: YARN-7421 URL: https://issues.apache.org/jira/browse/YARN-7421 Project: Hadoop YARN

[jira] [Updated] (YARN-7421) Preserve execution type for containers to be increased by AM post YARN-1015

2017-10-31 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7421: - Summary: Preserve execution type for containers to be increased by AM post YARN-1015 (was: Preserve execut

[jira] [Commented] (YARN-7276) Federation Router Web Service fixes

2017-10-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227220#comment-16227220 ] Hadoop QA commented on YARN-7276: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-7159) Normalize unit of resource objects in RM and avoid to do unit conversion in critical path

2017-10-31 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikandan R updated YARN-7159: --- Attachment: YARN-7159.009.patch > Normalize unit of resource objects in RM and avoid to do unit convers

[jira] [Updated] (YARN-7159) Normalize unit of resource objects in RM and avoid to do unit conversion in critical path

2017-10-31 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikandan R updated YARN-7159: --- Attachment: (was: YARN-7159.009.patch) > Normalize unit of resource objects in RM and avoid to do u

  1   2   >