[jira] [Commented] (YARN-4743) ResourceManager crash because TimSort

2016-09-28 Thread Zephyr Guo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15531924#comment-15531924 ] Zephyr Guo commented on YARN-4743: -- Thanks for you comment.I will submit a new patch in re

[jira] [Commented] (YARN-5145) [YARN-3368] Move new YARN UI configuration to HADOOP_CONF_DIR

2016-09-28 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15531918#comment-15531918 ] Sunil G commented on YARN-5145: --- I think hosting new web UI under same old webapp port can be

[jira] [Commented] (YARN-3139) Improve locks in AbstractYarnScheduler/CapacityScheduler/FairScheduler

2016-09-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15531876#comment-15531876 ] Hadoop QA commented on YARN-3139: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-4327) RM can not renew TIMELINE_DELEGATION_TOKEN in secure clusters

2016-09-28 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-4327: -- Component/s: security > RM can not renew TIMELINE_DELEGATION_TOKEN in secure clusters >

[jira] [Updated] (YARN-3139) Improve locks in AbstractYarnScheduler/CapacityScheduler/FairScheduler

2016-09-28 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-3139: - Attachment: YARN-3139.6.patch [~jianhe], added the null check, somehow I forgot updating this. Fixed this i

[jira] [Commented] (YARN-5683) Support specifying storage type for per-application local dirs

2016-09-28 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15531569#comment-15531569 ] Tao Yang commented on YARN-5683: Thanks for comments, [~grey]. We think [YARN-3409|https:/

[jira] [Updated] (YARN-5683) Support specifying storage type for per-application local dirs

2016-09-28 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-5683: --- Description: h3. Introduction * Some applications of various frameworks (Flink, Spark and MapReduce etc) usin

[jira] [Commented] (YARN-5384) Expose priority in ReservationSystem submission APIs

2016-09-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15531542#comment-15531542 ] Hadoop QA commented on YARN-5384: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-5486) Update OpportunisticContainerAllocatorAMService::allocate method to handle OPPORTUNISTIC container requests

2016-09-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15531533#comment-15531533 ] Hadoop QA commented on YARN-5486: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-5384) Expose priority in ReservationSystem submission APIs

2016-09-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15531522#comment-15531522 ] Hadoop QA commented on YARN-5384: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-5677) RM can be in active-active state for an extended period

2016-09-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15531486#comment-15531486 ] Hadoop QA commented on YARN-5677: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-5384) Expose priority in ReservationSystem submission APIs

2016-09-28 Thread Sean Po (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Po updated YARN-5384: -- Attachment: YARN-5384.v6.patch YARN-5384.v6.patch fixes the checkstyle issues. > Expose priority in ReservationS

[jira] [Commented] (YARN-5384) Expose priority in ReservationSystem submission APIs

2016-09-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15531411#comment-15531411 ] Hadoop QA commented on YARN-5384: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-5677) RM can be in active-active state for an extended period

2016-09-28 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-5677: --- Attachment: YARN-5677.001.patch This patch fixes the issue in trunk. I opted to be conservativ

[jira] [Created] (YARN-5688) Make allocation of opportunistic containers asynchronous

2016-09-28 Thread Konstantinos Karanasos (JIRA)
Konstantinos Karanasos created YARN-5688: Summary: Make allocation of opportunistic containers asynchronous Key: YARN-5688 URL: https://issues.apache.org/jira/browse/YARN-5688 Project: Hadoop Y

[jira] [Created] (YARN-5687) Refactor TestOpportunisticContainerAllocation to extend TestAMRMClient

2016-09-28 Thread Konstantinos Karanasos (JIRA)
Konstantinos Karanasos created YARN-5687: Summary: Refactor TestOpportunisticContainerAllocation to extend TestAMRMClient Key: YARN-5687 URL: https://issues.apache.org/jira/browse/YARN-5687 Pr

[jira] [Updated] (YARN-5486) Update OpportunisticContainerAllocatorAMService::allocate method to handle OPPORTUNISTIC container requests

2016-09-28 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantinos Karanasos updated YARN-5486: - Attachment: YARN-5486.004.patch Adding new patch. Fixed remaining checkstyle issues

[jira] [Updated] (YARN-5384) Expose priority in ReservationSystem submission APIs

2016-09-28 Thread Sean Po (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Po updated YARN-5384: -- Attachment: YARN-5384.v5.patch Thanks [~subru] for your comments! YARN-5384.v5.patch addresses all your comments

[jira] [Created] (YARN-5686) DefaultContainerExecutor random working dir algorigthm skews results

2016-09-28 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-5686: Summary: DefaultContainerExecutor random working dir algorigthm skews results Key: YARN-5686 URL: https://issues.apache.org/jira/browse/YARN-5686 Project: Hadoop YARN

[jira] [Commented] (YARN-5400) Light cleanup in ZKRMStateStore

2016-09-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15531223#comment-15531223 ] Arpit Agarwal commented on YARN-5400: - No problem and thank you for the quick fix Rober

[jira] [Updated] (YARN-2995) Enhance UI to show cluster resource utilization of various container types

2016-09-28 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantinos Karanasos updated YARN-2995: - Attachment: YARN-2995.001.patch Adding first version of the patch. > Enhance UI to

[jira] [Commented] (YARN-5400) Light cleanup in ZKRMStateStore

2016-09-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15531187#comment-15531187 ] Hudson commented on YARN-5400: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1050

[jira] [Updated] (YARN-5384) Expose priority in ReservationSystem submission APIs

2016-09-28 Thread Sean Po (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Po updated YARN-5384: -- Attachment: YARN-5384.v4.patch > Expose priority in ReservationSystem submission APIs > -

[jira] [Updated] (YARN-5400) Light cleanup in ZKRMStateStore

2016-09-28 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated YARN-5400: Attachment: YARN-5400.addendum.patch Ok, it should be fixed now. Sorry about that. I've attached

[jira] [Comment Edited] (YARN-5400) Light cleanup in ZKRMStateStore

2016-09-28 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15531129#comment-15531129 ] Robert Kanter edited comment on YARN-5400 at 9/28/16 10:57 PM: --

[jira] [Commented] (YARN-5400) Light cleanup in ZKRMStateStore

2016-09-28 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15531129#comment-15531129 ] Robert Kanter commented on YARN-5400: - Yup. I was just talking to [~templedf] about th

[jira] [Commented] (YARN-5466) DefaultContainerExecutor needs JavaDocs

2016-09-28 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15531132#comment-15531132 ] Miklos Szegedi commented on YARN-5466: -- looks good to me +1(non-binding) > DefaultCon

[jira] [Commented] (YARN-5400) Light cleanup in ZKRMStateStore

2016-09-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15531122#comment-15531122 ] Arpit Agarwal commented on YARN-5400: - Looks like this commit broke the build for branc

[jira] [Commented] (YARN-5685) Non-embedded HA failover is broken

2016-09-28 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15530963#comment-15530963 ] Daniel Templeton commented on YARN-5685: BTW, the bug introduced by YARN-4559 (that

[jira] [Updated] (YARN-5685) Non-embedded HA failover is broken

2016-09-28 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-5685: --- Description: If HA is enabled with automatic failover enabled and embedded failover disabled, a

[jira] [Commented] (YARN-5685) Non-embedded HA failover is broken

2016-09-28 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15530951#comment-15530951 ] Daniel Templeton commented on YARN-5685: I think I finally get it. The net is that

[jira] [Comment Edited] (YARN-5685) Non-embedded HA failover is broken

2016-09-28 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15530951#comment-15530951 ] Daniel Templeton edited comment on YARN-5685 at 9/28/16 9:37 PM:

[jira] [Commented] (YARN-5400) Light cleanup in ZKRMStateStore

2016-09-28 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15530923#comment-15530923 ] Robert Kanter commented on YARN-5400: - +1 > Light cleanup in ZKRMStateStore >

[jira] [Commented] (YARN-5400) Light cleanup in ZKRMStateStore

2016-09-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15530861#comment-15530861 ] Hadoop QA commented on YARN-5400: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-5678) Misleading log message in FSLeafQueue and FSParentQueue

2016-09-28 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-5678: --- Summary: Misleading log message in FSLeafQueue and FSParentQueue (was: Misleading log message in FSLeafQueue)

[jira] [Updated] (YARN-5400) Light cleanup in ZKRMStateStore

2016-09-28 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-5400: --- Attachment: YARN-5400.003.patch Here's a rebased version. > Light cleanup in ZKRMStateStore >

[jira] [Commented] (YARN-5400) Light cleanup in ZKRMStateStore

2016-09-28 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15530688#comment-15530688 ] Robert Kanter commented on YARN-5400: - Hmm, it doesn't apply cleanly now: {noformat} >>

[jira] [Commented] (YARN-5400) Light cleanup in ZKRMStateStore

2016-09-28 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15530671#comment-15530671 ] Robert Kanter commented on YARN-5400: - Will do momentarily. > Light cleanup in ZKRMSta

[jira] [Commented] (YARN-5599) Publish AM launch command to ATS

2016-09-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15530666#comment-15530666 ] Hadoop QA commented on YARN-5599: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-5685) Non-embedded HA failover is broken

2016-09-28 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15530642#comment-15530642 ] Daniel Templeton commented on YARN-5685: The issue is more than that change from YA

[jira] [Commented] (YARN-4329) Allow fetching exact reason as to why a submitted app is in ACCEPTED state in Fair Scheduler

2016-09-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15530633#comment-15530633 ] Hadoop QA commented on YARN-4329: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

[jira] [Commented] (YARN-4329) Allow fetching exact reason as to why a submitted app is in ACCEPTED state in Fair Scheduler

2016-09-28 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15530632#comment-15530632 ] Daniel Templeton commented on YARN-4329: Thanks, [~yufei]. Maybe I'm an old codger

[jira] [Commented] (YARN-4561) Compaction coprocessor enhancements: On/Off, whitelisting, blacklisting

2016-09-28 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15530597#comment-15530597 ] Joep Rottinghuis commented on YARN-4561: All data that comes in late would be marke

[jira] [Updated] (YARN-5145) [YARN-3368] Move new YARN UI configuration to HADOOP_CONF_DIR

2016-09-28 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-5145: -- Attachment: newUIInOldRMWebServer.png > [YARN-3368] Move new YARN UI configuration to HADOOP_CONF_DIR > -

[jira] [Updated] (YARN-5145) [YARN-3368] Move new YARN UI configuration to HADOOP_CONF_DIR

2016-09-28 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-5145: -- Attachment: 0001-YARN-5145-Run-NewUI-WithOldPort-POC.patch Attaching a POC patch to host new web UI under same ol

[jira] [Commented] (YARN-4561) Compaction coprocessor enhancements: On/Off, whitelisting, blacklisting

2016-09-28 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15530564#comment-15530564 ] Joep Rottinghuis commented on YARN-4561: For late arriving data that was spooled us

[jira] [Comment Edited] (YARN-4329) Allow fetching exact reason as to why a submitted app is in ACCEPTED state in Fair Scheduler

2016-09-28 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15530473#comment-15530473 ] Yufei Gu edited comment on YARN-4329 at 9/28/16 6:33 PM: - Hi [~temp

[jira] [Updated] (YARN-4329) Allow fetching exact reason as to why a submitted app is in ACCEPTED state in Fair Scheduler

2016-09-28 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-4329: --- Attachment: YARN-4329.002.patch Hi [~templedf], thanks for the review. I uploaded the new patch for your comme

[jira] [Commented] (YARN-5659) getPathFromYarnURL should use standard methods

2016-09-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15530407#comment-15530407 ] Hitesh Shah commented on YARN-5659: --- [~sershe] Just annotate the functions that are only

[jira] [Comment Edited] (YARN-5659) getPathFromYarnURL should use standard methods

2016-09-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15530407#comment-15530407 ] Hitesh Shah edited comment on YARN-5659 at 9/28/16 6:06 PM: [~s

[jira] [Commented] (YARN-5659) getPathFromYarnURL should use standard methods

2016-09-28 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15530399#comment-15530399 ] Sergey Shelukhin commented on YARN-5659: Hmm.. which one should I add? I am not ver

[jira] [Created] (YARN-5685) Non-embedded HA failover is broken

2016-09-28 Thread Daniel Templeton (JIRA)
Daniel Templeton created YARN-5685: -- Summary: Non-embedded HA failover is broken Key: YARN-5685 URL: https://issues.apache.org/jira/browse/YARN-5685 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-4061) [Fault tolerance] Fault tolerant writer for timeline v2

2016-09-28 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15530324#comment-15530324 ] Joep Rottinghuis commented on YARN-4061: HBASE-12728 introduced the BufferedMutator

[jira] [Commented] (YARN-5599) Publish AM launch command to ATS

2016-09-28 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15530315#comment-15530315 ] Rohith Sharma K S commented on YARN-5599: - updated branch-2 patch > Publish AM lau

[jira] [Updated] (YARN-5599) Publish AM launch command to ATS

2016-09-28 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-5599: Attachment: YARN-5599-branch-2.patch > Publish AM launch command to ATS > ---

[jira] [Commented] (YARN-4205) Add a service for monitoring application life time out

2016-09-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15530187#comment-15530187 ] Hadoop QA commented on YARN-4205: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-5676) Add a HashBasedRouterPolicy, that routes jobs based on queue name hash.

2016-09-28 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15530223#comment-15530223 ] Carlo Curino commented on YARN-5676: For very large queue structures, it is convenient

[jira] [Updated] (YARN-5600) Add a parameter to ContainerLaunchContext to emulate yarn.nodemanager.delete.debug-delay-sec on a per-application basis

2016-09-28 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-5600: --- Assignee: Miklos Szegedi (was: Daniel Templeton) > Add a parameter to ContainerLaunchContext t

[jira] [Commented] (YARN-3432) Cluster metrics have wrong Total Memory when there is reserved memory on CS

2016-09-28 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15530162#comment-15530162 ] Brahma Reddy Battula commented on YARN-3432: Oh sorry, missed this..didn't get

[jira] [Commented] (YARN-5677) RM can be in active-active state for an extended period

2016-09-28 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15530124#comment-15530124 ] Daniel Templeton commented on YARN-5677: [~jianhe], is leader election on by defaul

[jira] [Commented] (YARN-5677) RM can be in active-active state for an extended period

2016-09-28 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15530118#comment-15530118 ] Daniel Templeton commented on YARN-5677: Just tested the leader election (with the

[jira] [Commented] (YARN-5145) [YARN-3368] Move new YARN UI configuration to HADOOP_CONF_DIR

2016-09-28 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15530061#comment-15530061 ] Sunil G commented on YARN-5145: --- Currently {{/logs}} has added as a new context to existing w

[jira] [Commented] (YARN-4061) [Fault tolerance] Fault tolerant writer for timeline v2

2016-09-28 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15529989#comment-15529989 ] Joep Rottinghuis commented on YARN-4061: I'm going to write up some requirements fo

[jira] [Updated] (YARN-4205) Add a service for monitoring application life time out

2016-09-28 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-4205: Attachment: 0007-YARN-4205.2.patch Fixing TestPBImplRecords failure and some of the checkstyl

[jira] [Created] (YARN-5684) testDecreaseAfterIncreaseWithAllocationExpiration fails intermittently

2016-09-28 Thread Rohith Sharma K S (JIRA)
Rohith Sharma K S created YARN-5684: --- Summary: testDecreaseAfterIncreaseWithAllocationExpiration fails intermittently Key: YARN-5684 URL: https://issues.apache.org/jira/browse/YARN-5684 Project: Ha

[jira] [Commented] (YARN-4205) Add a service for monitoring application life time out

2016-09-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15529649#comment-15529649 ] Hadoop QA commented on YARN-4205: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-5683) Support specifying storage type for per-application local dirs

2016-09-28 Thread Lei Guo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15529614#comment-15529614 ] Lei Guo commented on YARN-5683: --- This is related the constraint label YARN-3409, but differen

[jira] [Commented] (YARN-5599) Publish AM launch command to ATS

2016-09-28 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15529549#comment-15529549 ] Varun Saxena commented on YARN-5599: [~rohithsharma] can you provide a branch-2 patch ?

[jira] [Commented] (YARN-4205) Add a service for monitoring application life time out

2016-09-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15529513#comment-15529513 ] Hadoop QA commented on YARN-4205: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-4205) Add a service for monitoring application life time out

2016-09-28 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-4205: Attachment: 0007-YARN-4205.1.patch I forgot to include test file. Updating new patch with Tes

[jira] [Comment Edited] (YARN-3139) Improve locks in AbstractYarnScheduler/CapacityScheduler/FairScheduler

2016-09-28 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15529409#comment-15529409 ] Jian He edited comment on YARN-3139 at 9/28/16 12:10 PM: - Patch loo

[jira] [Commented] (YARN-3139) Improve locks in AbstractYarnScheduler/CapacityScheduler/FairScheduler

2016-09-28 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15529409#comment-15529409 ] Jian He commented on YARN-3139: --- Patch looks good to me. bq. Instead of taking readLock, I

[jira] [Commented] (YARN-4205) Add a service for monitoring application life time out

2016-09-28 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15529380#comment-15529380 ] Jian He commented on YARN-4205: --- latest patch looks good to me > Add a service for monitorin

[jira] [Updated] (YARN-4205) Add a service for monitoring application life time out

2016-09-28 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-4205: Attachment: 0007-YARN-4205.patch Updated the patch with following major changes from previous

[jira] [Updated] (YARN-5683) Support specifying storage type for per-application local dirs

2016-09-28 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-5683: --- Description: h3. Introduction * Some applications of various frameworks (Flink, Spark and MapReduce etc) usin

[jira] [Updated] (YARN-5683) Support specifying storage type for per-application local dirs

2016-09-28 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-5683: --- Description: h3. Introduction * Some applications of various frameworks (Flink, Spark and MapReduce etc) usin

[jira] [Updated] (YARN-5683) Support specifying storage type for per-application local dirs

2016-09-28 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-5683: --- Attachment: flow_diagram_for_MapReduce.png > Support specifying storage type for per-application local dirs > -

[jira] [Updated] (YARN-5683) Support specifying storage type for per-application local dirs

2016-09-28 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-5683: --- Attachment: YARN-5683-1.patch > Support specifying storage type for per-application local dirs > --

[jira] [Updated] (YARN-5683) Support specifying storage type for per-application local dirs

2016-09-28 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-5683: --- Description: h1. Introduction * Some applications of various frameworks (Flink, Spark and MapReduce etc) usin

[jira] [Created] (YARN-5683) Support specifying storage type for per-application local dirs

2016-09-28 Thread Tao Yang (JIRA)
Tao Yang created YARN-5683: -- Summary: Support specifying storage type for per-application local dirs Key: YARN-5683 URL: https://issues.apache.org/jira/browse/YARN-5683 Project: Hadoop YARN Issue T

[jira] [Commented] (YARN-5662) Provide an option to enable ContainerMonitor

2016-09-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15529266#comment-15529266 ] Hudson commented on YARN-5662: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1050

[jira] [Commented] (YARN-5599) Publish AM launch command to ATS

2016-09-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15529267#comment-15529267 ] Hudson commented on YARN-5599: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1050

[jira] [Commented] (YARN-4855) Should check if node exists when replace nodelabels

2016-09-28 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15529000#comment-15529000 ] Naganarasimha G R commented on YARN-4855: - bq. so it will be better to not add the

[jira] [Commented] (YARN-5682) [YARN-3368] Fix maven build to keep all generated or downloaded files in target folder

2016-09-28 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15528995#comment-15528995 ] Sunil G commented on YARN-5682: --- Hi [~wangda] I ran {{mvn install -Pyarn-ui}} with and w/o {

[jira] [Comment Edited] (YARN-4743) ResourceManager crash because TimSort

2016-09-28 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15528957#comment-15528957 ] Yufei Gu edited comment on YARN-4743 at 9/28/16 9:06 AM: - Hi [~gzh1

[jira] [Commented] (YARN-4743) ResourceManager crash because TimSort

2016-09-28 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15528957#comment-15528957 ] Yufei Gu commented on YARN-4743: Hi [~gzh1992n], thanks for working on this. Some thoughts

[jira] [Commented] (YARN-5682) [YARN-3368] Fix maven build to keep all generated or downloaded files in target folder

2016-09-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15528887#comment-15528887 ] Hadoop QA commented on YARN-5682: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-5554) MoveApplicationAcrossQueues does not check user permission on the target queue

2016-09-28 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15528729#comment-15528729 ] Yufei Gu commented on YARN-5554: The latest patch looks good to me. +1(non-binding). > Mo

[jira] [Commented] (YARN-5599) Publish AM launch command to ATS

2016-09-28 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15528688#comment-15528688 ] Varun Saxena commented on YARN-5599: +1. Will commit shortly. > Publish AM launch comm

[jira] [Updated] (YARN-5599) Publish AM launch command to ATS

2016-09-28 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-5599: --- Summary: Publish AM launch command to ATS (was: Post AM launcher artifacts to ATS) > Publish AM launc