[jira] [Commented] (YARN-4736) Issues with HBaseTimelineWriterImpl

2016-03-19 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15198862#comment-15198862 ] Anoop Sam John commented on YARN-4736: -- When one RS is down, those regions in that wou

[jira] [Commented] (YARN-4829) Add support for binary units

2016-03-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15198456#comment-15198456 ] Hadoop QA commented on YARN-4829: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-4336) YARN NodeManager - Container Initialization - Excessive load on NSS/LDAP

2016-03-19 Thread Feng Yuan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feng Yuan updated YARN-4336: Description: Hi folks after performing some debug for our Unix Engineering and Active Directory teams it was

[jira] [Commented] (YARN-4743) ResourceManager crash because TimSort

2016-03-19 Thread Zephyr Guo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15201747#comment-15201747 ] Zephyr Guo commented on YARN-4743: -- I am trying to solve the issue, but I am failed. In my

[jira] [Updated] (YARN-4336) YARN NodeManager - Container Initialization - Excessive load on NSS/LDAP

2016-03-19 Thread Feng Yuan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feng Yuan updated YARN-4336: Description: Hi folks after performing some debug for our Unix Engineering and Active Directory teams it was

[jira] [Commented] (YARN-4390) Consider container request size during CS preemption

2016-03-19 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15199987#comment-15199987 ] Wangda Tan commented on YARN-4390: -- Thanks [~eepayne]/[~sunilg]. Will add implementation s

[jira] [Updated] (YARN-4336) YARN NodeManager - Container Initialization - Excessive load on NSS/LDAP

2016-03-19 Thread Feng Yuan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feng Yuan updated YARN-4336: Description: Hi folks after performing some debug for our Unix Engineering and Active Directory teams it was

[jira] [Updated] (YARN-4336) YARN NodeManager - Container Initialization - Excessive load on NSS/LDAP

2016-03-19 Thread Feng Yuan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feng Yuan updated YARN-4336: Description: Hi folks after performing some debug for our Unix Engineering and Active Directory teams it was

[jira] [Commented] (YARN-4829) Add support for binary units

2016-03-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15198171#comment-15198171 ] Hadoop QA commented on YARN-4829: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-4593) Deadlock in AbstractService.getConfig()

2016-03-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15197504#comment-15197504 ] Hudson commented on YARN-4593: -- FAILURE: Integrated in Hadoop-trunk-Commit #9469 (See [https:

[jira] [Updated] (YARN-4390) Consider container request size during CS preemption

2016-03-19 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4390: - Attachment: YARN-4390-design.1.pdf Uploaded ver.1 design doc for review. You can jump to "Proposal" part d

[jira] [Commented] (YARN-3926) Extend the YARN resource model for easier resource-type management and profiles

2016-03-19 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15197440#comment-15197440 ] Varun Vasudev commented on YARN-3926: - [~asuresh] - I was speaking with [~leftnoteasy]

[jira] [Commented] (YARN-2962) ZKRMStateStore: Limit the number of znodes under a znode

2016-03-19 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15200170#comment-15200170 ] Varun Saxena commented on YARN-2962: bq. Could you also explain in the parameter descri

[jira] [Commented] (YARN-4831) Recovered containers will be killed after NM stateful restart

2016-03-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15198512#comment-15198512 ] Hadoop QA commented on YARN-4831: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-4595) Add support for configurable read-only mounts

2016-03-19 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1518#comment-1518 ] Vinod Kumar Vavilapalli commented on YARN-4595: --- Can this also be the general

[jira] [Commented] (YARN-4839) ResourceManager deadlock between RMAppAttemptImpl and SchedulerApplicationAttempt

2016-03-19 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15201884#comment-15201884 ] Sunil G commented on YARN-4839: --- I feel that a call to {{RMAppAttemptImpl.getMasterContainer

[jira] [Commented] (YARN-4837) User facing aspects of 'AM blacklisting' feature need fixing

2016-03-19 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15200490#comment-15200490 ] Vinod Kumar Vavilapalli commented on YARN-4837: --- Here are my concerns - Firs

[jira] [Updated] (YARN-4829) Add support for binary units

2016-03-19 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-4829: Attachment: YARN-4829-YARN-3926.003.patch Good catch. Updated both of them. > Add support for binary

[jira] [Commented] (YARN-4790) Per user blacklist node for user specific error for container launch failure.

2016-03-19 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15201156#comment-15201156 ] Vinod Kumar Vavilapalli commented on YARN-4790: --- bq. when enabling LinuxConta

[jira] [Commented] (YARN-796) Allow for (admin) labels on nodes and resource-requests

2016-03-19 Thread Yi Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15197300#comment-15197300 ] Yi Zhou commented on YARN-796: -- Thanks [~Naganarasimha] > Allow for (admin) labels on nodes an

[jira] [Commented] (YARN-4785) inconsistent value type of the "type" field for LeafQueueInfo in response of RM REST API - cluster/scheduler

2016-03-19 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15197388#comment-15197388 ] Junping Du commented on YARN-4785: -- Thanks [~vvasudev] for explanation. I verified it in b

[jira] [Updated] (YARN-4062) Add the flush and compaction functionality via coprocessors and scanners for flow run table

2016-03-19 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-4062: - Attachment: YARN-4062-YARN-2928.08.patch Attaching patch v8 to address Sangjin’s review comments. bq. (F

[jira] [Updated] (YARN-4336) YARN NodeManager - Container Initialization - Excessive load on NSS/LDAP

2016-03-19 Thread Feng Yuan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feng Yuan updated YARN-4336: Description: Hi folks after performing some debug for our Unix Engineering and Active Directory teams it was

[jira] [Updated] (YARN-4829) Add support for binary units

2016-03-19 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-4829: Attachment: YARN-4829-YARN-3926.002.patch Thanks for the review [~asuresh]! Uploaded a new patch wit

[jira] [Updated] (YARN-4829) Add support for binary units

2016-03-19 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-4829: Attachment: YARN-4829-YARN-3926.004.patch Uploaded a new patch fixing the test failure. > Add suppor

[jira] [Resolved] (YARN-4783) Log aggregation failure for application when Nodemanager is restarted

2016-03-19 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe resolved YARN-4783. -- Resolution: Won't Fix Resolving as Won't Fix per the above discussion since we don't want to keep an app

[jira] [Updated] (YARN-4820) ResourceManager web redirects in HA mode drops query parameters

2016-03-19 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-4820: Attachment: YARN-4820.002.patch Uploaded a new patch to address the findbugs warnings. > ResourceMan

[jira] [Created] (YARN-4830) Add support for resource types in the nodemanager

2016-03-19 Thread Varun Vasudev (JIRA)
Varun Vasudev created YARN-4830: --- Summary: Add support for resource types in the nodemanager Key: YARN-4830 URL: https://issues.apache.org/jira/browse/YARN-4830 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-4686) MiniYARNCluster.start() returns before cluster is completely started

2016-03-19 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15200536#comment-15200536 ] Karthik Kambatla commented on YARN-4686: bq. Currently it is in the RM start method

[jira] [Commented] (YARN-4746) yarn web services should convert parse failures of appId to 400

2016-03-19 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15199400#comment-15199400 ] Steve Loughran commented on YARN-4746: -- looks reasonable. Given all uses of the conve

[jira] [Commented] (YARN-4820) ResourceManager web redirects in HA mode drops query parameters

2016-03-19 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15197218#comment-15197218 ] Steve Loughran commented on YARN-4820: -- What about 307 redirects? Even if they aren't

[jira] [Created] (YARN-4835) [YARN-3368] REST API related changes for new Web UI

2016-03-19 Thread Varun Saxena (JIRA)
Varun Saxena created YARN-4835: -- Summary: [YARN-3368] REST API related changes for new Web UI Key: YARN-4835 URL: https://issues.apache.org/jira/browse/YARN-4835 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-4833) For Queue AccessControlException client retries multiple times on both RM

2016-03-19 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-4833: --- Description: Submit application to queue where ACL is enabled and submitted user is not havin

[jira] [Commented] (YARN-4825) Remove redundant code in ClientRMService::listReservations

2016-03-19 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15200854#comment-15200854 ] Subru Krishnan commented on YARN-4825: -- The test case failures are consistent and unre

[jira] [Commented] (YARN-4712) CPU Usage Metric is not captured properly in YARN-2928

2016-03-19 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15201868#comment-15201868 ] Varun Saxena commented on YARN-4712: I have committed this to branch YARN-2928. Thanks

[jira] [Commented] (YARN-4822) Refactor existing Preemption Policy of CS for easier adding new approach to select preemption candidates

2016-03-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15200526#comment-15200526 ] Hadoop QA commented on YARN-4822: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-4820) ResourceManager web redirects in HA mode drops query parameters

2016-03-19 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15199449#comment-15199449 ] Junping Du commented on YARN-4820: -- Hi [~ste...@apache.org], I think the redirect logic no

[jira] [Commented] (YARN-4108) CapacityScheduler: Improve preemption to only kill containers that would satisfy the incoming request

2016-03-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15198600#comment-15198600 ] Hudson commented on YARN-4108: -- FAILURE: Integrated in Hadoop-trunk-Commit #9470 (See [https:

[jira] [Commented] (YARN-4576) Enhancement for tracking Blacklist in AM Launching

2016-03-19 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15202664#comment-15202664 ] Varun Vasudev commented on YARN-4576: - bq. No. DISKS_FAILED mark on bad disks are trans

[jira] [Created] (YARN-4834) ProcfsBasedProcessTree doesn't track daemonized processes

2016-03-19 Thread Nathan Roberts (JIRA)
Nathan Roberts created YARN-4834: Summary: ProcfsBasedProcessTree doesn't track daemonized processes Key: YARN-4834 URL: https://issues.apache.org/jira/browse/YARN-4834 Project: Hadoop YARN I

[jira] [Assigned] (YARN-4743) ResourceManager crash because TimSort

2016-03-19 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu reassigned YARN-4743: -- Assignee: Yufei Gu > ResourceManager crash because TimSort > - > >

[jira] [Commented] (YARN-4767) Network issues can cause persistent RM UI outage

2016-03-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15200138#comment-15200138 ] Hadoop QA commented on YARN-4767: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-4815) ATS 1.5 timelineclinet impl try to create attempt directory for every event call

2016-03-19 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15199611#comment-15199611 ] Junping Du commented on YARN-4815: -- The patch seems out of sync with trunk. [~xgong], can

[jira] [Commented] (YARN-3926) Extend the YARN resource model for easier resource-type management and profiles

2016-03-19 Thread Lei Guo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15197925#comment-15197925 ] Lei Guo commented on YARN-3926: --- Another topic related to rm-nm protocol is constraint label

[jira] [Updated] (YARN-4825) Remove redundant code in ClientRMService::listReservations

2016-03-19 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-4825: - Attachment: YARN-4825-v1.patch Attaching a patch that removes redundant code. Note: the patch does

[jira] [Created] (YARN-4838) TestLogAggregationService. testLocalFileDeletionOnDiskFull failed

2016-03-19 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-4838: Summary: TestLogAggregationService. testLocalFileDeletionOnDiskFull failed Key: YARN-4838 URL: https://issues.apache.org/jira/browse/YARN-4838 Project: Hadoop YARN

[jira] [Commented] (YARN-2915) Enable YARN RM scale out via federation using multiple RM's

2016-03-19 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15197956#comment-15197956 ] Vinod Kumar Vavilapalli commented on YARN-2915: --- One thing that occurred to m

[jira] [Updated] (YARN-4595) Add support for configurable read-only mounts

2016-03-19 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi updated YARN-4595: - Attachment: YARN-4595.2.patch Rebased patch. > Add support for configurable read-only mounts > ---

[jira] [Commented] (YARN-4839) ResourceManager deadlock between RMAppAttemptImpl and SchedulerApplicationAttempt

2016-03-19 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15201680#comment-15201680 ] Jason Lowe commented on YARN-4839: -- This appears to have been fixed as a side-effect of YA

[jira] [Created] (YARN-4836) [YARN-3368] Add AM related pages

2016-03-19 Thread Varun Saxena (JIRA)
Varun Saxena created YARN-4836: -- Summary: [YARN-3368] Add AM related pages Key: YARN-4836 URL: https://issues.apache.org/jira/browse/YARN-4836 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-4751) In 2.7, Labeled queue usage not shown properly in capacity scheduler UI

2016-03-19 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15197668#comment-15197668 ] Sunil G commented on YARN-4751: --- Yes, agreeing to the point that we have to aggregate and pee

[jira] [Commented] (YARN-4839) ResourceManager deadlock between RMAppAttemptImpl and SchedulerApplicationAttempt

2016-03-19 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15201578#comment-15201578 ] Jason Lowe commented on YARN-4839: -- Stack trace of the relevant threads: {noformat} "IPC S

[jira] [Commented] (YARN-4785) inconsistent value type of the "type" field for LeafQueueInfo in response of RM REST API - cluster/scheduler

2016-03-19 Thread Jayesh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15197781#comment-15197781 ] Jayesh commented on YARN-4785: -- +1 ( thanks for explaining the solution in code comment ) > i

[jira] [Updated] (YARN-4686) MiniYARNCluster.start() returns before cluster is completely started

2016-03-19 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-4686: -- Attachment: YARN-4686-branch-2.7.006.patch [~eepayne] Attaching the branch-2.7 patch. It passed all of th

[jira] [Commented] (YARN-4686) MiniYARNCluster.start() returns before cluster is completely started

2016-03-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15197845#comment-15197845 ] Hadoop QA commented on YARN-4686: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-4829) Add support for binary units

2016-03-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15200326#comment-15200326 ] Hadoop QA commented on YARN-4829: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-4311) Removing nodes from include and exclude lists will not remove them from decommissioned nodes list

2016-03-19 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15198218#comment-15198218 ] Daniel Templeton commented on YARN-4311: I don't have any further comments. LGTM.

[jira] [Commented] (YARN-4517) [YARN-3368] Add nodes page

2016-03-19 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15199784#comment-15199784 ] Sunil G commented on YARN-4517: --- [~varun_saxena] bq.Regarding node labels, we can add it in R

[jira] [Commented] (YARN-998) Persistent resource change during NM/RM restart

2016-03-19 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15197345#comment-15197345 ] Junping Du commented on YARN-998: - Thanks Jian for review and comments. bq. DynamicResourceC

[jira] [Commented] (YARN-4576) Enhancement for tracking Blacklist in AM Launching

2016-03-19 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15201139#comment-15201139 ] Vinod Kumar Vavilapalli commented on YARN-4576: --- Please read my comments on Y

[jira] [Commented] (YARN-4785) inconsistent value type of the "type" field for LeafQueueInfo in response of RM REST API - cluster/scheduler

2016-03-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15200116#comment-15200116 ] Hudson commented on YARN-4785: -- FAILURE: Integrated in Hadoop-trunk-Commit #9473 (See [https:

[jira] [Updated] (YARN-4746) yarn web services should convert parse failures of appId to 400

2016-03-19 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-4746: --- Attachment: 0003-YARN-4746.patch [~ste...@apache.org] Thanks you for review.Uploading patch wit

[jira] [Reopened] (YARN-4390) Consider container request size during CS preemption

2016-03-19 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne reopened YARN-4390: -- Assignee: Wangda Tan (was: Eric Payne) {quote} Since YARN-4108 doesn't solve all the issues. (I planne

[jira] [Commented] (YARN-4517) [YARN-3368] Add nodes page

2016-03-19 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15200211#comment-15200211 ] Varun Saxena commented on YARN-4517: Filed YARN-4835 > [YARN-3368] Add nodes page > --

[jira] [Updated] (YARN-4831) Recovered containers will be killed after NM stateful restart

2016-03-19 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-4831: -- Description: {code} 2016-03-04 19:43:48,130 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.cont

[jira] [Commented] (YARN-4686) MiniYARNCluster.start() returns before cluster is completely started

2016-03-19 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15198081#comment-15198081 ] Eric Payne commented on YARN-4686: -- Thanks, [~ebadger], for this patch. +1 LGTM. I will w

[jira] [Commented] (YARN-4823) Refactor the nested reservation id field in listReservation to simple string field

2016-03-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15200786#comment-15200786 ] Hadoop QA commented on YARN-4823: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-4822) Refactor existing Preemption Policy of CS for easier adding new approach to select preemption candidates

2016-03-19 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4822: - Attachment: YARN-4822.1.patch Attached ver.1 patch for review. > Refactor existing Preemption Policy of CS

[jira] [Commented] (YARN-4768) getAvailablePhysicalMemorySize can be inaccurate on linux

2016-03-19 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15199732#comment-15199732 ] Nathan Roberts commented on YARN-4768: -- Any comments on this approach? > getAvailabl

[jira] [Commented] (YARN-4711) NM is going down with NPE's due to single thread processing of events by Timeline client

2016-03-19 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15197864#comment-15197864 ] Naganarasimha G R commented on YARN-4711: - offline comments from [~sjlee0] : {quot

[jira] [Created] (YARN-4832) NM side resource value should get updated if change applied in RM side

2016-03-19 Thread Junping Du (JIRA)
Junping Du created YARN-4832: Summary: NM side resource value should get updated if change applied in RM side Key: YARN-4832 URL: https://issues.apache.org/jira/browse/YARN-4832 Project: Hadoop YARN

[jira] [Commented] (YARN-4820) ResourceManager web redirects in HA mode drops query parameters

2016-03-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15197561#comment-15197561 ] Hadoop QA commented on YARN-4820: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-1508) Document Dynamic Resource Configuration feature

2016-03-19 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-1508: - Summary: Document Dynamic Resource Configuration feature (was: Rename ResourceOption and document resource

[jira] [Created] (YARN-4828) Create a pull request template for github

2016-03-19 Thread Steve Loughran (JIRA)
Steve Loughran created YARN-4828: Summary: Create a pull request template for github Key: YARN-4828 URL: https://issues.apache.org/jira/browse/YARN-4828 Project: Hadoop YARN Issue Type: Impro

[jira] [Commented] (YARN-4595) Add support for configurable read-only mounts

2016-03-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15200385#comment-15200385 ] Hadoop QA commented on YARN-4595: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

[jira] [Commented] (YARN-4820) ResourceManager web redirects in HA mode drops query parameters

2016-03-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15200374#comment-15200374 ] Hadoop QA commented on YARN-4820: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-2005) Blacklisting support for scheduling AMs

2016-03-19 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15201146#comment-15201146 ] Vinod Kumar Vavilapalli commented on YARN-2005: --- -1 for backporting this, whi

[jira] [Commented] (YARN-4837) User facing aspects of 'AM blacklisting' feature need fixing

2016-03-19 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15201546#comment-15201546 ] Sunil G commented on YARN-4837: --- Thanks [~vinodkv] for pitching in. YARN-2005 blacklists nod

[jira] [Commented] (YARN-4502) Fix two AM containers get allocated when AM restart

2016-03-19 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15200423#comment-15200423 ] Vinod Kumar Vavilapalli commented on YARN-4502: --- [~zxu] / [~djp] bq. It looks

[jira] [Commented] (YARN-4746) yarn web services should convert parse failures of appId to 400

2016-03-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15201265#comment-15201265 ] Hadoop QA commented on YARN-4746: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-4823) Refactor the nested reservation id field in listReservation to simple string field

2016-03-19 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-4823: - Attachment: YARN-4823-v1.patch Attaching a patch that refactors the nested reservation id field in

[jira] [Commented] (YARN-4820) ResourceManager web redirects in HA mode drops query parameters

2016-03-19 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15197235#comment-15197235 ] Varun Vasudev commented on YARN-4820: - [~steve_l] - sorry I didn't understand the case

[jira] [Commented] (YARN-4062) Add the flush and compaction functionality via coprocessors and scanners for flow run table

2016-03-19 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15200414#comment-15200414 ] Sangjin Lee commented on YARN-4062: --- LGTM pending jenkins. I'll commit it once the jenkin

[jira] [Created] (YARN-4837) User facing aspects of 'AM blacklisting' feature need fixing

2016-03-19 Thread Vinod Kumar Vavilapalli (JIRA)
Vinod Kumar Vavilapalli created YARN-4837: - Summary: User facing aspects of 'AM blacklisting' feature need fixing Key: YARN-4837 URL: https://issues.apache.org/jira/browse/YARN-4837 Project: H

[jira] [Updated] (YARN-4390) Consider container request size during CS preemption

2016-03-19 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4390: - Attachment: YARN-4390.poc-WIP.1.patch And uploaded a WIP POC patch if you're interested to see what's the p

[jira] [Commented] (YARN-4636) Make blacklist tracking policy pluggable for more extensions.

2016-03-19 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15201206#comment-15201206 ] Vinod Kumar Vavilapalli commented on YARN-4636: --- -1 for something like this w

[jira] [Commented] (YARN-4829) Add support for binary units

2016-03-19 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15200878#comment-15200878 ] Varun Vasudev commented on YARN-4829: - [~asuresh] - can you take a look at the latest p

[jira] [Commented] (YARN-4686) MiniYARNCluster.start() returns before cluster is completely started

2016-03-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15202474#comment-15202474 ] Hadoop QA commented on YARN-4686: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Reopened] (YARN-2048) List all of the containers of an application from the yarn web

2016-03-19 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla reopened YARN-2048: > List all of the containers of an application from the yarn web > --

[jira] [Resolved] (YARN-2048) List all of the containers of an application from the yarn web

2016-03-19 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla resolved YARN-2048. Resolution: Duplicate > List all of the containers of an application from the yarn web >

[jira] [Commented] (YARN-2962) ZKRMStateStore: Limit the number of znodes under a znode

2016-03-19 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15198442#comment-15198442 ] Daniel Templeton commented on YARN-2962: Thanks for updating the patch, [~varun_sax

[jira] [Created] (YARN-4831) Recovered containers will be killed after NM stateful restart

2016-03-19 Thread Siqi Li (JIRA)
Siqi Li created YARN-4831: - Summary: Recovered containers will be killed after NM stateful restart Key: YARN-4831 URL: https://issues.apache.org/jira/browse/YARN-4831 Project: Hadoop YARN Issue Typ

[jira] [Commented] (YARN-3926) Extend the YARN resource model for easier resource-type management and profiles

2016-03-19 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15197811#comment-15197811 ] Arun Suresh commented on YARN-3926: --- bq. ..how this will affect on running apps Agreed, m

[jira] [Commented] (YARN-4825) Remove redundant code in ClientRMService::listReservations

2016-03-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15200746#comment-15200746 ] Hadoop QA commented on YARN-4825: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-4560) Make scheduler error checking message more user friendly

2016-03-19 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15197617#comment-15197617 ] Ray Chiang commented on YARN-4560: -- Thanks for the review everyone! Thanks for the commit

[jira] [Commented] (YARN-4785) inconsistent value type of the "type" field for LeafQueueInfo in response of RM REST API - cluster/scheduler

2016-03-19 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15200882#comment-15200882 ] Varun Vasudev commented on YARN-4785: - Thanks [~djp]! > inconsistent value type of the

[jira] [Commented] (YARN-4746) yarn web services should convert parse failures of appId to 400

2016-03-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15199226#comment-15199226 ] Hadoop QA commented on YARN-4746: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-4712) CPU Usage Metric is not captured properly in YARN-2928

2016-03-19 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15199768#comment-15199768 ] Varun Saxena commented on YARN-4712: +1 on the latest patch from me too. >From the poin

[jira] [Commented] (YARN-4517) [YARN-3368] Add nodes page

2016-03-19 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15200205#comment-15200205 ] Varun Saxena commented on YARN-4517: [~sunilg], bq. I will try and see whether we can m

[jira] [Commented] (YARN-998) Persistent resource change during NM/RM restart

2016-03-19 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15199584#comment-15199584 ] Junping Du commented on YARN-998: - Hi [~jianhe], would you kindly review the patch again? Th

  1   2   >