[jira] [Commented] (YARN-6302) Fail the node, if Linux Container Executor is not configured properly

2017-04-12 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15966484#comment-15966484 ] Miklos Szegedi commented on YARN-6302: -- Thank you, I opened YARN-6475. > Fail the nod

[jira] [Created] (YARN-6475) Fix some long function checkstyle issues

2017-04-12 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-6475: Summary: Fix some long function checkstyle issues Key: YARN-6475 URL: https://issues.apache.org/jira/browse/YARN-6475 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-5301) NM mount cpu cgroups failed on some systems

2017-04-12 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15966482#comment-15966482 ] Miklos Szegedi commented on YARN-5301: -- I opened YARN-6474 for the remaining checkstyl

[jira] [Created] (YARN-6474) CGroupsHandlerImpl.java has a few checkstyle issues left to be fixed after YARN-5301

2017-04-12 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-6474: Summary: CGroupsHandlerImpl.java has a few checkstyle issues left to be fixed after YARN-5301 Key: YARN-6474 URL: https://issues.apache.org/jira/browse/YARN-6474 Proj

[jira] [Updated] (YARN-5301) NM mount cpu cgroups failed on some systems

2017-04-12 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-5301: - Attachment: YARN-5301.004.patch Yes, that is probable more future proof. Attached the patch. > NM

[jira] [Created] (YARN-6472) Possible Java sandbox improvements

2017-04-12 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-6472: Summary: Possible Java sandbox improvements Key: YARN-6472 URL: https://issues.apache.org/jira/browse/YARN-6472 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-6456) Isolation of Docker containers In LinuxContainerExecutor

2017-04-11 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15964813#comment-15964813 ] Miklos Szegedi commented on YARN-6456: -- Thank you for the reply [~jlowe]. What I am th

[jira] [Updated] (YARN-5301) NM mount cpu cgroups failed on some systems

2017-04-10 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-5301: - Attachment: YARN-5301.003.patch Thank you, [~templedf]. I attached an updated patch. I decided not

[jira] [Updated] (YARN-6433) Only accessible cgroup mount directories should be selected for a controller

2017-04-10 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-6433: - Attachment: YARN-6433.001.patch Thank you, [~haibochen] and [~kasha] for the review. I attached an

[jira] [Updated] (YARN-6302) Fail the node, if Linux Container Executor is not configured properly

2017-04-10 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-6302: - Attachment: YARN-6302.003.patch [~templedf], that is a good point. I updated the patch. > Fail the

[jira] [Created] (YARN-6456) Isolation of Docker containers In LinuxContainerExecutor

2017-04-07 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-6456: Summary: Isolation of Docker containers In LinuxContainerExecutor Key: YARN-6456 URL: https://issues.apache.org/jira/browse/YARN-6456 Project: Hadoop YARN Is

[jira] [Updated] (YARN-6368) Decommissioning an NM results in a -1 exit code

2017-04-07 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-6368: - Attachment: YARN-6368.004.patch Adding the final to the pach for branch-2. > Decommissioning an NM

[jira] [Comment Edited] (YARN-6368) Decommissioning an NM results in a -1 exit code

2017-04-07 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15961154#comment-15961154 ] Miklos Szegedi edited comment on YARN-6368 at 4/7/17 5:29 PM: --

[jira] [Commented] (YARN-6368) Decommissioning an NM results in a -1 exit code

2017-04-05 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15958111#comment-15958111 ] Miklos Szegedi commented on YARN-6368: -- I cannot repro this. It must be a flaky test.

[jira] [Commented] (YARN-3760) FSDataOutputStream leak in AggregatedLogFormat.LogWriter.close()

2017-04-05 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15957749#comment-15957749 ] Miklos Szegedi commented on YARN-3760: -- +1 (non-binding) > FSDataOutputStream leak in

[jira] [Assigned] (YARN-3760) FSDataOutputStream leak in AggregatedLogFormat.LogWriter.close()

2017-04-05 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi reassigned YARN-3760: Assignee: Miklos Szegedi (was: Haibo Chen) > FSDataOutputStream leak in AggregatedLogFormat

[jira] [Commented] (YARN-6449) Enable YARN to accept jobs with < 1 core allocations

2017-04-05 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15957495#comment-15957495 ] Miklos Szegedi commented on YARN-6449: -- vcore is a setting per container. Another opti

[jira] [Commented] (YARN-6438) Code can be improved in ContainersMonitorImpl.java

2017-04-05 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15957488#comment-15957488 ] Miklos Szegedi commented on YARN-6438: -- Thank you, [~yufeigu]. > Code can be improved

[jira] [Commented] (YARN-6449) Enable YARN to accept jobs with < 1 core allocations

2017-04-05 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15957478#comment-15957478 ] Miklos Szegedi commented on YARN-6449: -- [~Jrtorres42], thank you for the suggestion. W

[jira] [Updated] (YARN-6438) Code can be improved in ContainersMonitorImpl.java

2017-04-05 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-6438: - Attachment: YARN-6438.002.patch Addressing comments > Code can be improved in ContainersMonitorImp

[jira] [Updated] (YARN-6438) Code can be improved in ContainersMonitorImpl.java

2017-04-05 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-6438: - Attachment: YARN-6438.001.patch Thank you for the review [~yufeigu]. Addressing the comments > Cod

[jira] [Created] (YARN-6442) Inaccurate javadoc in NodeManagerHardwareUtils.getContainerMemoryMB

2017-04-04 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-6442: Summary: Inaccurate javadoc in NodeManagerHardwareUtils.getContainerMemoryMB Key: YARN-6442 URL: https://issues.apache.org/jira/browse/YARN-6442 Project: Hadoop YARN

[jira] [Updated] (YARN-6432) FS preemption should reserve a node before considering containers on it for preemption

2017-04-04 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-6432: - Attachment: YARN-6432.002.patch > FS preemption should reserve a node before considering containers

[jira] [Comment Edited] (YARN-6423) Queue metrics doesn't work for Fair Scheduler in SLS

2017-04-04 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15955933#comment-15955933 ] Miklos Szegedi edited comment on YARN-6423 at 4/4/17 10:25 PM: --

[jira] [Comment Edited] (YARN-6423) Queue metrics doesn't work for Fair Scheduler in SLS

2017-04-04 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15955933#comment-15955933 ] Miklos Szegedi edited comment on YARN-6423 at 4/4/17 10:15 PM: --

[jira] [Comment Edited] (YARN-6423) Queue metrics doesn't work for Fair Scheduler in SLS

2017-04-04 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15955933#comment-15955933 ] Miklos Szegedi edited comment on YARN-6423 at 4/4/17 10:13 PM: --

[jira] [Comment Edited] (YARN-6423) Queue metrics doesn't work for Fair Scheduler in SLS

2017-04-04 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15955933#comment-15955933 ] Miklos Szegedi edited comment on YARN-6423 at 4/4/17 10:08 PM: --

[jira] [Commented] (YARN-6423) Queue metrics doesn't work for Fair Scheduler in SLS

2017-04-04 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15955933#comment-15955933 ] Miklos Szegedi commented on YARN-6423: -- Thank you for the patch [~yufeigu]. I have a f

[jira] [Commented] (YARN-3760) FSDataOutputStream leak in AggregatedLogFormat.LogWriter.close()

2017-04-04 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15955906#comment-15955906 ] Miklos Szegedi commented on YARN-3760: -- Thank you for the patch [~haibochen]. Is there

[jira] [Assigned] (YARN-6438) Code can be improved in ContainersMonitorImpl.java

2017-04-04 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi reassigned YARN-6438: Assignee: Miklos Szegedi > Code can be improved in ContainersMonitorImpl.java >

[jira] [Updated] (YARN-6438) Code can be improved in ContainersMonitorImpl.java

2017-04-04 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-6438: - Attachment: YARN-6438.000.patch > Code can be improved in ContainersMonitorImpl.java >

[jira] [Created] (YARN-6438) Code can be improved in ContainersMonitorImpl.java

2017-04-04 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-6438: Summary: Code can be improved in ContainersMonitorImpl.java Key: YARN-6438 URL: https://issues.apache.org/jira/browse/YARN-6438 Project: Hadoop YARN Issue Ty

[jira] [Commented] (YARN-6433) Only accessible cgroup mount directories should be selected for a controller

2017-04-04 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15955748#comment-15955748 ] Miklos Szegedi commented on YARN-6433: -- Thank you, [~haibochen] for the review. > Onl

[jira] [Updated] (YARN-6432) FS preemption should reserve a node before considering containers on it for preemption

2017-04-04 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-6432: - Attachment: YARN-6432.001.patch > FS preemption should reserve a node before considering containers

[jira] [Commented] (YARN-6384) Add configuratin to set max cpu usage when strict-resource-usage is false with cgroups

2017-04-03 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15954530#comment-15954530 ] Miklos Szegedi commented on YARN-6384: -- Thank you, [~dengkai] for the clarification. W

[jira] [Updated] (YARN-6433) Only accessible cgroup mount directories should be selected for a controller

2017-04-03 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-6433: - Attachment: YARN-6433.000.patch > Only accessible cgroup mount directories should be selected for a

[jira] [Created] (YARN-6433) Only accessible cgroup mount directories should be selected for a controller

2017-04-03 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-6433: Summary: Only accessible cgroup mount directories should be selected for a controller Key: YARN-6433 URL: https://issues.apache.org/jira/browse/YARN-6433 Project: Had

[jira] [Updated] (YARN-6432) FS preemption should reserve a node before considering containers on it for preemption

2017-04-03 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-6432: - Attachment: YARN-6432.000.patch > FS preemption should reserve a node before considering containers

[jira] [Commented] (YARN-6432) FS preemption should reserve a node before considering containers on it for preemption

2017-04-03 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15954486#comment-15954486 ] Miklos Szegedi commented on YARN-6432: -- YARN-5829 keeps pulling a previous version of

[jira] [Created] (YARN-6432) FS preemption should reserve a node before considering containers on it for preemption

2017-04-03 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-6432: Summary: FS preemption should reserve a node before considering containers on it for preemption Key: YARN-6432 URL: https://issues.apache.org/jira/browse/YARN-6432 Pr

[jira] [Updated] (YARN-5829) FS preemption should reserve a node before considering containers on it for preemption

2017-04-03 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-5829: - Attachment: YARN-5829.002.patch Retrying the same patch. Hopefully it gets selected this time. > F

[jira] [Commented] (YARN-5829) FS preemption should reserve a node before considering containers on it for preemption

2017-04-03 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15953800#comment-15953800 ] Miklos Szegedi commented on YARN-5829: -- I think Jenkins got confused on the pull reque

[jira] [Updated] (YARN-6368) Decommissioning an NM results in a -1 exit code

2017-03-31 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-6368: - Attachment: YARN-6368.003.patch > Decommissioning an NM results in a -1 exit code > ---

[jira] [Updated] (YARN-6302) Fail the node, if Linux Container Executor is not configured properly

2017-03-31 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-6302: - Attachment: YARN-6302.002.patch > Fail the node, if Linux Container Executor is not configured prop

[jira] [Updated] (YARN-5829) FS preemption should reserve a node before considering containers on it for preemption

2017-03-31 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-5829: - Attachment: YARN-5829.001.patch > FS preemption should reserve a node before considering containers

[jira] [Updated] (YARN-5301) NM mount cpu cgroups failed on some systems

2017-03-31 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-5301: - Attachment: YARN-5301.002.patch > NM mount cpu cgroups failed on some systems > ---

[jira] [Commented] (YARN-5301) NM mount cpu cgroups failed on some systems

2017-03-31 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15951701#comment-15951701 ] Miklos Szegedi commented on YARN-5301: -- Thank you, [~templedf] for the review. Most of

[jira] [Commented] (YARN-5986) Add support for container specific properties to the ContainerLaunchContext

2017-03-30 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15950055#comment-15950055 ] Miklos Szegedi commented on YARN-5986: -- Just a note: another candidate for container p

[jira] [Created] (YARN-6417) TestContainerManager.testContainerLaunchAndStop disabled

2017-03-30 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-6417: Summary: TestContainerManager.testContainerLaunchAndStop disabled Key: YARN-6417 URL: https://issues.apache.org/jira/browse/YARN-6417 Project: Hadoop YARN Is

[jira] [Created] (YARN-6416) SIGNAL_CMD argument number is wrong

2017-03-30 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-6416: Summary: SIGNAL_CMD argument number is wrong Key: YARN-6416 URL: https://issues.apache.org/jira/browse/YARN-6416 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-6302) Fail the node, if Linux Container Executor is not configured properly

2017-03-30 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-6302: - Attachment: YARN-6302.001.patch Fixing unit, checkstyle and javadoc > Fail the node, if Linux Cont

[jira] [Updated] (YARN-6302) Fail the node, if Linux Container Executor is not configured properly

2017-03-30 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-6302: - Attachment: YARN-6302.000.patch > Fail the node, if Linux Container Executor is not configured prop

[jira] [Commented] (YARN-6302) Fail the node, if Linux Container Executor is not configured properly

2017-03-30 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15949494#comment-15949494 ] Miklos Szegedi commented on YARN-6302: -- I just did. > Fail the node, if Linux Contain

[jira] [Created] (YARN-6412) aux-services classpath not documented

2017-03-29 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-6412: Summary: aux-services classpath not documented Key: YARN-6412 URL: https://issues.apache.org/jira/browse/YARN-6412 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-5301) NM mount cpu cgroups failed on some systems

2017-03-29 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15947957#comment-15947957 ] Miklos Szegedi commented on YARN-5301: -- [~bibinchundatt], do you have time to take a l

[jira] [Updated] (YARN-5301) NM mount cpu cgroups failed on some systems

2017-03-29 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-5301: - Attachment: YARN-5301.001.patch Fixing checkstyle issues. > NM mount cpu cgroups failed on some sy

[jira] [Updated] (YARN-5301) NM mount cpu cgroups failed on some systems

2017-03-29 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-5301: - Summary: NM mount cpu cgroups failed on some systems (was: NM mount cpu cgroups failed on some sys

[jira] [Updated] (YARN-5301) NM mount cpu cgroups failed on some system

2017-03-29 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-5301: - Attachment: YARN-5301.000.patch The attached patch fixes the issue by identifying any premounted cg

[jira] [Commented] (YARN-6246) Identifying starved apps does not need the scheduler writelock

2017-03-28 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15946416#comment-15946416 ] Miklos Szegedi commented on YARN-6246: -- +1 (Non-binding) Thank you [~kasha] for report

[jira] [Assigned] (YARN-5301) NM mount cpu cgroups failed on some system

2017-03-27 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi reassigned YARN-5301: Assignee: Miklos Szegedi > NM mount cpu cgroups failed on some system >

[jira] [Commented] (YARN-5301) NM mount cpu cgroups failed on some system

2017-03-27 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15944419#comment-15944419 ] Miklos Szegedi commented on YARN-5301: -- I was able to reproduce this with Ubuntu, kern

[jira] [Commented] (YARN-6384) Add configuratin to set max cpu usage when strict-resource-usage is false with cgroups

2017-03-27 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15943704#comment-15943704 ] Miklos Szegedi commented on YARN-6384: -- bq. This may be confused, the yarn.nodemanage

[jira] [Assigned] (YARN-5987) NM configured command to collect heap dump of preempted container

2017-03-24 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi reassigned YARN-5987: Assignee: (was: Miklos Szegedi) > NM configured command to collect heap dump of preempte

[jira] [Commented] (YARN-6372) Add default value for NM disk validator

2017-03-24 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15941355#comment-15941355 ] Miklos Szegedi commented on YARN-6372: -- +1 (non-binding) Thank you, [~yufeigu] for fix

[jira] [Updated] (YARN-3427) Remove deprecated methods from ResourceCalculatorProcessTree

2017-03-24 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-3427: - Attachment: YARN-3427.001.patch Good point. I updated the patch. > Remove deprecated methods from

[jira] [Comment Edited] (YARN-6384) Add configuratin to set max cpu usage when strict-resource-usage is false with cgroups

2017-03-24 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15940948#comment-15940948 ] Miklos Szegedi edited comment on YARN-6384 at 3/24/17 7:00 PM: --

[jira] [Commented] (YARN-6384) Add configuratin to set max cpu usage when strict-resource-usage is false with cgroups

2017-03-24 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15940948#comment-15940948 ] Miklos Szegedi commented on YARN-6384: -- Thank you for reporting this [~dengkai]. Is no

[jira] [Commented] (YARN-6372) Add default value for NM disk validator

2017-03-23 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15939502#comment-15939502 ] Miklos Szegedi commented on YARN-6372: -- Thank you for the patch [~yufeigu]. It is not

[jira] [Commented] (YARN-6246) Identifying starved apps does not need the scheduler writelock

2017-03-23 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15939497#comment-15939497 ] Miklos Szegedi commented on YARN-6246: -- Thank you for the patch [~kasha]. shouldAttemp

[jira] [Updated] (YARN-6368) Decommissioning an NM results in a -1 exit code

2017-03-21 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-6368: - Attachment: YARN-6368.002.patch Attaching fix for the build break > Decommissioning an NM results

[jira] [Commented] (YARN-5600) Allow setting yarn.nodemanager.delete.debug-delay-sec on a per-application basis

2017-03-21 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15935084#comment-15935084 ] Miklos Szegedi commented on YARN-5600: -- [~vvasudev], please review the latest patch. D

[jira] [Updated] (YARN-6368) Decommissioning an NM results in a -1 exit code

2017-03-21 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-6368: - Attachment: YARN-6368.001.patch Thank you, [~haibochen] for the review. I attached an updated patch

[jira] [Updated] (YARN-3427) Remove deprecated methods from ResourceCalculatorProcessTree

2017-03-20 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-3427: - Attachment: YARN-3427.000.patch Attached patch > Remove deprecated methods from ResourceCalculator

[jira] [Updated] (YARN-6368) Decommissioning an NM results in a -1 exit code

2017-03-20 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-6368: - Attachment: YARN-6368.000.patch Attaching patch > Decommissioning an NM results in a -1 exit code

[jira] [Created] (YARN-6368) Decommissioning an NM results in a -1 exit code

2017-03-20 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-6368: Summary: Decommissioning an NM results in a -1 exit code Key: YARN-6368 URL: https://issues.apache.org/jira/browse/YARN-6368 Project: Hadoop YARN Issue Type:

[jira] [Comment Edited] (YARN-5179) Issue of CPU usage of containers

2017-03-17 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15931007#comment-15931007 ] Miklos Szegedi edited comment on YARN-5179 at 3/18/17 2:32 AM: --

[jira] [Comment Edited] (YARN-5179) Issue of CPU usage of containers

2017-03-17 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15931007#comment-15931007 ] Miklos Szegedi edited comment on YARN-5179 at 3/18/17 2:16 AM: --

[jira] [Commented] (YARN-5179) Issue of CPU usage of containers

2017-03-17 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15931007#comment-15931007 ] Miklos Szegedi commented on YARN-5179: -- [~maniraj...@gmail.com], could you help me, wh

[jira] [Commented] (YARN-4599) Set OOM control for memory cgroups

2017-03-17 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15930826#comment-15930826 ] Miklos Szegedi commented on YARN-4599: -- Thank you, [~sandflee] for the reply. The patc

[jira] [Commented] (YARN-6217) TestLocalCacheDirectoryManager test timeout is too aggressive

2017-03-17 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15930580#comment-15930580 ] Miklos Szegedi commented on YARN-6217: -- Thank you for the commit, [~jlowe], and for th

[jira] [Updated] (YARN-6217) TestLocalCacheDirectoryManager test timeout is too aggressive

2017-03-17 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-6217: - Attachment: YARN-6217.001.patch > TestLocalCacheDirectoryManager test timeout is too aggressive > -

[jira] [Assigned] (YARN-6217) TestLocalCacheDirectoryManager test timeout is too aggressive

2017-03-16 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi reassigned YARN-6217: Assignee: Miklos Szegedi > TestLocalCacheDirectoryManager test timeout is too aggressive > -

[jira] [Updated] (YARN-6217) TestLocalCacheDirectoryManager test timeout is too aggressive

2017-03-16 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-6217: - Attachment: YARN-6217.000.patch Attaching suggested patch. > TestLocalCacheDirectoryManager test t

[jira] [Commented] (YARN-6229) resource manager web UI display BUG

2017-03-16 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15929318#comment-15929318 ] Miklos Szegedi commented on YARN-6229: -- [~gehaijiang], are you using fair scheduler or

[jira] [Commented] (YARN-6242) [Umbrella] Miscellaneous Scheduler Performance Improvements

2017-03-16 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15929309#comment-15929309 ] Miklos Szegedi commented on YARN-6242: -- [~leftnoteasy], YARN-6361is a FS performance i

[jira] [Updated] (YARN-6361) FairScheduler: FSLeafQueue.fetchAppsWithDemand CPU usage is high with big queues

2017-03-16 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-6361: - Summary: FairScheduler: FSLeafQueue.fetchAppsWithDemand CPU usage is high with big queues (was: FS

[jira] [Updated] (YARN-6361) FSLeafQueue.fetchAppsWithDemand CPU usage is high with big queues

2017-03-16 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-6361: - Attachment: dispatcherthread.png > FSLeafQueue.fetchAppsWithDemand CPU usage is high with big queue

[jira] [Updated] (YARN-6361) FSLeafQueue.fetchAppsWithDemand CPU usage is high with big queues

2017-03-16 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-6361: - Attachment: threads.png > FSLeafQueue.fetchAppsWithDemand CPU usage is high with big queues > -

[jira] [Updated] (YARN-6361) FSLeafQueue.fetchAppsWithDemand CPU usage is high with big queues

2017-03-16 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-6361: - Description: FSLeafQueue.fetchAppsWithDemand sorts the applications by the current policy. Most of

[jira] [Created] (YARN-6361) FSLeafQueue.fetchAppsWithDemand CPU usage is high with big queues

2017-03-16 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-6361: Summary: FSLeafQueue.fetchAppsWithDemand CPU usage is high with big queues Key: YARN-6361 URL: https://issues.apache.org/jira/browse/YARN-6361 Project: Hadoop YARN

[jira] [Commented] (YARN-6244) Introduce AtomicResource in ResourceUsage to avoid read-write lock.

2017-03-16 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15929299#comment-15929299 ] Miklos Szegedi commented on YARN-6244: -- [~leftnoteasy], I have a question regarding At

[jira] [Comment Edited] (YARN-6279) Scheduler rest api JSON is not providing all child queues names

2017-03-16 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15929266#comment-15929266 ] Miklos Szegedi edited comment on YARN-6279 at 3/17/17 1:03 AM: --

[jira] [Commented] (YARN-6279) Scheduler rest api JSON is not providing all child queues names

2017-03-16 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15929266#comment-15929266 ] Miklos Szegedi commented on YARN-6279: -- [~ashishdoneriya], based on the JSON and the v

[jira] [Commented] (YARN-6345) Add container tags to resource requests

2017-03-16 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15929255#comment-15929255 ] Miklos Szegedi commented on YARN-6345: -- [~subru], [~kkaranasos], yes it does. Thank yo

[jira] [Commented] (YARN-6345) Add container tags to resource requests

2017-03-16 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15928522#comment-15928522 ] Miklos Szegedi commented on YARN-6345: -- bq. How would it simplify the CLC though? Ther

[jira] [Commented] (YARN-6345) Add container tags to resource requests

2017-03-15 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15927433#comment-15927433 ] Miklos Szegedi commented on YARN-6345: -- bq. Hi Miklos Szegedi. We could, but we were t

[jira] [Commented] (YARN-6345) Add container tags to resource requests

2017-03-15 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15927262#comment-15927262 ] Miklos Szegedi commented on YARN-6345: -- Thank you [~kkaranasos], for the report. It wo

[jira] [Commented] (YARN-6302) Fail the node, if Linux Container Executor is not configured properly

2017-03-15 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15927144#comment-15927144 ] Miklos Szegedi commented on YARN-6302: -- Not all of these, like directory permissions c

[jira] [Commented] (YARN-5829) FS preemption should reserve a node before considering containers on it for preemption

2017-03-10 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15905611#comment-15905611 ] Miklos Szegedi commented on YARN-5829: -- Thank you, [~Tao Jie] for the reply. 1, I sugg

[jira] [Assigned] (YARN-5829) FS preemption should reserve a node before considering containers on it for preemption

2017-03-09 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi reassigned YARN-5829: Assignee: Miklos Szegedi (was: Karthik Kambatla) > FS preemption should reserve a node befo

<    3   4   5   6   7   8   9   10   11   >