[jira] [Updated] (YARN-2185) Use pipes when localizing archives

2018-01-09 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-2185: - Attachment: YARN-2185.003.patch > Use pipes when localizing archives >

[jira] [Commented] (YARN-7705) Create the container log directory with correct sticky bit in C code

2018-01-09 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16319519#comment-16319519 ] Miklos Szegedi commented on YARN-7705: -- Adding dependency > Create the container log

[jira] [Commented] (YARN-2185) Use pipes when localizing archives

2018-01-09 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16319446#comment-16319446 ] Miklos Szegedi commented on YARN-2185: -- Thank you for the review, [~jlowe] and [~grepa

[jira] [Commented] (YARN-7712) Add ability to ignore timestamps in localized files

2018-01-09 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16318891#comment-16318891 ] Miklos Szegedi commented on YARN-7712: -- [~chris.douglas], thank you for the suggestion

[jira] [Updated] (YARN-7713) Add parallel copying of directories into FSDownload

2018-01-08 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7713: - Summary: Add parallel copying of directories into FSDownload (was: Add parallel copying of directo

[jira] [Commented] (YARN-7689) TestRMContainerAllocator fails after YARN-6124

2018-01-08 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317310#comment-16317310 ] Miklos Szegedi commented on YARN-7689: -- Thank you, [~wilfreds]. Could you address the

[jira] [Created] (YARN-7713) Add parallel copying of directories into

2018-01-08 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-7713: Summary: Add parallel copying of directories into Key: YARN-7713 URL: https://issues.apache.org/jira/browse/YARN-7713 Project: Hadoop YARN Issue Type: Improv

[jira] [Created] (YARN-7712) Add ability to ignore timestamps in localized files

2018-01-08 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-7712: Summary: Add ability to ignore timestamps in localized files Key: YARN-7712 URL: https://issues.apache.org/jira/browse/YARN-7712 Project: Hadoop YARN Issue T

[jira] [Commented] (YARN-7590) Improve container-executor validation check

2018-01-05 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16313730#comment-16313730 ] Miklos Szegedi commented on YARN-7590: -- [~eyang], thank you for the updated patch. {co

[jira] [Commented] (YARN-6673) Add cpu cgroup configurations for opportunistic containers

2018-01-05 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16313529#comment-16313529 ] Miklos Szegedi commented on YARN-6673: -- [~yangjiandan], I am assuming the requestor sp

[jira] [Commented] (YARN-7693) ContainersMonitor support configurable

2018-01-05 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16313488#comment-16313488 ] Miklos Szegedi commented on YARN-7693: -- [~yangjiandan], than you for the detailed repl

[jira] [Commented] (YARN-6673) Add cpu cgroup configurations for opportunistic containers

2018-01-04 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16312476#comment-16312476 ] Miklos Szegedi commented on YARN-6673: -- [~yangjiandan], would not that allow opportuni

[jira] [Updated] (YARN-6416) SIGNAL_CMD argument number is wrong

2018-01-04 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-6416: - Labels: newbie (was: ) > SIGNAL_CMD argument number is wrong > ---

[jira] [Comment Edited] (YARN-7516) Security check for untrusted docker image

2018-01-04 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16311786#comment-16311786 ] Miklos Szegedi edited comment on YARN-7516 at 1/5/18 1:54 AM: --

[jira] [Commented] (YARN-2185) Use pipes when localizing archives

2018-01-04 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16312332#comment-16312332 ] Miklos Szegedi commented on YARN-2185: -- The findbugs issue is in trunk. > Use pipes w

[jira] [Updated] (YARN-2185) Use pipes when localizing archives

2018-01-04 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-2185: - Attachment: YARN-2185.002.patch > Use pipes when localizing archives >

[jira] [Commented] (YARN-7516) Security check for untrusted docker image

2018-01-04 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16311786#comment-16311786 ] Miklos Szegedi commented on YARN-7516: -- [~eyang] thanks for the reply, bq. I am inclin

[jira] [Commented] (YARN-6894) RM Apps API returns only active apps when query parameter queue used

2018-01-03 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16310763#comment-16310763 ] Miklos Szegedi commented on YARN-6894: -- Thank you, [~gsohn]! > RM Apps API returns on

[jira] [Commented] (YARN-7516) Security check for untrusted docker image

2018-01-03 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16310726#comment-16310726 ] Miklos Szegedi commented on YARN-7516: -- [~eyang], [~ebadger], [~vinodkv], thank you fo

[jira] [Commented] (YARN-7590) Improve container-executor validation check

2018-01-03 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16310534#comment-16310534 ] Miklos Szegedi commented on YARN-7590: -- Thank you for the patch [~eyang]. I have two m

[jira] [Commented] (YARN-7693) ContainersMonitor support configurable

2018-01-03 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16310276#comment-16310276 ] Miklos Szegedi commented on YARN-7693: -- Thank you for the reply [~yangjiandan]. +0 on

[jira] [Commented] (YARN-7585) NodeManager should go unhealthy when state store throws DBException

2018-01-02 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16309046#comment-16309046 ] Miklos Szegedi commented on YARN-7585: -- +1. Thank you for the contribution [~wilfreds]

[jira] [Commented] (YARN-6894) RM Apps API returns only active apps when query parameter queue used

2018-01-02 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16309042#comment-16309042 ] Miklos Szegedi commented on YARN-6894: -- +1 Thank you for the contribution [~GergelyNov

[jira] [Commented] (YARN-7688) Miscellaneous Improvements To ProcfsBasedProcessTree

2018-01-02 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16309011#comment-16309011 ] Miklos Szegedi commented on YARN-7688: -- Committed to trunk. Thank you for the contribu

[jira] [Commented] (YARN-7688) Miscellaneous Improvements To ProcfsBasedProcessTree

2018-01-02 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16308982#comment-16308982 ] Miklos Szegedi commented on YARN-7688: -- +1 LGTM. I will commit this shortly. > Miscel

[jira] [Comment Edited] (YARN-7687) ContainerLogAppender Improvements

2018-01-02 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16308942#comment-16308942 ] Miklos Szegedi edited comment on YARN-7687 at 1/3/18 12:58 AM: --

[jira] [Commented] (YARN-7687) ContainerLogAppender Improvements

2018-01-02 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16308936#comment-16308936 ] Miklos Szegedi commented on YARN-7687: -- +1 LGTM. Thank you for the contribution [~belu

[jira] [Commented] (YARN-7694) Optionally run shared cache manager as part of the resource manager

2018-01-02 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16308833#comment-16308833 ] Miklos Szegedi commented on YARN-7694: -- [~ctrezzo], thank you for raising this. The sh

[jira] [Commented] (YARN-7693) ContainersMonitor support configurable

2018-01-02 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16308824#comment-16308824 ] Miklos Szegedi commented on YARN-7693: -- [~yangjiandan], thank you for raising this. Ho

[jira] [Commented] (YARN-7687) ContainerLogAppender Improvements

2017-12-29 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16306571#comment-16306571 ] Miklos Szegedi commented on YARN-7687: -- Thank you for the patch [~belugabehr]. Please

[jira] [Commented] (YARN-7688) Miscellaneous Improvements To ProcfsBasedProcessTree

2017-12-29 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16306550#comment-16306550 ] Miklos Szegedi commented on YARN-7688: -- Thank you for the patch [~belugabehr]. Please

[jira] [Commented] (YARN-7580) ContainersMonitorImpl logged message lacks detail when exceeding memory limits

2017-12-29 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16306540#comment-16306540 ] Miklos Szegedi commented on YARN-7580: -- Thank you for the contribution [~wilfreds]! >

[jira] [Commented] (YARN-7689) TestRMContainerAllocator fails after YARN-6124

2017-12-29 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16306521#comment-16306521 ] Miklos Szegedi commented on YARN-7689: -- Thank you for the patch [~wilfreds]. {code} //

[jira] [Commented] (YARN-7580) ContainersMonitorImpl logged message lacks detail when exceeding memory limits

2017-12-29 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16306509#comment-16306509 ] Miklos Szegedi commented on YARN-7580: -- +1. I will commit this shortly. > ContainersM

[jira] [Updated] (YARN-2185) Use pipes when localizing archives

2017-12-28 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-2185: - Attachment: YARN-2185.001.patch Findbugs does not like the coding style, so I am fixing it with thi

[jira] [Commented] (YARN-7688) Miscellaneous Improvements To ProcfsBasedProcessTree

2017-12-28 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16305839#comment-16305839 ] Miklos Szegedi commented on YARN-7688: -- Thank you for the patch [~belugabehr]. I have

[jira] [Commented] (YARN-7590) Improve container-executor validation check

2017-12-22 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16302137#comment-16302137 ] Miklos Szegedi commented on YARN-7590: -- Thank you for the patch [~eyang]. I have a few

[jira] [Comment Edited] (YARN-2185) Use pipes when localizing archives

2017-12-22 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16302123#comment-16302123 ] Miklos Szegedi edited comment on YARN-2185 at 12/23/17 12:10 AM:

[jira] [Comment Edited] (YARN-2185) Use pipes when localizing archives

2017-12-22 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16302123#comment-16302123 ] Miklos Szegedi edited comment on YARN-2185 at 12/23/17 12:08 AM:

[jira] [Updated] (YARN-2185) Use pipes when localizing archives

2017-12-22 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-2185: - Attachment: YARN-2185.000.patch Attaching my suggestion how to solve this. The code streams HDFS as

[jira] [Commented] (YARN-7590) Improve container-executor validation check

2017-12-21 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16300387#comment-16300387 ] Miklos Szegedi commented on YARN-7590: -- Thank you for the patch, [~eyang]. I have a fe

[jira] [Commented] (YARN-2185) Use pipes when localizing archives

2017-12-20 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16299199#comment-16299199 ] Miklos Szegedi commented on YARN-2185: -- Based on our discussion offline I can spend a

[jira] [Assigned] (YARN-2185) Use pipes when localizing archives

2017-12-20 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi reassigned YARN-2185: Assignee: Miklos Szegedi > Use pipes when localizing archives >

[jira] [Commented] (YARN-7590) Improve container-executor validation check

2017-12-20 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16298990#comment-16298990 ] Miklos Szegedi commented on YARN-7590: -- Thank you for the patch, [~eyang]. I see two m

[jira] [Commented] (YARN-7577) Unit Fail: TestAMRestart#testPreemptedAMRestartOnRMRestart

2017-12-18 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16295326#comment-16295326 ] Miklos Szegedi commented on YARN-7577: -- The other unit test errors should be unrelated

[jira] [Updated] (YARN-7577) Unit Fail: TestAMRestart#testPreemptedAMRestartOnRMRestart

2017-12-12 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7577: - Attachment: YARN-7577.006.patch Fixing checkstyle > Unit Fail: TestAMRestart#testPreemptedAMRestar

[jira] [Commented] (YARN-7590) Improve container-executor validation check

2017-12-12 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16288599#comment-16288599 ] Miklos Szegedi commented on YARN-7590: -- [~eyang], the first line of {{main()}} calls {

[jira] [Updated] (YARN-7577) Unit Fail: TestAMRestart#testPreemptedAMRestartOnRMRestart

2017-12-11 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7577: - Attachment: YARN-7577.005.patch > Unit Fail: TestAMRestart#testPreemptedAMRestartOnRMRestart >

[jira] [Updated] (YARN-7577) Unit Fail: TestAMRestart#testPreemptedAMRestartOnRMRestart

2017-12-11 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7577: - Attachment: YARN-7577.004.patch > Unit Fail: TestAMRestart#testPreemptedAMRestartOnRMRestart >

[jira] [Commented] (YARN-7064) Use cgroup to get container resource utilization

2017-12-11 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16286461#comment-16286461 ] Miklos Szegedi commented on YARN-7064: -- The unit test error is YARN-7629. TestRaceWhen

[jira] [Commented] (YARN-7590) Improve container-executor validation check

2017-12-08 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16284372#comment-16284372 ] Miklos Szegedi commented on YARN-7590: -- [~eyang], sorry about the delay. Due to the se

[jira] [Updated] (YARN-7064) Use cgroup to get container resource utilization

2017-12-08 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7064: - Attachment: YARN-7064.009.patch Fixing checkstyle and unit tests > Use cgroup to get container res

[jira] [Commented] (YARN-7577) Unit Fail: TestAMRestart#testPreemptedAMRestartOnRMRestart

2017-12-06 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16280657#comment-16280657 ] Miklos Szegedi commented on YARN-7577: -- Thank you for the review [~rkanter]. I updated

[jira] [Updated] (YARN-7577) Unit Fail: TestAMRestart#testPreemptedAMRestartOnRMRestart

2017-12-06 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7577: - Attachment: YARN-7577.003.patch > Unit Fail: TestAMRestart#testPreemptedAMRestartOnRMRestart >

[jira] [Updated] (YARN-7064) Use cgroup to get container resource utilization

2017-12-06 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7064: - Attachment: YARN-7064.008.patch > Use cgroup to get container resource utilization > --

[jira] [Commented] (YARN-7590) Improve container-executor validation check

2017-12-01 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16275315#comment-16275315 ] Miklos Szegedi commented on YARN-7590: -- [~eyang], why do not we just call getuid() to

[jira] [Commented] (YARN-7590) Improve container-executor validation check

2017-12-01 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16275142#comment-16275142 ] Miklos Szegedi commented on YARN-7590: -- I have two more options: 3. Instead of getting

[jira] [Commented] (YARN-7577) Unit Fail: TestAMRestart#testPreemptedAMRestartOnRMRestart

2017-11-29 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16271256#comment-16271256 ] Miklos Szegedi commented on YARN-7577: -- The unit test issues are unrelated. > Unit Fa

[jira] [Updated] (YARN-7577) Unit Fail: TestAMRestart#testPreemptedAMRestartOnRMRestart

2017-11-28 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7577: - Attachment: YARN-7577.002.patch > Unit Fail: TestAMRestart#testPreemptedAMRestartOnRMRestart >

[jira] [Updated] (YARN-7577) Unit Fail: TestAMRestart#testPreemptedAMRestartOnRMRestart

2017-11-28 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7577: - Attachment: YARN-7577.001.patch > Unit Fail: TestAMRestart#testPreemptedAMRestartOnRMRestart >

[jira] [Updated] (YARN-7577) Unit Fail: TestAMRestart#testPreemptedAMRestartOnRMRestart

2017-11-28 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7577: - Description: This happens, if Fair Scheduler is the default. The test should run with both schedul

[jira] [Updated] (YARN-7577) Unit Fail: TestAMRestart#testPreemptedAMRestartOnRMRestart

2017-11-28 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7577: - Attachment: YARN-7577.000.patch > Unit Fail: TestAMRestart#testPreemptedAMRestartOnRMRestart >

[jira] [Commented] (YARN-7491) Make sure AM is not scheduled on an opportunistic container

2017-11-28 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16269490#comment-16269490 ] Miklos Szegedi commented on YARN-7491: -- +1 Thank you for the contribution [~haibochen]

[jira] [Created] (YARN-7577) Unit Fail: TestAMRestart#testPreemptedAMRestartOnRMRestart

2017-11-28 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-7577: Summary: Unit Fail: TestAMRestart#testPreemptedAMRestartOnRMRestart Key: YARN-7577 URL: https://issues.apache.org/jira/browse/YARN-7577 Project: Hadoop YARN

[jira] [Commented] (YARN-7491) Make sure AM is not scheduled on an opportunistic container

2017-11-28 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16269285#comment-16269285 ] Miklos Szegedi commented on YARN-7491: -- We discussed this in person. So the issue is t

[jira] [Commented] (YARN-7491) Make sure AM is not scheduled on an opportunistic container

2017-11-27 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16267920#comment-16267920 ] Miklos Szegedi commented on YARN-7491: -- I reverted the AM request line in the patch to

[jira] [Commented] (YARN-7491) Make sure AM is not scheduled on an opportunistic container

2017-11-27 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16267702#comment-16267702 ] Miklos Szegedi commented on YARN-7491: -- Thank you for the patch [~haibochen]. Even tho

[jira] [Commented] (YARN-7363) ContainerLocalizer don't have a valid log4j config in case of Linux container executor

2017-11-22 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16263329#comment-16263329 ] Miklos Szegedi commented on YARN-7363: -- +1 (non-binding). Thank you for the patch [~yu

[jira] [Comment Edited] (YARN-6921) Allow resource request to opt out of oversubscription in Fair Scheduler

2017-11-22 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16262916#comment-16262916 ] Miklos Szegedi edited comment on YARN-6921 at 11/22/17 6:22 PM: -

[jira] [Comment Edited] (YARN-6921) Allow resource request to opt out of oversubscription in Fair Scheduler

2017-11-22 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16262916#comment-16262916 ] Miklos Szegedi edited comment on YARN-6921 at 11/22/17 6:21 PM: -

[jira] [Commented] (YARN-6750) Add a configuration to cap how much a NM can be overallocated

2017-11-22 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16262941#comment-16262941 ] Miklos Szegedi commented on YARN-6750: -- +1 Thank you for the contribution [~haibochen]

[jira] [Commented] (YARN-6921) Allow resource request to opt out of oversubscription in Fair Scheduler

2017-11-22 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16262916#comment-16262916 ] Miklos Szegedi commented on YARN-6921: -- Thank you for the contribution, [~haibochen].

[jira] [Commented] (YARN-7337) Expose per-node over-allocation info in Node Report

2017-11-22 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16262892#comment-16262892 ] Miklos Szegedi commented on YARN-7337: -- +1. Thank you for the contribution [~haibochen

[jira] [Comment Edited] (YARN-7337) Expose per-node over-allocation info in Node Report

2017-11-22 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16259899#comment-16259899 ] Miklos Szegedi edited comment on YARN-7337 at 11/22/17 4:33 PM: -

[jira] [Commented] (YARN-5534) Allow user provided Docker volume mount list

2017-11-21 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16261921#comment-16261921 ] Miklos Szegedi commented on YARN-5534: -- Thank you, [~shaneku...@gmail.com] for the pat

[jira] [Created] (YARN-7554) TestCryptoStreamsWithOpensslAesCtrCryptoCodec fails on Debian 9

2017-11-21 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-7554: Summary: TestCryptoStreamsWithOpensslAesCtrCryptoCodec fails on Debian 9 Key: YARN-7554 URL: https://issues.apache.org/jira/browse/YARN-7554 Project: Hadoop YARN

[jira] [Created] (YARN-7553) TestShellBasedUnixGroupsMapping.testFiniteGroupResolutionTime flaky

2017-11-21 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-7553: Summary: TestShellBasedUnixGroupsMapping.testFiniteGroupResolutionTime flaky Key: YARN-7553 URL: https://issues.apache.org/jira/browse/YARN-7553 Project: Hadoop YARN

[jira] [Commented] (YARN-7363) ContainerLocalizer don't have a valid log4j config in case of Linux container executor

2017-11-21 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16261650#comment-16261650 ] Miklos Szegedi commented on YARN-7363: -- Thank you, [~yufeigu] for the patch. {code} 48

[jira] [Commented] (YARN-6750) Add a configuration to cap how much a NM can be overallocated

2017-11-20 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16259942#comment-16259942 ] Miklos Szegedi commented on YARN-6750: -- Thank you for the patch [~haibochen]. {code} 9

[jira] [Commented] (YARN-6921) Allow resource request to opt out of oversubscription in Fair Scheduler

2017-11-20 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16259934#comment-16259934 ] Miklos Szegedi commented on YARN-6921: -- +1 pending jenkins. Thank you for the patch [~

[jira] [Comment Edited] (YARN-7337) Expose per-node over-allocation info in Node Report

2017-11-20 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16259899#comment-16259899 ] Miklos Szegedi edited comment on YARN-7337 at 11/20/17 9:50 PM: -

[jira] [Commented] (YARN-7337) Expose per-node over-allocation info in Node Report

2017-11-20 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16259899#comment-16259899 ] Miklos Szegedi commented on YARN-7337: -- Thenk you for the patch [~haibochen] {code} 15

[jira] [Commented] (YARN-7506) Overhaul the design of the Linux container-executor regarding Docker and future runtimes

2017-11-20 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16259740#comment-16259740 ] Miklos Szegedi commented on YARN-7506: -- The startup time might prevent us to use a roo

[jira] [Commented] (YARN-5673) [Umbrella] Re-write container-executor to improve security, extensibility, and portability

2017-11-17 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16257394#comment-16257394 ] Miklos Szegedi commented on YARN-5673: -- [~eyang], thank you for the explanation. Indee

[jira] [Updated] (YARN-7506) Overhaul the design of the Linux container-executor regarding Docker and future runtimes

2017-11-17 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7506: - Issue Type: Sub-task (was: Wish) Parent: YARN-5673 > Overhaul the design of the Linux cont

[jira] [Updated] (YARN-7506) Overhaul the design of the Linux container-executor regarding Docker and future runtimes

2017-11-17 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7506: - Attachment: (was: YARN-Docker control options.pdf) > Overhaul the design of the Linux container

[jira] [Updated] (YARN-7506) Overhaul the design of the Linux container-executor regarding Docker and future runtimes

2017-11-17 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7506: - Attachment: YARN-Docker control options.pdf > Overhaul the design of the Linux container-executor r

[jira] [Commented] (YARN-7506) Overhaul the design of the Linux container-executor regarding Docker and future runtimes

2017-11-17 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16257375#comment-16257375 ] Miklos Szegedi commented on YARN-7506: -- Thank you for the comments. [~ebadger], the ma

[jira] [Updated] (YARN-7506) Overhaul the design of the Linux container-executor regarding Docker and future runtimes

2017-11-17 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7506: - Attachment: YARN-Docker control options.pdf > Overhaul the design of the Linux container-executor r

[jira] [Commented] (YARN-5673) [Umbrella] Re-write container-executor to improve security, extensibility, and portability

2017-11-17 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16257268#comment-16257268 ] Miklos Szegedi commented on YARN-5673: -- [~eyang], Thank you for your comment. I have a

[jira] [Commented] (YARN-7460) Exclude findbugs warnings on SchedulerNode.numGuaranteedContainers and numOpportunisticContainers

2017-11-16 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16256192#comment-16256192 ] Miklos Szegedi commented on YARN-7460: -- +1 (binding). Thank you, for the patch [~haibo

[jira] [Created] (YARN-7506) Overhaul the design of the Linux container-executor regarding Docker and future runtimes

2017-11-15 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-7506: Summary: Overhaul the design of the Linux container-executor regarding Docker and future runtimes Key: YARN-7506 URL: https://issues.apache.org/jira/browse/YARN-7506

[jira] [Commented] (YARN-5936) when cpu strict mode is closed, yarn couldn't assure scheduling fairness between containers

2017-11-13 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16250021#comment-16250021 ] Miklos Szegedi commented on YARN-5936: -- Another option for the future is the use of th

[jira] [Commented] (YARN-7337) Expose per-node over-allocation info in Node Report

2017-11-09 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16246786#comment-16246786 ] Miklos Szegedi commented on YARN-7337: -- Why do not we create a getTotalNumContainers,

[jira] [Commented] (YARN-7460) Exclude findbugs warnings on SchedulerNode.numGuaranteedContainers and numOpportunisticContainers

2017-11-09 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16246351#comment-16246351 ] Miklos Szegedi commented on YARN-7460: -- Thank you for the patch [~haibochen]. The call

[jira] [Commented] (YARN-7337) Expose per-node over-allocation info in Node Report

2017-11-09 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16246308#comment-16246308 ] Miklos Szegedi commented on YARN-7337: -- Thank you for the patch [~haibochen]. {code} 1

[jira] [Commented] (YARN-1015) FS should watch node resource utilization and allocate opportunistic containers if appropriate

2017-11-09 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16246270#comment-16246270 ] Miklos Szegedi commented on YARN-1015: -- [~asuresh], do you have more comments on this

[jira] [Commented] (YARN-1015) FS should watch node resource utilization and allocate opportunistic containers if appropriate

2017-11-03 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238188#comment-16238188 ] Miklos Szegedi commented on YARN-1015: -- Thank you for the patch [~haibochen]. {code} 3

[jira] [Commented] (YARN-7289) Application lifetime does not work with FairScheduler

2017-11-01 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16234942#comment-16234942 ] Miklos Szegedi commented on YARN-7289: -- [~rohithsharma], could you please look at the

[jira] [Updated] (YARN-7289) Application lifetime does not work with FairScheduler

2017-11-01 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7289: - Attachment: YARN-7289.addendum.000.patch > Application lifetime does not work with FairScheduler >

<    1   2   3   4   5   6   7   8   9   10   >