[jira] [Reopened] (YARN-7289) Application lifetime does not work with FairScheduler

2017-11-01 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi reopened YARN-7289: -- I noticed that we override the configuration in case of capacity scheduler instead of extending it.

[jira] [Updated] (YARN-6747) TestFSAppStarvation.testPreemptionEnable fails intermittently

2017-10-27 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-6747: - Attachment: YARN-6747.002.patch Thank you for the review, [~yufeigu]. I updated the patch. >

[jira] [Updated] (YARN-7064) Use cgroup to get container resource utilization

2017-10-27 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7064: - Attachment: YARN-7064.007.patch > Use cgroup to get container resource utilization >

[jira] [Updated] (YARN-7064) Use cgroup to get container resource utilization

2017-10-27 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7064: - Attachment: (was: YARN-7064.006.patch) > Use cgroup to get container resource utilization >

[jira] [Updated] (YARN-7064) Use cgroup to get container resource utilization

2017-10-27 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7064: - Attachment: YARN-7064.006.patch I did a rebase because there were some conflicts. > Use cgroup to

[jira] [Commented] (YARN-1015) FS should watch node resource utilization and allocate opportunistic containers if appropriate

2017-10-27 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16222740#comment-16222740 ] Miklos Szegedi commented on YARN-1015: -- Thank you for the patch [~haibochen]. {code} 271 public

[jira] [Commented] (YARN-7289) Application lifetime does not work with FairScheduler

2017-10-27 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16222658#comment-16222658 ] Miklos Szegedi commented on YARN-7289: -- The ASF license issues are unrelated to the patch. >

[jira] [Updated] (YARN-7336) Unsafe cast from long to int Resource.hashCode() method

2017-10-26 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7336: - Attachment: YARN-7336.001.patch Thank you, [~templedf] for the review. I updated the patch. >

[jira] [Updated] (YARN-7289) Application lifetime does not work with FairScheduler

2017-10-26 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7289: - Attachment: YARN-7289.005.patch > Application lifetime does not work with FairScheduler >

[jira] [Commented] (YARN-7289) Application lifetime does not work with FairScheduler

2017-10-26 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16220744#comment-16220744 ] Miklos Szegedi commented on YARN-7289: -- [~rohithsharma], I was not off yesterday. Thank you for the

[jira] [Commented] (YARN-7289) Application lifetime does not work with FairScheduler

2017-10-25 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16219807#comment-16219807 ] Miklos Szegedi commented on YARN-7289: -- [~rohithsharma], thank you for the patch. Would you like to

[jira] [Updated] (YARN-7064) Use cgroup to get container resource utilization

2017-10-25 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7064: - Attachment: YARN-7064.005.patch > Use cgroup to get container resource utilization >

[jira] [Commented] (YARN-7064) Use cgroup to get container resource utilization

2017-10-25 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16219785#comment-16219785 ] Miklos Szegedi commented on YARN-7064: -- Thank you, [~haibochen] for the review. I changed the

[jira] [Updated] (YARN-7336) Unsafe cast from long to int Resource.hashCode() method

2017-10-24 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7336: - Attachment: YARN-7336.000.patch > Unsafe cast from long to int Resource.hashCode() method >

[jira] [Commented] (YARN-7289) TestApplicationLifetimeMonitor.testApplicationLifetimeMonitor times out

2017-10-24 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217685#comment-16217685 ] Miklos Szegedi commented on YARN-7289: -- The issues are YARN-6747, YARN-7385, YARN-7385 and YARN-7387

[jira] [Created] (YARN-7387) org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestIncreaseAllocationExpirer fails intermittently

2017-10-24 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-7387: Summary: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestIncreaseAllocationExpirer fails intermittently Key: YARN-7387 URL:

[jira] [Comment Edited] (YARN-6747) TestFSAppStarvation.testPreemptionEnable fails intermittently

2017-10-24 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217577#comment-16217577 ] Miklos Szegedi edited comment on YARN-6747 at 10/24/17 8:36 PM: The first

[jira] [Commented] (YARN-6747) TestFSAppStarvation.testPreemptionEnable fails intermittently

2017-10-24 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217577#comment-16217577 ] Miklos Szegedi commented on YARN-6747: -- The first and second issues are YARN-7385. >

[jira] [Commented] (YARN-7289) TestApplicationLifetimeMonitor.testApplicationLifetimeMonitor times out

2017-10-23 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16215960#comment-16215960 ] Miklos Szegedi commented on YARN-7289: -- I was looking at the test failures. Most of these are due to

[jira] [Commented] (YARN-4511) Common scheduler changes supporting scheduler-specific implementations

2017-10-23 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16215729#comment-16215729 ] Miklos Szegedi commented on YARN-4511: -- [~leftnoteasy], [~asuresh], do you have any more comments on

[jira] [Commented] (YARN-4511) Common scheduler changes supporting scheduler-specific implementations

2017-10-23 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16215566#comment-16215566 ] Miklos Szegedi commented on YARN-4511: -- Thank you, [~haibochen] for the patch. {code} 342 //

[jira] [Commented] (YARN-6757) Refactor the usage of yarn.nodemanager.linux-container-executor.cgroups.mount-path

2017-10-23 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16215456#comment-16215456 ] Miklos Szegedi commented on YARN-6757: -- Yes, we can modify the type. > Refactor the usage of >

[jira] [Commented] (YARN-7373) The atomicity of container update in RM is not clear

2017-10-23 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16215406#comment-16215406 ] Miklos Szegedi commented on YARN-7373: -- Thank you, [~asuresh]. Yes, I agree, since we modify the node

[jira] [Commented] (YARN-4511) Common scheduler changes supporting scheduler-specific implementations

2017-10-20 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16212848#comment-16212848 ] Miklos Szegedi commented on YARN-4511: -- Thank you, [~haibochen] for the patch. {code} 342 //

[jira] [Commented] (YARN-4511) Common scheduler changes supporting scheduler-specific implementations

2017-10-19 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16211480#comment-16211480 ] Miklos Szegedi commented on YARN-4511: -- Thank you, [~haibochen] for the patch. I have a few comments.

[jira] [Commented] (YARN-7289) TestApplicationLifetimeMonitor.testApplicationLifetimeMonitor times out

2017-10-19 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16211407#comment-16211407 ] Miklos Szegedi commented on YARN-7289: -- Thank you, [~rohithsharma] and [~templedf] for the reviews.

[jira] [Updated] (YARN-7289) TestApplicationLifetimeMonitor.testApplicationLifetimeMonitor times out

2017-10-19 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7289: - Attachment: YARN-7289.003.patch > TestApplicationLifetimeMonitor.testApplicationLifetimeMonitor

[jira] [Updated] (YARN-6747) TestFSAppStarvation.testPreemptionEnable fails intermittently

2017-10-18 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-6747: - Attachment: YARN-6747.001.patch Thank you, [~templedf]. I tried to be even more specific and

[jira] [Updated] (YARN-7289) TestApplicationLifetimeMonitor.testApplicationLifetimeMonitor times out

2017-10-18 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7289: - Attachment: YARN-7289.002.patch > TestApplicationLifetimeMonitor.testApplicationLifetimeMonitor

[jira] [Commented] (YARN-7289) TestApplicationLifetimeMonitor.testApplicationLifetimeMonitor times out

2017-10-18 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210088#comment-16210088 ] Miklos Szegedi commented on YARN-7289: -- Thank you for reviewing the patch. Fair scheduler simply

[jira] [Created] (YARN-7354) Fair scheduler should support application lifetime monitor

2017-10-18 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-7354: Summary: Fair scheduler should support application lifetime monitor Key: YARN-7354 URL: https://issues.apache.org/jira/browse/YARN-7354 Project: Hadoop YARN

[jira] [Updated] (YARN-7289) TestApplicationLifetimeMonitor.testApplicationLifetimeMonitor times out

2017-10-18 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7289: - Attachment: YARN-7289.001.patch > TestApplicationLifetimeMonitor.testApplicationLifetimeMonitor

[jira] [Commented] (YARN-7289) TestApplicationLifetimeMonitor.testApplicationLifetimeMonitor times out

2017-10-18 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16209960#comment-16209960 ] Miklos Szegedi commented on YARN-7289: -- Indeed, I did some more debugging. The issue was that it ran

[jira] [Created] (YARN-7350) TestSignalContainer should check both FS and CS

2017-10-17 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-7350: Summary: TestSignalContainer should check both FS and CS Key: YARN-7350 URL: https://issues.apache.org/jira/browse/YARN-7350 Project: Hadoop YARN Issue

[jira] [Comment Edited] (YARN-7294) TestSignalContainer#testSignalRequestDeliveryToNM fails intermittently with Fair scheduler

2017-10-17 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16208438#comment-16208438 ] Miklos Szegedi edited comment on YARN-7294 at 10/17/17 9:41 PM: Thank you,

[jira] [Created] (YARN-7349) TestSignalContainer.testSignalRequestDeliveryToNM fails with attempt state is not correct

2017-10-17 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-7349: Summary: TestSignalContainer.testSignalRequestDeliveryToNM fails with attempt state is not correct Key: YARN-7349 URL: https://issues.apache.org/jira/browse/YARN-7349

[jira] [Comment Edited] (YARN-7294) TestSignalContainer#testSignalRequestDeliveryToNM fails intermittently with Fair scheduler

2017-10-17 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16208438#comment-16208438 ] Miklos Szegedi edited comment on YARN-7294 at 10/17/17 9:39 PM: Thank you,

[jira] [Commented] (YARN-7294) TestSignalContainer#testSignalRequestDeliveryToNM fails intermittently with Fair scheduler

2017-10-17 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16208438#comment-16208438 ] Miklos Szegedi commented on YARN-7294: -- Thank you, [~yufeigu] for the review. Yes, that should be a

[jira] [Commented] (YARN-5764) NUMA awareness support for launching containers

2017-10-16 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206455#comment-16206455 ] Miklos Szegedi commented on YARN-5764: -- Thank you for the patch, [~devaraj.k].

[jira] [Commented] (YARN-6384) Add configuratin to set max cpu usage when strict-resource-usage is false with cgroups

2017-10-16 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206295#comment-16206295 ] Miklos Szegedi commented on YARN-6384: -- Thank you for the patch [~lolee_k],

[jira] [Commented] (YARN-6546) SLS is slow while loading 10k queues

2017-10-16 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206260#comment-16206260 ] Miklos Szegedi commented on YARN-6546: -- Thank you for the patch [~yufeigu]. {code} 245 if

[jira] [Resolved] (YARN-4943) Add support to collect actual resource usage from cgroups

2017-10-16 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi resolved YARN-4943. -- Resolution: Duplicate > Add support to collect actual resource usage from cgroups >

[jira] [Commented] (YARN-4943) Add support to collect actual resource usage from cgroups

2017-10-12 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202875#comment-16202875 ] Miklos Szegedi commented on YARN-4943: -- [~vvasudev], YARN-6668 is very similar to this jira. Would you

[jira] [Commented] (YARN-6668) Use cgroup to get container resource utilization

2017-10-12 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202192#comment-16202192 ] Miklos Szegedi commented on YARN-6668: -- Indeed this is a duplicate. How should we coordinate? > Use

[jira] [Commented] (YARN-6384) Add configuratin to set max cpu usage when strict-resource-usage is false with cgroups

2017-10-09 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16197265#comment-16197265 ] Miklos Szegedi commented on YARN-6384: -- My opinion is that the distinction between strict and

[jira] [Updated] (YARN-7294) TestSignalContainer#testSignalRequestDeliveryToNM fails intermittently with Fair scheduler

2017-10-06 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7294: - Attachment: YARN-7294.000.patch > TestSignalContainer#testSignalRequestDeliveryToNM fails

[jira] [Created] (YARN-7294) TestSignalContainer#testSignalRequestDeliveryToNM fails intermittently with Fair scheduler

2017-10-06 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-7294: Summary: TestSignalContainer#testSignalRequestDeliveryToNM fails intermittently with Fair scheduler Key: YARN-7294 URL: https://issues.apache.org/jira/browse/YARN-7294

[jira] [Updated] (YARN-7293) ContainerLaunch.cleanupContainer may miss a starting container

2017-10-05 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7293: - Description: The relevant part of YARN-7009 needs to be backported to branch-2 (was: The relevant

[jira] [Commented] (YARN-7009) TestNMClient.testNMClientNoCleanupOnStop is flaky by design

2017-10-05 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16193970#comment-16193970 ] Miklos Szegedi commented on YARN-7009: -- Thank you, [~haibochen]. I opened YARN-7293 for the backport.

[jira] [Created] (YARN-7293) ContainerLaunch.cleanupContainer may miss a starting node

2017-10-05 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-7293: Summary: ContainerLaunch.cleanupContainer may miss a starting node Key: YARN-7293 URL: https://issues.apache.org/jira/browse/YARN-7293 Project: Hadoop YARN

[jira] [Updated] (YARN-7293) ContainerLaunch.cleanupContainer may miss a starting container

2017-10-05 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7293: - Summary: ContainerLaunch.cleanupContainer may miss a starting container (was:

[jira] [Commented] (YARN-7289) TestApplicationLifetimeMonitor.testApplicationLifetimeMonitor times out

2017-10-05 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16193382#comment-16193382 ] Miklos Szegedi commented on YARN-7289: -- It finished in about 40 seconds to me. That suggested that it

[jira] [Comment Edited] (YARN-7289) TestApplicationLifetimeMonitor.testApplicationLifetimeMonitor times out

2017-10-04 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16191993#comment-16191993 ] Miklos Szegedi edited comment on YARN-7289 at 10/4/17 8:35 PM: --- The other

[jira] [Comment Edited] (YARN-7289) TestApplicationLifetimeMonitor.testApplicationLifetimeMonitor times out

2017-10-04 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16191993#comment-16191993 ] Miklos Szegedi edited comment on YARN-7289 at 10/4/17 8:33 PM: --- The other

[jira] [Commented] (YARN-7289) TestApplicationLifetimeMonitor.testApplicationLifetimeMonitor times out

2017-10-04 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16191993#comment-16191993 ] Miklos Szegedi commented on YARN-7289: -- The other issues should be unrelated. This is just a timeout

[jira] [Comment Edited] (YARN-6747) TestFSAppStarvation.testPreemptionEnable fails intermittently

2017-10-04 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16191988#comment-16191988 ] Miklos Szegedi edited comment on YARN-6747 at 10/4/17 8:29 PM: --- Both unit

[jira] [Commented] (YARN-6747) TestFSAppStarvation.testPreemptionEnable fails intermittently

2017-10-04 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16191988#comment-16191988 ] Miklos Szegedi commented on YARN-6747: -- Both unit test issues are timeouts: {code}

[jira] [Updated] (YARN-7289) TestApplicationLifetimeMonitor.testApplicationLifetimeMonitor times out

2017-10-04 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7289: - Attachment: YARN-7289.000.patch > TestApplicationLifetimeMonitor.testApplicationLifetimeMonitor

[jira] [Created] (YARN-7289) TestApplicationLifetimeMonitor.testApplicationLifetimeMonitor times out

2017-10-04 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-7289: Summary: TestApplicationLifetimeMonitor.testApplicationLifetimeMonitor times out Key: YARN-7289 URL: https://issues.apache.org/jira/browse/YARN-7289 Project: Hadoop

[jira] [Updated] (YARN-6747) TestFSAppStarvation.testPreemptionEnable fails intermittently

2017-10-04 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-6747: - Attachment: YARN-6747.000.patch > TestFSAppStarvation.testPreemptionEnable fails intermittently >

[jira] [Commented] (YARN-6747) TestFSAppStarvation.testPreemptionEnable fails intermittently

2017-10-04 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16191558#comment-16191558 ] Miklos Szegedi commented on YARN-6747: -- I was able to reproduce this. It happens because the main test

[jira] [Assigned] (YARN-6747) TestFSAppStarvation.testPreemptionEnable fails intermittently

2017-10-04 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi reassigned YARN-6747: Assignee: Miklos Szegedi > TestFSAppStarvation.testPreemptionEnable fails intermittently >

[jira] [Commented] (YARN-7001) If shared cache upload is terminated in the middle, the temp file will never be deleted

2017-09-29 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16186756#comment-16186756 ] Miklos Szegedi commented on YARN-7001: -- [~ctrezzo], would you like to review this jira? > If shared

[jira] [Commented] (YARN-4599) Set OOM control for memory cgroups

2017-09-29 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16186681#comment-16186681 ] Miklos Szegedi commented on YARN-4599: -- [~sandflee], do you plan to continue working on the patch? I

[jira] [Commented] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-09-28 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16184415#comment-16184415 ] Miklos Szegedi commented on YARN-6623: -- If the decision is to ignore this bug for beta1, how about

[jira] [Updated] (YARN-7009) TestNMClient.testNMClientNoCleanupOnStop is flaky by design

2017-09-27 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7009: - Attachment: YARN-7009.007.patch > TestNMClient.testNMClientNoCleanupOnStop is flaky by design >

[jira] [Updated] (YARN-7009) TestNMClient.testNMClientNoCleanupOnStop is flaky by design

2017-09-27 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7009: - Attachment: YARN-7009.006.patch > TestNMClient.testNMClientNoCleanupOnStop is flaky by design >

[jira] [Commented] (YARN-1014) Configure OOM Killer to kill OPPORTUNISTIC containers first

2017-09-25 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179775#comment-16179775 ] Miklos Szegedi commented on YARN-1014: -- Thank you for the patch [~haibochen]. I have a few comments:

[jira] [Comment Edited] (YARN-7009) TestNMClient.testNMClientNoCleanupOnStop is flaky by design

2017-09-22 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16176865#comment-16176865 ] Miklos Szegedi edited comment on YARN-7009 at 9/22/17 6:20 PM: --- Thank you for

[jira] [Updated] (YARN-7009) TestNMClient.testNMClientNoCleanupOnStop is flaky by design

2017-09-22 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7009: - Attachment: YARN-7009.005.patch Thank you for the review [~haibochen] and [~templedf]. I updated

[jira] [Commented] (YARN-6968) Hardcoded absolute pathname in DockerLinuxContainerRuntime

2017-09-21 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16175360#comment-16175360 ] Miklos Szegedi commented on YARN-6968: -- Thank you, [~ebadger] and [~jlowe] for working on this! It is

[jira] [Updated] (YARN-7239) Possible launch/cleanup race condition in ContainersLauncher

2017-09-21 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7239: - Description: ContainersLauncher.handle() submits the launch job and then adds the job into the

[jira] [Updated] (YARN-7009) TestNMClient.testNMClientNoCleanupOnStop is flaky by design

2017-09-21 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7009: - Attachment: YARN-7009.004.patch Thank you, [~asuresh] for the review. I updated the patch. In

[jira] [Created] (YARN-7239) Possible launch/cleanup race condition in ContainersLauncher

2017-09-21 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-7239: Summary: Possible launch/cleanup race condition in ContainersLauncher Key: YARN-7239 URL: https://issues.apache.org/jira/browse/YARN-7239 Project: Hadoop YARN

[jira] [Commented] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-09-21 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16175249#comment-16175249 ] Miklos Szegedi commented on YARN-6623: -- Indeed, I verified and we still need the strlen in the first

[jira] [Commented] (YARN-6546) SLS is slow while loading 10k queues

2017-09-21 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16175225#comment-16175225 ] Miklos Szegedi commented on YARN-6546: -- Thank you for the patch [~yufeigu]. If I understand well we

[jira] [Created] (YARN-7233) Make the cgroup mount into Docker containers configurable

2017-09-20 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-7233: Summary: Make the cgroup mount into Docker containers configurable Key: YARN-7233 URL: https://issues.apache.org/jira/browse/YARN-7233 Project: Hadoop YARN

[jira] [Created] (YARN-7232) Consider /sys/fs/cgroup as the default CGroup mount path

2017-09-20 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-7232: Summary: Consider /sys/fs/cgroup as the default CGroup mount path Key: YARN-7232 URL: https://issues.apache.org/jira/browse/YARN-7232 Project: Hadoop YARN

[jira] [Commented] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-09-20 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16173952#comment-16173952 ] Miklos Szegedi commented on YARN-6623: -- [~vvasudev], thank you for the updated patch. I will review it

[jira] [Commented] (YARN-6968) Hardcoded absolute pathname in DockerLinuxContainerRuntime

2017-09-20 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16173925#comment-16173925 ] Miklos Szegedi commented on YARN-6968: -- Ah I see. Yes it also sounds too general How about "Make

[jira] [Updated] (YARN-7009) TestNMClient.testNMClientNoCleanupOnStop is flaky by design

2017-09-20 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7009: - Attachment: YARN-7009.003.patch Submitting new patch. > TestNMClient.testNMClientNoCleanupOnStop

[jira] [Commented] (YARN-6968) Hardcoded absolute pathname in DockerLinuxContainerRuntime

2017-09-20 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16173898#comment-16173898 ] Miklos Szegedi commented on YARN-6968: -- Thank you, [~ebadger] for the patch and [~jlowe] for the

[jira] [Commented] (YARN-7009) TestNMClient.testNMClientNoCleanupOnStop is flaky by design

2017-09-20 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16173858#comment-16173858 ] Miklos Szegedi commented on YARN-7009: -- Thank you for the review and comments, [~asuresh], [~templedf]

[jira] [Commented] (YARN-6968) Hard coded reference to an absolute pathname in org.apache.hadoop.yarn.server.nodemanager.containermanager.linux.runtime.DockerLinuxContainerRuntime.launchContainer(Cont

2017-09-20 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16173635#comment-16173635 ] Miklos Szegedi commented on YARN-6968: -- Thank you, [~ebadger]. bq. In this JIRA we just want that

[jira] [Commented] (YARN-6943) Update Yarn to YARN in documentation

2017-09-20 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16173433#comment-16173433 ] Miklos Szegedi commented on YARN-6943: -- +1 (non-binding) It looks good to me. Thank you for working on

[jira] [Commented] (YARN-6968) Hard coded reference to an absolute pathname in org.apache.hadoop.yarn.server.nodemanager.containermanager.linux.runtime.DockerLinuxContainerRuntime.launchContainer(Cont

2017-09-20 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16173337#comment-16173337 ] Miklos Szegedi commented on YARN-6968: -- Thank you, [~ebadger] for working on this and submitting the

[jira] [Commented] (YARN-6943) Update Yarn to YARN in documentation

2017-09-19 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16172106#comment-16172106 ] Miklos Szegedi commented on YARN-6943: -- Thank you for signing up. I assigned it to you [~chetna]. >

[jira] [Assigned] (YARN-6943) Update Yarn to YARN in documentation

2017-09-19 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi reassigned YARN-6943: Assignee: Chetna Chaudhari > Update Yarn to YARN in documentation >

[jira] [Commented] (YARN-5534) Allow whitelisted volume mounts

2017-09-19 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16172102#comment-16172102 ] Miklos Szegedi commented on YARN-5534: -- Thank you, [~eyang] for sharing your thoughts. Sorry, I am

[jira] [Commented] (YARN-7034) DefaultLinuxContainerRuntime and DockerLinuxContainerRuntime sends client environment variables to container-executor

2017-09-19 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16172087#comment-16172087 ] Miklos Szegedi commented on YARN-7034: -- [~shaneku...@gmail.com], do you have any other comments? >

[jira] [Commented] (YARN-7034) DefaultLinuxContainerRuntime and DockerLinuxContainerRuntime sends client environment variables to container-executor

2017-09-19 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16172086#comment-16172086 ] Miklos Szegedi commented on YARN-7034: -- The unit test is a flaky one. See YARN-7145 Identify potential

[jira] [Commented] (YARN-7001) If shared cache upload is terminated in the middle, the temp file will never be deleted

2017-09-19 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16172026#comment-16172026 ] Miklos Szegedi commented on YARN-7001: -- Thank you, [~Sen Zhao] for the patch. Could you add a unit

[jira] [Commented] (YARN-5534) Allow whitelisted volume mounts

2017-09-18 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16170610#comment-16170610 ] Miklos Szegedi commented on YARN-5534: -- Thank you, [~eyang] for the comment. Can you please clarify

[jira] [Comment Edited] (YARN-5534) Allow whitelisted volume mounts

2017-09-18 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16168728#comment-16168728 ] Miklos Szegedi edited comment on YARN-5534 at 9/18/17 7:25 PM: --- [~eyang] I

[jira] [Commented] (YARN-7207) Cache the local host name when getting application list in RM

2017-09-15 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16168732#comment-16168732 ] Miklos Szegedi commented on YARN-7207: -- Thank you [~yufeigu] for reporting this. Please also run a

[jira] [Commented] (YARN-5534) Allow whitelisted volume mounts

2017-09-15 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16168728#comment-16168728 ] Miklos Szegedi commented on YARN-5534: -- [~eyang] I would approach this from the user point of new.

[jira] [Commented] (YARN-7192) Add a pluggable StateMachine Listener that is notified of NM Container State changes

2017-09-15 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16168403#comment-16168403 ] Miklos Szegedi commented on YARN-7192: -- +1 (non-binding) Thank you [~asuresh], the latest patch looks

[jira] [Commented] (YARN-7192) Add a pluggable StateMachine Listener that is notified of NM Container State changes

2017-09-15 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16168238#comment-16168238 ] Miklos Szegedi commented on YARN-7192: -- Thank you [~asuresh] for the updated patch. bq. Hmm.. it is

[jira] [Updated] (YARN-7034) DefaultLinuxContainerRuntime and DockerLinuxContainerRuntime sends client environment variables to container-executor

2017-09-15 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7034: - Attachment: YARN-7034.006.patch YARN-7034.branch-2.006.patch

[jira] [Commented] (YARN-7034) DefaultLinuxContainerRuntime and DockerLinuxContainerRuntime sends client environment variables to container-executor

2017-09-15 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16168180#comment-16168180 ] Miklos Szegedi commented on YARN-7034: -- Thank you, [~shaneku...@gmail.com] for the review.

<    1   2   3   4   5   6   7   8   9   10   >