[jira] [Commented] (YARN-8320) [Umbrella] Support CPU isolation for latency-sensitive (LS) service

2018-05-28 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16493112#comment-16493112 ] Miklos Szegedi commented on YARN-8320: -- Thank you, [~cheersyang]. For the responses. They make sense

[jira] [Commented] (YARN-6677) Preempt opportunistic containers when root container cgroup goes over memory limit

2018-05-28 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16493085#comment-16493085 ] Miklos Szegedi commented on YARN-6677: -- Thank you, [~haibochen] for the patch. {code:java} // Reverse

[jira] [Updated] (YARN-8310) Handle old NMTokenIdentifier, AMRMTokenIdentifier, and ContainerTokenIdentifier formats

2018-05-24 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-8310: - Fix Version/s: (was: 3.0.x) 3.0.3 > Handle old NMTokenIdentifier,

[jira] [Updated] (YARN-8310) Handle old NMTokenIdentifier, AMRMTokenIdentifier, and ContainerTokenIdentifier formats

2018-05-24 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-8310: - Fix Version/s: 3.0.x 3.1.1 2.10.0 > Handle old

[jira] [Updated] (YARN-5764) NUMA awareness support for launching containers

2018-05-24 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-5764: - Fix Version/s: 3.2.0 3.1.0 > NUMA awareness support for launching containers >

[jira] [Commented] (YARN-8320) [Umbrella] Support CPU isolation for latency-sensitive (LS) service

2018-05-24 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16489398#comment-16489398 ] Miklos Szegedi commented on YARN-8320: -- [~cheersyang] / [~yangjiandan], thank you for raising this,

[jira] [Commented] (YARN-4599) Set OOM control for memory cgroups

2018-05-23 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16487742#comment-16487742 ] Miklos Szegedi commented on YARN-4599: -- The unit test issues are not related to the patch. > Set OOM

[jira] [Updated] (YARN-4599) Set OOM control for memory cgroups

2018-05-22 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-4599: - Attachment: YARN-4599.016.patch > Set OOM control for memory cgroups >

[jira] [Commented] (YARN-8310) Handle old NMTokenIdentifier, AMRMTokenIdentifier, and ContainerTokenIdentifier formats

2018-05-22 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16486637#comment-16486637 ] Miklos Szegedi commented on YARN-8310: -- I will backport this to branches branch-2, branch-3.0 and

[jira] [Commented] (YARN-8310) Handle old NMTokenIdentifier, AMRMTokenIdentifier, and ContainerTokenIdentifier formats

2018-05-22 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16486628#comment-16486628 ] Miklos Szegedi commented on YARN-8310: -- Committed to trunk. Thank you for the patch [~rkanter] and for

[jira] [Commented] (YARN-8310) Handle old NMTokenIdentifier, AMRMTokenIdentifier, and ContainerTokenIdentifier formats

2018-05-22 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16486626#comment-16486626 ] Miklos Szegedi commented on YARN-8310: -- +1 LGTM. > Handle old NMTokenIdentifier, AMRMTokenIdentifier,

[jira] [Commented] (YARN-8310) Handle old NMTokenIdentifier, AMRMTokenIdentifier, and ContainerTokenIdentifier formats

2018-05-17 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16479685#comment-16479685 ] Miklos Szegedi commented on YARN-8310: -- Thank you for the patch [~rkanter]. I have a couple of

[jira] [Updated] (YARN-4599) Set OOM control for memory cgroups

2018-05-17 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-4599: - Attachment: YARN-4599.015.patch > Set OOM control for memory cgroups >

[jira] [Updated] (YARN-4599) Set OOM control for memory cgroups

2018-05-16 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-4599: - Attachment: YARN-4599.014.patch > Set OOM control for memory cgroups >

[jira] [Updated] (YARN-4599) Set OOM control for memory cgroups

2018-05-16 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-4599: - Attachment: YARN-4599.013.patch > Set OOM control for memory cgroups >

[jira] [Updated] (YARN-4599) Set OOM control for memory cgroups

2018-05-16 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-4599: - Attachment: YARN-4599.012.patch > Set OOM control for memory cgroups >

[jira] [Commented] (YARN-4599) Set OOM control for memory cgroups

2018-05-16 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16478004#comment-16478004 ] Miklos Szegedi commented on YARN-4599: -- [~snemeth], thanks for the review. oomHandlerTemp is

[jira] [Comment Edited] (YARN-7715) Support NM promotion/demotion of running containers.

2018-05-16 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16477692#comment-16477692 ] Miklos Szegedi edited comment on YARN-7715 at 5/16/18 4:34 PM: ---

[jira] [Commented] (YARN-7715) Support NM promotion/demotion of running containers.

2018-05-16 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16477692#comment-16477692 ] Miklos Szegedi commented on YARN-7715: -- [~yangjiandan], none of these are the job of this jira. This

[jira] [Updated] (YARN-4599) Set OOM control for memory cgroups

2018-05-16 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-4599: - Attachment: YARN-4599.011.patch > Set OOM control for memory cgroups >

[jira] [Commented] (YARN-4599) Set OOM control for memory cgroups

2018-05-16 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16477620#comment-16477620 ] Miklos Szegedi commented on YARN-4599: -- Fixing 2 checkstyle issues. > Set OOM control for memory

[jira] [Updated] (YARN-4599) Set OOM control for memory cgroups

2018-05-16 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-4599: - Attachment: YARN-4599.010.patch > Set OOM control for memory cgroups >

[jira] [Commented] (YARN-4599) Set OOM control for memory cgroups

2018-05-16 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16477614#comment-16477614 ] Miklos Szegedi commented on YARN-4599: -- The HDFS test failures are unrelated. > Set OOM control for

[jira] [Commented] (YARN-7715) Support NM promotion/demotion of running containers.

2018-05-15 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16476852#comment-16476852 ] Miklos Szegedi commented on YARN-7715: -- updateContainer only supports execution type updates so far. A

[jira] [Updated] (YARN-4599) Set OOM control for memory cgroups

2018-05-15 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-4599: - Attachment: YARN-4599.009.patch > Set OOM control for memory cgroups >

[jira] [Updated] (YARN-4599) Set OOM control for memory cgroups

2018-05-15 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-4599: - Attachment: YARN-4599.008.patch > Set OOM control for memory cgroups >

[jira] [Comment Edited] (YARN-4599) Set OOM control for memory cgroups

2018-05-15 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16476365#comment-16476365 ] Miklos Szegedi edited comment on YARN-4599 at 5/15/18 10:09 PM: Thanks for

[jira] [Commented] (YARN-7715) Support NM promotion/demotion of running containers.

2018-05-15 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16476409#comment-16476409 ] Miklos Szegedi commented on YARN-7715: -- cgroups should work independently of the AM I think. In fact

[jira] [Updated] (YARN-4599) Set OOM control for memory cgroups

2018-05-15 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-4599: - Attachment: YARN-4599.007.patch > Set OOM control for memory cgroups >

[jira] [Commented] (YARN-4599) Set OOM control for memory cgroups

2018-05-15 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16476365#comment-16476365 ] Miklos Szegedi commented on YARN-4599: -- Thanks for the review [~snemeth]. {quote}{quote} [Question] In

[jira] [Commented] (YARN-4599) Set OOM control for memory cgroups

2018-05-14 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16475059#comment-16475059 ] Miklos Szegedi commented on YARN-4599: -- {quote}bq. Is 'descriptors->event_control_fd = -1;' 

[jira] [Updated] (YARN-4599) Set OOM control for memory cgroups

2018-05-11 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-4599: - Attachment: Elastic Memory Control in YARN.pdf > Set OOM control for memory cgroups >

[jira] [Updated] (YARN-4599) Set OOM control for memory cgroups

2018-05-11 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-4599: - Attachment: YARN-4599.006.patch > Set OOM control for memory cgroups >

[jira] [Commented] (YARN-8275) Create a JNI interface to interact with Windows

2018-05-11 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16472663#comment-16472663 ] Miklos Szegedi commented on YARN-8275: -- [~giovanni.fumarola], I am curious about your opinion about

[jira] [Updated] (YARN-4599) Set OOM control for memory cgroups

2018-05-10 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-4599: - Attachment: YARN-4599.005.patch > Set OOM control for memory cgroups >

[jira] [Commented] (YARN-4599) Set OOM control for memory cgroups

2018-05-10 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16470881#comment-16470881 ] Miklos Szegedi commented on YARN-4599: -- Fixing unit tests. [~asuresh], FYI this patch affects

[jira] [Updated] (YARN-4599) Set OOM control for memory cgroups

2018-05-10 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-4599: - Attachment: YARN-4599.004.patch > Set OOM control for memory cgroups >

[jira] [Updated] (YARN-4599) Set OOM control for memory cgroups

2018-05-09 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-4599: - Attachment: YARN-4599.003.patch > Set OOM control for memory cgroups >

[jira] [Commented] (YARN-4599) Set OOM control for memory cgroups

2018-05-09 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16469907#comment-16469907 ] Miklos Szegedi commented on YARN-4599: -- HDFS is not related to the patch. > Set OOM control for

[jira] [Commented] (YARN-8250) Create another implementation of ContainerScheduler to support NM overallocation

2018-05-09 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16469553#comment-16469553 ] Miklos Szegedi commented on YARN-8250: -- I think the first and the last checkstyle comments could be

[jira] [Commented] (YARN-8250) Create another implementation of ContainerScheduler to support NM overallocation

2018-05-09 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16469378#comment-16469378 ] Miklos Szegedi commented on YARN-8250: -- Thank you for the updated patch [~haibochen]. {code:java} if

[jira] [Updated] (YARN-8090) Race conditions in FadvisedChunkedFile

2018-05-08 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-8090: - Attachment: YARN-8090.002.patch > Race conditions in FadvisedChunkedFile >

[jira] [Commented] (YARN-8090) Race conditions in FadvisedChunkedFile

2018-05-08 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16468068#comment-16468068 ] Miklos Szegedi commented on YARN-8090: -- Thank you for the review [~haibochen]. I updated the patch. >

[jira] [Updated] (YARN-4599) Set OOM control for memory cgroups

2018-05-08 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-4599: - Attachment: YARN-4599.002.patch > Set OOM control for memory cgroups >

[jira] [Commented] (YARN-4599) Set OOM control for memory cgroups

2018-05-08 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16468062#comment-16468062 ] Miklos Szegedi commented on YARN-4599: -- Fixing unit test. > Set OOM control for memory cgroups >

[jira] [Commented] (YARN-8250) Create another implementation of ContainerScheduler to support NM overallocation

2018-05-08 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16468020#comment-16468020 ] Miklos Szegedi commented on YARN-8250: -- Thanks for the patch, [~haibochen]. ContainerScheduler could

[jira] [Updated] (YARN-7715) Update CPU and Memory cgroups params on container update as well.

2018-05-08 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7715: - Attachment: YARN-7715.004.patch > Update CPU and Memory cgroups params on container update as

[jira] [Commented] (YARN-4599) Set OOM control for memory cgroups

2018-05-08 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16467721#comment-16467721 ] Miklos Szegedi commented on YARN-4599: -- The build issue seems to be unrelated. Restarting the build.

[jira] [Created] (YARN-8262) get_executable in container-executor should provide meaningful error codes

2018-05-08 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-8262: Summary: get_executable in container-executor should provide meaningful error codes Key: YARN-8262 URL: https://issues.apache.org/jira/browse/YARN-8262 Project:

[jira] [Updated] (YARN-4599) Set OOM control for memory cgroups

2018-05-07 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-4599: - Attachment: YARN-4599.001.patch > Set OOM control for memory cgroups >

[jira] [Updated] (YARN-7715) Update CPU and Memory cgroups params on container update as well.

2018-05-07 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7715: - Attachment: YARN-7715.003.patch > Update CPU and Memory cgroups params on container update as

[jira] [Commented] (YARN-7715) Update CPU and Memory cgroups params on container update as well.

2018-05-07 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466274#comment-16466274 ] Miklos Szegedi commented on YARN-7715: -- Thank you for the review [~haibochen]. I added a unit test

[jira] [Commented] (YARN-7715) Update CPU and Memory cgroups params on container update as well.

2018-05-04 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16464275#comment-16464275 ] Miklos Szegedi commented on YARN-7715: -- Thank you for the review [~haibochen]. I updated the patch. >

[jira] [Updated] (YARN-7715) Update CPU and Memory cgroups params on container update as well.

2018-05-04 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7715: - Attachment: YARN-7715.002.patch > Update CPU and Memory cgroups params on container update as

[jira] [Updated] (YARN-7715) Update CPU and Memory cgroups params on container update as well.

2018-05-03 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7715: - Attachment: YARN-7715.001.patch > Update CPU and Memory cgroups params on container update as

[jira] [Commented] (YARN-8244) ContainersLauncher.ContainerLaunch can throw ConcurrentModificationException

2018-05-03 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16463247#comment-16463247 ] Miklos Szegedi commented on YARN-8244: -- This happens with

[jira] [Created] (YARN-8244) ContainersLauncher.ContainerLaunch can throw ConcurrentModificationException

2018-05-03 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-8244: Summary: ContainersLauncher.ContainerLaunch can throw ConcurrentModificationException Key: YARN-8244 URL: https://issues.apache.org/jira/browse/YARN-8244 Project:

[jira] [Commented] (YARN-7715) Update CPU and Memory cgroups params on container update as well.

2018-05-02 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16461797#comment-16461797 ] Miklos Szegedi commented on YARN-7715: -- [~asuresh], [~haibo.chen] I attached a patch of my proposal.

[jira] [Updated] (YARN-7715) Update CPU and Memory cgroups params on container update as well.

2018-05-02 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7715: - Attachment: YARN-7715.000.patch > Update CPU and Memory cgroups params on container update as

[jira] [Commented] (YARN-7715) Update CPU and Memory cgroups params on container update as well.

2018-05-02 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16461741#comment-16461741 ] Miklos Szegedi commented on YARN-7715: -- I am working on a preliminary patch to discuss. Do you think

[jira] [Assigned] (YARN-7715) Update CPU and Memory cgroups params on container update as well.

2018-05-02 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi reassigned YARN-7715: Assignee: Miklos Szegedi > Update CPU and Memory cgroups params on container update as

[jira] [Commented] (YARN-4599) Set OOM control for memory cgroups

2018-05-02 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16461681#comment-16461681 ] Miklos Szegedi commented on YARN-4599: -- [~aw], [~haibo.chen], [~kasha], [~mding], [~sandflee],

[jira] [Updated] (YARN-4599) Set OOM control for memory cgroups

2018-04-30 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-4599: - Attachment: YARN-4599.000.patch > Set OOM control for memory cgroups >

[jira] [Commented] (YARN-4599) Set OOM control for memory cgroups

2018-04-30 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16458806#comment-16458806 ] Miklos Szegedi commented on YARN-4599: -- I will provide the patch shortly. Here are the design

[jira] [Commented] (YARN-6675) Add NM support to launch opportunistic containers based on overallocation

2018-04-20 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16446378#comment-16446378 ] Miklos Szegedi commented on YARN-6675: -- +1 pending Jenkins. > Add NM support to launch opportunistic

[jira] [Commented] (YARN-6675) Add NM support to launch opportunistic containers based on overallocation

2018-04-20 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16446344#comment-16446344 ] Miklos Szegedi commented on YARN-6675: -- Thank you for the patch [~haibochen]. Can you address this

[jira] [Commented] (YARN-8090) Race conditions in FadvisedChunkedFile

2018-04-20 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16445915#comment-16445915 ] Miklos Szegedi commented on YARN-8090: -- Thank you for the comments [~grepas]. I updated the patch. >

[jira] [Updated] (YARN-8090) Race conditions in FadvisedChunkedFile

2018-04-20 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-8090: - Attachment: YARN-8090.001.patch > Race conditions in FadvisedChunkedFile >

[jira] [Commented] (YARN-8037) CGroupsResourceCalculator logs excessive warnings on container relaunch

2018-04-09 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16431526#comment-16431526 ] Miklos Szegedi commented on YARN-8037: -- Thank you, [~shaneku...@gmail.com]. How about hashing the

[jira] [Updated] (YARN-8090) Race conditions in FadvisedChunkedFile

2018-04-04 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-8090: - Attachment: YARN-8090.000.patch > Race conditions in FadvisedChunkedFile >

[jira] [Commented] (YARN-8035) Uncaught exception in ContainersMonitorImpl during relaunch due to the process ID changing

2018-04-03 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16424406#comment-16424406 ] Miklos Szegedi commented on YARN-8035: -- +1 LGTM. Thank you for the patch [~shaneku...@gmail.com]. I

[jira] [Commented] (YARN-6739) Crash NM at start time if oversubscription is on but LinuxContainerExcutor or cgroup is off

2018-04-02 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16423197#comment-16423197 ] Miklos Szegedi commented on YARN-6739: -- +1 Thank you for the patch [~haibochen]. > Crash NM at start

[jira] [Commented] (YARN-8077) The vmemLimit parameter in ContainersMonitorImpl#isProcessTreeOverLimit is confusing

2018-03-29 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16419921#comment-16419921 ] Miklos Szegedi commented on YARN-8077: -- The patch is integrated in trunk. > The vmemLimit parameter

[jira] [Commented] (YARN-8090) Race conditions in FadvisedChunkedFile

2018-03-29 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16419898#comment-16419898 ] Miklos Szegedi commented on YARN-8090: -- I have seen a similar race condition in the shuffle handler

[jira] [Created] (YARN-8090) Race conditions in FadvisedChunkedFile

2018-03-29 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-8090: Summary: Race conditions in FadvisedChunkedFile Key: YARN-8090 URL: https://issues.apache.org/jira/browse/YARN-8090 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-8077) The vmemLimit parameter in ContainersMonitorImpl#isProcessTreeOverLimit is confusing

2018-03-28 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417735#comment-16417735 ] Miklos Szegedi commented on YARN-8077: -- The Jenkins failure seems to be unrelated (protoc). Let me

[jira] [Issue Comment Deleted] (YARN-8077) The vmemLimit parameter in ContainersMonitorImpl#isProcessTreeOverLimit is confusing

2018-03-28 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-8077: - Comment: was deleted (was: Committed to trunk.) > The vmemLimit parameter in

[jira] [Commented] (YARN-8077) The vmemLimit parameter in ContainersMonitorImpl#isProcessTreeOverLimit is confusing

2018-03-27 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16416040#comment-16416040 ] Miklos Szegedi commented on YARN-8077: -- +1 LGTM. Thank you for raising this [~Sen Zhao] and for the

[jira] [Updated] (YARN-8039) Clean up log dir configuration in TestLinuxContainerExecutorWithMocks.testStartLocalizer

2018-03-16 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-8039: - Attachment: YARN-8039.000.patch > Clean up log dir configuration in >

[jira] [Commented] (YARN-8031) NodeManager will fail to start if cpu subsystem is already mounted

2018-03-16 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16402162#comment-16402162 ] Miklos Szegedi commented on YARN-8031: -- [~jayceAu], thank you for raising this. If you have CGroups

[jira] [Created] (YARN-8039) Clean up log dir configuration in TestLinuxContainerExecutorWithMocks.testStartLocalizer

2018-03-16 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-8039: Summary: Clean up log dir configuration in TestLinuxContainerExecutorWithMocks.testStartLocalizer Key: YARN-8039 URL: https://issues.apache.org/jira/browse/YARN-8039

[jira] [Commented] (YARN-8037) CGroupsResourceCalculator excessive warnings on container relaunch

2018-03-16 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16402121#comment-16402121 ] Miklos Szegedi commented on YARN-8037: -- Thank you, [~shaneku...@gmail.com] for raising this.

[jira] [Commented] (YARN-5764) NUMA awareness support for launching containers

2018-03-13 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397531#comment-16397531 ] Miklos Szegedi commented on YARN-5764: -- Committed to trunk. Thank you for the contribution 

[jira] [Commented] (YARN-5764) NUMA awareness support for launching containers

2018-03-09 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16393396#comment-16393396 ] Miklos Szegedi commented on YARN-5764: -- +1 LGTM pending Jenkins. I will commit this shortly

[jira] [Commented] (YARN-5764) NUMA awareness support for launching containers

2018-03-09 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16393265#comment-16393265 ] Miklos Szegedi commented on YARN-5764: -- [~devaraj.k], could you address the two checkstyle issues? >

[jira] [Commented] (YARN-5764) NUMA awareness support for launching containers

2018-03-08 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16392213#comment-16392213 ] Miklos Szegedi commented on YARN-5764: -- Thank you, [~devaraj.k]. The patch looks good to me in

[jira] [Commented] (YARN-8009) YARN limit number of simultaneously running containers in the application level

2018-03-07 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390116#comment-16390116 ] Miklos Szegedi commented on YARN-8009: -- Thank you for raising this [~sachinjose2...@gmail.com].

[jira] [Commented] (YARN-7626) Allow regular expression matching in container-executor.cfg for devices and named docker volumes mount

2018-03-07 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390095#comment-16390095 ] Miklos Szegedi commented on YARN-7626: -- Thank you for the contribution [~Zian Chen] and for the commit

[jira] [Commented] (YARN-5764) NUMA awareness support for launching containers

2018-03-05 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16387021#comment-16387021 ] Miklos Szegedi commented on YARN-5764: -- Thank you, [~devaraj.k] for the updated patch. {code:java}

[jira] [Commented] (YARN-7626) Allow regular expression matching in container-executor.cfg for devices and named docker volumes mount

2018-03-05 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16386738#comment-16386738 ] Miklos Szegedi commented on YARN-7626: -- Thank you for the patch [~Zian Chen] and for the review

[jira] [Commented] (YARN-7626) Allow regular expression matching in container-executor.cfg for devices and named docker volumes mount

2018-02-20 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16370401#comment-16370401 ] Miklos Szegedi commented on YARN-7626: -- Indeed there is not there any substantial difference other

[jira] [Commented] (YARN-7626) Allow regular expression matching in container-executor.cfg for devices and named docker volumes mount

2018-02-13 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16363078#comment-16363078 ] Miklos Szegedi commented on YARN-7626: -- Thank you for the patch [~Zian Chen]. {code:java} return !(len

[jira] [Commented] (YARN-5764) NUMA awareness support for launching containers

2018-02-12 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16361284#comment-16361284 ] Miklos Szegedi commented on YARN-5764: -- [~devaraj.k], thank you for the reply. Did you update the

[jira] [Commented] (YARN-7626) Allow regular expression matching in container-executor.cfg for devices and named docker volumes mount

2018-02-08 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16357340#comment-16357340 ] Miklos Szegedi commented on YARN-7626: -- Thank you, [~Zian Chen] for the reply and update. Your latest

[jira] [Commented] (YARN-7859) New feature: add queue scheduling deadLine in fairScheduler.

2018-02-06 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354632#comment-16354632 ] Miklos Szegedi commented on YARN-7859: -- Never mind, I found the location for the compare. Please

[jira] [Commented] (YARN-7859) New feature: add queue scheduling deadLine in fairScheduler.

2018-02-06 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354266#comment-16354266 ] Miklos Szegedi commented on YARN-7859: -- [~wangwj], thank you for the patch. Sorry, I think there is a

[jira] [Commented] (YARN-7859) New feature: add queue scheduling deadLine in fairScheduler.

2018-02-05 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353084#comment-16353084 ] Miklos Szegedi commented on YARN-7859: -- [~wangwj], thank you for the debugging, patch and the

[jira] [Commented] (YARN-7876) Localized jars that are expanded after localization are not fully copied

2018-02-05 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353017#comment-16353017 ] Miklos Szegedi commented on YARN-7876: -- Thank you for committing this [~jlowe]! > Localized jars that

[jira] [Commented] (YARN-7857) -fstack-check compilation flag causes binary incompatibility for container-executor between RHEL 6 and RHEL 7

2018-02-05 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16352824#comment-16352824 ] Miklos Szegedi commented on YARN-7857: -- [~Jim_Brennan], I agree let's postpone removing the guard. The

[jira] [Commented] (YARN-6739) Crash NM at start time if oversubscription is on but LinuxContainerExcutor or cgroup is off

2018-02-02 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16351267#comment-16351267 ] Miklos Szegedi commented on YARN-6739: -- Thank you, [~haibochen] for the patch. {code:java} void

<    1   2   3   4   5   6   7   8   9   10   >