[jira] [Commented] (YARN-7879) NM user is unable to access the application filecache due to permissions

2018-02-02 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16351148#comment-16351148 ] Miklos Szegedi commented on YARN-7879: -- +1 I will commit this shortly. > NM user is unable to access

[jira] [Commented] (YARN-7879) NM user is unable to access the application filecache due to permissions

2018-02-02 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16351061#comment-16351061 ] Miklos Szegedi commented on YARN-7879: -- Thank you, [~shaneku...@gmail.com] for the report, [~jlowe]

[jira] [Commented] (YARN-6456) Isolation of Docker containers In LinuxContainerExecutor

2018-02-02 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16350942#comment-16350942 ] Miklos Szegedi commented on YARN-6456: -- Sure, I would keep the description just for context but let

[jira] [Commented] (YARN-6456) Isolation of Docker containers In LinuxContainerExecutor

2018-02-02 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16350787#comment-16350787 ] Miklos Szegedi commented on YARN-6456: -- Sure, I made it as a subtask. Are you referring to #3 as this?

[jira] [Updated] (YARN-6456) Isolation of Docker containers In LinuxContainerExecutor

2018-02-02 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-6456: - Issue Type: Sub-task (was: Bug) Parent: YARN-3611 > Isolation of Docker containers In

[jira] [Commented] (YARN-7857) -fstack-check compilation flag causes binary incompatibility for container-executor between RHEL 6 and RHEL 7

2018-02-02 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16350781#comment-16350781 ] Miklos Szegedi commented on YARN-7857: -- Thank you, [~Jim_Brennan] for the patch. I am a little bit

[jira] [Comment Edited] (YARN-7876) Localized jars that are expanded after localization are not fully copied

2018-02-02 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16350762#comment-16350762 ] Miklos Szegedi edited comment on YARN-7876 at 2/2/18 6:19 PM: -- Thank you

[jira] [Commented] (YARN-7876) Localized jars that are expanded after localization are not fully copied

2018-02-02 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16350762#comment-16350762 ] Miklos Szegedi commented on YARN-7876: -- Thank you [~grepas] for the review and [~jlowe] for updating

[jira] [Updated] (YARN-7876) Localized jars that are expanded after localization are not fully copied

2018-02-02 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7876: - Summary: Localized jars that are expanded after localization are not fully copied (was: Localized

[jira] [Updated] (YARN-7876) Localized jars that are expanded during localization are not fully copied

2018-02-02 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7876: - Attachment: YARN-7876.001.patch > Localized jars that are expanded during localization are not

[jira] [Updated] (YARN-7876) Workaround ZipInputStream limitation for YARN-2185

2018-02-01 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7876: - Attachment: YARN-7876.000.patch > Workaround ZipInputStream limitation for YARN-2185 >

[jira] [Created] (YARN-7876) Workaround ZipInputStream limitation for YARN-2185

2018-02-01 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-7876: Summary: Workaround ZipInputStream limitation for YARN-2185 Key: YARN-7876 URL: https://issues.apache.org/jira/browse/YARN-7876 Project: Hadoop YARN Issue

[jira] [Assigned] (YARN-4599) Set OOM control for memory cgroups

2018-01-31 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi reassigned YARN-4599: Assignee: Miklos Szegedi (was: sandflee) > Set OOM control for memory cgroups >

[jira] [Commented] (YARN-4599) Set OOM control for memory cgroups

2018-01-31 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347259#comment-16347259 ] Miklos Szegedi commented on YARN-4599: -- Thank you, [~sandflee]. I am working on a patch now. > Set

[jira] [Commented] (YARN-7857) -fstack-check compilation flag causes binary incompatibility for container-executor between RHEL 6 and RHEL 7

2018-01-31 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16346985#comment-16346985 ] Miklos Szegedi commented on YARN-7857: -- Thank you, [~Jim_Brennan] for raising this. Indeed, you are

[jira] [Commented] (YARN-2185) Use pipes when localizing archives

2018-01-30 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16345961#comment-16345961 ] Miklos Szegedi commented on YARN-2185: -- ~[~rohithsharma] I am sorry about the inconvenience.

[jira] [Updated] (YARN-2185) Use pipes when localizing archives

2018-01-30 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-2185: - Attachment: YARN-2185.014.patch > Use pipes when localizing archives >

[jira] [Updated] (YARN-2185) Use pipes when localizing archives

2018-01-30 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-2185: - Attachment: YARN-2185.013.patch > Use pipes when localizing archives >

[jira] [Commented] (YARN-7815) Mount the filecache as read-only in Docker containers

2018-01-29 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344082#comment-16344082 ] Miklos Szegedi commented on YARN-7815: -- Thank you, for the replies [~jlowe] and [~eyang]. I understand

[jira] [Commented] (YARN-7815) Mount the filecache as read-only in Docker containers

2018-01-29 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344052#comment-16344052 ] Miklos Szegedi commented on YARN-7815: -- Thank you [~jlowe] for the response. I agree with 1. and 2.

[jira] [Commented] (YARN-2185) Use pipes when localizing archives

2018-01-26 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16341972#comment-16341972 ] Miklos Szegedi commented on YARN-2185: -- Thank you for the reviews [~jlowe], [~grepas] and [~rkanter]

[jira] [Commented] (YARN-7815) Mount the filecache as read-only in Docker containers

2018-01-26 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16341966#comment-16341966 ] Miklos Szegedi commented on YARN-7815: -- [~jlowe], {quote}The appcache mount needs to be read-write

[jira] [Commented] (YARN-6668) Use cgroup to get container resource utilization

2018-01-26 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16341952#comment-16341952 ] Miklos Szegedi commented on YARN-6668: -- This has been checked in as YARN-7064. > Use cgroup to get

[jira] [Commented] (YARN-7796) Container-executor fails with segfault on certain OS configurations

2018-01-26 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16341948#comment-16341948 ] Miklos Szegedi commented on YARN-7796: -- Now the question is, how does a 128K allocation fill in a

[jira] [Commented] (YARN-7796) Container-executor fails with segfault on certain OS configurations

2018-01-26 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16341932#comment-16341932 ] Miklos Szegedi commented on YARN-7796: -- [~Jim_Brennan], [~grepas], the stack depth is specified by 

[jira] [Commented] (YARN-7626) Allow regular expression matching in container-executor.cfg for devices and named docker volumes mount

2018-01-26 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16341810#comment-16341810 ] Miklos Szegedi commented on YARN-7626: -- [~Zian Chen], thank you for the patch. {code:java} 76

[jira] [Commented] (YARN-7815) Mount the filecache as read-only in Docker containers

2018-01-26 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16341728#comment-16341728 ] Miklos Szegedi commented on YARN-7815: -- [~ebadger], thank you for raising this. I am just wondering

[jira] [Updated] (YARN-7064) Use cgroup to get container resource utilization

2018-01-26 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7064: - Attachment: YARN-7064.014.patch > Use cgroup to get container resource utilization >

[jira] [Updated] (YARN-7064) Use cgroup to get container resource utilization

2018-01-25 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7064: - Attachment: YARN-7064.013.patch > Use cgroup to get container resource utilization >

[jira] [Commented] (YARN-7814) Remove automatic mounting of the cgroups root directory into Docker containers

2018-01-25 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16340423#comment-16340423 ] Miklos Szegedi commented on YARN-7814: -- +1 LGTM. I will commit this shortly. > Remove automatic

[jira] [Commented] (YARN-7814) Remove automatic mounting of the cgroups root directory into Docker containers

2018-01-25 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16339519#comment-16339519 ] Miklos Szegedi commented on YARN-7814: -- Thank you for the patch [~shaneku...@gmail.com]. Could you fix

[jira] [Commented] (YARN-7814) Remove automatic mounting of the cgroups root directory into Docker containers

2018-01-24 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16338705#comment-16338705 ] Miklos Szegedi commented on YARN-7814: -- Please repurpose and close them as you see fit. I think it is

[jira] [Updated] (YARN-2185) Use pipes when localizing archives

2018-01-24 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-2185: - Attachment: YARN-2185.012.patch > Use pipes when localizing archives >

[jira] [Updated] (YARN-2185) Use pipes when localizing archives

2018-01-24 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-2185: - Attachment: YARN-2185.011.patch > Use pipes when localizing archives >

[jira] [Commented] (YARN-7814) Remove automatic mounting of the cgroups root directory into Docker containers

2018-01-24 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16338401#comment-16338401 ] Miklos Szegedi commented on YARN-7814: -- Thank you for reporting this. Is not this a dupe of YARN-7233?

[jira] [Commented] (YARN-2185) Use pipes when localizing archives

2018-01-24 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16338279#comment-16338279 ] Miklos Szegedi commented on YARN-2185: -- Thank you, [~jlowe]. I updated the patch. {quote}makeShellPath

[jira] [Updated] (YARN-2185) Use pipes when localizing archives

2018-01-24 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-2185: - Attachment: YARN-2185.010.patch > Use pipes when localizing archives >

[jira] [Commented] (YARN-5473) Expose per-application over-allocation info in the Resource Manager

2018-01-23 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16337007#comment-16337007 ] Miklos Szegedi commented on YARN-5473: -- +1. I will commit this shortly. The unit test is YARN-7020 as

[jira] [Comment Edited] (YARN-2185) Use pipes when localizing archives

2018-01-23 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16337005#comment-16337005 ] Miklos Szegedi edited comment on YARN-2185 at 1/24/18 6:30 AM: --- I opened

[jira] [Commented] (YARN-2185) Use pipes when localizing archives

2018-01-23 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16337005#comment-16337005 ] Miklos Szegedi commented on YARN-2185: -- I opened YARN-7803 for the unit test error. > Use pipes when

[jira] [Updated] (YARN-7803) TestZKFailoverController occasionally fails in trunk

2018-01-23 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7803: - Description: I see this sometimes in Apache jenkins runs sometimes but pretty consistently with

[jira] [Created] (YARN-7803) TestZKFailoverController occasionally fails in trunk

2018-01-23 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-7803: Summary: TestZKFailoverController occasionally fails in trunk Key: YARN-7803 URL: https://issues.apache.org/jira/browse/YARN-7803 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-7796) Container-executor fails with segfault on certain OS configurations

2018-01-23 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7796: - Fix Version/s: 3.0.1 > Container-executor fails with segfault on certain OS configurations >

[jira] [Commented] (YARN-7796) Container-executor fails with segfault on certain OS configurations

2018-01-23 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336942#comment-16336942 ] Miklos Szegedi commented on YARN-7796: -- +1 LGTM. The docker issue is unrelated. > Container-executor

[jira] [Commented] (YARN-5473) Expose per-application over-allocation info in the Resource Manager

2018-01-23 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336643#comment-16336643 ] Miklos Szegedi commented on YARN-5473: -- +1 pending Jenkins. > Expose per-application over-allocation

[jira] [Commented] (YARN-7796) Container-executor fails with segfault on certain OS configurations

2018-01-23 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336628#comment-16336628 ] Miklos Szegedi commented on YARN-7796: -- {{[ERROR] unable to create new native thread -> [Help 1]}} It

[jira] [Commented] (YARN-7796) Container-executor fails with segfault on certain OS configurations

2018-01-23 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336605#comment-16336605 ] Miklos Szegedi commented on YARN-7796: -- +1 pending Jenkins

[jira] [Commented] (YARN-7064) Use cgroup to get container resource utilization

2018-01-23 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336569#comment-16336569 ] Miklos Szegedi commented on YARN-7064: -- TestContainerLogsPage is unrelated web app issue. > Use

[jira] [Commented] (YARN-7796) Container-executor fails with segfault on certain OS configurations

2018-01-23 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336469#comment-16336469 ] Miklos Szegedi commented on YARN-7796: -- Thank you [~grepas] for the patch. Can you fix the

[jira] [Commented] (YARN-7796) Container-executor fails with segfault on certain OS configurations

2018-01-23 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336151#comment-16336151 ] Miklos Szegedi commented on YARN-7796: -- I tried to start jenkins manually.

[jira] [Updated] (YARN-7064) Use cgroup to get container resource utilization

2018-01-23 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7064: - Attachment: YARN-7064.012.patch > Use cgroup to get container resource utilization >

[jira] [Commented] (YARN-7796) Container-executor fails with segfault on certain OS configurations

2018-01-23 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336028#comment-16336028 ] Miklos Szegedi commented on YARN-7796: -- [~grepas], thank you for the patch. {{malloc}} may return NULL

[jira] [Commented] (YARN-5473) Expose per-application over-allocation info in the Resource Manager

2018-01-23 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336014#comment-16336014 ] Miklos Szegedi commented on YARN-5473: -- Thank you, [~haibochen]! The latest patch have a few

[jira] [Commented] (YARN-5473) Expose per-application over-allocation info in the Resource Manager

2018-01-22 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335263#comment-16335263 ] Miklos Szegedi commented on YARN-5473: -- Thank you for the patch [~haibochen] and for the review

[jira] [Updated] (YARN-2185) Use pipes when localizing archives

2018-01-22 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-2185: - Attachment: YARN-2185.009.patch > Use pipes when localizing archives >

[jira] [Commented] (YARN-2185) Use pipes when localizing archives

2018-01-22 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335173#comment-16335173 ] Miklos Szegedi commented on YARN-2185: -- Thank you for the review [~jlowe]! bq. If the subprocess ends

[jira] [Updated] (YARN-2185) Use pipes when localizing archives

2018-01-19 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-2185: - Attachment: YARN-2185.008.patch > Use pipes when localizing archives >

[jira] [Commented] (YARN-2185) Use pipes when localizing archives

2018-01-19 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16332965#comment-16332965 ] Miklos Szegedi commented on YARN-2185: -- Thank you for the review [~rkanter]. I updated the patch. >

[jira] [Commented] (YARN-6384) Add configuration property to set max CPU usage when strict-resource-usage is false with cgroups

2018-01-19 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16332616#comment-16332616 ] Miklos Szegedi commented on YARN-6384: -- Thank you for the latest patch [~lolee_k] and for the review

[jira] [Updated] (YARN-6384) Add configuration property to increase max CPU usage when strict-resource-usage is true with cgroups

2018-01-19 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-6384: - Summary: Add configuration property to increase max CPU usage when strict-resource-usage is true

[jira] [Assigned] (YARN-6384) Add configuration property to set max CPU usage when strict-resource-usage is false with cgroups

2018-01-19 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi reassigned YARN-6384: Assignee: dengkai > Add configuration property to set max CPU usage when

[jira] [Commented] (YARN-2185) Use pipes when localizing archives

2018-01-18 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16331605#comment-16331605 ] Miklos Szegedi commented on YARN-2185: -- The deprecated message is expected, the unit test error is

[jira] [Commented] (YARN-7139) FairScheduler: finished applications are always restored to default queue

2018-01-18 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16331597#comment-16331597 ] Miklos Szegedi commented on YARN-7139: -- Committed to trunk. Thank you for the contribution [~wilfreds]

[jira] [Commented] (YARN-7139) FairScheduler: finished applications are always restored to default queue

2018-01-18 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16331586#comment-16331586 ] Miklos Szegedi commented on YARN-7139: -- +1. I cannot reproduce the unit test failure. >

[jira] [Updated] (YARN-2185) Use pipes when localizing archives

2018-01-18 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-2185: - Attachment: YARN-2185.007.patch > Use pipes when localizing archives >

[jira] [Commented] (YARN-2185) Use pipes when localizing archives

2018-01-18 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16331435#comment-16331435 ] Miklos Szegedi commented on YARN-2185: -- Thank you for the review [~rkanter]. I updated the patch. >

[jira] [Commented] (YARN-7590) Improve container-executor validation check

2018-01-18 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16331284#comment-16331284 ] Miklos Szegedi commented on YARN-7590: -- Thank you, [~eyang] for the patches, I verified and committed

[jira] [Updated] (YARN-7590) Improve container-executor validation check

2018-01-18 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7590: - Fix Version/s: 2.6.6 > Improve container-executor validation check >

[jira] [Updated] (YARN-7590) Improve container-executor validation check

2018-01-18 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7590: - Fix Version/s: 2.7.6 > Improve container-executor validation check >

[jira] [Created] (YARN-7775) Unit test fail: Testing resolve_config_path in 2.7

2018-01-18 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-7775: Summary: Unit test fail: Testing resolve_config_path in 2.7 Key: YARN-7775 URL: https://issues.apache.org/jira/browse/YARN-7775 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-2185) Use pipes when localizing archives

2018-01-18 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16331129#comment-16331129 ] Miklos Szegedi commented on YARN-2185: -- I intentionally added the javac warning, so that we deprecate

[jira] [Commented] (YARN-7717) Add configuration consistency for module.enabled and docker.privileged-containers.enabled

2018-01-17 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16329811#comment-16329811 ] Miklos Szegedi commented on YARN-7717: -- +1. Thank you [~yeshavora] for reporting this, [~ebadger] for

[jira] [Updated] (YARN-7758) Add an additional check to the validity of container and application ids passed to container-executor

2018-01-17 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7758: - Fix Version/s: 3.0.1 > Add an additional check to the validity of container and application ids >

[jira] [Commented] (YARN-7758) Add an additional check to the validity of container and application ids passed to container-executor

2018-01-16 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16328173#comment-16328173 ] Miklos Szegedi commented on YARN-7758: -- Committed to trunk. Thank you for the contribution [~yufeigu]!

[jira] [Commented] (YARN-7758) Add an additional check to the validity of container and application ids passed to container-executor

2018-01-16 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16328065#comment-16328065 ] Miklos Szegedi commented on YARN-7758: -- +1 Pending Jenkins. Thank you for the contribution [~yufeigu]

[jira] [Updated] (YARN-7758) Add an additional check to the validity of container and application ids passed to container-executor

2018-01-16 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7758: - Description: I would make sure that they contain characters a-z 0-9 and _- (underscore and dash)

[jira] [Created] (YARN-7758) Add an additional check to the validity of container and application ids passed to container-executor

2018-01-16 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-7758: Summary: Add an additional check to the validity of container and application ids passed to container-executor Key: YARN-7758 URL: https://issues.apache.org/jira/browse/YARN-7758

[jira] [Commented] (YARN-7712) Add ability to ignore timestamps in localized files

2018-01-12 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324906#comment-16324906 ] Miklos Szegedi commented on YARN-7712: -- Thank you, [~chris.douglas] for the reply. Here are my

[jira] [Updated] (YARN-7705) Create the container log directory with correct sticky bit in C code

2018-01-12 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7705: - Fix Version/s: 3.0.1 > Create the container log directory with correct sticky bit in C code >

[jira] [Updated] (YARN-7705) Create the container log directory with correct sticky bit in C code

2018-01-12 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7705: - Fix Version/s: 2.10.0 > Create the container log directory with correct sticky bit in C code >

[jira] [Commented] (YARN-7705) Create the container log directory with correct sticky bit in C code

2018-01-12 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324884#comment-16324884 ] Miklos Szegedi commented on YARN-7705: -- +1. > Create the container log directory with correct sticky

[jira] [Commented] (YARN-7064) Use cgroup to get container resource utilization

2018-01-12 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324269#comment-16324269 ] Miklos Szegedi commented on YARN-7064: -- The asflicense and unit test issues are unrelated. bq. Under

[jira] [Updated] (YARN-7064) Use cgroup to get container resource utilization

2018-01-11 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7064: - Attachment: YARN-7064.011.patch > Use cgroup to get container resource utilization >

[jira] [Commented] (YARN-7064) Use cgroup to get container resource utilization

2018-01-11 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16323408#comment-16323408 ] Miklos Szegedi commented on YARN-7064: -- Thank you for the review [~haibochen]. bq. In

[jira] [Commented] (YARN-7590) Improve container-executor validation check

2018-01-11 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16322776#comment-16322776 ] Miklos Szegedi commented on YARN-7590: -- Thank you for the contribution [~eyang]! I am still working on

[jira] [Commented] (YARN-7717) Add configuration consistency for module.enabled and docker.privileged-containers.enabled

2018-01-11 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16322758#comment-16322758 ] Miklos Szegedi commented on YARN-7717: -- Thank you, [~ebadger] for the updated patch. {code} 442

[jira] [Commented] (YARN-7590) Improve container-executor validation check

2018-01-11 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16322705#comment-16322705 ] Miklos Szegedi commented on YARN-7590: -- +1. I will commit this shortly. > Improve container-executor

[jira] [Commented] (YARN-7715) Update CPU and Memory cgroups params on container update as well.

2018-01-10 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16321730#comment-16321730 ] Miklos Szegedi commented on YARN-7715: -- I would separate {{preStart}} into two functions, {{preStart}}

[jira] [Commented] (YARN-7712) Add ability to ignore timestamps in localized files

2018-01-10 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16321724#comment-16321724 ] Miklos Szegedi commented on YARN-7712: -- Thank you for the reply, [~chris.douglas]. The scenario is

[jira] [Commented] (YARN-7717) Add configuration consistency for module.enabled and docker.privileged-containers.enabled

2018-01-10 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16321708#comment-16321708 ] Miklos Szegedi commented on YARN-7717: -- Thank you for the patch, [~ebadger]. {code} 5

[jira] [Commented] (YARN-7730) Add memory management configs to yarn-default

2018-01-10 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16321685#comment-16321685 ] Miklos Szegedi commented on YARN-7730: -- [~yeshavora], thank you for reporting this. Please review

[jira] [Commented] (YARN-7064) Use cgroup to get container resource utilization

2018-01-10 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16321676#comment-16321676 ] Miklos Szegedi commented on YARN-7064: -- The failing unit test is YARN-7734. > Use cgroup to get

[jira] [Created] (YARN-7734) YARN-5418 breaks TestContainerLogsPage.testContainerLogPageAccess

2018-01-10 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-7734: Summary: YARN-5418 breaks TestContainerLogsPage.testContainerLogPageAccess Key: YARN-7734 URL: https://issues.apache.org/jira/browse/YARN-7734 Project: Hadoop YARN

[jira] [Commented] (YARN-7590) Improve container-executor validation check

2018-01-10 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16321664#comment-16321664 ] Miklos Szegedi commented on YARN-7590: -- [~eyang], The code I suggested above {code} fprintf(LOGFILE,

[jira] [Commented] (YARN-7064) Use cgroup to get container resource utilization

2018-01-10 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16321513#comment-16321513 ] Miklos Szegedi commented on YARN-7064: -- Thank you for the review, [~haibochen]. bq. 1) Why are we

[jira] [Updated] (YARN-7064) Use cgroup to get container resource utilization

2018-01-10 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7064: - Attachment: YARN-7064.010.patch > Use cgroup to get container resource utilization >

[jira] [Commented] (YARN-7705) Create the container log directory with correct sticky bit in C code

2018-01-10 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16321317#comment-16321317 ] Miklos Szegedi commented on YARN-7705: -- Thank you for the patch [~yufeigu]! {code} 1068if

[jira] [Commented] (YARN-7590) Improve container-executor validation check

2018-01-10 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16321274#comment-16321274 ] Miklos Szegedi commented on YARN-7590: -- [~eyang], I figured it out. {code} char *local_path =

[jira] [Updated] (YARN-2185) Use pipes when localizing archives

2018-01-10 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-2185: - Attachment: YARN-2185.004.patch Fixing findbugs and checkstyle > Use pipes when localizing

[jira] [Commented] (YARN-7689) TestRMContainerAllocator fails after YARN-6124

2018-01-09 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16319544#comment-16319544 ] Miklos Szegedi commented on YARN-7689: -- +1. Thank you for the contribution [~wilfreds]. I will commit

<    1   2   3   4   5   6   7   8   9   10   >