[jira] [Updated] (YARN-7757) Refactor NodeLabelsProvider to be more generic and reusable for node attributes providers

2018-02-02 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7757: -- Attachment: YARN-7757-YARN-3409.006.patch > Refactor NodeLabelsProvider to be more generic and reusable f

[jira] [Commented] (YARN-7757) Refactor NodeLabelsProvider to be more generic and reusable for node attributes providers

2018-02-02 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349983#comment-16349983 ] Weiwei Yang commented on YARN-7757: --- Per offline discussion with [~Naganarasimha], upload

[jira] [Comment Edited] (YARN-7757) Refactor NodeLabelsProvider to be more generic and reusable for node attributes providers

2018-02-02 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349983#comment-16349983 ] Weiwei Yang edited comment on YARN-7757 at 2/2/18 8:46 AM: --- Per o

[jira] [Updated] (YARN-7757) Refactor NodeLabelsProvider to be more generic and reusable for node attributes providers

2018-02-02 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7757: -- Attachment: nodeLabelsProvider_refactor_v3.pdf > Refactor NodeLabelsProvider to be more generic and reusa

[jira] [Comment Edited] (YARN-7757) Refactor NodeLabelsProvider to be more generic and reusable for node attributes providers

2018-02-02 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349983#comment-16349983 ] Weiwei Yang edited comment on YARN-7757 at 2/2/18 8:50 AM: --- Per o

[jira] [Commented] (YARN-7841) Cleanup AllocationFileLoaderService's reloadAllocations method

2018-02-02 Thread Gergo Repas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16350170#comment-16350170 ] Gergo Repas commented on YARN-7841: --- +1 (non-binding) Since this is a big piece of refac

[jira] [Commented] (YARN-7876) Workaround ZipInputStream limitation for YARN-2185

2018-02-02 Thread Gergo Repas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16350189#comment-16350189 ] Gergo Repas commented on YARN-7876: --- Nit: there is already a BUFFER_SIZE constant used fo

[jira] [Comment Edited] (YARN-7876) Workaround ZipInputStream limitation for YARN-2185

2018-02-02 Thread Gergo Repas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16350189#comment-16350189 ] Gergo Repas edited comment on YARN-7876 at 2/2/18 11:30 AM: Tha

[jira] [Commented] (YARN-7841) Cleanup AllocationFileLoaderService's reloadAllocations method

2018-02-02 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16350171#comment-16350171 ] Szilard Nemeth commented on YARN-7841: -- [~grepas] Thanks for the review! > Cleanup A

[jira] [Commented] (YARN-7757) Refactor NodeLabelsProvider to be more generic and reusable for node attributes providers

2018-02-02 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16350141#comment-16350141 ] genericqa commented on YARN-7757: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Created] (YARN-7879) NM user is unable to access the application filecache due to permissions

2018-02-02 Thread Shane Kumpf (JIRA)
Shane Kumpf created YARN-7879: - Summary: NM user is unable to access the application filecache due to permissions Key: YARN-7879 URL: https://issues.apache.org/jira/browse/YARN-7879 Project: Hadoop YARN

[jira] [Updated] (YARN-5028) RMStateStore should trim down app state for completed applications

2018-02-02 Thread Gergo Repas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergo Repas updated YARN-5028: -- Attachment: YARN-5028.001.patch > RMStateStore should trim down app state for completed applications > --

[jira] [Commented] (YARN-6456) Isolation of Docker containers In LinuxContainerExecutor

2018-02-02 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16350340#comment-16350340 ] Shane Kumpf commented on YARN-6456: --- [~miklos.szeg...@cloudera.com] - I believe YARN-7815

[jira] [Commented] (YARN-5028) RMStateStore should trim down app state for completed applications

2018-02-02 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16350349#comment-16350349 ] genericqa commented on YARN-5028: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-7677) Docker image cannot set HADOOP_CONF_DIR

2018-02-02 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16350353#comment-16350353 ] Jason Lowe commented on YARN-7677: -- I realize now that the theoretical example cannot work

[jira] [Commented] (YARN-5714) ContainerExecutor does not order environment map

2018-02-02 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16350359#comment-16350359 ] Jason Lowe commented on YARN-5714: -- On second thought, it's extremely unlikely that NM whi

[jira] [Updated] (YARN-7838) Support AND/OR constraints in Distributed Shell

2018-02-02 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7838: -- Description: Extending DS placement spec syntax to support AND/OR constraints, something like {code} //

[jira] [Updated] (YARN-7838) Support AND/OR constraints in Distributed Shell

2018-02-02 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7838: -- Attachment: YARN-7838.prelim.patch > Support AND/OR constraints in Distributed Shell > --

[jira] [Created] (YARN-7880) FiCaSchedulerApp.commonCheckContainerAllocation throws NPE when running sls

2018-02-02 Thread Jiandan Yang (JIRA)
Jiandan Yang created YARN-7880: --- Summary: FiCaSchedulerApp.commonCheckContainerAllocation throws NPE when running sls Key: YARN-7880 URL: https://issues.apache.org/jira/browse/YARN-7880 Project: Hadoop

[jira] [Updated] (YARN-7839) Check node capacity before placing in the Algorithm

2018-02-02 Thread Panagiotis Garefalakis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Panagiotis Garefalakis updated YARN-7839: - Description: Currently, the Algorithm assigns a node to a request purely based on i

[jira] [Commented] (YARN-7677) Docker image cannot set HADOOP_CONF_DIR

2018-02-02 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16350368#comment-16350368 ] Billie Rinaldi commented on YARN-7677: -- That sounds like a good approach, NM vars foll

[jira] [Updated] (YARN-7880) FiCaSchedulerApp.commonCheckContainerAllocation throws NPE when running sls

2018-02-02 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-7880: Description: {code} 18/02/02 20:54:28 INFO rmcontainer.RMContainerImpl: container_1517575125794_5707

[jira] [Commented] (YARN-7815) Mount the filecache as read-only in Docker containers

2018-02-02 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16350375#comment-16350375 ] Shane Kumpf commented on YARN-7815: --- The localization issue appears to be unrelated. I se

[jira] [Updated] (YARN-7880) FiCaSchedulerApp.commonCheckContainerAllocation throws NPE when running sls

2018-02-02 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-7880: Description: {code} 18/02/02 20:54:28 INFO rmcontainer.RMContainerImpl: container_1517575125794_5707

[jira] [Commented] (YARN-7838) Support AND/OR constraints in Distributed Shell

2018-02-02 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16350372#comment-16350372 ] Weiwei Yang commented on YARN-7838: --- Hello [~asuresh] Today I spent a few hours working

[jira] [Assigned] (YARN-7879) NM user is unable to access the application filecache due to permissions

2018-02-02 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reassigned YARN-7879: Assignee: Jason Lowe Affects Version/s: 3.1.0 Priority: Critical (was: Maj

[jira] [Updated] (YARN-7876) Localized jars that are expanded during localization are not fully copied

2018-02-02 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-7876: - Affects Version/s: 3.1.0 Target Version/s: 3.1.0 Priority: Blocker (was: Major)

[jira] [Updated] (YARN-7815) Mount the filecache as read-only in Docker containers

2018-02-02 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf updated YARN-7815: -- Attachment: YARN-7815.001.patch > Mount the filecache as read-only in Docker containers > ---

[jira] [Assigned] (YARN-7839) Check node capacity before placing in the Algorithm

2018-02-02 Thread Panagiotis Garefalakis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Panagiotis Garefalakis reassigned YARN-7839: Assignee: Panagiotis Garefalakis > Check node capacity before placing in the

[jira] [Commented] (YARN-7815) Mount the filecache as read-only in Docker containers

2018-02-02 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16350424#comment-16350424 ] Shane Kumpf commented on YARN-7815: --- Attached a patch that implements the proposal. Given

[jira] [Updated] (YARN-7839) Check node capacity before placing in the Algorithm

2018-02-02 Thread Panagiotis Garefalakis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Panagiotis Garefalakis updated YARN-7839: - Attachment: YARN-7839-YARN-6592.001.patch > Check node capacity before placing in t

[jira] [Commented] (YARN-7839) Check node capacity before placing in the Algorithm

2018-02-02 Thread Panagiotis Garefalakis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16350496#comment-16350496 ] Panagiotis Garefalakis commented on YARN-7839: --   Submitting a simple patch t

[jira] [Commented] (YARN-7677) Docker image cannot set HADOOP_CONF_DIR

2018-02-02 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16350500#comment-16350500 ] Jim Brennan commented on YARN-7677: --- Thanks everyone! I will work on a new patch using t

[jira] [Comment Edited] (YARN-7839) Check node capacity before placing in the Algorithm

2018-02-02 Thread Panagiotis Garefalakis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16350496#comment-16350496 ] Panagiotis Garefalakis edited comment on YARN-7839 at 2/2/18 3:13 PM: ---

[jira] [Resolved] (YARN-7832) Logs page does not work for Running applications

2018-02-02 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G resolved YARN-7832. --- Resolution: Not A Problem Thanks [~yeshavora] for confirming, This is working fine with Combine System Metric

[jira] [Commented] (YARN-7879) NM user is unable to access the application filecache due to permissions

2018-02-02 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16350564#comment-16350564 ] Jason Lowe commented on YARN-7879: -- This was caused by YARN-2185. That change locked down

[jira] [Commented] (YARN-7815) Mount the filecache as read-only in Docker containers

2018-02-02 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16350571#comment-16350571 ] genericqa commented on YARN-7815: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-7879) NM user is unable to access the application filecache due to permissions

2018-02-02 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-7879: - Attachment: YARN-7879.001.patch > NM user is unable to access the application filecache due to permissions

[jira] [Commented] (YARN-7866) [UI2] Kerberizing the UI doesn't give any warning or content when UI is accessed without kinit

2018-02-02 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16350610#comment-16350610 ] genericqa commented on YARN-7866: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

[jira] [Updated] (YARN-7881) Add Log Aggregation Status API to the RM Webservice

2018-02-02 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-7881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Novák updated YARN-7881: Description: The old YARN UI has a page:  /cluster/logaggregationstatus/\{app_id} which shows the log

[jira] [Created] (YARN-7881) Add Log Aggregation Status API to the RM Webservice

2018-02-02 Thread JIRA
Gergely Novák created YARN-7881: --- Summary: Add Log Aggregation Status API to the RM Webservice Key: YARN-7881 URL: https://issues.apache.org/jira/browse/YARN-7881 Project: Hadoop YARN Issue Typ

[jira] [Commented] (YARN-7879) NM user is unable to access the application filecache due to permissions

2018-02-02 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16350628#comment-16350628 ] Jason Lowe commented on YARN-7879: -- I also manually tested the patch on a secure cluster a

[jira] [Commented] (YARN-7868) Provide improved error message when YARN service is disabled

2018-02-02 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16350632#comment-16350632 ] Eric Yang commented on YARN-7868: - [~csingh] Thank you for reviewing the patch. [~jianhe]

[jira] [Updated] (YARN-7881) Add Log Aggregation Status API to the RM Webservice

2018-02-02 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-7881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Novák updated YARN-7881: Attachment: YARN-7881.001.patch > Add Log Aggregation Status API to the RM Webservice > -

[jira] [Commented] (YARN-7850) New UI does not show status for Log Aggregation

2018-02-02 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16350635#comment-16350635 ] Sunil G commented on YARN-7850: --- [~GergelyNovak] Change looks fine to me. One dbt, when log

[jira] [Commented] (YARN-7850) New UI does not show status for Log Aggregation

2018-02-02 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-7850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16350642#comment-16350642 ] Gergely Novák commented on YARN-7850: - We show it with the default style (grey). > Ne

[jira] [Commented] (YARN-7850) New UI does not show status for Log Aggregation

2018-02-02 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-7850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16350625#comment-16350625 ] Gergely Novák commented on YARN-7850: - Created [YARN-7881|https://issues.apache.org/jir

[jira] [Commented] (YARN-7879) NM user is unable to access the application filecache due to permissions

2018-02-02 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16350648#comment-16350648 ] genericqa commented on YARN-7879: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

[jira] [Commented] (YARN-7839) Check node capacity before placing in the Algorithm

2018-02-02 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16350649#comment-16350649 ] genericqa commented on YARN-7839: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-7839) Check node capacity before placing in the Algorithm

2018-02-02 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16350656#comment-16350656 ] Sunil G commented on YARN-7839: --- bq.despite the naming, as far as I know, the candidateNodeSe

[jira] [Commented] (YARN-5028) RMStateStore should trim down app state for completed applications

2018-02-02 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16350701#comment-16350701 ] genericqa commented on YARN-5028: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-7839) Check node capacity before placing in the Algorithm

2018-02-02 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16350731#comment-16350731 ] Arun Suresh commented on YARN-7839: --- [~sunilg], regarding the {{CandidateNodeSet}}, lets

[jira] [Commented] (YARN-7839) Check node capacity before placing in the Algorithm

2018-02-02 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16350732#comment-16350732 ] Arun Suresh commented on YARN-7839: --- Thanks for the patch [~pgaref] It looks pretty strai

[jira] [Updated] (YARN-7876) Localized jars that are expanded during localization are not fully copied

2018-02-02 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7876: - Attachment: YARN-7876.001.patch > Localized jars that are expanded during localization are not full

[jira] [Updated] (YARN-7876) Localized jars that are expanded after localization are not fully copied

2018-02-02 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7876: - Summary: Localized jars that are expanded after localization are not fully copied (was: Localized

[jira] [Commented] (YARN-7876) Localized jars that are expanded after localization are not fully copied

2018-02-02 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16350762#comment-16350762 ] Miklos Szegedi commented on YARN-7876: -- Thank you [~grepas] for the review and [~jlowe

[jira] [Comment Edited] (YARN-7876) Localized jars that are expanded after localization are not fully copied

2018-02-02 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16350762#comment-16350762 ] Miklos Szegedi edited comment on YARN-7876 at 2/2/18 6:19 PM: --

[jira] [Updated] (YARN-7839) Modify PlacementAlgorithm to Check node capacity before placing request on node

2018-02-02 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7839: -- Summary: Modify PlacementAlgorithm to Check node capacity before placing request on node (was: Check nod

[jira] [Updated] (YARN-7791) Support submit intra-app placement constraint in Distributed Shell to AppPlacementAllocator

2018-02-02 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7791: -- Environment: (was: Set {{yarn.resourcemanager.placement-constraints.enabled}} to {{false}} Submit a j

[jira] [Commented] (YARN-7879) NM user is unable to access the application filecache due to permissions

2018-02-02 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16350775#comment-16350775 ] Eric Yang commented on YARN-7879: - Are we conformable in assuming all files in filecache ar

[jira] [Commented] (YARN-7857) -fstack-check compilation flag causes binary incompatibility for container-executor between RHEL 6 and RHEL 7

2018-02-02 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16350781#comment-16350781 ] Miklos Szegedi commented on YARN-7857: -- Thank you, [~Jim_Brennan] for the patch. I am

[jira] [Updated] (YARN-6456) Isolation of Docker containers In LinuxContainerExecutor

2018-02-02 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-6456: - Issue Type: Sub-task (was: Bug) Parent: YARN-3611 > Isolation of Docker containers In Linu

[jira] [Commented] (YARN-6456) Isolation of Docker containers In LinuxContainerExecutor

2018-02-02 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16350787#comment-16350787 ] Miklos Szegedi commented on YARN-6456: -- Sure, I made it as a subtask. Are you referrin

[jira] [Commented] (YARN-7879) NM user is unable to access the application filecache due to permissions

2018-02-02 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16350794#comment-16350794 ] Jason Lowe commented on YARN-7879: -- bq. Are we conformable in assuming all files in fileca

[jira] [Commented] (YARN-7838) Support AND/OR constraints in Distributed Shell

2018-02-02 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16350798#comment-16350798 ] Arun Suresh commented on YARN-7838: --- Thanks for taking a stab at this [~cheersyang]. Yup

[jira] [Commented] (YARN-7655) avoid AM preemption caused by RRs for specific nodes or racks

2018-02-02 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16350831#comment-16350831 ] Yufei Gu commented on YARN-7655: The patch looks good to me generally. Only some nits: # Ad

[jira] [Commented] (YARN-7876) Localized jars that are expanded after localization are not fully copied

2018-02-02 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16350832#comment-16350832 ] Jason Lowe commented on YARN-7876: -- Right, thanks for clarifying the title further. +1 lg

[jira] [Commented] (YARN-7857) -fstack-check compilation flag causes binary incompatibility for container-executor between RHEL 6 and RHEL 7

2018-02-02 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16350833#comment-16350833 ] Jim Brennan commented on YARN-7857: --- Thanks [~miklos.szeg...@cloudera.com]! That is a goo

[jira] [Updated] (YARN-7732) Support Generic AM Simulator from SynthGenerator

2018-02-02 Thread Young Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Young Chen updated YARN-7732: - Attachment: YARN-7732.04.patch > Support Generic AM Simulator from SynthGenerator > ---

[jira] [Commented] (YARN-7868) Provide improved error message when YARN service is disabled

2018-02-02 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16350851#comment-16350851 ] Eric Yang commented on YARN-7868: - [~jianhe] Thank you for the commit. > Provide improved

[jira] [Commented] (YARN-7732) Support Generic AM Simulator from SynthGenerator

2018-02-02 Thread Young Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16350853#comment-16350853 ] Young Chen commented on YARN-7732: -- Added back compatibility with JobStory and JobStoryPro

[jira] [Updated] (YARN-7626) Allow regular expression matching in container-executor.cfg for devices and named docker volumes mount

2018-02-02 Thread Zian Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-7626: Attachment: YARN-7626.006.patch > Allow regular expression matching in container-executor.cfg for devices and

[jira] [Created] (YARN-7882) Server side proxy for UI2 log viewer

2018-02-02 Thread Eric Yang (JIRA)
Eric Yang created YARN-7882: --- Summary: Server side proxy for UI2 log viewer Key: YARN-7882 URL: https://issues.apache.org/jira/browse/YARN-7882 Project: Hadoop YARN Issue Type: Bug Compon

[jira] [Commented] (YARN-7626) Allow regular expression matching in container-executor.cfg for devices and named docker volumes mount

2018-02-02 Thread Zian Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16350873#comment-16350873 ] Zian Chen commented on YARN-7626: - Update patch 006 per Miklos's suggestions. [~leftnoteasy

[jira] [Commented] (YARN-7876) Localized jars that are expanded after localization are not fully copied

2018-02-02 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16350895#comment-16350895 ] Robert Kanter commented on YARN-7876: - +1 LGTM pending Jenkins Thanks for adding the d

[jira] [Commented] (YARN-6456) Isolation of Docker containers In LinuxContainerExecutor

2018-02-02 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16350904#comment-16350904 ] Shane Kumpf commented on YARN-6456: --- Thanks [~miklos.szeg...@cloudera.com]. {quote}Are yo

[jira] [Updated] (YARN-7720) Race condition between second app attempt and UAM timeout when first attempt node is down

2018-02-02 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-7720: --- Summary: Race condition between second app attempt and UAM timeout when first attempt node is down (wa

[jira] [Commented] (YARN-7572) Make the service status output more readable

2018-02-02 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16350938#comment-16350938 ] Chandni Singh commented on YARN-7572: -  Do we want something like this? Due to space co

[jira] [Commented] (YARN-6456) Isolation of Docker containers In LinuxContainerExecutor

2018-02-02 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16350942#comment-16350942 ] Miklos Szegedi commented on YARN-6456: -- Sure, I would keep the description just for co

[jira] [Commented] (YARN-7881) Add Log Aggregation Status API to the RM Webservice

2018-02-02 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16350954#comment-16350954 ] Giovanni Matteo Fumarola commented on YARN-7881: Thanks [~GergelyNovak] for

[jira] [Comment Edited] (YARN-7572) Make the service status output more readable

2018-02-02 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16350938#comment-16350938 ] Chandni Singh edited comment on YARN-7572 at 2/2/18 9:37 PM: -  

[jira] [Commented] (YARN-7572) Make the service status output more readable

2018-02-02 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16350974#comment-16350974 ] Vinod Kumar Vavilapalli commented on YARN-7572: --- This is a generally better p

[jira] [Commented] (YARN-7879) NM user is unable to access the application filecache due to permissions

2018-02-02 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16350981#comment-16350981 ] Eric Yang commented on YARN-7879: - [~jlowe] Thank you for the reply. We are allowing file

[jira] [Commented] (YARN-7572) Make the service status output more readable

2018-02-02 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16350994#comment-16350994 ] Eric Yang commented on YARN-7572: - Num Container, State and Lifetime on the Service line se

[jira] [Commented] (YARN-7819) Allow PlacementProcessor to be used with the FairScheduler

2018-02-02 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16351009#comment-16351009 ] Arun Suresh commented on YARN-7819: --- Updating patch after rebasing. The earlier testcase

[jira] [Updated] (YARN-7819) Allow PlacementProcessor to be used with the FairScheduler

2018-02-02 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7819: -- Attachment: YARN-7819.004.patch > Allow PlacementProcessor to be used with the FairScheduler > --

[jira] [Comment Edited] (YARN-7819) Allow PlacementProcessor to be used with the FairScheduler

2018-02-02 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16351009#comment-16351009 ] Arun Suresh edited comment on YARN-7819 at 2/2/18 10:23 PM: Upd

[jira] [Updated] (YARN-6456) Allow administrators to set a single ContainerRuntime for all containers

2018-02-02 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf updated YARN-6456: -- Summary: Allow administrators to set a single ContainerRuntime for all containers (was: Isolation of Doc

[jira] [Updated] (YARN-6456) Allow administrators to set a single ContainerRuntime for all containers

2018-02-02 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf updated YARN-6456: -- Description:   With LCE, there are multiple ContainerRuntimes available for handling different types of

[jira] [Updated] (YARN-7778) Merging of placement constraints defined at different levels

2018-02-02 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantinos Karanasos updated YARN-7778: - Summary: Merging of placement constraints defined at different levels (was: Mergin

[jira] [Commented] (YARN-7572) Make the service status output more readable

2018-02-02 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16351028#comment-16351028 ] Vinod Kumar Vavilapalli commented on YARN-7572: --- [~eyang], see my first comme

[jira] [Commented] (YARN-7572) Make the service status output more readable

2018-02-02 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16351035#comment-16351035 ] Chandni Singh commented on YARN-7572: - [~vinodkv] I don't think we currently have any

[jira] [Created] (YARN-7883) Make HAR tool support IndexedLogAggregtionController

2018-02-02 Thread Xuan Gong (JIRA)
Xuan Gong created YARN-7883: --- Summary: Make HAR tool support IndexedLogAggregtionController Key: YARN-7883 URL: https://issues.apache.org/jira/browse/YARN-7883 Project: Hadoop YARN Issue Type: Sub-

[jira] [Resolved] (YARN-7883) Make HAR tool support IndexedLogAggregtionController

2018-02-02 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong resolved YARN-7883. - Resolution: Duplicate > Make HAR tool support IndexedLogAggregtionController >

[jira] [Commented] (YARN-7883) Make HAR tool support IndexedLogAggregtionController

2018-02-02 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16351050#comment-16351050 ] Xuan Gong commented on YARN-7883: - Created a MapReduce ticket to track the work progress.

[jira] [Commented] (YARN-7879) NM user is unable to access the application filecache due to permissions

2018-02-02 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16351059#comment-16351059 ] Jason Lowe commented on YARN-7879: -- bq. We are allowing file cache to be mounted in docker

[jira] [Commented] (YARN-7879) NM user is unable to access the application filecache due to permissions

2018-02-02 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16351061#comment-16351061 ] Miklos Szegedi commented on YARN-7879: -- Thank you, [~shaneku...@gmail.com] for the rep

[jira] [Created] (YARN-7884) Race condition in registering YARN service in ZooKeeper

2018-02-02 Thread Eric Yang (JIRA)
Eric Yang created YARN-7884: --- Summary: Race condition in registering YARN service in ZooKeeper Key: YARN-7884 URL: https://issues.apache.org/jira/browse/YARN-7884 Project: Hadoop YARN Issue Type: B

[jira] [Commented] (YARN-7879) NM user is unable to access the application filecache due to permissions

2018-02-02 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16351065#comment-16351065 ] Shane Kumpf commented on YARN-7879: --- Thanks for the patch [~jlowe] - I've tested the patc

[jira] [Commented] (YARN-7879) NM user is unable to access the application filecache due to permissions

2018-02-02 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16351083#comment-16351083 ] Eric Yang commented on YARN-7879: - {quote} The only way I can see it being an issue specif

  1   2   >