[jira] [Updated] (YARN-7612) Add Processor Framework for Rich Placement Constraints

2017-12-22 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7612: -- Summary: Add Processor Framework for Rich Placement Constraints (was: Add Placement Processor

[jira] [Commented] (YARN-7612) Add Placement Processor Framework

2017-12-22 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16302223#comment-16302223 ] Arun Suresh commented on YARN-7612: --- Thanks for the reviews [~kkaranasos], [~sunilg] and [~cheersyang].

[jira] [Commented] (YARN-7612) Add Placement Processor Framework

2017-12-22 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16302218#comment-16302218 ] genericqa commented on YARN-7612: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-2185) Use pipes when localizing archives

2017-12-22 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16302207#comment-16302207 ] genericqa commented on YARN-2185: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-7612) Add Placement Processor Framework

2017-12-22 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16302197#comment-16302197 ] Konstantinos Karanasos edited comment on YARN-7612 at 12/23/17 4:24 AM:

[jira] [Commented] (YARN-7612) Add Placement Processor Framework

2017-12-22 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16302197#comment-16302197 ] Konstantinos Karanasos commented on YARN-7612: -- Thanks @arun suresh, +1 to latest patch. >

[jira] [Updated] (YARN-7677) HADOOP_CONF_DIR should not be automatically put in task environment

2017-12-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated YARN-7677: --- Hadoop Flags: Incompatible change > HADOOP_CONF_DIR should not be automatically put in task

[jira] [Commented] (YARN-7590) Improve container-executor validation check

2017-12-22 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16302137#comment-16302137 ] Miklos Szegedi commented on YARN-7590: -- Thank you for the patch [~eyang]. I have a few style issues:

[jira] [Comment Edited] (YARN-2185) Use pipes when localizing archives

2017-12-22 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16302123#comment-16302123 ] Miklos Szegedi edited comment on YARN-2185 at 12/23/17 12:10 AM: - Attaching

[jira] [Comment Edited] (YARN-2185) Use pipes when localizing archives

2017-12-22 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16302123#comment-16302123 ] Miklos Szegedi edited comment on YARN-2185 at 12/23/17 12:08 AM: - Attaching

[jira] [Updated] (YARN-2185) Use pipes when localizing archives

2017-12-22 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-2185: - Attachment: YARN-2185.000.patch Attaching my suggestion how to solve this. The code streams HDFS

[jira] [Updated] (YARN-7612) Add Placement Processor Framework

2017-12-22 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7612: -- Attachment: YARN-7612-YARN-6592.012.patch Updating patch based on [~kkaranasos]'s suggestions. > Add

[jira] [Commented] (YARN-7612) Add Placement Processor Framework

2017-12-22 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16302115#comment-16302115 ] genericqa commented on YARN-7612: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-1709) Admission Control: Reservation subsystem

2017-12-22 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16302037#comment-16302037 ] Subru Krishnan commented on YARN-1709: -- [~xingbao], thanks for your interest. I have responded to you

[jira] [Comment Edited] (YARN-1051) YARN Admission Control/Planner: enhancing the resource allocation model with time.

2017-12-22 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16302033#comment-16302033 ] Subru Krishnan edited comment on YARN-1051 at 12/22/17 10:42 PM: -

[jira] [Commented] (YARN-1051) YARN Admission Control/Planner: enhancing the resource allocation model with time.

2017-12-22 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16302033#comment-16302033 ] Subru Krishnan commented on YARN-1051: -- [~xingbao], the behavior depends on whether there's any job

[jira] [Commented] (YARN-7590) Improve container-executor validation check

2017-12-22 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16302020#comment-16302020 ] genericqa commented on YARN-7590: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7612) Add Placement Processor Framework

2017-12-22 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16302013#comment-16302013 ] Konstantinos Karanasos commented on YARN-7612: -- Thanks for the patch [~asuresh]. Some

[jira] [Commented] (YARN-6596) Introduce Placement Constraint Manager module

2017-12-22 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301984#comment-16301984 ] Konstantinos Karanasos commented on YARN-6596: -- Thanks [~asuresh], as well as [~sunilg] and

[jira] [Commented] (YARN-6596) Introduce Placement Constraint Manager module

2017-12-22 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301973#comment-16301973 ] Arun Suresh commented on YARN-6596: --- Committed to branch YARN-6592 > Introduce Placement Constraint

[jira] [Commented] (YARN-7590) Improve container-executor validation check

2017-12-22 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301970#comment-16301970 ] Eric Yang commented on YARN-7590: - [~miklos.szeg...@cloudera.com] Thank you for the feedback, and I revised

[jira] [Updated] (YARN-7590) Improve container-executor validation check

2017-12-22 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7590: Attachment: YARN-7590.005.patch - Added directory permission check before creation of directories. - Reuse

[jira] [Comment Edited] (YARN-6596) Introduce Placement Constraint Manager module

2017-12-22 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301966#comment-16301966 ] Arun Suresh edited comment on YARN-6596 at 12/22/17 9:17 PM: - Thanks for the

[jira] [Commented] (YARN-6596) Introduce Placement Constraint Manager module

2017-12-22 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301966#comment-16301966 ] Arun Suresh commented on YARN-6596: --- Thanks for the update [~kkaranasos]. +1 Committing this shortly. >

[jira] [Commented] (YARN-6596) Introduce Placement Constraint Manager module

2017-12-22 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301950#comment-16301950 ] genericqa commented on YARN-6596: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7605) Implement doAs for Api Service REST API

2017-12-22 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301946#comment-16301946 ] genericqa commented on YARN-7605: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5366) Improve handling of the Docker container life cycle

2017-12-22 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301864#comment-16301864 ] genericqa commented on YARN-5366: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (YARN-7451) Resources Types should be visible in the Cluster Apps API "resourceRequests" section

2017-12-22 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-7451: Assignee: Yufei Gu (was: Szilard Nemeth) > Resources Types should be visible in the

[jira] [Assigned] (YARN-7451) Resources Types should be visible in the Cluster Apps API "resourceRequests" section

2017-12-22 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-7451: Assignee: Szilard Nemeth (was: Yufei Gu) > Resources Types should be visible in the

[jira] [Commented] (YARN-6596) Introduce Placement Constraint Manager module

2017-12-22 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301804#comment-16301804 ] Konstantinos Karanasos commented on YARN-6596: -- Thanks [~sunilg] for the comments. bq. When

[jira] [Updated] (YARN-6596) Introduce Placement Constraint Manager module

2017-12-22 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantinos Karanasos updated YARN-6596: - Attachment: YARN-6596-YARN-6592.003.patch New version of the patch to fix

[jira] [Updated] (YARN-7612) Add Placement Processor Framework

2017-12-22 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7612: -- Attachment: YARN-7612-YARN-6592.011.patch Updating patch (v011): * Addressed some of [~sunilg]'s

[jira] [Updated] (YARN-5366) Improve handling of the Docker container life cycle

2017-12-22 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf updated YARN-5366: -- Attachment: (was: YARN-5366.009.patch) > Improve handling of the Docker container life cycle >

[jira] [Updated] (YARN-5366) Improve handling of the Docker container life cycle

2017-12-22 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf updated YARN-5366: -- Attachment: YARN-5366.009.patch > Improve handling of the Docker container life cycle >

[jira] [Updated] (YARN-7605) Implement doAs for Api Service REST API

2017-12-22 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7605: Attachment: YARN-7605.009.patch - Fix a bug where pseudo security use doAs=username to allow impersonation.

[jira] [Commented] (YARN-7612) Add Placement Processor Framework

2017-12-22 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301708#comment-16301708 ] Sunil G commented on YARN-7612: --- Yes.. Gotcha. It could be possible to have some entries in that list in that

[jira] [Commented] (YARN-7612) Add Placement Processor Framework

2017-12-22 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301699#comment-16301699 ] Arun Suresh commented on YARN-7612: --- bq. Then schedulePlacedRequests is inturn calls addToRetryList which

[jira] [Comment Edited] (YARN-7612) Add Placement Processor Framework

2017-12-22 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301676#comment-16301676 ] Sunil G edited comment on YARN-7612 at 12/22/17 5:14 PM: - Thanks [~asuresh] bq.That

[jira] [Commented] (YARN-7612) Add Placement Processor Framework

2017-12-22 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301676#comment-16301676 ] Sunil G commented on YARN-7612: --- Thanks [~asuresh] bq.That should be OK right ? if it gets cleared up, then

[jira] [Commented] (YARN-7612) Add Placement Processor Framework

2017-12-22 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301671#comment-16301671 ] Arun Suresh commented on YARN-7612: --- Thanks for the review [~sunilg] bq. I had one smaller concern here.

[jira] [Commented] (YARN-7612) Add Placement Processor Framework

2017-12-22 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301638#comment-16301638 ] Sunil G commented on YARN-7612: --- Thanks [~asuresh] bq.But Currently, and to keep things less complicated, I

[jira] [Commented] (YARN-7679) Application blacklist to drop misbehave AM requests

2017-12-22 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301611#comment-16301611 ] Arun Suresh commented on YARN-7679: --- Thanks for starting the discussion. We actually introduced YARN-6355

[jira] [Commented] (YARN-6596) Introduce Placement Constraint Manager module

2017-12-22 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301583#comment-16301583 ] Sunil G commented on YARN-6596: --- Thanks [~kkaranasos] bq.I think we can use the same or similar API that we

[jira] [Comment Edited] (YARN-6597) Store and update allocation tags in the Placement Constraint Manager

2017-12-22 Thread Panagiotis Garefalakis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301574#comment-16301574 ] Panagiotis Garefalakis edited comment on YARN-6597 at 12/22/17 3:45 PM:

[jira] [Comment Edited] (YARN-6597) Store and update allocation tags in the Placement Constraint Manager

2017-12-22 Thread Panagiotis Garefalakis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301574#comment-16301574 ] Panagiotis Garefalakis edited comment on YARN-6597 at 12/22/17 3:42 PM:

[jira] [Commented] (YARN-6597) Store and update allocation tags in the Placement Constraint Manager

2017-12-22 Thread Panagiotis Garefalakis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301574#comment-16301574 ] Panagiotis Garefalakis commented on YARN-6597: -- [~cheersyang]

[jira] [Comment Edited] (YARN-6597) Store and update allocation tags in the Placement Constraint Manager

2017-12-22 Thread Panagiotis Garefalakis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301574#comment-16301574 ] Panagiotis Garefalakis edited comment on YARN-6597 at 12/22/17 3:42 PM:

[jira] [Commented] (YARN-7653) Node group support for AllocationTagsManager

2017-12-22 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301557#comment-16301557 ] Arun Suresh commented on YARN-7653: --- Thanks [~pgaref] +1 > Node group support for AllocationTagsManager

[jira] [Commented] (YARN-5366) Improve handling of the Docker container life cycle

2017-12-22 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301374#comment-16301374 ] genericqa commented on YARN-5366: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5366) Improve handling of the Docker container life cycle

2017-12-22 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf updated YARN-5366: -- Attachment: YARN-5366.009.patch > Improve handling of the Docker container life cycle >

[jira] [Commented] (YARN-1709) Admission Control: Reservation subsystem

2017-12-22 Thread yangzhangyang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301313#comment-16301313 ] yangzhangyang commented on YARN-1709: - Hi, I want to ask you a question about reservation, "Step 7

[jira] [Updated] (YARN-7679) Application blacklist to drop misbehave AM requests

2017-12-22 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7679: -- Labels: admin command-line (was: admin) > Application blacklist to drop misbehave AM requests >

[jira] [Commented] (YARN-1051) YARN Admission Control/Planner: enhancing the resource allocation model with time.

2017-12-22 Thread yangzhangyang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301283#comment-16301283 ] yangzhangyang commented on YARN-1051: - [~curino] I want to ask you a question about "Step 7 The

[jira] [Commented] (YARN-7653) Node group support for AllocationTagsManager

2017-12-22 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301175#comment-16301175 ] genericqa commented on YARN-7653: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-7653) Node group support for AllocationTagsManager

2017-12-22 Thread Panagiotis Garefalakis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301091#comment-16301091 ] Panagiotis Garefalakis edited comment on YARN-7653 at 12/22/17 8:15 AM:

[jira] [Commented] (YARN-7653) Node group support for AllocationTagsManager

2017-12-22 Thread Panagiotis Garefalakis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301091#comment-16301091 ] Panagiotis Garefalakis commented on YARN-7653: -- Thanks for the comments [~asuresh] !