[jira] [Updated] (YARN-7218) ApiServer REST API naming convention /ws/v1 is already used in Hadoop v2

2017-11-15 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7218: Attachment: YARN-7218.004.patch - Remove YarnJacksonJaxbProvider change because this breaks some existing

[jira] [Commented] (YARN-7218) ApiServer REST API naming convention /ws/v1 is already used in Hadoop v2

2017-11-14 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16252723#comment-16252723 ] Eric Yang commented on YARN-7218: - [~billie.rinaldi] This is good practice to add root level wrapper to

[jira] [Updated] (YARN-7218) ApiServer REST API naming convention /ws/v1 is already used in Hadoop v2

2017-11-25 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7218: Fix Version/s: 3.1.0 > ApiServer REST API naming convention /ws/v1 is already used in Hadoop v2 >

[jira] [Commented] (YARN-5534) Allow user provided Docker volume mount list

2017-11-22 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263698#comment-16263698 ] Eric Yang commented on YARN-5534: - [~ebadger] This is currently committed to trunk (3.1.0). > Allow user

[jira] [Updated] (YARN-5534) Allow user provided Docker volume mount list

2017-11-22 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-5534: Fix Version/s: 3.1.0 > Allow user provided Docker volume mount list >

[jira] [Commented] (YARN-5534) Allow user provided Docker volume mount list

2017-11-22 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263014#comment-16263014 ] Eric Yang commented on YARN-5534: - +1 looks good for 007. I will commit this shortly. > Allow user

[jira] [Updated] (YARN-7540) Convert yarn app cli to call yarn api services

2017-11-29 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7540: Attachment: YARN-7540.002.patch - Fixed styling issues. > Convert yarn app cli to call yarn api services >

[jira] [Created] (YARN-7590) Improve container-executor validation check

2017-11-30 Thread Eric Yang (JIRA)
Eric Yang created YARN-7590: --- Summary: Improve container-executor validation check Key: YARN-7590 URL: https://issues.apache.org/jira/browse/YARN-7590 Project: Hadoop YARN Issue Type: Improvement

[jira] [Updated] (YARN-7540) Convert yarn app cli to call yarn api services

2017-11-29 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7540: Attachment: (was: YARN-7540.001.patch) > Convert yarn app cli to call yarn api services >

[jira] [Updated] (YARN-7540) Convert yarn app cli to call yarn api services

2017-11-29 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7540: Attachment: YARN-7540.001.patch > Convert yarn app cli to call yarn api services >

[jira] [Assigned] (YARN-7540) Convert yarn app cli to call yarn api services

2017-11-29 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang reassigned YARN-7540: --- Assignee: Eric Yang > Convert yarn app cli to call yarn api services >

[jira] [Commented] (YARN-6669) Support security for YARN service framework

2017-11-29 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16271879#comment-16271879 ] Eric Yang commented on YARN-6669: - ServiceScheduler tries to register the application in zookeeper, but it

[jira] [Updated] (YARN-7540) Convert yarn app cli to call yarn api services

2017-11-29 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7540: Attachment: YARN-7540.001.patch - Rewired YARN client to API Service REST API. > Convert yarn app cli to

[jira] [Commented] (YARN-6669) Support security for YARN service framework

2017-12-04 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16277422#comment-16277422 ] Eric Yang commented on YARN-6669: - +1. Summary of this patch: # Initiate Kerberos login via Application

[jira] [Commented] (YARN-7590) Improve container-executor validation check

2017-12-04 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16277252#comment-16277252 ] Eric Yang commented on YARN-7590: - [~miklos.szeg...@cloudera.com] getuid() may produce uid belong to

[jira] [Assigned] (YARN-7590) Improve container-executor validation check

2017-12-04 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang reassigned YARN-7590: --- Assignee: Eric Yang > Improve container-executor validation check >

[jira] [Updated] (YARN-7590) Improve container-executor validation check

2017-12-04 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7590: Attachment: YARN-7590.001.patch - Added node manager prefix directory ownership validation check. > Improve

[jira] [Updated] (YARN-7605) Implement doAs for Api Service REST API

2017-12-04 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7605: Description: In YARN-7540, all client entry points for API service is centralized to use REST API instead of

[jira] [Created] (YARN-7605) Implement doAs for Api Service REST API

2017-12-04 Thread Eric Yang (JIRA)
Eric Yang created YARN-7605: --- Summary: Implement doAs for Api Service REST API Key: YARN-7605 URL: https://issues.apache.org/jira/browse/YARN-7605 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-6669) Support security for YARN service framework

2017-12-01 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16274754#comment-16274754 ] Eric Yang commented on YARN-6669: - In ServiceScheduler.java, the newly introduced code for setting

[jira] [Commented] (YARN-7590) Improve container-executor validation check

2017-12-01 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16274708#comment-16274708 ] Eric Yang commented on YARN-7590: - There is currently two proposals to address this issue: h3. Proposals

[jira] [Resolved] (YARN-7517) RegistryDNS does not work with secure ZooKeeper

2017-12-01 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang resolved YARN-7517. - Resolution: Duplicate Assignee: Jian He This issue will be fixed in YARN-6669. > RegistryDNS does

[jira] [Updated] (YARN-7540) Convert yarn app cli to call yarn api services

2017-12-12 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7540: Attachment: YARN-7540.006.patch > Convert yarn app cli to call yarn api services >

[jira] [Commented] (YARN-7590) Improve container-executor validation check

2017-12-14 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16291770#comment-16291770 ] Eric Yang commented on YARN-7590: - The unit test failure for TestContainerLaunch is caused by YARN-7381,

[jira] [Reopened] (YARN-7381) Enable the configuration: yarn.nodemanager.log-container-debug-info.enabled by default in yarn-default.xml

2017-12-14 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang reopened YARN-7381: - This patch is causing TestContainerLaunch unit test case to fail in hadoop-yarn-server-node-manager project.

[jira] [Updated] (YARN-7381) Enable the configuration: yarn.nodemanager.log-container-debug-info.enabled by default in yarn-default.xml

2017-12-14 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7381: Attachment:

[jira] [Updated] (YARN-7516) Security check for untrusted docker image

2017-12-14 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7516: Attachment: YARN-7516.002.patch - Updated configuration in site document. > Security check for untrusted

[jira] [Updated] (YARN-7605) Implement doAs for Api Service REST API

2017-12-18 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7605: Attachment: YARN-7605.006.patch - Fix some status report issues. > Implement doAs for Api Service REST API

[jira] [Commented] (YARN-7381) Enable the configuration: yarn.nodemanager.log-container-debug-info.enabled by default in yarn-default.xml

2017-12-15 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16292794#comment-16292794 ] Eric Yang commented on YARN-7381: - It would be best to understand the implication of turning on debug cause

[jira] [Commented] (YARN-7381) Enable the configuration: yarn.nodemanager.log-container-debug-info.enabled by default in yarn-default.xml

2017-12-15 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16292864#comment-16292864 ] Eric Yang commented on YARN-7381: - I verified that UGI.doAs call to ApplicationManager, the rpc channel

[jira] [Commented] (YARN-7381) Enable the configuration: yarn.nodemanager.log-container-debug-info.enabled by default in yarn-default.xml

2017-12-15 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16292946#comment-16292946 ] Eric Yang commented on YARN-7381: - Ignore the previous comment. There was an error in the testing

[jira] [Assigned] (YARN-7605) Implement doAs for Api Service REST API

2017-12-13 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang reassigned YARN-7605: --- Assignee: Eric Yang > Implement doAs for Api Service REST API >

[jira] [Updated] (YARN-7605) Implement doAs for Api Service REST API

2017-12-13 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7605: Attachment: YARN-7605.005.patch Fixed javadoc for the newly introduced servlet initialization. > Implement

[jira] [Updated] (YARN-7605) Implement doAs for Api Service REST API

2017-12-13 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7605: Attachment: YARN-7605.004.patch Rebase patch for changes occurred in YARN-7540. > Implement doAs for Api

[jira] [Updated] (YARN-7656) Can not destroy yarn service application in stopped state

2017-12-13 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7656: Issue Type: Sub-task (was: Bug) Parent: YARN-7054 > Can not destroy yarn service application in

[jira] [Commented] (YARN-7590) Improve container-executor validation check

2017-12-13 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16290142#comment-16290142 ] Eric Yang commented on YARN-7590: - [~miklos.szeg...@cloudera.com] Thank you for the review. I revised the

[jira] [Updated] (YARN-7590) Improve container-executor validation check

2017-12-13 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7590: Attachment: YARN-7590.002.patch - Capture uid during program start. > Improve container-executor validation

[jira] [Created] (YARN-7656) Can not destroy yarn service application in stopped state

2017-12-13 Thread Eric Yang (JIRA)
Eric Yang created YARN-7656: --- Summary: Can not destroy yarn service application in stopped state Key: YARN-7656 URL: https://issues.apache.org/jira/browse/YARN-7656 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-7540) Convert yarn app cli to call yarn api services

2017-12-12 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7540: Attachment: YARN-7540.005.patch - Fixed flex and save operation to map correctly to REST API. > Convert

[jira] [Resolved] (YARN-7507) TestNodeLabelContainerAllocation failing in trunk

2017-12-19 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang resolved YARN-7507. - Resolution: Duplicate Fixed by addendum patch for YARN-7466. > TestNodeLabelContainerAllocation failing

[jira] [Resolved] (YARN-7559) TestNodeLabelContainerAllocation failing intermittently

2017-12-19 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang resolved YARN-7559. - Resolution: Duplicate Fixed by addendum patch for YARN-7466. > TestNodeLabelContainerAllocation failing

[jira] [Commented] (YARN-5366) Improve handling of the Docker container life cycle

2017-12-19 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16297452#comment-16297452 ] Eric Yang commented on YARN-5366: - The current implementation seems to work like this: # Generate

[jira] [Commented] (YARN-7616) App status does not return state STABLE for a running and stable service

2017-12-19 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16297677#comment-16297677 ] Eric Yang commented on YARN-7616: - +1 Status of service is reflected more accurately with this patch. >

[jira] [Commented] (YARN-7466) ResourceRequest has a different default for allocationRequestId than Container

2017-12-19 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16297729#comment-16297729 ] Eric Yang commented on YARN-7466: - [~djp] I cherry-pick the addendum patch to branch 3.0. Thanks for the

[jira] [Updated] (YARN-7466) ResourceRequest has a different default for allocationRequestId than Container

2017-12-19 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7466: Fix Version/s: 3.0.1 > ResourceRequest has a different default for allocationRequestId than Container >

[jira] [Commented] (YARN-7565) Yarn service pre-maturely releases the container after AM restart

2017-12-19 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16297734#comment-16297734 ] Eric Yang commented on YARN-7565: - [~csingh] This is happening in my development cluster. My service spec

[jira] [Commented] (YARN-7565) Yarn service pre-maturely releases the container after AM restart

2017-12-19 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16297713#comment-16297713 ] Eric Yang commented on YARN-7565: - I get a null pointer exception like this: {code} 2017-12-20

[jira] [Commented] (YARN-7605) Implement doAs for Api Service REST API

2017-12-18 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16296071#comment-16296071 ] Eric Yang commented on YARN-7605: - The unit test failure for hadoop-common is broken by HADOOP-10054.

[jira] [Commented] (YARN-7507) TestNodeLabelContainerAllocation failing in trunk

2017-12-18 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16296216#comment-16296216 ] Eric Yang commented on YARN-7507: - This test was broken by YARN-7466. > TestNodeLabelContainerAllocation

[jira] [Commented] (YARN-7466) ResourceRequest has a different default for allocationRequestId than Container

2017-12-18 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16296214#comment-16296214 ] Eric Yang commented on YARN-7466: - This patch is breaking Resource Manager unit test. {code} mvn clean

[jira] [Created] (YARN-7654) Support ENTRY_POINT for docker container

2017-12-13 Thread Eric Yang (JIRA)
Eric Yang created YARN-7654: --- Summary: Support ENTRY_POINT for docker container Key: YARN-7654 URL: https://issues.apache.org/jira/browse/YARN-7654 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-7218) ApiServer REST API naming convention /ws/v1 is already used in Hadoop v2

2017-11-16 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255598#comment-16255598 ] Eric Yang commented on YARN-7218: - [~jianhe] Yes and no, it is related, but it is not something that we

[jira] [Commented] (YARN-5534) Allow whitelisted volume mounts

2017-11-16 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255583#comment-16255583 ] Eric Yang commented on YARN-5534: - [~ebadger] [~shaneku...@gmail.com] In YARN-7430, there was mentioned how

[jira] [Commented] (YARN-7506) Overhaul the design of the Linux container-executor regarding Docker and future runtimes

2017-11-17 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257446#comment-16257446 ] Eric Yang commented on YARN-7506: - [~miklos.szeg...@cloudera.com] We agree on trust and verify is the way

[jira] [Commented] (YARN-7523) Introduce description and version field in Service record

2017-11-17 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257479#comment-16257479 ] Eric Yang commented on YARN-7523: - [~gsaha] For catalog, can we consider these fields? # Organization #

[jira] [Commented] (YARN-7218) ApiServer REST API naming convention /ws/v1 is already used in Hadoop v2

2017-11-17 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257270#comment-16257270 ] Eric Yang commented on YARN-7218: - Thank you [~billie.rinaldi]. I just committed this. > ApiServer REST

[jira] [Commented] (YARN-7430) Enable user re-mapping for Docker containers by default

2017-11-17 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257348#comment-16257348 ] Eric Yang commented on YARN-7430: - Thank you [~vvasudev]. > Enable user re-mapping for Docker containers

[jira] [Commented] (YARN-7470) TestYarnNativeServices testRecoverComponentsAfterRMRestart fails due to BindingException

2017-11-17 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257254#comment-16257254 ] Eric Yang commented on YARN-7470: - [~csingh] Are we at risk of introducing circular dependencies?

[jira] [Comment Edited] (YARN-5673) [Umbrella] Re-write container-executor to improve security, extensibility, and portability

2017-11-17 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257315#comment-16257315 ] Eric Yang edited comment on YARN-5673 at 11/17/17 6:11 PM: --- Hi

[jira] [Commented] (YARN-5673) [Umbrella] Re-write container-executor to improve security, extensibility, and portability

2017-11-17 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257315#comment-16257315 ] Eric Yang commented on YARN-5673: - Hi [~miklos.szeg...@cloudera.com] 4) For clean up container, it *might*

[jira] [Comment Edited] (YARN-7530) hadoop-yarn-services-api should be part of hadoop-yarn-services

2017-11-17 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257593#comment-16257593 ] Eric Yang edited comment on YARN-7530 at 11/17/17 9:23 PM: --- This patch is same

[jira] [Assigned] (YARN-7530) hadoop-yarn-services-api should be part of hadoop-yarn-services

2017-11-17 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang reassigned YARN-7530: --- Assignee: Eric Yang > hadoop-yarn-services-api should be part of hadoop-yarn-services >

[jira] [Updated] (YARN-7530) hadoop-yarn-services-api should be part of hadoop-yarn-services

2017-11-17 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7530: Attachment: YARN-7530.001.patch This patch is same as: {{code}} git mv hadoop-yarn-services-api

[jira] [Created] (YARN-7530) hadoop-yarn-services-api should be part of hadoop-yarn-services

2017-11-17 Thread Eric Yang (JIRA)
Eric Yang created YARN-7530: --- Summary: hadoop-yarn-services-api should be part of hadoop-yarn-services Key: YARN-7530 URL: https://issues.apache.org/jira/browse/YARN-7530 Project: Hadoop YARN

[jira] [Comment Edited] (YARN-7218) ApiServer REST API naming convention /ws/v1 is already used in Hadoop v2

2017-11-10 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16247767#comment-16247767 ] Eric Yang edited comment on YARN-7218 at 11/10/17 4:58 PM: --- Service REST API was

[jira] [Reopened] (YARN-7218) ApiServer REST API naming convention /ws/v1 is already used in Hadoop v2

2017-11-10 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang reopened YARN-7218: - Service REST API was written to use Jackson natural serialization format to serialize and deserialize

[jira] [Created] (YARN-7472) Inconsistent annotation and getter/setter method for Service data model

2017-11-10 Thread Eric Yang (JIRA)
Eric Yang created YARN-7472: --- Summary: Inconsistent annotation and getter/setter method for Service data model Key: YARN-7472 URL: https://issues.apache.org/jira/browse/YARN-7472 Project: Hadoop YARN

[jira] [Commented] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-10 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248147#comment-16248147 ] Eric Yang commented on YARN-7430: - {quote} I don't believe that is true? I'm referring to YARN containers,

[jira] [Commented] (YARN-7218) ApiServer REST API naming convention /ws/v1 is already used in Hadoop v2

2017-11-13 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16250523#comment-16250523 ] Eric Yang commented on YARN-7218: - The failed unit tests are not related to this patch. > ApiServer REST

[jira] [Updated] (YARN-7218) ApiServer REST API naming convention /ws/v1 is already used in Hadoop v2

2017-11-13 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7218: Attachment: YARN-7218.003.patch - Revise patch to exclude POJOMapping logic. That code is not essential to

[jira] [Commented] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-13 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16249817#comment-16249817 ] Eric Yang commented on YARN-7430: - [~ebadger] {quote} What about the logs written via log4j or some other

[jira] [Updated] (YARN-7447) Fix a couple of issues in services REST API

2017-11-13 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7447: Attachment: YARN-7447.003.patch Revise the patch to handle classpath issue only. The second discovered

[jira] [Updated] (YARN-7218) ApiServer REST API naming convention /ws/v1 is already used in Hadoop v2

2017-11-13 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7218: Attachment: YARN-7218.001.patch - Setup a separate servlet for initialize YARN service rest api. -

[jira] [Updated] (YARN-7218) ApiServer REST API naming convention /ws/v1 is already used in Hadoop v2

2017-11-13 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7218: Attachment: YARN-7218.002.patch Rebase patch to current trunk. > ApiServer REST API naming convention

[jira] [Commented] (YARN-7539) NullPointerException in timeline service v2

2017-11-20 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16259992#comment-16259992 ] Eric Yang commented on YARN-7539: - Hi [~vrushalic], yes, the job failed because container can not be

[jira] [Created] (YARN-7540) Convert yarn app cli to call yarn api services

2017-11-20 Thread Eric Yang (JIRA)
Eric Yang created YARN-7540: --- Summary: Convert yarn app cli to call yarn api services Key: YARN-7540 URL: https://issues.apache.org/jira/browse/YARN-7540 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Created] (YARN-7539) NullPointerException in timeline service v2

2017-11-20 Thread Eric Yang (JIRA)
Eric Yang created YARN-7539: --- Summary: NullPointerException in timeline service v2 Key: YARN-7539 URL: https://issues.apache.org/jira/browse/YARN-7539 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-5534) Allow user provided Docker volume mount list

2017-11-21 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261038#comment-16261038 ] Eric Yang commented on YARN-5534: - [~shaneku...@gmail.com] This failure is caused by: {code} :: {code}

[jira] [Comment Edited] (YARN-7399) Yarn services metadata storage improvement

2017-11-21 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261337#comment-16261337 ] Eric Yang edited comment on YARN-7399 at 11/21/17 7:24 PM: --- Hi [~billie.rinaldi],

[jira] [Comment Edited] (YARN-7399) Yarn services metadata storage improvement

2017-11-21 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261337#comment-16261337 ] Eric Yang edited comment on YARN-7399 at 11/21/17 7:25 PM: --- Hi [~billie.rinaldi],

[jira] [Updated] (YARN-7399) Yarn services metadata storage improvement

2017-11-21 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7399: Attachment: YARN-7399.002.patch [~billie.rinaldi], updated according to your suggestion. > Yarn services

[jira] [Commented] (YARN-7399) Yarn services metadata storage improvement

2017-11-21 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261337#comment-16261337 ] Eric Yang commented on YARN-7399: - Hi [~billie.rinaldi], YARN-7523 has a proposal for refining Service

[jira] [Commented] (YARN-7505) RM REST endpoints generate malformed JSON

2017-11-16 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255682#comment-16255682 ] Eric Yang commented on YARN-7505: - Hi [~templedf], Part of Hadoop switched to com.fastxml version of

[jira] [Updated] (YARN-7516) Security check for untrusted docker image

2017-11-16 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7516: Description: Hadoop YARN Services can support using private docker registry image or docker image from

[jira] [Created] (YARN-7516) Security check for untrusted docker image

2017-11-16 Thread Eric Yang (JIRA)
Eric Yang created YARN-7516: --- Summary: Security check for untrusted docker image Key: YARN-7516 URL: https://issues.apache.org/jira/browse/YARN-7516 Project: Hadoop YARN Issue Type: Improvement

[jira] [Commented] (YARN-5534) Allow whitelisted volume mounts

2017-11-16 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255850#comment-16255850 ] Eric Yang commented on YARN-5534: - [~shaneku...@gmail.com][~ebadger] . Thanks for the input. I open a

[jira] [Commented] (YARN-7516) Security check for untrusted docker image

2017-11-16 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255811#comment-16255811 ] Eric Yang commented on YARN-7516: - Other possible solution is to use docker user remapping feature to

[jira] [Commented] (YARN-7516) Security check for untrusted docker image

2017-11-16 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255856#comment-16255856 ] Eric Yang commented on YARN-7516: - [~ebadger] Will do. Thanks for the advice. > Security check for

[jira] [Commented] (YARN-7506) Overhaul the design of the Linux container-executor regarding Docker and future runtimes

2017-11-16 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256115#comment-16256115 ] Eric Yang commented on YARN-7506: - IMO, Container-executor is essentially a light weight sudo with extra

[jira] [Commented] (YARN-5673) [Umbrella] Re-write container-executor to improve security, extensibility, and portability

2017-11-16 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256151#comment-16256151 ] Eric Yang commented on YARN-5673: - It would be safer for container-executor to follow specific workflow,

[jira] [Commented] (YARN-7505) RM REST endpoints generate malformed JSON

2017-11-16 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255837#comment-16255837 ] Eric Yang commented on YARN-7505: - [~templedf] YARN-7218 describes the same challenges with YARN services

[jira] [Updated] (YARN-7517) RegistryDNS does not work with secure ZooKeeper

2017-11-16 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7517: Attachment: YARN-7517.001.patch Rebase Jian's code to trunk. > RegistryDNS does not work with secure

[jira] [Created] (YARN-7517) RegistryDNS does not work with secure ZooKeeper

2017-11-16 Thread Eric Yang (JIRA)
Eric Yang created YARN-7517: --- Summary: RegistryDNS does not work with secure ZooKeeper Key: YARN-7517 URL: https://issues.apache.org/jira/browse/YARN-7517 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-7517) RegistryDNS does not work with secure ZooKeeper

2017-11-16 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7517: Issue Type: Sub-task (was: Bug) Parent: YARN-7054 > RegistryDNS does not work with secure ZooKeeper

[jira] [Commented] (YARN-5366) Improve handling of the Docker container life cycle

2017-11-15 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16254598#comment-16254598 ] Eric Yang commented on YARN-5366: - {{--rm}} will remove container when docker is restarted. If a system

[jira] [Commented] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-14 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16252023#comment-16252023 ] Eric Yang commented on YARN-7430: - [~ebadger] {quote} I agree, but I was under the assumption that this was

[jira] [Commented] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-14 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16251805#comment-16251805 ] Eric Yang commented on YARN-7430: - [~ebadger] IT infrastructure keeps the entire company's user credential

[jira] [Comment Edited] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-14 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16251805#comment-16251805 ] Eric Yang edited comment on YARN-7430 at 11/14/17 5:40 PM: --- [~ebadger] IT

[jira] [Commented] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-13 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16250242#comment-16250242 ] Eric Yang commented on YARN-7430: - [~shaneku...@gmail.com] {quote} I'm concerned that we are changing

[jira] [Commented] (YARN-7218) ApiServer REST API naming convention /ws/v1 is already used in Hadoop v2

2017-11-13 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16250299#comment-16250299 ] Eric Yang commented on YARN-7218: - [~gsaha] Thanks for the review. There is no other entry point to

<    1   2   3   4   5   6   7   8   9   10   >