[jira] [Updated] (YARN-7540) Convert yarn app cli to call yarn api services

2017-12-08 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7540: Attachment: YARN-7540.004.patch - Bugfix to make sure non-HA + SSL mode uses yarn.resourcemanager.webapp.htt

[jira] [Commented] (YARN-7540) Convert yarn app cli to call yarn api services

2017-12-08 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16284456#comment-16284456 ] Eric Yang commented on YARN-7540: - The failed unit test is not related to this JIRA. > Con

[jira] [Updated] (YARN-7605) Implement doAs for Api Service REST API

2017-12-08 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7605: Attachment: YARN-7605.001.patch - Add server side REST API check for kerberos tokens - Added doAs call to per

[jira] [Commented] (YARN-7516) Security check for untrusted docker image

2017-12-11 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16287195#comment-16287195 ] Eric Yang commented on YARN-7516: - [~vinodkv] Thank you for the review. Images are untrust

[jira] [Updated] (YARN-7540) Convert yarn app cli to call yarn api services

2017-12-12 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7540: Attachment: YARN-7540.005.patch - Fixed flex and save operation to map correctly to REST API. > Convert yarn

[jira] [Updated] (YARN-7540) Convert yarn app cli to call yarn api services

2017-12-12 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7540: Attachment: YARN-7540.006.patch > Convert yarn app cli to call yarn api services > --

[jira] [Created] (YARN-7654) Support ENTRY_POINT for docker container

2017-12-13 Thread Eric Yang (JIRA)
Eric Yang created YARN-7654: --- Summary: Support ENTRY_POINT for docker container Key: YARN-7654 URL: https://issues.apache.org/jira/browse/YARN-7654 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Updated] (YARN-7590) Improve container-executor validation check

2017-12-13 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7590: Attachment: YARN-7590.002.patch - Capture uid during program start. > Improve container-executor validation

[jira] [Commented] (YARN-7590) Improve container-executor validation check

2017-12-13 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16290142#comment-16290142 ] Eric Yang commented on YARN-7590: - [~miklos.szeg...@cloudera.com] Thank you for the review.

[jira] [Created] (YARN-7656) Can not destroy yarn service application in stopped state

2017-12-13 Thread Eric Yang (JIRA)
Eric Yang created YARN-7656: --- Summary: Can not destroy yarn service application in stopped state Key: YARN-7656 URL: https://issues.apache.org/jira/browse/YARN-7656 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-7656) Can not destroy yarn service application in stopped state

2017-12-13 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7656: Issue Type: Sub-task (was: Bug) Parent: YARN-7054 > Can not destroy yarn service application in stop

[jira] [Assigned] (YARN-7605) Implement doAs for Api Service REST API

2017-12-13 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang reassigned YARN-7605: --- Assignee: Eric Yang > Implement doAs for Api Service REST API > --

[jira] [Updated] (YARN-7605) Implement doAs for Api Service REST API

2017-12-13 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7605: Attachment: YARN-7605.004.patch Rebase patch for changes occurred in YARN-7540. > Implement doAs for Api Ser

[jira] [Updated] (YARN-7605) Implement doAs for Api Service REST API

2017-12-13 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7605: Attachment: YARN-7605.005.patch Fixed javadoc for the newly introduced servlet initialization. > Implement d

[jira] [Updated] (YARN-7516) Security check for untrusted docker image

2017-12-14 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7516: Attachment: YARN-7516.002.patch - Updated configuration in site document. > Security check for untrusted doc

[jira] [Commented] (YARN-7590) Improve container-executor validation check

2017-12-14 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16291770#comment-16291770 ] Eric Yang commented on YARN-7590: - The unit test failure for TestContainerLaunch is caused

[jira] [Reopened] (YARN-7381) Enable the configuration: yarn.nodemanager.log-container-debug-info.enabled by default in yarn-default.xml

2017-12-14 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang reopened YARN-7381: - This patch is causing TestContainerLaunch unit test case to fail in hadoop-yarn-server-node-manager project.

[jira] [Updated] (YARN-7381) Enable the configuration: yarn.nodemanager.log-container-debug-info.enabled by default in yarn-default.xml

2017-12-14 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7381: Attachment: org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.TestContainerLaunch-output.tx

[jira] [Commented] (YARN-7381) Enable the configuration: yarn.nodemanager.log-container-debug-info.enabled by default in yarn-default.xml

2017-12-15 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16292794#comment-16292794 ] Eric Yang commented on YARN-7381: - It would be best to understand the implication of turnin

[jira] [Commented] (YARN-7381) Enable the configuration: yarn.nodemanager.log-container-debug-info.enabled by default in yarn-default.xml

2017-12-15 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16292864#comment-16292864 ] Eric Yang commented on YARN-7381: - I verified that UGI.doAs call to ApplicationManager, the

[jira] [Commented] (YARN-7381) Enable the configuration: yarn.nodemanager.log-container-debug-info.enabled by default in yarn-default.xml

2017-12-15 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16292946#comment-16292946 ] Eric Yang commented on YARN-7381: - Ignore the previous comment. There was an error in the

[jira] [Updated] (YARN-7605) Implement doAs for Api Service REST API

2017-12-18 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7605: Attachment: YARN-7605.006.patch - Fix some status report issues. > Implement doAs for Api Service REST API >

[jira] [Commented] (YARN-7605) Implement doAs for Api Service REST API

2017-12-18 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16296071#comment-16296071 ] Eric Yang commented on YARN-7605: - The unit test failure for hadoop-common is broken by HAD

[jira] [Commented] (YARN-7466) ResourceRequest has a different default for allocationRequestId than Container

2017-12-18 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16296214#comment-16296214 ] Eric Yang commented on YARN-7466: - This patch is breaking Resource Manager unit test. {cod

[jira] [Commented] (YARN-7507) TestNodeLabelContainerAllocation failing in trunk

2017-12-18 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16296216#comment-16296216 ] Eric Yang commented on YARN-7507: - This test was broken by YARN-7466. > TestNodeLabelConta

[jira] [Commented] (YARN-5366) Improve handling of the Docker container life cycle

2017-12-19 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16297452#comment-16297452 ] Eric Yang commented on YARN-5366: - The current implementation seems to work like this: #

[jira] [Resolved] (YARN-7559) TestNodeLabelContainerAllocation failing intermittently

2017-12-19 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang resolved YARN-7559. - Resolution: Duplicate Fixed by addendum patch for YARN-7466. > TestNodeLabelContainerAllocation failing in

[jira] [Resolved] (YARN-7507) TestNodeLabelContainerAllocation failing in trunk

2017-12-19 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang resolved YARN-7507. - Resolution: Duplicate Fixed by addendum patch for YARN-7466. > TestNodeLabelContainerAllocation failing in

[jira] [Commented] (YARN-7616) App status does not return state STABLE for a running and stable service

2017-12-19 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16297677#comment-16297677 ] Eric Yang commented on YARN-7616: - +1 Status of service is reflected more accurately with t

[jira] [Commented] (YARN-7565) Yarn service pre-maturely releases the container after AM restart

2017-12-19 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16297713#comment-16297713 ] Eric Yang commented on YARN-7565: - I get a null pointer exception like this: {code} 2017-1

[jira] [Updated] (YARN-7466) ResourceRequest has a different default for allocationRequestId than Container

2017-12-19 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7466: Fix Version/s: 3.0.1 > ResourceRequest has a different default for allocationRequestId than Container > -

[jira] [Commented] (YARN-7466) ResourceRequest has a different default for allocationRequestId than Container

2017-12-19 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16297729#comment-16297729 ] Eric Yang commented on YARN-7466: - [~djp] I cherry-pick the addendum patch to branch 3.0.

[jira] [Commented] (YARN-7565) Yarn service pre-maturely releases the container after AM restart

2017-12-19 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16297734#comment-16297734 ] Eric Yang commented on YARN-7565: - [~csingh] This is happening in my development cluster.

[jira] [Commented] (YARN-7565) Yarn service pre-maturely releases the container after AM restart

2017-12-20 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16298747#comment-16298747 ] Eric Yang commented on YARN-7565: - Thank you for point out the record.description maps to c

[jira] [Comment Edited] (YARN-7565) Yarn service pre-maturely releases the container after AM restart

2017-12-20 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16298747#comment-16298747 ] Eric Yang edited comment on YARN-7565 at 12/20/17 5:33 PM: --- Thank

[jira] [Commented] (YARN-7565) Yarn service pre-maturely releases the container after AM restart

2017-12-20 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16298837#comment-16298837 ] Eric Yang commented on YARN-7565: - More information revealed that, there was a problem with

[jira] [Updated] (YARN-7605) Implement doAs for Api Service REST API

2017-12-20 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7605: Attachment: YARN-7605.007.patch - Fix checkstyle issues. > Implement doAs for Api Service REST API > ---

[jira] [Resolved] (YARN-7381) Enable the configuration: yarn.nodemanager.log-container-debug-info.enabled by default in yarn-default.xml

2017-12-20 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang resolved YARN-7381. - Resolution: Fixed When NM_LOG_CONTAINER_DEBUG_INFO is enabled, and there is a problem to execute container

[jira] [Updated] (YARN-7590) Improve container-executor validation check

2017-12-20 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7590: Description: There is minimum check for prefix path for container-executor. If YARN is compromised, attacke

[jira] [Updated] (YARN-7590) Improve container-executor validation check

2017-12-20 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7590: Attachment: YARN-7590.003.patch - Rename uid to caller_uid. - Use global variable for caller_uid to minimize

[jira] [Updated] (YARN-7590) Improve container-executor validation check

2017-12-20 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7590: Attachment: YARN-7590.004.patch - Fix a segmentation fault in test case. > Improve container-executor valida

[jira] [Updated] (YARN-7605) Implement doAs for Api Service REST API

2017-12-20 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7605: Attachment: YARN-7605.008.patch > Implement doAs for Api Service REST API > -

[jira] [Commented] (YARN-7605) Implement doAs for Api Service REST API

2017-12-21 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16300235#comment-16300235 ] Eric Yang commented on YARN-7605: - Hadoop common unit test failure is tracked in HADOOP-151

[jira] [Updated] (YARN-7516) Security check for untrusted docker image

2017-12-21 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7516: Attachment: YARN-7516.003.patch - Fix checkstyle warnings. - Findbug issue is not introduced by this patch.

[jira] [Resolved] (YARN-7656) Can not destroy yarn service application in stopped state

2017-12-21 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang resolved YARN-7656. - Resolution: Resolved Assignee: Eric Yang This has been addressed as part of YARN-7605. > Can not des

[jira] [Commented] (YARN-7516) Security check for untrusted docker image

2017-12-21 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16300453#comment-16300453 ] Eric Yang commented on YARN-7516: - Findbug, shadedclient, and unit test failures exists in

[jira] [Updated] (YARN-7605) Implement doAs for Api Service REST API

2017-12-22 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7605: Attachment: YARN-7605.009.patch - Fix a bug where pseudo security use doAs=username to allow impersonation.

[jira] [Updated] (YARN-7590) Improve container-executor validation check

2017-12-22 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7590: Attachment: YARN-7590.005.patch - Added directory permission check before creation of directories. - Reuse nm

[jira] [Commented] (YARN-7590) Improve container-executor validation check

2017-12-22 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16301970#comment-16301970 ] Eric Yang commented on YARN-7590: - [~miklos.szeg...@cloudera.com] Thank you for the feedbac

[jira] [Commented] (YARN-7677) HADOOP_CONF_DIR should not be automatically put in task environment

2018-01-02 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16308357#comment-16308357 ] Eric Yang commented on YARN-7677: - [~ebadger] Happy new year. I think it will be safer for

[jira] [Comment Edited] (YARN-7677) HADOOP_CONF_DIR should not be automatically put in task environment

2018-01-02 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16308357#comment-16308357 ] Eric Yang edited comment on YARN-7677 at 1/2/18 4:54 PM: - [~ebadger

[jira] [Updated] (YARN-7590) Improve container-executor validation check

2018-01-02 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7590: Attachment: YARN-7590.006.patch - Updated according to most recent feedback. > Improve container-executor va

[jira] [Commented] (YARN-7590) Improve container-executor validation check

2018-01-03 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16309902#comment-16309902 ] Eric Yang commented on YARN-7590: - Happy New Year [~miklos.szeg...@cloudera.com], Can you r

[jira] [Commented] (YARN-7677) HADOOP_CONF_DIR should not be automatically put in task environment

2018-01-03 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16309995#comment-16309995 ] Eric Yang commented on YARN-7677: - [~ebadger] I think I understand your scenario better now

[jira] [Commented] (YARN-7516) Security check for untrusted docker image

2018-01-03 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16310005#comment-16310005 ] Eric Yang commented on YARN-7516: - Ping, can someone review 003 patch? Thanks > Security

[jira] [Commented] (YARN-7677) HADOOP_CONF_DIR should not be automatically put in task environment

2018-01-03 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16310273#comment-16310273 ] Eric Yang commented on YARN-7677: - [~ebadger] My initial reaction would be to make docker c

[jira] [Commented] (YARN-7677) HADOOP_CONF_DIR should not be automatically put in task environment

2018-01-03 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16310288#comment-16310288 ] Eric Yang commented on YARN-7677: - I think I am stuck on understanding: {quote} It complet

[jira] [Updated] (YARN-7516) Security check for untrusted docker image

2018-01-03 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7516: Attachment: YARN-7516.004.patch [~ebadger] Patch applies. The rebased patch is attached in 004. > Security

[jira] [Comment Edited] (YARN-7677) HADOOP_CONF_DIR should not be automatically put in task environment

2018-01-03 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16310288#comment-16310288 ] Eric Yang edited comment on YARN-7677 at 1/3/18 9:33 PM: - I think I

[jira] [Commented] (YARN-7677) HADOOP_CONF_DIR should not be automatically put in task environment

2018-01-03 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16310385#comment-16310385 ] Eric Yang commented on YARN-7677: - [~ebadger] I think I understand the goal now. Thank you

[jira] [Commented] (YARN-7516) Security check for untrusted docker image

2018-01-03 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16310455#comment-16310455 ] Eric Yang commented on YARN-7516: - [~ebadger] The same question has been ask by Vinod on De

[jira] [Commented] (YARN-7516) Security check for untrusted docker image

2018-01-04 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16311772#comment-16311772 ] Eric Yang commented on YARN-7516: - [~miklos.szeg...@cloudera.com] . The privileged containe

[jira] [Updated] (YARN-7605) Implement doAs for Api Service REST API

2018-01-04 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7605: Attachment: YARN-7605.010.patch [~jianhe] Thank you for the review. Patch 10 fixed unused parameter clazz, t

[jira] [Updated] (YARN-7605) Implement doAs for Api Service REST API

2018-01-05 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7605: Attachment: YARN-7605.011.patch - Added configuration instruction. > Implement doAs for Api Service REST API

[jira] [Updated] (YARN-7605) Implement doAs for Api Service REST API

2018-01-05 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7605: Attachment: YARN-7605.012.patch > Implement doAs for Api Service REST API > -

[jira] [Updated] (YARN-7590) Improve container-executor validation check

2018-01-05 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7590: Attachment: YARN-7590.007.patch - Produce more verbose messages on failure. > Improve container-executor val

[jira] [Comment Edited] (YARN-7590) Improve container-executor validation check

2018-01-05 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16313502#comment-16313502 ] Eric Yang edited comment on YARN-7590 at 1/5/18 5:34 PM: - [~miklos.

[jira] [Commented] (YARN-7590) Improve container-executor validation check

2018-01-05 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16313502#comment-16313502 ] Eric Yang commented on YARN-7590: - [~miklos.szeg...@cloudera.com] Sorry about missing the l

[jira] [Updated] (YARN-7516) Security check for untrusted docker image

2018-01-05 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7516: Attachment: YARN-7516.005.patch - Moved validation to container-executor. > Security check for untrusted doc

[jira] [Updated] (YARN-7590) Improve container-executor validation check

2018-01-05 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7590: Attachment: YARN-7590.008.patch [~miklos.szeg...@cloudera.com] Are you using the same user on multiple build?

[jira] [Updated] (YARN-7605) Implement doAs for Api Service REST API

2018-01-05 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7605: Attachment: YARN-7605.013.patch - Disable proxy user check when security is not enabled. > Implement doAs fo

[jira] [Commented] (YARN-7540) Convert yarn app cli to call yarn api services

2018-01-05 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16314423#comment-16314423 ] Eric Yang commented on YARN-7540: - Hadoop officially supports two distinct security modes,

[jira] [Commented] (YARN-7516) Security check for untrusted docker image

2018-01-08 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317330#comment-16317330 ] Eric Yang commented on YARN-7516: - [~ebadger] Thanks for the review. I will fix the first

[jira] [Updated] (YARN-7605) Implement doAs for Api Service REST API

2018-01-08 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7605: Attachment: YARN-7605.014.patch [~jianhe] . Thanks for the review: {quote} Previous comment: Here it still a

[jira] [Updated] (YARN-7605) Implement doAs for Api Service REST API

2018-01-08 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7605: Attachment: (was: YARN-7605.014.patch) > Implement doAs for Api Service REST API > --

[jira] [Updated] (YARN-7605) Implement doAs for Api Service REST API

2018-01-08 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7605: Attachment: YARN-7605.014.patch > Implement doAs for Api Service REST API > -

[jira] [Commented] (YARN-7605) Implement doAs for Api Service REST API

2018-01-08 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317550#comment-16317550 ] Eric Yang commented on YARN-7605: - Patch failed due to revert of YARN-7540. Please commit

[jira] [Commented] (YARN-7605) Implement doAs for Api Service REST API

2018-01-08 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317705#comment-16317705 ] Eric Yang commented on YARN-7605: - [~jianhe] {quote} IIUC, the code is load if app is not r

[jira] [Commented] (YARN-7605) Implement doAs for Api Service REST API

2018-01-09 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16318862#comment-16318862 ] Eric Yang commented on YARN-7605: - [~jianhe] If we don't load spec from HDFS, then the info

[jira] [Comment Edited] (YARN-7605) Implement doAs for Api Service REST API

2018-01-09 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16318862#comment-16318862 ] Eric Yang edited comment on YARN-7605 at 1/9/18 6:24 PM: - [~jianhe]

[jira] [Commented] (YARN-7590) Improve container-executor validation check

2018-01-09 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16319001#comment-16319001 ] Eric Yang commented on YARN-7590: - Hi [~miklos.szeg...@cloudera.com], could you shed some l

[jira] [Updated] (YARN-7516) Security check for untrusted docker image

2018-01-09 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7516: Attachment: YARN-7516.006.patch - Change variable name to privileged_registry. - Improved registry name detec

[jira] [Commented] (YARN-7605) Implement doAs for Api Service REST API

2018-01-09 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16319275#comment-16319275 ] Eric Yang commented on YARN-7605: - [~jianhe] Life time remaining calculated from RM doesn't

[jira] [Updated] (YARN-7516) Security check for untrusted docker image

2018-01-09 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7516: Attachment: YARN-7516.007.patch [~ebadger] Good catch on C99 restriction. Patch 007 removed usage of boolean

[jira] [Commented] (YARN-7605) Implement doAs for Api Service REST API

2018-01-09 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16319487#comment-16319487 ] Eric Yang commented on YARN-7605: - [~jianhe] In the current trunk, the life time is set at

[jira] [Updated] (YARN-7605) Implement doAs for Api Service REST API

2018-01-09 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7605: Attachment: YARN-7605.015.patch - Added a fix to display remaining lifetime properly. Patch 015 is still ret

[jira] [Commented] (YARN-5366) Improve handling of the Docker container life cycle

2018-01-10 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16320775#comment-16320775 ] Eric Yang commented on YARN-5366: - [~shaneku...@gmail.com] The way docker commands are hand

[jira] [Commented] (YARN-7717) Add configuration consistency for module.enabled and docker.privileged-containers.enabled

2018-01-10 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16320820#comment-16320820 ] Eric Yang commented on YARN-7717: - Can we use {code} #include intstrcasecmp(const ch

[jira] [Reopened] (YARN-7540) Convert yarn app cli to call yarn api services

2018-01-10 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang reopened YARN-7540: - The code has been reverted. Keep this issue reopened and patch available to track commit for YARN-7540 and YA

[jira] [Commented] (YARN-5366) Improve handling of the Docker container life cycle

2018-01-10 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16321093#comment-16321093 ] Eric Yang commented on YARN-5366: - Docker rm [container-id] already send TERM signal to the

[jira] [Updated] (YARN-7731) RegistryDNS should handle upstream DNS returning CNAME

2018-01-10 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7731: Attachment: YARN-7731.001.patch Add recursive lookup for cname record. > RegistryDNS should handle upstream

[jira] [Created] (YARN-7733) Clean up YARN services znode after application is destroyed

2018-01-10 Thread Eric Yang (JIRA)
Eric Yang created YARN-7733: --- Summary: Clean up YARN services znode after application is destroyed Key: YARN-7733 URL: https://issues.apache.org/jira/browse/YARN-7733 Project: Hadoop YARN Issue Ty

[jira] [Updated] (YARN-7590) Improve container-executor validation check

2018-01-10 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7590: Attachment: YARN-7590.009.patch [~miklos.szeg...@cloudera.com] Thank you for the review. Good catch on chec

[jira] [Commented] (YARN-7724) yarn application status should support application name

2018-01-10 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16321600#comment-16321600 ] Eric Yang commented on YARN-7724: - If RM is rebooted, the application status shows errors:

[jira] [Commented] (YARN-7590) Improve container-executor validation check

2018-01-11 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16322538#comment-16322538 ] Eric Yang commented on YARN-7590: - [~miklos.szeg...@cloudera.com] Sure, I can wait for YARN

[jira] [Comment Edited] (YARN-7590) Improve container-executor validation check

2018-01-11 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16322559#comment-16322559 ] Eric Yang edited comment on YARN-7590 at 1/11/18 5:04 PM: -- Fixed {

[jira] [Updated] (YARN-7590) Improve container-executor validation check

2018-01-11 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7590: Attachment: YARN-7590.010.patch Fixed {{strerror(errno)}} problem in case, we decided to unblock YARN-7705 an

[jira] [Commented] (YARN-7516) Security check for untrusted docker image

2018-01-11 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16322693#comment-16322693 ] Eric Yang commented on YARN-7516: - [~ebadger] Thanks for the review. The untrusted image w

[jira] [Comment Edited] (YARN-7516) Security check for untrusted docker image

2018-01-11 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16322693#comment-16322693 ] Eric Yang edited comment on YARN-7516 at 1/11/18 6:22 PM: -- [~ebadg

[jira] [Updated] (YARN-7731) RegistryDNS should handle upstream DNS returning CNAME

2018-01-11 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7731: Attachment: YARN-7731.002.patch - Fixed test case accuracy to verify existence of A record instead of dependi

<    10   11   12   13   14   15   16   17   18   19   >