[jira] [Commented] (YARN-8342) Using docker image from a non-privileged registry, the launch_command is not honored

2018-05-29 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16494120#comment-16494120 ] Eric Yang commented on YARN-8342: - [~ebadger] {quote} You have high confidence in everything in this

[jira] [Created] (YARN-8376) Separate white list for docker.trusted.registries and docker.privileged-container.registries

2018-05-29 Thread Eric Yang (JIRA)
Eric Yang created YARN-8376: --- Summary: Separate white list for docker.trusted.registries and docker.privileged-container.registries Key: YARN-8376 URL: https://issues.apache.org/jira/browse/YARN-8376

[jira] [Commented] (YARN-8342) Using docker image from a non-privileged registry, the launch_command is not honored

2018-05-30 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16495831#comment-16495831 ] Eric Yang commented on YARN-8342: - Patch 002 includes: - Allow untrusted image to supply launch_command to

[jira] [Updated] (YARN-8333) Load balance YARN services using RegistryDNS multiple A records

2018-05-30 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8333: Attachment: YARN-8333.003.patch > Load balance YARN services using RegistryDNS multiple A records >

[jira] [Updated] (YARN-8333) Load balance YARN services using RegistryDNS multiple A records

2018-05-30 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8333: Attachment: (was: YARN-8333.003.patch) > Load balance YARN services using RegistryDNS multiple A

[jira] [Comment Edited] (YARN-8197) Tracking URL in the app state does not get redirected to MR ApplicationMaster for Running applications

2018-05-30 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16495934#comment-16495934 ] Eric Yang edited comment on YARN-8197 at 5/31/18 12:36 AM: --- I am able to look at

[jira] [Updated] (YARN-8342) Using docker image from a non-privileged registry, the launch_command is not honored

2018-05-30 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8342: Attachment: YARN-8342.002.patch > Using docker image from a non-privileged registry, the launch_command is

[jira] [Comment Edited] (YARN-8342) Using docker image from a non-privileged registry, the launch_command is not honored

2018-05-30 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16495831#comment-16495831 ] Eric Yang edited comment on YARN-8342 at 5/30/18 10:51 PM: --- Patch 002 includes:

[jira] [Updated] (YARN-8342) Using docker image from a non-privileged registry, the launch_command is not honored

2018-05-30 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8342: Target Version/s: 3.2.0, 3.1.1 > Using docker image from a non-privileged registry, the launch_command is

[jira] [Commented] (YARN-8333) Load balance YARN services using RegistryDNS multiple A records

2018-05-30 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16495861#comment-16495861 ] Eric Yang commented on YARN-8333: - [~billie.rinaldi] Thank you for the review. Patch 3 added

[jira] [Updated] (YARN-8333) Load balance YARN services using RegistryDNS multiple A records

2018-05-30 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8333: Attachment: YARN-8333.003.patch > Load balance YARN services using RegistryDNS multiple A records >

[jira] [Commented] (YARN-8197) Tracking URL in the app state does not get redirected to MR ApplicationMaster for Running applications

2018-05-30 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16495934#comment-16495934 ] Eric Yang commented on YARN-8197: - +1 . I am able to look at AM UI for Mapreduce job on a secure cluster

[jira] [Commented] (YARN-8342) Using docker image from a non-privileged registry, the launch_command is not honored

2018-05-26 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16491922#comment-16491922 ] Eric Yang commented on YARN-8342: - [~ebadger] {quote} 2. Registries from which we can run non-privileged

[jira] [Commented] (YARN-8343) YARN should have ability to run images only from a whitelist docker registries

2018-05-29 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16494370#comment-16494370 ] Eric Yang commented on YARN-8343: - I opened a duplicated JIRA by accident. The other JIRA has better

[jira] [Commented] (YARN-8360) Yarn service conflict between restart policy and NM configuration

2018-05-26 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16491916#comment-16491916 ] Eric Yang commented on YARN-8360: - Option 1 is better proposal from my point of view. > Yarn service

[jira] [Updated] (YARN-8384) stdout, stderr logs of a Native Service container is coming with group as nobody

2018-05-31 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8384: Description: When {{yarn.nodemanager.linux-container-executor.nonsecure-mode.limit-users}} is set to true,

[jira] [Updated] (YARN-8384) stdout, stderr logs of a Native Service container is coming with group as nobody

2018-05-31 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8384: Labels: docker (was: ) > stdout, stderr logs of a Native Service container is coming with group as >

[jira] [Commented] (YARN-8342) Using docker image from a non-privileged registry, the launch_command is not honored

2018-05-31 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16496810#comment-16496810 ] Eric Yang commented on YARN-8342: - Precommit build test report was for: YARN-8350. NPE in service AM

[jira] [Updated] (YARN-8342) Using docker image from a non-privileged registry, the launch_command is not honored

2018-05-31 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8342: Attachment: YARN-8342.003.patch > Using docker image from a non-privileged registry, the launch_command is

[jira] [Updated] (YARN-8384) stdout, stderr logs of a Native Service container is coming with group as nobody

2018-05-31 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8384: Issue Type: Sub-task (was: Bug) Parent: YARN-3611 > stdout, stderr logs of a Native Service

[jira] [Updated] (YARN-8384) stdout, stderr logs of a Native Service container is coming with group as nobody

2018-05-31 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8384: Attachment: YARN-8384.001.patch > stdout, stderr logs of a Native Service container is coming with group as

[jira] [Commented] (YARN-8342) Using docker image from a non-privileged registry, the launch_command is not honored

2018-05-31 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16497173#comment-16497173 ] Eric Yang commented on YARN-8342: - The failed unit tests are not related to this patch, and it seems to be

[jira] [Commented] (YARN-8384) stdout, stderr logs of a Native Service container is coming with group as nobody

2018-05-31 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16497377#comment-16497377 ] Eric Yang commented on YARN-8384: - [~vinodkv], there are 3 different paths to start docker container: 1.

[jira] [Commented] (YARN-8384) stdout, stderr logs of a Native Service container is coming with group as nobody

2018-05-31 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16497100#comment-16497100 ] Eric Yang commented on YARN-8384: - [~sunilg] Yes, that is the problem. I will change this to use node

[jira] [Commented] (YARN-8308) Yarn service app fails due to issues with Renew Token

2018-05-31 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16497157#comment-16497157 ] Eric Yang commented on YARN-8308: - [~gsaha] The patch is moving removeHdfsDelegationToken logic to outside

[jira] [Assigned] (YARN-8384) stdout, stderr logs of a Native Service container is coming with group as nobody

2018-05-31 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang reassigned YARN-8384: --- Assignee: Eric Yang > stdout, stderr logs of a Native Service container is coming with group as >

[jira] [Commented] (YARN-8342) Using docker image from a non-privileged registry, the launch_command is not honored

2018-05-31 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16497320#comment-16497320 ] Eric Yang commented on YARN-8342: - [~shaneku...@gmail.com] Could you help to review this patch? Thanks >

[jira] [Commented] (YARN-8384) stdout, stderr logs of a Native Service container is coming with group as nobody

2018-05-31 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16497403#comment-16497403 ] Eric Yang commented on YARN-8384: - [~leftnoteasy] I verified the file permission is setup correctly with

[jira] [Updated] (YARN-8342) Using docker image from a non-privileged registry, the launch_command is not honored

2018-06-01 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8342: Attachment: YARN-8342.005.patch > Using docker image from a non-privileged registry, the launch_command is

[jira] [Comment Edited] (YARN-8342) Using docker image from a non-privileged registry, the launch_command is not honored

2018-06-01 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16498498#comment-16498498 ] Eric Yang edited comment on YARN-8342 at 6/1/18 8:07 PM: - Patch 005 includes an

[jira] [Commented] (YARN-8342) Using docker image from a non-privileged registry, the launch_command is not honored

2018-06-01 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16498498#comment-16498498 ] Eric Yang commented on YARN-8342: - Patch 005 includes a new example to show how to specify launch_command

[jira] [Commented] (YARN-8220) Running Tensorflow on YARN with GPU and Docker - Examples

2018-06-02 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16498929#comment-16498929 ] Eric Yang commented on YARN-8220: - [~sunilg] ENTRYPOINT could be anything even bash. If you want a more

[jira] [Commented] (YARN-8258) YARN webappcontext for UI2 should inherit all filters from default context

2018-06-05 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16502066#comment-16502066 ] Eric Yang commented on YARN-8258: - [~sunilg] The test case shows that RMAuthenticationFilter and

[jira] [Commented] (YARN-8258) YARN webappcontext for UI2 should inherit all filters from default context

2018-06-05 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16502190#comment-16502190 ] Eric Yang commented on YARN-8258: - [~sunilg] While I agree that pathSpec plays a important role to ensure

[jira] [Commented] (YARN-8258) YARN webappcontext for UI2 should inherit all filters from default context

2018-06-05 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16502683#comment-16502683 ] Eric Yang commented on YARN-8258: - With this patch, I am getting this error message with Kerberos enabled

[jira] [Created] (YARN-8403) Nodemanager logs failed to download file with INFO level

2018-06-06 Thread Eric Yang (JIRA)
Eric Yang created YARN-8403: --- Summary: Nodemanager logs failed to download file with INFO level Key: YARN-8403 URL: https://issues.apache.org/jira/browse/YARN-8403 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-8403) Nodemanager logs failed to download file with INFO level

2018-06-06 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8403: Description: Some of the container execution related stack traces are printing in INFO or WARN level.

[jira] [Commented] (YARN-8403) Nodemanager logs failed to download file with INFO level

2018-06-06 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16504004#comment-16504004 ] Eric Yang commented on YARN-8403: - We can not aggregate this error message to app logs due to race

[jira] [Updated] (YARN-8403) Nodemanager logs failed to download file with INFO level

2018-06-06 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8403: Component/s: yarn > Nodemanager logs failed to download file with INFO level >

[jira] [Assigned] (YARN-8403) Nodemanager logs failed to download file with INFO level

2018-06-06 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang reassigned YARN-8403: --- Assignee: Eric Yang > Nodemanager logs failed to download file with INFO level >

[jira] [Updated] (YARN-8403) Nodemanager logs failed to download file with INFO level

2018-06-06 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8403: Attachment: YARN-8403.001.patch > Nodemanager logs failed to download file with INFO level >

[jira] [Commented] (YARN-8342) Using docker image from a non-privileged registry, the launch_command is not honored

2018-05-29 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16493804#comment-16493804 ] Eric Yang commented on YARN-8342: - [~ebadger] {quote} Depending on the registry it comes from, yes. If the

[jira] [Commented] (YARN-8342) Using docker image from a non-privileged registry, the launch_command is not honored

2018-05-29 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16493824#comment-16493824 ] Eric Yang commented on YARN-8342: - [~ebadger] Btw, docker.privileged-containers.enabled is a

[jira] [Commented] (YARN-8365) Revisit the record type used by Registry DNS for upstream resolution

2018-05-29 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16493870#comment-16493870 ] Eric Yang commented on YARN-8365: - [~shaneku...@gmail.com] Thanks for the patch. This change will break

[jira] [Commented] (YARN-8365) Revisit the record type used by Registry DNS for upstream resolution

2018-05-29 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16493884#comment-16493884 ] Eric Yang commented on YARN-8365: - Root record can still be fetched through ANY or SOA if upstream

[jira] [Commented] (YARN-8220) Running Tensorflow on YARN with GPU and Docker - Examples

2018-06-01 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16498199#comment-16498199 ] Eric Yang commented on YARN-8220: - [~sunilg] Thank you for the patch, a couple suggestions: 1. Avoid

[jira] [Commented] (YARN-8333) Load balance YARN services using RegistryDNS multiple A records

2018-05-31 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16496737#comment-16496737 ] Eric Yang commented on YARN-8333: - Thank you [~billie.rinaldi] for the review and commit. > Load balance

[jira] [Updated] (YARN-8342) Using docker image from a non-privileged registry, the launch_command is not honored

2018-06-01 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8342: Attachment: YARN-8342.004.patch > Using docker image from a non-privileged registry, the launch_command is

[jira] [Commented] (YARN-8342) Using docker image from a non-privileged registry, the launch_command is not honored

2018-06-01 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16498349#comment-16498349 ] Eric Yang commented on YARN-8342: - [~billie.rinaldi] Thanks for the review. I made correction to the

[jira] [Commented] (YARN-8220) Running Tensorflow on YARN with GPU and Docker - Examples

2018-06-01 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16498365#comment-16498365 ] Eric Yang commented on YARN-8220: - [~leftnoteasy] {quote} Entry point is a nice feature for static

[jira] [Commented] (YARN-8474) sleeper service fails to launch with "Authentication Required"

2018-06-29 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16528096#comment-16528096 ] Eric Yang commented on YARN-8474: - Patch 003 fixed white space and added unit test. > sleeper service

[jira] [Updated] (YARN-8474) sleeper service fails to launch with "Authentication Required"

2018-06-29 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8474: Attachment: YARN-8474.003.patch > sleeper service fails to launch with "Authentication Required" >

[jira] [Commented] (YARN-8214) Change default RegistryDNS port

2018-06-26 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16523903#comment-16523903 ] Eric Yang commented on YARN-8214: - Port 5335 is unregistered according to IANA. > Change default

[jira] [Commented] (YARN-8108) RM metrics rest API throws GSSException in kerberized environment

2018-06-26 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16524081#comment-16524081 ] Eric Yang commented on YARN-8108: - [~sunilg], you are correct, the test case is intermittent and does not

[jira] [Comment Edited] (YARN-8214) Change default RegistryDNS port

2018-06-26 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16524090#comment-16524090 ] Eric Yang edited comment on YARN-8214 at 6/26/18 6:27 PM: -- +1 looks good to me. 

[jira] [Updated] (YARN-8108) RM metrics rest API throws GSSException in kerberized environment

2018-06-26 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8108: Target Version/s: 3.2.0, 3.1.1 (was: 3.2.0, 3.1.1, 3.0.3) > RM metrics rest API throws GSSException in

[jira] [Assigned] (YARN-8108) RM metrics rest API throws GSSException in kerberized environment

2018-06-26 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang reassigned YARN-8108: --- Assignee: Sunil Govindan (was: Eric Yang) > RM metrics rest API throws GSSException in kerberized

[jira] [Commented] (YARN-8108) RM metrics rest API throws GSSException in kerberized environment

2018-06-26 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16524041#comment-16524041 ] Eric Yang commented on YARN-8108: - [~sunilg], thank you for the patch.  Patch 2 will remove the conflict

[jira] [Commented] (YARN-8214) Change default RegistryDNS port

2018-06-25 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16522918#comment-16522918 ] Eric Yang commented on YARN-8214: - Port 5300 is used by W32.Kibuv.Worm.  This port may generate false

[jira] [Updated] (YARN-7129) Application Catalog for YARN applications

2018-06-26 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7129: Attachment: YARN-7129.001.patch > Application Catalog for YARN applications >

[jira] [Commented] (YARN-8485) Priviledged container app launch is failing intermittently

2018-07-02 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16530442#comment-16530442 ] Eric Yang commented on YARN-8485: - [~gsaha], by checking /usr/bin/sudo is good enough.  /bin/sudo was a

[jira] [Commented] (YARN-8485) Priviledged container app launch is failing intermittently

2018-07-02 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16530514#comment-16530514 ] Eric Yang commented on YARN-8485: - Thank you [~shaneku...@gmail.com] for the review and commit. >

[jira] [Commented] (YARN-8465) Dshell docker container gets marked as lost after NM restart

2018-07-02 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16530221#comment-16530221 ] Eric Yang commented on YARN-8465: - +1 works on my test cluster.  I will commit this shortly. > Dshell

[jira] [Updated] (YARN-8485) Priviledged container app launch is failing intermittently

2018-07-02 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8485: Attachment: YARN-8485.001.patch > Priviledged container app launch is failing intermittently >

[jira] [Updated] (YARN-8485) Priviledged container app launch is failing intermittently

2018-07-02 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8485: Attachment: YARN-8485.002.patch > Priviledged container app launch is failing intermittently >

[jira] [Commented] (YARN-8485) Priviledged container app launch is failing intermittently

2018-07-02 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16530218#comment-16530218 ] Eric Yang commented on YARN-8485: - sudo binary path for Debian is different from Redhat/CentOS that caused

[jira] [Assigned] (YARN-8485) Priviledged container app launch is failing intermittently

2018-07-02 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang reassigned YARN-8485: --- Assignee: Eric Yang Convert sudo check to base on path variable. > Priviledged container app launch

[jira] [Commented] (YARN-8485) Priviledged container app launch is failing intermittently

2018-07-02 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16530397#comment-16530397 ] Eric Yang commented on YARN-8485: - [~shaneku...@gmail.com] thank you for the review.  Rogue sudo could be

[jira] [Updated] (YARN-8485) Priviledged container app launch is failing intermittently

2018-07-02 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8485: Environment: Debian > Priviledged container app launch is failing intermittently >

[jira] [Commented] (YARN-8209) NPE in DeletionService

2018-05-01 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16459922#comment-16459922 ] Eric Yang commented on YARN-8209: - {quote}I personally would rather get the actual exit code from the

[jira] [Updated] (YARN-8207) Docker container launch use popen have risk of shell expansion

2018-05-01 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8207: Attachment: YARN-8207.003.patch > Docker container launch use popen have risk of shell expansion >

[jira] [Comment Edited] (YARN-8207) Docker container launch use popen have risk of shell expansion

2018-05-01 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16459992#comment-16459992 ] Eric Yang edited comment on YARN-8207 at 5/1/18 6:44 PM: - {quote}How would the

[jira] [Commented] (YARN-8207) Docker container launch use popen have risk of shell expansion

2018-05-01 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16460010#comment-16460010 ] Eric Yang commented on YARN-8207: - Patch 003 restored the blocking and wait for child pid behavior, and

[jira] [Updated] (YARN-8207) Docker container launch use popen have risk of shell expansion

2018-04-30 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8207: Attachment: YARN-8207.002.patch > Docker container launch use popen have risk of shell expansion >

[jira] [Commented] (YARN-8207) Docker container launch use popen have risk of shell expansion

2018-04-30 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16459178#comment-16459178 ] Eric Yang commented on YARN-8207: - [~jlowe] Patch 002 has converted to use struct instead of char **out,

[jira] [Commented] (YARN-8207) Docker container launch use popen have risk of shell expansion

2018-05-01 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16460255#comment-16460255 ] Eric Yang commented on YARN-8207: - [~Jim_Brennan] Thank you for the review. I made the changes according

[jira] [Updated] (YARN-8207) Docker container launch use popen have risk of shell expansion

2018-05-01 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8207: Attachment: YARN-8207.004.patch > Docker container launch use popen have risk of shell expansion >

[jira] [Commented] (YARN-8207) Docker container launch use popen have risk of shell expansion

2018-05-01 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16460297#comment-16460297 ] Eric Yang commented on YARN-8207: - Patch 005 removed bug found by cc. > Docker container launch use popen

[jira] [Updated] (YARN-8207) Docker container launch use popen have risk of shell expansion

2018-05-01 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8207: Attachment: YARN-8207.005.patch > Docker container launch use popen have risk of shell expansion >

[jira] [Commented] (YARN-8207) Docker container launch use popen have risk of shell expansion

2018-05-01 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16459992#comment-16459992 ] Eric Yang commented on YARN-8207: - {quote}How would the docker run be aborted? The container executor will

[jira] [Updated] (YARN-7654) Support ENTRY_POINT for docker container

2018-05-01 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7654: Attachment: YARN-7654.019.patch > Support ENTRY_POINT for docker container >

[jira] [Commented] (YARN-7654) Support ENTRY_POINT for docker container

2018-05-01 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16460353#comment-16460353 ] Eric Yang commented on YARN-7654: - Rebased patch to based on YARN-8207 patch 5. > Support ENTRY_POINT for

[jira] [Updated] (YARN-8207) Docker container launch use popen have risk of shell expansion

2018-05-02 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8207: Affects Version/s: 3.1.0 3.0.0 3.0.1

[jira] [Updated] (YARN-7654) Support ENTRY_POINT for docker container

2018-05-02 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7654: Target Version/s: 3.2.0, 3.1.1 (was: 3.2.0) > Support ENTRY_POINT for docker container >

[jira] [Updated] (YARN-8209) NPE in DeletionService

2018-05-02 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8209: Fix Version/s: 3.1.1 3.2.0 > NPE in DeletionService > -- > >

[jira] [Updated] (YARN-7729) Add support for setting the PID namespace mode

2018-05-02 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7729: Fix Version/s: 3.1.0 > Add support for setting the PID namespace mode >

[jira] [Commented] (YARN-8194) Exception when reinitializing a container using LinuxContainerExecutor

2018-05-02 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16461759#comment-16461759 ] Eric Yang commented on YARN-8194: - [~csingh] There is no container relaunch commited to branch-3.1.  I

[jira] [Updated] (YARN-8194) Exception when reinitializing a container using LinuxContainerExecutor

2018-05-02 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8194: Fix Version/s: (was: 3.1.1) 3.2.0 > Exception when reinitializing a container using

[jira] [Commented] (YARN-8241) MRAppMaster fails when using UID:GID pair within docker container

2018-05-02 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16461706#comment-16461706 ] Eric Yang commented on YARN-8241: - There are two possible solutions for this problem: Option 1)

[jira] [Comment Edited] (YARN-8241) MRAppMaster fails when using UID:GID pair within docker container

2018-05-02 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16461706#comment-16461706 ] Eric Yang edited comment on YARN-8241 at 5/2/18 10:53 PM: -- There are two possible

[jira] [Commented] (YARN-8206) Sending a kill does not immediately kill docker containers

2018-05-02 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16461751#comment-16461751 ] Eric Yang commented on YARN-8206: - >From today's meeting, signal handling is ran as the user who submit the

[jira] [Commented] (YARN-8140) Improve log message when launch cmd is ran for stopped yarn service

2018-04-26 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16454681#comment-16454681 ] Eric Yang commented on YARN-8140: - [~billie.rinaldi] The message from Slider exception class, which is used

[jira] [Commented] (YARN-8206) Sending a kill does not immediately kill docker containers

2018-04-26 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16454599#comment-16454599 ] Eric Yang commented on YARN-8206: - [~jlowe] I agree with [~shaneku...@gmail.com] to use docker API as much

[jira] [Updated] (YARN-8216) Reduce RegistryDNS port ping logging

2018-04-26 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8216: Description: System monitoring software usually send a tcp packet to test if port is alive. This can cause

[jira] [Updated] (YARN-8216) Reduce RegistryDNS port ping logging

2018-04-26 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8216: Environment: (was: System monitoring software usually send a tcp packet to test if port is alive. This

[jira] [Created] (YARN-8216) Reduce RegistryDNS port ping logging

2018-04-26 Thread Eric Yang (JIRA)
Eric Yang created YARN-8216: --- Summary: Reduce RegistryDNS port ping logging Key: YARN-8216 URL: https://issues.apache.org/jira/browse/YARN-8216 Project: Hadoop YARN Issue Type: Bug Affects

[jira] [Updated] (YARN-8211) Yarn registry dns log finds BufferUnderflowException

2018-04-26 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8211: Attachment: YARN-8211.001.patch > Yarn registry dns log finds BufferUnderflowException >

[jira] [Assigned] (YARN-8211) Yarn registry dns log finds BufferUnderflowException

2018-04-26 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang reassigned YARN-8211: --- Assignee: Eric Yang > Yarn registry dns log finds BufferUnderflowException >

[jira] [Commented] (YARN-8211) Yarn registry dns log finds BufferUnderflowException

2018-04-26 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16454562#comment-16454562 ] Eric Yang commented on YARN-8211: - System monitoring software usually send a tcp packet to test if port is

[jira] [Resolved] (YARN-8216) Reduce RegistryDNS port ping logging

2018-04-26 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang resolved YARN-8216. - Resolution: Fixed > Reduce RegistryDNS port ping logging > > >

<    2   3   4   5   6   7   8   9   10   11   >