[jira] [Commented] (YARN-8079) Support specify files to be downloaded (localized) before containers launched by YARN

2018-05-03 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16462872#comment-16462872 ] Eric Yang commented on YARN-8079: - [~billie.rinaldi] STATIC works better in my opinion.  It

[jira] [Commented] (YARN-8079) Support specify files to be downloaded (localized) before containers launched by YARN

2018-05-03 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16462928#comment-16462928 ] Eric Yang commented on YARN-8079: - [~gsaha] PLAIN is usually used as reference to text file

[jira] [Commented] (YARN-8223) ClassNotFoundException when auxiliary service is loaded from HDFS

2018-05-03 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16463120#comment-16463120 ] Eric Yang commented on YARN-8223: - [~Zian Chen] Thank you for the patch.  This patch 001 wo

[jira] [Commented] (YARN-8207) Docker container launch use popen have risk of shell expansion

2018-05-03 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16463266#comment-16463266 ] Eric Yang commented on YARN-8207: - [~jlowe] Thank you for the review. A couple comments:

[jira] [Comment Edited] (YARN-8207) Docker container launch use popen have risk of shell expansion

2018-05-03 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16463266#comment-16463266 ] Eric Yang edited comment on YARN-8207 at 5/4/18 1:34 AM: - [~jlowe]

[jira] [Commented] (YARN-8207) Docker container launch use popen have risk of shell expansion

2018-05-04 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16464035#comment-16464035 ] Eric Yang commented on YARN-8207: - [~jlowe] I see your concerns now. Thanks for the explan

[jira] [Updated] (YARN-8223) ClassNotFoundException when auxiliary service is loaded from HDFS

2018-05-04 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8223: Target Version/s: 3.2.0, 3.1.1 > ClassNotFoundException when auxiliary service is loaded from HDFS >

[jira] [Commented] (YARN-8080) YARN native service should support component restart policy

2018-05-04 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16464158#comment-16464158 ] Eric Yang commented on YARN-8080: - [~suma.shivaprasad] Thank you for the patch. Flex is a

[jira] [Comment Edited] (YARN-8080) YARN native service should support component restart policy

2018-05-04 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16464158#comment-16464158 ] Eric Yang edited comment on YARN-8080 at 5/4/18 5:23 PM: - [~suma.sh

[jira] [Updated] (YARN-8207) Docker container launch use popen have risk of shell expansion

2018-05-05 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8207: Attachment: YARN-8207.006.patch > Docker container launch use popen have risk of shell expansion > --

[jira] [Commented] (YARN-8207) Docker container launch use popen have risk of shell expansion

2018-05-05 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16464873#comment-16464873 ] Eric Yang commented on YARN-8207: - [~jlowe] Patch 006 contains all style fixes from your re

[jira] [Updated] (YARN-8207) Docker container launch use popen have risk of shell expansion

2018-05-05 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8207: Attachment: (was: YARN-8207.006.patch) > Docker container launch use popen have risk of shell expansion >

[jira] [Updated] (YARN-8207) Docker container launch use popen have risk of shell expansion

2018-05-05 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8207: Attachment: YARN-8207.006.patch > Docker container launch use popen have risk of shell expansion > --

[jira] [Updated] (YARN-8207) Docker container launch use popen have risk of shell expansion

2018-05-07 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8207: Attachment: YARN-8207.007.patch > Docker container launch use popen have risk of shell expansion > --

[jira] [Updated] (YARN-7654) Support ENTRY_POINT for docker container

2018-05-07 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7654: Attachment: YARN-7654.020.patch > Support ENTRY_POINT for docker container >

[jira] [Commented] (YARN-7654) Support ENTRY_POINT for docker container

2018-05-07 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16466258#comment-16466258 ] Eric Yang commented on YARN-7654: - Rebased patch 20 to based on YARN-8207 patch 007. > Sup

[jira] [Commented] (YARN-8255) Allow option to disable flex for a service component

2018-05-07 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16466448#comment-16466448 ] Eric Yang commented on YARN-8255: - Instead of introduce another field to enable or disable

[jira] [Updated] (YARN-8207) Docker container launch use popen have risk of shell expansion

2018-05-07 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8207: Priority: Blocker (was: Major) > Docker container launch use popen have risk of shell expansion > --

[jira] [Commented] (YARN-8207) Docker container launch use popen have risk of shell expansion

2018-05-07 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16466512#comment-16466512 ] Eric Yang commented on YARN-8207: - [~jlowe] Hadoop 3.1.1 release date was proposed for May

[jira] [Comment Edited] (YARN-8207) Docker container launch use popen have risk of shell expansion

2018-05-07 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16466512#comment-16466512 ] Eric Yang edited comment on YARN-8207 at 5/7/18 9:47 PM: - [~jlowe]

[jira] [Commented] (YARN-8206) Sending a kill does not immediately kill docker containers

2018-05-07 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16466616#comment-16466616 ] Eric Yang commented on YARN-8206: - [~ebadger] +1 for proposal 2. This is safer option in m

[jira] [Commented] (YARN-8207) Docker container launch use popen have risk of shell expansion

2018-05-07 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16466683#comment-16466683 ] Eric Yang commented on YARN-8207: - [~jlowe] {quote}Rather than make an expensive deep cop

[jira] [Updated] (YARN-8207) Docker container launch use popen have risk of shell expansion

2018-05-07 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8207: Attachment: YARN-8207.008.patch > Docker container launch use popen have risk of shell expansion > --

[jira] [Commented] (YARN-8207) Docker container launch use popen have risk of shell expansion

2018-05-07 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16466716#comment-16466716 ] Eric Yang commented on YARN-8207: - [~jlowe] Patch 008 fixed the issues discovered except ch

[jira] [Commented] (YARN-8255) Allow option to disable flex for a service component

2018-05-07 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16466800#comment-16466800 ] Eric Yang commented on YARN-8255: - [~leftnoteasy] Recompute and expandable are intertwined.

[jira] [Comment Edited] (YARN-8255) Allow option to disable flex for a service component

2018-05-07 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16466800#comment-16466800 ] Eric Yang edited comment on YARN-8255 at 5/8/18 3:08 AM: - [~leftnot

[jira] [Commented] (YARN-8207) Docker container launch use popen have risk of shell expansion

2018-05-08 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16467673#comment-16467673 ] Eric Yang commented on YARN-8207: - [~jlowe] {quote}At a bare minimum there should be a util

[jira] [Updated] (YARN-8207) Docker container launch use popen have risk of shell expansion

2018-05-08 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8207: Attachment: YARN-8207.009.patch > Docker container launch use popen have risk of shell expansion > --

[jira] [Commented] (YARN-8207) Docker container launch use popen have risk of shell expansion

2018-05-08 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16467727#comment-16467727 ] Eric Yang commented on YARN-8207: - [~jlowe] Patch 9 fixes most nits from your comments exce

[jira] [Commented] (YARN-8207) Docker container launch use popen have risk of shell expansion

2018-05-08 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16467762#comment-16467762 ] Eric Yang commented on YARN-8207: - [~jlowe] I see what you mean now, and patch 10 updated a

[jira] [Updated] (YARN-8207) Docker container launch use popen have risk of shell expansion

2018-05-08 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8207: Attachment: YARN-8207.010.patch > Docker container launch use popen have risk of shell expansion > --

[jira] [Commented] (YARN-8207) Docker container launch use popen have risk of shell expansion

2018-05-08 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16467853#comment-16467853 ] Eric Yang commented on YARN-8207: - [~jlowe] Patch 10 is posted. > Docker container launch

[jira] [Created] (YARN-8265) AM should retrieve new IP for restarted container

2018-05-08 Thread Eric Yang (JIRA)
Eric Yang created YARN-8265: --- Summary: AM should retrieve new IP for restarted container Key: YARN-8265 URL: https://issues.apache.org/jira/browse/YARN-8265 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-8265) AM should retrieve new IP for restarted container

2018-05-08 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8265: Attachment: YARN-8265.001.patch > AM should retrieve new IP for restarted container > ---

[jira] [Commented] (YARN-8207) Docker container launch use popen have risk of shell expansion

2018-05-08 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16467950#comment-16467950 ] Eric Yang commented on YARN-8207: - [~jlowe] Thank you for the persistent reviews to make th

[jira] [Commented] (YARN-7654) Support ENTRY_POINT for docker container

2018-05-08 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16468111#comment-16468111 ] Eric Yang commented on YARN-7654: - [~jlowe] {quote}I'll try to find time to take a closer l

[jira] [Updated] (YARN-7654) Support ENTRY_POINT for docker container

2018-05-08 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7654: Attachment: YARN-7654.021.patch > Support ENTRY_POINT for docker container >

[jira] [Commented] (YARN-7654) Support ENTRY_POINT for docker container

2018-05-09 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16469061#comment-16469061 ] Eric Yang commented on YARN-7654: - [~jlowe] [~Jim_Brennan] I misread the last message in t

[jira] [Commented] (YARN-8261) Docker container launch fails due to .cmd file creation failure

2018-05-09 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16469152#comment-16469152 ] Eric Yang commented on YARN-8261: - +1 looks good to me. > Docker container launch fails du

[jira] [Updated] (YARN-8261) Docker container launch fails due to .cmd file creation failure

2018-05-09 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8261: Fix Version/s: 3.1.1 3.2.0 > Docker container launch fails due to .cmd file creation failu

[jira] [Commented] (YARN-7654) Support ENTRY_POINT for docker container

2018-05-09 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16469823#comment-16469823 ] Eric Yang commented on YARN-7654: - [~jlowe] Thank you for the review, the styling improveme

[jira] [Commented] (YARN-8108) RM metrics rest API throws GSSException in kerberized environment

2018-05-10 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16470814#comment-16470814 ] Eric Yang commented on YARN-8108: - [~daryn] This issue doesn't present in Hadoop 2.7.5, doe

[jira] [Updated] (YARN-7799) YARN Service dependency follow up work

2018-05-10 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7799: Fix Version/s: 3.1.1 3.2.0 > YARN Service dependency follow up work >

[jira] [Commented] (YARN-7654) Support ENTRY_POINT for docker container

2018-05-10 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16471073#comment-16471073 ] Eric Yang commented on YARN-7654: - [~jlowe] I am struggling withe the following problems: {

[jira] [Updated] (YARN-7654) Support ENTRY_POINT for docker container

2018-05-10 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7654: Attachment: YARN-7654.022.patch > Support ENTRY_POINT for docker container >

[jira] [Commented] (YARN-7654) Support ENTRY_POINT for docker container

2018-05-10 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16471387#comment-16471387 ] Eric Yang commented on YARN-7654: - [~jlowe] Patch 22 contains all requested changes except

[jira] [Updated] (YARN-8108) RM metrics rest API throws GSSException in kerberized environment

2018-05-11 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8108: Target Version/s: 3.2.0, 3.1.1, 3.0.3 > RM metrics rest API throws GSSException in kerberized environment > -

[jira] [Updated] (YARN-8108) RM metrics rest API throws GSSException in kerberized environment

2018-05-11 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8108: Priority: Blocker (was: Major) > RM metrics rest API throws GSSException in kerberized environment > ---

[jira] [Commented] (YARN-7654) Support ENTRY_POINT for docker container

2018-05-11 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16472318#comment-16472318 ] Eric Yang commented on YARN-7654: - [~jlowe] Thanks for the reply. Some answers: {quote} I

[jira] [Commented] (YARN-8274) Docker command error during container relaunch

2018-05-11 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16472392#comment-16472392 ] Eric Yang commented on YARN-8274: - Sorry the code was missed during refactoring. +1 The ch

[jira] [Updated] (YARN-7654) Support ENTRY_POINT for docker container

2018-05-11 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7654: Attachment: YARN-7654.023.patch > Support ENTRY_POINT for docker container >

[jira] [Commented] (YARN-7654) Support ENTRY_POINT for docker container

2018-05-11 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16472407#comment-16472407 ] Eric Yang commented on YARN-7654: - [~jlowe] Patch 23 includes all your suggestions. > Supp

[jira] [Updated] (YARN-8274) Docker command error during container relaunch

2018-05-11 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8274: Fix Version/s: 3.1.1 3.2.0 > Docker command error during container relaunch >

[jira] [Commented] (YARN-8274) Docker command error during container relaunch

2018-05-11 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16472548#comment-16472548 ] Eric Yang commented on YARN-8274: - [~ebadger] Sorry my mistake, I thought the report was fo

[jira] [Updated] (YARN-7654) Support ENTRY_POINT for docker container

2018-05-11 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7654: Attachment: YARN-7654.024.patch > Support ENTRY_POINT for docker container >

[jira] [Commented] (YARN-7654) Support ENTRY_POINT for docker container

2018-05-11 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16472661#comment-16472661 ] Eric Yang commented on YARN-7654: - [~jlowe] Patch 24 fixed the issues above. I still need

[jira] [Commented] (YARN-8274) Docker command error during container relaunch

2018-05-11 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16472771#comment-16472771 ] Eric Yang commented on YARN-8274: - [~ebadger] Your earnestly advocate is not going unheard.

[jira] [Commented] (YARN-7654) Support ENTRY_POINT for docker container

2018-05-11 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16472778#comment-16472778 ] Eric Yang commented on YARN-7654: - [~jlowe] All 5 scenarios passed with my local kerberos e

[jira] [Commented] (YARN-8274) Docker command error during container relaunch

2018-05-11 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16472780#comment-16472780 ] Eric Yang commented on YARN-8274: - [~jlowe] Thank you for all your efforts. It is greatly

[jira] [Commented] (YARN-8265) Service AM should retrieve new IP for docker container relaunched by NM

2018-05-11 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16472837#comment-16472837 ] Eric Yang commented on YARN-8265: - [~billie.rinaldi] I am struggling to understand the reas

[jira] [Commented] (YARN-7654) Support ENTRY_POINT for docker container

2018-05-11 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16472839#comment-16472839 ] Eric Yang commented on YARN-7654: - [~jlowe] Thank you for the great reviews and commit. [~s

[jira] [Commented] (YARN-8265) Service AM should retrieve new IP for docker container relaunched by NM

2018-05-11 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16472901#comment-16472901 ] Eric Yang commented on YARN-8265: - "onContainerRestart" event is currently not working. Th

[jira] [Updated] (YARN-8265) Service AM should retrieve new IP for docker container relaunched by NM

2018-05-11 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8265: Target Version/s: 3.2.0, 3.1.1 (was: 3.2.0) Fix Version/s: 3.1.1 3.2.0 > Servic

[jira] [Commented] (YARN-8265) Service AM should retrieve new IP for docker container relaunched by NM

2018-05-11 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16472923#comment-16472923 ] Eric Yang commented on YARN-8265: - +1 looks good to me. I just committed this on trunk and

[jira] [Updated] (YARN-8286) Add NMClient callback on container relaunch

2018-05-12 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8286: Description: The AM may need to perform actions when a container has been relaunched. For example, the servic

[jira] [Updated] (YARN-8286) Add NMClient callback on container relaunch

2018-05-12 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8286: Environment: (was: The AM may need to perform actions when a container has been relaunched. For example,

[jira] [Commented] (YARN-8265) Service AM should retrieve new IP for docker container relaunched by NM

2018-05-12 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16473179#comment-16473179 ] Eric Yang commented on YARN-8265: - [~billie.rinaldi] The plan looks good. Thank you. > Se

[jira] [Commented] (YARN-8108) RM metrics rest API throws GSSException in kerberized environment

2018-05-14 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16474510#comment-16474510 ] Eric Yang commented on YARN-8108: - Kerberos SPN support by browser definition are: HTTP/,

[jira] [Commented] (YARN-8284) get_docker_command refactoring

2018-05-14 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16474826#comment-16474826 ] Eric Yang commented on YARN-8284: - +1 looks good to me. > get_docker_command refactoring >

[jira] [Commented] (YARN-8293) In YARN Services UI, "User Name for service" should be completely removed in secure clusters

2018-05-15 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16476034#comment-16476034 ] Eric Yang commented on YARN-8293: - YARN service can have duplicated application name betwee

[jira] [Commented] (YARN-7960) Add no-new-privileges flag to docker run

2018-05-15 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16476330#comment-16476330 ] Eric Yang commented on YARN-7960: - [~ebadger] no-new-privileges option will block [selinux

[jira] [Commented] (YARN-7960) Add no-new-privileges flag to docker run

2018-05-15 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16476416#comment-16476416 ] Eric Yang commented on YARN-7960: - [~ebadger] Can we run sestatus to check instead of depen

[jira] [Commented] (YARN-8080) YARN native service should support component restart policy

2018-05-15 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16476621#comment-16476621 ] Eric Yang commented on YARN-8080: - [~suma.shivaprasad] Thank you for the patch, a few nitpi

[jira] [Commented] (YARN-8081) Yarn Service Upgrade: Add support to upgrade a component

2018-05-15 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16476655#comment-16476655 ] Eric Yang commented on YARN-8081: - +1 looks good to me. > Yarn Service Upgrade: Add suppor

[jira] [Commented] (YARN-8293) In YARN Services UI, "User Name for service" should be completely removed in secure clusters

2018-05-16 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16477594#comment-16477594 ] Eric Yang commented on YARN-8293: - [~sunilg] The changes in hadoop-yarn-project/hadoop-yar

[jira] [Commented] (YARN-8080) YARN native service should support component restart policy

2018-05-16 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16477665#comment-16477665 ] Eric Yang commented on YARN-8080: - [~suma.shivaprasad] {quote} {quote} restart_policy=ON_FA

[jira] [Comment Edited] (YARN-8080) YARN native service should support component restart policy

2018-05-16 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16477665#comment-16477665 ] Eric Yang edited comment on YARN-8080 at 5/16/18 4:19 PM: -- Thank y

[jira] [Commented] (YARN-8300) Fix NPE in DefaultUpgradeComponentsFinder

2018-05-16 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16477697#comment-16477697 ] Eric Yang commented on YARN-8300: - [~giovanni.fumarola] Patch 003 looks good to me. I can

[jira] [Updated] (YARN-8300) Fix NPE in DefaultUpgradeComponentsFinder

2018-05-16 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8300: Affects Version/s: 3.1.1 Target Version/s: 3.2.0, 3.1.1 Fix Version/s: 3.2.0 Descriptio

[jira] [Comment Edited] (YARN-8300) Fix NPE in DefaultUpgradeComponentsFinder

2018-05-16 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16477708#comment-16477708 ] Eric Yang edited comment on YARN-8300 at 5/16/18 4:44 PM: -- Thank y

[jira] [Commented] (YARN-7960) Add no-new-privileges flag to docker run

2018-05-16 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16477861#comment-16477861 ] Eric Yang commented on YARN-7960: - [~ebadger] You are right. Selinux presence is not a goo

[jira] [Updated] (YARN-8290) Yarn application failed to recover with "Error Launching job : User is not set in the application report" error after RM restart

2018-05-16 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8290: Attachment: YARN-8290.001.patch > Yarn application failed to recover with "Error Launching job : User is not

[jira] [Assigned] (YARN-8290) Yarn application failed to recover with "Error Launching job : User is not set in the application report" error after RM restart

2018-05-16 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang reassigned YARN-8290: --- Assignee: Eric Yang Affects Version/s: 3.1.1 [~leftnoteasy] According to your suggestion

[jira] [Commented] (YARN-8141) YARN Native Service: Respect YARN_CONTAINER_RUNTIME_DOCKER_LOCAL_RESOURCE_MOUNTS specified in service spec

2018-05-16 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16478311#comment-16478311 ] Eric Yang commented on YARN-8141: - [~csingh] Thank you for the patch, a few nits: FindAbso

[jira] [Updated] (YARN-8290) Yarn application failed to recover with "Error Launching job : User is not set in the application report" error after RM restart

2018-05-17 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8290: Attachment: YARN-8290.002.patch > Yarn application failed to recover with "Error Launching job : User is not

[jira] [Commented] (YARN-8290) Yarn application failed to recover with "Error Launching job : User is not set in the application report" error after RM restart

2018-05-17 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16479255#comment-16479255 ] Eric Yang commented on YARN-8290: - - Patch 002 Fixed white space. > Yarn application faile

[jira] [Commented] (YARN-8315) HDP 3.0.0 perfromance is slower than HDP 2.6.4

2018-05-17 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16479673#comment-16479673 ] Eric Yang commented on YARN-8315: - [~hlhu...@us.ibm.com] Apache Hadoop community is not res

[jira] [Updated] (YARN-8293) In YARN Services UI, "User Name for service" should be completely removed in secure clusters

2018-05-17 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8293: Fix Version/s: 3.1.1 3.2.0 > In YARN Services UI, "User Name for service" should be comple

[jira] [Updated] (YARN-8315) HDP 3.0.0 perfromance is slower than HDP 2.6.4

2018-05-17 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8315: Environment: (was: I have a HDP 2.6.4 cluster and HDP 3.0.0 cluster,  I set up to have the same settings

[jira] [Comment Edited] (YARN-8315) HDP 3.0.0 perfromance is slower than HDP 2.6.4

2018-05-17 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16479673#comment-16479673 ] Eric Yang edited comment on YARN-8315 at 5/17/18 9:37 PM: -- [~hlhu.

[jira] [Commented] (YARN-8259) Revisit liveliness checks for privileged Docker containers

2018-05-17 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16479872#comment-16479872 ] Eric Yang commented on YARN-8259: - I prefer to use docker ps -fname=containerID. This appr

[jira] [Updated] (YARN-8290) Yarn application failed to recover with "Error Launching job : User is not set in the application report" error after RM restart

2018-05-17 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8290: Attachment: YARN-8290.003.patch > Yarn application failed to recover with "Error Launching job : User is not

[jira] [Updated] (YARN-8296) Update YarnServiceApi documentation and yarn service UI code to remove references to unique_component_support

2018-05-17 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8296: Fix Version/s: 3.2.0 > Update YarnServiceApi documentation and yarn service UI code to remove > references t

[jira] [Updated] (YARN-8290) Yarn application failed to recover with "Error Launching job : User is not set in the application report" error after RM restart

2018-05-18 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8290: Attachment: YARN-8290.004.patch > Yarn application failed to recover with "Error Launching job : User is not

[jira] [Commented] (YARN-7530) hadoop-yarn-services-api should be part of hadoop-yarn-services

2018-05-18 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16481059#comment-16481059 ] Eric Yang commented on YARN-7530: - The pre-commit build failed because it downloaded pre-bu

[jira] [Commented] (YARN-8108) RM metrics rest API throws GSSException in kerberized environment

2018-05-18 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16481207#comment-16481207 ] Eric Yang commented on YARN-8108: - cc [~rkanter] and [~tucu00] > RM metrics rest API thr

[jira] [Commented] (YARN-8079) Support static and archive unmodified local resources in service AM

2018-05-20 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16482076#comment-16482076 ] Eric Yang commented on YARN-8079: - [~leftnoteasy] When the files are placed in resources di

[jira] [Comment Edited] (YARN-8079) Support static and archive unmodified local resources in service AM

2018-05-20 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16482076#comment-16482076 ] Eric Yang edited comment on YARN-8079 at 5/21/18 12:20 AM: --- [~lef

[jira] [Created] (YARN-8333) Load balance YARN services using RegistryDNS multiple A records

2018-05-21 Thread Eric Yang (JIRA)
Eric Yang created YARN-8333: --- Summary: Load balance YARN services using RegistryDNS multiple A records Key: YARN-8333 URL: https://issues.apache.org/jira/browse/YARN-8333 Project: Hadoop YARN Issu

[jira] [Updated] (YARN-8333) Load balance YARN services using RegistryDNS multiple A records

2018-05-21 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8333: Description: For scaling stateless containers, it would be great to support DNS round robin for fault tolera

<    7   8   9   10   11   12   13   14   15   16   >