[jira] [Commented] (YARN-2480) DockerContainerExecutor must support user namespaces

[ https://issues.apache.org/jira/browse/YARN-2480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15001707#comment-15001707 ] Abin Shahab commented on YARN-2480: --- Thanks, yes, it's interesting, but it demands contiguous id space

[jira] [Commented] (YARN-4016) docker container is still running when app is killed

[ https://issues.apache.org/jira/browse/YARN-4016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14654345#comment-14654345 ] Abin Shahab commented on YARN-4016: --- [~zhiguohong] Thanks for sending it. Please use the

[jira] [Updated] (YARN-3852) Add docker container support to container-executor

[ https://issues.apache.org/jira/browse/YARN-3852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abin Shahab updated YARN-3852: -- Attachment: YARN-3852-3.patch Add docker container support to container-executor

[jira] [Commented] (YARN-3852) Add docker container support to container-executor

[ https://issues.apache.org/jira/browse/YARN-3852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14637242#comment-14637242 ] Abin Shahab commented on YARN-3852: --- So is this happening because of the refactor? On

[jira] [Updated] (YARN-3852) Add docker container support to container-executor

[ https://issues.apache.org/jira/browse/YARN-3852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abin Shahab updated YARN-3852: -- Attachment: YARN-3852-2.patch Add docker container support to container-executor

[jira] [Commented] (YARN-3852) Add docker container support to container-executor

[ https://issues.apache.org/jira/browse/YARN-3852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14635872#comment-14635872 ] Abin Shahab commented on YARN-3852: --- The test failures are unrelated to the

[jira] [Updated] (YARN-3852) Add docker container support to container-executor

[ https://issues.apache.org/jira/browse/YARN-3852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abin Shahab updated YARN-3852: -- Attachment: YARN-3852-1.patch Code review fixes and refactoring Add docker container support to

[jira] [Commented] (YARN-3852) Add docker container support to container-executor

[ https://issues.apache.org/jira/browse/YARN-3852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14619628#comment-14619628 ] Abin Shahab commented on YARN-3852: --- [~vvasudev] I'm looking at the test failures.

[jira] [Updated] (YARN-3852) Add docker container support to container-executor

[ https://issues.apache.org/jira/browse/YARN-3852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abin Shahab updated YARN-3852: -- Attachment: YARN-3852.patch Changes to container executor for running docker from LCE Add docker

[jira] [Commented] (YARN-19) 4-layer topology (with NodeGroup layer) implementation of Container Assignment and Task Scheduling (for YARN)

[ https://issues.apache.org/jira/browse/YARN-19?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571632#comment-14571632 ] Abin Shahab commented on YARN-19: - Hi [~jdu] Can this be merged in 2.8? We at Altiscale are

[jira] [Commented] (YARN-3712) ContainersLauncher: handle event CLEANUP_CONTAINER asynchronously

[ https://issues.apache.org/jira/browse/YARN-3712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14559366#comment-14559366 ] Abin Shahab commented on YARN-3712: --- You an try changing the file system to aufs or

[jira] [Commented] (YARN-3611) Support Docker Containers In LinuxContainerExecutor

[ https://issues.apache.org/jira/browse/YARN-3611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14542235#comment-14542235 ] Abin Shahab commented on YARN-3611: --- I agree with [~vinodkv]. Both Jiras have the same

[jira] [Commented] (YARN-3339) TestDockerContainerExecutor should pull a single image and not the entire centos repository

[ https://issues.apache.org/jira/browse/YARN-3339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14364146#comment-14364146 ] Abin Shahab commented on YARN-3339: --- Looks great! LGTM! TestDockerContainerExecutor

[jira] [Updated] (YARN-3291) DockerContainerExecutor should run as a non-root user inside the container

[ https://issues.apache.org/jira/browse/YARN-3291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abin Shahab updated YARN-3291: -- Attachment: YARN-3291.patch Removed findbugs warning DockerContainerExecutor should run as a non-root

[jira] [Commented] (YARN-3291) DockerContainerExecutor should run as a non-root user inside the container

[ https://issues.apache.org/jira/browse/YARN-3291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14358856#comment-14358856 ] Abin Shahab commented on YARN-3291: --- [~sidharta-s] [~raviprak] [~aw] [~vinodkv]

[jira] [Commented] (YARN-3291) DockerContainerExecutor should run as a non-root user inside the container

[ https://issues.apache.org/jira/browse/YARN-3291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14358858#comment-14358858 ] Abin Shahab commented on YARN-3291: --- I'll fix the findbug error.

[jira] [Updated] (YARN-3291) DockerContainerExecutor should run as a non-root user inside the container

[ https://issues.apache.org/jira/browse/YARN-3291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abin Shahab updated YARN-3291: -- Attachment: YARN-3291.patch DockerContainerExecutor should run as a non-root user inside the container

[jira] [Assigned] (YARN-3291) DockerContainerExecutor should run as a non-root user inside the container

[ https://issues.apache.org/jira/browse/YARN-3291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abin Shahab reassigned YARN-3291: - Assignee: Abin Shahab DockerContainerExecutor should run as a non-root user inside the container

[jira] [Updated] (YARN-3080) The DockerContainerExecutor could not write the right pid to container pidFile

[ https://issues.apache.org/jira/browse/YARN-3080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abin Shahab updated YARN-3080: -- Attachment: YARN-3080.patch Removed gitignore The DockerContainerExecutor could not write the right

[jira] [Commented] (YARN-3080) The DockerContainerExecutor could not write the right pid to container pidFile

[ https://issues.apache.org/jira/browse/YARN-3080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356323#comment-14356323 ] Abin Shahab commented on YARN-3080: --- [~vinodkv], Do you think you can review this? I have

[jira] [Commented] (YARN-3080) The DockerContainerExecutor could not write the right pid to container pidFile

[ https://issues.apache.org/jira/browse/YARN-3080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14350529#comment-14350529 ] Abin Shahab commented on YARN-3080: --- [~sidharta-s] Thanks for looking into this.

[jira] [Updated] (YARN-3291) DockerContainerExecutor should run as a non-root user inside the container

[ https://issues.apache.org/jira/browse/YARN-3291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abin Shahab updated YARN-3291: -- Summary: DockerContainerExecutor should run as a non-root user inside the container (was:

[jira] [Updated] (YARN-3291) DockerContainerExecutor should run as a non-root user

[ https://issues.apache.org/jira/browse/YARN-3291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abin Shahab updated YARN-3291: -- Description: Currently DockerContainerExecutor runs container as root(inside the container). Outside the

[jira] [Commented] (YARN-2981) DockerContainerExecutor must support a Cluster-wide default Docker image

[ https://issues.apache.org/jira/browse/YARN-2981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14347972#comment-14347972 ] Abin Shahab commented on YARN-2981: --- [~sidharta-s] Can you review this?

[jira] [Updated] (YARN-2981) DockerContainerExecutor must support a Cluster-wide default Docker image

[ https://issues.apache.org/jira/browse/YARN-2981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abin Shahab updated YARN-2981: -- Attachment: YARN-2981.patch Fixed docs. DockerContainerExecutor must support a Cluster-wide default

[jira] [Created] (YARN-3291) DockerContainerExecutor should run as a non-root user

Abin Shahab created YARN-3291: - Summary: DockerContainerExecutor should run as a non-root user Key: YARN-3291 URL: https://issues.apache.org/jira/browse/YARN-3291 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-2981) DockerContainerExecutor must support a Cluster-wide default Docker image

[ https://issues.apache.org/jira/browse/YARN-2981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abin Shahab updated YARN-2981: -- Attachment: YARN-2981.patch Removed as [~raviprak] suggested. DockerContainerExecutor must support a

[jira] [Created] (YARN-3290) DockerContainerExecutor should optionally limit memory and cpu

Abin Shahab created YARN-3290: - Summary: DockerContainerExecutor should optionally limit memory and cpu Key: YARN-3290 URL: https://issues.apache.org/jira/browse/YARN-3290 Project: Hadoop YARN

[jira] [Updated] (YARN-2981) DockerContainerExecutor must support a Cluster-wide default Docker image

[ https://issues.apache.org/jira/browse/YARN-2981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abin Shahab updated YARN-2981: -- Attachment: YARN-2981.patch Another fix DockerContainerExecutor must support a Cluster-wide default

[jira] [Commented] (YARN-3080) The DockerContainerExecutor could not write the right pid to container pidFile

[ https://issues.apache.org/jira/browse/YARN-3080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14343403#comment-14343403 ] Abin Shahab commented on YARN-3080: --- [~vvasudev], Thanks again for looking into this.

[jira] [Commented] (YARN-3080) The DockerContainerExecutor could not write the right pid to container pidFile

[ https://issues.apache.org/jira/browse/YARN-3080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14342744#comment-14342744 ] Abin Shahab commented on YARN-3080: --- [~beckham007] Thanks for your comment. So you're

[jira] [Commented] (YARN-3080) The DockerContainerExecutor could not write the right pid to container pidFile

[ https://issues.apache.org/jira/browse/YARN-3080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14342828#comment-14342828 ] Abin Shahab commented on YARN-3080: --- [~chengzhendong888], you are implying that the

[jira] [Commented] (YARN-3080) The DockerContainerExecutor could not write the right pid to container pidFile

[ https://issues.apache.org/jira/browse/YARN-3080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14342876#comment-14342876 ] Abin Shahab commented on YARN-3080: --- I agree with that Varun. However, I'm not sure the

[jira] [Commented] (YARN-3080) The DockerContainerExecutor could not write the right pid to container pidFile

[ https://issues.apache.org/jira/browse/YARN-3080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341761#comment-14341761 ] Abin Shahab commented on YARN-3080: --- [~chenchun], Also, other threads in the NM may

[jira] [Commented] (YARN-3080) The DockerContainerExecutor could not write the right pid to container pidFile

[ https://issues.apache.org/jira/browse/YARN-3080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341759#comment-14341759 ] Abin Shahab commented on YARN-3080: --- And how will you derive the container is from pid?

[jira] [Commented] (YARN-3282) DockerContainerExecutor should support environment variables setting

[ https://issues.apache.org/jira/browse/YARN-3282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341953#comment-14341953 ] Abin Shahab commented on YARN-3282: --- [~guoleitao], Can you not include everything you

[jira] [Updated] (YARN-2981) DockerContainerExecutor must support a Cluster-wide default Docker image

[ https://issues.apache.org/jira/browse/YARN-2981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abin Shahab updated YARN-2981: -- Description: This allows the yarn administrator to add a cluster-wide default docker image that will be

[jira] [Commented] (YARN-2981) DockerContainerExecutor must support a Cluster-wide default Docker image

[ https://issues.apache.org/jira/browse/YARN-2981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14339744#comment-14339744 ] Abin Shahab commented on YARN-2981: --- [~raviprak] [~vinodkv] [~vvasudev] [~ywskycn] please

[jira] [Updated] (YARN-3080) The DockerContainerExecutor could not write the right pid to container pidFile

[ https://issues.apache.org/jira/browse/YARN-3080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abin Shahab updated YARN-3080: -- Attachment: YARN-3080.patch Updated callable to runnable. The DockerContainerExecutor could not write

[jira] [Updated] (YARN-2981) DockerContainerExecutor must support a Cluster-wide default Docker image

[ https://issues.apache.org/jira/browse/YARN-2981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abin Shahab updated YARN-2981: -- Attachment: YARN-2981.patch This introduced a cluster-default docker image, and limits memory, cpu, and

[jira] [Updated] (YARN-3080) The DockerContainerExecutor could not write the right pid to container pidFile

[ https://issues.apache.org/jira/browse/YARN-3080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abin Shahab updated YARN-3080: -- Attachment: YARN-3080.patch Fixed the findbug errors. The DockerContainerExecutor could not write the

[jira] [Commented] (YARN-3080) The DockerContainerExecutor could not write the right pid to container pidFile

[ https://issues.apache.org/jira/browse/YARN-3080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14337668#comment-14337668 ] Abin Shahab commented on YARN-3080: --- [~raviprakash], [~vinodkv], [~vvasudev] [~ywskycn]

[jira] [Updated] (YARN-3080) The DockerContainerExecutor could not write the right pid to container pidFile

[ https://issues.apache.org/jira/browse/YARN-3080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abin Shahab updated YARN-3080: -- Attachment: YARN-3080.patch The DockerContainerExecutor could not write the right pid to container

[jira] [Assigned] (YARN-3080) The DockerContainerExecutor could not write the right pid to container pidFile

[ https://issues.apache.org/jira/browse/YARN-3080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abin Shahab reassigned YARN-3080: - Assignee: Abin Shahab The DockerContainerExecutor could not write the right pid to container

[jira] [Updated] (YARN-3080) The DockerContainerExecutor could not write the right pid to container pidFile

[ https://issues.apache.org/jira/browse/YARN-3080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abin Shahab updated YARN-3080: -- Attachment: YARN-3080.patch Tested on trunk The DockerContainerExecutor could not write the right pid

[jira] [Commented] (YARN-2466) Umbrella issue for Yarn launched Docker Containers

[ https://issues.apache.org/jira/browse/YARN-2466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286380#comment-14286380 ] Abin Shahab commented on YARN-2466: --- Yes, [~airbots], Please elaborate this 'interactive'

[jira] [Commented] (YARN-2466) Umbrella issue for Yarn launched Docker Containers

[ https://issues.apache.org/jira/browse/YARN-2466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286337#comment-14286337 ] Abin Shahab commented on YARN-2466: --- [~eronwright] We are working to make it easy to use

[jira] [Created] (YARN-2981) DockerContainerExecutor must support a Cluster-wide default Docker image

Abin Shahab created YARN-2981: - Summary: DockerContainerExecutor must support a Cluster-wide default Docker image Key: YARN-2981 URL: https://issues.apache.org/jira/browse/YARN-2981 Project: Hadoop YARN

[jira] [Commented] (YARN-1964) Create Docker analog of the LinuxContainerExecutor in YARN

[ https://issues.apache.org/jira/browse/YARN-1964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14247798#comment-14247798 ] Abin Shahab commented on YARN-1964: --- Hi [~airbots], Did this fix your issue? Abin

[jira] [Commented] (YARN-1964) Create Docker analog of the LinuxContainerExecutor in YARN

[ https://issues.apache.org/jira/browse/YARN-1964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14245421#comment-14245421 ] Abin Shahab commented on YARN-1964: --- Thanks for testing! On Sat, Dec 13, 2014 at 7:20

[jira] [Commented] (YARN-1964) Create Docker analog of the LinuxContainerExecutor in YARN

[ https://issues.apache.org/jira/browse/YARN-1964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14241672#comment-14241672 ] Abin Shahab commented on YARN-1964: --- [~airbots] We at altiscale are running this on a 6

[jira] [Commented] (YARN-1964) Create Docker analog of the LinuxContainerExecutor in YARN

[ https://issues.apache.org/jira/browse/YARN-1964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14241692#comment-14241692 ] Abin Shahab commented on YARN-1964: --- Hey [~matyix], if you have a chance, can you give

[jira] [Created] (YARN-2878) Fix DockerContainerExecutor.apt.vm formatting

Abin Shahab created YARN-2878: - Summary: Fix DockerContainerExecutor.apt.vm formatting Key: YARN-2878 URL: https://issues.apache.org/jira/browse/YARN-2878 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-2878) Fix DockerContainerExecutor.apt.vm formatting

[ https://issues.apache.org/jira/browse/YARN-2878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abin Shahab updated YARN-2878: -- Attachment: YARN-1964-docs.patch Fix DockerContainerExecutor.apt.vm formatting

[jira] [Updated] (YARN-1964) Create Docker analog of the LinuxContainerExecutor in YARN

[ https://issues.apache.org/jira/browse/YARN-1964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abin Shahab updated YARN-1964: -- Attachment: YARN-1964.patch fixed imports. Create Docker analog of the LinuxContainerExecutor in YARN

[jira] [Updated] (YARN-1964) Create Docker analog of the LinuxContainerExecutor in YARN

[ https://issues.apache.org/jira/browse/YARN-1964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abin Shahab updated YARN-1964: -- Attachment: YARN-1964.patch [~chenchun] Thanks a lot for your feedback. I have made some of the changes

[jira] [Commented] (YARN-1964) Create Docker analog of the LinuxContainerExecutor in YARN

[ https://issues.apache.org/jira/browse/YARN-1964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14202926#comment-14202926 ] Abin Shahab commented on YARN-1964: --- I meant, [~raviprak], I have made most of the

[jira] [Updated] (YARN-1964) Create Docker analog of the LinuxContainerExecutor in YARN

[ https://issues.apache.org/jira/browse/YARN-1964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abin Shahab updated YARN-1964: -- Attachment: YARN-1964.patch Added nullcheck Create Docker analog of the LinuxContainerExecutor in

[jira] [Commented] (YARN-1964) Create Docker analog of the LinuxContainerExecutor in YARN

[ https://issues.apache.org/jira/browse/YARN-1964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14194718#comment-14194718 ] Abin Shahab commented on YARN-1964: --- [~acmurthy], [~vinodkv], Do you guys have any

[jira] [Updated] (YARN-1964) Create Docker analog of the LinuxContainerExecutor in YARN

[ https://issues.apache.org/jira/browse/YARN-1964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abin Shahab updated YARN-1964: -- Attachment: YARN-1964.patch Patch with merge conflicts fixed. Docs pointing back to

[jira] [Commented] (YARN-1964) Create Docker analog of the LinuxContainerExecutor in YARN

[ https://issues.apache.org/jira/browse/YARN-1964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14187081#comment-14187081 ] Abin Shahab commented on YARN-1964: --- This says it passed:

[jira] [Updated] (YARN-1964) Create Docker analog of the LinuxContainerExecutor in YARN

[ https://issues.apache.org/jira/browse/YARN-1964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abin Shahab updated YARN-1964: -- Attachment: YARN-1964.patch Fixed rebase issue. Create Docker analog of the LinuxContainerExecutor in

[jira] [Commented] (YARN-1964) Create Docker analog of the LinuxContainerExecutor in YARN

[ https://issues.apache.org/jira/browse/YARN-1964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14187587#comment-14187587 ] Abin Shahab commented on YARN-1964: --- Fixed. I had tested the patch on my box, and that

[jira] [Commented] (YARN-1964) Create Docker analog of the LinuxContainerExecutor in YARN

[ https://issues.apache.org/jira/browse/YARN-1964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14188033#comment-14188033 ] Abin Shahab commented on YARN-1964: --- I don't think the broken rm tests are linked to this

[jira] [Commented] (YARN-1964) Create Docker analog of the LinuxContainerExecutor in YARN

[ https://issues.apache.org/jira/browse/YARN-1964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14186253#comment-14186253 ] Abin Shahab commented on YARN-1964: --- Sid, thanks for looking at it. The docker image is

[jira] [Updated] (YARN-1964) Create Docker analog of the LinuxContainerExecutor in YARN

[ https://issues.apache.org/jira/browse/YARN-1964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abin Shahab updated YARN-1964: -- Attachment: YARN-1964.patch This patch simplifies the use-case by exposing only one docker configuration

[jira] [Created] (YARN-2718) Create a CompositeConatainerExecutor that combines DockerContainerExecutor and DefaultContainerExecutor

Abin Shahab created YARN-2718: - Summary: Create a CompositeConatainerExecutor that combines DockerContainerExecutor and DefaultContainerExecutor Key: YARN-2718 URL: https://issues.apache.org/jira/browse/YARN-2718

[jira] [Updated] (YARN-1964) Create Docker analog of the LinuxContainerExecutor in YARN

[ https://issues.apache.org/jira/browse/YARN-1964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abin Shahab updated YARN-1964: -- Attachment: YARN-1964.patch Patch with all classpath changes inside DCE. Create Docker analog of the

[jira] [Updated] (YARN-1964) Create Docker analog of the LinuxContainerExecutor in YARN

[ https://issues.apache.org/jira/browse/YARN-1964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abin Shahab updated YARN-1964: -- Attachment: YARN-1964.patch Harmonized changes between yarn-default.xml and YarnConfiguration. Updated

[jira] [Updated] (YARN-1964) Create Docker analog of the LinuxContainerExecutor in YARN

[ https://issues.apache.org/jira/browse/YARN-1964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abin Shahab updated YARN-1964: -- Attachment: YARN-1964.patch Added example and test for JAVA_HOME change for mappers and reducers.

[jira] [Commented] (YARN-2481) YARN should allow defining the location of java

[ https://issues.apache.org/jira/browse/YARN-2481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14151341#comment-14151341 ] Abin Shahab commented on YARN-2481: --- Thanks for the clarification [~acmurthy]. I have

[jira] [Resolved] (YARN-2481) YARN should allow defining the location of java

[ https://issues.apache.org/jira/browse/YARN-2481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abin Shahab resolved YARN-2481. --- Resolution: Cannot Reproduce Assignee: Abin Shahab Verified on trunk that JAVA_HOME can be set

[jira] [Updated] (YARN-1964) Create Docker analog of the LinuxContainerExecutor in YARN

[ https://issues.apache.org/jira/browse/YARN-1964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abin Shahab updated YARN-1964: -- Attachment: YARN-1964.patch Patch that scopes down the YARN integration as mentioned above. Create

[jira] [Commented] (YARN-1964) Create Docker analog of the LinuxContainerExecutor in YARN

[ https://issues.apache.org/jira/browse/YARN-1964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14146531#comment-14146531 ] Abin Shahab commented on YARN-1964: --- Pull-request on git:

[jira] [Commented] (YARN-1964) Create Docker analog of the LinuxContainerExecutor in YARN

[ https://issues.apache.org/jira/browse/YARN-1964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14131640#comment-14131640 ] Abin Shahab commented on YARN-1964: --- We have decided to create an umbrella issue to cover

[jira] [Created] (YARN-2477) DockerContainerExecutor must support secure mode

Abin Shahab created YARN-2477: - Summary: DockerContainerExecutor must support secure mode Key: YARN-2477 URL: https://issues.apache.org/jira/browse/YARN-2477 Project: Hadoop YARN Issue Type: New

[jira] [Created] (YARN-2478) Nested containers should be supported

Abin Shahab created YARN-2478: - Summary: Nested containers should be supported Key: YARN-2478 URL: https://issues.apache.org/jira/browse/YARN-2478 Project: Hadoop YARN Issue Type: New Feature

[jira] [Created] (YARN-2479) DockerContainerExecutor must support handling of distributed cache

Abin Shahab created YARN-2479: - Summary: DockerContainerExecutor must support handling of distributed cache Key: YARN-2479 URL: https://issues.apache.org/jira/browse/YARN-2479 Project: Hadoop YARN

[jira] [Created] (YARN-2480) DockerContainerExecutor must support user namespaces

Abin Shahab created YARN-2480: - Summary: DockerContainerExecutor must support user namespaces Key: YARN-2480 URL: https://issues.apache.org/jira/browse/YARN-2480 Project: Hadoop YARN Issue Type:

[jira] [Created] (YARN-2481) YARN should allow defining the location of java

Abin Shahab created YARN-2481: - Summary: YARN should allow defining the location of java Key: YARN-2481 URL: https://issues.apache.org/jira/browse/YARN-2481 Project: Hadoop YARN Issue Type: New

[jira] [Created] (YARN-2482) DockerContainerExecutor configuration

Abin Shahab created YARN-2482: - Summary: DockerContainerExecutor configuration Key: YARN-2482 URL: https://issues.apache.org/jira/browse/YARN-2482 Project: Hadoop YARN Issue Type: New Feature

[jira] [Commented] (YARN-2477) DockerContainerExecutor must support secure mode

[ https://issues.apache.org/jira/browse/YARN-2477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14116501#comment-14116501 ] Abin Shahab commented on YARN-2477: --- [~drankye], I am eluding to the fact that Kerberized

[jira] [Created] (YARN-2466) Umbrella issue for Yarn launched Docker Containers

Abin Shahab created YARN-2466: - Summary: Umbrella issue for Yarn launched Docker Containers Key: YARN-2466 URL: https://issues.apache.org/jira/browse/YARN-2466 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-18) Configurable Hierarchical Topology for YARN

[ https://issues.apache.org/jira/browse/YARN-18?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105863#comment-14105863 ] Abin Shahab commented on YARN-18: - [~djp], and [~gujilangzi], I tried patching this on trunk

[jira] [Commented] (YARN-18) Configurable Hierarchical Topology for YARN

[ https://issues.apache.org/jira/browse/YARN-18?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105986#comment-14105986 ] Abin Shahab commented on YARN-18: - Ok it merged fine to trunk. I am having issues merging to

[jira] [Commented] (YARN-1964) Create Docker analog of the LinuxContainerExecutor in YARN

[ https://issues.apache.org/jira/browse/YARN-1964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14006222#comment-14006222 ] Abin Shahab commented on YARN-1964: --- Does others have comments on it. [~acmurthy]] ?

[jira] [Commented] (YARN-1983) Support heterogeneous container types at runtime on YARN

[ https://issues.apache.org/jira/browse/YARN-1983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13988840#comment-13988840 ] Abin Shahab commented on YARN-1983: --- I'm assuming we'll still be using a generic

[jira] [Updated] (YARN-1964) Create Docker analog of the LinuxContainerExecutor in YARN

[ https://issues.apache.org/jira/browse/YARN-1964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abin Shahab updated YARN-1964: -- Attachment: yarn-1964-docker.patch Fixed tests. Create Docker analog of the LinuxContainerExecutor in

[jira] [Updated] (YARN-1964) Create Docker analog of the LinuxContainerExecutor in YARN

[ https://issues.apache.org/jira/browse/YARN-1964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abin Shahab updated YARN-1964: -- Attachment: yarn-1964-docker.patch Removed javac warnings. Create Docker analog of the

[jira] [Updated] (YARN-1964) Create Docker analog of the LinuxContainerExecutor in YARN

[ https://issues.apache.org/jira/browse/YARN-1964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abin Shahab updated YARN-1964: -- Attachment: yarn-1964-docker.patch Patch with tests. Create Docker analog of the

[jira] [Updated] (YARN-1964) Create Docker analog of the LinuxContainerExecutor in YARN

[ https://issues.apache.org/jira/browse/YARN-1964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abin Shahab updated YARN-1964: -- Attachment: yarn-1964-branch-2.2.0-docker.patch This should pass on the branch. Create Docker analog

[jira] [Updated] (YARN-1964) Create Docker analog of the LinuxContainerExecutor in YARN

[ https://issues.apache.org/jira/browse/YARN-1964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abin Shahab updated YARN-1964: -- Attachment: yarn-1964-docker.patch Trunk-patch with test passing. Create Docker analog of the

[jira] [Commented] (YARN-1983) Support heterogeneous container types at runtime on YARN

[ https://issues.apache.org/jira/browse/YARN-1983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13981509#comment-13981509 ] Abin Shahab commented on YARN-1983: --- After YARN-1964, I can work on extending the

[jira] [Commented] (YARN-1983) Support heterogeneous container types at runtime on YARN

[ https://issues.apache.org/jira/browse/YARN-1983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13981632#comment-13981632 ] Abin Shahab commented on YARN-1983: --- Right, there maybe other, better alternatives. What

[jira] [Updated] (YARN-1964) Support Docker containers in YARN

[ https://issues.apache.org/jira/browse/YARN-1964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abin Shahab updated YARN-1964: -- Attachment: yarn-1964-branch-2.2.0-docker.patch This adds a new ContainerExecutor called

[jira] [Commented] (YARN-1964) Support Docker containers in YARN

[ https://issues.apache.org/jira/browse/YARN-1964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13980159#comment-13980159 ] Abin Shahab commented on YARN-1964: --- Wangda Tan, I like your suggestion. The patch that

[jira] [Commented] (YARN-1964) Support Docker containers in YARN

[ https://issues.apache.org/jira/browse/YARN-1964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13980356#comment-13980356 ] Abin Shahab commented on YARN-1964: --- Jay Vyas, I think the task here is to enable yarn to

[jira] [Commented] (YARN-1964) Support Docker containers in YARN

[ https://issues.apache.org/jira/browse/YARN-1964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13977304#comment-13977304 ] Abin Shahab commented on YARN-1964: --- I have a patch for a docker container executor, and