[ https://issues.apache.org/jira/browse/YARN-6988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16127493#comment-16127493 ]
Eric Badger commented on YARN-6988: ----------------------------------- [~vvasudev], if we just increase the EXECUTOR_PATH_MAX then we would be wasting a lot of memory if the system arg length was set to lower. Also, YARN-6623 is a pretty large patch and might take some time to go through review. I would prefer to put up a patch here, if that's alright. I can put up the patch today. > container-executor fails for docker when command length > 4096 B > ---------------------------------------------------------------- > > Key: YARN-6988 > URL: https://issues.apache.org/jira/browse/YARN-6988 > Project: Hadoop YARN > Issue Type: Sub-task > Components: yarn > Reporter: Eric Badger > Assignee: Eric Badger > > {{run_docker}} and {{launch_docker_container_as_user}} allocate their command > arrays using EXECUTOR_PATH_MAX, which is hardcoded to 4096 in > configuration.h. Because of this, the full docker command can only be 4096 > characters. If it is longer, it will be truncated and the command will fail > with a parsing error. Because of the bind-mounting of volumes, the arguments > to the docker command can quickly get large. For example, I passed the 4096 > limit with an 11 disk node. -- This message was sent by Atlassian JIRA (v6.4.14#64029) --------------------------------------------------------------------- To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org