[ https://issues.apache.org/jira/browse/MAPREDUCE-1595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12844452#action_12844452 ]
Vinod K V commented on MAPREDUCE-1595: -------------------------------------- Consider this failure case: - Two mapred-local-dirs "/a/b/c/ML1" and "/a/b/c/ML2". - TT first creates userdir Alice in both the dirs, i.e. "/a/b/c/ML1/taskTracker/Alice" and "/a/b/c/ML2/taskTracker/Alice" - TT then launched LinuxTaskController for 'securifying' the user-dirs aka MAPREDUCE-856. - LinuxTaskController then successfully changes ownership of "/a/b/c/ML1/taskTracker/Alice" to "Alice:tt_group" but then fails on changing ownership of "/a/b/c/ML2/taskTracker/Alice" due to a transitory disk problem. The above result in the failure of current task because of a failed INITIALIZE_USER operation. Not just that, every other task of Alice that ever comes on this TT will try INITIALIZE_USER and fail because LinuxTaskController see "Alice:tt_group" on "/a/b/c/ML1/taskTracker/Alice" and fails saying the file is not owned by TT. This can otherwise only be rectified when TT restarts/reinits and moves and deletes the old mapred-local-dirs. > LinuxTaskController is too strict on the initial ownership of files/dir. > ------------------------------------------------------------------------ > > Key: MAPREDUCE-1595 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1595 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: security, task-controller > Reporter: Vinod K V > Fix For: 0.22.0 > > > Linux task controller is too strict now w.r.t the initial ownership of the > files/dir that it tries to make as secure as possible. Currently, it expects, > for e.g, the mapred-local/tasktracker/user-dir to be both user-owned and > group-owned by TT. This leads to unrecoverable failures in some corner cases. > It can instead allow the files/dirs to be owned either by TT *or* by the > jobOwner. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.