[
https://issues.apache.org/jira/browse/MAPREDUCE-896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12793592#action_12793592
]
Hemanth Yamijala commented on MAPREDUCE-896:
--------------------------------------------
TestMapReduceJobControl failed with a timeout. Locally, I ran this several
times and every time it passed. Without logs it is difficult to debug this
issue. And as Ravi pointed out, it appears it has been observed previously.
The failure in TestServiceLevelAuthorization could be explained though.
Essentially, the test case is failing at a place where it assumes that the
localized job directories are cleaned up. However, this cleanup is asynchronous
in nature and hence, because of timing issues it can fail. However, it is also
true that this patch could make the failure situation a little more probable as
it does more work in the asynchronous cleanup code. Since the issue is
inherently present in the test case even without this patch, we can fix it in a
follow-up JIRA. The advantage we get is that we merge this reasonably complex
patch on trunk, thereby avoiding more merge conflicts, like I discovered today.
Thoughts ?
> Users can set non-writable permissions on temporary files for TT and can
> abuse disk usage.
> ------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-896
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-896
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tasktracker
> Affects Versions: 0.21.0
> Reporter: Vinod K V
> Assignee: Ravi Gummadi
> Fix For: 0.21.0
>
> Attachments: MR-896.patch, MR-896.v1.patch, MR-896.v2.patch,
> MR-896.v3.patch, MR-896.v4.patch, MR-896.v5.patch, MR-896.v6.patch,
> y896.v1.patch, y896.v2.1.fix.patch, y896.v2.1.fix.v1.patch,
> y896.v2.1.fix.v2.patch, y896.v2.1.patch, y896.v2.patch
>
>
> As of now, irrespective of the TaskController in use, TT itself does a full
> delete on local files created by itself or job tasks. This step, depending
> upon TT's umask and the permissions set by files by the user, for e.g in
> job-work/task-work or child.tmp directories, may or may not go through
> successful completion fully. Thus is left an opportunity for abusing disk
> space usage either accidentally or intentionally by TT/users.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
