[
https://issues.apache.org/jira/browse/MAPREDUCE-5357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13698391#comment-13698391
]
Chuan Liu commented on MAPREDUCE-5357:
--------------------------------------
Hi Chris, the following tests fail on my machine.
* TestClusterMRNotification
* TestJobCleanup
* TestJobCounters
* TestJobOutputCommitter
* TestMROldApiJobs
* TestSpeculativeExecution
You may need to delete the stating directory on your local drive to repro the
failure.
The user running the tests need to be an Administrators group user.
Error message looks like the following for me.
{noformat}
testSpeculativeExecution(org.apache.hadoop.mapreduce.v2.TestSpeculativeExecution)
Time elapsed: 22109 sec <<< ERROR!
java.io.IOException: The ownership on the staging directory
E:/tmp/hadoop-yarn/staging/chuanliu/.staging is not as expected. It is owned by
Administrators. The directory must be owned by the submitter chuanliu or by
chuanliu
{noformat}
> Job staging directory owner checking could fail on Windows
> ----------------------------------------------------------
>
> Key: MAPREDUCE-5357
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-5357
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 3.0.0, 2.1.0-beta
> Reporter: Chuan Liu
> Assignee: Chuan Liu
> Priority: Minor
> Attachments: MAPREDUCE-5357-trunk.patch
>
>
> In {{JobSubmissionFiles.getStagingDir()}}, we have following code that will
> throw exception if the directory owner is not the current user.
> {code:java}
> String owner = fsStatus.getOwner();
> if (!(owner.equals(currentUser) || owner.equals(realUser))) {
> throw new IOException("The ownership on the staging directory " +
> stagingArea + " is not as expected. " +
> "It is owned by " + owner + ". The directory must " +
> "be owned by the submitter " + currentUser + " or " +
> "by " + realUser);
> }
> {code}
> This check will fail on Windows when the underlying file system is
> LocalFileSystem. Because on Windows, the default file or directory owner
> could be "Administrators" group if the user belongs to "Administrators" group.
> Quite a few MR unit tests that runs MR mini cluster with localFs as
> underlying file system fail because of this.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira