[jira] [Updated] (MAPREDUCE-5357) Job staging directory owner checking could fail on Windows
[ https://issues.apache.org/jira/browse/MAPREDUCE-5357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated MAPREDUCE-5357: - Target Version/s: 3.0.0, 2.1.0-beta Hadoop Flags: Reviewed Job staging directory owner checking could fail on Windows -- Key: MAPREDUCE-5357 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5357 Project: Hadoop Map/Reduce Issue Type: Bug Affects Versions: 3.0.0, 2.1.0-beta Reporter: Chuan Liu Assignee: Chuan Liu Priority: Minor Attachments: MAPREDUCE-5357-trunk.patch In {{JobSubmissionFiles.getStagingDir()}}, we have following code that will throw exception if the directory owner is not the current user. {code:java} String owner = fsStatus.getOwner(); if (!(owner.equals(currentUser) || owner.equals(realUser))) { throw new IOException(The ownership on the staging directory + stagingArea + is not as expected. + It is owned by + owner + . The directory must + be owned by the submitter + currentUser + or + by + realUser); } {code} This check will fail on Windows when the underlying file system is LocalFileSystem. Because on Windows, the default file or directory owner could be Administrators group if the user belongs to Administrators group. Quite a few MR unit tests that runs MR mini cluster with localFs as underlying file system fail because of this. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-5357) Job staging directory owner checking could fail on Windows
[ https://issues.apache.org/jira/browse/MAPREDUCE-5357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated MAPREDUCE-5357: - Resolution: Fixed Status: Resolved (was: Patch Available) I committed this to trunk, branch-2, and branch-2.1-beta. Thank you for contributing the patch, Chuan. Job staging directory owner checking could fail on Windows -- Key: MAPREDUCE-5357 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5357 Project: Hadoop Map/Reduce Issue Type: Bug Affects Versions: 3.0.0, 2.1.0-beta Reporter: Chuan Liu Assignee: Chuan Liu Priority: Minor Attachments: MAPREDUCE-5357-trunk.patch In {{JobSubmissionFiles.getStagingDir()}}, we have following code that will throw exception if the directory owner is not the current user. {code:java} String owner = fsStatus.getOwner(); if (!(owner.equals(currentUser) || owner.equals(realUser))) { throw new IOException(The ownership on the staging directory + stagingArea + is not as expected. + It is owned by + owner + . The directory must + be owned by the submitter + currentUser + or + by + realUser); } {code} This check will fail on Windows when the underlying file system is LocalFileSystem. Because on Windows, the default file or directory owner could be Administrators group if the user belongs to Administrators group. Quite a few MR unit tests that runs MR mini cluster with localFs as underlying file system fail because of this. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-5357) Job staging directory owner checking could fail on Windows
[ https://issues.apache.org/jira/browse/MAPREDUCE-5357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated MAPREDUCE-5357: - Fix Version/s: 2.1.0-beta 3.0.0 Job staging directory owner checking could fail on Windows -- Key: MAPREDUCE-5357 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5357 Project: Hadoop Map/Reduce Issue Type: Bug Affects Versions: 3.0.0, 2.1.0-beta Reporter: Chuan Liu Assignee: Chuan Liu Priority: Minor Fix For: 3.0.0, 2.1.0-beta Attachments: MAPREDUCE-5357-trunk.patch In {{JobSubmissionFiles.getStagingDir()}}, we have following code that will throw exception if the directory owner is not the current user. {code:java} String owner = fsStatus.getOwner(); if (!(owner.equals(currentUser) || owner.equals(realUser))) { throw new IOException(The ownership on the staging directory + stagingArea + is not as expected. + It is owned by + owner + . The directory must + be owned by the submitter + currentUser + or + by + realUser); } {code} This check will fail on Windows when the underlying file system is LocalFileSystem. Because on Windows, the default file or directory owner could be Administrators group if the user belongs to Administrators group. Quite a few MR unit tests that runs MR mini cluster with localFs as underlying file system fail because of this. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-5357) Job staging directory owner checking could fail on Windows
[ https://issues.apache.org/jira/browse/MAPREDUCE-5357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chuan Liu updated MAPREDUCE-5357: - Attachment: MAPREDUCE-5357-trunk.patch Attaching a patch that explicitly set the owner for the staging directory. Job staging directory owner checking could fail on Windows -- Key: MAPREDUCE-5357 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5357 Project: Hadoop Map/Reduce Issue Type: Bug Affects Versions: 3.0.0, 2.1.0-beta Reporter: Chuan Liu Assignee: Chuan Liu Priority: Minor Attachments: MAPREDUCE-5357-trunk.patch In {{JobSubmissionFiles.getStagingDir()}}, we have following code that will throw exception if the directory owner is not the current user. {code:java} String owner = fsStatus.getOwner(); if (!(owner.equals(currentUser) || owner.equals(realUser))) { throw new IOException(The ownership on the staging directory + stagingArea + is not as expected. + It is owned by + owner + . The directory must + be owned by the submitter + currentUser + or + by + realUser); } {code} This check will fail on Windows when the underlying file system is LocalFileSystem. Because on Windows, the default file or directory owner could be Administrators group if the user belongs to Administrators group. Quite a few MR unit tests that runs MR mini cluster with localFs as underlying file system fail because of this. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-5357) Job staging directory owner checking could fail on Windows
[ https://issues.apache.org/jira/browse/MAPREDUCE-5357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chuan Liu updated MAPREDUCE-5357: - Status: Patch Available (was: Open) Job staging directory owner checking could fail on Windows -- Key: MAPREDUCE-5357 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5357 Project: Hadoop Map/Reduce Issue Type: Bug Affects Versions: 3.0.0, 2.1.0-beta Reporter: Chuan Liu Assignee: Chuan Liu Priority: Minor Attachments: MAPREDUCE-5357-trunk.patch In {{JobSubmissionFiles.getStagingDir()}}, we have following code that will throw exception if the directory owner is not the current user. {code:java} String owner = fsStatus.getOwner(); if (!(owner.equals(currentUser) || owner.equals(realUser))) { throw new IOException(The ownership on the staging directory + stagingArea + is not as expected. + It is owned by + owner + . The directory must + be owned by the submitter + currentUser + or + by + realUser); } {code} This check will fail on Windows when the underlying file system is LocalFileSystem. Because on Windows, the default file or directory owner could be Administrators group if the user belongs to Administrators group. Quite a few MR unit tests that runs MR mini cluster with localFs as underlying file system fail because of this. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira