[jira] [Updated] (MAPREDUCE-3982) TestEmptyJob fails with FileNotFound
[ https://issues.apache.org/jira/browse/MAPREDUCE-3982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated MAPREDUCE-3982: --- Resolution: Fixed Fix Version/s: 0.23.2 Release Note: Fixed FileOutputCommitter to not err out for an 'empty-job' whose tasks don't write any outputs. Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) I just committed this to trunk, branch-0.23 and branch-0.23.2. Thanks Robert! > TestEmptyJob fails with FileNotFound > > > Key: MAPREDUCE-3982 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-3982 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: mrv2 >Affects Versions: 0.24.0, 0.23.2 >Reporter: Robert Joseph Evans >Assignee: Robert Joseph Evans >Priority: Critical > Fix For: 0.23.2 > > Attachments: MR-3982.txt, MR-3982.txt > > > TestEmptyJob fails because teh FileOutputCommitter expects a directory to be > created that is not created. The FileOutputCommitter should either ignore > the error or create the directory itself. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3982) TestEmptyJob fails with FileNotFound
[ https://issues.apache.org/jira/browse/MAPREDUCE-3982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Joseph Evans updated MAPREDUCE-3982: --- Status: Patch Available (was: Open) > TestEmptyJob fails with FileNotFound > > > Key: MAPREDUCE-3982 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-3982 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: mrv2 >Affects Versions: 0.24.0, 0.23.2 >Reporter: Robert Joseph Evans >Assignee: Robert Joseph Evans >Priority: Critical > Attachments: MR-3982.txt, MR-3982.txt > > > TestEmptyJob fails because teh FileOutputCommitter expects a directory to be > created that is not created. The FileOutputCommitter should either ignore > the error or create the directory itself. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3982) TestEmptyJob fails with FileNotFound
[ https://issues.apache.org/jira/browse/MAPREDUCE-3982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Joseph Evans updated MAPREDUCE-3982: --- Attachment: MR-3982.txt This patch adds in a unit test that verifies that it still works even without any output. I started to port TestEmptyJob to the MiniMrYarnCluster, but it uses a lot of methods that are specific to the JT implementation to do some sort of synchronization test. I really don't understand all of the reasons for that test and why it is trying to force the scheduler to schedule something. I will file a separate JIRA to port it over because it is probably going to take a while for me to fully understand the test. > TestEmptyJob fails with FileNotFound > > > Key: MAPREDUCE-3982 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-3982 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: mrv2 >Affects Versions: 0.24.0, 0.23.2 >Reporter: Robert Joseph Evans >Assignee: Robert Joseph Evans >Priority: Critical > Attachments: MR-3982.txt, MR-3982.txt > > > TestEmptyJob fails because teh FileOutputCommitter expects a directory to be > created that is not created. The FileOutputCommitter should either ignore > the error or create the directory itself. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3982) TestEmptyJob fails with FileNotFound
[ https://issues.apache.org/jira/browse/MAPREDUCE-3982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated MAPREDUCE-3982: --- Status: Open (was: Patch Available) Patch looks good. Can you please port the test TestEmptyJob to maven build and possibly MiniMRYarnCluster? Tx. > TestEmptyJob fails with FileNotFound > > > Key: MAPREDUCE-3982 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-3982 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: mrv2 >Affects Versions: 0.24.0, 0.23.2 >Reporter: Robert Joseph Evans >Assignee: Robert Joseph Evans >Priority: Critical > Attachments: MR-3982.txt > > > TestEmptyJob fails because teh FileOutputCommitter expects a directory to be > created that is not created. The FileOutputCommitter should either ignore > the error or create the directory itself. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3982) TestEmptyJob fails with FileNotFound
[ https://issues.apache.org/jira/browse/MAPREDUCE-3982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Joseph Evans updated MAPREDUCE-3982: --- Priority: Critical (was: Major) > TestEmptyJob fails with FileNotFound > > > Key: MAPREDUCE-3982 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-3982 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: mrv2 >Affects Versions: 0.24.0, 0.23.2 >Reporter: Robert Joseph Evans >Assignee: Robert Joseph Evans >Priority: Critical > Attachments: MR-3982.txt > > > TestEmptyJob fails because teh FileOutputCommitter expects a directory to be > created that is not created. The FileOutputCommitter should either ignore > the error or create the directory itself. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3982) TestEmptyJob fails with FileNotFound
[ https://issues.apache.org/jira/browse/MAPREDUCE-3982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Joseph Evans updated MAPREDUCE-3982: --- Attachment: MR-3982.txt This fixes the issue by createing the directory earlier instead of relying on the mapper or reducer to do it. > TestEmptyJob fails with FileNotFound > > > Key: MAPREDUCE-3982 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-3982 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: mrv2 >Affects Versions: 0.24.0, 0.23.2 >Reporter: Robert Joseph Evans >Assignee: Robert Joseph Evans >Priority: Critical > Attachments: MR-3982.txt > > > TestEmptyJob fails because teh FileOutputCommitter expects a directory to be > created that is not created. The FileOutputCommitter should either ignore > the error or create the directory itself. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3982) TestEmptyJob fails with FileNotFound
[ https://issues.apache.org/jira/browse/MAPREDUCE-3982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Joseph Evans updated MAPREDUCE-3982: --- Status: Patch Available (was: Open) > TestEmptyJob fails with FileNotFound > > > Key: MAPREDUCE-3982 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-3982 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: mrv2 >Affects Versions: 0.24.0, 0.23.2 >Reporter: Robert Joseph Evans >Assignee: Robert Joseph Evans >Priority: Critical > Attachments: MR-3982.txt > > > TestEmptyJob fails because teh FileOutputCommitter expects a directory to be > created that is not created. The FileOutputCommitter should either ignore > the error or create the directory itself. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
