[jira] [Updated] (MAPREDUCE-5156) Hadoop-examples-1.x.x.jar cannot run on Yarn
[ https://issues.apache.org/jira/browse/MAPREDUCE-5156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated MAPREDUCE-5156: --- Resolution: Fixed Fix Version/s: 2.0.5-beta Hadoop Flags: Incompatible change,Reviewed Status: Resolved (was: Patch Available) Committed this to trunk and branch-2. Thanks Zhijie! Marking this as incompatible as it breaks 0.23.x direct usages of ProgramDriver (which should be rare). > Hadoop-examples-1.x.x.jar cannot run on Yarn > > > Key: MAPREDUCE-5156 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-5156 > Project: Hadoop Map/Reduce > Issue Type: Sub-task >Reporter: Zhijie Shen >Assignee: Zhijie Shen >Priority: Blocker > Fix For: 2.0.5-beta > > Attachments: MAPREDUCE-5156.1.patch, MAPREDUCE-5156.2.patch, > MAPREDUCE-5156.3.patch, MAPREDUCE-5156.4.patch > > > M/R examples are run through ProgramDriver.driver. ProgramDriver.driver > returns void in hadoop-1, while it returns int in hadoop-2. Therefore, the > function signatures in the example jar and yarn are incompatible. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-5156) Hadoop-examples-1.x.x.jar cannot run on Yarn
[ https://issues.apache.org/jira/browse/MAPREDUCE-5156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated MAPREDUCE-5156: --- Status: Patch Available (was: Open) > Hadoop-examples-1.x.x.jar cannot run on Yarn > > > Key: MAPREDUCE-5156 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-5156 > Project: Hadoop Map/Reduce > Issue Type: Sub-task >Reporter: Zhijie Shen >Assignee: Zhijie Shen >Priority: Blocker > Attachments: MAPREDUCE-5156.1.patch, MAPREDUCE-5156.2.patch, > MAPREDUCE-5156.3.patch, MAPREDUCE-5156.4.patch > > > M/R examples are run through ProgramDriver.driver. ProgramDriver.driver > returns void in hadoop-1, while it returns int in hadoop-2. Therefore, the > function signatures in the example jar and yarn are incompatible. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-5156) Hadoop-examples-1.x.x.jar cannot run on Yarn
[ https://issues.apache.org/jira/browse/MAPREDUCE-5156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated MAPREDUCE-5156: --- Attachment: MAPREDUCE-5156.4.patch Thanks, Vinod! Updated the patch. > Hadoop-examples-1.x.x.jar cannot run on Yarn > > > Key: MAPREDUCE-5156 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-5156 > Project: Hadoop Map/Reduce > Issue Type: Sub-task >Reporter: Zhijie Shen >Assignee: Zhijie Shen >Priority: Blocker > Attachments: MAPREDUCE-5156.1.patch, MAPREDUCE-5156.2.patch, > MAPREDUCE-5156.3.patch, MAPREDUCE-5156.4.patch > > > M/R examples are run through ProgramDriver.driver. ProgramDriver.driver > returns void in hadoop-1, while it returns int in hadoop-2. Therefore, the > function signatures in the example jar and yarn are incompatible. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-5156) Hadoop-examples-1.x.x.jar cannot run on Yarn
[ https://issues.apache.org/jira/browse/MAPREDUCE-5156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated MAPREDUCE-5156: --- Status: Open (was: Patch Available) I figured out why your patch was failing findBugs: You have a bug name instead of bug-pattern in the exclude file :) Please update the patch. Tx. > Hadoop-examples-1.x.x.jar cannot run on Yarn > > > Key: MAPREDUCE-5156 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-5156 > Project: Hadoop Map/Reduce > Issue Type: Sub-task >Reporter: Zhijie Shen >Assignee: Zhijie Shen >Priority: Blocker > Attachments: MAPREDUCE-5156.1.patch, MAPREDUCE-5156.2.patch, > MAPREDUCE-5156.3.patch > > > M/R examples are run through ProgramDriver.driver. ProgramDriver.driver > returns void in hadoop-1, while it returns int in hadoop-2. Therefore, the > function signatures in the example jar and yarn are incompatible. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-5156) Hadoop-examples-1.x.x.jar cannot run on Yarn
[ https://issues.apache.org/jira/browse/MAPREDUCE-5156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated MAPREDUCE-5156: --- Status: Patch Available (was: Open) > Hadoop-examples-1.x.x.jar cannot run on Yarn > > > Key: MAPREDUCE-5156 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-5156 > Project: Hadoop Map/Reduce > Issue Type: Sub-task >Reporter: Zhijie Shen >Assignee: Zhijie Shen >Priority: Blocker > Attachments: MAPREDUCE-5156.1.patch, MAPREDUCE-5156.2.patch, > MAPREDUCE-5156.3.patch > > > M/R examples are run through ProgramDriver.driver. ProgramDriver.driver > returns void in hadoop-1, while it returns int in hadoop-2. Therefore, the > function signatures in the example jar and yarn are incompatible. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-5156) Hadoop-examples-1.x.x.jar cannot run on Yarn
[ https://issues.apache.org/jira/browse/MAPREDUCE-5156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated MAPREDUCE-5156: --- Attachment: MAPREDUCE-5156.3.patch Try to fix the findbugs warning > Hadoop-examples-1.x.x.jar cannot run on Yarn > > > Key: MAPREDUCE-5156 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-5156 > Project: Hadoop Map/Reduce > Issue Type: Sub-task >Reporter: Zhijie Shen >Assignee: Zhijie Shen >Priority: Blocker > Attachments: MAPREDUCE-5156.1.patch, MAPREDUCE-5156.2.patch, > MAPREDUCE-5156.3.patch > > > M/R examples are run through ProgramDriver.driver. ProgramDriver.driver > returns void in hadoop-1, while it returns int in hadoop-2. Therefore, the > function signatures in the example jar and yarn are incompatible. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-5156) Hadoop-examples-1.x.x.jar cannot run on Yarn
[ https://issues.apache.org/jira/browse/MAPREDUCE-5156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated MAPREDUCE-5156: --- Status: Open (was: Patch Available) Can you please address the findBugs warning? > Hadoop-examples-1.x.x.jar cannot run on Yarn > > > Key: MAPREDUCE-5156 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-5156 > Project: Hadoop Map/Reduce > Issue Type: Sub-task >Reporter: Zhijie Shen >Assignee: Zhijie Shen >Priority: Blocker > Attachments: MAPREDUCE-5156.1.patch, MAPREDUCE-5156.2.patch > > > M/R examples are run through ProgramDriver.driver. ProgramDriver.driver > returns void in hadoop-1, while it returns int in hadoop-2. Therefore, the > function signatures in the example jar and yarn are incompatible. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-5156) Hadoop-examples-1.x.x.jar cannot run on Yarn
[ https://issues.apache.org/jira/browse/MAPREDUCE-5156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated MAPREDUCE-5156: --- Attachment: MAPREDUCE-5156.2.patch I've uploaded a new patch, which modifies the javadoc, changes driverV2 to run, and tries to exclude the System.exit() warning. > Hadoop-examples-1.x.x.jar cannot run on Yarn > > > Key: MAPREDUCE-5156 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-5156 > Project: Hadoop Map/Reduce > Issue Type: Sub-task >Reporter: Zhijie Shen >Assignee: Zhijie Shen >Priority: Blocker > Attachments: MAPREDUCE-5156.1.patch, MAPREDUCE-5156.2.patch > > > M/R examples are run through ProgramDriver.driver. ProgramDriver.driver > returns void in hadoop-1, while it returns int in hadoop-2. Therefore, the > function signatures in the example jar and yarn are incompatible. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-5156) Hadoop-examples-1.x.x.jar cannot run on Yarn
[ https://issues.apache.org/jira/browse/MAPREDUCE-5156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated MAPREDUCE-5156: --- Status: Patch Available (was: Open) > Hadoop-examples-1.x.x.jar cannot run on Yarn > > > Key: MAPREDUCE-5156 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-5156 > Project: Hadoop Map/Reduce > Issue Type: Sub-task >Reporter: Zhijie Shen >Assignee: Zhijie Shen >Priority: Blocker > Attachments: MAPREDUCE-5156.1.patch, MAPREDUCE-5156.2.patch > > > M/R examples are run through ProgramDriver.driver. ProgramDriver.driver > returns void in hadoop-1, while it returns int in hadoop-2. Therefore, the > function signatures in the example jar and yarn are incompatible. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-5156) Hadoop-examples-1.x.x.jar cannot run on Yarn
[ https://issues.apache.org/jira/browse/MAPREDUCE-5156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated MAPREDUCE-5156: --- Status: Open (was: Patch Available) MAPREDUCE-5193 is committed, let's see if Jenkins is okay this time. In the while, can you please fix the javadoc like Karthik says. Also, shall we rename driverV2 to something like run() or runDriver()? > Hadoop-examples-1.x.x.jar cannot run on Yarn > > > Key: MAPREDUCE-5156 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-5156 > Project: Hadoop Map/Reduce > Issue Type: Sub-task >Reporter: Zhijie Shen >Assignee: Zhijie Shen >Priority: Blocker > Attachments: MAPREDUCE-5156.1.patch > > > M/R examples are run through ProgramDriver.driver. ProgramDriver.driver > returns void in hadoop-1, while it returns int in hadoop-2. Therefore, the > function signatures in the example jar and yarn are incompatible. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-5156) Hadoop-examples-1.x.x.jar cannot run on Yarn
[ https://issues.apache.org/jira/browse/MAPREDUCE-5156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated MAPREDUCE-5156: --- Status: Patch Available (was: Open) > Hadoop-examples-1.x.x.jar cannot run on Yarn > > > Key: MAPREDUCE-5156 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-5156 > Project: Hadoop Map/Reduce > Issue Type: Sub-task >Reporter: Zhijie Shen >Assignee: Zhijie Shen >Priority: Blocker > Attachments: MAPREDUCE-5156.1.patch > > > M/R examples are run through ProgramDriver.driver. ProgramDriver.driver > returns void in hadoop-1, while it returns int in hadoop-2. Therefore, the > function signatures in the example jar and yarn are incompatible. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-5156) Hadoop-examples-1.x.x.jar cannot run on Yarn
[ https://issues.apache.org/jira/browse/MAPREDUCE-5156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated MAPREDUCE-5156: --- Attachment: MAPREDUCE-5156.1.patch I've drafted a patch, which changes "int ProgramDriver#driver" to "int ProgramDriver#driverV2", and adds "void ProgramDriver#driver" that wraps "int ProgramDriver#driverV2". This is an incompatible change, which is not binary compatible with the previous Hadoop 2.x alpha releases. Therefore, the changes is trading binary compatibility of Hadoop 2 with that of Hadoop 1. IMHO, since Hadoop 2 is still in alpha, the impact of incompatibility should be much smaller. In addition, though there's very little code modification, common, mapreduce and hdfs are all affected. We need to think about the way of managing the change. And probably we'd like to move this M/R ticket to common. You idea, please! > Hadoop-examples-1.x.x.jar cannot run on Yarn > > > Key: MAPREDUCE-5156 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-5156 > Project: Hadoop Map/Reduce > Issue Type: Sub-task >Reporter: Zhijie Shen >Assignee: Zhijie Shen >Priority: Blocker > Attachments: MAPREDUCE-5156.1.patch > > > M/R examples are run through ProgramDriver.driver. ProgramDriver.driver > returns void in hadoop-1, while it returns int in hadoop-2. Therefore, the > function signatures in the example jar and yarn are incompatible. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-5156) Hadoop-examples-1.x.x.jar cannot run on Yarn
[ https://issues.apache.org/jira/browse/MAPREDUCE-5156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated MAPREDUCE-5156: - Priority: Blocker (was: Major) > Hadoop-examples-1.x.x.jar cannot run on Yarn > > > Key: MAPREDUCE-5156 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-5156 > Project: Hadoop Map/Reduce > Issue Type: Sub-task >Reporter: Zhijie Shen >Assignee: Zhijie Shen >Priority: Blocker > > M/R examples are run through ProgramDriver.driver. ProgramDriver.driver > returns void in hadoop-1, while it returns int in hadoop-2. Therefore, the > function signatures in the example jar and yarn are incompatible. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-5156) Hadoop-examples-1.x.x.jar cannot run on Yarn
[ https://issues.apache.org/jira/browse/MAPREDUCE-5156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated MAPREDUCE-5156: - Target Version/s: 2.0.5-beta > Hadoop-examples-1.x.x.jar cannot run on Yarn > > > Key: MAPREDUCE-5156 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-5156 > Project: Hadoop Map/Reduce > Issue Type: Sub-task >Reporter: Zhijie Shen >Assignee: Zhijie Shen >Priority: Blocker > > M/R examples are run through ProgramDriver.driver. ProgramDriver.driver > returns void in hadoop-1, while it returns int in hadoop-2. Therefore, the > function signatures in the example jar and yarn are incompatible. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-5156) Hadoop-examples-1.x.x.jar cannot run on Yarn
[ https://issues.apache.org/jira/browse/MAPREDUCE-5156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated MAPREDUCE-5156: --- Issue Type: Sub-task (was: Bug) Parent: MAPREDUCE-5108 > Hadoop-examples-1.x.x.jar cannot run on Yarn > > > Key: MAPREDUCE-5156 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-5156 > Project: Hadoop Map/Reduce > Issue Type: Sub-task >Reporter: Zhijie Shen >Assignee: Zhijie Shen > > M/R examples are run through ProgramDriver.driver. ProgramDriver.driver > returns void in hadoop-1, while it returns int in hadoop-2. Therefore, the > function signatures in the example jar and yarn are incompatible. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
