[jira] [Commented] (MAPREDUCE-2924) TaskTracker number of failed disks to tolerate should be configurable
[ https://issues.apache.org/jira/browse/MAPREDUCE-2924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13095798#comment-13095798 ] Joep Rottinghuis commented on MAPREDUCE-2924: - Would it be possible to keep the TT up. but scale back the # slots available? Something such as 3 out of 10 discs are bad, so only 7/10th of the slots are available? TaskTracker number of failed disks to tolerate should be configurable - Key: MAPREDUCE-2924 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2924 Project: Hadoop Map/Reduce Issue Type: Sub-task Components: tasktracker Affects Versions: 0.20.204.0 Reporter: Eli Collins Like HDFS-1161 but for the TT. The user should be able to configure how many valid disks are needed for operation. Currently the TT will start and accept tasks even if eg only 1 of its 12 disks is working, which leads to poor performance of jobs with tasks that use this machine. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2756) JobControl can drop jobs if an error occurs
[ https://issues.apache.org/jira/browse/MAPREDUCE-2756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13095808#comment-13095808 ] Hudson commented on MAPREDUCE-2756: --- Integrated in Hadoop-Hdfs-trunk-Commit #900 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/900/]) MAPREDUCE-2756. Better error handling in JobControl for failed jobs. Contributed by Robert Evans. acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1164255 Files : * /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/lib/jobcontrol/ControlledJob.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/lib/jobcontrol/JobControl.java * /hadoop/common/trunk/hadoop-mapreduce-project/src/test/unit/org/apache/hadoop/mapreduce/lib/jobcontrol/TestMapReduceJobControlWithMocks.java JobControl can drop jobs if an error occurs --- Key: MAPREDUCE-2756 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2756 Project: Hadoop Map/Reduce Issue Type: Bug Components: client, mrv2 Affects Versions: 0.23.0 Reporter: Robert Joseph Evans Assignee: Robert Joseph Evans Priority: Minor Fix For: 0.23.0 Attachments: MR-2756-V1.patch, MR-2756-trunk-v2.patch, MR-2756-trunk-v3.patch If you run a pig job with UDFs that has not been recompiled for MRV2. There are situations where pig will fail with an error message stating that Hadoop failed and did not give a reason. There is even the possibility of deadlock if an Error is thrown and the JobControl thread dies. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2735) MR279: finished applications should be added to an application summary log
[ https://issues.apache.org/jira/browse/MAPREDUCE-2735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13095807#comment-13095807 ] Hudson commented on MAPREDUCE-2735: --- Integrated in Hadoop-Hdfs-trunk-Commit #900 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/900/]) MAPREDUCE-2735. Add an applications summary log to ResourceManager. Contributed by Thomas Graves. acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1164301 Files : * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/conf/log4j.properties * /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMAppManager.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/MockRMApp.java MR279: finished applications should be added to an application summary log -- Key: MAPREDUCE-2735 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2735 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2 Reporter: Thomas Graves Assignee: Thomas Graves Fix For: 0.23.0 Attachments: MAPREDUCE-2735-v2.patch, MAPREDUCE-2735.patch When an application finishes it should be added to an application summary log for historical purposes. jira MAPREDUCE-2649 is going to start purging applications from RM when certain limits are hit which makes this more critical. We also need to save the information early enough after the app finishes so we don't lose the info if the RM does get restarted. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2767) Remove Linux task-controller from 0.22 branch
[ https://issues.apache.org/jira/browse/MAPREDUCE-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13095809#comment-13095809 ] Hadoop QA commented on MAPREDUCE-2767: -- -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12492662/MR2767-trunk.patch against trunk revision . +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 46 new or modified tests. -1 patch. The patch command could not apply the patch. Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/585//console This message is automatically generated. Remove Linux task-controller from 0.22 branch - Key: MAPREDUCE-2767 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2767 Project: Hadoop Map/Reduce Issue Type: Bug Components: security Affects Versions: 0.22.0, 0.23.0, 0.24.0 Reporter: Milind Bhandarkar Assignee: Milind Bhandarkar Priority: Blocker Fix For: 0.22.0, 0.23.0, 0.24.0 Attachments: MR2767-22.patch, MR2767-23.patch, MR2767-trunk.patch, TEST-org.apache.hadoop.mapred.TestMiniMRChildTask.txt, testlog.txt There's a potential security hole in the task-controller as it stands. Based on the discussion on general@, removing task-controller from the 0.22 branch will pave way for 0.22.0 release. (This was done for the 0.21.0 release as well: see MAPREDUCE-2014.) We can roll a 0.22.1 release with the task-controller when it is fixed. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2756) JobControl can drop jobs if an error occurs
[ https://issues.apache.org/jira/browse/MAPREDUCE-2756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13095815#comment-13095815 ] Hudson commented on MAPREDUCE-2756: --- Integrated in Hadoop-Mapreduce-trunk-Commit #833 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/833/]) MAPREDUCE-2756. Better error handling in JobControl for failed jobs. Contributed by Robert Evans. acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1164255 Files : * /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/lib/jobcontrol/ControlledJob.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/lib/jobcontrol/JobControl.java * /hadoop/common/trunk/hadoop-mapreduce-project/src/test/unit/org/apache/hadoop/mapreduce/lib/jobcontrol/TestMapReduceJobControlWithMocks.java JobControl can drop jobs if an error occurs --- Key: MAPREDUCE-2756 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2756 Project: Hadoop Map/Reduce Issue Type: Bug Components: client, mrv2 Affects Versions: 0.23.0 Reporter: Robert Joseph Evans Assignee: Robert Joseph Evans Priority: Minor Fix For: 0.23.0 Attachments: MR-2756-V1.patch, MR-2756-trunk-v2.patch, MR-2756-trunk-v3.patch If you run a pig job with UDFs that has not been recompiled for MRV2. There are situations where pig will fail with an error message stating that Hadoop failed and did not give a reason. There is even the possibility of deadlock if an Error is thrown and the JobControl thread dies. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2735) MR279: finished applications should be added to an application summary log
[ https://issues.apache.org/jira/browse/MAPREDUCE-2735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13095814#comment-13095814 ] Hudson commented on MAPREDUCE-2735: --- Integrated in Hadoop-Mapreduce-trunk-Commit #833 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/833/]) MAPREDUCE-2735. Add an applications summary log to ResourceManager. Contributed by Thomas Graves. acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1164301 Files : * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/conf/log4j.properties * /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMAppManager.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/MockRMApp.java MR279: finished applications should be added to an application summary log -- Key: MAPREDUCE-2735 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2735 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2 Reporter: Thomas Graves Assignee: Thomas Graves Fix For: 0.23.0 Attachments: MAPREDUCE-2735-v2.patch, MAPREDUCE-2735.patch When an application finishes it should be added to an application summary log for historical purposes. jira MAPREDUCE-2649 is going to start purging applications from RM when certain limits are hit which makes this more critical. We also need to save the information early enough after the app finishes so we don't lose the info if the RM does get restarted. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2836) Provide option to fail jobs when submitted to non-existent pools.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13095825#comment-13095825 ] Hadoop QA commented on MAPREDUCE-2836: -- -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12492698/MAPREDUCE-2836_rev4.patch against trunk revision . +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 3 new or modified tests. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. -1 findbugs. The patch appears to introduce 8 new Findbugs (version 1.3.9) warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. +1 core tests. The patch passed unit tests in .. +1 contrib tests. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/584//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/584//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-common.html Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/584//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-hs.html Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/584//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-core.html Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/584//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-app.html Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/584//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-shuffle.html Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/584//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-jobclient.html Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/584//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-api.html Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/584//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-server-nodemanager.html Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/584//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-server-resourcemanager.html Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/584//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-server-common.html Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/584//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-common.html Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/584//console This message is automatically generated. Provide option to fail jobs when submitted to non-existent pools. - Key: MAPREDUCE-2836 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2836 Project: Hadoop Map/Reduce Issue Type: Improvement Components: contrib/fair-share Reporter: Jeff Bean Assignee: Ahmed Radwan Priority: Minor Attachments: MAPREDUCE-2836.patch, MAPREDUCE-2836_rev2.patch, MAPREDUCE-2836_rev3.patch, MAPREDUCE-2836_rev4.patch In some environments, it might be desirable to explicitly specify the fair scheduler pools and to explicitly fail jobs that are not submitted to any of the pools. Current behavior of the fair scheduler is to submit jobs to a default pool if a pool name isn't specified or to create a pool with the new name if the pool name doesn't already exist. There should be a configuration option for the fair scheduler that causes it to noisily fail the job if it's submitted to a pool that isn't pre-specified or if the specified pool doesn't exist. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2669) Some new examples and test cases for them.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13095830#comment-13095830 ] Hadoop QA commented on MAPREDUCE-2669: -- -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12492659/MAPREDUCE-2669.patch against trunk revision . +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 4 new or modified tests. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. -1 findbugs. The patch appears to introduce 8 new Findbugs (version 1.3.9) warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. +1 core tests. The patch passed unit tests in .. +1 contrib tests. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/586//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/586//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-common.html Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/586//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-api.html Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/586//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-server-common.html Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/586//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-server-resourcemanager.html Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/586//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-server-nodemanager.html Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/586//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-app.html Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/586//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-core.html Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/586//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-common.html Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/586//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-hs.html Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/586//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-shuffle.html Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/586//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-jobclient.html Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/586//console This message is automatically generated. Some new examples and test cases for them. -- Key: MAPREDUCE-2669 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2669 Project: Hadoop Map/Reduce Issue Type: Test Components: examples Affects Versions: 0.22.0 Reporter: Plamen Jeliazkov Priority: Minor Attachments: MAPREDUCE-2669.patch, MAPREDUCE-2669.patch, MAPREDUCE-2669.patch, MAPREDUCE-2669.patch, MAPREDUCE-2669.patch, MAPREDUCE-2669.patch, MAPREDUCE-2669.patch, MAPREDUCE-2669.patch, MAPREDUCE-2669.patch, mapreduce-new-examples-0.22.patch Original Estimate: 48h Remaining Estimate: 48h Looking to add some more examples such as Mean, Median, and Standard Deviation to the examples. I have some generic JUnit testcases as well. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2901) Build should fail sanely if protoc isn't on PATH
[ https://issues.apache.org/jira/browse/MAPREDUCE-2901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13095875#comment-13095875 ] Ravi Teja Ch N V commented on MAPREDUCE-2901: - I think we can we can check for protoc.exe file in the classpath, instead. Build should fail sanely if protoc isn't on PATH Key: MAPREDUCE-2901 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2901 Project: Hadoop Map/Reduce Issue Type: Bug Components: build Affects Versions: 0.23.0 Reporter: Vinod Kumar Vavilapalli It now fails [ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (generate-sources) on project hadoop-yarn-api: Command execution failed. Process exited with an error: 1(Exit value: 1) - [Help 1]. Which doesn't help much. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (MAPREDUCE-2925) job -status JOB_ID is giving continuously info message for completed jobs on the console
job -status JOB_ID is giving continuously info message for completed jobs on
the console
--
Key: MAPREDUCE-2925
URL: https://issues.apache.org/jira/browse/MAPREDUCE-2925
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: mrv2
Affects Versions: 0.23.0, 0.24.0
Reporter: Devaraj K
Assignee: Devaraj K
This below message is coming continuously on the console.
{code:xml}
11/09/02 16:00:00 INFO mapred.ClientServiceDelegate: Failed to contact AM for
job job_1314955256658_0009 Will retry..
11/09/02 16:00:00 INFO mapred.ClientServiceDelegate: Application state is
completed. Redirecting to job history server null
11/09/02 16:00:00 INFO mapred.ClientServiceDelegate: Failed to contact AM for
job job_1314955256658_0009 Will retry..
11/09/02 16:00:00 INFO mapred.ClientServiceDelegate: Application state is
completed. Redirecting to job history server null
{code}
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2735) MR279: finished applications should be added to an application summary log
[ https://issues.apache.org/jira/browse/MAPREDUCE-2735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13095946#comment-13095946 ] Hudson commented on MAPREDUCE-2735: --- Integrated in Hadoop-Hdfs-trunk #780 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/780/]) MAPREDUCE-2735. Add an applications summary log to ResourceManager. Contributed by Thomas Graves. acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1164301 Files : * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/conf/log4j.properties * /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMAppManager.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/MockRMApp.java MR279: finished applications should be added to an application summary log -- Key: MAPREDUCE-2735 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2735 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2 Reporter: Thomas Graves Assignee: Thomas Graves Fix For: 0.23.0 Attachments: MAPREDUCE-2735-v2.patch, MAPREDUCE-2735.patch When an application finishes it should be added to an application summary log for historical purposes. jira MAPREDUCE-2649 is going to start purging applications from RM when certain limits are hit which makes this more critical. We also need to save the information early enough after the app finishes so we don't lose the info if the RM does get restarted. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2756) JobControl can drop jobs if an error occurs
[ https://issues.apache.org/jira/browse/MAPREDUCE-2756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13095948#comment-13095948 ] Hudson commented on MAPREDUCE-2756: --- Integrated in Hadoop-Hdfs-trunk #780 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/780/]) MAPREDUCE-2756. Better error handling in JobControl for failed jobs. Contributed by Robert Evans. acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1164255 Files : * /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/lib/jobcontrol/ControlledJob.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/lib/jobcontrol/JobControl.java * /hadoop/common/trunk/hadoop-mapreduce-project/src/test/unit/org/apache/hadoop/mapreduce/lib/jobcontrol/TestMapReduceJobControlWithMocks.java JobControl can drop jobs if an error occurs --- Key: MAPREDUCE-2756 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2756 Project: Hadoop Map/Reduce Issue Type: Bug Components: client, mrv2 Affects Versions: 0.23.0 Reporter: Robert Joseph Evans Assignee: Robert Joseph Evans Priority: Minor Fix For: 0.23.0 Attachments: MR-2756-V1.patch, MR-2756-trunk-v2.patch, MR-2756-trunk-v3.patch If you run a pig job with UDFs that has not been recompiled for MRV2. There are situations where pig will fail with an error message stating that Hadoop failed and did not give a reason. There is even the possibility of deadlock if an Error is thrown and the JobControl thread dies. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2735) MR279: finished applications should be added to an application summary log
[ https://issues.apache.org/jira/browse/MAPREDUCE-2735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13095958#comment-13095958 ] Hudson commented on MAPREDUCE-2735: --- Integrated in Hadoop-Mapreduce-trunk #804 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/804/]) MAPREDUCE-2735. Add an applications summary log to ResourceManager. Contributed by Thomas Graves. acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1164301 Files : * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/conf/log4j.properties * /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMAppManager.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/MockRMApp.java MR279: finished applications should be added to an application summary log -- Key: MAPREDUCE-2735 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2735 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2 Reporter: Thomas Graves Assignee: Thomas Graves Fix For: 0.23.0 Attachments: MAPREDUCE-2735-v2.patch, MAPREDUCE-2735.patch When an application finishes it should be added to an application summary log for historical purposes. jira MAPREDUCE-2649 is going to start purging applications from RM when certain limits are hit which makes this more critical. We also need to save the information early enough after the app finishes so we don't lose the info if the RM does get restarted. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2687) Non superusers unable to launch apps in both secure and non-secure cluster
[
https://issues.apache.org/jira/browse/MAPREDUCE-2687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinod Kumar Vavilapalli updated MAPREDUCE-2687:
---
Description: Apps of non superuser fail to succeed in both secure and
non-secure environment. Only the superuser(i.e. one who started/owns the mrv2
cluster) is able to launch apps successfully. However, when a normal user
submits a job, the job fails. (was: Apps of non superuser fail to succeed in a
non-secure environment. Only the superuser(i.e. one who started/owns the mrv2
cluster) is able to launch apps successfully. However, when a normal user
submits a job, the job fails.)
Priority: Blocker (was: Major)
Summary: Non superusers unable to launch apps in both secure and
non-secure cluster (was: Non superusers unable to launch apps in a non-secure
cluster)
[~karams] found another bug but in secure mode which I tracked down to be just
another manifestation of this bug.
{code}
2011-08-30 15:22:55,997 INFO
org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container:
Container container_1314717753121_0001_01_01 transitioned from LOCALIZING
to LOCALIZED
2011-08-30 15:22:56,007 WARN
org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext: Disk Error
Exception: org.apache.hadoop.util.DiskChecker$DiskErrorException: directory is
not writable: /tmp/hadoop/var/log/mapred/application_1314717753121_0001
at org.apache.hadoop.util.DiskChecker.checkDir(DiskChecker.java:99)
at
org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.createPath(LocalDirAllocator.java:260)
at
org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathForWrite(LocalDirAllocator.java:327)
at
org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:132)
at
org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:101)
at
org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:61)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:619)
(4 times)
2011-08-30 15:22:56,009 WARN
org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch:
Failed to launch container
org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find any valid
local directory for
application_1314717753121_0001/container_1314717753121_0001_01_01
at
org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathForWrite(LocalDirAllocator.java:350)
at
org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:132)
at
org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:101)
at
org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:61)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:619)
2011-08-30 15:22:56,010 INFO
org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container:
Processing container_1314717753121_0001_01_01 of type
CONTAINER_EXITED_WITH_FAILURE
{code}
Updating title, description and upping it to a blocker.
Non superusers unable to launch apps in both secure and non-secure cluster
--
Key: MAPREDUCE-2687
URL: https://issues.apache.org/jira/browse/MAPREDUCE-2687
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: mrv2
Affects Versions: 0.23.0
Reporter: Ramya Sunil
Assignee: Mahadev konar
Priority: Blocker
Fix For: 0.23.0
Attachments: MAREDUCE-2687.patch
Apps of non superuser fail to succeed in both secure and non-secure
environment. Only the superuser(i.e. one who started/owns the mrv2 cluster)
is able to launch apps successfully. However, when a normal user submits a
job, the job fails.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2901) Build should fail sanely if protoc isn't on PATH
[ https://issues.apache.org/jira/browse/MAPREDUCE-2901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13095981#comment-13095981 ] Vinod Kumar Vavilapalli commented on MAPREDUCE-2901: bq. Does that mean that on my Ubuntu machine I should uninstall the deb packages listed in my previous comment and configure/make/install from scratch? Yes Joep, that is what I had to do on my Ubuntu box. Watch out, the compilation of the proto takes quite some time. Also, can you please paste the error you got with the 2.3 version? I'd like to get it added to the wiki page. Thanks! Build should fail sanely if protoc isn't on PATH Key: MAPREDUCE-2901 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2901 Project: Hadoop Map/Reduce Issue Type: Bug Components: build Affects Versions: 0.23.0 Reporter: Vinod Kumar Vavilapalli It now fails [ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (generate-sources) on project hadoop-yarn-api: Command execution failed. Process exited with an error: 1(Exit value: 1) - [Help 1]. Which doesn't help much. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2745) [MR-279] NM UI should get a read-only view instead of the actual NMContext
[
https://issues.apache.org/jira/browse/MAPREDUCE-2745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13096004#comment-13096004
]
Vinod Kumar Vavilapalli commented on MAPREDUCE-2745:
Looked at the patch.
While I understand the intention, I think Immutable-records are going to be a
maintenance nightmare.
We can instead simply return clones to the webUI - a copy of the maps should be
enough. If you are willing to go the full distance, you could supply the clones
for all those objects which you wrote Immutable versions for - ApplicationId,
Container, Application, LocalResource etc. You can see
{{BuilderUtils.clone(Container c)}} for example.
[MR-279] NM UI should get a read-only view instead of the actual NMContext
---
Key: MAPREDUCE-2745
URL: https://issues.apache.org/jira/browse/MAPREDUCE-2745
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: mrv2
Affects Versions: 0.23.0
Reporter: Vinod Kumar Vavilapalli
Assignee: Anupam Seth
Labels: newbie
Fix For: 0.23.0
Attachments: MAPREDUCE-2745-branch-0_23.patch
NMContext is modifiable, the UI should only get read-only access. Just like
the AM web-ui.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2749) [MR-279] NM registers with RM even before it starts various servers
[ https://issues.apache.org/jira/browse/MAPREDUCE-2749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated MAPREDUCE-2749: - Attachment: MAPREDUCE-2749.patch [MR-279] NM registers with RM even before it starts various servers --- Key: MAPREDUCE-2749 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2749 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2 Affects Versions: 0.23.0 Reporter: Vinod Kumar Vavilapalli Assignee: Thomas Graves Fix For: 0.23.0 Attachments: MAPREDUCE-2749.patch In case NM eventually fails to start the ContainerManager server because of say a port clash, RM will have to wait for expiry to detect the NM crash. It is desirable to make NM register with RM only after it can start all of its components successfully. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2749) [MR-279] NM registers with RM even before it starts various servers
[ https://issues.apache.org/jira/browse/MAPREDUCE-2749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13096016#comment-13096016 ] Thomas Graves commented on MAPREDUCE-2749: -- Steps to reproduce original issue: on single node cluster: - configure nm to be use same port as rm. (or another port that is already in use) - start rm and nm - view RM node webui (or logs) and see that the nm is registered - After node timeout RM expires the node (default value is 60) [MR-279] NM registers with RM even before it starts various servers --- Key: MAPREDUCE-2749 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2749 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2 Affects Versions: 0.23.0 Reporter: Vinod Kumar Vavilapalli Assignee: Thomas Graves Fix For: 0.23.0 Attachments: MAPREDUCE-2749.patch In case NM eventually fails to start the ContainerManager server because of say a port clash, RM will have to wait for expiry to detect the NM crash. It is desirable to make NM register with RM only after it can start all of its components successfully. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2716) MR279: MRReliabilityTest job fails because of missing job-file.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13096027#comment-13096027 ] Jeffrey Naisbitt commented on MAPREDUCE-2716: - Yeah, it looks like the user is not actually set in the application report (I'm trying to use it in the getProxy() method in ClientServiceDelegate). MR279: MRReliabilityTest job fails because of missing job-file. --- Key: MAPREDUCE-2716 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2716 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2 Affects Versions: 0.23.0 Reporter: Jeffrey Naisbitt Assignee: Jeffrey Naisbitt Fix For: 0.23.0 Attachments: MAPREDUCE-2716-v2.patch, MAPREDUCE-2716-v3.patch, MAPREDUCE-2716-v4.patch, MAPREDUCE-2716-v5.patch, MAPREDUCE-2716-v6.patch, MAPREDUCE-2716-v7.patch, MAPREDUCE-2716.patch The ApplicationReport should have the jobFile (e.g. hdfs://localhost:9000/tmp/hadoop-USER/mapred/staging/USER/.staging/job_201107121640_0001/job.xml) Without it, jobs such as MRReliabilityTest fail with the following error (caused by the fact that jobFile is hardcoded to in TypeConverter.java): e.g. java.lang.IllegalArgumentException: Can not create a Path from an empty string at org.apache.hadoop.fs.Path.checkPathArg(Path.java:88) at org.apache.hadoop.fs.Path.init(Path.java:96) at org.apache.hadoop.mapred.JobConf.init(JobConf.java:445) at org.apache.hadoop.mapreduce.Cluster.getJobs(Cluster.java:104) at org.apache.hadoop.mapreduce.Cluster.getAllJobs(Cluster.java:218) at org.apache.hadoop.mapred.JobClient.getAllJobs(JobClient.java:757) at org.apache.hadoop.mapred.JobClient.jobsToComplete(JobClient.java:741) at org.apache.hadoop.mapred.ReliabilityTest.runTest(ReliabilityTest.java:219) at org.apache.hadoop.mapred.ReliabilityTest.runSleepJobTest(ReliabilityTest.java:133) at org.apache.hadoop.mapred.ReliabilityTest.run(ReliabilityTest.java:116) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69) at org.apache.hadoop.mapred.ReliabilityTest.main(ReliabilityTest.java:504) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:72) at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:144) at org.apache.hadoop.test.MapredTestDriver.run(MapredTestDriver.java:111) at org.apache.hadoop.test.MapredTestDriver.main(MapredTestDriver.java:118) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.util.RunJar.main(RunJar.java:192) -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2864) Renaming of configuration property names in yarn
[ https://issues.apache.org/jira/browse/MAPREDUCE-2864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13096039#comment-13096039 ] Robert Joseph Evans commented on MAPREDUCE-2864: I went through all of the findbugs warnings in YARN, and none of them have anything to do with the changes I have made. I am not sure why findbugs is complaining that these issues are new. Could someone please commit this sooner rather then later. It has a big impact on a number of files and I will have to keep upmerging the patch if it does not go in quickly. Also as it goes in please e-mail the dev list to indicate that the config values have changed and give a reference to the script to update them. Renaming of configuration property names in yarn Key: MAPREDUCE-2864 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2864 Project: Hadoop Map/Reduce Issue Type: Improvement Components: jobhistoryserver, mrv2, nodemanager, resourcemanager Affects Versions: 0.23.0, 0.24.0 Reporter: Robert Joseph Evans Assignee: Robert Joseph Evans Fix For: 0.23.0, 0.24.0 Attachments: MR-2864-v1.patch, MR-2864-v2.patch, MR-2864-v3.patch, MR-2864-v4.patch, update.pl, yarnConfigs.csv Now that YARN has been put in to trunk we should do something similar to MAPREDUCE-849. We should go back and look at all of the configurations that have been added in and rename them as needed to be consistent and subdivided by component. # We should use all lowercase in the config names. e.g., we should use appsmanager instead of appsManager etc. # history server config names should be prefixed with mapreduce instead of yarn. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2716) MR279: MRReliabilityTest job fails because of missing job-file.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeffrey Naisbitt updated MAPREDUCE-2716: Status: Open (was: Patch Available) MR279: MRReliabilityTest job fails because of missing job-file. --- Key: MAPREDUCE-2716 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2716 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2 Affects Versions: 0.23.0 Reporter: Jeffrey Naisbitt Assignee: Jeffrey Naisbitt Fix For: 0.23.0 Attachments: MAPREDUCE-2716-v2.patch, MAPREDUCE-2716-v3.patch, MAPREDUCE-2716-v4.patch, MAPREDUCE-2716-v5.patch, MAPREDUCE-2716-v6.patch, MAPREDUCE-2716-v7.patch, MAPREDUCE-2716.patch The ApplicationReport should have the jobFile (e.g. hdfs://localhost:9000/tmp/hadoop-USER/mapred/staging/USER/.staging/job_201107121640_0001/job.xml) Without it, jobs such as MRReliabilityTest fail with the following error (caused by the fact that jobFile is hardcoded to in TypeConverter.java): e.g. java.lang.IllegalArgumentException: Can not create a Path from an empty string at org.apache.hadoop.fs.Path.checkPathArg(Path.java:88) at org.apache.hadoop.fs.Path.init(Path.java:96) at org.apache.hadoop.mapred.JobConf.init(JobConf.java:445) at org.apache.hadoop.mapreduce.Cluster.getJobs(Cluster.java:104) at org.apache.hadoop.mapreduce.Cluster.getAllJobs(Cluster.java:218) at org.apache.hadoop.mapred.JobClient.getAllJobs(JobClient.java:757) at org.apache.hadoop.mapred.JobClient.jobsToComplete(JobClient.java:741) at org.apache.hadoop.mapred.ReliabilityTest.runTest(ReliabilityTest.java:219) at org.apache.hadoop.mapred.ReliabilityTest.runSleepJobTest(ReliabilityTest.java:133) at org.apache.hadoop.mapred.ReliabilityTest.run(ReliabilityTest.java:116) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69) at org.apache.hadoop.mapred.ReliabilityTest.main(ReliabilityTest.java:504) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:72) at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:144) at org.apache.hadoop.test.MapredTestDriver.run(MapredTestDriver.java:111) at org.apache.hadoop.test.MapredTestDriver.main(MapredTestDriver.java:118) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.util.RunJar.main(RunJar.java:192) -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2716) MR279: MRReliabilityTest job fails because of missing job-file.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeffrey Naisbitt updated MAPREDUCE-2716: Attachment: MAPREDUCE-2716-v8.patch v8 fixes the issue with TestClientRedirect's infinite loop and adds a null check to make future debugging easier and to prevent the loop in cases like this (where the application does not have the user set). MR279: MRReliabilityTest job fails because of missing job-file. --- Key: MAPREDUCE-2716 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2716 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2 Affects Versions: 0.23.0 Reporter: Jeffrey Naisbitt Assignee: Jeffrey Naisbitt Fix For: 0.23.0 Attachments: MAPREDUCE-2716-v2.patch, MAPREDUCE-2716-v3.patch, MAPREDUCE-2716-v4.patch, MAPREDUCE-2716-v5.patch, MAPREDUCE-2716-v6.patch, MAPREDUCE-2716-v7.patch, MAPREDUCE-2716-v8.patch, MAPREDUCE-2716.patch The ApplicationReport should have the jobFile (e.g. hdfs://localhost:9000/tmp/hadoop-USER/mapred/staging/USER/.staging/job_201107121640_0001/job.xml) Without it, jobs such as MRReliabilityTest fail with the following error (caused by the fact that jobFile is hardcoded to in TypeConverter.java): e.g. java.lang.IllegalArgumentException: Can not create a Path from an empty string at org.apache.hadoop.fs.Path.checkPathArg(Path.java:88) at org.apache.hadoop.fs.Path.init(Path.java:96) at org.apache.hadoop.mapred.JobConf.init(JobConf.java:445) at org.apache.hadoop.mapreduce.Cluster.getJobs(Cluster.java:104) at org.apache.hadoop.mapreduce.Cluster.getAllJobs(Cluster.java:218) at org.apache.hadoop.mapred.JobClient.getAllJobs(JobClient.java:757) at org.apache.hadoop.mapred.JobClient.jobsToComplete(JobClient.java:741) at org.apache.hadoop.mapred.ReliabilityTest.runTest(ReliabilityTest.java:219) at org.apache.hadoop.mapred.ReliabilityTest.runSleepJobTest(ReliabilityTest.java:133) at org.apache.hadoop.mapred.ReliabilityTest.run(ReliabilityTest.java:116) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69) at org.apache.hadoop.mapred.ReliabilityTest.main(ReliabilityTest.java:504) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:72) at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:144) at org.apache.hadoop.test.MapredTestDriver.run(MapredTestDriver.java:111) at org.apache.hadoop.test.MapredTestDriver.main(MapredTestDriver.java:118) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.util.RunJar.main(RunJar.java:192) -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2716) MR279: MRReliabilityTest job fails because of missing job-file.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeffrey Naisbitt updated MAPREDUCE-2716: Status: Patch Available (was: Open) MR279: MRReliabilityTest job fails because of missing job-file. --- Key: MAPREDUCE-2716 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2716 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2 Affects Versions: 0.23.0 Reporter: Jeffrey Naisbitt Assignee: Jeffrey Naisbitt Fix For: 0.23.0 Attachments: MAPREDUCE-2716-v2.patch, MAPREDUCE-2716-v3.patch, MAPREDUCE-2716-v4.patch, MAPREDUCE-2716-v5.patch, MAPREDUCE-2716-v6.patch, MAPREDUCE-2716-v7.patch, MAPREDUCE-2716-v8.patch, MAPREDUCE-2716.patch The ApplicationReport should have the jobFile (e.g. hdfs://localhost:9000/tmp/hadoop-USER/mapred/staging/USER/.staging/job_201107121640_0001/job.xml) Without it, jobs such as MRReliabilityTest fail with the following error (caused by the fact that jobFile is hardcoded to in TypeConverter.java): e.g. java.lang.IllegalArgumentException: Can not create a Path from an empty string at org.apache.hadoop.fs.Path.checkPathArg(Path.java:88) at org.apache.hadoop.fs.Path.init(Path.java:96) at org.apache.hadoop.mapred.JobConf.init(JobConf.java:445) at org.apache.hadoop.mapreduce.Cluster.getJobs(Cluster.java:104) at org.apache.hadoop.mapreduce.Cluster.getAllJobs(Cluster.java:218) at org.apache.hadoop.mapred.JobClient.getAllJobs(JobClient.java:757) at org.apache.hadoop.mapred.JobClient.jobsToComplete(JobClient.java:741) at org.apache.hadoop.mapred.ReliabilityTest.runTest(ReliabilityTest.java:219) at org.apache.hadoop.mapred.ReliabilityTest.runSleepJobTest(ReliabilityTest.java:133) at org.apache.hadoop.mapred.ReliabilityTest.run(ReliabilityTest.java:116) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69) at org.apache.hadoop.mapred.ReliabilityTest.main(ReliabilityTest.java:504) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:72) at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:144) at org.apache.hadoop.test.MapredTestDriver.run(MapredTestDriver.java:111) at org.apache.hadoop.test.MapredTestDriver.main(MapredTestDriver.java:118) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.util.RunJar.main(RunJar.java:192) -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2767) Remove Linux task-controller from 0.22 branch
[ https://issues.apache.org/jira/browse/MAPREDUCE-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Milind Bhandarkar updated MAPREDUCE-2767: - Attachment: (was: MR2767-trunk.patch) Remove Linux task-controller from 0.22 branch - Key: MAPREDUCE-2767 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2767 Project: Hadoop Map/Reduce Issue Type: Bug Components: security Affects Versions: 0.22.0, 0.23.0, 0.24.0 Reporter: Milind Bhandarkar Assignee: Milind Bhandarkar Priority: Blocker Fix For: 0.22.0, 0.23.0, 0.24.0 Attachments: MR2767-22.patch, MR2767-23.patch, MR2767-trunk.patch, TEST-org.apache.hadoop.mapred.TestMiniMRChildTask.txt, testlog.txt There's a potential security hole in the task-controller as it stands. Based on the discussion on general@, removing task-controller from the 0.22 branch will pave way for 0.22.0 release. (This was done for the 0.21.0 release as well: see MAPREDUCE-2014.) We can roll a 0.22.1 release with the task-controller when it is fixed. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2767) Remove Linux task-controller from 0.22 branch
[ https://issues.apache.org/jira/browse/MAPREDUCE-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Milind Bhandarkar updated MAPREDUCE-2767: - Status: Open (was: Patch Available) Cancelling, and re-making patch-available. Remove Linux task-controller from 0.22 branch - Key: MAPREDUCE-2767 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2767 Project: Hadoop Map/Reduce Issue Type: Bug Components: security Affects Versions: 0.22.0, 0.23.0, 0.24.0 Reporter: Milind Bhandarkar Assignee: Milind Bhandarkar Priority: Blocker Fix For: 0.22.0, 0.23.0, 0.24.0 Attachments: MR2767-22.patch, MR2767-23.patch, MR2767-trunk.patch, TEST-org.apache.hadoop.mapred.TestMiniMRChildTask.txt, testlog.txt There's a potential security hole in the task-controller as it stands. Based on the discussion on general@, removing task-controller from the 0.22 branch will pave way for 0.22.0 release. (This was done for the 0.21.0 release as well: see MAPREDUCE-2014.) We can roll a 0.22.1 release with the task-controller when it is fixed. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2767) Remove Linux task-controller from 0.22 branch
[ https://issues.apache.org/jira/browse/MAPREDUCE-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Milind Bhandarkar updated MAPREDUCE-2767: - Attachment: MR2767-trunk.patch Removing conflict in trunk due to recent commits. Re-did patch for trunk. Remove Linux task-controller from 0.22 branch - Key: MAPREDUCE-2767 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2767 Project: Hadoop Map/Reduce Issue Type: Bug Components: security Affects Versions: 0.22.0, 0.23.0, 0.24.0 Reporter: Milind Bhandarkar Assignee: Milind Bhandarkar Priority: Blocker Fix For: 0.22.0, 0.23.0, 0.24.0 Attachments: MR2767-22.patch, MR2767-23.patch, MR2767-trunk.patch, TEST-org.apache.hadoop.mapred.TestMiniMRChildTask.txt, testlog.txt There's a potential security hole in the task-controller as it stands. Based on the discussion on general@, removing task-controller from the 0.22 branch will pave way for 0.22.0 release. (This was done for the 0.21.0 release as well: see MAPREDUCE-2014.) We can roll a 0.22.1 release with the task-controller when it is fixed. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2749) [MR-279] NM registers with RM even before it starts various servers
[ https://issues.apache.org/jira/browse/MAPREDUCE-2749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated MAPREDUCE-2749: - Attachment: MAPREDUCE-2749-v2.patch added unit test [MR-279] NM registers with RM even before it starts various servers --- Key: MAPREDUCE-2749 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2749 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2 Affects Versions: 0.23.0 Reporter: Vinod Kumar Vavilapalli Assignee: Thomas Graves Fix For: 0.23.0 Attachments: MAPREDUCE-2749-v2.patch, MAPREDUCE-2749.patch In case NM eventually fails to start the ContainerManager server because of say a port clash, RM will have to wait for expiry to detect the NM crash. It is desirable to make NM register with RM only after it can start all of its components successfully. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2767) Remove Linux task-controller from 0.22 branch
[ https://issues.apache.org/jira/browse/MAPREDUCE-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Milind Bhandarkar updated MAPREDUCE-2767: - Status: Patch Available (was: Open) Making patch available for trunk. Remove Linux task-controller from 0.22 branch - Key: MAPREDUCE-2767 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2767 Project: Hadoop Map/Reduce Issue Type: Bug Components: security Affects Versions: 0.22.0, 0.23.0, 0.24.0 Reporter: Milind Bhandarkar Assignee: Milind Bhandarkar Priority: Blocker Fix For: 0.22.0, 0.23.0, 0.24.0 Attachments: MR2767-22.patch, MR2767-23.patch, MR2767-trunk.patch, TEST-org.apache.hadoop.mapred.TestMiniMRChildTask.txt, testlog.txt There's a potential security hole in the task-controller as it stands. Based on the discussion on general@, removing task-controller from the 0.22 branch will pave way for 0.22.0 release. (This was done for the 0.21.0 release as well: see MAPREDUCE-2014.) We can roll a 0.22.1 release with the task-controller when it is fixed. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2749) [MR-279] NM registers with RM even before it starts various servers
[ https://issues.apache.org/jira/browse/MAPREDUCE-2749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13096068#comment-13096068 ] Thomas Graves commented on MAPREDUCE-2749: -- Manually tested with and without security. Verified jobs worked in both cases. Test procedure for the error case is the same as steps to reproduce above, now however the NM will NOT show up on RM node webui if nm doesn't start properly. [MR-279] NM registers with RM even before it starts various servers --- Key: MAPREDUCE-2749 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2749 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2 Affects Versions: 0.23.0 Reporter: Vinod Kumar Vavilapalli Assignee: Thomas Graves Fix For: 0.23.0 Attachments: MAPREDUCE-2749-v2.patch, MAPREDUCE-2749.patch In case NM eventually fails to start the ContainerManager server because of say a port clash, RM will have to wait for expiry to detect the NM crash. It is desirable to make NM register with RM only after it can start all of its components successfully. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2749) [MR-279] NM registers with RM even before it starts various servers
[ https://issues.apache.org/jira/browse/MAPREDUCE-2749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated MAPREDUCE-2749: - Status: Patch Available (was: Open) [MR-279] NM registers with RM even before it starts various servers --- Key: MAPREDUCE-2749 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2749 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2 Affects Versions: 0.23.0 Reporter: Vinod Kumar Vavilapalli Assignee: Thomas Graves Fix For: 0.23.0 Attachments: MAPREDUCE-2749-v2.patch, MAPREDUCE-2749.patch In case NM eventually fails to start the ContainerManager server because of say a port clash, RM will have to wait for expiry to detect the NM crash. It is desirable to make NM register with RM only after it can start all of its components successfully. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2413) TaskTracker should handle disk failures at both startup and runtime
[ https://issues.apache.org/jira/browse/MAPREDUCE-2413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13096076#comment-13096076 ] Eli Collins commented on MAPREDUCE-2413: Thanks for the update Bharath. Could you share the functional tests that your QA team wrote? How will other developers know whether they broke this feature? In your experiments, does a machine with only a single functioning disk warrant staying up? I suspect tasks on this machine will perform poorly. I suspect at Yahoo! you're using some configuration that blacklists a TT after X disk failures. If someone isn't using such a configuration their cluster will perform poorly. Did you guys test both the default and link task controllers? TaskTracker should handle disk failures at both startup and runtime --- Key: MAPREDUCE-2413 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2413 Project: Hadoop Map/Reduce Issue Type: Sub-task Components: task-controller, tasktracker Affects Versions: 0.20.204.0 Reporter: Bharath Mundlapudi Assignee: Ravi Gummadi Fix For: 0.20.204.0 Attachments: MR-2413.v0.1.patch, MR-2413.v0.2.patch, MR-2413.v0.3.patch, MR-2413.v0.patch At present, TaskTracker doesn't handle disk failures properly both at startup and runtime. (1) Currently TaskTracker doesn't come up if any of the mapred-local-dirs is on a bad disk. TaskTracker should ignore that particular mapred-local-dir and start up and use only the remaining good mapred-local-dirs. (2) If a disk goes bad while TaskTracker is running, currently TaskTracker doesn't do anything special. This results in either (a) TaskTracker continues to try to use that bad disk and this results in lots of task failures and possibly job failures(because of multiple TTs having bad disks) and eventually these TTs getting graylisted for all jobs. And this needs manual restart of TT with modified configuration of mapred-local-dirs avoiding the bad disk. OR (b) Health check script identifying the disk as bad and the TT gets blacklisted. And this also needs manual restart of TT with modified configuration of mapred-local-dirs avoiding the bad disk. This JIRA is to make TaskTracker more fault-tolerant to disk failures solving (1) and (2). i.e. TT should start even if at least one of the mapred-local-dirs is on a good disk and TT should adjust its in-memory list of mapred-local-dirs and avoid using bad mapred-local-dirs. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2767) Remove Linux task-controller from 0.22 branch
[ https://issues.apache.org/jira/browse/MAPREDUCE-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13096082#comment-13096082 ] Hadoop QA commented on MAPREDUCE-2767: -- -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12492764/MR2767-trunk.patch against trunk revision . +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 46 new or modified tests. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. -1 findbugs. The patch appears to introduce 8 new Findbugs (version 1.3.9) warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. +1 core tests. The patch passed unit tests in hadoop-mapreduce-project. +1 contrib tests. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/587//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/587//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-hs.html Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/587//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-shuffle.html Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/587//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-common.html Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/587//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-app.html Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/587//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-jobclient.html Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/587//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-core.html Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/587//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-server-common.html Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/587//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-server-resourcemanager.html Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/587//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-server-nodemanager.html Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/587//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-common.html Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/587//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-api.html Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/587//console This message is automatically generated. Remove Linux task-controller from 0.22 branch - Key: MAPREDUCE-2767 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2767 Project: Hadoop Map/Reduce Issue Type: Bug Components: security Affects Versions: 0.22.0, 0.23.0, 0.24.0 Reporter: Milind Bhandarkar Assignee: Milind Bhandarkar Priority: Blocker Fix For: 0.22.0, 0.23.0, 0.24.0 Attachments: MR2767-22.patch, MR2767-23.patch, MR2767-trunk.patch, TEST-org.apache.hadoop.mapred.TestMiniMRChildTask.txt, testlog.txt There's a potential security hole in the task-controller as it stands. Based on the discussion on general@, removing task-controller from the 0.22 branch will pave way for 0.22.0 release. (This was done for the 0.21.0 release as well: see MAPREDUCE-2014.) We can roll a 0.22.1 release with the task-controller when it is fixed. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2716) MR279: MRReliabilityTest job fails because of missing job-file.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13096081#comment-13096081 ] Hadoop QA commented on MAPREDUCE-2716: -- -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12492763/MAPREDUCE-2716-v8.patch against trunk revision . +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 9 new or modified tests. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. -1 findbugs. The patch appears to introduce 8 new Findbugs (version 1.3.9) warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. +1 core tests. The patch passed unit tests in hadoop-mapreduce-project. +1 contrib tests. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/588//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/588//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-common.html Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/588//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-api.html Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/588//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-server-common.html Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/588//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-server-resourcemanager.html Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/588//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-server-nodemanager.html Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/588//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-app.html Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/588//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-core.html Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/588//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-common.html Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/588//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-hs.html Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/588//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-shuffle.html Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/588//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-jobclient.html Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/588//console This message is automatically generated. MR279: MRReliabilityTest job fails because of missing job-file. --- Key: MAPREDUCE-2716 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2716 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2 Affects Versions: 0.23.0 Reporter: Jeffrey Naisbitt Assignee: Jeffrey Naisbitt Fix For: 0.23.0 Attachments: MAPREDUCE-2716-v2.patch, MAPREDUCE-2716-v3.patch, MAPREDUCE-2716-v4.patch, MAPREDUCE-2716-v5.patch, MAPREDUCE-2716-v6.patch, MAPREDUCE-2716-v7.patch, MAPREDUCE-2716-v8.patch, MAPREDUCE-2716.patch The ApplicationReport should have the jobFile (e.g. hdfs://localhost:9000/tmp/hadoop-USER/mapred/staging/USER/.staging/job_201107121640_0001/job.xml) Without it, jobs such as MRReliabilityTest fail with the following error (caused by the fact that jobFile is hardcoded to in TypeConverter.java): e.g. java.lang.IllegalArgumentException: Can not create a Path from an empty string at org.apache.hadoop.fs.Path.checkPathArg(Path.java:88) at org.apache.hadoop.fs.Path.init(Path.java:96) at org.apache.hadoop.mapred.JobConf.init(JobConf.java:445) at org.apache.hadoop.mapreduce.Cluster.getJobs(Cluster.java:104) at org.apache.hadoop.mapreduce.Cluster.getAllJobs(Cluster.java:218) at org.apache.hadoop.mapred.JobClient.getAllJobs(JobClient.java:757) at org.apache.hadoop.mapred.JobClient.jobsToComplete(JobClient.java:741) at org.apache.hadoop.mapred.ReliabilityTest.runTest(ReliabilityTest.java:219) at org.apache.hadoop.mapred.ReliabilityTest.runSleepJobTest(ReliabilityTest.java:133) at org.apache.hadoop.mapred.ReliabilityTest.run(ReliabilityTest.java:116)
[jira] [Commented] (MAPREDUCE-2749) [MR-279] NM registers with RM even before it starts various servers
[ https://issues.apache.org/jira/browse/MAPREDUCE-2749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13096090#comment-13096090 ] Hadoop QA commented on MAPREDUCE-2749: -- -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12492765/MAPREDUCE-2749-v2.patch against trunk revision . +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 3 new or modified tests. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. -1 findbugs. The patch appears to introduce 8 new Findbugs (version 1.3.9) warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. +1 core tests. The patch passed unit tests in hadoop-mapreduce-project. +1 contrib tests. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/589//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/589//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-common.html Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/589//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-hs.html Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/589//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-core.html Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/589//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-app.html Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/589//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-shuffle.html Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/589//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-jobclient.html Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/589//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-api.html Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/589//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-server-nodemanager.html Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/589//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-server-resourcemanager.html Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/589//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-server-common.html Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/589//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-common.html Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/589//console This message is automatically generated. [MR-279] NM registers with RM even before it starts various servers --- Key: MAPREDUCE-2749 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2749 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2 Affects Versions: 0.23.0 Reporter: Vinod Kumar Vavilapalli Assignee: Thomas Graves Fix For: 0.23.0 Attachments: MAPREDUCE-2749-v2.patch, MAPREDUCE-2749.patch In case NM eventually fails to start the ContainerManager server because of say a port clash, RM will have to wait for expiry to detect the NM crash. It is desirable to make NM register with RM only after it can start all of its components successfully. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (MAPREDUCE-2926) 500 Error in ResourceManager UI
500 Error in ResourceManager UI
---
Key: MAPREDUCE-2926
URL: https://issues.apache.org/jira/browse/MAPREDUCE-2926
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: mrv2
Affects Versions: 0.23.0, 0.24.0
Reporter: Robert Joseph Evans
Assignee: Robert Joseph Evans
Fix For: 0.23.0, 0.24.0
When accessing the resource manager UI the following is returned
{noformat}
Problem accessing /. Reason:
org.codehaus.jackson.type.JavaType.init(Ljava/lang/Class;)V
Caused by:
java.lang.NoSuchMethodError:
org.codehaus.jackson.type.JavaType.init(Ljava/lang/Class;)V
at org.codehaus.jackson.map.type.TypeBase.init(TypeBase.java:15)
at org.codehaus.jackson.map.type.SimpleType.init(SimpleType.java:45)
at org.codehaus.jackson.map.type.SimpleType.init(SimpleType.java:40)
at
org.codehaus.jackson.map.type.TypeBindings.clinit(TypeBindings.java:20)
at
org.codehaus.jackson.map.type.TypeFactory._fromType(TypeFactory.java:530)
at org.codehaus.jackson.map.type.TypeFactory.type(TypeFactory.java:63)
at org.codehaus.jackson.map.ObjectMapper.clinit(ObjectMapper.java:179)
at org.apache.hadoop.yarn.webapp.Controller.clinit(Controller.java:43)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
at
com.google.inject.DefaultConstructionProxyFactory$2.newInstance(DefaultConstructionProxyFactory.java:81)
at
com.google.inject.ConstructorInjector.construct(ConstructorInjector.java:85)
at
com.google.inject.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:111)
at com.google.inject.InjectorImpl$4$1.call(InjectorImpl.java:758)
at com.google.inject.InjectorImpl.callInContext(InjectorImpl.java:804)
at com.google.inject.InjectorImpl$4.get(InjectorImpl.java:754)
at com.google.inject.InjectorImpl.getInstance(InjectorImpl.java:793)
at org.apache.hadoop.yarn.webapp.Dispatcher.service(Dispatcher.java:136)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
at
com.google.inject.servlet.ServletDefinition.doService(ServletDefinition.java:216)
at
com.google.inject.servlet.ServletDefinition.service(ServletDefinition.java:141)
at
com.google.inject.servlet.ManagedServletPipeline.service(ManagedServletPipeline.java:93)
at
com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:63)
at
com.google.inject.servlet.ManagedFilterPipeline.dispatch(ManagedFilterPipeline.java:122)
at com.google.inject.servlet.GuiceFilter.doFilter(GuiceFilter.java:110)
at
org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
at
org.apache.hadoop.http.HttpServer$QuotingInputFilter.doFilter(HttpServer.java:892)
at
org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
at
org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399)
at
org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
at
org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
at
org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)
at
org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)
at
org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
at org.mortbay.jetty.Server.handle(Server.java:326)
at
org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
at
org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:928)
at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:549)
at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
at
org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:410)
at
org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
Powered by Jetty://
{noformat}
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2926) 500 Error in ResourceManager UI
[
https://issues.apache.org/jira/browse/MAPREDUCE-2926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13096106#comment-13096106
]
Robert Joseph Evans commented on MAPREDUCE-2926:
The issue appears to be related to different versions of Jackson in the
classpath. The API that is being called in for the 1.6 release of jackson, but
the API changed in 1.7, both of these appear as dependencies. in both mvn and
ivy.
500 Error in ResourceManager UI
---
Key: MAPREDUCE-2926
URL: https://issues.apache.org/jira/browse/MAPREDUCE-2926
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: mrv2
Affects Versions: 0.23.0, 0.24.0
Reporter: Robert Joseph Evans
Assignee: Robert Joseph Evans
Fix For: 0.23.0, 0.24.0
When accessing the resource manager UI the following is returned
{noformat}
Problem accessing /. Reason:
org.codehaus.jackson.type.JavaType.init(Ljava/lang/Class;)V
Caused by:
java.lang.NoSuchMethodError:
org.codehaus.jackson.type.JavaType.init(Ljava/lang/Class;)V
at org.codehaus.jackson.map.type.TypeBase.init(TypeBase.java:15)
at org.codehaus.jackson.map.type.SimpleType.init(SimpleType.java:45)
at org.codehaus.jackson.map.type.SimpleType.init(SimpleType.java:40)
at
org.codehaus.jackson.map.type.TypeBindings.clinit(TypeBindings.java:20)
at
org.codehaus.jackson.map.type.TypeFactory._fromType(TypeFactory.java:530)
at org.codehaus.jackson.map.type.TypeFactory.type(TypeFactory.java:63)
at org.codehaus.jackson.map.ObjectMapper.clinit(ObjectMapper.java:179)
at org.apache.hadoop.yarn.webapp.Controller.clinit(Controller.java:43)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
at
com.google.inject.DefaultConstructionProxyFactory$2.newInstance(DefaultConstructionProxyFactory.java:81)
at
com.google.inject.ConstructorInjector.construct(ConstructorInjector.java:85)
at
com.google.inject.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:111)
at com.google.inject.InjectorImpl$4$1.call(InjectorImpl.java:758)
at com.google.inject.InjectorImpl.callInContext(InjectorImpl.java:804)
at com.google.inject.InjectorImpl$4.get(InjectorImpl.java:754)
at com.google.inject.InjectorImpl.getInstance(InjectorImpl.java:793)
at org.apache.hadoop.yarn.webapp.Dispatcher.service(Dispatcher.java:136)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
at
com.google.inject.servlet.ServletDefinition.doService(ServletDefinition.java:216)
at
com.google.inject.servlet.ServletDefinition.service(ServletDefinition.java:141)
at
com.google.inject.servlet.ManagedServletPipeline.service(ManagedServletPipeline.java:93)
at
com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:63)
at
com.google.inject.servlet.ManagedFilterPipeline.dispatch(ManagedFilterPipeline.java:122)
at com.google.inject.servlet.GuiceFilter.doFilter(GuiceFilter.java:110)
at
org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
at
org.apache.hadoop.http.HttpServer$QuotingInputFilter.doFilter(HttpServer.java:892)
at
org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
at
org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399)
at
org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
at
org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
at
org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)
at
org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)
at
org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
at org.mortbay.jetty.Server.handle(Server.java:326)
at
org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
at
org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:928)
at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:549)
at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
at
[jira] [Commented] (MAPREDUCE-2767) Remove Linux task-controller from 0.22 branch
[ https://issues.apache.org/jira/browse/MAPREDUCE-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13096109#comment-13096109 ] Milind Bhandarkar commented on MAPREDUCE-2767: -- Re: FindBugs warnings. These are not new. In fact none of these directories (all in mrv2 code) have been touched by the patch. Remove Linux task-controller from 0.22 branch - Key: MAPREDUCE-2767 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2767 Project: Hadoop Map/Reduce Issue Type: Bug Components: security Affects Versions: 0.22.0, 0.23.0, 0.24.0 Reporter: Milind Bhandarkar Assignee: Milind Bhandarkar Priority: Blocker Fix For: 0.22.0, 0.23.0, 0.24.0 Attachments: MR2767-22.patch, MR2767-23.patch, MR2767-trunk.patch, TEST-org.apache.hadoop.mapred.TestMiniMRChildTask.txt, testlog.txt There's a potential security hole in the task-controller as it stands. Based on the discussion on general@, removing task-controller from the 0.22 branch will pave way for 0.22.0 release. (This was done for the 0.21.0 release as well: see MAPREDUCE-2014.) We can roll a 0.22.1 release with the task-controller when it is fixed. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2716) MR279: MRReliabilityTest job fails because of missing job-file.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13096113#comment-13096113 ] Jeffrey Naisbitt commented on MAPREDUCE-2716: - The findbugs warnings are still unrelated to this patch. MR279: MRReliabilityTest job fails because of missing job-file. --- Key: MAPREDUCE-2716 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2716 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2 Affects Versions: 0.23.0 Reporter: Jeffrey Naisbitt Assignee: Jeffrey Naisbitt Fix For: 0.23.0 Attachments: MAPREDUCE-2716-v2.patch, MAPREDUCE-2716-v3.patch, MAPREDUCE-2716-v4.patch, MAPREDUCE-2716-v5.patch, MAPREDUCE-2716-v6.patch, MAPREDUCE-2716-v7.patch, MAPREDUCE-2716-v8.patch, MAPREDUCE-2716.patch The ApplicationReport should have the jobFile (e.g. hdfs://localhost:9000/tmp/hadoop-USER/mapred/staging/USER/.staging/job_201107121640_0001/job.xml) Without it, jobs such as MRReliabilityTest fail with the following error (caused by the fact that jobFile is hardcoded to in TypeConverter.java): e.g. java.lang.IllegalArgumentException: Can not create a Path from an empty string at org.apache.hadoop.fs.Path.checkPathArg(Path.java:88) at org.apache.hadoop.fs.Path.init(Path.java:96) at org.apache.hadoop.mapred.JobConf.init(JobConf.java:445) at org.apache.hadoop.mapreduce.Cluster.getJobs(Cluster.java:104) at org.apache.hadoop.mapreduce.Cluster.getAllJobs(Cluster.java:218) at org.apache.hadoop.mapred.JobClient.getAllJobs(JobClient.java:757) at org.apache.hadoop.mapred.JobClient.jobsToComplete(JobClient.java:741) at org.apache.hadoop.mapred.ReliabilityTest.runTest(ReliabilityTest.java:219) at org.apache.hadoop.mapred.ReliabilityTest.runSleepJobTest(ReliabilityTest.java:133) at org.apache.hadoop.mapred.ReliabilityTest.run(ReliabilityTest.java:116) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69) at org.apache.hadoop.mapred.ReliabilityTest.main(ReliabilityTest.java:504) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:72) at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:144) at org.apache.hadoop.test.MapredTestDriver.run(MapredTestDriver.java:111) at org.apache.hadoop.test.MapredTestDriver.main(MapredTestDriver.java:118) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.util.RunJar.main(RunJar.java:192) -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2926) 500 Error in ResourceManager UI
[
https://issues.apache.org/jira/browse/MAPREDUCE-2926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13096128#comment-13096128
]
Robert Joseph Evans commented on MAPREDUCE-2926:
OK so here are the dependencies that include Jackson
{noformat}
hadoop-common
+- jersey-json:1.8
| +- jackson-core-asl:1.7.1
| +- jackson-jaxrs:1.7.1
| \- jackson-xc:1.7.1
+- jackson-mapper-asl:1.6.9
hadoop-hdfs
+- jersey-json:1.8
| +- jackson-core-asl:1.7.1
| +- jackson-jaxrs:1.7.1
| \- jackson-xc:1.7.1
+- jackson-mapper-asl:1.6.9
hadoop-yarn-api
+- avro:1.5.3
| +- jackson-mapper-asl:1.7.3
| \- jackson-core-asl:1.7.3
+- jersey-json:1.8
+- jackson-jaxrs:1.7.1
\- jackson-xc:1.7.1
hadoop-(yarn|mapreduce)*
+- avro:1.5.3
| +- jackson-mapper-asl:1.7.3
| \- jackson-core-asl:1.7.3
+- jersey-json:1.8
+- jackson-jaxrs:1.7.1
\- jackson-xc:1.7.1
{noformat}
500 Error in ResourceManager UI
---
Key: MAPREDUCE-2926
URL: https://issues.apache.org/jira/browse/MAPREDUCE-2926
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: mrv2
Affects Versions: 0.23.0, 0.24.0
Reporter: Robert Joseph Evans
Assignee: Robert Joseph Evans
Fix For: 0.23.0, 0.24.0
When accessing the resource manager UI the following is returned
{noformat}
Problem accessing /. Reason:
org.codehaus.jackson.type.JavaType.init(Ljava/lang/Class;)V
Caused by:
java.lang.NoSuchMethodError:
org.codehaus.jackson.type.JavaType.init(Ljava/lang/Class;)V
at org.codehaus.jackson.map.type.TypeBase.init(TypeBase.java:15)
at org.codehaus.jackson.map.type.SimpleType.init(SimpleType.java:45)
at org.codehaus.jackson.map.type.SimpleType.init(SimpleType.java:40)
at
org.codehaus.jackson.map.type.TypeBindings.clinit(TypeBindings.java:20)
at
org.codehaus.jackson.map.type.TypeFactory._fromType(TypeFactory.java:530)
at org.codehaus.jackson.map.type.TypeFactory.type(TypeFactory.java:63)
at org.codehaus.jackson.map.ObjectMapper.clinit(ObjectMapper.java:179)
at org.apache.hadoop.yarn.webapp.Controller.clinit(Controller.java:43)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
at
com.google.inject.DefaultConstructionProxyFactory$2.newInstance(DefaultConstructionProxyFactory.java:81)
at
com.google.inject.ConstructorInjector.construct(ConstructorInjector.java:85)
at
com.google.inject.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:111)
at com.google.inject.InjectorImpl$4$1.call(InjectorImpl.java:758)
at com.google.inject.InjectorImpl.callInContext(InjectorImpl.java:804)
at com.google.inject.InjectorImpl$4.get(InjectorImpl.java:754)
at com.google.inject.InjectorImpl.getInstance(InjectorImpl.java:793)
at org.apache.hadoop.yarn.webapp.Dispatcher.service(Dispatcher.java:136)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
at
com.google.inject.servlet.ServletDefinition.doService(ServletDefinition.java:216)
at
com.google.inject.servlet.ServletDefinition.service(ServletDefinition.java:141)
at
com.google.inject.servlet.ManagedServletPipeline.service(ManagedServletPipeline.java:93)
at
com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:63)
at
com.google.inject.servlet.ManagedFilterPipeline.dispatch(ManagedFilterPipeline.java:122)
at com.google.inject.servlet.GuiceFilter.doFilter(GuiceFilter.java:110)
at
org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
at
org.apache.hadoop.http.HttpServer$QuotingInputFilter.doFilter(HttpServer.java:892)
at
org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
at
org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399)
at
org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
at
org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
at
org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)
at
org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)
at
org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
at org.mortbay.jetty.Server.handle(Server.java:326)
at
[jira] [Updated] (MAPREDUCE-2926) 500 Error in ResourceManager UI
[
https://issues.apache.org/jira/browse/MAPREDUCE-2926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Robert Joseph Evans updated MAPREDUCE-2926:
---
Status: Patch Available (was: Open)
500 Error in ResourceManager UI
---
Key: MAPREDUCE-2926
URL: https://issues.apache.org/jira/browse/MAPREDUCE-2926
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: mrv2
Affects Versions: 0.23.0, 0.24.0
Reporter: Robert Joseph Evans
Assignee: Robert Joseph Evans
Fix For: 0.23.0, 0.24.0
Attachments: MR-2926-v1.patch
When accessing the resource manager UI the following is returned
{noformat}
Problem accessing /. Reason:
org.codehaus.jackson.type.JavaType.init(Ljava/lang/Class;)V
Caused by:
java.lang.NoSuchMethodError:
org.codehaus.jackson.type.JavaType.init(Ljava/lang/Class;)V
at org.codehaus.jackson.map.type.TypeBase.init(TypeBase.java:15)
at org.codehaus.jackson.map.type.SimpleType.init(SimpleType.java:45)
at org.codehaus.jackson.map.type.SimpleType.init(SimpleType.java:40)
at
org.codehaus.jackson.map.type.TypeBindings.clinit(TypeBindings.java:20)
at
org.codehaus.jackson.map.type.TypeFactory._fromType(TypeFactory.java:530)
at org.codehaus.jackson.map.type.TypeFactory.type(TypeFactory.java:63)
at org.codehaus.jackson.map.ObjectMapper.clinit(ObjectMapper.java:179)
at org.apache.hadoop.yarn.webapp.Controller.clinit(Controller.java:43)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
at
com.google.inject.DefaultConstructionProxyFactory$2.newInstance(DefaultConstructionProxyFactory.java:81)
at
com.google.inject.ConstructorInjector.construct(ConstructorInjector.java:85)
at
com.google.inject.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:111)
at com.google.inject.InjectorImpl$4$1.call(InjectorImpl.java:758)
at com.google.inject.InjectorImpl.callInContext(InjectorImpl.java:804)
at com.google.inject.InjectorImpl$4.get(InjectorImpl.java:754)
at com.google.inject.InjectorImpl.getInstance(InjectorImpl.java:793)
at org.apache.hadoop.yarn.webapp.Dispatcher.service(Dispatcher.java:136)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
at
com.google.inject.servlet.ServletDefinition.doService(ServletDefinition.java:216)
at
com.google.inject.servlet.ServletDefinition.service(ServletDefinition.java:141)
at
com.google.inject.servlet.ManagedServletPipeline.service(ManagedServletPipeline.java:93)
at
com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:63)
at
com.google.inject.servlet.ManagedFilterPipeline.dispatch(ManagedFilterPipeline.java:122)
at com.google.inject.servlet.GuiceFilter.doFilter(GuiceFilter.java:110)
at
org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
at
org.apache.hadoop.http.HttpServer$QuotingInputFilter.doFilter(HttpServer.java:892)
at
org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
at
org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399)
at
org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
at
org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
at
org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)
at
org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)
at
org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
at org.mortbay.jetty.Server.handle(Server.java:326)
at
org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
at
org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:928)
at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:549)
at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
at
org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:410)
at
org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
Powered by Jetty://
{noformat}
--
This message is automatically generated by JIRA.
For more information on JIRA,
[jira] [Updated] (MAPREDUCE-2926) 500 Error in ResourceManager UI
[
https://issues.apache.org/jira/browse/MAPREDUCE-2926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Robert Joseph Evans updated MAPREDUCE-2926:
---
Attachment: MR-2926-v1.patch
This patch upgrades the version of jackson to be 1.7.9 consistently across all
hadoop code (except the contrib projects) I have manually verified that the UI
can come up now, and the unit tests still pass, so I don't think there are any
issues with this newer version of jackson.
500 Error in ResourceManager UI
---
Key: MAPREDUCE-2926
URL: https://issues.apache.org/jira/browse/MAPREDUCE-2926
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: mrv2
Affects Versions: 0.23.0, 0.24.0
Reporter: Robert Joseph Evans
Assignee: Robert Joseph Evans
Fix For: 0.23.0, 0.24.0
Attachments: MR-2926-v1.patch
When accessing the resource manager UI the following is returned
{noformat}
Problem accessing /. Reason:
org.codehaus.jackson.type.JavaType.init(Ljava/lang/Class;)V
Caused by:
java.lang.NoSuchMethodError:
org.codehaus.jackson.type.JavaType.init(Ljava/lang/Class;)V
at org.codehaus.jackson.map.type.TypeBase.init(TypeBase.java:15)
at org.codehaus.jackson.map.type.SimpleType.init(SimpleType.java:45)
at org.codehaus.jackson.map.type.SimpleType.init(SimpleType.java:40)
at
org.codehaus.jackson.map.type.TypeBindings.clinit(TypeBindings.java:20)
at
org.codehaus.jackson.map.type.TypeFactory._fromType(TypeFactory.java:530)
at org.codehaus.jackson.map.type.TypeFactory.type(TypeFactory.java:63)
at org.codehaus.jackson.map.ObjectMapper.clinit(ObjectMapper.java:179)
at org.apache.hadoop.yarn.webapp.Controller.clinit(Controller.java:43)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
at
com.google.inject.DefaultConstructionProxyFactory$2.newInstance(DefaultConstructionProxyFactory.java:81)
at
com.google.inject.ConstructorInjector.construct(ConstructorInjector.java:85)
at
com.google.inject.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:111)
at com.google.inject.InjectorImpl$4$1.call(InjectorImpl.java:758)
at com.google.inject.InjectorImpl.callInContext(InjectorImpl.java:804)
at com.google.inject.InjectorImpl$4.get(InjectorImpl.java:754)
at com.google.inject.InjectorImpl.getInstance(InjectorImpl.java:793)
at org.apache.hadoop.yarn.webapp.Dispatcher.service(Dispatcher.java:136)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
at
com.google.inject.servlet.ServletDefinition.doService(ServletDefinition.java:216)
at
com.google.inject.servlet.ServletDefinition.service(ServletDefinition.java:141)
at
com.google.inject.servlet.ManagedServletPipeline.service(ManagedServletPipeline.java:93)
at
com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:63)
at
com.google.inject.servlet.ManagedFilterPipeline.dispatch(ManagedFilterPipeline.java:122)
at com.google.inject.servlet.GuiceFilter.doFilter(GuiceFilter.java:110)
at
org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
at
org.apache.hadoop.http.HttpServer$QuotingInputFilter.doFilter(HttpServer.java:892)
at
org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
at
org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399)
at
org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
at
org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
at
org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)
at
org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)
at
org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
at org.mortbay.jetty.Server.handle(Server.java:326)
at
org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
at
org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:928)
at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:549)
at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
at
[jira] [Commented] (MAPREDUCE-2926) 500 Error in ResourceManager UI
[
https://issues.apache.org/jira/browse/MAPREDUCE-2926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13096237#comment-13096237
]
Mahadev konar commented on MAPREDUCE-2926:
--
Bobby,
Looks like you added more jackson dependencies. Are all of those needed?
500 Error in ResourceManager UI
---
Key: MAPREDUCE-2926
URL: https://issues.apache.org/jira/browse/MAPREDUCE-2926
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: mrv2
Affects Versions: 0.23.0, 0.24.0
Reporter: Robert Joseph Evans
Assignee: Robert Joseph Evans
Fix For: 0.23.0, 0.24.0
Attachments: MR-2926-v1.patch
When accessing the resource manager UI the following is returned
{noformat}
Problem accessing /. Reason:
org.codehaus.jackson.type.JavaType.init(Ljava/lang/Class;)V
Caused by:
java.lang.NoSuchMethodError:
org.codehaus.jackson.type.JavaType.init(Ljava/lang/Class;)V
at org.codehaus.jackson.map.type.TypeBase.init(TypeBase.java:15)
at org.codehaus.jackson.map.type.SimpleType.init(SimpleType.java:45)
at org.codehaus.jackson.map.type.SimpleType.init(SimpleType.java:40)
at
org.codehaus.jackson.map.type.TypeBindings.clinit(TypeBindings.java:20)
at
org.codehaus.jackson.map.type.TypeFactory._fromType(TypeFactory.java:530)
at org.codehaus.jackson.map.type.TypeFactory.type(TypeFactory.java:63)
at org.codehaus.jackson.map.ObjectMapper.clinit(ObjectMapper.java:179)
at org.apache.hadoop.yarn.webapp.Controller.clinit(Controller.java:43)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
at
com.google.inject.DefaultConstructionProxyFactory$2.newInstance(DefaultConstructionProxyFactory.java:81)
at
com.google.inject.ConstructorInjector.construct(ConstructorInjector.java:85)
at
com.google.inject.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:111)
at com.google.inject.InjectorImpl$4$1.call(InjectorImpl.java:758)
at com.google.inject.InjectorImpl.callInContext(InjectorImpl.java:804)
at com.google.inject.InjectorImpl$4.get(InjectorImpl.java:754)
at com.google.inject.InjectorImpl.getInstance(InjectorImpl.java:793)
at org.apache.hadoop.yarn.webapp.Dispatcher.service(Dispatcher.java:136)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
at
com.google.inject.servlet.ServletDefinition.doService(ServletDefinition.java:216)
at
com.google.inject.servlet.ServletDefinition.service(ServletDefinition.java:141)
at
com.google.inject.servlet.ManagedServletPipeline.service(ManagedServletPipeline.java:93)
at
com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:63)
at
com.google.inject.servlet.ManagedFilterPipeline.dispatch(ManagedFilterPipeline.java:122)
at com.google.inject.servlet.GuiceFilter.doFilter(GuiceFilter.java:110)
at
org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
at
org.apache.hadoop.http.HttpServer$QuotingInputFilter.doFilter(HttpServer.java:892)
at
org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
at
org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399)
at
org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
at
org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
at
org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)
at
org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)
at
org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
at org.mortbay.jetty.Server.handle(Server.java:326)
at
org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
at
org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:928)
at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:549)
at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
at
org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:410)
at
org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
Powered by Jetty://
{noformat}
[jira] [Commented] (MAPREDUCE-2926) 500 Error in ResourceManager UI
[
https://issues.apache.org/jira/browse/MAPREDUCE-2926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13096243#comment-13096243
]
Giridharan Kesavan commented on MAPREDUCE-2926:
---
why is the jackson dependencies added twice?
one with config compile-master and one with compile-default
500 Error in ResourceManager UI
---
Key: MAPREDUCE-2926
URL: https://issues.apache.org/jira/browse/MAPREDUCE-2926
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: mrv2
Affects Versions: 0.23.0, 0.24.0
Reporter: Robert Joseph Evans
Assignee: Robert Joseph Evans
Fix For: 0.23.0, 0.24.0
Attachments: MR-2926-v1.patch
When accessing the resource manager UI the following is returned
{noformat}
Problem accessing /. Reason:
org.codehaus.jackson.type.JavaType.init(Ljava/lang/Class;)V
Caused by:
java.lang.NoSuchMethodError:
org.codehaus.jackson.type.JavaType.init(Ljava/lang/Class;)V
at org.codehaus.jackson.map.type.TypeBase.init(TypeBase.java:15)
at org.codehaus.jackson.map.type.SimpleType.init(SimpleType.java:45)
at org.codehaus.jackson.map.type.SimpleType.init(SimpleType.java:40)
at
org.codehaus.jackson.map.type.TypeBindings.clinit(TypeBindings.java:20)
at
org.codehaus.jackson.map.type.TypeFactory._fromType(TypeFactory.java:530)
at org.codehaus.jackson.map.type.TypeFactory.type(TypeFactory.java:63)
at org.codehaus.jackson.map.ObjectMapper.clinit(ObjectMapper.java:179)
at org.apache.hadoop.yarn.webapp.Controller.clinit(Controller.java:43)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
at
com.google.inject.DefaultConstructionProxyFactory$2.newInstance(DefaultConstructionProxyFactory.java:81)
at
com.google.inject.ConstructorInjector.construct(ConstructorInjector.java:85)
at
com.google.inject.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:111)
at com.google.inject.InjectorImpl$4$1.call(InjectorImpl.java:758)
at com.google.inject.InjectorImpl.callInContext(InjectorImpl.java:804)
at com.google.inject.InjectorImpl$4.get(InjectorImpl.java:754)
at com.google.inject.InjectorImpl.getInstance(InjectorImpl.java:793)
at org.apache.hadoop.yarn.webapp.Dispatcher.service(Dispatcher.java:136)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
at
com.google.inject.servlet.ServletDefinition.doService(ServletDefinition.java:216)
at
com.google.inject.servlet.ServletDefinition.service(ServletDefinition.java:141)
at
com.google.inject.servlet.ManagedServletPipeline.service(ManagedServletPipeline.java:93)
at
com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:63)
at
com.google.inject.servlet.ManagedFilterPipeline.dispatch(ManagedFilterPipeline.java:122)
at com.google.inject.servlet.GuiceFilter.doFilter(GuiceFilter.java:110)
at
org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
at
org.apache.hadoop.http.HttpServer$QuotingInputFilter.doFilter(HttpServer.java:892)
at
org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
at
org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399)
at
org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
at
org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
at
org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)
at
org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)
at
org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
at org.mortbay.jetty.Server.handle(Server.java:326)
at
org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
at
org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:928)
at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:549)
at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
at
org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:410)
at
[jira] [Commented] (MAPREDUCE-2926) 500 Error in ResourceManager UI
[
https://issues.apache.org/jira/browse/MAPREDUCE-2926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13096244#comment-13096244
]
Robert Joseph Evans commented on MAPREDUCE-2926:
I did not add in any new dependencies to the mvn builds. The
dependencyManagement section in the pom just says if this package is needed
then here is the version to use. I did have to add it into each of those
locations because each of them is the root pom for a tree. Ideally at some
point hadoop-mapreduce-project, hadoop-mapreduce-client and hadoop-yarn will
all be children of hadoop-project. Then it would handle all of the version
resolution.
For ivy I did add then in as dependencies. I am not an ivy expert, so I don't
know the proper way to override the version of jackson in ivy.xml, so if I did
it wrong I am happy to correct it. I could not get the override tag
https://ant.apache.org/ivy/history/2.2.0/ivyfile/override.html to work for me.
All of the jars I added as dependencies are transitive dependencies that were
already being included in the build already, just not as directly.
500 Error in ResourceManager UI
---
Key: MAPREDUCE-2926
URL: https://issues.apache.org/jira/browse/MAPREDUCE-2926
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: mrv2
Affects Versions: 0.23.0, 0.24.0
Reporter: Robert Joseph Evans
Assignee: Robert Joseph Evans
Fix For: 0.23.0, 0.24.0
Attachments: MR-2926-v1.patch
When accessing the resource manager UI the following is returned
{noformat}
Problem accessing /. Reason:
org.codehaus.jackson.type.JavaType.init(Ljava/lang/Class;)V
Caused by:
java.lang.NoSuchMethodError:
org.codehaus.jackson.type.JavaType.init(Ljava/lang/Class;)V
at org.codehaus.jackson.map.type.TypeBase.init(TypeBase.java:15)
at org.codehaus.jackson.map.type.SimpleType.init(SimpleType.java:45)
at org.codehaus.jackson.map.type.SimpleType.init(SimpleType.java:40)
at
org.codehaus.jackson.map.type.TypeBindings.clinit(TypeBindings.java:20)
at
org.codehaus.jackson.map.type.TypeFactory._fromType(TypeFactory.java:530)
at org.codehaus.jackson.map.type.TypeFactory.type(TypeFactory.java:63)
at org.codehaus.jackson.map.ObjectMapper.clinit(ObjectMapper.java:179)
at org.apache.hadoop.yarn.webapp.Controller.clinit(Controller.java:43)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
at
com.google.inject.DefaultConstructionProxyFactory$2.newInstance(DefaultConstructionProxyFactory.java:81)
at
com.google.inject.ConstructorInjector.construct(ConstructorInjector.java:85)
at
com.google.inject.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:111)
at com.google.inject.InjectorImpl$4$1.call(InjectorImpl.java:758)
at com.google.inject.InjectorImpl.callInContext(InjectorImpl.java:804)
at com.google.inject.InjectorImpl$4.get(InjectorImpl.java:754)
at com.google.inject.InjectorImpl.getInstance(InjectorImpl.java:793)
at org.apache.hadoop.yarn.webapp.Dispatcher.service(Dispatcher.java:136)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
at
com.google.inject.servlet.ServletDefinition.doService(ServletDefinition.java:216)
at
com.google.inject.servlet.ServletDefinition.service(ServletDefinition.java:141)
at
com.google.inject.servlet.ManagedServletPipeline.service(ManagedServletPipeline.java:93)
at
com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:63)
at
com.google.inject.servlet.ManagedFilterPipeline.dispatch(ManagedFilterPipeline.java:122)
at com.google.inject.servlet.GuiceFilter.doFilter(GuiceFilter.java:110)
at
org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
at
org.apache.hadoop.http.HttpServer$QuotingInputFilter.doFilter(HttpServer.java:892)
at
org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
at
org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399)
at
org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
at
org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
at
org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)
at
[jira] [Commented] (MAPREDUCE-2926) 500 Error in ResourceManager UI
[
https://issues.apache.org/jira/browse/MAPREDUCE-2926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13096248#comment-13096248
]
Robert Joseph Evans commented on MAPREDUCE-2926:
@Giri
I added in the jackson dependencies twice because avro was in there twice, with
a different conf each time, compile-master and compile-default. If that is
not the correct way to do it I am very happy to change it.
500 Error in ResourceManager UI
---
Key: MAPREDUCE-2926
URL: https://issues.apache.org/jira/browse/MAPREDUCE-2926
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: mrv2
Affects Versions: 0.23.0, 0.24.0
Reporter: Robert Joseph Evans
Assignee: Robert Joseph Evans
Fix For: 0.23.0, 0.24.0
Attachments: MR-2926-v1.patch
When accessing the resource manager UI the following is returned
{noformat}
Problem accessing /. Reason:
org.codehaus.jackson.type.JavaType.init(Ljava/lang/Class;)V
Caused by:
java.lang.NoSuchMethodError:
org.codehaus.jackson.type.JavaType.init(Ljava/lang/Class;)V
at org.codehaus.jackson.map.type.TypeBase.init(TypeBase.java:15)
at org.codehaus.jackson.map.type.SimpleType.init(SimpleType.java:45)
at org.codehaus.jackson.map.type.SimpleType.init(SimpleType.java:40)
at
org.codehaus.jackson.map.type.TypeBindings.clinit(TypeBindings.java:20)
at
org.codehaus.jackson.map.type.TypeFactory._fromType(TypeFactory.java:530)
at org.codehaus.jackson.map.type.TypeFactory.type(TypeFactory.java:63)
at org.codehaus.jackson.map.ObjectMapper.clinit(ObjectMapper.java:179)
at org.apache.hadoop.yarn.webapp.Controller.clinit(Controller.java:43)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
at
com.google.inject.DefaultConstructionProxyFactory$2.newInstance(DefaultConstructionProxyFactory.java:81)
at
com.google.inject.ConstructorInjector.construct(ConstructorInjector.java:85)
at
com.google.inject.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:111)
at com.google.inject.InjectorImpl$4$1.call(InjectorImpl.java:758)
at com.google.inject.InjectorImpl.callInContext(InjectorImpl.java:804)
at com.google.inject.InjectorImpl$4.get(InjectorImpl.java:754)
at com.google.inject.InjectorImpl.getInstance(InjectorImpl.java:793)
at org.apache.hadoop.yarn.webapp.Dispatcher.service(Dispatcher.java:136)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
at
com.google.inject.servlet.ServletDefinition.doService(ServletDefinition.java:216)
at
com.google.inject.servlet.ServletDefinition.service(ServletDefinition.java:141)
at
com.google.inject.servlet.ManagedServletPipeline.service(ManagedServletPipeline.java:93)
at
com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:63)
at
com.google.inject.servlet.ManagedFilterPipeline.dispatch(ManagedFilterPipeline.java:122)
at com.google.inject.servlet.GuiceFilter.doFilter(GuiceFilter.java:110)
at
org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
at
org.apache.hadoop.http.HttpServer$QuotingInputFilter.doFilter(HttpServer.java:892)
at
org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
at
org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399)
at
org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
at
org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
at
org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)
at
org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)
at
org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
at org.mortbay.jetty.Server.handle(Server.java:326)
at
org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
at
org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:928)
at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:549)
at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
at
[jira] [Created] (MAPREDUCE-2927) CompletedJob.isUber throws a Yarn exception which makes the JobHistory UI unusable.
CompletedJob.isUber throws a Yarn exception which makes the JobHistory UI unusable. --- Key: MAPREDUCE-2927 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2927 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2 Affects Versions: 0.23.0, 0.24.0 Reporter: Robert Joseph Evans Assignee: Robert Joseph Evans Fix For: 0.23.0, 0.24.0 CompletedJob.isUber on the MR-279 branch returns jobInfo.getIsUber() but got turned into an exception when MR-279 was merged to trunk. SVN Revision 1159166. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2926) 500 Error in ResourceManager UI
[
https://issues.apache.org/jira/browse/MAPREDUCE-2926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13096279#comment-13096279
]
Giridharan Kesavan commented on MAPREDUCE-2926:
---
compile-master will just pull the master artifacts; compile-default will pull
master artifact and its transient dependencies. I think we should just pull the
master and not the transient deps. If yarn/mr requires those dependencies then
we should add them separately.
IMO we should just stick to compile-master;
500 Error in ResourceManager UI
---
Key: MAPREDUCE-2926
URL: https://issues.apache.org/jira/browse/MAPREDUCE-2926
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: mrv2
Affects Versions: 0.23.0, 0.24.0
Reporter: Robert Joseph Evans
Assignee: Robert Joseph Evans
Fix For: 0.23.0, 0.24.0
Attachments: MR-2926-v1.patch
When accessing the resource manager UI the following is returned
{noformat}
Problem accessing /. Reason:
org.codehaus.jackson.type.JavaType.init(Ljava/lang/Class;)V
Caused by:
java.lang.NoSuchMethodError:
org.codehaus.jackson.type.JavaType.init(Ljava/lang/Class;)V
at org.codehaus.jackson.map.type.TypeBase.init(TypeBase.java:15)
at org.codehaus.jackson.map.type.SimpleType.init(SimpleType.java:45)
at org.codehaus.jackson.map.type.SimpleType.init(SimpleType.java:40)
at
org.codehaus.jackson.map.type.TypeBindings.clinit(TypeBindings.java:20)
at
org.codehaus.jackson.map.type.TypeFactory._fromType(TypeFactory.java:530)
at org.codehaus.jackson.map.type.TypeFactory.type(TypeFactory.java:63)
at org.codehaus.jackson.map.ObjectMapper.clinit(ObjectMapper.java:179)
at org.apache.hadoop.yarn.webapp.Controller.clinit(Controller.java:43)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
at
com.google.inject.DefaultConstructionProxyFactory$2.newInstance(DefaultConstructionProxyFactory.java:81)
at
com.google.inject.ConstructorInjector.construct(ConstructorInjector.java:85)
at
com.google.inject.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:111)
at com.google.inject.InjectorImpl$4$1.call(InjectorImpl.java:758)
at com.google.inject.InjectorImpl.callInContext(InjectorImpl.java:804)
at com.google.inject.InjectorImpl$4.get(InjectorImpl.java:754)
at com.google.inject.InjectorImpl.getInstance(InjectorImpl.java:793)
at org.apache.hadoop.yarn.webapp.Dispatcher.service(Dispatcher.java:136)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
at
com.google.inject.servlet.ServletDefinition.doService(ServletDefinition.java:216)
at
com.google.inject.servlet.ServletDefinition.service(ServletDefinition.java:141)
at
com.google.inject.servlet.ManagedServletPipeline.service(ManagedServletPipeline.java:93)
at
com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:63)
at
com.google.inject.servlet.ManagedFilterPipeline.dispatch(ManagedFilterPipeline.java:122)
at com.google.inject.servlet.GuiceFilter.doFilter(GuiceFilter.java:110)
at
org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
at
org.apache.hadoop.http.HttpServer$QuotingInputFilter.doFilter(HttpServer.java:892)
at
org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
at
org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399)
at
org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
at
org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
at
org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)
at
org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)
at
org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
at org.mortbay.jetty.Server.handle(Server.java:326)
at
org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
at
org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:928)
at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:549)
at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
at
[jira] [Commented] (MAPREDUCE-2926) 500 Error in ResourceManager UI
[
https://issues.apache.org/jira/browse/MAPREDUCE-2926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13096288#comment-13096288
]
Robert Joseph Evans commented on MAPREDUCE-2926:
Thanks,
That should be a quick fix.
500 Error in ResourceManager UI
---
Key: MAPREDUCE-2926
URL: https://issues.apache.org/jira/browse/MAPREDUCE-2926
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: mrv2
Affects Versions: 0.23.0, 0.24.0
Reporter: Robert Joseph Evans
Assignee: Robert Joseph Evans
Fix For: 0.23.0, 0.24.0
Attachments: MR-2926-v1.patch
When accessing the resource manager UI the following is returned
{noformat}
Problem accessing /. Reason:
org.codehaus.jackson.type.JavaType.init(Ljava/lang/Class;)V
Caused by:
java.lang.NoSuchMethodError:
org.codehaus.jackson.type.JavaType.init(Ljava/lang/Class;)V
at org.codehaus.jackson.map.type.TypeBase.init(TypeBase.java:15)
at org.codehaus.jackson.map.type.SimpleType.init(SimpleType.java:45)
at org.codehaus.jackson.map.type.SimpleType.init(SimpleType.java:40)
at
org.codehaus.jackson.map.type.TypeBindings.clinit(TypeBindings.java:20)
at
org.codehaus.jackson.map.type.TypeFactory._fromType(TypeFactory.java:530)
at org.codehaus.jackson.map.type.TypeFactory.type(TypeFactory.java:63)
at org.codehaus.jackson.map.ObjectMapper.clinit(ObjectMapper.java:179)
at org.apache.hadoop.yarn.webapp.Controller.clinit(Controller.java:43)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
at
com.google.inject.DefaultConstructionProxyFactory$2.newInstance(DefaultConstructionProxyFactory.java:81)
at
com.google.inject.ConstructorInjector.construct(ConstructorInjector.java:85)
at
com.google.inject.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:111)
at com.google.inject.InjectorImpl$4$1.call(InjectorImpl.java:758)
at com.google.inject.InjectorImpl.callInContext(InjectorImpl.java:804)
at com.google.inject.InjectorImpl$4.get(InjectorImpl.java:754)
at com.google.inject.InjectorImpl.getInstance(InjectorImpl.java:793)
at org.apache.hadoop.yarn.webapp.Dispatcher.service(Dispatcher.java:136)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
at
com.google.inject.servlet.ServletDefinition.doService(ServletDefinition.java:216)
at
com.google.inject.servlet.ServletDefinition.service(ServletDefinition.java:141)
at
com.google.inject.servlet.ManagedServletPipeline.service(ManagedServletPipeline.java:93)
at
com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:63)
at
com.google.inject.servlet.ManagedFilterPipeline.dispatch(ManagedFilterPipeline.java:122)
at com.google.inject.servlet.GuiceFilter.doFilter(GuiceFilter.java:110)
at
org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
at
org.apache.hadoop.http.HttpServer$QuotingInputFilter.doFilter(HttpServer.java:892)
at
org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
at
org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399)
at
org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
at
org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
at
org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)
at
org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)
at
org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
at org.mortbay.jetty.Server.handle(Server.java:326)
at
org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
at
org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:928)
at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:549)
at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
at
org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:410)
at
org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
Powered by Jetty://
{noformat}
--
This message is
[jira] [Updated] (MAPREDUCE-2926) 500 Error in ResourceManager UI
[
https://issues.apache.org/jira/browse/MAPREDUCE-2926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Robert Joseph Evans updated MAPREDUCE-2926:
---
Attachment: MR-2926-v2.patch
500 Error in ResourceManager UI
---
Key: MAPREDUCE-2926
URL: https://issues.apache.org/jira/browse/MAPREDUCE-2926
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: mrv2
Affects Versions: 0.23.0, 0.24.0
Reporter: Robert Joseph Evans
Assignee: Robert Joseph Evans
Fix For: 0.23.0, 0.24.0
Attachments: MR-2926-v1.patch, MR-2926-v2.patch
When accessing the resource manager UI the following is returned
{noformat}
Problem accessing /. Reason:
org.codehaus.jackson.type.JavaType.init(Ljava/lang/Class;)V
Caused by:
java.lang.NoSuchMethodError:
org.codehaus.jackson.type.JavaType.init(Ljava/lang/Class;)V
at org.codehaus.jackson.map.type.TypeBase.init(TypeBase.java:15)
at org.codehaus.jackson.map.type.SimpleType.init(SimpleType.java:45)
at org.codehaus.jackson.map.type.SimpleType.init(SimpleType.java:40)
at
org.codehaus.jackson.map.type.TypeBindings.clinit(TypeBindings.java:20)
at
org.codehaus.jackson.map.type.TypeFactory._fromType(TypeFactory.java:530)
at org.codehaus.jackson.map.type.TypeFactory.type(TypeFactory.java:63)
at org.codehaus.jackson.map.ObjectMapper.clinit(ObjectMapper.java:179)
at org.apache.hadoop.yarn.webapp.Controller.clinit(Controller.java:43)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
at
com.google.inject.DefaultConstructionProxyFactory$2.newInstance(DefaultConstructionProxyFactory.java:81)
at
com.google.inject.ConstructorInjector.construct(ConstructorInjector.java:85)
at
com.google.inject.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:111)
at com.google.inject.InjectorImpl$4$1.call(InjectorImpl.java:758)
at com.google.inject.InjectorImpl.callInContext(InjectorImpl.java:804)
at com.google.inject.InjectorImpl$4.get(InjectorImpl.java:754)
at com.google.inject.InjectorImpl.getInstance(InjectorImpl.java:793)
at org.apache.hadoop.yarn.webapp.Dispatcher.service(Dispatcher.java:136)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
at
com.google.inject.servlet.ServletDefinition.doService(ServletDefinition.java:216)
at
com.google.inject.servlet.ServletDefinition.service(ServletDefinition.java:141)
at
com.google.inject.servlet.ManagedServletPipeline.service(ManagedServletPipeline.java:93)
at
com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:63)
at
com.google.inject.servlet.ManagedFilterPipeline.dispatch(ManagedFilterPipeline.java:122)
at com.google.inject.servlet.GuiceFilter.doFilter(GuiceFilter.java:110)
at
org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
at
org.apache.hadoop.http.HttpServer$QuotingInputFilter.doFilter(HttpServer.java:892)
at
org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
at
org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399)
at
org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
at
org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
at
org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)
at
org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)
at
org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
at org.mortbay.jetty.Server.handle(Server.java:326)
at
org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
at
org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:928)
at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:549)
at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
at
org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:410)
at
org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
Powered by Jetty://
{noformat}
--
This message is automatically generated by JIRA.
For more information
[jira] [Updated] (MAPREDUCE-2926) 500 Error in ResourceManager UI
[
https://issues.apache.org/jira/browse/MAPREDUCE-2926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Robert Joseph Evans updated MAPREDUCE-2926:
---
Status: Open (was: Patch Available)
500 Error in ResourceManager UI
---
Key: MAPREDUCE-2926
URL: https://issues.apache.org/jira/browse/MAPREDUCE-2926
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: mrv2
Affects Versions: 0.23.0, 0.24.0
Reporter: Robert Joseph Evans
Assignee: Robert Joseph Evans
Fix For: 0.23.0, 0.24.0
Attachments: MR-2926-v1.patch, MR-2926-v2.patch
When accessing the resource manager UI the following is returned
{noformat}
Problem accessing /. Reason:
org.codehaus.jackson.type.JavaType.init(Ljava/lang/Class;)V
Caused by:
java.lang.NoSuchMethodError:
org.codehaus.jackson.type.JavaType.init(Ljava/lang/Class;)V
at org.codehaus.jackson.map.type.TypeBase.init(TypeBase.java:15)
at org.codehaus.jackson.map.type.SimpleType.init(SimpleType.java:45)
at org.codehaus.jackson.map.type.SimpleType.init(SimpleType.java:40)
at
org.codehaus.jackson.map.type.TypeBindings.clinit(TypeBindings.java:20)
at
org.codehaus.jackson.map.type.TypeFactory._fromType(TypeFactory.java:530)
at org.codehaus.jackson.map.type.TypeFactory.type(TypeFactory.java:63)
at org.codehaus.jackson.map.ObjectMapper.clinit(ObjectMapper.java:179)
at org.apache.hadoop.yarn.webapp.Controller.clinit(Controller.java:43)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
at
com.google.inject.DefaultConstructionProxyFactory$2.newInstance(DefaultConstructionProxyFactory.java:81)
at
com.google.inject.ConstructorInjector.construct(ConstructorInjector.java:85)
at
com.google.inject.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:111)
at com.google.inject.InjectorImpl$4$1.call(InjectorImpl.java:758)
at com.google.inject.InjectorImpl.callInContext(InjectorImpl.java:804)
at com.google.inject.InjectorImpl$4.get(InjectorImpl.java:754)
at com.google.inject.InjectorImpl.getInstance(InjectorImpl.java:793)
at org.apache.hadoop.yarn.webapp.Dispatcher.service(Dispatcher.java:136)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
at
com.google.inject.servlet.ServletDefinition.doService(ServletDefinition.java:216)
at
com.google.inject.servlet.ServletDefinition.service(ServletDefinition.java:141)
at
com.google.inject.servlet.ManagedServletPipeline.service(ManagedServletPipeline.java:93)
at
com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:63)
at
com.google.inject.servlet.ManagedFilterPipeline.dispatch(ManagedFilterPipeline.java:122)
at com.google.inject.servlet.GuiceFilter.doFilter(GuiceFilter.java:110)
at
org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
at
org.apache.hadoop.http.HttpServer$QuotingInputFilter.doFilter(HttpServer.java:892)
at
org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
at
org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399)
at
org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
at
org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
at
org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)
at
org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)
at
org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
at org.mortbay.jetty.Server.handle(Server.java:326)
at
org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
at
org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:928)
at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:549)
at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
at
org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:410)
at
org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
Powered by Jetty://
{noformat}
--
This message is automatically generated by JIRA.
For more
[jira] [Updated] (MAPREDUCE-2926) 500 Error in ResourceManager UI
[
https://issues.apache.org/jira/browse/MAPREDUCE-2926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Robert Joseph Evans updated MAPREDUCE-2926:
---
Status: Patch Available (was: Open)
This patch removed the jackson dependencies in compile-default
500 Error in ResourceManager UI
---
Key: MAPREDUCE-2926
URL: https://issues.apache.org/jira/browse/MAPREDUCE-2926
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: mrv2
Affects Versions: 0.23.0, 0.24.0
Reporter: Robert Joseph Evans
Assignee: Robert Joseph Evans
Fix For: 0.23.0, 0.24.0
Attachments: MR-2926-v1.patch, MR-2926-v2.patch
When accessing the resource manager UI the following is returned
{noformat}
Problem accessing /. Reason:
org.codehaus.jackson.type.JavaType.init(Ljava/lang/Class;)V
Caused by:
java.lang.NoSuchMethodError:
org.codehaus.jackson.type.JavaType.init(Ljava/lang/Class;)V
at org.codehaus.jackson.map.type.TypeBase.init(TypeBase.java:15)
at org.codehaus.jackson.map.type.SimpleType.init(SimpleType.java:45)
at org.codehaus.jackson.map.type.SimpleType.init(SimpleType.java:40)
at
org.codehaus.jackson.map.type.TypeBindings.clinit(TypeBindings.java:20)
at
org.codehaus.jackson.map.type.TypeFactory._fromType(TypeFactory.java:530)
at org.codehaus.jackson.map.type.TypeFactory.type(TypeFactory.java:63)
at org.codehaus.jackson.map.ObjectMapper.clinit(ObjectMapper.java:179)
at org.apache.hadoop.yarn.webapp.Controller.clinit(Controller.java:43)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
at
com.google.inject.DefaultConstructionProxyFactory$2.newInstance(DefaultConstructionProxyFactory.java:81)
at
com.google.inject.ConstructorInjector.construct(ConstructorInjector.java:85)
at
com.google.inject.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:111)
at com.google.inject.InjectorImpl$4$1.call(InjectorImpl.java:758)
at com.google.inject.InjectorImpl.callInContext(InjectorImpl.java:804)
at com.google.inject.InjectorImpl$4.get(InjectorImpl.java:754)
at com.google.inject.InjectorImpl.getInstance(InjectorImpl.java:793)
at org.apache.hadoop.yarn.webapp.Dispatcher.service(Dispatcher.java:136)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
at
com.google.inject.servlet.ServletDefinition.doService(ServletDefinition.java:216)
at
com.google.inject.servlet.ServletDefinition.service(ServletDefinition.java:141)
at
com.google.inject.servlet.ManagedServletPipeline.service(ManagedServletPipeline.java:93)
at
com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:63)
at
com.google.inject.servlet.ManagedFilterPipeline.dispatch(ManagedFilterPipeline.java:122)
at com.google.inject.servlet.GuiceFilter.doFilter(GuiceFilter.java:110)
at
org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
at
org.apache.hadoop.http.HttpServer$QuotingInputFilter.doFilter(HttpServer.java:892)
at
org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
at
org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399)
at
org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
at
org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
at
org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)
at
org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)
at
org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
at org.mortbay.jetty.Server.handle(Server.java:326)
at
org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
at
org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:928)
at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:549)
at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
at
org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:410)
at
org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
Powered by Jetty://
{noformat}
[jira] [Commented] (MAPREDUCE-2926) 500 Error in ResourceManager UI
[
https://issues.apache.org/jira/browse/MAPREDUCE-2926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13096300#comment-13096300
]
Hadoop QA commented on MAPREDUCE-2926:
--
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12492810/MR-2926-v2.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
-1 tests included. The patch doesn't appear to include any new or modified
tests.
Please justify why no new tests are needed for this
patch.
Also please list what manual steps were performed to
verify this patch.
-1 patch. The patch command could not apply the patch.
Console output:
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/591//console
This message is automatically generated.
500 Error in ResourceManager UI
---
Key: MAPREDUCE-2926
URL: https://issues.apache.org/jira/browse/MAPREDUCE-2926
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: mrv2
Affects Versions: 0.23.0, 0.24.0
Reporter: Robert Joseph Evans
Assignee: Robert Joseph Evans
Fix For: 0.23.0, 0.24.0
Attachments: MR-2926-v1.patch, MR-2926-v2.patch
When accessing the resource manager UI the following is returned
{noformat}
Problem accessing /. Reason:
org.codehaus.jackson.type.JavaType.init(Ljava/lang/Class;)V
Caused by:
java.lang.NoSuchMethodError:
org.codehaus.jackson.type.JavaType.init(Ljava/lang/Class;)V
at org.codehaus.jackson.map.type.TypeBase.init(TypeBase.java:15)
at org.codehaus.jackson.map.type.SimpleType.init(SimpleType.java:45)
at org.codehaus.jackson.map.type.SimpleType.init(SimpleType.java:40)
at
org.codehaus.jackson.map.type.TypeBindings.clinit(TypeBindings.java:20)
at
org.codehaus.jackson.map.type.TypeFactory._fromType(TypeFactory.java:530)
at org.codehaus.jackson.map.type.TypeFactory.type(TypeFactory.java:63)
at org.codehaus.jackson.map.ObjectMapper.clinit(ObjectMapper.java:179)
at org.apache.hadoop.yarn.webapp.Controller.clinit(Controller.java:43)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
at
com.google.inject.DefaultConstructionProxyFactory$2.newInstance(DefaultConstructionProxyFactory.java:81)
at
com.google.inject.ConstructorInjector.construct(ConstructorInjector.java:85)
at
com.google.inject.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:111)
at com.google.inject.InjectorImpl$4$1.call(InjectorImpl.java:758)
at com.google.inject.InjectorImpl.callInContext(InjectorImpl.java:804)
at com.google.inject.InjectorImpl$4.get(InjectorImpl.java:754)
at com.google.inject.InjectorImpl.getInstance(InjectorImpl.java:793)
at org.apache.hadoop.yarn.webapp.Dispatcher.service(Dispatcher.java:136)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
at
com.google.inject.servlet.ServletDefinition.doService(ServletDefinition.java:216)
at
com.google.inject.servlet.ServletDefinition.service(ServletDefinition.java:141)
at
com.google.inject.servlet.ManagedServletPipeline.service(ManagedServletPipeline.java:93)
at
com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:63)
at
com.google.inject.servlet.ManagedFilterPipeline.dispatch(ManagedFilterPipeline.java:122)
at com.google.inject.servlet.GuiceFilter.doFilter(GuiceFilter.java:110)
at
org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
at
org.apache.hadoop.http.HttpServer$QuotingInputFilter.doFilter(HttpServer.java:892)
at
org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
at
org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399)
at
org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
at
org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
at
org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)
at
org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)
at
org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
at
[jira] [Commented] (MAPREDUCE-2925) job -status JOB_ID is giving continuously info message for completed jobs on the console
[
https://issues.apache.org/jira/browse/MAPREDUCE-2925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13096306#comment-13096306
]
Arun C Murthy commented on MAPREDUCE-2925:
--
Looks like a bug where the client can't deal with absence of job-history server
- we should quit after a while...
job -status JOB_ID is giving continuously info message for completed jobs
on the console
--
Key: MAPREDUCE-2925
URL: https://issues.apache.org/jira/browse/MAPREDUCE-2925
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: mrv2
Affects Versions: 0.23.0, 0.24.0
Reporter: Devaraj K
Assignee: Devaraj K
This below message is coming continuously on the console.
{code:xml}
11/09/02 16:00:00 INFO mapred.ClientServiceDelegate: Failed to contact AM for
job job_1314955256658_0009 Will retry..
11/09/02 16:00:00 INFO mapred.ClientServiceDelegate: Application state is
completed. Redirecting to job history server null
11/09/02 16:00:00 INFO mapred.ClientServiceDelegate: Failed to contact AM for
job job_1314955256658_0009 Will retry..
11/09/02 16:00:00 INFO mapred.ClientServiceDelegate: Application state is
completed. Redirecting to job history server null
{code}
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2926) 500 Error in ResourceManager UI
[
https://issues.apache.org/jira/browse/MAPREDUCE-2926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13096309#comment-13096309
]
Arun C Murthy commented on MAPREDUCE-2926:
--
Giri - if you are fine with this patch, can you pls commit it? Tx
500 Error in ResourceManager UI
---
Key: MAPREDUCE-2926
URL: https://issues.apache.org/jira/browse/MAPREDUCE-2926
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: mrv2
Affects Versions: 0.23.0, 0.24.0
Reporter: Robert Joseph Evans
Assignee: Robert Joseph Evans
Fix For: 0.23.0, 0.24.0
Attachments: MR-2926-v1.patch, MR-2926-v2.patch
When accessing the resource manager UI the following is returned
{noformat}
Problem accessing /. Reason:
org.codehaus.jackson.type.JavaType.init(Ljava/lang/Class;)V
Caused by:
java.lang.NoSuchMethodError:
org.codehaus.jackson.type.JavaType.init(Ljava/lang/Class;)V
at org.codehaus.jackson.map.type.TypeBase.init(TypeBase.java:15)
at org.codehaus.jackson.map.type.SimpleType.init(SimpleType.java:45)
at org.codehaus.jackson.map.type.SimpleType.init(SimpleType.java:40)
at
org.codehaus.jackson.map.type.TypeBindings.clinit(TypeBindings.java:20)
at
org.codehaus.jackson.map.type.TypeFactory._fromType(TypeFactory.java:530)
at org.codehaus.jackson.map.type.TypeFactory.type(TypeFactory.java:63)
at org.codehaus.jackson.map.ObjectMapper.clinit(ObjectMapper.java:179)
at org.apache.hadoop.yarn.webapp.Controller.clinit(Controller.java:43)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
at
com.google.inject.DefaultConstructionProxyFactory$2.newInstance(DefaultConstructionProxyFactory.java:81)
at
com.google.inject.ConstructorInjector.construct(ConstructorInjector.java:85)
at
com.google.inject.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:111)
at com.google.inject.InjectorImpl$4$1.call(InjectorImpl.java:758)
at com.google.inject.InjectorImpl.callInContext(InjectorImpl.java:804)
at com.google.inject.InjectorImpl$4.get(InjectorImpl.java:754)
at com.google.inject.InjectorImpl.getInstance(InjectorImpl.java:793)
at org.apache.hadoop.yarn.webapp.Dispatcher.service(Dispatcher.java:136)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
at
com.google.inject.servlet.ServletDefinition.doService(ServletDefinition.java:216)
at
com.google.inject.servlet.ServletDefinition.service(ServletDefinition.java:141)
at
com.google.inject.servlet.ManagedServletPipeline.service(ManagedServletPipeline.java:93)
at
com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:63)
at
com.google.inject.servlet.ManagedFilterPipeline.dispatch(ManagedFilterPipeline.java:122)
at com.google.inject.servlet.GuiceFilter.doFilter(GuiceFilter.java:110)
at
org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
at
org.apache.hadoop.http.HttpServer$QuotingInputFilter.doFilter(HttpServer.java:892)
at
org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
at
org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399)
at
org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
at
org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
at
org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)
at
org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)
at
org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
at org.mortbay.jetty.Server.handle(Server.java:326)
at
org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
at
org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:928)
at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:549)
at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
at
org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:410)
at
org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
Powered by Jetty://
[jira] [Updated] (MAPREDUCE-2764) Fix renewal of dfs delegation tokens
[
https://issues.apache.org/jira/browse/MAPREDUCE-2764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Daryn Sharp updated MAPREDUCE-2764:
---
Attachment: MAPREDUCE-2764-4.patch
token renewal is based on managers
Fix renewal of dfs delegation tokens
Key: MAPREDUCE-2764
URL: https://issues.apache.org/jira/browse/MAPREDUCE-2764
Project: Hadoop Map/Reduce
Issue Type: Bug
Reporter: Daryn Sharp
Assignee: Daryn Sharp
Fix For: 0.20.205.0
Attachments: MAPREDUCE-2764-2.patch, MAPREDUCE-2764-3.patch,
MAPREDUCE-2764-4.patch, MAPREDUCE-2764.patch, delegation.patch
The JT may have issues renewing hftp tokens which disrupt long distcp jobs.
The problem is the JT's delegation token renewal code is built on brittle
assumptions. The token's service field contains only the ip:port pair.
The renewal process assumes that the scheme must be hdfs. If that fails due
to a {{VersionMismatchException}}, it tries https based on another assumption
that it must be hftp if it's not hdfs. A number of other exceptions, most
commonly {{IOExceptions}}, can be generated which fouls up the renewal since
it won't fallback to https.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2836) Provide option to fail jobs when submitted to non-existent pools.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13096437#comment-13096437 ] Todd Lipcon commented on MAPREDUCE-2836: Any idea what these new findbugs warnings are? The links above seem broken. I'll kick the test-patch build again, I think Giri fixed something this morning that was breaking these links. Provide option to fail jobs when submitted to non-existent pools. - Key: MAPREDUCE-2836 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2836 Project: Hadoop Map/Reduce Issue Type: Improvement Components: contrib/fair-share Reporter: Jeff Bean Assignee: Ahmed Radwan Priority: Minor Attachments: MAPREDUCE-2836.patch, MAPREDUCE-2836_rev2.patch, MAPREDUCE-2836_rev3.patch, MAPREDUCE-2836_rev4.patch In some environments, it might be desirable to explicitly specify the fair scheduler pools and to explicitly fail jobs that are not submitted to any of the pools. Current behavior of the fair scheduler is to submit jobs to a default pool if a pool name isn't specified or to create a pool with the new name if the pool name doesn't already exist. There should be a configuration option for the fair scheduler that causes it to noisily fail the job if it's submitted to a pool that isn't pre-specified or if the specified pool doesn't exist. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2927) CompletedJob.isUber throws a Yarn exception which makes the JobHistory UI unusable.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13096439#comment-13096439 ] Arun C Murthy commented on MAPREDUCE-2927: -- It does. The 'isUber' *code* is legacy of MAPREDUCE-1220 which isn't relevant in MR2 context. Makes sense? CompletedJob.isUber throws a Yarn exception which makes the JobHistory UI unusable. --- Key: MAPREDUCE-2927 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2927 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2 Affects Versions: 0.23.0, 0.24.0 Reporter: Robert Joseph Evans Assignee: Robert Joseph Evans Fix For: 0.23.0, 0.24.0 CompletedJob.isUber on the MR-279 branch returns jobInfo.getIsUber() but got turned into an exception when MR-279 was merged to trunk. SVN Revision 1159166. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2836) Provide option to fail jobs when submitted to non-existent pools.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13096446#comment-13096446 ] Hadoop QA commented on MAPREDUCE-2836: -- -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12492698/MAPREDUCE-2836_rev4.patch against trunk revision . +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 3 new or modified tests. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. -1 findbugs. The patch appears to introduce 8 new Findbugs (version 1.3.9) warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. +1 core tests. The patch passed unit tests in .. +1 contrib tests. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/592//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/592//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-hs.html Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/592//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-shuffle.html Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/592//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-common.html Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/592//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-app.html Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/592//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-jobclient.html Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/592//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-core.html Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/592//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-server-common.html Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/592//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-server-resourcemanager.html Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/592//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-server-nodemanager.html Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/592//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-common.html Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/592//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-api.html Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/592//console This message is automatically generated. Provide option to fail jobs when submitted to non-existent pools. - Key: MAPREDUCE-2836 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2836 Project: Hadoop Map/Reduce Issue Type: Improvement Components: contrib/fair-share Reporter: Jeff Bean Assignee: Ahmed Radwan Priority: Minor Attachments: MAPREDUCE-2836.patch, MAPREDUCE-2836_rev2.patch, MAPREDUCE-2836_rev3.patch, MAPREDUCE-2836_rev4.patch In some environments, it might be desirable to explicitly specify the fair scheduler pools and to explicitly fail jobs that are not submitted to any of the pools. Current behavior of the fair scheduler is to submit jobs to a default pool if a pool name isn't specified or to create a pool with the new name if the pool name doesn't already exist. There should be a configuration option for the fair scheduler that causes it to noisily fail the job if it's submitted to a pool that isn't pre-specified or if the specified pool doesn't exist. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2836) Provide option to fail jobs when submitted to non-existent pools.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13096453#comment-13096453 ] Ahmed Radwan commented on MAPREDUCE-2836: - Thanks Todd for kicking the test again! The links above are still broken (they are missing the hadoop-mapreduce-project after trunk in the url. I viewed the details from: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/592/ Then going through -Build Artifacts - View - trunk/hadoop-mapreduce-project/patchprocess See for example: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/592/artifact/trunk/hadoop-mapreduce-project/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-shuffle.html These Findbugs warnings are unrelated to the submitted patch in this ticket. Provide option to fail jobs when submitted to non-existent pools. - Key: MAPREDUCE-2836 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2836 Project: Hadoop Map/Reduce Issue Type: Improvement Components: contrib/fair-share Reporter: Jeff Bean Assignee: Ahmed Radwan Priority: Minor Attachments: MAPREDUCE-2836.patch, MAPREDUCE-2836_rev2.patch, MAPREDUCE-2836_rev3.patch, MAPREDUCE-2836_rev4.patch In some environments, it might be desirable to explicitly specify the fair scheduler pools and to explicitly fail jobs that are not submitted to any of the pools. Current behavior of the fair scheduler is to submit jobs to a default pool if a pool name isn't specified or to create a pool with the new name if the pool name doesn't already exist. There should be a configuration option for the fair scheduler that causes it to noisily fail the job if it's submitted to a pool that isn't pre-specified or if the specified pool doesn't exist. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2927) CompletedJob.isUber throws a Yarn exception which makes the JobHistory UI unusable.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13096458#comment-13096458 ] Arun C Murthy commented on MAPREDUCE-2927: -- I take it back, we can expose 'uberness' in JobHistory - I confused this with JobClient... Robert, if you have a patch I'll review/commit. Thanks, and sorry for causing the confusion. CompletedJob.isUber throws a Yarn exception which makes the JobHistory UI unusable. --- Key: MAPREDUCE-2927 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2927 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2 Affects Versions: 0.23.0, 0.24.0 Reporter: Robert Joseph Evans Assignee: Robert Joseph Evans Fix For: 0.23.0, 0.24.0 CompletedJob.isUber on the MR-279 branch returns jobInfo.getIsUber() but got turned into an exception when MR-279 was merged to trunk. SVN Revision 1159166. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (MAPREDUCE-2928) MR-2413 improvements
MR-2413 improvements Key: MAPREDUCE-2928 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2928 Project: Hadoop Map/Reduce Issue Type: Improvement Components: tasktracker Reporter: Eli Collins Fix For: 0.20.205.0 Tracks improvements to MR-2413. See [this comment|https://issues.apache.org/jira/browse/MAPREDUCE-2413?focusedCommentId=13095073page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13095073]. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2928) MR-2413 improvements
[ https://issues.apache.org/jira/browse/MAPREDUCE-2928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated MAPREDUCE-2928: --- Issue Type: Sub-task (was: Improvement) Parent: MAPREDUCE-2657 MR-2413 improvements Key: MAPREDUCE-2928 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2928 Project: Hadoop Map/Reduce Issue Type: Sub-task Components: tasktracker Reporter: Eli Collins Fix For: 0.20.205.0 Tracks improvements to MR-2413. See [this comment|https://issues.apache.org/jira/browse/MAPREDUCE-2413?focusedCommentId=13095073page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13095073]. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (MAPREDUCE-2928) MR-2413 improvements
[ https://issues.apache.org/jira/browse/MAPREDUCE-2928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins reassigned MAPREDUCE-2928: -- Assignee: Eli Collins MR-2413 improvements Key: MAPREDUCE-2928 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2928 Project: Hadoop Map/Reduce Issue Type: Sub-task Components: tasktracker Reporter: Eli Collins Assignee: Eli Collins Fix For: 0.20.205.0 Attachments: mapreduce-2928-1.patch Tracks improvements to MR-2413. See [this comment|https://issues.apache.org/jira/browse/MAPREDUCE-2413?focusedCommentId=13095073page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13095073]. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2928) MR-2413 improvements
[ https://issues.apache.org/jira/browse/MAPREDUCE-2928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated MAPREDUCE-2928: --- Attachment: mapreduce-2928-1.patch Here's a preliminary patch. Hasn't been tested extensively. MR-2413 improvements Key: MAPREDUCE-2928 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2928 Project: Hadoop Map/Reduce Issue Type: Sub-task Components: tasktracker Reporter: Eli Collins Fix For: 0.20.205.0 Attachments: mapreduce-2928-1.patch Tracks improvements to MR-2413. See [this comment|https://issues.apache.org/jira/browse/MAPREDUCE-2413?focusedCommentId=13095073page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13095073]. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2926) 500 Error in ResourceManager UI
[
https://issues.apache.org/jira/browse/MAPREDUCE-2926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13096492#comment-13096492
]
Giridharan Kesavan commented on MAPREDUCE-2926:
---
Adding dependencies in the dependency management section of the pom is not
going to resolve dependencies for the projects. Its just going to fix the
version of the dependency for the submodules and modules that depends.
we should just add jackson dependency in the hadoop-project/pom.xml dependency
management section and not in the mapreduce pom's - as mr code doesnt depends
on the jackson jars ; this is a transient dependency getting pulled through
common.
500 Error in ResourceManager UI
---
Key: MAPREDUCE-2926
URL: https://issues.apache.org/jira/browse/MAPREDUCE-2926
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: mrv2
Affects Versions: 0.23.0, 0.24.0
Reporter: Robert Joseph Evans
Assignee: Robert Joseph Evans
Fix For: 0.23.0, 0.24.0
Attachments: MR-2926-v1.patch, MR-2926-v2.patch
When accessing the resource manager UI the following is returned
{noformat}
Problem accessing /. Reason:
org.codehaus.jackson.type.JavaType.init(Ljava/lang/Class;)V
Caused by:
java.lang.NoSuchMethodError:
org.codehaus.jackson.type.JavaType.init(Ljava/lang/Class;)V
at org.codehaus.jackson.map.type.TypeBase.init(TypeBase.java:15)
at org.codehaus.jackson.map.type.SimpleType.init(SimpleType.java:45)
at org.codehaus.jackson.map.type.SimpleType.init(SimpleType.java:40)
at
org.codehaus.jackson.map.type.TypeBindings.clinit(TypeBindings.java:20)
at
org.codehaus.jackson.map.type.TypeFactory._fromType(TypeFactory.java:530)
at org.codehaus.jackson.map.type.TypeFactory.type(TypeFactory.java:63)
at org.codehaus.jackson.map.ObjectMapper.clinit(ObjectMapper.java:179)
at org.apache.hadoop.yarn.webapp.Controller.clinit(Controller.java:43)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
at
com.google.inject.DefaultConstructionProxyFactory$2.newInstance(DefaultConstructionProxyFactory.java:81)
at
com.google.inject.ConstructorInjector.construct(ConstructorInjector.java:85)
at
com.google.inject.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:111)
at com.google.inject.InjectorImpl$4$1.call(InjectorImpl.java:758)
at com.google.inject.InjectorImpl.callInContext(InjectorImpl.java:804)
at com.google.inject.InjectorImpl$4.get(InjectorImpl.java:754)
at com.google.inject.InjectorImpl.getInstance(InjectorImpl.java:793)
at org.apache.hadoop.yarn.webapp.Dispatcher.service(Dispatcher.java:136)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
at
com.google.inject.servlet.ServletDefinition.doService(ServletDefinition.java:216)
at
com.google.inject.servlet.ServletDefinition.service(ServletDefinition.java:141)
at
com.google.inject.servlet.ManagedServletPipeline.service(ManagedServletPipeline.java:93)
at
com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:63)
at
com.google.inject.servlet.ManagedFilterPipeline.dispatch(ManagedFilterPipeline.java:122)
at com.google.inject.servlet.GuiceFilter.doFilter(GuiceFilter.java:110)
at
org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
at
org.apache.hadoop.http.HttpServer$QuotingInputFilter.doFilter(HttpServer.java:892)
at
org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
at
org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399)
at
org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
at
org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
at
org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)
at
org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)
at
org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
at org.mortbay.jetty.Server.handle(Server.java:326)
at
org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
at
org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:928)
at
[jira] [Commented] (MAPREDUCE-920) Add jvm params introduced in MAPREDUCE-478 to mapred-default.xml
[ https://issues.apache.org/jira/browse/MAPREDUCE-920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13096501#comment-13096501 ] Alejandro Abdelnur commented on MAPREDUCE-920: -- Is this still relevant? Else we should close it. Add jvm params introduced in MAPREDUCE-478 to mapred-default.xml Key: MAPREDUCE-920 URL: https://issues.apache.org/jira/browse/MAPREDUCE-920 Project: Hadoop Map/Reduce Issue Type: Improvement Components: documentation Reporter: Ramya Sunil Assignee: Alejandro Abdelnur Priority: Minor Labels: newbie Fix For: 0.22.0 Attachments: MAPREDUCE-920.patch mapred-default.xml still provides definition for old params which were deprecated in MAPREDUCE:478. It should be changed to define the new params such as mapred.map.child.java.opts, mapred.reduce.child.java.opts, mapred.map.child.env, mapred.reduce.child.env, mapred.map.child.ulimit, mapred.reduce.child.ulimit. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (MAPREDUCE-2929) Move task-controller from bin to libexec
Move task-controller from bin to libexec Key: MAPREDUCE-2929 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2929 Project: Hadoop Map/Reduce Issue Type: Bug Components: task-controller Affects Versions: 0.20.204.0, 0.23.0 Environment: Java, Redhat 5.6 Reporter: Eric Yang Linux task-controller is hard coded to $HADOOP_HOME/bin. Ideally, it should be moved to $HADOOP_PREFIX/libexec for ant binary layout, or the updated file structure layout for trunk. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2887) MR changes to match HADOOP-7524 (multiple RPC protocols)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13096514#comment-13096514 ] Hudson commented on MAPREDUCE-2887: --- Integrated in Hadoop-Common-trunk-Commit #825 (See [https://builds.apache.org/job/Hadoop-Common-trunk-Commit/825/]) HADOOP-7524 and MapReduce-2887 Change RPC to allow multiple protocols including multuple versions of the same protocol (sanjay Radia) MR changes to match HADOOP-7524 (multiple RPC protocols) Key: MAPREDUCE-2887 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2887 Project: Hadoop Map/Reduce Issue Type: Improvement Reporter: Sanjay Radia Assignee: Sanjay Radia Fix For: 0.23.0, 0.24.0 Attachments: rpc6ForMR.patch, rpc7ForMR.patch -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2887) MR changes to match HADOOP-7524 (multiple RPC protocols)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13096518#comment-13096518 ] Hudson commented on MAPREDUCE-2887: --- Integrated in Hadoop-Hdfs-trunk-Commit #902 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/902/]) HADOOP-7524 and MapReduce-2887 Change RPC to allow multiple protocols including multuple versions of the same protocol (sanjay Radia) MR changes to match HADOOP-7524 (multiple RPC protocols) Key: MAPREDUCE-2887 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2887 Project: Hadoop Map/Reduce Issue Type: Improvement Reporter: Sanjay Radia Assignee: Sanjay Radia Fix For: 0.23.0, 0.24.0 Attachments: rpc6ForMR.patch, rpc7ForMR.patch -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2887) MR changes to match HADOOP-7524 (multiple RPC protocols)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13096524#comment-13096524 ] Hudson commented on MAPREDUCE-2887: --- Integrated in Hadoop-Mapreduce-trunk-Commit #835 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/835/]) HADOOP-7524 and MapReduce-2887 Change RPC to allow multiple protocols including multuple versions of the same protocol (sanjay Radia) MR changes to match HADOOP-7524 (multiple RPC protocols) Key: MAPREDUCE-2887 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2887 Project: Hadoop Map/Reduce Issue Type: Improvement Reporter: Sanjay Radia Assignee: Sanjay Radia Fix For: 0.23.0, 0.24.0 Attachments: rpc6ForMR.patch, rpc7ForMR.patch -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (MAPREDUCE-2887) MR changes to match HADOOP-7524 (multiple RPC protocols)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Radia resolved MAPREDUCE-2887. - Resolution: Fixed Committed as part of HADOOP-7524 MR changes to match HADOOP-7524 (multiple RPC protocols) Key: MAPREDUCE-2887 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2887 Project: Hadoop Map/Reduce Issue Type: Improvement Reporter: Sanjay Radia Assignee: Sanjay Radia Fix For: 0.23.0, 0.24.0 Attachments: rpc6ForMR.patch, rpc7ForMR.patch -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2926) 500 Error in ResourceManager UI
[
https://issues.apache.org/jira/browse/MAPREDUCE-2926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13096533#comment-13096533
]
Aaron T. Myers commented on MAPREDUCE-2926:
---
I just committed HADOOP-7606. Is this now fixed?
500 Error in ResourceManager UI
---
Key: MAPREDUCE-2926
URL: https://issues.apache.org/jira/browse/MAPREDUCE-2926
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: mrv2
Affects Versions: 0.23.0, 0.24.0
Reporter: Robert Joseph Evans
Assignee: Robert Joseph Evans
Fix For: 0.23.0, 0.24.0
Attachments: MR-2926-v1.patch, MR-2926-v2.patch
When accessing the resource manager UI the following is returned
{noformat}
Problem accessing /. Reason:
org.codehaus.jackson.type.JavaType.init(Ljava/lang/Class;)V
Caused by:
java.lang.NoSuchMethodError:
org.codehaus.jackson.type.JavaType.init(Ljava/lang/Class;)V
at org.codehaus.jackson.map.type.TypeBase.init(TypeBase.java:15)
at org.codehaus.jackson.map.type.SimpleType.init(SimpleType.java:45)
at org.codehaus.jackson.map.type.SimpleType.init(SimpleType.java:40)
at
org.codehaus.jackson.map.type.TypeBindings.clinit(TypeBindings.java:20)
at
org.codehaus.jackson.map.type.TypeFactory._fromType(TypeFactory.java:530)
at org.codehaus.jackson.map.type.TypeFactory.type(TypeFactory.java:63)
at org.codehaus.jackson.map.ObjectMapper.clinit(ObjectMapper.java:179)
at org.apache.hadoop.yarn.webapp.Controller.clinit(Controller.java:43)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
at
com.google.inject.DefaultConstructionProxyFactory$2.newInstance(DefaultConstructionProxyFactory.java:81)
at
com.google.inject.ConstructorInjector.construct(ConstructorInjector.java:85)
at
com.google.inject.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:111)
at com.google.inject.InjectorImpl$4$1.call(InjectorImpl.java:758)
at com.google.inject.InjectorImpl.callInContext(InjectorImpl.java:804)
at com.google.inject.InjectorImpl$4.get(InjectorImpl.java:754)
at com.google.inject.InjectorImpl.getInstance(InjectorImpl.java:793)
at org.apache.hadoop.yarn.webapp.Dispatcher.service(Dispatcher.java:136)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
at
com.google.inject.servlet.ServletDefinition.doService(ServletDefinition.java:216)
at
com.google.inject.servlet.ServletDefinition.service(ServletDefinition.java:141)
at
com.google.inject.servlet.ManagedServletPipeline.service(ManagedServletPipeline.java:93)
at
com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:63)
at
com.google.inject.servlet.ManagedFilterPipeline.dispatch(ManagedFilterPipeline.java:122)
at com.google.inject.servlet.GuiceFilter.doFilter(GuiceFilter.java:110)
at
org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
at
org.apache.hadoop.http.HttpServer$QuotingInputFilter.doFilter(HttpServer.java:892)
at
org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
at
org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399)
at
org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
at
org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
at
org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)
at
org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)
at
org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
at org.mortbay.jetty.Server.handle(Server.java:326)
at
org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
at
org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:928)
at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:549)
at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
at
org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:410)
at
org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
Powered by Jetty://
{noformat}
--
This
[jira] [Commented] (MAPREDUCE-2779) JobSplitWriter.java can't handle large job.split file
[ https://issues.apache.org/jira/browse/MAPREDUCE-2779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13096548#comment-13096548 ] Ming Ma commented on MAPREDUCE-2779: It is tested on 0.20-security-* branches. Testing on 0.22 will be conducted later. JobSplitWriter.java can't handle large job.split file - Key: MAPREDUCE-2779 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2779 Project: Hadoop Map/Reduce Issue Type: Bug Components: job submission Affects Versions: 0.20.205.0, 0.22.0, 0.23.0 Reporter: Ming Ma Assignee: Ming Ma Fix For: 0.22.0 Attachments: MAPREDUCE-2779-trunk.patch We use cascading MultiInputFormat. MultiInputFormat sometimes generates big job.split used internally by hadoop, sometimes it can go beyond 2GB. In JobSplitWriter.java, the function that generates such file uses 32bit signed integer to compute offset into job.split. writeNewSplits ... int prevCount = out.size(); ... int currCount = out.size(); writeOldSplits ... long offset = out.size(); ... int currLen = out.size(); -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2926) 500 Error in ResourceManager UI
[
https://issues.apache.org/jira/browse/MAPREDUCE-2926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13096550#comment-13096550
]
Mahadev konar commented on MAPREDUCE-2926:
--
The jackson error went away, now I am seeing:
{code}
Problem accessing /. Reason:
Could not initialize class
org.apache.hadoop.yarn.server.resourcemanager.webapp.RmController
Caused by:
java.lang.NoClassDefFoundError: Could not initialize class
org.apache.hadoop.yarn.server.resourcemanager.webapp.RmController
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
at
com.google.inject.DefaultConstructionProxyFactory$2.newInstance(DefaultConstructionProxyFactory.java:81)
at
com.google.inject.ConstructorInjector.construct(ConstructorInjector.java:85)
at
com.google.inject.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:111)
at com.google.inject.InjectorImpl$4$1.call(InjectorImpl.java:758)
at com.google.inject.InjectorImpl.callInContext(InjectorImpl.java:804)
at com.google.inject.InjectorImpl$4.get(InjectorImpl.java:754)
at com.google.inject.InjectorImpl.getInstance(InjectorImpl.java:793)
at org.apache.hadoop.yarn.webapp.Dispatcher.service(Dispatcher.java:136)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
at
com.google.inject.servlet.ServletDefinition.doService(ServletDefinition.java:216)
at
com.google.inject.servlet.ServletDefinition.service(ServletDefinition.java:141)
at
com.google.inject.servlet.ManagedServletPipeline.service(ManagedServletPipeline.java:93)
at
com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:63)
at
com.google.inject.servlet.ManagedFilterPipeline.dispatch(ManagedFilterPipeline.java:122)
at com.google.inject.servlet.GuiceFilter.doFilter(GuiceFilter.java:110)
at
org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
at
org.apache.hadoop.http.HttpServer$QuotingInputFilter.doFilter(HttpServer.java:892)
at
org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
at
org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399)
at
org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
at
org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
at
org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)
at
org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)
at
org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
at org.mortbay.jetty.Server.handle(Server.java:326)
at
org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
at
org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:928)
at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:549)
at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
at
org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:410)
at
org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
{code}
Debugging still. Will update.
500 Error in ResourceManager UI
---
Key: MAPREDUCE-2926
URL: https://issues.apache.org/jira/browse/MAPREDUCE-2926
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: mrv2
Affects Versions: 0.23.0, 0.24.0
Reporter: Robert Joseph Evans
Assignee: Robert Joseph Evans
Fix For: 0.23.0, 0.24.0
Attachments: MR-2926-v1.patch, MR-2926-v2.patch
When accessing the resource manager UI the following is returned
{noformat}
Problem accessing /. Reason:
org.codehaus.jackson.type.JavaType.init(Ljava/lang/Class;)V
Caused by:
java.lang.NoSuchMethodError:
org.codehaus.jackson.type.JavaType.init(Ljava/lang/Class;)V
at org.codehaus.jackson.map.type.TypeBase.init(TypeBase.java:15)
at org.codehaus.jackson.map.type.SimpleType.init(SimpleType.java:45)
at org.codehaus.jackson.map.type.SimpleType.init(SimpleType.java:40)
at
org.codehaus.jackson.map.type.TypeBindings.clinit(TypeBindings.java:20)
at
[jira] [Updated] (MAPREDUCE-2690) Construct the web page for default scheduler
[ https://issues.apache.org/jira/browse/MAPREDUCE-2690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated MAPREDUCE-2690: -- Attachment: MAPREDUCE-2690.2011-09-02.patch Default Queue capacity percentage. Also, Queue status and metrics information is included under the capacity percentage bar. Construct the web page for default scheduler Key: MAPREDUCE-2690 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2690 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2 Affects Versions: 0.23.0 Reporter: Ramya Sunil Assignee: Eric Payne Fix For: 0.23.0 Attachments: MAPREDUCE-2690.2011-09-02.patch Currently, the web page for default scheduler reads as Under construction. This is a long known issue, but could not find a tracking ticket. Hence opening one. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2690) Construct the web page for default scheduler
[ https://issues.apache.org/jira/browse/MAPREDUCE-2690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated MAPREDUCE-2690: -- Status: Patch Available (was: Open) Construct the web page for default scheduler Key: MAPREDUCE-2690 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2690 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2 Affects Versions: 0.23.0 Reporter: Ramya Sunil Assignee: Eric Payne Fix For: 0.23.0 Attachments: MAPREDUCE-2690.2011-09-02.patch Currently, the web page for default scheduler reads as Under construction. This is a long known issue, but could not find a tracking ticket. Hence opening one. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2690) Construct the web page for default scheduler
[ https://issues.apache.org/jira/browse/MAPREDUCE-2690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13096566#comment-13096566 ] Hadoop QA commented on MAPREDUCE-2690: -- -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12492868/MAPREDUCE-2690.2011-09-02.patch against trunk revision . +1 @author. The patch does not contain any @author tags. -1 tests included. The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. -1 findbugs. The patch appears to introduce 9 new Findbugs (version 1.3.9) warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. +1 core tests. The patch passed unit tests in .. +1 contrib tests. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/593//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/593//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-hs.html Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/593//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-shuffle.html Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/593//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-common.html Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/593//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-app.html Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/593//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-jobclient.html Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/593//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-core.html Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/593//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-server-common.html Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/593//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-server-resourcemanager.html Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/593//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-server-nodemanager.html Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/593//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-common.html Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/593//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-api.html Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/593//console This message is automatically generated. Construct the web page for default scheduler Key: MAPREDUCE-2690 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2690 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2 Affects Versions: 0.23.0 Reporter: Ramya Sunil Assignee: Eric Payne Fix For: 0.23.0 Attachments: MAPREDUCE-2690.2011-09-02.patch Currently, the web page for default scheduler reads as Under construction. This is a long known issue, but could not find a tracking ticket. Hence opening one. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2690) Construct the web page for default scheduler
[ https://issues.apache.org/jira/browse/MAPREDUCE-2690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated MAPREDUCE-2690: -- Attachment: DefaultSchedulerPage.jpg Construct the web page for default scheduler Key: MAPREDUCE-2690 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2690 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2 Affects Versions: 0.23.0 Reporter: Ramya Sunil Assignee: Eric Payne Fix For: 0.23.0 Attachments: DefaultSchedulerPage.jpg, MAPREDUCE-2690.2011-09-02.patch Currently, the web page for default scheduler reads as Under construction. This is a long known issue, but could not find a tracking ticket. Hence opening one. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2690) Construct the web page for default scheduler
[ https://issues.apache.org/jira/browse/MAPREDUCE-2690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13096568#comment-13096568 ] Hadoop QA commented on MAPREDUCE-2690: -- -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12492870/DefaultSchedulerPage.jpg against trunk revision . +1 @author. The patch does not contain any @author tags. -1 tests included. The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. -1 patch. The patch command could not apply the patch. Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/594//console This message is automatically generated. Construct the web page for default scheduler Key: MAPREDUCE-2690 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2690 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2 Affects Versions: 0.23.0 Reporter: Ramya Sunil Assignee: Eric Payne Fix For: 0.23.0 Attachments: DefaultSchedulerPage.jpg, MAPREDUCE-2690.2011-09-02.patch Currently, the web page for default scheduler reads as Under construction. This is a long known issue, but could not find a tracking ticket. Hence opening one. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2716) MR279: MRReliabilityTest job fails because of missing job-file.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated MAPREDUCE-2716: --- Status: Open (was: Patch Available) MR279: MRReliabilityTest job fails because of missing job-file. --- Key: MAPREDUCE-2716 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2716 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2 Affects Versions: 0.23.0 Reporter: Jeffrey Naisbitt Assignee: Jeffrey Naisbitt Fix For: 0.23.0 Attachments: MAPREDUCE-2716-v2.patch, MAPREDUCE-2716-v3.patch, MAPREDUCE-2716-v4.patch, MAPREDUCE-2716-v5.patch, MAPREDUCE-2716-v6.patch, MAPREDUCE-2716-v7.patch, MAPREDUCE-2716-v8.patch, MAPREDUCE-2716.patch The ApplicationReport should have the jobFile (e.g. hdfs://localhost:9000/tmp/hadoop-USER/mapred/staging/USER/.staging/job_201107121640_0001/job.xml) Without it, jobs such as MRReliabilityTest fail with the following error (caused by the fact that jobFile is hardcoded to in TypeConverter.java): e.g. java.lang.IllegalArgumentException: Can not create a Path from an empty string at org.apache.hadoop.fs.Path.checkPathArg(Path.java:88) at org.apache.hadoop.fs.Path.init(Path.java:96) at org.apache.hadoop.mapred.JobConf.init(JobConf.java:445) at org.apache.hadoop.mapreduce.Cluster.getJobs(Cluster.java:104) at org.apache.hadoop.mapreduce.Cluster.getAllJobs(Cluster.java:218) at org.apache.hadoop.mapred.JobClient.getAllJobs(JobClient.java:757) at org.apache.hadoop.mapred.JobClient.jobsToComplete(JobClient.java:741) at org.apache.hadoop.mapred.ReliabilityTest.runTest(ReliabilityTest.java:219) at org.apache.hadoop.mapred.ReliabilityTest.runSleepJobTest(ReliabilityTest.java:133) at org.apache.hadoop.mapred.ReliabilityTest.run(ReliabilityTest.java:116) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69) at org.apache.hadoop.mapred.ReliabilityTest.main(ReliabilityTest.java:504) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:72) at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:144) at org.apache.hadoop.test.MapredTestDriver.run(MapredTestDriver.java:111) at org.apache.hadoop.test.MapredTestDriver.main(MapredTestDriver.java:118) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.util.RunJar.main(RunJar.java:192) -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2716) MR279: MRReliabilityTest job fails because of missing job-file.
[
https://issues.apache.org/jira/browse/MAPREDUCE-2716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinod Kumar Vavilapalli updated MAPREDUCE-2716:
---
Attachment: MAPREDUCE-2716-20110903.txt
+1 for the patch overall.
Minor update to synchronize the access to {{notRunningJobs}} map in
multi-threaded case.
MR279: MRReliabilityTest job fails because of missing job-file.
---
Key: MAPREDUCE-2716
URL: https://issues.apache.org/jira/browse/MAPREDUCE-2716
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: mrv2
Affects Versions: 0.23.0
Reporter: Jeffrey Naisbitt
Assignee: Jeffrey Naisbitt
Fix For: 0.23.0
Attachments: MAPREDUCE-2716-20110903.txt, MAPREDUCE-2716-v2.patch,
MAPREDUCE-2716-v3.patch, MAPREDUCE-2716-v4.patch, MAPREDUCE-2716-v5.patch,
MAPREDUCE-2716-v6.patch, MAPREDUCE-2716-v7.patch, MAPREDUCE-2716-v8.patch,
MAPREDUCE-2716.patch
The ApplicationReport should have the jobFile (e.g.
hdfs://localhost:9000/tmp/hadoop-USER/mapred/staging/USER/.staging/job_201107121640_0001/job.xml)
Without it, jobs such as MRReliabilityTest fail with the following error
(caused by the fact that jobFile is hardcoded to in TypeConverter.java):
e.g. java.lang.IllegalArgumentException: Can not create a Path from an empty
string
at org.apache.hadoop.fs.Path.checkPathArg(Path.java:88)
at org.apache.hadoop.fs.Path.init(Path.java:96)
at org.apache.hadoop.mapred.JobConf.init(JobConf.java:445)
at org.apache.hadoop.mapreduce.Cluster.getJobs(Cluster.java:104)
at org.apache.hadoop.mapreduce.Cluster.getAllJobs(Cluster.java:218)
at org.apache.hadoop.mapred.JobClient.getAllJobs(JobClient.java:757)
at
org.apache.hadoop.mapred.JobClient.jobsToComplete(JobClient.java:741)
at
org.apache.hadoop.mapred.ReliabilityTest.runTest(ReliabilityTest.java:219)
at
org.apache.hadoop.mapred.ReliabilityTest.runSleepJobTest(ReliabilityTest.java:133)
at
org.apache.hadoop.mapred.ReliabilityTest.run(ReliabilityTest.java:116)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
at
org.apache.hadoop.mapred.ReliabilityTest.main(ReliabilityTest.java:504)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:72)
at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:144)
at
org.apache.hadoop.test.MapredTestDriver.run(MapredTestDriver.java:111)
at
org.apache.hadoop.test.MapredTestDriver.main(MapredTestDriver.java:118)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:192)
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2716) MR279: MRReliabilityTest job fails because of missing job-file.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated MAPREDUCE-2716: --- Hadoop Flags: [Reviewed] Status: Patch Available (was: Open) MR279: MRReliabilityTest job fails because of missing job-file. --- Key: MAPREDUCE-2716 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2716 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2 Affects Versions: 0.23.0 Reporter: Jeffrey Naisbitt Assignee: Jeffrey Naisbitt Fix For: 0.23.0 Attachments: MAPREDUCE-2716-20110903.txt, MAPREDUCE-2716-v2.patch, MAPREDUCE-2716-v3.patch, MAPREDUCE-2716-v4.patch, MAPREDUCE-2716-v5.patch, MAPREDUCE-2716-v6.patch, MAPREDUCE-2716-v7.patch, MAPREDUCE-2716-v8.patch, MAPREDUCE-2716.patch The ApplicationReport should have the jobFile (e.g. hdfs://localhost:9000/tmp/hadoop-USER/mapred/staging/USER/.staging/job_201107121640_0001/job.xml) Without it, jobs such as MRReliabilityTest fail with the following error (caused by the fact that jobFile is hardcoded to in TypeConverter.java): e.g. java.lang.IllegalArgumentException: Can not create a Path from an empty string at org.apache.hadoop.fs.Path.checkPathArg(Path.java:88) at org.apache.hadoop.fs.Path.init(Path.java:96) at org.apache.hadoop.mapred.JobConf.init(JobConf.java:445) at org.apache.hadoop.mapreduce.Cluster.getJobs(Cluster.java:104) at org.apache.hadoop.mapreduce.Cluster.getAllJobs(Cluster.java:218) at org.apache.hadoop.mapred.JobClient.getAllJobs(JobClient.java:757) at org.apache.hadoop.mapred.JobClient.jobsToComplete(JobClient.java:741) at org.apache.hadoop.mapred.ReliabilityTest.runTest(ReliabilityTest.java:219) at org.apache.hadoop.mapred.ReliabilityTest.runSleepJobTest(ReliabilityTest.java:133) at org.apache.hadoop.mapred.ReliabilityTest.run(ReliabilityTest.java:116) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69) at org.apache.hadoop.mapred.ReliabilityTest.main(ReliabilityTest.java:504) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:72) at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:144) at org.apache.hadoop.test.MapredTestDriver.run(MapredTestDriver.java:111) at org.apache.hadoop.test.MapredTestDriver.main(MapredTestDriver.java:118) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.util.RunJar.main(RunJar.java:192) -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
