[jira] [Commented] (MAPREDUCE-3088) Clover 2.4.3 breaks build for 0.22 branch
[ https://issues.apache.org/jira/browse/MAPREDUCE-3088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116205#comment-13116205 ] Hudson commented on MAPREDUCE-3088: --- Integrated in Hadoop-Hdfs-22-branch #92 (See [https://builds.apache.org/job/Hadoop-Hdfs-22-branch/92/]) MAPREDUCE-3088. Turn off Clover 2.4.3 until upgraded. Contributed by Konstantin Shvachko. shv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1176723 Files : * /hadoop/nightly/hudsonBuildHadoopNightly.sh Clover 2.4.3 breaks build for 0.22 branch - Key: MAPREDUCE-3088 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3088 Project: Hadoop Map/Reduce Issue Type: Bug Components: build Affects Versions: 0.22.0 Reporter: Konstantin Shvachko Assignee: Konstantin Shvachko Fix For: 0.22.0 Attachments: nightly.patch Due to known bug in Clover 2.4.3 build for 0.22 branch is broken. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3078) Application's progress isn't updated from AM to RM.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116206#comment-13116206 ] Arun C Murthy commented on MAPREDUCE-3078: -- +1 Application's progress isn't updated from AM to RM. --- Key: MAPREDUCE-3078 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3078 Project: Hadoop Map/Reduce Issue Type: Bug Components: applicationmaster, mrv2, resourcemanager Affects Versions: 0.23.0 Reporter: Vinod Kumar Vavilapalli Assignee: Vinod Kumar Vavilapalli Priority: Blocker Fix For: 0.23.0 Attachments: MAPREDUCE-3078-20110927.txt It helps to be able to monitor the application-progress from the RM UI itself. Bits of it is already there, even the AM-RM API (in AllocateRequest). We just need to make sure the progress is produced and consumed properly. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3110) TestRPC.testUnknownCall() is failing
[
https://issues.apache.org/jira/browse/MAPREDUCE-3110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinod Kumar Vavilapalli updated MAPREDUCE-3110:
---
Resolution: Fixed
Status: Resolved (was: Patch Available)
Trivial test-fix. I just committed this to trunk and branch-0.23.
Devaraj K/Mahadev, can you see if it works for you now? Thanks!
TestRPC.testUnknownCall() is failing
Key: MAPREDUCE-3110
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3110
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: mrv2, test
Affects Versions: 0.23.0
Reporter: Devaraj K
Assignee: Vinod Kumar Vavilapalli
Fix For: 0.23.0
Attachments: MAPREDUCE-3110-20110928.txt
{code:xml}
Failed tests:
testUnknownCall(org.apache.hadoop.yarn.TestRPC): null
expected:...icationId called on []org.apache.hadoop.ya... but
was:...icationId called on [interface ]org.apache.hadoop.ya...
Tests run: 65, Failures: 1, Errors: 0, Skipped: 0
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3078) Application's progress isn't updated from AM to RM.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116210#comment-13116210 ] Arun C Murthy commented on MAPREDUCE-3078: -- Testing on a cluster now, I'll commit after. Application's progress isn't updated from AM to RM. --- Key: MAPREDUCE-3078 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3078 Project: Hadoop Map/Reduce Issue Type: Bug Components: applicationmaster, mrv2, resourcemanager Affects Versions: 0.23.0 Reporter: Vinod Kumar Vavilapalli Assignee: Vinod Kumar Vavilapalli Priority: Blocker Fix For: 0.23.0 Attachments: MAPREDUCE-3078-20110927.txt It helps to be able to monitor the application-progress from the RM UI itself. Bits of it is already there, even the AM-RM API (in AllocateRequest). We just need to make sure the progress is produced and consumed properly. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3021) all yarn webapps use same base name of yarn/
[ https://issues.apache.org/jira/browse/MAPREDUCE-3021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116212#comment-13116212 ] Vinod Kumar Vavilapalli commented on MAPREDUCE-3021: Great test coverage again, Thomas! all yarn webapps use same base name of yarn/ -- Key: MAPREDUCE-3021 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3021 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2 Affects Versions: 0.23.0 Reporter: Thomas Graves Assignee: Thomas Graves Fix For: 0.23.0 Attachments: MAPREDUCE-3021.patch, MAPREDUCE-3021.patch All of the yarn webapps (resource manager, node manager, app master, job history) use the same base url of /yarn/. This doesn't lend itself very well to filters be able to differentiate them to say allow some to be not authenticated and other to be authenticated. Perhaps we should rename them based on component. There are also things in the code that hardcode paths to /yarn that should be fixed up. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2843) [MR-279] Node entries on the RM UI are not sortable
[ https://issues.apache.org/jira/browse/MAPREDUCE-2843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116215#comment-13116215 ] Hudson commented on MAPREDUCE-2843: --- Integrated in Hadoop-Mapreduce-trunk-Commit #995 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/995/]) MAPREDUCE-2843. Fixed the node-table to be completely displayed and making node entries on RM UI to be sortable. Contributed by Abhijit Suresh Shingate. vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1176730 Files : * /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/NodesPage.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/TestNodesPage.java [MR-279] Node entries on the RM UI are not sortable --- Key: MAPREDUCE-2843 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2843 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2 Affects Versions: 0.23.0, 0.24.0 Reporter: Ramya Sunil Assignee: Abhijit Suresh Shingate Fix For: 0.23.0, 0.24.0 Attachments: MAPREDUCE-2843- scr shot.jpg, MAPREDUCE-2843.1.patch, MAPREDUCE-2843.2.patch, MAPREDUCE-2843.3.patch, MAPREDUCE-2843.patch, MAPREDUCE-2843.patch The nodemanager entries on the RM UI is not sortable unlike the other web pages. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3110) TestRPC.testUnknownCall() is failing
[
https://issues.apache.org/jira/browse/MAPREDUCE-3110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116221#comment-13116221
]
Hudson commented on MAPREDUCE-3110:
---
Integrated in Hadoop-Hdfs-trunk-Commit #1053 (See
[https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1053/])
MAPREDUCE-3110. Fixed TestRPC failure. Contributed by Vinod Kumar
Vavilapalli.
vinodkv :
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1176739
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
*
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/test/java/org/apache/hadoop/yarn/TestRPC.java
TestRPC.testUnknownCall() is failing
Key: MAPREDUCE-3110
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3110
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: mrv2, test
Affects Versions: 0.23.0
Reporter: Devaraj K
Assignee: Vinod Kumar Vavilapalli
Fix For: 0.23.0
Attachments: MAPREDUCE-3110-20110928.txt
{code:xml}
Failed tests:
testUnknownCall(org.apache.hadoop.yarn.TestRPC): null
expected:...icationId called on []org.apache.hadoop.ya... but
was:...icationId called on [interface ]org.apache.hadoop.ya...
Tests run: 65, Failures: 1, Errors: 0, Skipped: 0
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3110) TestRPC.testUnknownCall() is failing
[
https://issues.apache.org/jira/browse/MAPREDUCE-3110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116224#comment-13116224
]
Hudson commented on MAPREDUCE-3110:
---
Integrated in Hadoop-Common-trunk-Commit #975 (See
[https://builds.apache.org/job/Hadoop-Common-trunk-Commit/975/])
MAPREDUCE-3110. Fixed TestRPC failure. Contributed by Vinod Kumar
Vavilapalli.
vinodkv :
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1176739
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
*
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/test/java/org/apache/hadoop/yarn/TestRPC.java
TestRPC.testUnknownCall() is failing
Key: MAPREDUCE-3110
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3110
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: mrv2, test
Affects Versions: 0.23.0
Reporter: Devaraj K
Assignee: Vinod Kumar Vavilapalli
Fix For: 0.23.0
Attachments: MAPREDUCE-3110-20110928.txt
{code:xml}
Failed tests:
testUnknownCall(org.apache.hadoop.yarn.TestRPC): null
expected:...icationId called on []org.apache.hadoop.ya... but
was:...icationId called on [interface ]org.apache.hadoop.ya...
Tests run: 65, Failures: 1, Errors: 0, Skipped: 0
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2702) [MR-279] OutputCommitter changes for MR Application Master recovery
[ https://issues.apache.org/jira/browse/MAPREDUCE-2702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116228#comment-13116228 ] Sharad Agarwal commented on MAPREDUCE-2702: --- can be done as separate jira for old api. anyway if the outputcommitter doesn't support recovery (the default), the MR AM falls back to rerun the job from beginning. [MR-279] OutputCommitter changes for MR Application Master recovery --- Key: MAPREDUCE-2702 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2702 Project: Hadoop Map/Reduce Issue Type: New Feature Components: mrv2 Reporter: Sharad Agarwal Assignee: Sharad Agarwal Priority: Blocker Attachments: mr2702_v1.patch, mr2702_v2.patch, mr2702_v3.patch, mr2702_v4.patch In MR AM recovers from a crash, it only reruns the non completed tasks. The completed tasks (along with their output, if any) needs to be recovered from the previous life. This would require some changes in OutputCommitter. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2843) [MR-279] Node entries on the RM UI are not sortable
[ https://issues.apache.org/jira/browse/MAPREDUCE-2843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116236#comment-13116236 ] Abhijit Suresh Shingate commented on MAPREDUCE-2843: Thanks a lot vinod!!! :-) [MR-279] Node entries on the RM UI are not sortable --- Key: MAPREDUCE-2843 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2843 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2 Affects Versions: 0.23.0, 0.24.0 Reporter: Ramya Sunil Assignee: Abhijit Suresh Shingate Fix For: 0.23.0, 0.24.0 Attachments: MAPREDUCE-2843- scr shot.jpg, MAPREDUCE-2843.1.patch, MAPREDUCE-2843.2.patch, MAPREDUCE-2843.3.patch, MAPREDUCE-2843.patch, MAPREDUCE-2843.patch The nodemanager entries on the RM UI is not sortable unlike the other web pages. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3110) TestRPC.testUnknownCall() is failing
[
https://issues.apache.org/jira/browse/MAPREDUCE-3110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116257#comment-13116257
]
Hudson commented on MAPREDUCE-3110:
---
Integrated in Hadoop-Mapreduce-trunk-Commit #996 (See
[https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/996/])
MAPREDUCE-3110. Fixed TestRPC failure. Contributed by Vinod Kumar
Vavilapalli.
vinodkv :
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1176739
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
*
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/test/java/org/apache/hadoop/yarn/TestRPC.java
TestRPC.testUnknownCall() is failing
Key: MAPREDUCE-3110
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3110
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: mrv2, test
Affects Versions: 0.23.0
Reporter: Devaraj K
Assignee: Vinod Kumar Vavilapalli
Fix For: 0.23.0
Attachments: MAPREDUCE-3110-20110928.txt
{code:xml}
Failed tests:
testUnknownCall(org.apache.hadoop.yarn.TestRPC): null
expected:...icationId called on []org.apache.hadoop.ya... but
was:...icationId called on [interface ]org.apache.hadoop.ya...
Tests run: 65, Failures: 1, Errors: 0, Skipped: 0
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3078) Application's progress isn't updated from AM to RM.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated MAPREDUCE-3078: - Resolution: Fixed Status: Resolved (was: Patch Available) I just committed this. Thanks Vinod! Application's progress isn't updated from AM to RM. --- Key: MAPREDUCE-3078 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3078 Project: Hadoop Map/Reduce Issue Type: Bug Components: applicationmaster, mrv2, resourcemanager Affects Versions: 0.23.0 Reporter: Vinod Kumar Vavilapalli Assignee: Vinod Kumar Vavilapalli Priority: Blocker Fix For: 0.23.0 Attachments: MAPREDUCE-3078-20110927.txt It helps to be able to monitor the application-progress from the RM UI itself. Bits of it is already there, even the AM-RM API (in AllocateRequest). We just need to make sure the progress is produced and consumed properly. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3078) Application's progress isn't updated from AM to RM.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116266#comment-13116266 ] Hudson commented on MAPREDUCE-3078: --- Integrated in Hadoop-Hdfs-trunk-Commit #1054 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1054/]) MAPREDUCE-3078. Ensure MapReduce AM reports progress correctly for displaying on the RM Web-UI. Contributed by Vinod K V. acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1176762 Files : * /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/pom.xml * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/MRAppMaster.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/job/impl/JobImpl.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/local/LocalContainerAllocator.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/rm/RMCommunicator.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/rm/RMContainerRequestor.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/TestRMContainerAllocator.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/util/MRBuilderUtils.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/pom.xml * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/pom.xml * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/util/BuilderUtils.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/pom.xml * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMAppManager.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceManager.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/RMApp.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/attempt/RMAppAttempt.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/attempt/RMAppAttemptImpl.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/SchedulerApp.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/event/NodeUpdateSchedulerEvent.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fifo/FifoScheduler.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/MockAM.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/applicationsmanager/TestAMRMRPCResponseId.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/MockRMApp.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-tests/src/test/java/org/apache/hadoop/yarn/server/TestContainerTokenSecretManager.java Application's progress isn't updated from AM to RM. ---
[jira] [Commented] (MAPREDUCE-3078) Application's progress isn't updated from AM to RM.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116265#comment-13116265 ] Hudson commented on MAPREDUCE-3078: --- Integrated in Hadoop-Common-trunk-Commit #976 (See [https://builds.apache.org/job/Hadoop-Common-trunk-Commit/976/]) MAPREDUCE-3078. Ensure MapReduce AM reports progress correctly for displaying on the RM Web-UI. Contributed by Vinod K V. acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1176762 Files : * /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/pom.xml * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/MRAppMaster.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/job/impl/JobImpl.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/local/LocalContainerAllocator.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/rm/RMCommunicator.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/rm/RMContainerRequestor.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/TestRMContainerAllocator.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/util/MRBuilderUtils.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/pom.xml * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/pom.xml * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/util/BuilderUtils.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/pom.xml * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMAppManager.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceManager.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/RMApp.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/attempt/RMAppAttempt.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/attempt/RMAppAttemptImpl.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/SchedulerApp.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/event/NodeUpdateSchedulerEvent.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fifo/FifoScheduler.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/MockAM.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/applicationsmanager/TestAMRMRPCResponseId.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/MockRMApp.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-tests/src/test/java/org/apache/hadoop/yarn/server/TestContainerTokenSecretManager.java Application's progress isn't updated from AM to RM. ---
[jira] [Commented] (MAPREDUCE-3078) Application's progress isn't updated from AM to RM.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116276#comment-13116276 ] Hudson commented on MAPREDUCE-3078: --- Integrated in Hadoop-Mapreduce-trunk-Commit #997 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/997/]) MAPREDUCE-3078. Ensure MapReduce AM reports progress correctly for displaying on the RM Web-UI. Contributed by Vinod K V. acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1176762 Files : * /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/pom.xml * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/MRAppMaster.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/job/impl/JobImpl.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/local/LocalContainerAllocator.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/rm/RMCommunicator.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/rm/RMContainerRequestor.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/TestRMContainerAllocator.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/util/MRBuilderUtils.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/pom.xml * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/pom.xml * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/util/BuilderUtils.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/pom.xml * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMAppManager.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceManager.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/RMApp.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/attempt/RMAppAttempt.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/attempt/RMAppAttemptImpl.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/SchedulerApp.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/event/NodeUpdateSchedulerEvent.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fifo/FifoScheduler.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/MockAM.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/applicationsmanager/TestAMRMRPCResponseId.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/MockRMApp.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-tests/src/test/java/org/apache/hadoop/yarn/server/TestContainerTokenSecretManager.java Application's progress isn't updated from AM to RM. ---
[jira] [Resolved] (MAPREDUCE-3088) Clover 2.4.3 breaks build for 0.22 branch
[ https://issues.apache.org/jira/browse/MAPREDUCE-3088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko resolved MAPREDUCE-3088. Resolution: Fixed Hadoop Flags: Reviewed I just committed this. Clover 2.4.3 breaks build for 0.22 branch - Key: MAPREDUCE-3088 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3088 Project: Hadoop Map/Reduce Issue Type: Bug Components: build Affects Versions: 0.22.0 Reporter: Konstantin Shvachko Assignee: Konstantin Shvachko Fix For: 0.22.0 Attachments: nightly.patch Due to known bug in Clover 2.4.3 build for 0.22 branch is broken. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3106) Replacing Mapper with MultithreadedMapper causes the job to crash with Type mismatch in key from map
[
https://issues.apache.org/jira/browse/MAPREDUCE-3106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116286#comment-13116286
]
Bhallamudi Venkata Siva Kamesh commented on MAPREDUCE-3106:
---
Job set up has not been done properly. Can't occur with we set
MultithreadedMapper.setMapperClass(job, MyMapper.class);
I feel it is an invalid bug and can be closed.
Replacing Mapper with MultithreadedMapper causes the job to crash with Type
mismatch in key from map
---
Key: MAPREDUCE-3106
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3106
Project: Hadoop Map/Reduce
Issue Type: Bug
Affects Versions: 0.20.203.0
Reporter: Arsen Zahray
Priority: Blocker
I have a hadoop job, which works perfectly fine when done with a class
implementing Mapper. When I do replace Mapper with MultithreadMapper, the job
crashes with following message:
java.io.IOException: Type mismatch in key from map: expected
org.apache.hadoop.io.IntWritable, recieved org.apache.hadoop.io.LongWritable
at
org.apache.hadoop.mapred.MapTask$MapOutputBuffer.collect(MapTask.java:862)
at
org.apache.hadoop.mapred.MapTask$NewOutputCollector.write(MapTask.java:549)
at
org.apache.hadoop.mapreduce.TaskInputOutputContext.write(TaskInputOutputContext.java:80)
at
org.apache.hadoop.mapreduce.lib.map.MultithreadedMapper$SubMapRecordWriter.write(MultithreadedMapper.java:211)
at
org.apache.hadoop.mapreduce.TaskInputOutputContext.write(TaskInputOutputContext.java:80)
at org.apache.hadoop.mapreduce.Mapper.map(Mapper.java:124)
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
at
org.apache.hadoop.mapreduce.lib.map.MultithreadedMapper$MapRunner.run(MultithreadedMapper.java:264)
Here are the relevant source codes:
public class MapReduceMain {
/**
* @param args
*/
public static void main(String[] args) {
try {
if (args.length != 2) {
System.err.println(Usage: MapReduceMain input
path output path);
System.exit(123);
}
Job job = new Job();
job.setJarByClass(MapReduceMain.class);
job.setInputFormatClass(TextInputFormat.class);
FileSystem fs = FileSystem.get(URI.create(args[0]),
job.getConfiguration());
FileStatus[] files = fs.listStatus(new Path(args[0]));
for(FileStatus sfs:files){
FileInputFormat.addInputPath(job,
sfs.getPath());
}
FileOutputFormat.setOutputPath(job, new Path(args[1]));
job.setMapperClass(MyMultithreadMapper.class);
job.setReducerClass(MyReducer.class);
MultithreadedMapper.setNumberOfThreads(job,
MyMultithreadMapper.nThreads);
job.setOutputKeyClass(IntWritable.class);
job.setOutputValueClass(MyPage.class);
job.setOutputFormatClass(SequenceFileOutputFormat.class);
System.exit(job.waitForCompletion(true) ? 0 : 1);
} catch (Exception e) {
e.printStackTrace();
}
}
public class MyMultithreadMapper extends MultithreadedMapperLongWritable,
Text, IntWritable, MyPage {
ConcurrentLinkedQueueMyScraperscrapers= new
ConcurrentLinkedQueueMyScraper();
public static final int nThreads= 5;
public VrboMultithreadMapper() {
for (int i = 0; i nThreads; i++) {
scrapers.add(new MyScraper());
}
}
public void map(LongWritable key, Text value, Context context) throws
IOException, InterruptedException {
MyScraper scraper = scrapers.poll();
MyPage result = null;
for (int i = 0; i 10; i++) {
try {
result = scraper.scrapPage(value.toString(),
true);
break;
} catch (Exception e) {
e.printStackTrace();
}
}
if (result == null) {
result = new MyPage();
result.setUrl(key.toString());
}
context.write(new IntWritable(result.getUrl().hashCode()),
result);
[jira] [Commented] (MAPREDUCE-3039) Make mapreduce use same version of avro as HBase
[ https://issues.apache.org/jira/browse/MAPREDUCE-3039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116295#comment-13116295 ] Hudson commented on MAPREDUCE-3039: --- Integrated in Hadoop-Mapreduce-22-branch #77 (See [https://builds.apache.org/job/Hadoop-Mapreduce-22-branch/77/]) MAPREDUCE-3039. Upgrade to Avro 1.5.3. Contributed by Joep Rottinghuis. shv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1176694 Files : * /hadoop/common/branches/branch-0.22/mapreduce/CHANGES.txt * /hadoop/common/branches/branch-0.22/mapreduce/build.xml * /hadoop/common/branches/branch-0.22/mapreduce/ivy.xml * /hadoop/common/branches/branch-0.22/mapreduce/ivy/libraries.properties * /hadoop/common/branches/branch-0.22/mapreduce/src/contrib/capacity-scheduler/ivy.xml * /hadoop/common/branches/branch-0.22/mapreduce/src/contrib/fairscheduler/ivy.xml * /hadoop/common/branches/branch-0.22/mapreduce/src/contrib/gridmix/ivy.xml * /hadoop/common/branches/branch-0.22/mapreduce/src/contrib/mrunit/ivy.xml * /hadoop/common/branches/branch-0.22/mapreduce/src/contrib/mumak/ivy.xml * /hadoop/common/branches/branch-0.22/mapreduce/src/contrib/raid/ivy.xml * /hadoop/common/branches/branch-0.22/mapreduce/src/contrib/streaming/ivy.xml * /hadoop/common/branches/branch-0.22/mapreduce/src/java/org/apache/hadoop/mapreduce/jobhistory/EventReader.java * /hadoop/common/branches/branch-0.22/mapreduce/src/java/org/apache/hadoop/mapreduce/jobhistory/EventWriter.java * /hadoop/common/branches/branch-0.22/mapreduce/src/java/org/apache/hadoop/mapreduce/jobhistory/JobSubmittedEvent.java Make mapreduce use same version of avro as HBase Key: MAPREDUCE-3039 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3039 Project: Hadoop Map/Reduce Issue Type: Bug Components: contrib/capacity-sched, contrib/fair-share, contrib/gridmix, contrib/mrunit, contrib/mumak, contrib/raid, contrib/streaming, jobhistoryserver Affects Versions: 0.22.0 Reporter: Joep Rottinghuis Assignee: Joep Rottinghuis Fix For: 0.22.0 Attachments: MAPREDUCE-3039-branch-0.22-shv.patch, MAPREDUCE-3039-branch-0.22.patch HBase depends on avro 1.5.3 whereas hadoop-common depends on 1.3.2. When building HBase on top of hadoop, this should be consistent. Moreover, this should be consistent between common, hdfs, and mapreduce. Contribs seem to have declared a dependency on avro but are not in fact depending on it. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3106) Replacing Mapper with MultithreadedMapper causes the job to crash with Type mismatch in key from map
[
https://issues.apache.org/jira/browse/MAPREDUCE-3106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116314#comment-13116314
]
Arsen Zahray commented on MAPREDUCE-3106:
-
Can the code be changed so it works like I tried to use it?
I believe that many developers to come will make the same mistake I did. Making
it work by subclass would make the api more intuitive
Replacing Mapper with MultithreadedMapper causes the job to crash with Type
mismatch in key from map
---
Key: MAPREDUCE-3106
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3106
Project: Hadoop Map/Reduce
Issue Type: Bug
Affects Versions: 0.20.203.0
Reporter: Arsen Zahray
Priority: Blocker
I have a hadoop job, which works perfectly fine when done with a class
implementing Mapper. When I do replace Mapper with MultithreadMapper, the job
crashes with following message:
java.io.IOException: Type mismatch in key from map: expected
org.apache.hadoop.io.IntWritable, recieved org.apache.hadoop.io.LongWritable
at
org.apache.hadoop.mapred.MapTask$MapOutputBuffer.collect(MapTask.java:862)
at
org.apache.hadoop.mapred.MapTask$NewOutputCollector.write(MapTask.java:549)
at
org.apache.hadoop.mapreduce.TaskInputOutputContext.write(TaskInputOutputContext.java:80)
at
org.apache.hadoop.mapreduce.lib.map.MultithreadedMapper$SubMapRecordWriter.write(MultithreadedMapper.java:211)
at
org.apache.hadoop.mapreduce.TaskInputOutputContext.write(TaskInputOutputContext.java:80)
at org.apache.hadoop.mapreduce.Mapper.map(Mapper.java:124)
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
at
org.apache.hadoop.mapreduce.lib.map.MultithreadedMapper$MapRunner.run(MultithreadedMapper.java:264)
Here are the relevant source codes:
public class MapReduceMain {
/**
* @param args
*/
public static void main(String[] args) {
try {
if (args.length != 2) {
System.err.println(Usage: MapReduceMain input
path output path);
System.exit(123);
}
Job job = new Job();
job.setJarByClass(MapReduceMain.class);
job.setInputFormatClass(TextInputFormat.class);
FileSystem fs = FileSystem.get(URI.create(args[0]),
job.getConfiguration());
FileStatus[] files = fs.listStatus(new Path(args[0]));
for(FileStatus sfs:files){
FileInputFormat.addInputPath(job,
sfs.getPath());
}
FileOutputFormat.setOutputPath(job, new Path(args[1]));
job.setMapperClass(MyMultithreadMapper.class);
job.setReducerClass(MyReducer.class);
MultithreadedMapper.setNumberOfThreads(job,
MyMultithreadMapper.nThreads);
job.setOutputKeyClass(IntWritable.class);
job.setOutputValueClass(MyPage.class);
job.setOutputFormatClass(SequenceFileOutputFormat.class);
System.exit(job.waitForCompletion(true) ? 0 : 1);
} catch (Exception e) {
e.printStackTrace();
}
}
public class MyMultithreadMapper extends MultithreadedMapperLongWritable,
Text, IntWritable, MyPage {
ConcurrentLinkedQueueMyScraperscrapers= new
ConcurrentLinkedQueueMyScraper();
public static final int nThreads= 5;
public VrboMultithreadMapper() {
for (int i = 0; i nThreads; i++) {
scrapers.add(new MyScraper());
}
}
public void map(LongWritable key, Text value, Context context) throws
IOException, InterruptedException {
MyScraper scraper = scrapers.poll();
MyPage result = null;
for (int i = 0; i 10; i++) {
try {
result = scraper.scrapPage(value.toString(),
true);
break;
} catch (Exception e) {
e.printStackTrace();
}
}
if (result == null) {
result = new MyPage();
result.setUrl(key.toString());
}
context.write(new IntWritable(result.getUrl().hashCode()),
result);
[jira] [Commented] (MAPREDUCE-3112) Calling hadoop cli inside mapreduce job leads to errors
[
https://issues.apache.org/jira/browse/MAPREDUCE-3112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116318#comment-13116318
]
Matt Foley commented on MAPREDUCE-3112:
---
If HADOOP_OPTS is viewed as a dictionary for sharing key/value pairs among
Hadoop processes, then it seems that hadoop.log.dir should not be in
HADOOP_OPTS. Either:
* all processes can continue to use the name hadoop.log.dir for this
parameter, but not share it through HADOOP_OPTS. Instead, sets of processes
that need to share this value can share it through some other mechanism,
perhaps a PROCESS_SET_X_SHARED_LOG parameter list, where each such process
set have a differently named list; or
* each set of processes that CAN share a value for log location should have its
own name for the log location parameter, such as hadoop.log.dir and
tasktracker.log.dir. Then all (or none) of these parameters could be shared
in HADOOP_OPTS.
Calling hadoop cli inside mapreduce job leads to errors
---
Key: MAPREDUCE-3112
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3112
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: contrib/streaming
Affects Versions: 0.20.205.0
Environment: Java, Linux
Reporter: Eric Yang
Assignee: Eric Yang
Fix For: 0.20.205.0
When running a streaming job with mapper
bin/hadoop --config /etc/hadoop/ jar
contrib/streaming/hadoop-streaming-0.20.205.0.jar -mapper hadoop --config
/etc/hadoop/ dfs -help -reducer NONE -input /tmp/input.txt -output NONE
Task log shows:
{noformat}
Exception in thread main java.lang.ExceptionInInitializerError
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:57)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
at org.apache.hadoop.fs.FsShell.main(FsShell.java:1895)
Caused by: org.apache.commons.logging.LogConfigurationException:
User-specified log class 'org.apache.commons.logging.impl.Log4JLogger' cannot
be found or is not useable.
at
org.apache.commons.logging.impl.LogFactoryImpl.discoverLogImplementation(LogFactoryImpl.java:874)
at
org.apache.commons.logging.impl.LogFactoryImpl.newInstance(LogFactoryImpl.java:604)
at
org.apache.commons.logging.impl.LogFactoryImpl.getInstance(LogFactoryImpl.java:336)
at
org.apache.commons.logging.impl.LogFactoryImpl.getInstance(LogFactoryImpl.java:310)
at org.apache.commons.logging.LogFactory.getLog(LogFactory.java:685)
at org.apache.hadoop.conf.Configuration.clinit(Configuration.java:142)
... 3 more
java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed
with code 1
at
org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:311)
at
org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:545)
at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:132)
at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:57)
at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:36)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:436)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:372)
at org.apache.hadoop.mapred.Child$4.run(Child.java:261)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
at org.apache.hadoop.mapred.Child.main(Child.java:255)
{noformat}
Upon inspection, there are two problems in the inherited from environment
which prevent the logger initialization to work properly. In hadoop-env.sh,
the HADOOP_OPTS is inherited from the parent process. This configuration was
requested by user to have a way to override HADOOP environment in the
configuration template:
{noformat}
export HADOOP_OPTS=-Djava.net.preferIPv4Stack=true $HADOOP_OPTS
{noformat}
-Dhadoop.log.dir=$HADOOP_LOG_DIR/task_tracker_user is injected into
HADOOP_OPTS in the tasktracker environment. Hence, the running task would
inherit the wrong logging directory, which the end user might not have
sufficient access to write. Second, $HADOOP_ROOT_LOGGER is override to:
-Dhadoop.root.logger=INFO,TLA by the task controller, therefore, the
bin/hadoop script will attempt to use hadoop.root.logger=INFO,TLA, but fail
to initialize.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3106) Replacing Mapper with MultithreadedMapper causes the job to crash with Type mismatch in key from map
[
https://issues.apache.org/jira/browse/MAPREDUCE-3106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116319#comment-13116319
]
Arsen Zahray commented on MAPREDUCE-3106:
-
On the other hand, it's probably better the way it is now. Once you know how to
use it, it's much easier to write a multithread code with it
Replacing Mapper with MultithreadedMapper causes the job to crash with Type
mismatch in key from map
---
Key: MAPREDUCE-3106
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3106
Project: Hadoop Map/Reduce
Issue Type: Bug
Affects Versions: 0.20.203.0
Reporter: Arsen Zahray
Priority: Blocker
I have a hadoop job, which works perfectly fine when done with a class
implementing Mapper. When I do replace Mapper with MultithreadMapper, the job
crashes with following message:
java.io.IOException: Type mismatch in key from map: expected
org.apache.hadoop.io.IntWritable, recieved org.apache.hadoop.io.LongWritable
at
org.apache.hadoop.mapred.MapTask$MapOutputBuffer.collect(MapTask.java:862)
at
org.apache.hadoop.mapred.MapTask$NewOutputCollector.write(MapTask.java:549)
at
org.apache.hadoop.mapreduce.TaskInputOutputContext.write(TaskInputOutputContext.java:80)
at
org.apache.hadoop.mapreduce.lib.map.MultithreadedMapper$SubMapRecordWriter.write(MultithreadedMapper.java:211)
at
org.apache.hadoop.mapreduce.TaskInputOutputContext.write(TaskInputOutputContext.java:80)
at org.apache.hadoop.mapreduce.Mapper.map(Mapper.java:124)
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
at
org.apache.hadoop.mapreduce.lib.map.MultithreadedMapper$MapRunner.run(MultithreadedMapper.java:264)
Here are the relevant source codes:
public class MapReduceMain {
/**
* @param args
*/
public static void main(String[] args) {
try {
if (args.length != 2) {
System.err.println(Usage: MapReduceMain input
path output path);
System.exit(123);
}
Job job = new Job();
job.setJarByClass(MapReduceMain.class);
job.setInputFormatClass(TextInputFormat.class);
FileSystem fs = FileSystem.get(URI.create(args[0]),
job.getConfiguration());
FileStatus[] files = fs.listStatus(new Path(args[0]));
for(FileStatus sfs:files){
FileInputFormat.addInputPath(job,
sfs.getPath());
}
FileOutputFormat.setOutputPath(job, new Path(args[1]));
job.setMapperClass(MyMultithreadMapper.class);
job.setReducerClass(MyReducer.class);
MultithreadedMapper.setNumberOfThreads(job,
MyMultithreadMapper.nThreads);
job.setOutputKeyClass(IntWritable.class);
job.setOutputValueClass(MyPage.class);
job.setOutputFormatClass(SequenceFileOutputFormat.class);
System.exit(job.waitForCompletion(true) ? 0 : 1);
} catch (Exception e) {
e.printStackTrace();
}
}
public class MyMultithreadMapper extends MultithreadedMapperLongWritable,
Text, IntWritable, MyPage {
ConcurrentLinkedQueueMyScraperscrapers= new
ConcurrentLinkedQueueMyScraper();
public static final int nThreads= 5;
public VrboMultithreadMapper() {
for (int i = 0; i nThreads; i++) {
scrapers.add(new MyScraper());
}
}
public void map(LongWritable key, Text value, Context context) throws
IOException, InterruptedException {
MyScraper scraper = scrapers.poll();
MyPage result = null;
for (int i = 0; i 10; i++) {
try {
result = scraper.scrapPage(value.toString(),
true);
break;
} catch (Exception e) {
e.printStackTrace();
}
}
if (result == null) {
result = new MyPage();
result.setUrl(key.toString());
}
context.write(new IntWritable(result.getUrl().hashCode()),
result);
scrapers.add(scraper);
}
}
and here's the code for the working
[jira] [Resolved] (MAPREDUCE-3106) Replacing Mapper with MultithreadedMapper causes the job to crash with Type mismatch in key from map
[
https://issues.apache.org/jira/browse/MAPREDUCE-3106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arsen Zahray resolved MAPREDUCE-3106.
-
Resolution: Won't Fix
Replacing Mapper with MultithreadedMapper causes the job to crash with Type
mismatch in key from map
---
Key: MAPREDUCE-3106
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3106
Project: Hadoop Map/Reduce
Issue Type: Bug
Affects Versions: 0.20.203.0
Reporter: Arsen Zahray
Priority: Blocker
I have a hadoop job, which works perfectly fine when done with a class
implementing Mapper. When I do replace Mapper with MultithreadMapper, the job
crashes with following message:
java.io.IOException: Type mismatch in key from map: expected
org.apache.hadoop.io.IntWritable, recieved org.apache.hadoop.io.LongWritable
at
org.apache.hadoop.mapred.MapTask$MapOutputBuffer.collect(MapTask.java:862)
at
org.apache.hadoop.mapred.MapTask$NewOutputCollector.write(MapTask.java:549)
at
org.apache.hadoop.mapreduce.TaskInputOutputContext.write(TaskInputOutputContext.java:80)
at
org.apache.hadoop.mapreduce.lib.map.MultithreadedMapper$SubMapRecordWriter.write(MultithreadedMapper.java:211)
at
org.apache.hadoop.mapreduce.TaskInputOutputContext.write(TaskInputOutputContext.java:80)
at org.apache.hadoop.mapreduce.Mapper.map(Mapper.java:124)
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
at
org.apache.hadoop.mapreduce.lib.map.MultithreadedMapper$MapRunner.run(MultithreadedMapper.java:264)
Here are the relevant source codes:
public class MapReduceMain {
/**
* @param args
*/
public static void main(String[] args) {
try {
if (args.length != 2) {
System.err.println(Usage: MapReduceMain input
path output path);
System.exit(123);
}
Job job = new Job();
job.setJarByClass(MapReduceMain.class);
job.setInputFormatClass(TextInputFormat.class);
FileSystem fs = FileSystem.get(URI.create(args[0]),
job.getConfiguration());
FileStatus[] files = fs.listStatus(new Path(args[0]));
for(FileStatus sfs:files){
FileInputFormat.addInputPath(job,
sfs.getPath());
}
FileOutputFormat.setOutputPath(job, new Path(args[1]));
job.setMapperClass(MyMultithreadMapper.class);
job.setReducerClass(MyReducer.class);
MultithreadedMapper.setNumberOfThreads(job,
MyMultithreadMapper.nThreads);
job.setOutputKeyClass(IntWritable.class);
job.setOutputValueClass(MyPage.class);
job.setOutputFormatClass(SequenceFileOutputFormat.class);
System.exit(job.waitForCompletion(true) ? 0 : 1);
} catch (Exception e) {
e.printStackTrace();
}
}
public class MyMultithreadMapper extends MultithreadedMapperLongWritable,
Text, IntWritable, MyPage {
ConcurrentLinkedQueueMyScraperscrapers= new
ConcurrentLinkedQueueMyScraper();
public static final int nThreads= 5;
public VrboMultithreadMapper() {
for (int i = 0; i nThreads; i++) {
scrapers.add(new MyScraper());
}
}
public void map(LongWritable key, Text value, Context context) throws
IOException, InterruptedException {
MyScraper scraper = scrapers.poll();
MyPage result = null;
for (int i = 0; i 10; i++) {
try {
result = scraper.scrapPage(value.toString(),
true);
break;
} catch (Exception e) {
e.printStackTrace();
}
}
if (result == null) {
result = new MyPage();
result.setUrl(key.toString());
}
context.write(new IntWritable(result.getUrl().hashCode()),
result);
scrapers.add(scraper);
}
}
and here's the code for the working mapper class, just to be sure:
public class MyMapper extends MapperLongWritable, Text, IntWritable,MyPage {
MyScraper scr = new MyScraper();
public void
[jira] [Commented] (MAPREDUCE-3088) Clover 2.4.3 breaks build for 0.22 branch
[ https://issues.apache.org/jira/browse/MAPREDUCE-3088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116323#comment-13116323 ] Hudson commented on MAPREDUCE-3088: --- Integrated in Hadoop-Common-22-branch #87 (See [https://builds.apache.org/job/Hadoop-Common-22-branch/87/]) MAPREDUCE-3088. Turn off Clover 2.4.3 until upgraded. Contributed by Konstantin Shvachko. shv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1176723 Files : * /hadoop/nightly/hudsonBuildHadoopNightly.sh Clover 2.4.3 breaks build for 0.22 branch - Key: MAPREDUCE-3088 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3088 Project: Hadoop Map/Reduce Issue Type: Bug Components: build Affects Versions: 0.22.0 Reporter: Konstantin Shvachko Assignee: Konstantin Shvachko Fix For: 0.22.0 Attachments: nightly.patch Due to known bug in Clover 2.4.3 build for 0.22 branch is broken. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3088) Clover 2.4.3 breaks build for 0.22 branch
[ https://issues.apache.org/jira/browse/MAPREDUCE-3088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116337#comment-13116337 ] Hudson commented on MAPREDUCE-3088: --- Integrated in ZooKeeper-trunk #1317 (See [https://builds.apache.org/job/ZooKeeper-trunk/1317/]) MAPREDUCE-3088. Turn off Clover 2.4.3 until upgraded. Contributed by Konstantin Shvachko. shv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1176723 Files : * /hadoop/nightly/hudsonBuildHadoopNightly.sh Clover 2.4.3 breaks build for 0.22 branch - Key: MAPREDUCE-3088 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3088 Project: Hadoop Map/Reduce Issue Type: Bug Components: build Affects Versions: 0.22.0 Reporter: Konstantin Shvachko Assignee: Konstantin Shvachko Fix For: 0.22.0 Attachments: nightly.patch Due to known bug in Clover 2.4.3 build for 0.22 branch is broken. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (MAPREDUCE-3113) the scripts yarn-daemon.sh and yarn are not working properly
the scripts yarn-daemon.sh and yarn are not working properly
Key: MAPREDUCE-3113
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3113
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: mrv2
Affects Versions: 0.24.0
Reporter: XieXianshan
Assignee: XieXianshan
Priority: Minor
Fix For: 0.24.0
When we execute them on any path but $YARN_HOME,it is giving the error as
follows:
(Of course we should set the path variable of that scritps into the .bashrc or
profile in advance)
{code}
/usr/share/hadoop/hadoop-mapreduce-0.24.0-SNAPSHOT/bin/yarn: line 55:
/usr/share/hadoop/yarn-config.sh: No such file or directory
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3113) the scripts yarn-daemon.sh and yarn are not working properly
[
https://issues.apache.org/jira/browse/MAPREDUCE-3113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
XieXianshan updated MAPREDUCE-3113:
---
Attachment: MAPREDUCE-3113.patch
Fixed it.
the scripts yarn-daemon.sh and yarn are not working properly
Key: MAPREDUCE-3113
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3113
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: mrv2
Affects Versions: 0.24.0
Reporter: XieXianshan
Assignee: XieXianshan
Priority: Minor
Fix For: 0.24.0
Attachments: MAPREDUCE-3113.patch
When we execute them on any path but $YARN_HOME,it is giving the error as
follows:
(Of course we should set the path variable of that scritps into the .bashrc
or profile in advance)
{code}
/usr/share/hadoop/hadoop-mapreduce-0.24.0-SNAPSHOT/bin/yarn: line 55:
/usr/share/hadoop/yarn-config.sh: No such file or directory
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3113) the scripts yarn-daemon.sh and yarn are not working properly
[
https://issues.apache.org/jira/browse/MAPREDUCE-3113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
XieXianshan updated MAPREDUCE-3113:
---
Status: Patch Available (was: Open)
the scripts yarn-daemon.sh and yarn are not working properly
Key: MAPREDUCE-3113
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3113
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: mrv2
Affects Versions: 0.24.0
Reporter: XieXianshan
Assignee: XieXianshan
Priority: Minor
Fix For: 0.24.0
Attachments: MAPREDUCE-3113.patch
When we execute them on any path but $YARN_HOME,it is giving the error as
follows:
(Of course we should set the path variable of that scritps into the .bashrc
or profile in advance)
{code}
/usr/share/hadoop/hadoop-mapreduce-0.24.0-SNAPSHOT/bin/yarn: line 55:
/usr/share/hadoop/yarn-config.sh: No such file or directory
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3113) the scripts yarn-daemon.sh and yarn are not working properly
[
https://issues.apache.org/jira/browse/MAPREDUCE-3113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116353#comment-13116353
]
Hadoop QA commented on MAPREDUCE-3113:
--
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12496870/MAPREDUCE-3113.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
-1 tests included. The patch doesn't appear to include any new or modified
tests.
Please justify why no new tests are needed for this
patch.
Also please list what manual steps were performed to
verify this patch.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac
compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9)
warnings.
+1 release audit. The applied patch does not increase the total number of
release audit warnings.
+1 core tests. The patch passed unit tests in .
+1 contrib tests. The patch passed contrib unit tests.
Test results:
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/879//testReport/
Console output:
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/879//console
This message is automatically generated.
the scripts yarn-daemon.sh and yarn are not working properly
Key: MAPREDUCE-3113
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3113
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: mrv2
Affects Versions: 0.24.0
Reporter: XieXianshan
Assignee: XieXianshan
Priority: Minor
Fix For: 0.24.0
Attachments: MAPREDUCE-3113.patch
When we execute them on any path but $YARN_HOME,it is giving the error as
follows:
(Of course we should set the path variable of that scritps into the .bashrc
or profile in advance)
{code}
/usr/share/hadoop/hadoop-mapreduce-0.24.0-SNAPSHOT/bin/yarn: line 55:
/usr/share/hadoop/yarn-config.sh: No such file or directory
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (MAPREDUCE-2777) Backport MAPREDUCE-220 to Hadoop 20 security branch
[ https://issues.apache.org/jira/browse/MAPREDUCE-2777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amar Kamat resolved MAPREDUCE-2777. --- Resolution: Fixed Release Note: Adds cumulative cpu usage and total heap usage to task counters. This is a backport of MAPREDUCE-220 and MAPREDUCE-2469. Hadoop Flags: Reviewed I just committed this to the 0.20 security branch. Backport MAPREDUCE-220 to Hadoop 20 security branch --- Key: MAPREDUCE-2777 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2777 Project: Hadoop Map/Reduce Issue Type: New Feature Affects Versions: 0.20.205.0 Reporter: Jonathan Eagles Assignee: Amar Kamat Attachments: mapreduce-2777-v1.3.patch -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3113) the scripts yarn-daemon.sh and yarn are not working properly
[
https://issues.apache.org/jira/browse/MAPREDUCE-3113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
XieXianshan updated MAPREDUCE-3113:
---
Description:
When we execute them on any path but $YARN_HOME with bash -x option,it is
giving the error as follows:
(Of course we should set the path variable of that scritps into the .bashrc or
profile in advance)
{code}
/usr/share/hadoop/hadoop-mapreduce-0.24.0-SNAPSHOT/bin/yarn: line 55:
/usr/share/hadoop/yarn-config.sh: No such file or directory
{code}
was:
When we execute them on any path but $YARN_HOME,it is giving the error as
follows:
(Of course we should set the path variable of that scritps into the .bashrc or
profile in advance)
{code}
/usr/share/hadoop/hadoop-mapreduce-0.24.0-SNAPSHOT/bin/yarn: line 55:
/usr/share/hadoop/yarn-config.sh: No such file or directory
{code}
Issue Type: Improvement (was: Bug)
the scripts yarn-daemon.sh and yarn are not working properly
Key: MAPREDUCE-3113
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3113
Project: Hadoop Map/Reduce
Issue Type: Improvement
Components: mrv2
Affects Versions: 0.24.0
Reporter: XieXianshan
Assignee: XieXianshan
Priority: Minor
Fix For: 0.24.0
Attachments: MAPREDUCE-3113.patch
When we execute them on any path but $YARN_HOME with bash -x option,it is
giving the error as follows:
(Of course we should set the path variable of that scritps into the .bashrc
or profile in advance)
{code}
/usr/share/hadoop/hadoop-mapreduce-0.24.0-SNAPSHOT/bin/yarn: line 55:
/usr/share/hadoop/yarn-config.sh: No such file or directory
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3021) all yarn webapps use same base name of yarn/
[ https://issues.apache.org/jira/browse/MAPREDUCE-3021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116386#comment-13116386 ] Hudson commented on MAPREDUCE-3021: --- Integrated in Hadoop-Hdfs-trunk #814 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/814/]) MAPREDUCE-3021. Adding additional files needed for new web-ui. MAPREDUCE-3021. Change base urls for RM web-ui. Contributed by Thomas Graves. acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1176708 Files : * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/webapps/cluster * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/webapps/cluster/.keep * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/webapps/jobhistory * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/webapps/jobhistory/.keep * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/webapps/mapreduce * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/webapps/mapreduce/.keep * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/webapps/node * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/webapps/node/.keep acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1176681 Files : * /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/client/MRClientService.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/NavBlock.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/TaskPage.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/jobhistory/JobHistoryUtils.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/main/java/org/apache/hadoop/mapreduce/v2/hs/HistoryClientService.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/conf/YarnConfiguration.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/test/java/org/apache/hadoop/yarn/conf * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/test/java/org/apache/hadoop/yarn/conf/TestYarnConfiguration.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/WebServer.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceManager.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/RmController.java all yarn webapps use same base name of yarn/ -- Key: MAPREDUCE-3021 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3021 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2 Affects Versions: 0.23.0 Reporter: Thomas Graves Assignee: Thomas Graves Fix For: 0.23.0 Attachments: MAPREDUCE-3021.patch, MAPREDUCE-3021.patch All of the yarn webapps (resource manager, node manager, app master, job history) use the same base url of /yarn/. This doesn't lend itself very well to filters be able to differentiate them to say allow some to be not authenticated and other to be authenticated. Perhaps we should rename them based on component. There are also things in the code that hardcode paths to /yarn that should be fixed up. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3041) Enhance YARN Client-RM protocol to provide access to information such as cluster's Min/Max Resource capabilities similar to that of AM-RM protocol
[ https://issues.apache.org/jira/browse/MAPREDUCE-3041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116389#comment-13116389 ] Hudson commented on MAPREDUCE-3041: --- Integrated in Hadoop-Hdfs-trunk #814 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/814/]) MAPREDUCE-3041. Fixed ClientRMProtocol to provide min/max resource capabilities along-with new ApplicationId for application submission. Contributed by Hitesh Shah. acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1176715 Files : * /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ResourceMgrDelegate.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestClientRedirect.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/TestYARNRunner.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/ClientRMProtocol.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/protocolrecords/GetNewApplicationIdRequest.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/protocolrecords/GetNewApplicationIdResponse.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/protocolrecords/GetNewApplicationRequest.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/protocolrecords/GetNewApplicationResponse.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/protocolrecords/impl/pb/GetNewApplicationIdRequestPBImpl.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/protocolrecords/impl/pb/GetNewApplicationIdResponsePBImpl.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/protocolrecords/impl/pb/GetNewApplicationRequestPBImpl.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/protocolrecords/impl/pb/GetNewApplicationResponsePBImpl.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/proto/client_RM_protocol.proto * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/proto/yarn_service_protos.proto * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/api/impl/pb/client/ClientRMProtocolPBClientImpl.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/api/impl/pb/service/ClientRMProtocolPBServiceImpl.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/test/java/org/apache/hadoop/yarn/TestRPC.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ClientRMService.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/MockRM.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/TestRM.java Enhance YARN Client-RM protocol to provide access to information such as cluster's Min/Max Resource capabilities similar to that of AM-RM protocol -- Key: MAPREDUCE-3041 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3041 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2 Affects Versions: 0.23.0 Reporter: Hitesh Shah Assignee: Hitesh Shah Priority: Blocker Fix For: 0.23.0 Attachments: MR-3041.1.patch, MR-3041.2.patch, MR-3041.3.patch To request a container to launch an application master, the client needs to know the min/max resource capabilities so as to be able to make a proper resource request when submitting a new application. -- This message is automatically generated by JIRA. If
[jira] [Commented] (MAPREDUCE-3110) TestRPC.testUnknownCall() is failing
[
https://issues.apache.org/jira/browse/MAPREDUCE-3110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116391#comment-13116391
]
Hudson commented on MAPREDUCE-3110:
---
Integrated in Hadoop-Hdfs-trunk #814 (See
[https://builds.apache.org/job/Hadoop-Hdfs-trunk/814/])
MAPREDUCE-3110. Fixed TestRPC failure. Contributed by Vinod Kumar
Vavilapalli.
vinodkv :
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1176739
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
*
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/test/java/org/apache/hadoop/yarn/TestRPC.java
TestRPC.testUnknownCall() is failing
Key: MAPREDUCE-3110
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3110
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: mrv2, test
Affects Versions: 0.23.0
Reporter: Devaraj K
Assignee: Vinod Kumar Vavilapalli
Fix For: 0.23.0
Attachments: MAPREDUCE-3110-20110928.txt
{code:xml}
Failed tests:
testUnknownCall(org.apache.hadoop.yarn.TestRPC): null
expected:...icationId called on []org.apache.hadoop.ya... but
was:...icationId called on [interface ]org.apache.hadoop.ya...
Tests run: 65, Failures: 1, Errors: 0, Skipped: 0
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2999) hadoop.http.filter.initializers not working properly on yarn UI
[ https://issues.apache.org/jira/browse/MAPREDUCE-2999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116392#comment-13116392 ] Hudson commented on MAPREDUCE-2999: --- Integrated in Hadoop-Hdfs-trunk #814 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/814/]) MAPREDUCE-2999. Fix YARN webapp framework to properly filter servlet paths. Contributed by Thomas Graves. vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1176469 Files : * /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/webapp/Dispatcher.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/webapp/WebApp.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/webapp/WebApps.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/test/java/org/apache/hadoop/yarn/webapp/TestWebApp.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmnode/RMNodeImpl.java hadoop.http.filter.initializers not working properly on yarn UI --- Key: MAPREDUCE-2999 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2999 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2 Affects Versions: 0.23.0 Reporter: Thomas Graves Assignee: Thomas Graves Priority: Critical Fix For: 0.23.0 Attachments: MAPREDUCE-2999.patch, MAPREDUCE-2999.patch, MAPREDUCE-2999.patch, MAPREDUCE-2999.patch, MAPREDUCE-2999.patch, MAPREDUCE-2999.patch Currently httpserver only has *.html, *.jsp as user facing urls when you add a filter. For the new web framework in yarn, the pages no longer have the *.html or *.jsp and thus they are not properly being filtered. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3095) fairscheduler ivy including wrong version for hdfs
[ https://issues.apache.org/jira/browse/MAPREDUCE-3095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116393#comment-13116393 ] Hudson commented on MAPREDUCE-3095: --- Integrated in Hadoop-Hdfs-trunk #814 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/814/]) MAPREDUCE-3095. fairscheduler ivy including wrong version for hdfs. (John George via mahadev) mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1176566 Files : * /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt * /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/fairscheduler/ivy.xml fairscheduler ivy including wrong version for hdfs -- Key: MAPREDUCE-3095 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3095 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2 Affects Versions: 0.23.0 Reporter: John George Assignee: John George Fix For: 0.23.0 Attachments: mapreduce-3095.patch, mapreduce-branch-0.23.patch fairscheduler ivy.xml includes the common version for hdfs dependency. This could break builds that have different common and hdfs version numbers. The reason we dont see it on the jenkins build is because we use the same version number for common and hdfs. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2843) [MR-279] Node entries on the RM UI are not sortable
[ https://issues.apache.org/jira/browse/MAPREDUCE-2843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116395#comment-13116395 ] Hudson commented on MAPREDUCE-2843: --- Integrated in Hadoop-Hdfs-trunk #814 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/814/]) MAPREDUCE-2843. Fixed the node-table to be completely displayed and making node entries on RM UI to be sortable. Contributed by Abhijit Suresh Shingate. vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1176730 Files : * /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/NodesPage.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/TestNodesPage.java [MR-279] Node entries on the RM UI are not sortable --- Key: MAPREDUCE-2843 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2843 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2 Affects Versions: 0.23.0, 0.24.0 Reporter: Ramya Sunil Assignee: Abhijit Suresh Shingate Fix For: 0.23.0, 0.24.0 Attachments: MAPREDUCE-2843- scr shot.jpg, MAPREDUCE-2843.1.patch, MAPREDUCE-2843.2.patch, MAPREDUCE-2843.3.patch, MAPREDUCE-2843.patch, MAPREDUCE-2843.patch The nodemanager entries on the RM UI is not sortable unlike the other web pages. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3081) Change the name format for hadoop core and vaidya jar to be hadoop-{core/vaidya}-{version}.jar in vaidya.sh
[
https://issues.apache.org/jira/browse/MAPREDUCE-3081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116398#comment-13116398
]
Hudson commented on MAPREDUCE-3081:
---
Integrated in Hadoop-Hdfs-trunk #814 (See
[https://builds.apache.org/job/Hadoop-Hdfs-trunk/814/])
MAPREDUCE-3081. Fix vaidya startup script. Contributed by Suhas
gkesavan :
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1176550
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
*
/hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/vaidya/src/java/org/apache/hadoop/vaidya/vaidya.sh
Change the name format for hadoop core and vaidya jar to be
hadoop-{core/vaidya}-{version}.jar in vaidya.sh
---
Key: MAPREDUCE-3081
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3081
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: contrib/vaidya
Affects Versions: 0.20.1, 0.20.205.0, 0.20.206.0
Reporter: vitthal (Suhas) Gogate
Fix For: 0.20.205.0, 0.23.0
Attachments: HADOOP-3081-trunk.patch, MAPREDUCE-3081-2.patch
Vaidya script is broken due to change in the naming convention for hadoop
core jar and vaidya jar.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3092) Remove JOB_ID_COMPARATOR usage in JobHistory.java
[ https://issues.apache.org/jira/browse/MAPREDUCE-3092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116397#comment-13116397 ] Hudson commented on MAPREDUCE-3092: --- Integrated in Hadoop-Hdfs-trunk #814 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/814/]) MAPREDUCE-3092. Removed a special comparator for JobIDs in JobHistory as JobIDs are already comparable. Contributed by Devaraj K. vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1176453 Files : * /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/main/java/org/apache/hadoop/mapreduce/v2/hs/JobHistory.java Remove JOB_ID_COMPARATOR usage in JobHistory.java - Key: MAPREDUCE-3092 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3092 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2 Affects Versions: 0.24.0 Reporter: Devaraj K Assignee: Devaraj K Priority: Minor Fix For: 0.23.0, 0.24.0 Attachments: MAPREDUCE-3092.patch As part of the defect MAPREDUCE-2965, JobId.compareTo() has been implemented. Usage of JOB_ID_COMPARATOR in JobHistory.java can be removed because comparison is handling by JobId itself. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3088) Clover 2.4.3 breaks build for 0.22 branch
[ https://issues.apache.org/jira/browse/MAPREDUCE-3088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116396#comment-13116396 ] Hudson commented on MAPREDUCE-3088: --- Integrated in Hadoop-Hdfs-trunk #814 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/814/]) MAPREDUCE-3088. Turn off Clover 2.4.3 until upgraded. Contributed by Konstantin Shvachko. shv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1176723 Files : * /hadoop/nightly/hudsonBuildHadoopNightly.sh Clover 2.4.3 breaks build for 0.22 branch - Key: MAPREDUCE-3088 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3088 Project: Hadoop Map/Reduce Issue Type: Bug Components: build Affects Versions: 0.22.0 Reporter: Konstantin Shvachko Assignee: Konstantin Shvachko Fix For: 0.22.0 Attachments: nightly.patch Due to known bug in Clover 2.4.3 build for 0.22 branch is broken. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3078) Application's progress isn't updated from AM to RM.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116394#comment-13116394 ] Hudson commented on MAPREDUCE-3078: --- Integrated in Hadoop-Hdfs-trunk #814 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/814/]) MAPREDUCE-3078. Ensure MapReduce AM reports progress correctly for displaying on the RM Web-UI. Contributed by Vinod K V. acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1176762 Files : * /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/pom.xml * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/MRAppMaster.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/job/impl/JobImpl.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/local/LocalContainerAllocator.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/rm/RMCommunicator.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/rm/RMContainerRequestor.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/TestRMContainerAllocator.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/util/MRBuilderUtils.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/pom.xml * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/pom.xml * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/util/BuilderUtils.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/pom.xml * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMAppManager.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceManager.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/RMApp.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/attempt/RMAppAttempt.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/attempt/RMAppAttemptImpl.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/SchedulerApp.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/event/NodeUpdateSchedulerEvent.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fifo/FifoScheduler.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/MockAM.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/applicationsmanager/TestAMRMRPCResponseId.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/MockRMApp.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-tests/src/test/java/org/apache/hadoop/yarn/server/TestContainerTokenSecretManager.java Application's progress isn't updated from AM to RM. --- Key:
[jira] [Commented] (MAPREDUCE-3054) Unable to kill submitted jobs
[ https://issues.apache.org/jira/browse/MAPREDUCE-3054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116399#comment-13116399 ] Hudson commented on MAPREDUCE-3054: --- Integrated in Hadoop-Hdfs-trunk #814 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/814/]) MAPREDUCE-3054. Unable to kill submitted jobs. (mahadev) mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1176600 Files : * /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ClientCache.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ClientServiceDelegate.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ResourceMgrDelegate.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/YARNRunner.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestClientRedirect.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/TestYARNRunner.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/ClientRMProtocol.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/protocolrecords/FinishApplicationRequest.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/protocolrecords/FinishApplicationResponse.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/protocolrecords/KillApplicationRequest.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/protocolrecords/KillApplicationResponse.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/protocolrecords/impl/pb/FinishApplicationRequestPBImpl.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/protocolrecords/impl/pb/FinishApplicationResponsePBImpl.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/protocolrecords/impl/pb/KillApplicationRequestPBImpl.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/protocolrecords/impl/pb/KillApplicationResponsePBImpl.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/proto/client_RM_protocol.proto * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/proto/yarn_service_protos.proto * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/api/impl/pb/client/ClientRMProtocolPBClientImpl.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/api/impl/pb/service/ClientRMProtocolPBServiceImpl.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ClientRMService.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/RMAppImpl.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/MockRM.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/resourcetracker/InlineDispatcher.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/TestRMAppTransitions.java Unable to kill submitted jobs - Key: MAPREDUCE-3054 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3054 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2 Affects Versions: 0.23.0 Reporter:
[jira] [Commented] (MAPREDUCE-3099) Add docs for setting up a single node MRv2 cluster.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116401#comment-13116401 ] Hudson commented on MAPREDUCE-3099: --- Integrated in Hadoop-Hdfs-trunk #814 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/814/]) MAPREDUCE-3099. Add docs for setting up a single node MRv2 cluster. (mahadev) mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1176607 Files : * /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/src * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/src/site * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/src/site/apt * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/src/site/apt/SingleCluster.apt.vm * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/src/site/apt/index.apt.vm * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/src/site/site.xml Add docs for setting up a single node MRv2 cluster. --- Key: MAPREDUCE-3099 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3099 Project: Hadoop Map/Reduce Issue Type: Sub-task Affects Versions: 0.23.0 Reporter: Mahadev konar Assignee: Mahadev konar Fix For: 0.23.0 Attachments: MAPREDUCE-3099.patch -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3098) Report Application status as well as ApplicationMaster status in GetApplicationReportResponse
[ https://issues.apache.org/jira/browse/MAPREDUCE-3098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116417#comment-13116417 ] Vinod Kumar Vavilapalli commented on MAPREDUCE-3098: I understand the areas of concern now. To summarize, let's do this: - Rename ApplicationState to _YarnApplicationState_ without changing any functionality. - Rename ApplicationState.SUCCEEDED to _YarnApplicationState.FINISHED_ - Make String finalState as Enum _FinalStatus_ which can take values SUCCEEDED, FAILED and KILLED. Now the various scenarios: - If an application crashes because of Yarn issues, for e.g. AM going over limits, _YarnApplicationState_ will be FAILED. - If an application fails because of framework issue, for e.g a MR task fails four times and thus the job fails, _YarnApplicationState_ will be FINISHED reflecting no platform errors, but AM will send _FinalStatus_ as FAILED - If an application finishes properly and the framework is happy too, for e.g. a successful MR job, _YarnApplicationState_ will be FINISHED and AM will send _FinalStatus_ to be SUCCEEDED. To summarize, for the client, the following holds: ||_YarnApplicationState_||_FinalStatus_||What Happenend|| |FINISHED|SUCCEEDED|MR job succeeeded| |FINISHED|FAILED|MR job failed say due to four attempt failures| |FINISHED|KILLED|MR job killed by user via AM| |FAILED|Anything|MR job failed because of YARN errors| |KILLED|Anything|MR job forcefully terminated via RM| We will need separate columns on the RM UI for _YarnApplicationState_ and _FinalStatus_. Similarly, we also need separate columns on the command line for bin/hadoop job -list and an extra entry for _YarnApplicationState_ in bin/hadoop job -status Report Application status as well as ApplicationMaster status in GetApplicationReportResponse -- Key: MAPREDUCE-3098 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3098 Project: Hadoop Map/Reduce Issue Type: Sub-task Components: mrv2 Affects Versions: 0.23.0 Reporter: Hitesh Shah Assignee: Hitesh Shah Priority: Blocker Fix For: 0.23.0 Currently, an application report received by the client from the RM/ASM for a given application returns the status of the application master. It does not return the status of the application i.e. whether that particular job succeeded or failed. The AM status would be one of FINISHED (SUCCEEDED should be renamed to FINISHED as AM state does not indicate overall success/failure), FAILED or KILLED. The final state sent by the AM to the RM in the FinishApplicationMasterRequest should be exposed to the client as ApplicationState. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2999) hadoop.http.filter.initializers not working properly on yarn UI
[ https://issues.apache.org/jira/browse/MAPREDUCE-2999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116428#comment-13116428 ] Hudson commented on MAPREDUCE-2999: --- Integrated in Hadoop-Mapreduce-0.23-Build #30 (See [https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/30/]) MAPREDUCE-2999. svn merge -c r1176469 --ignore-ancestry ../../trunk/ vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1176470 Files : * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/webapp/Dispatcher.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/webapp/WebApp.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/webapp/WebApps.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/test/java/org/apache/hadoop/yarn/webapp/TestWebApp.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmnode/RMNodeImpl.java hadoop.http.filter.initializers not working properly on yarn UI --- Key: MAPREDUCE-2999 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2999 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2 Affects Versions: 0.23.0 Reporter: Thomas Graves Assignee: Thomas Graves Priority: Critical Fix For: 0.23.0 Attachments: MAPREDUCE-2999.patch, MAPREDUCE-2999.patch, MAPREDUCE-2999.patch, MAPREDUCE-2999.patch, MAPREDUCE-2999.patch, MAPREDUCE-2999.patch Currently httpserver only has *.html, *.jsp as user facing urls when you add a filter. For the new web framework in yarn, the pages no longer have the *.html or *.jsp and thus they are not properly being filtered. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3021) all yarn webapps use same base name of yarn/
[ https://issues.apache.org/jira/browse/MAPREDUCE-3021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116424#comment-13116424 ] Hudson commented on MAPREDUCE-3021: --- Integrated in Hadoop-Mapreduce-0.23-Build #30 (See [https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/30/]) Merge -r 1176707:1176708 from trunk to branch-0.23 to fix MAPREDUCE-3021. Merge -r 1176680:1176681 from trunk to branch-0.23 to fix MAPREDUCE-3021. acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1176709 Files : * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/webapps/cluster * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/webapps/cluster/.keep * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/webapps/jobhistory * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/webapps/jobhistory/.keep * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/webapps/mapreduce * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/webapps/mapreduce/.keep * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/webapps/node * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/webapps/node/.keep acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1176683 Files : * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/client/MRClientService.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/NavBlock.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/TaskPage.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/jobhistory/JobHistoryUtils.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/main/java/org/apache/hadoop/mapreduce/v2/hs/HistoryClientService.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/conf/YarnConfiguration.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/test/java/org/apache/hadoop/yarn/conf * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/test/java/org/apache/hadoop/yarn/conf/TestYarnConfiguration.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/WebServer.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceManager.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/RmController.java all yarn webapps use same base name of yarn/ -- Key: MAPREDUCE-3021 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3021 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2 Affects Versions: 0.23.0 Reporter: Thomas Graves Assignee: Thomas Graves Fix For: 0.23.0 Attachments: MAPREDUCE-3021.patch, MAPREDUCE-3021.patch All of the yarn webapps (resource manager, node manager, app master, job history) use the same base url of /yarn/. This doesn't lend itself very well to filters be able to differentiate them to say allow some to be not authenticated and other to be authenticated. Perhaps we should rename them based on component. There are also things in the code that hardcode paths to /yarn that should be fixed up. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators:
[jira] [Commented] (MAPREDUCE-3110) TestRPC.testUnknownCall() is failing
[
https://issues.apache.org/jira/browse/MAPREDUCE-3110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116427#comment-13116427
]
Hudson commented on MAPREDUCE-3110:
---
Integrated in Hadoop-Mapreduce-0.23-Build #30 (See
[https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/30/])
MAPREDUCE-3110. svn merge -c r1176739 --ignore-ancestry ../../trunk/
vinodkv :
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1176740
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
*
/hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/test/java/org/apache/hadoop/yarn/TestRPC.java
TestRPC.testUnknownCall() is failing
Key: MAPREDUCE-3110
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3110
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: mrv2, test
Affects Versions: 0.23.0
Reporter: Devaraj K
Assignee: Vinod Kumar Vavilapalli
Fix For: 0.23.0
Attachments: MAPREDUCE-3110-20110928.txt
{code:xml}
Failed tests:
testUnknownCall(org.apache.hadoop.yarn.TestRPC): null
expected:...icationId called on []org.apache.hadoop.ya... but
was:...icationId called on [interface ]org.apache.hadoop.ya...
Tests run: 65, Failures: 1, Errors: 0, Skipped: 0
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3041) Enhance YARN Client-RM protocol to provide access to information such as cluster's Min/Max Resource capabilities similar to that of AM-RM protocol
[ https://issues.apache.org/jira/browse/MAPREDUCE-3041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116426#comment-13116426 ] Hudson commented on MAPREDUCE-3041: --- Integrated in Hadoop-Mapreduce-0.23-Build #30 (See [https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/30/]) Merge -r 1176714:1176715 from trunk to branch-0.23 to fix MAPREDUCE-3041. acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1176718 Files : * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ResourceMgrDelegate.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestClientRedirect.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/TestYARNRunner.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/ClientRMProtocol.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/protocolrecords/GetNewApplicationIdRequest.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/protocolrecords/GetNewApplicationIdResponse.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/protocolrecords/GetNewApplicationRequest.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/protocolrecords/GetNewApplicationResponse.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/protocolrecords/impl/pb/GetNewApplicationIdRequestPBImpl.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/protocolrecords/impl/pb/GetNewApplicationIdResponsePBImpl.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/protocolrecords/impl/pb/GetNewApplicationRequestPBImpl.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/protocolrecords/impl/pb/GetNewApplicationResponsePBImpl.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/proto/client_RM_protocol.proto * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/proto/yarn_service_protos.proto * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/api/impl/pb/client/ClientRMProtocolPBClientImpl.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/api/impl/pb/service/ClientRMProtocolPBServiceImpl.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/test/java/org/apache/hadoop/yarn/TestRPC.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ClientRMService.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/MockRM.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/TestRM.java Enhance YARN Client-RM protocol to provide access to information such as cluster's Min/Max Resource capabilities similar to that of AM-RM protocol -- Key: MAPREDUCE-3041 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3041 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2 Affects Versions: 0.23.0 Reporter: Hitesh Shah Assignee: Hitesh Shah Priority: Blocker Fix For: 0.23.0 Attachments: MR-3041.1.patch, MR-3041.2.patch, MR-3041.3.patch To request a
[jira] [Commented] (MAPREDUCE-3092) Remove JOB_ID_COMPARATOR usage in JobHistory.java
[ https://issues.apache.org/jira/browse/MAPREDUCE-3092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116433#comment-13116433 ] Hudson commented on MAPREDUCE-3092: --- Integrated in Hadoop-Mapreduce-0.23-Build #30 (See [https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/30/]) MAPREDUCE-3092. svn merge -c r1176453 --ignore-ancestry ../../trunk/ vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1176458 Files : * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/main/java/org/apache/hadoop/mapreduce/v2/hs/JobHistory.java Remove JOB_ID_COMPARATOR usage in JobHistory.java - Key: MAPREDUCE-3092 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3092 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2 Affects Versions: 0.24.0 Reporter: Devaraj K Assignee: Devaraj K Priority: Minor Fix For: 0.23.0, 0.24.0 Attachments: MAPREDUCE-3092.patch As part of the defect MAPREDUCE-2965, JobId.compareTo() has been implemented. Usage of JOB_ID_COMPARATOR in JobHistory.java can be removed because comparison is handling by JobId itself. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3081) Change the name format for hadoop core and vaidya jar to be hadoop-{core/vaidya}-{version}.jar in vaidya.sh
[
https://issues.apache.org/jira/browse/MAPREDUCE-3081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116434#comment-13116434
]
Hudson commented on MAPREDUCE-3081:
---
Integrated in Hadoop-Mapreduce-0.23-Build #30 (See
[https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/30/])
MAPREDUCE-3081. Fix vaidya startup script. Contributed by Suhas
gkesavan :
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1176563
Files :
* /hadoop/common/branches/branch-0.23
* /hadoop/common/branches/branch-0.23/hadoop-common-project
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common
*
/hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt
*
/hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/docs
*
/hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/java
*
/hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/test/core
* /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs
*
/hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/java
*
/hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/native
*
/hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/webapps/datanode
*
/hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/webapps/hdfs
*
/hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/webapps/secondary
*
/hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/test/hdfs
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/.gitignore
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/conf
*
/hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/conf/capacity-scheduler.xml.template
*
/hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/c++
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib
*
/hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/block_forensics
*
/hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/build-contrib.xml
*
/hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/build.xml
*
/hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/capacity-scheduler
*
/hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/data_join
*
/hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/dynamic-scheduler
*
/hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/eclipse-plugin
*
/hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/fairscheduler
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/index
*
/hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/streaming
*
/hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/vaidya
*
/hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/vaidya/src/java/org/apache/hadoop/vaidya/vaidya.sh
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/examples
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred
*
/hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/fs
*
/hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/hdfs
*
/hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/io/FileBench.java
*
/hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/io/TestSequenceFileMergeProgress.java
*
/hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/ipc
*
/hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/security/authorize/TestServiceLevelAuthorization.java
*
/hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/test/MapredTestDriver.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/webapps/job
Change the name format for hadoop core and vaidya jar to be
hadoop-{core/vaidya}-{version}.jar in vaidya.sh
---
Key: MAPREDUCE-3081
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3081
Project: Hadoop Map/Reduce
[jira] [Commented] (MAPREDUCE-3095) fairscheduler ivy including wrong version for hdfs
[ https://issues.apache.org/jira/browse/MAPREDUCE-3095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116430#comment-13116430 ] Hudson commented on MAPREDUCE-3095: --- Integrated in Hadoop-Mapreduce-0.23-Build #30 (See [https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/30/]) MAPREDUCE-3095. fairscheduler ivy including wrong version for hdfs. (John George via mahadev) - Merging r1176566 from trunk mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1176574 Files : * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/fairscheduler/ivy.xml fairscheduler ivy including wrong version for hdfs -- Key: MAPREDUCE-3095 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3095 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2 Affects Versions: 0.23.0 Reporter: John George Assignee: John George Fix For: 0.23.0 Attachments: mapreduce-3095.patch, mapreduce-branch-0.23.patch fairscheduler ivy.xml includes the common version for hdfs dependency. This could break builds that have different common and hdfs version numbers. The reason we dont see it on the jenkins build is because we use the same version number for common and hdfs. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3088) Clover 2.4.3 breaks build for 0.22 branch
[ https://issues.apache.org/jira/browse/MAPREDUCE-3088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116432#comment-13116432 ] Hudson commented on MAPREDUCE-3088: --- Integrated in Hadoop-Mapreduce-0.23-Build #30 (See [https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/30/]) MAPREDUCE-3088. Turn off Clover 2.4.3 until upgraded. Contributed by Konstantin Shvachko. shv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1176723 Files : * /hadoop/nightly/hudsonBuildHadoopNightly.sh Clover 2.4.3 breaks build for 0.22 branch - Key: MAPREDUCE-3088 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3088 Project: Hadoop Map/Reduce Issue Type: Bug Components: build Affects Versions: 0.22.0 Reporter: Konstantin Shvachko Assignee: Konstantin Shvachko Fix For: 0.22.0 Attachments: nightly.patch Due to known bug in Clover 2.4.3 build for 0.22 branch is broken. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2843) [MR-279] Node entries on the RM UI are not sortable
[ https://issues.apache.org/jira/browse/MAPREDUCE-2843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116431#comment-13116431 ] Hudson commented on MAPREDUCE-2843: --- Integrated in Hadoop-Mapreduce-0.23-Build #30 (See [https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/30/]) MAPREDUCE-2843. svn merge -c r1176730 --ignore-ancestry ../../trunk/ vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1176731 Files : * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/NodesPage.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/TestNodesPage.java [MR-279] Node entries on the RM UI are not sortable --- Key: MAPREDUCE-2843 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2843 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2 Affects Versions: 0.23.0, 0.24.0 Reporter: Ramya Sunil Assignee: Abhijit Suresh Shingate Fix For: 0.23.0, 0.24.0 Attachments: MAPREDUCE-2843- scr shot.jpg, MAPREDUCE-2843.1.patch, MAPREDUCE-2843.2.patch, MAPREDUCE-2843.3.patch, MAPREDUCE-2843.patch, MAPREDUCE-2843.patch The nodemanager entries on the RM UI is not sortable unlike the other web pages. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3099) Add docs for setting up a single node MRv2 cluster.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116438#comment-13116438 ] Hudson commented on MAPREDUCE-3099: --- Integrated in Hadoop-Mapreduce-0.23-Build #30 (See [https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/30/]) MAPREDUCE-3099. Add docs for setting up a single node MRv2 cluster. (mahadev) - Merging r1176607 from trunk mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1176610 Files : * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/src * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/src/site * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/src/site/apt * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/src/site/apt/SingleCluster.apt.vm * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/src/site/apt/index.apt.vm * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/src/site/site.xml Add docs for setting up a single node MRv2 cluster. --- Key: MAPREDUCE-3099 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3099 Project: Hadoop Map/Reduce Issue Type: Sub-task Affects Versions: 0.23.0 Reporter: Mahadev konar Assignee: Mahadev konar Fix For: 0.23.0 Attachments: MAPREDUCE-3099.patch -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3078) Application's progress isn't updated from AM to RM.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116429#comment-13116429 ] Hudson commented on MAPREDUCE-3078: --- Integrated in Hadoop-Mapreduce-0.23-Build #30 (See [https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/30/]) Merge -r 1176761:1176762 from trunk to branch-0.23 to fix MAPREDUCE-3078. acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1176763 Files : * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/pom.xml * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/MRAppMaster.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/job/impl/JobImpl.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/local/LocalContainerAllocator.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/rm/RMCommunicator.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/rm/RMContainerRequestor.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/TestRMContainerAllocator.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/util/MRBuilderUtils.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/pom.xml * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/pom.xml * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/util/BuilderUtils.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/pom.xml * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMAppManager.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceManager.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/RMApp.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/attempt/RMAppAttempt.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/attempt/RMAppAttemptImpl.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/SchedulerApp.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/event/NodeUpdateSchedulerEvent.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fifo/FifoScheduler.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/MockAM.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/applicationsmanager/TestAMRMRPCResponseId.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/MockRMApp.java *
[jira] [Commented] (MAPREDUCE-3054) Unable to kill submitted jobs
[ https://issues.apache.org/jira/browse/MAPREDUCE-3054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116436#comment-13116436 ] Hudson commented on MAPREDUCE-3054: --- Integrated in Hadoop-Mapreduce-0.23-Build #30 (See [https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/30/]) MAPREDUCE-3054. Unable to kill submitted jobs. (mahadev) - Merging r1176600 from trunk mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1176604 Files : * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ClientCache.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ClientServiceDelegate.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ResourceMgrDelegate.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/YARNRunner.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestClientRedirect.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/TestYARNRunner.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/ClientRMProtocol.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/protocolrecords/FinishApplicationRequest.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/protocolrecords/FinishApplicationResponse.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/protocolrecords/KillApplicationRequest.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/protocolrecords/KillApplicationResponse.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/protocolrecords/impl/pb/FinishApplicationRequestPBImpl.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/protocolrecords/impl/pb/FinishApplicationResponsePBImpl.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/protocolrecords/impl/pb/KillApplicationRequestPBImpl.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/protocolrecords/impl/pb/KillApplicationResponsePBImpl.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/proto/client_RM_protocol.proto * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/proto/yarn_service_protos.proto * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/api/impl/pb/client/ClientRMProtocolPBClientImpl.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/api/impl/pb/service/ClientRMProtocolPBServiceImpl.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/test/java/org/apache/hadoop/yarn/TestRPC.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ClientRMService.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/RMAppImpl.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/MockRM.java *
[jira] [Commented] (MAPREDUCE-3021) all yarn webapps use same base name of yarn/
[ https://issues.apache.org/jira/browse/MAPREDUCE-3021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116446#comment-13116446 ] Hudson commented on MAPREDUCE-3021: --- Integrated in Hadoop-Mapreduce-trunk #844 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/844/]) MAPREDUCE-3021. Adding additional files needed for new web-ui. MAPREDUCE-3021. Change base urls for RM web-ui. Contributed by Thomas Graves. acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1176708 Files : * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/webapps/cluster * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/webapps/cluster/.keep * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/webapps/jobhistory * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/webapps/jobhistory/.keep * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/webapps/mapreduce * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/webapps/mapreduce/.keep * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/webapps/node * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/webapps/node/.keep acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1176681 Files : * /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/client/MRClientService.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/NavBlock.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/TaskPage.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/jobhistory/JobHistoryUtils.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/main/java/org/apache/hadoop/mapreduce/v2/hs/HistoryClientService.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/conf/YarnConfiguration.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/test/java/org/apache/hadoop/yarn/conf * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/test/java/org/apache/hadoop/yarn/conf/TestYarnConfiguration.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/WebServer.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceManager.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/RmController.java all yarn webapps use same base name of yarn/ -- Key: MAPREDUCE-3021 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3021 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2 Affects Versions: 0.23.0 Reporter: Thomas Graves Assignee: Thomas Graves Fix For: 0.23.0 Attachments: MAPREDUCE-3021.patch, MAPREDUCE-3021.patch All of the yarn webapps (resource manager, node manager, app master, job history) use the same base url of /yarn/. This doesn't lend itself very well to filters be able to differentiate them to say allow some to be not authenticated and other to be authenticated. Perhaps we should rename them based on component. There are also things in the code that hardcode paths to /yarn that should be fixed up. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2999) hadoop.http.filter.initializers not working properly on yarn UI
[ https://issues.apache.org/jira/browse/MAPREDUCE-2999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116452#comment-13116452 ] Hudson commented on MAPREDUCE-2999: --- Integrated in Hadoop-Mapreduce-trunk #844 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/844/]) MAPREDUCE-2999. Fix YARN webapp framework to properly filter servlet paths. Contributed by Thomas Graves. vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1176469 Files : * /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/webapp/Dispatcher.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/webapp/WebApp.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/webapp/WebApps.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/test/java/org/apache/hadoop/yarn/webapp/TestWebApp.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmnode/RMNodeImpl.java hadoop.http.filter.initializers not working properly on yarn UI --- Key: MAPREDUCE-2999 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2999 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2 Affects Versions: 0.23.0 Reporter: Thomas Graves Assignee: Thomas Graves Priority: Critical Fix For: 0.23.0 Attachments: MAPREDUCE-2999.patch, MAPREDUCE-2999.patch, MAPREDUCE-2999.patch, MAPREDUCE-2999.patch, MAPREDUCE-2999.patch, MAPREDUCE-2999.patch Currently httpserver only has *.html, *.jsp as user facing urls when you add a filter. For the new web framework in yarn, the pages no longer have the *.html or *.jsp and thus they are not properly being filtered. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3081) Change the name format for hadoop core and vaidya jar to be hadoop-{core/vaidya}-{version}.jar in vaidya.sh
[
https://issues.apache.org/jira/browse/MAPREDUCE-3081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116458#comment-13116458
]
Hudson commented on MAPREDUCE-3081:
---
Integrated in Hadoop-Mapreduce-trunk #844 (See
[https://builds.apache.org/job/Hadoop-Mapreduce-trunk/844/])
MAPREDUCE-3081. Fix vaidya startup script. Contributed by Suhas
gkesavan :
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1176550
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
*
/hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/vaidya/src/java/org/apache/hadoop/vaidya/vaidya.sh
Change the name format for hadoop core and vaidya jar to be
hadoop-{core/vaidya}-{version}.jar in vaidya.sh
---
Key: MAPREDUCE-3081
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3081
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: contrib/vaidya
Affects Versions: 0.20.1, 0.20.205.0, 0.20.206.0
Reporter: vitthal (Suhas) Gogate
Fix For: 0.20.205.0, 0.23.0
Attachments: HADOOP-3081-trunk.patch, MAPREDUCE-3081-2.patch
Vaidya script is broken due to change in the naming convention for hadoop
core jar and vaidya jar.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3095) fairscheduler ivy including wrong version for hdfs
[ https://issues.apache.org/jira/browse/MAPREDUCE-3095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116453#comment-13116453 ] Hudson commented on MAPREDUCE-3095: --- Integrated in Hadoop-Mapreduce-trunk #844 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/844/]) MAPREDUCE-3095. fairscheduler ivy including wrong version for hdfs. (John George via mahadev) mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1176566 Files : * /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt * /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/fairscheduler/ivy.xml fairscheduler ivy including wrong version for hdfs -- Key: MAPREDUCE-3095 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3095 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2 Affects Versions: 0.23.0 Reporter: John George Assignee: John George Fix For: 0.23.0 Attachments: mapreduce-3095.patch, mapreduce-branch-0.23.patch fairscheduler ivy.xml includes the common version for hdfs dependency. This could break builds that have different common and hdfs version numbers. The reason we dont see it on the jenkins build is because we use the same version number for common and hdfs. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2843) [MR-279] Node entries on the RM UI are not sortable
[ https://issues.apache.org/jira/browse/MAPREDUCE-2843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116455#comment-13116455 ] Hudson commented on MAPREDUCE-2843: --- Integrated in Hadoop-Mapreduce-trunk #844 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/844/]) MAPREDUCE-2843. Fixed the node-table to be completely displayed and making node entries on RM UI to be sortable. Contributed by Abhijit Suresh Shingate. vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1176730 Files : * /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/NodesPage.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/TestNodesPage.java [MR-279] Node entries on the RM UI are not sortable --- Key: MAPREDUCE-2843 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2843 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2 Affects Versions: 0.23.0, 0.24.0 Reporter: Ramya Sunil Assignee: Abhijit Suresh Shingate Fix For: 0.23.0, 0.24.0 Attachments: MAPREDUCE-2843- scr shot.jpg, MAPREDUCE-2843.1.patch, MAPREDUCE-2843.2.patch, MAPREDUCE-2843.3.patch, MAPREDUCE-2843.patch, MAPREDUCE-2843.patch The nodemanager entries on the RM UI is not sortable unlike the other web pages. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3078) Application's progress isn't updated from AM to RM.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116454#comment-13116454 ] Hudson commented on MAPREDUCE-3078: --- Integrated in Hadoop-Mapreduce-trunk #844 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/844/]) MAPREDUCE-3078. Ensure MapReduce AM reports progress correctly for displaying on the RM Web-UI. Contributed by Vinod K V. acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1176762 Files : * /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/pom.xml * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/MRAppMaster.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/job/impl/JobImpl.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/local/LocalContainerAllocator.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/rm/RMCommunicator.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/rm/RMContainerRequestor.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/TestRMContainerAllocator.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/util/MRBuilderUtils.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/pom.xml * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/pom.xml * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/util/BuilderUtils.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/pom.xml * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMAppManager.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceManager.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/RMApp.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/attempt/RMAppAttempt.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/attempt/RMAppAttemptImpl.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/SchedulerApp.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/event/NodeUpdateSchedulerEvent.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fifo/FifoScheduler.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/MockAM.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/applicationsmanager/TestAMRMRPCResponseId.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/MockRMApp.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-tests/src/test/java/org/apache/hadoop/yarn/server/TestContainerTokenSecretManager.java Application's progress isn't updated from AM to RM. ---
[jira] [Commented] (MAPREDUCE-3088) Clover 2.4.3 breaks build for 0.22 branch
[ https://issues.apache.org/jira/browse/MAPREDUCE-3088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116456#comment-13116456 ] Hudson commented on MAPREDUCE-3088: --- Integrated in Hadoop-Mapreduce-trunk #844 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/844/]) MAPREDUCE-3088. Turn off Clover 2.4.3 until upgraded. Contributed by Konstantin Shvachko. shv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1176723 Files : * /hadoop/nightly/hudsonBuildHadoopNightly.sh Clover 2.4.3 breaks build for 0.22 branch - Key: MAPREDUCE-3088 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3088 Project: Hadoop Map/Reduce Issue Type: Bug Components: build Affects Versions: 0.22.0 Reporter: Konstantin Shvachko Assignee: Konstantin Shvachko Fix For: 0.22.0 Attachments: nightly.patch Due to known bug in Clover 2.4.3 build for 0.22 branch is broken. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3110) TestRPC.testUnknownCall() is failing
[
https://issues.apache.org/jira/browse/MAPREDUCE-3110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116451#comment-13116451
]
Hudson commented on MAPREDUCE-3110:
---
Integrated in Hadoop-Mapreduce-trunk #844 (See
[https://builds.apache.org/job/Hadoop-Mapreduce-trunk/844/])
MAPREDUCE-3110. Fixed TestRPC failure. Contributed by Vinod Kumar
Vavilapalli.
vinodkv :
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1176739
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
*
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/test/java/org/apache/hadoop/yarn/TestRPC.java
TestRPC.testUnknownCall() is failing
Key: MAPREDUCE-3110
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3110
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: mrv2, test
Affects Versions: 0.23.0
Reporter: Devaraj K
Assignee: Vinod Kumar Vavilapalli
Fix For: 0.23.0
Attachments: MAPREDUCE-3110-20110928.txt
{code:xml}
Failed tests:
testUnknownCall(org.apache.hadoop.yarn.TestRPC): null
expected:...icationId called on []org.apache.hadoop.ya... but
was:...icationId called on [interface ]org.apache.hadoop.ya...
Tests run: 65, Failures: 1, Errors: 0, Skipped: 0
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3054) Unable to kill submitted jobs
[ https://issues.apache.org/jira/browse/MAPREDUCE-3054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116459#comment-13116459 ] Hudson commented on MAPREDUCE-3054: --- Integrated in Hadoop-Mapreduce-trunk #844 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/844/]) MAPREDUCE-3054. Unable to kill submitted jobs. (mahadev) mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1176600 Files : * /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ClientCache.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ClientServiceDelegate.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ResourceMgrDelegate.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/YARNRunner.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestClientRedirect.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/TestYARNRunner.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/ClientRMProtocol.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/protocolrecords/FinishApplicationRequest.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/protocolrecords/FinishApplicationResponse.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/protocolrecords/KillApplicationRequest.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/protocolrecords/KillApplicationResponse.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/protocolrecords/impl/pb/FinishApplicationRequestPBImpl.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/protocolrecords/impl/pb/FinishApplicationResponsePBImpl.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/protocolrecords/impl/pb/KillApplicationRequestPBImpl.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/protocolrecords/impl/pb/KillApplicationResponsePBImpl.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/proto/client_RM_protocol.proto * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/proto/yarn_service_protos.proto * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/api/impl/pb/client/ClientRMProtocolPBClientImpl.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/api/impl/pb/service/ClientRMProtocolPBServiceImpl.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ClientRMService.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/RMAppImpl.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/MockRM.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/resourcetracker/InlineDispatcher.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/TestRMAppTransitions.java Unable to kill submitted jobs - Key: MAPREDUCE-3054 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3054 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2 Affects Versions: 0.23.0
[jira] [Commented] (MAPREDUCE-3099) Add docs for setting up a single node MRv2 cluster.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116462#comment-13116462 ] Hudson commented on MAPREDUCE-3099: --- Integrated in Hadoop-Mapreduce-trunk #844 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/844/]) MAPREDUCE-3099. Add docs for setting up a single node MRv2 cluster. (mahadev) mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1176607 Files : * /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/src * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/src/site * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/src/site/apt * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/src/site/apt/SingleCluster.apt.vm * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/src/site/apt/index.apt.vm * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/src/site/site.xml Add docs for setting up a single node MRv2 cluster. --- Key: MAPREDUCE-3099 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3099 Project: Hadoop Map/Reduce Issue Type: Sub-task Affects Versions: 0.23.0 Reporter: Mahadev konar Assignee: Mahadev konar Fix For: 0.23.0 Attachments: MAPREDUCE-3099.patch -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (MAPREDUCE-3114) Invalid ApplicationMaster URL in Applications Page
Invalid ApplicationMaster URL in Applications Page -- Key: MAPREDUCE-3114 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3114 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2 Affects Versions: 0.23.0 Reporter: Subroto Sanyal Assignee: Subroto Sanyal Fix For: 0.23.0 When the Application is in Accepted state and user tries to click the ApplicationMaster URL in Applications Page, it ends up in Invalid HTTP URL. The screenshot attached with this Issue makes it more clear. The HTTP url formed is: http://n/A -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3114) Invalid ApplicationMaster URL in Applications Page
[ https://issues.apache.org/jira/browse/MAPREDUCE-3114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subroto Sanyal updated MAPREDUCE-3114: -- Attachment: Wrong URL.PNG Invalid ApplicationMaster URL in Applications Page -- Key: MAPREDUCE-3114 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3114 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2 Affects Versions: 0.23.0 Reporter: Subroto Sanyal Assignee: Subroto Sanyal Fix For: 0.23.0 Attachments: Wrong URL.PNG When the Application is in Accepted state and user tries to click the ApplicationMaster URL in Applications Page, it ends up in Invalid HTTP URL. The screenshot attached with this Issue makes it more clear. The HTTP url formed is: http://n/A -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3041) Enhance YARN Client-RM protocol to provide access to information such as cluster's Min/Max Resource capabilities similar to that of AM-RM protocol
[ https://issues.apache.org/jira/browse/MAPREDUCE-3041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116472#comment-13116472 ] Hudson commented on MAPREDUCE-3041: --- Integrated in Hadoop-Hdfs-0.23-Build #23 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/23/]) Merge -r 1176714:1176715 from trunk to branch-0.23 to fix MAPREDUCE-3041. acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1176718 Files : * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ResourceMgrDelegate.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestClientRedirect.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/TestYARNRunner.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/ClientRMProtocol.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/protocolrecords/GetNewApplicationIdRequest.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/protocolrecords/GetNewApplicationIdResponse.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/protocolrecords/GetNewApplicationRequest.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/protocolrecords/GetNewApplicationResponse.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/protocolrecords/impl/pb/GetNewApplicationIdRequestPBImpl.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/protocolrecords/impl/pb/GetNewApplicationIdResponsePBImpl.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/protocolrecords/impl/pb/GetNewApplicationRequestPBImpl.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/protocolrecords/impl/pb/GetNewApplicationResponsePBImpl.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/proto/client_RM_protocol.proto * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/proto/yarn_service_protos.proto * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/api/impl/pb/client/ClientRMProtocolPBClientImpl.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/api/impl/pb/service/ClientRMProtocolPBServiceImpl.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/test/java/org/apache/hadoop/yarn/TestRPC.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ClientRMService.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/MockRM.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/TestRM.java Enhance YARN Client-RM protocol to provide access to information such as cluster's Min/Max Resource capabilities similar to that of AM-RM protocol -- Key: MAPREDUCE-3041 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3041 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2 Affects Versions: 0.23.0 Reporter: Hitesh Shah Assignee: Hitesh Shah Priority: Blocker Fix For: 0.23.0 Attachments: MR-3041.1.patch, MR-3041.2.patch, MR-3041.3.patch To request a container to
[jira] [Commented] (MAPREDUCE-2999) hadoop.http.filter.initializers not working properly on yarn UI
[ https://issues.apache.org/jira/browse/MAPREDUCE-2999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116474#comment-13116474 ] Hudson commented on MAPREDUCE-2999: --- Integrated in Hadoop-Hdfs-0.23-Build #23 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/23/]) MAPREDUCE-2999. svn merge -c r1176469 --ignore-ancestry ../../trunk/ vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1176470 Files : * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/webapp/Dispatcher.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/webapp/WebApp.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/webapp/WebApps.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/test/java/org/apache/hadoop/yarn/webapp/TestWebApp.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmnode/RMNodeImpl.java hadoop.http.filter.initializers not working properly on yarn UI --- Key: MAPREDUCE-2999 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2999 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2 Affects Versions: 0.23.0 Reporter: Thomas Graves Assignee: Thomas Graves Priority: Critical Fix For: 0.23.0 Attachments: MAPREDUCE-2999.patch, MAPREDUCE-2999.patch, MAPREDUCE-2999.patch, MAPREDUCE-2999.patch, MAPREDUCE-2999.patch, MAPREDUCE-2999.patch Currently httpserver only has *.html, *.jsp as user facing urls when you add a filter. For the new web framework in yarn, the pages no longer have the *.html or *.jsp and thus they are not properly being filtered. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3110) TestRPC.testUnknownCall() is failing
[
https://issues.apache.org/jira/browse/MAPREDUCE-3110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116473#comment-13116473
]
Hudson commented on MAPREDUCE-3110:
---
Integrated in Hadoop-Hdfs-0.23-Build #23 (See
[https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/23/])
MAPREDUCE-3110. svn merge -c r1176739 --ignore-ancestry ../../trunk/
vinodkv :
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1176740
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
*
/hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/test/java/org/apache/hadoop/yarn/TestRPC.java
TestRPC.testUnknownCall() is failing
Key: MAPREDUCE-3110
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3110
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: mrv2, test
Affects Versions: 0.23.0
Reporter: Devaraj K
Assignee: Vinod Kumar Vavilapalli
Fix For: 0.23.0
Attachments: MAPREDUCE-3110-20110928.txt
{code:xml}
Failed tests:
testUnknownCall(org.apache.hadoop.yarn.TestRPC): null
expected:...icationId called on []org.apache.hadoop.ya... but
was:...icationId called on [interface ]org.apache.hadoop.ya...
Tests run: 65, Failures: 1, Errors: 0, Skipped: 0
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3021) all yarn webapps use same base name of yarn/
[ https://issues.apache.org/jira/browse/MAPREDUCE-3021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116470#comment-13116470 ] Hudson commented on MAPREDUCE-3021: --- Integrated in Hadoop-Hdfs-0.23-Build #23 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/23/]) Merge -r 1176707:1176708 from trunk to branch-0.23 to fix MAPREDUCE-3021. Merge -r 1176680:1176681 from trunk to branch-0.23 to fix MAPREDUCE-3021. acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1176709 Files : * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/webapps/cluster * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/webapps/cluster/.keep * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/webapps/jobhistory * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/webapps/jobhistory/.keep * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/webapps/mapreduce * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/webapps/mapreduce/.keep * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/webapps/node * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/webapps/node/.keep acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1176683 Files : * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/client/MRClientService.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/NavBlock.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/TaskPage.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/jobhistory/JobHistoryUtils.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/main/java/org/apache/hadoop/mapreduce/v2/hs/HistoryClientService.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/conf/YarnConfiguration.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/test/java/org/apache/hadoop/yarn/conf * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/test/java/org/apache/hadoop/yarn/conf/TestYarnConfiguration.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/WebServer.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceManager.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/RmController.java all yarn webapps use same base name of yarn/ -- Key: MAPREDUCE-3021 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3021 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2 Affects Versions: 0.23.0 Reporter: Thomas Graves Assignee: Thomas Graves Fix For: 0.23.0 Attachments: MAPREDUCE-3021.patch, MAPREDUCE-3021.patch All of the yarn webapps (resource manager, node manager, app master, job history) use the same base url of /yarn/. This doesn't lend itself very well to filters be able to differentiate them to say allow some to be not authenticated and other to be authenticated. Perhaps we should rename them based on component. There are also things in the code that hardcode paths to /yarn that should be fixed up. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators:
[jira] [Commented] (MAPREDUCE-3099) Add docs for setting up a single node MRv2 cluster.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116483#comment-13116483 ] Hudson commented on MAPREDUCE-3099: --- Integrated in Hadoop-Hdfs-0.23-Build #23 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/23/]) MAPREDUCE-3099. Add docs for setting up a single node MRv2 cluster. (mahadev) - Merging r1176607 from trunk mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1176610 Files : * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/src * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/src/site * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/src/site/apt * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/src/site/apt/SingleCluster.apt.vm * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/src/site/apt/index.apt.vm * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/src/site/site.xml Add docs for setting up a single node MRv2 cluster. --- Key: MAPREDUCE-3099 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3099 Project: Hadoop Map/Reduce Issue Type: Sub-task Affects Versions: 0.23.0 Reporter: Mahadev konar Assignee: Mahadev konar Fix For: 0.23.0 Attachments: MAPREDUCE-3099.patch -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3092) Remove JOB_ID_COMPARATOR usage in JobHistory.java
[ https://issues.apache.org/jira/browse/MAPREDUCE-3092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116479#comment-13116479 ] Hudson commented on MAPREDUCE-3092: --- Integrated in Hadoop-Hdfs-0.23-Build #23 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/23/]) MAPREDUCE-3092. svn merge -c r1176453 --ignore-ancestry ../../trunk/ vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1176458 Files : * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/main/java/org/apache/hadoop/mapreduce/v2/hs/JobHistory.java Remove JOB_ID_COMPARATOR usage in JobHistory.java - Key: MAPREDUCE-3092 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3092 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2 Affects Versions: 0.24.0 Reporter: Devaraj K Assignee: Devaraj K Priority: Minor Fix For: 0.23.0, 0.24.0 Attachments: MAPREDUCE-3092.patch As part of the defect MAPREDUCE-2965, JobId.compareTo() has been implemented. Usage of JOB_ID_COMPARATOR in JobHistory.java can be removed because comparison is handling by JobId itself. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3095) fairscheduler ivy including wrong version for hdfs
[ https://issues.apache.org/jira/browse/MAPREDUCE-3095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116476#comment-13116476 ] Hudson commented on MAPREDUCE-3095: --- Integrated in Hadoop-Hdfs-0.23-Build #23 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/23/]) MAPREDUCE-3095. fairscheduler ivy including wrong version for hdfs. (John George via mahadev) - Merging r1176566 from trunk mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1176574 Files : * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/fairscheduler/ivy.xml fairscheduler ivy including wrong version for hdfs -- Key: MAPREDUCE-3095 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3095 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2 Affects Versions: 0.23.0 Reporter: John George Assignee: John George Fix For: 0.23.0 Attachments: mapreduce-3095.patch, mapreduce-branch-0.23.patch fairscheduler ivy.xml includes the common version for hdfs dependency. This could break builds that have different common and hdfs version numbers. The reason we dont see it on the jenkins build is because we use the same version number for common and hdfs. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2843) [MR-279] Node entries on the RM UI are not sortable
[ https://issues.apache.org/jira/browse/MAPREDUCE-2843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116477#comment-13116477 ] Hudson commented on MAPREDUCE-2843: --- Integrated in Hadoop-Hdfs-0.23-Build #23 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/23/]) MAPREDUCE-2843. svn merge -c r1176730 --ignore-ancestry ../../trunk/ vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1176731 Files : * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/NodesPage.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/TestNodesPage.java [MR-279] Node entries on the RM UI are not sortable --- Key: MAPREDUCE-2843 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2843 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2 Affects Versions: 0.23.0, 0.24.0 Reporter: Ramya Sunil Assignee: Abhijit Suresh Shingate Fix For: 0.23.0, 0.24.0 Attachments: MAPREDUCE-2843- scr shot.jpg, MAPREDUCE-2843.1.patch, MAPREDUCE-2843.2.patch, MAPREDUCE-2843.3.patch, MAPREDUCE-2843.patch, MAPREDUCE-2843.patch The nodemanager entries on the RM UI is not sortable unlike the other web pages. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3081) Change the name format for hadoop core and vaidya jar to be hadoop-{core/vaidya}-{version}.jar in vaidya.sh
[
https://issues.apache.org/jira/browse/MAPREDUCE-3081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116482#comment-13116482
]
Hudson commented on MAPREDUCE-3081:
---
Integrated in Hadoop-Hdfs-0.23-Build #23 (See
[https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/23/])
MAPREDUCE-3081. Fix vaidya startup script. Contributed by Suhas
gkesavan :
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1176563
Files :
* /hadoop/common/branches/branch-0.23
* /hadoop/common/branches/branch-0.23/hadoop-common-project
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common
*
/hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt
*
/hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/docs
*
/hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/java
*
/hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/test/core
* /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs
*
/hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/java
*
/hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/native
*
/hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/webapps/datanode
*
/hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/webapps/hdfs
*
/hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/webapps/secondary
*
/hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/test/hdfs
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/.gitignore
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/conf
*
/hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/conf/capacity-scheduler.xml.template
*
/hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/c++
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib
*
/hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/block_forensics
*
/hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/build-contrib.xml
*
/hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/build.xml
*
/hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/capacity-scheduler
*
/hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/data_join
*
/hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/dynamic-scheduler
*
/hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/eclipse-plugin
*
/hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/fairscheduler
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/index
*
/hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/streaming
*
/hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/vaidya
*
/hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/vaidya/src/java/org/apache/hadoop/vaidya/vaidya.sh
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/examples
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred
*
/hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/fs
*
/hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/hdfs
*
/hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/io/FileBench.java
*
/hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/io/TestSequenceFileMergeProgress.java
*
/hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/ipc
*
/hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/security/authorize/TestServiceLevelAuthorization.java
*
/hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/test/MapredTestDriver.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/webapps/job
Change the name format for hadoop core and vaidya jar to be
hadoop-{core/vaidya}-{version}.jar in vaidya.sh
---
Key: MAPREDUCE-3081
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3081
Project: Hadoop Map/Reduce
Issue
[jira] [Commented] (MAPREDUCE-3078) Application's progress isn't updated from AM to RM.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116475#comment-13116475 ] Hudson commented on MAPREDUCE-3078: --- Integrated in Hadoop-Hdfs-0.23-Build #23 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/23/]) Merge -r 1176761:1176762 from trunk to branch-0.23 to fix MAPREDUCE-3078. acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1176763 Files : * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/pom.xml * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/MRAppMaster.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/job/impl/JobImpl.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/local/LocalContainerAllocator.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/rm/RMCommunicator.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/rm/RMContainerRequestor.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/TestRMContainerAllocator.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/util/MRBuilderUtils.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/pom.xml * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/pom.xml * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/util/BuilderUtils.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/pom.xml * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMAppManager.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceManager.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/RMApp.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/attempt/RMAppAttempt.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/attempt/RMAppAttemptImpl.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/SchedulerApp.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/event/NodeUpdateSchedulerEvent.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fifo/FifoScheduler.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/MockAM.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/applicationsmanager/TestAMRMRPCResponseId.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/MockRMApp.java *
[jira] [Commented] (MAPREDUCE-3054) Unable to kill submitted jobs
[ https://issues.apache.org/jira/browse/MAPREDUCE-3054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116481#comment-13116481 ] Hudson commented on MAPREDUCE-3054: --- Integrated in Hadoop-Hdfs-0.23-Build #23 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/23/]) MAPREDUCE-3054. Unable to kill submitted jobs. (mahadev) - Merging r1176600 from trunk mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1176604 Files : * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ClientCache.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ClientServiceDelegate.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ResourceMgrDelegate.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/YARNRunner.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestClientRedirect.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/TestYARNRunner.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/ClientRMProtocol.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/protocolrecords/FinishApplicationRequest.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/protocolrecords/FinishApplicationResponse.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/protocolrecords/KillApplicationRequest.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/protocolrecords/KillApplicationResponse.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/protocolrecords/impl/pb/FinishApplicationRequestPBImpl.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/protocolrecords/impl/pb/FinishApplicationResponsePBImpl.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/protocolrecords/impl/pb/KillApplicationRequestPBImpl.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/protocolrecords/impl/pb/KillApplicationResponsePBImpl.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/proto/client_RM_protocol.proto * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/proto/yarn_service_protos.proto * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/api/impl/pb/client/ClientRMProtocolPBClientImpl.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/api/impl/pb/service/ClientRMProtocolPBServiceImpl.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/test/java/org/apache/hadoop/yarn/TestRPC.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ClientRMService.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/RMAppImpl.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/MockRM.java * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/resourcetracker/InlineDispatcher.java *
[jira] [Created] (MAPREDUCE-3115) OOM When the value for the property mapred.map.multithreadedrunner.class is set to MultithreadedMapper instance.
OOM When the value for the property mapred.map.multithreadedrunner.class is set to MultithreadedMapper instance. -- Key: MAPREDUCE-3115 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3115 Project: Hadoop Map/Reduce Issue Type: Bug Environment: NA Reporter: Bhallamudi Venkata Siva Kamesh When we set the value for the property *mapred.map.multithreadedrunner.class* as instance of MultithreadedMapper, using MultithreadedMapper.setMapperClass(), it simply throws IllegalArgumentException. But when we set the same property, using job's conf object using job.getConfiguration().setClass(*mapred.map.multithreadedrunner.class*, MultithreadedMapper.class, Mapper.class), throws OOM. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3115) OOM When the value for the property mapred.map.multithreadedrunner.class is set to MultithreadedMapper instance.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116491#comment-13116491 ] Bhallamudi Venkata Siva Kamesh commented on MAPREDUCE-3115: --- When we set instace of MultithreadedMapper using job.getConfiguration().setClass(mapred.map.multithreadedrunner.class, MultithreadedMapper.class, Mapper.class), the same class acts as mapClass. so it calls recursively itself, till OOM occures. OOM When the value for the property mapred.map.multithreadedrunner.class is set to MultithreadedMapper instance. -- Key: MAPREDUCE-3115 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3115 Project: Hadoop Map/Reduce Issue Type: Bug Environment: NA Reporter: Bhallamudi Venkata Siva Kamesh When we set the value for the property *mapred.map.multithreadedrunner.class* as instance of MultithreadedMapper, using MultithreadedMapper.setMapperClass(), it simply throws IllegalArgumentException. But when we set the same property, using job's conf object using job.getConfiguration().setClass(*mapred.map.multithreadedrunner.class*, MultithreadedMapper.class, Mapper.class), throws OOM. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3001) Map Reduce JobHistory and AppMaster UI should have ability to display task specific counters.
[
https://issues.apache.org/jira/browse/MAPREDUCE-3001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinod Kumar Vavilapalli updated MAPREDUCE-3001:
---
Status: Open (was: Patch Available)
Really cool patch, great job!
Particularly I just loved singlejobcounters page. It helps us to compare across
all tasks things like memory usage, input records etc.
Minor improvement, not caused by your patch: The Counter Group section on the
counters-page isn't going well with the rest of the page looks-wise. In the
minimum we should fix the wrapping, right now names of some counters like
org.​apache.​hadoop.​mapreduce.​lib.​output.​FileOutputFormatCounter are not
getting displayed completely.
One bug I ran into with failed job with failed tasks:
{code}
Caused by: java.lang.NullPointerException
at
org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.render(CountersBlock.java:85)
at
org.apache.hadoop.yarn.webapp.view.HtmlBlock.render(HtmlBlock.java:64)
at
org.apache.hadoop.yarn.webapp.view.HtmlBlock.renderPartial(HtmlBlock.java:74)
at org.apache.hadoop.yarn.webapp.View.render(View.java:210)
at
org.apache.hadoop.yarn.webapp.view.HtmlPage$Page.subView(HtmlPage.java:47)
at
org.apache.hadoop.yarn.webapp.hamlet.HamletImpl$EImp._v(HamletImpl.java:117)
at org.apache.hadoop.yarn.webapp.hamlet.Hamlet$TD._(Hamlet.java:843)
at
org.apache.hadoop.yarn.webapp.view.TwoColumnLayout.render(TwoColumnLayout.java:54)
at org.apache.hadoop.yarn.webapp.view.HtmlPage.render(HtmlPage.java:80)
at org.apache.hadoop.yarn.webapp.Controller.render(Controller.java:210)
at
org.apache.hadoop.mapreduce.v2.app.webapp.AppController.taskCounters(AppController.java:123)
at
org.apache.hadoop.mapreduce.v2.hs.webapp.HsController.taskCounters(HsController.java:120)
... 32 more
{code}
You will need to check for absent counters for failed attempts, tasks.
Thanks for doing this!
Map Reduce JobHistory and AppMaster UI should have ability to display task
specific counters.
-
Key: MAPREDUCE-3001
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3001
Project: Hadoop Map/Reduce
Issue Type: Improvement
Components: jobhistoryserver, mrv2
Affects Versions: 0.23.0, 0.24.0
Reporter: Robert Joseph Evans
Assignee: Robert Joseph Evans
Priority: Blocker
Fix For: 0.23.0, 0.24.0
Attachments: MR-3001.txt
Map Reduce JobHistory and AppMaster UI should have ability to display task
specific counters. I think the best way to do this is to include in the Nav
Block a task specific section with task links when a task is selected.
Counters is already set up to deal with a task passed in.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3114) Invalid ApplicationMaster URL in Applications Page
[ https://issues.apache.org/jira/browse/MAPREDUCE-3114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116500#comment-13116500 ] Vinod Kumar Vavilapalli commented on MAPREDUCE-3114: Yes, please change it to display no link when the App is not yet RUNNING. Also, while you are at it, can you rename the link-name from ApplicationMaster URL to just ApplicationMaster and JobHistory URL to just History? Thanks! Invalid ApplicationMaster URL in Applications Page -- Key: MAPREDUCE-3114 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3114 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2 Affects Versions: 0.23.0 Reporter: Subroto Sanyal Assignee: Subroto Sanyal Fix For: 0.23.0 Attachments: Wrong URL.PNG When the Application is in Accepted state and user tries to click the ApplicationMaster URL in Applications Page, it ends up in Invalid HTTP URL. The screenshot attached with this Issue makes it more clear. The HTTP url formed is: http://n/A -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (MAPREDUCE-2892) Improvements to AM apis
[ https://issues.apache.org/jira/browse/MAPREDUCE-2892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli resolved MAPREDUCE-2892. Resolution: Duplicate Being fixed as part of MAPREDUCE-3098. Improvements to AM apis --- Key: MAPREDUCE-2892 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2892 Project: Hadoop Map/Reduce Issue Type: Sub-task Components: mr-am, mrv2, resourcemanager Affects Versions: 0.23.0 Reporter: Arun C Murthy Assignee: Hitesh Shah Priority: Blocker Fix For: 0.23.0 Some api changes before we declare yarn apis as stable: # FinishApplicationMasterRequest doesn't need to send out 'tracking url'. # FinishApplicationMasterRequest shouldn't use 'string' as final state - it's got to be an enum and we need to use that enum appropriately in the RM's state-machines. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3001) Map Reduce JobHistory and AppMaster UI should have ability to display task specific counters.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116504#comment-13116504 ] Robert Joseph Evans commented on MAPREDUCE-3001: Thanks for the testing. I will look into the failure. As for the counters block I can try and see what I can do for it, but I am not a web expert, I know enough to ask questions and break things :). Luke wrote that code and I don't completely understand it. There are loops inside of loops to make multiple nested tables and how the CSS/jquery datatable initialization interacts with that to make the layout what he wants is a bit beyond me. But I can see what I can do. Map Reduce JobHistory and AppMaster UI should have ability to display task specific counters. - Key: MAPREDUCE-3001 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3001 Project: Hadoop Map/Reduce Issue Type: Improvement Components: jobhistoryserver, mrv2 Affects Versions: 0.23.0, 0.24.0 Reporter: Robert Joseph Evans Assignee: Robert Joseph Evans Priority: Blocker Fix For: 0.23.0, 0.24.0 Attachments: MR-3001.txt Map Reduce JobHistory and AppMaster UI should have ability to display task specific counters. I think the best way to do this is to include in the Nav Block a task specific section with task links when a task is selected. Counters is already set up to deal with a task passed in. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3050) YarnScheduler needs to expose Resource Usage Information
[ https://issues.apache.org/jira/browse/MAPREDUCE-3050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated MAPREDUCE-3050: --- Component/s: mrv2 I wasn't looking at this because of the missing Mrv2 tag :) Reviewing the patch now, please gimme a day. YarnScheduler needs to expose Resource Usage Information Key: MAPREDUCE-3050 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3050 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2, resourcemanager Affects Versions: 0.23.0, 0.24.0 Reporter: Robert Joseph Evans Assignee: Robert Joseph Evans Priority: Blocker Fix For: 0.23.0, 0.24.0 Attachments: MR-3050.txt, MR-3050.txt, MR-3050.txt, MR-3050.txt Before the recent refactor The nodes had information in them about how much resources they were using. This information is not hidden inside SchedulerNode. Similarly resource usage information about an application, or in aggregate is only available through the Scheduler and there is not interface to pull it out. We need to expose APIs to get Resource and Container information from the scheduler, in aggregate across the entire cluster, per application, per node, and ideally also per queue if applicable (although there are no JIRAs I am aware of that need this right now). -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3050) YarnScheduler needs to expose Resource Usage Information
[ https://issues.apache.org/jira/browse/MAPREDUCE-3050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116515#comment-13116515 ] Robert Joseph Evans commented on MAPREDUCE-3050: Sorry about that. I thought that because there is resourcemanager now and I did not touch the applicationmaster or the mr app client and the mrv2 code is in trunk that I did not need it. It almost seems that everything targeted to 0.23 or 0.24 and is a MAPREDCUE JIRA is mrv2. I am a bit confused about what mrv2 really means. If it is just hey Vinod take a look at this, then I am happy to use it as such :). YarnScheduler needs to expose Resource Usage Information Key: MAPREDUCE-3050 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3050 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2, resourcemanager Affects Versions: 0.23.0, 0.24.0 Reporter: Robert Joseph Evans Assignee: Robert Joseph Evans Priority: Blocker Fix For: 0.23.0, 0.24.0 Attachments: MR-3050.txt, MR-3050.txt, MR-3050.txt, MR-3050.txt Before the recent refactor The nodes had information in them about how much resources they were using. This information is not hidden inside SchedulerNode. Similarly resource usage information about an application, or in aggregate is only available through the Scheduler and there is not interface to pull it out. We need to expose APIs to get Resource and Container information from the scheduler, in aggregate across the entire cluster, per application, per node, and ideally also per queue if applicable (although there are no JIRAs I am aware of that need this right now). -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2777) Backport MAPREDUCE-220 to Hadoop 20 security branch
[ https://issues.apache.org/jira/browse/MAPREDUCE-2777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley updated MAPREDUCE-2777: -- Fix Version/s: 0.20.206.0 Backport MAPREDUCE-220 to Hadoop 20 security branch --- Key: MAPREDUCE-2777 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2777 Project: Hadoop Map/Reduce Issue Type: New Feature Affects Versions: 0.20.205.0 Reporter: Jonathan Eagles Assignee: Amar Kamat Fix For: 0.20.206.0 Attachments: mapreduce-2777-v1.3.patch -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3112) Calling hadoop cli inside mapreduce job leads to errors
[
https://issues.apache.org/jira/browse/MAPREDUCE-3112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116551#comment-13116551
]
Eric Yang commented on MAPREDUCE-3112:
--
In previous release of HADOOP, we don't have this problem because we are always
reconstructing HADOOP_OPTS from scratch in the invoking process.
hadoop.log.dir is setup by the parent process to ensure the output are
redirected properly to the desired location. This change was done as part of
request from HCatalog to have ability to override the HADOOP_OPTS. HCatalog's
request may be supported by changing HADOOP_OPTS overrides to HADOOP_USER_OPTS,
and make HADOOP_USER_OPTS as the prefix of HADOOP_OPTS.
In streaming job, we should unset HADOOP_ROOT_LOGGER environment variable to
ensure hadoop command invoked in streaming job is output to console which gets
redirected to TaskLogAppender by the task attempt.
Calling hadoop cli inside mapreduce job leads to errors
---
Key: MAPREDUCE-3112
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3112
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: contrib/streaming
Affects Versions: 0.20.205.0
Environment: Java, Linux
Reporter: Eric Yang
Assignee: Eric Yang
Fix For: 0.20.205.0
When running a streaming job with mapper
bin/hadoop --config /etc/hadoop/ jar
contrib/streaming/hadoop-streaming-0.20.205.0.jar -mapper hadoop --config
/etc/hadoop/ dfs -help -reducer NONE -input /tmp/input.txt -output NONE
Task log shows:
{noformat}
Exception in thread main java.lang.ExceptionInInitializerError
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:57)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
at org.apache.hadoop.fs.FsShell.main(FsShell.java:1895)
Caused by: org.apache.commons.logging.LogConfigurationException:
User-specified log class 'org.apache.commons.logging.impl.Log4JLogger' cannot
be found or is not useable.
at
org.apache.commons.logging.impl.LogFactoryImpl.discoverLogImplementation(LogFactoryImpl.java:874)
at
org.apache.commons.logging.impl.LogFactoryImpl.newInstance(LogFactoryImpl.java:604)
at
org.apache.commons.logging.impl.LogFactoryImpl.getInstance(LogFactoryImpl.java:336)
at
org.apache.commons.logging.impl.LogFactoryImpl.getInstance(LogFactoryImpl.java:310)
at org.apache.commons.logging.LogFactory.getLog(LogFactory.java:685)
at org.apache.hadoop.conf.Configuration.clinit(Configuration.java:142)
... 3 more
java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed
with code 1
at
org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:311)
at
org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:545)
at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:132)
at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:57)
at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:36)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:436)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:372)
at org.apache.hadoop.mapred.Child$4.run(Child.java:261)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
at org.apache.hadoop.mapred.Child.main(Child.java:255)
{noformat}
Upon inspection, there are two problems in the inherited from environment
which prevent the logger initialization to work properly. In hadoop-env.sh,
the HADOOP_OPTS is inherited from the parent process. This configuration was
requested by user to have a way to override HADOOP environment in the
configuration template:
{noformat}
export HADOOP_OPTS=-Djava.net.preferIPv4Stack=true $HADOOP_OPTS
{noformat}
-Dhadoop.log.dir=$HADOOP_LOG_DIR/task_tracker_user is injected into
HADOOP_OPTS in the tasktracker environment. Hence, the running task would
inherit the wrong logging directory, which the end user might not have
sufficient access to write. Second, $HADOOP_ROOT_LOGGER is override to:
-Dhadoop.root.logger=INFO,TLA by the task controller, therefore, the
bin/hadoop script will attempt to use hadoop.root.logger=INFO,TLA, but fail
to initialize.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2777) Backport MAPREDUCE-220 to Hadoop 20 security branch
[ https://issues.apache.org/jira/browse/MAPREDUCE-2777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116565#comment-13116565 ] Amar Kamat commented on MAPREDUCE-2777: --- I also committed this to 0.20-205. Backport MAPREDUCE-220 to Hadoop 20 security branch --- Key: MAPREDUCE-2777 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2777 Project: Hadoop Map/Reduce Issue Type: New Feature Affects Versions: 0.20.205.0 Reporter: Jonathan Eagles Assignee: Amar Kamat Fix For: 0.20.206.0 Attachments: mapreduce-2777-v1.3.patch -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3001) Map Reduce JobHistory and AppMaster UI should have ability to display task specific counters.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116574#comment-13116574 ] Robert Joseph Evans commented on MAPREDUCE-3001: I have been looking into the cutoff of the counter. It looks like Luke did this on purpose. There are a couple of options that I can put in and I am not really sure what the correct one is. # I can increase the width of the column to 15em. This has enough space for what we have now, but may not be enough in the future and the error will happen again. # I can set it up so if there is an overflow then a scroll bar shows up and you can scroll to see the rest (This is kind of ugly) # I can set it up so if there is an overflow then the name will write off the edge and potentially overwrite text in the next column (also ugly) # I can try and make it so that we split the string in a different location. Right now there is code inserting 0-width spaces after '.' and before '$' characters to allow splits there. I could also put them in other places too. Like before a Capital letter. I think #1 is the best choice right now, and I am going to go with it. If you want something else in addition to it or instead of it then please say so. Map Reduce JobHistory and AppMaster UI should have ability to display task specific counters. - Key: MAPREDUCE-3001 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3001 Project: Hadoop Map/Reduce Issue Type: Improvement Components: jobhistoryserver, mrv2 Affects Versions: 0.23.0, 0.24.0 Reporter: Robert Joseph Evans Assignee: Robert Joseph Evans Priority: Blocker Fix For: 0.23.0, 0.24.0 Attachments: MR-3001.txt Map Reduce JobHistory and AppMaster UI should have ability to display task specific counters. I think the best way to do this is to include in the Nav Block a task specific section with task links when a task is selected. Counters is already set up to deal with a task passed in. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3112) Calling hadoop cli inside mapreduce job leads to errors
[
https://issues.apache.org/jira/browse/MAPREDUCE-3112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eric Yang updated MAPREDUCE-3112:
-
Attachment: MAPREDUCE-3112.patch
Patch for brach-20-security.
Calling hadoop cli inside mapreduce job leads to errors
---
Key: MAPREDUCE-3112
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3112
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: contrib/streaming
Affects Versions: 0.20.205.0
Environment: Java, Linux
Reporter: Eric Yang
Assignee: Eric Yang
Fix For: 0.20.205.0
Attachments: MAPREDUCE-3112.patch
When running a streaming job with mapper
bin/hadoop --config /etc/hadoop/ jar
contrib/streaming/hadoop-streaming-0.20.205.0.jar -mapper hadoop --config
/etc/hadoop/ dfs -help -reducer NONE -input /tmp/input.txt -output NONE
Task log shows:
{noformat}
Exception in thread main java.lang.ExceptionInInitializerError
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:57)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
at org.apache.hadoop.fs.FsShell.main(FsShell.java:1895)
Caused by: org.apache.commons.logging.LogConfigurationException:
User-specified log class 'org.apache.commons.logging.impl.Log4JLogger' cannot
be found or is not useable.
at
org.apache.commons.logging.impl.LogFactoryImpl.discoverLogImplementation(LogFactoryImpl.java:874)
at
org.apache.commons.logging.impl.LogFactoryImpl.newInstance(LogFactoryImpl.java:604)
at
org.apache.commons.logging.impl.LogFactoryImpl.getInstance(LogFactoryImpl.java:336)
at
org.apache.commons.logging.impl.LogFactoryImpl.getInstance(LogFactoryImpl.java:310)
at org.apache.commons.logging.LogFactory.getLog(LogFactory.java:685)
at org.apache.hadoop.conf.Configuration.clinit(Configuration.java:142)
... 3 more
java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed
with code 1
at
org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:311)
at
org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:545)
at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:132)
at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:57)
at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:36)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:436)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:372)
at org.apache.hadoop.mapred.Child$4.run(Child.java:261)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
at org.apache.hadoop.mapred.Child.main(Child.java:255)
{noformat}
Upon inspection, there are two problems in the inherited from environment
which prevent the logger initialization to work properly. In hadoop-env.sh,
the HADOOP_OPTS is inherited from the parent process. This configuration was
requested by user to have a way to override HADOOP environment in the
configuration template:
{noformat}
export HADOOP_OPTS=-Djava.net.preferIPv4Stack=true $HADOOP_OPTS
{noformat}
-Dhadoop.log.dir=$HADOOP_LOG_DIR/task_tracker_user is injected into
HADOOP_OPTS in the tasktracker environment. Hence, the running task would
inherit the wrong logging directory, which the end user might not have
sufficient access to write. Second, $HADOOP_ROOT_LOGGER is override to:
-Dhadoop.root.logger=INFO,TLA by the task controller, therefore, the
bin/hadoop script will attempt to use hadoop.root.logger=INFO,TLA, but fail
to initialize.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3112) Calling hadoop cli inside mapreduce job leads to errors
[
https://issues.apache.org/jira/browse/MAPREDUCE-3112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eric Yang updated MAPREDUCE-3112:
-
Attachment: MAPREDUCE-3112-trunk.patch
Same patch for trunk.
Calling hadoop cli inside mapreduce job leads to errors
---
Key: MAPREDUCE-3112
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3112
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: contrib/streaming
Affects Versions: 0.20.205.0
Environment: Java, Linux
Reporter: Eric Yang
Assignee: Eric Yang
Fix For: 0.20.205.0
Attachments: MAPREDUCE-3112-trunk.patch, MAPREDUCE-3112.patch
When running a streaming job with mapper
bin/hadoop --config /etc/hadoop/ jar
contrib/streaming/hadoop-streaming-0.20.205.0.jar -mapper hadoop --config
/etc/hadoop/ dfs -help -reducer NONE -input /tmp/input.txt -output NONE
Task log shows:
{noformat}
Exception in thread main java.lang.ExceptionInInitializerError
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:57)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
at org.apache.hadoop.fs.FsShell.main(FsShell.java:1895)
Caused by: org.apache.commons.logging.LogConfigurationException:
User-specified log class 'org.apache.commons.logging.impl.Log4JLogger' cannot
be found or is not useable.
at
org.apache.commons.logging.impl.LogFactoryImpl.discoverLogImplementation(LogFactoryImpl.java:874)
at
org.apache.commons.logging.impl.LogFactoryImpl.newInstance(LogFactoryImpl.java:604)
at
org.apache.commons.logging.impl.LogFactoryImpl.getInstance(LogFactoryImpl.java:336)
at
org.apache.commons.logging.impl.LogFactoryImpl.getInstance(LogFactoryImpl.java:310)
at org.apache.commons.logging.LogFactory.getLog(LogFactory.java:685)
at org.apache.hadoop.conf.Configuration.clinit(Configuration.java:142)
... 3 more
java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed
with code 1
at
org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:311)
at
org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:545)
at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:132)
at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:57)
at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:36)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:436)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:372)
at org.apache.hadoop.mapred.Child$4.run(Child.java:261)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
at org.apache.hadoop.mapred.Child.main(Child.java:255)
{noformat}
Upon inspection, there are two problems in the inherited from environment
which prevent the logger initialization to work properly. In hadoop-env.sh,
the HADOOP_OPTS is inherited from the parent process. This configuration was
requested by user to have a way to override HADOOP environment in the
configuration template:
{noformat}
export HADOOP_OPTS=-Djava.net.preferIPv4Stack=true $HADOOP_OPTS
{noformat}
-Dhadoop.log.dir=$HADOOP_LOG_DIR/task_tracker_user is injected into
HADOOP_OPTS in the tasktracker environment. Hence, the running task would
inherit the wrong logging directory, which the end user might not have
sufficient access to write. Second, $HADOOP_ROOT_LOGGER is override to:
-Dhadoop.root.logger=INFO,TLA by the task controller, therefore, the
bin/hadoop script will attempt to use hadoop.root.logger=INFO,TLA, but fail
to initialize.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3112) Calling hadoop cli inside mapreduce job leads to errors
[
https://issues.apache.org/jira/browse/MAPREDUCE-3112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eric Yang updated MAPREDUCE-3112:
-
Fix Version/s: 0.23.0
Affects Version/s: 0.23.0
Release Note:
Removed inheritance of certain server environment variables (HADOOP_OPTS and
HADOOP_ROOT_LOGGER) in task attempt process.
Status: Patch Available (was: Open)
Calling hadoop cli inside mapreduce job leads to errors
---
Key: MAPREDUCE-3112
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3112
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: contrib/streaming
Affects Versions: 0.20.205.0, 0.23.0
Environment: Java, Linux
Reporter: Eric Yang
Assignee: Eric Yang
Fix For: 0.20.205.0, 0.23.0
Attachments: MAPREDUCE-3112-trunk.patch, MAPREDUCE-3112.patch
When running a streaming job with mapper
bin/hadoop --config /etc/hadoop/ jar
contrib/streaming/hadoop-streaming-0.20.205.0.jar -mapper hadoop --config
/etc/hadoop/ dfs -help -reducer NONE -input /tmp/input.txt -output NONE
Task log shows:
{noformat}
Exception in thread main java.lang.ExceptionInInitializerError
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:57)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
at org.apache.hadoop.fs.FsShell.main(FsShell.java:1895)
Caused by: org.apache.commons.logging.LogConfigurationException:
User-specified log class 'org.apache.commons.logging.impl.Log4JLogger' cannot
be found or is not useable.
at
org.apache.commons.logging.impl.LogFactoryImpl.discoverLogImplementation(LogFactoryImpl.java:874)
at
org.apache.commons.logging.impl.LogFactoryImpl.newInstance(LogFactoryImpl.java:604)
at
org.apache.commons.logging.impl.LogFactoryImpl.getInstance(LogFactoryImpl.java:336)
at
org.apache.commons.logging.impl.LogFactoryImpl.getInstance(LogFactoryImpl.java:310)
at org.apache.commons.logging.LogFactory.getLog(LogFactory.java:685)
at org.apache.hadoop.conf.Configuration.clinit(Configuration.java:142)
... 3 more
java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed
with code 1
at
org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:311)
at
org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:545)
at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:132)
at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:57)
at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:36)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:436)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:372)
at org.apache.hadoop.mapred.Child$4.run(Child.java:261)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
at org.apache.hadoop.mapred.Child.main(Child.java:255)
{noformat}
Upon inspection, there are two problems in the inherited from environment
which prevent the logger initialization to work properly. In hadoop-env.sh,
the HADOOP_OPTS is inherited from the parent process. This configuration was
requested by user to have a way to override HADOOP environment in the
configuration template:
{noformat}
export HADOOP_OPTS=-Djava.net.preferIPv4Stack=true $HADOOP_OPTS
{noformat}
-Dhadoop.log.dir=$HADOOP_LOG_DIR/task_tracker_user is injected into
HADOOP_OPTS in the tasktracker environment. Hence, the running task would
inherit the wrong logging directory, which the end user might not have
sufficient access to write. Second, $HADOOP_ROOT_LOGGER is override to:
-Dhadoop.root.logger=INFO,TLA by the task controller, therefore, the
bin/hadoop script will attempt to use hadoop.root.logger=INFO,TLA, but fail
to initialize.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3112) Calling hadoop cli inside mapreduce job leads to errors
[
https://issues.apache.org/jira/browse/MAPREDUCE-3112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116593#comment-13116593
]
Hadoop QA commented on MAPREDUCE-3112:
--
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12496894/MAPREDUCE-3112-trunk.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
-1 tests included. The patch doesn't appear to include any new or modified
tests.
Please justify why no new tests are needed for this
patch.
Also please list what manual steps were performed to
verify this patch.
-1 patch. The patch command could not apply the patch.
Console output:
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/880//console
This message is automatically generated.
Calling hadoop cli inside mapreduce job leads to errors
---
Key: MAPREDUCE-3112
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3112
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: contrib/streaming
Affects Versions: 0.20.205.0, 0.23.0
Environment: Java, Linux
Reporter: Eric Yang
Assignee: Eric Yang
Fix For: 0.20.205.0, 0.23.0
Attachments: MAPREDUCE-3112-trunk.patch, MAPREDUCE-3112.patch
When running a streaming job with mapper
bin/hadoop --config /etc/hadoop/ jar
contrib/streaming/hadoop-streaming-0.20.205.0.jar -mapper hadoop --config
/etc/hadoop/ dfs -help -reducer NONE -input /tmp/input.txt -output NONE
Task log shows:
{noformat}
Exception in thread main java.lang.ExceptionInInitializerError
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:57)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
at org.apache.hadoop.fs.FsShell.main(FsShell.java:1895)
Caused by: org.apache.commons.logging.LogConfigurationException:
User-specified log class 'org.apache.commons.logging.impl.Log4JLogger' cannot
be found or is not useable.
at
org.apache.commons.logging.impl.LogFactoryImpl.discoverLogImplementation(LogFactoryImpl.java:874)
at
org.apache.commons.logging.impl.LogFactoryImpl.newInstance(LogFactoryImpl.java:604)
at
org.apache.commons.logging.impl.LogFactoryImpl.getInstance(LogFactoryImpl.java:336)
at
org.apache.commons.logging.impl.LogFactoryImpl.getInstance(LogFactoryImpl.java:310)
at org.apache.commons.logging.LogFactory.getLog(LogFactory.java:685)
at org.apache.hadoop.conf.Configuration.clinit(Configuration.java:142)
... 3 more
java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed
with code 1
at
org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:311)
at
org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:545)
at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:132)
at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:57)
at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:36)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:436)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:372)
at org.apache.hadoop.mapred.Child$4.run(Child.java:261)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
at org.apache.hadoop.mapred.Child.main(Child.java:255)
{noformat}
Upon inspection, there are two problems in the inherited from environment
which prevent the logger initialization to work properly. In hadoop-env.sh,
the HADOOP_OPTS is inherited from the parent process. This configuration was
requested by user to have a way to override HADOOP environment in the
configuration template:
{noformat}
export HADOOP_OPTS=-Djava.net.preferIPv4Stack=true $HADOOP_OPTS
{noformat}
-Dhadoop.log.dir=$HADOOP_LOG_DIR/task_tracker_user is injected into
HADOOP_OPTS in the tasktracker environment. Hence, the running task would
inherit the wrong logging directory, which the end user might not have
sufficient access to write. Second, $HADOOP_ROOT_LOGGER is override to:
-Dhadoop.root.logger=INFO,TLA by the task controller, therefore, the
bin/hadoop script will attempt to use hadoop.root.logger=INFO,TLA, but fail
to initialize.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (MAPREDUCE-3116) RM and NM fail to start (webapps/cluster is missing)
RM and NM fail to start (webapps/cluster is missing) Key: MAPREDUCE-3116 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3116 Project: Hadoop Map/Reduce Issue Type: Bug Components: nodemanager, resourcemanager Affects Versions: 0.24.0 Environment: [criccomi@criccomi-ld trunk]$ svn info Path: . URL: http://svn.apache.org/repos/asf/hadoop/common/trunk Repository Root: http://svn.apache.org/repos/asf Repository UUID: 13f79535-47bb-0310-9956-ffa450edef68 Revision: 1176955 Node Kind: directory Schedule: normal Last Changed Author: vinodkv Last Changed Rev: 1176849 Last Changed Date: 2011-09-28 05:36:30 -0700 (Wed, 28 Sep 2011) Reporter: Chris Riccomini Priority: Critical When I try to start the RM, I get: 2011-09-28 10:03:42,848 FATAL resourcemanager.ResourceManager (ResourceManager.java:main(514)) - Error starting ResourceManager org.apache.hadoop.yarn.webapp.WebAppException: Error starting http server at org.apache.hadoop.yarn.webapp.WebApps$Builder.start(WebApps.java:152) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.startWepApp(ResourceManager.java:396) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.start(ResourceManager.java:411) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:512) Caused by: java.io.FileNotFoundException: webapps/cluster not found in CLASSPATH at org.apache.hadoop.http.HttpServer.getWebAppsPath(HttpServer.java:484) at org.apache.hadoop.http.HttpServer.init(HttpServer.java:184) at org.apache.hadoop.http.HttpServer.init(HttpServer.java:139) at org.apache.hadoop.yarn.webapp.WebApps$Builder.start(WebApps.java:144) ... 3 more When I try to start the NM, I get: 2011-09-28 09:40:52,330 ERROR webapp.WebServer (WebServer.java:start(65)) - NMWebapps failed to start. org.apache.hadoop.yarn.webapp.WebAppException: Error starting http server at org.apache.hadoop.yarn.webapp.WebApps$Builder.start(WebApps.java:152) at org.apache.hadoop.yarn.server.nodemanager.webapp.WebServer.start(WebServer.java:59) at org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:68) at org.apache.hadoop.yarn.server.nodemanager.NodeManager.start(NodeManager.java:153) at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:202) Caused by: java.io.FileNotFoundException: webapps/node not found in CLASSPATH at org.apache.hadoop.http.HttpServer.getWebAppsPath(HttpServer.java:507) at org.apache.hadoop.http.HttpServer.init(HttpServer.java:207) at org.apache.hadoop.http.HttpServer.init(HttpServer.java:162) at org.apache.hadoop.yarn.webapp.WebApps$Builder.start(WebApps.java:144) ... 4 more I poked around a bit. When I jar -tvf my hadoop-yarn-common-0.24.0-SNAPSHOT.jar file, I see that it has: 0 Mon Sep 19 09:41:18 PDT 2011 webapps/ 0 Mon Sep 19 09:41:18 PDT 2011 webapps/static/ 0 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/ 0 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/ 0 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/js/ 0 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/css/ 0 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/ 0 Mon Sep 19 09:41:18 PDT 2011 webapps/static/jt/ 0 Mon Sep 19 09:41:18 PDT 2011 webapps/test/ 0 Mon Sep 19 09:41:18 PDT 2011 webapps/yarn/ 612 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/back_disabled.jpg 260 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/sort_desc.png 263 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/sort_asc.png 807 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/back_enabled.jpg 894 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/favicon.ico 251 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/sort_desc_disabled.png 252 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/sort_asc_disabled.png 27490 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/Sorting icons.psd 635 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/forward_disabled.jpg 282 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/sort_both.png 852 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/forward_enabled.jpg 18043 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/js/jquery.dataTables.min.js.gz 1276 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/css/demo_page.css 9689 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/css/demo_table.css 6211 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/css/jui-dt.css 4191 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/theme_90_trontastic.png 3259 Mon Sep 19
[jira] [Commented] (MAPREDUCE-3116) RM and NM fail to start (webapps/cluster is missing)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116616#comment-13116616 ] Chris Riccomini commented on MAPREDUCE-3116: Hmm.. older working jars that I have look the same. Wondering if something changed in the code. RM and NM fail to start (webapps/cluster is missing) Key: MAPREDUCE-3116 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3116 Project: Hadoop Map/Reduce Issue Type: Bug Components: nodemanager, resourcemanager Affects Versions: 0.24.0 Environment: [criccomi@criccomi-ld trunk]$ svn info Path: . URL: http://svn.apache.org/repos/asf/hadoop/common/trunk Repository Root: http://svn.apache.org/repos/asf Repository UUID: 13f79535-47bb-0310-9956-ffa450edef68 Revision: 1176955 Node Kind: directory Schedule: normal Last Changed Author: vinodkv Last Changed Rev: 1176849 Last Changed Date: 2011-09-28 05:36:30 -0700 (Wed, 28 Sep 2011) Reporter: Chris Riccomini Priority: Critical When I try to start the RM, I get: 2011-09-28 10:03:42,848 FATAL resourcemanager.ResourceManager (ResourceManager.java:main(514)) - Error starting ResourceManager org.apache.hadoop.yarn.webapp.WebAppException: Error starting http server at org.apache.hadoop.yarn.webapp.WebApps$Builder.start(WebApps.java:152) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.startWepApp(ResourceManager.java:396) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.start(ResourceManager.java:411) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:512) Caused by: java.io.FileNotFoundException: webapps/cluster not found in CLASSPATH at org.apache.hadoop.http.HttpServer.getWebAppsPath(HttpServer.java:484) at org.apache.hadoop.http.HttpServer.init(HttpServer.java:184) at org.apache.hadoop.http.HttpServer.init(HttpServer.java:139) at org.apache.hadoop.yarn.webapp.WebApps$Builder.start(WebApps.java:144) ... 3 more When I try to start the NM, I get: 2011-09-28 09:40:52,330 ERROR webapp.WebServer (WebServer.java:start(65)) - NMWebapps failed to start. org.apache.hadoop.yarn.webapp.WebAppException: Error starting http server at org.apache.hadoop.yarn.webapp.WebApps$Builder.start(WebApps.java:152) at org.apache.hadoop.yarn.server.nodemanager.webapp.WebServer.start(WebServer.java:59) at org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:68) at org.apache.hadoop.yarn.server.nodemanager.NodeManager.start(NodeManager.java:153) at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:202) Caused by: java.io.FileNotFoundException: webapps/node not found in CLASSPATH at org.apache.hadoop.http.HttpServer.getWebAppsPath(HttpServer.java:507) at org.apache.hadoop.http.HttpServer.init(HttpServer.java:207) at org.apache.hadoop.http.HttpServer.init(HttpServer.java:162) at org.apache.hadoop.yarn.webapp.WebApps$Builder.start(WebApps.java:144) ... 4 more I poked around a bit. When I jar -tvf my hadoop-yarn-common-0.24.0-SNAPSHOT.jar file, I see that it has: 0 Mon Sep 19 09:41:18 PDT 2011 webapps/ 0 Mon Sep 19 09:41:18 PDT 2011 webapps/static/ 0 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/ 0 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/ 0 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/js/ 0 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/css/ 0 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/ 0 Mon Sep 19 09:41:18 PDT 2011 webapps/static/jt/ 0 Mon Sep 19 09:41:18 PDT 2011 webapps/test/ 0 Mon Sep 19 09:41:18 PDT 2011 webapps/yarn/ 612 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/back_disabled.jpg 260 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/sort_desc.png 263 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/sort_asc.png 807 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/back_enabled.jpg 894 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/favicon.ico 251 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/sort_desc_disabled.png 252 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/sort_asc_disabled.png 27490 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/Sorting icons.psd 635 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/forward_disabled.jpg 282 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/sort_both.png 852 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/forward_enabled.jpg
[jira] [Commented] (MAPREDUCE-3116) RM and NM fail to start (webapps/cluster is missing)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116619#comment-13116619 ] Thomas Graves commented on MAPREDUCE-3116: -- This change comes from MAPREDUCE-3021. Everything should be there as of rev http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1176709. What method of distribution are you using? I tested using the tarballs. In svn you will see: ./hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/webapps/test/.keep ./hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/webapps/cluster/.keep ./hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/webapps/node/.keep ./hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/webapps/jobhistory/.keep ./hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/webapps/yarn/.keep ./hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/webapps/mapreduce/.keep RM and NM fail to start (webapps/cluster is missing) Key: MAPREDUCE-3116 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3116 Project: Hadoop Map/Reduce Issue Type: Bug Components: nodemanager, resourcemanager Affects Versions: 0.24.0 Environment: [criccomi@criccomi-ld trunk]$ svn info Path: . URL: http://svn.apache.org/repos/asf/hadoop/common/trunk Repository Root: http://svn.apache.org/repos/asf Repository UUID: 13f79535-47bb-0310-9956-ffa450edef68 Revision: 1176955 Node Kind: directory Schedule: normal Last Changed Author: vinodkv Last Changed Rev: 1176849 Last Changed Date: 2011-09-28 05:36:30 -0700 (Wed, 28 Sep 2011) Reporter: Chris Riccomini Priority: Critical When I try to start the RM, I get: 2011-09-28 10:03:42,848 FATAL resourcemanager.ResourceManager (ResourceManager.java:main(514)) - Error starting ResourceManager org.apache.hadoop.yarn.webapp.WebAppException: Error starting http server at org.apache.hadoop.yarn.webapp.WebApps$Builder.start(WebApps.java:152) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.startWepApp(ResourceManager.java:396) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.start(ResourceManager.java:411) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:512) Caused by: java.io.FileNotFoundException: webapps/cluster not found in CLASSPATH at org.apache.hadoop.http.HttpServer.getWebAppsPath(HttpServer.java:484) at org.apache.hadoop.http.HttpServer.init(HttpServer.java:184) at org.apache.hadoop.http.HttpServer.init(HttpServer.java:139) at org.apache.hadoop.yarn.webapp.WebApps$Builder.start(WebApps.java:144) ... 3 more When I try to start the NM, I get: 2011-09-28 09:40:52,330 ERROR webapp.WebServer (WebServer.java:start(65)) - NMWebapps failed to start. org.apache.hadoop.yarn.webapp.WebAppException: Error starting http server at org.apache.hadoop.yarn.webapp.WebApps$Builder.start(WebApps.java:152) at org.apache.hadoop.yarn.server.nodemanager.webapp.WebServer.start(WebServer.java:59) at org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:68) at org.apache.hadoop.yarn.server.nodemanager.NodeManager.start(NodeManager.java:153) at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:202) Caused by: java.io.FileNotFoundException: webapps/node not found in CLASSPATH at org.apache.hadoop.http.HttpServer.getWebAppsPath(HttpServer.java:507) at org.apache.hadoop.http.HttpServer.init(HttpServer.java:207) at org.apache.hadoop.http.HttpServer.init(HttpServer.java:162) at org.apache.hadoop.yarn.webapp.WebApps$Builder.start(WebApps.java:144) ... 4 more I poked around a bit. When I jar -tvf my hadoop-yarn-common-0.24.0-SNAPSHOT.jar file, I see that it has: 0 Mon Sep 19 09:41:18 PDT 2011 webapps/ 0 Mon Sep 19 09:41:18 PDT 2011 webapps/static/ 0 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/ 0 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/ 0 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/js/ 0 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/css/ 0 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/ 0 Mon Sep 19 09:41:18 PDT 2011 webapps/static/jt/ 0 Mon Sep 19 09:41:18 PDT 2011 webapps/test/ 0 Mon Sep 19 09:41:18 PDT 2011 webapps/yarn/ 612 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/back_disabled.jpg 260 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/sort_desc.png 263 Mon Sep 19 09:41:18 PDT 2011
[jira] [Commented] (MAPREDUCE-3116) RM and NM fail to start (webapps/cluster is missing)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116621#comment-13116621 ] Chris Riccomini commented on MAPREDUCE-3116: Interesting, so I was copying the jars from my target directory directly into my yarn_conf home. When I untgz's the tgz package, THAT hadoop-yarn-common jar has: 0 Wed Sep 28 10:01:32 PDT 2011 webapps/test/.keep 0 Wed Sep 28 10:01:32 PDT 2011 webapps/mapreduce/.keep 0 Wed Sep 28 10:01:32 PDT 2011 webapps/cluster/.keep 0 Wed Sep 28 10:01:32 PDT 2011 webapps/node/.keep 0 Wed Sep 28 10:01:32 PDT 2011 webapps/yarn/.keep 0 Wed Sep 28 10:01:32 PDT 2011 webapps/jobhistory/.keep Strange. RM and NM fail to start (webapps/cluster is missing) Key: MAPREDUCE-3116 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3116 Project: Hadoop Map/Reduce Issue Type: Bug Components: nodemanager, resourcemanager Affects Versions: 0.24.0 Environment: [criccomi@criccomi-ld trunk]$ svn info Path: . URL: http://svn.apache.org/repos/asf/hadoop/common/trunk Repository Root: http://svn.apache.org/repos/asf Repository UUID: 13f79535-47bb-0310-9956-ffa450edef68 Revision: 1176955 Node Kind: directory Schedule: normal Last Changed Author: vinodkv Last Changed Rev: 1176849 Last Changed Date: 2011-09-28 05:36:30 -0700 (Wed, 28 Sep 2011) Reporter: Chris Riccomini Priority: Critical When I try to start the RM, I get: 2011-09-28 10:03:42,848 FATAL resourcemanager.ResourceManager (ResourceManager.java:main(514)) - Error starting ResourceManager org.apache.hadoop.yarn.webapp.WebAppException: Error starting http server at org.apache.hadoop.yarn.webapp.WebApps$Builder.start(WebApps.java:152) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.startWepApp(ResourceManager.java:396) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.start(ResourceManager.java:411) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:512) Caused by: java.io.FileNotFoundException: webapps/cluster not found in CLASSPATH at org.apache.hadoop.http.HttpServer.getWebAppsPath(HttpServer.java:484) at org.apache.hadoop.http.HttpServer.init(HttpServer.java:184) at org.apache.hadoop.http.HttpServer.init(HttpServer.java:139) at org.apache.hadoop.yarn.webapp.WebApps$Builder.start(WebApps.java:144) ... 3 more When I try to start the NM, I get: 2011-09-28 09:40:52,330 ERROR webapp.WebServer (WebServer.java:start(65)) - NMWebapps failed to start. org.apache.hadoop.yarn.webapp.WebAppException: Error starting http server at org.apache.hadoop.yarn.webapp.WebApps$Builder.start(WebApps.java:152) at org.apache.hadoop.yarn.server.nodemanager.webapp.WebServer.start(WebServer.java:59) at org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:68) at org.apache.hadoop.yarn.server.nodemanager.NodeManager.start(NodeManager.java:153) at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:202) Caused by: java.io.FileNotFoundException: webapps/node not found in CLASSPATH at org.apache.hadoop.http.HttpServer.getWebAppsPath(HttpServer.java:507) at org.apache.hadoop.http.HttpServer.init(HttpServer.java:207) at org.apache.hadoop.http.HttpServer.init(HttpServer.java:162) at org.apache.hadoop.yarn.webapp.WebApps$Builder.start(WebApps.java:144) ... 4 more I poked around a bit. When I jar -tvf my hadoop-yarn-common-0.24.0-SNAPSHOT.jar file, I see that it has: 0 Mon Sep 19 09:41:18 PDT 2011 webapps/ 0 Mon Sep 19 09:41:18 PDT 2011 webapps/static/ 0 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/ 0 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/ 0 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/js/ 0 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/css/ 0 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/ 0 Mon Sep 19 09:41:18 PDT 2011 webapps/static/jt/ 0 Mon Sep 19 09:41:18 PDT 2011 webapps/test/ 0 Mon Sep 19 09:41:18 PDT 2011 webapps/yarn/ 612 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/back_disabled.jpg 260 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/sort_desc.png 263 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/sort_asc.png 807 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/back_enabled.jpg 894 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/favicon.ico 251 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/sort_desc_disabled.png 252 Mon Sep 19
[jira] [Commented] (MAPREDUCE-3116) RM and NM fail to start (webapps/cluster is missing)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116623#comment-13116623 ] Thomas Graves commented on MAPREDUCE-3116: -- $ jar -tvf ./hadoop-mapreduce-0.23.0-SNAPSHOT/modules/hadoop-yarn-common-0.23.0-SNAPSHOT.jar | grep webapps | grep .keep 0 Wed Sep 28 17:30:24 UTC 2011 webapps/test/.keep 0 Wed Sep 28 17:30:24 UTC 2011 webapps/cluster/.keep 0 Wed Sep 28 17:30:24 UTC 2011 webapps/node/.keep 0 Wed Sep 28 17:30:24 UTC 2011 webapps/jobhistory/.keep 0 Wed Sep 28 17:30:24 UTC 2011 webapps/yarn/.keep 0 Wed Sep 28 17:30:24 UTC 2011 webapps/mapreduce/.keep RM and NM fail to start (webapps/cluster is missing) Key: MAPREDUCE-3116 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3116 Project: Hadoop Map/Reduce Issue Type: Bug Components: nodemanager, resourcemanager Affects Versions: 0.24.0 Environment: [criccomi@criccomi-ld trunk]$ svn info Path: . URL: http://svn.apache.org/repos/asf/hadoop/common/trunk Repository Root: http://svn.apache.org/repos/asf Repository UUID: 13f79535-47bb-0310-9956-ffa450edef68 Revision: 1176955 Node Kind: directory Schedule: normal Last Changed Author: vinodkv Last Changed Rev: 1176849 Last Changed Date: 2011-09-28 05:36:30 -0700 (Wed, 28 Sep 2011) Reporter: Chris Riccomini Priority: Critical When I try to start the RM, I get: 2011-09-28 10:03:42,848 FATAL resourcemanager.ResourceManager (ResourceManager.java:main(514)) - Error starting ResourceManager org.apache.hadoop.yarn.webapp.WebAppException: Error starting http server at org.apache.hadoop.yarn.webapp.WebApps$Builder.start(WebApps.java:152) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.startWepApp(ResourceManager.java:396) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.start(ResourceManager.java:411) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:512) Caused by: java.io.FileNotFoundException: webapps/cluster not found in CLASSPATH at org.apache.hadoop.http.HttpServer.getWebAppsPath(HttpServer.java:484) at org.apache.hadoop.http.HttpServer.init(HttpServer.java:184) at org.apache.hadoop.http.HttpServer.init(HttpServer.java:139) at org.apache.hadoop.yarn.webapp.WebApps$Builder.start(WebApps.java:144) ... 3 more When I try to start the NM, I get: 2011-09-28 09:40:52,330 ERROR webapp.WebServer (WebServer.java:start(65)) - NMWebapps failed to start. org.apache.hadoop.yarn.webapp.WebAppException: Error starting http server at org.apache.hadoop.yarn.webapp.WebApps$Builder.start(WebApps.java:152) at org.apache.hadoop.yarn.server.nodemanager.webapp.WebServer.start(WebServer.java:59) at org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:68) at org.apache.hadoop.yarn.server.nodemanager.NodeManager.start(NodeManager.java:153) at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:202) Caused by: java.io.FileNotFoundException: webapps/node not found in CLASSPATH at org.apache.hadoop.http.HttpServer.getWebAppsPath(HttpServer.java:507) at org.apache.hadoop.http.HttpServer.init(HttpServer.java:207) at org.apache.hadoop.http.HttpServer.init(HttpServer.java:162) at org.apache.hadoop.yarn.webapp.WebApps$Builder.start(WebApps.java:144) ... 4 more I poked around a bit. When I jar -tvf my hadoop-yarn-common-0.24.0-SNAPSHOT.jar file, I see that it has: 0 Mon Sep 19 09:41:18 PDT 2011 webapps/ 0 Mon Sep 19 09:41:18 PDT 2011 webapps/static/ 0 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/ 0 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/ 0 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/js/ 0 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/css/ 0 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/ 0 Mon Sep 19 09:41:18 PDT 2011 webapps/static/jt/ 0 Mon Sep 19 09:41:18 PDT 2011 webapps/test/ 0 Mon Sep 19 09:41:18 PDT 2011 webapps/yarn/ 612 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/back_disabled.jpg 260 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/sort_desc.png 263 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/sort_asc.png 807 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/back_enabled.jpg 894 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/favicon.ico 251 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/sort_desc_disabled.png 252 Mon Sep 19 09:41:18 PDT 2011
[jira] [Commented] (MAPREDUCE-3116) RM and NM fail to start (webapps/cluster is missing)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116624#comment-13116624 ] Chris Riccomini commented on MAPREDUCE-3116: It was ivy cache. Sigh. Sorry. RM and NM fail to start (webapps/cluster is missing) Key: MAPREDUCE-3116 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3116 Project: Hadoop Map/Reduce Issue Type: Bug Components: nodemanager, resourcemanager Affects Versions: 0.24.0 Environment: [criccomi@criccomi-ld trunk]$ svn info Path: . URL: http://svn.apache.org/repos/asf/hadoop/common/trunk Repository Root: http://svn.apache.org/repos/asf Repository UUID: 13f79535-47bb-0310-9956-ffa450edef68 Revision: 1176955 Node Kind: directory Schedule: normal Last Changed Author: vinodkv Last Changed Rev: 1176849 Last Changed Date: 2011-09-28 05:36:30 -0700 (Wed, 28 Sep 2011) Reporter: Chris Riccomini Priority: Critical When I try to start the RM, I get: 2011-09-28 10:03:42,848 FATAL resourcemanager.ResourceManager (ResourceManager.java:main(514)) - Error starting ResourceManager org.apache.hadoop.yarn.webapp.WebAppException: Error starting http server at org.apache.hadoop.yarn.webapp.WebApps$Builder.start(WebApps.java:152) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.startWepApp(ResourceManager.java:396) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.start(ResourceManager.java:411) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:512) Caused by: java.io.FileNotFoundException: webapps/cluster not found in CLASSPATH at org.apache.hadoop.http.HttpServer.getWebAppsPath(HttpServer.java:484) at org.apache.hadoop.http.HttpServer.init(HttpServer.java:184) at org.apache.hadoop.http.HttpServer.init(HttpServer.java:139) at org.apache.hadoop.yarn.webapp.WebApps$Builder.start(WebApps.java:144) ... 3 more When I try to start the NM, I get: 2011-09-28 09:40:52,330 ERROR webapp.WebServer (WebServer.java:start(65)) - NMWebapps failed to start. org.apache.hadoop.yarn.webapp.WebAppException: Error starting http server at org.apache.hadoop.yarn.webapp.WebApps$Builder.start(WebApps.java:152) at org.apache.hadoop.yarn.server.nodemanager.webapp.WebServer.start(WebServer.java:59) at org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:68) at org.apache.hadoop.yarn.server.nodemanager.NodeManager.start(NodeManager.java:153) at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:202) Caused by: java.io.FileNotFoundException: webapps/node not found in CLASSPATH at org.apache.hadoop.http.HttpServer.getWebAppsPath(HttpServer.java:507) at org.apache.hadoop.http.HttpServer.init(HttpServer.java:207) at org.apache.hadoop.http.HttpServer.init(HttpServer.java:162) at org.apache.hadoop.yarn.webapp.WebApps$Builder.start(WebApps.java:144) ... 4 more I poked around a bit. When I jar -tvf my hadoop-yarn-common-0.24.0-SNAPSHOT.jar file, I see that it has: 0 Mon Sep 19 09:41:18 PDT 2011 webapps/ 0 Mon Sep 19 09:41:18 PDT 2011 webapps/static/ 0 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/ 0 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/ 0 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/js/ 0 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/css/ 0 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/ 0 Mon Sep 19 09:41:18 PDT 2011 webapps/static/jt/ 0 Mon Sep 19 09:41:18 PDT 2011 webapps/test/ 0 Mon Sep 19 09:41:18 PDT 2011 webapps/yarn/ 612 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/back_disabled.jpg 260 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/sort_desc.png 263 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/sort_asc.png 807 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/back_enabled.jpg 894 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/favicon.ico 251 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/sort_desc_disabled.png 252 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/sort_asc_disabled.png 27490 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/Sorting icons.psd 635 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/forward_disabled.jpg 282 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/sort_both.png 852 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/forward_enabled.jpg 18043 Mon Sep 19 09:41:18 PDT 2011
