[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13912904#comment-13912904 ] Steffen Grohsschmiedt commented on MAPREDUCE-3868: -- Are there any ongoing attempts to fix this issue and bring HDFS-RAID to Hadoop 2.x or is the progress stuck because of [HDFS-3554|https://issues.apache.org/jira/browse/HDFS-3554]? Reenable Raid - Key: MAPREDUCE-3868 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868 Project: Hadoop Map/Reduce Issue Type: Bug Components: contrib/raid Reporter: Scott Chen Assignee: Weiyan Wang Attachments: MAPREDUCE-3868-1.patch, MAPREDUCE-3868-2.patch, MAPREDUCE-3868-3.patch, MAPREDUCE-3868.patch, MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh Currently Raid is outdated and not compiled. Make it compile. -- This message was sent by Atlassian JIRA (v6.1.5#6160)
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13418732#comment-13418732 ] Eli Collins commented on MAPREDUCE-3868: I've reverted this. The HDFS build has been red (due to An Ant BuildException has occured in the hdfs raid project) since this was committed a month ago, the test still fails consistently (HDFS-3554) and the findbugs warnings have not been resolved (HDFS-3563). This patch needs more love before it's ready to go in. Reenable Raid - Key: MAPREDUCE-3868 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868 Project: Hadoop Map/Reduce Issue Type: Bug Components: contrib/raid Reporter: Scott Chen Assignee: Weiyan Wang Attachments: MAPREDUCE-3868-1.patch, MAPREDUCE-3868-2.patch, MAPREDUCE-3868-3.patch, MAPREDUCE-3868.patch, MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh Currently Raid is outdated and not compiled. Make it compile. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13418739#comment-13418739 ] Hudson commented on MAPREDUCE-3868: --- Integrated in Hadoop-Hdfs-trunk-Commit #2569 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/2569/]) Revert MAPREDUCE-3868. Reenable Raid. (Revision 1363572) Result = SUCCESS eli : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1363572 Files : * /hadoop/common/trunk/hadoop-assemblies/src/main/resources/assemblies/hadoop-raid-dist.xml * /hadoop/common/trunk/hadoop-dist/pom.xml * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid * /hadoop/common/trunk/hadoop-hdfs-project/pom.xml * /hadoop/common/trunk/hadoop-mapreduce-project/build.xml * /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/build.xml * /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/raid * /hadoop/common/trunk/hadoop-project/pom.xml Reenable Raid - Key: MAPREDUCE-3868 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868 Project: Hadoop Map/Reduce Issue Type: Bug Components: contrib/raid Reporter: Scott Chen Assignee: Weiyan Wang Attachments: MAPREDUCE-3868-1.patch, MAPREDUCE-3868-2.patch, MAPREDUCE-3868-3.patch, MAPREDUCE-3868.patch, MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh Currently Raid is outdated and not compiled. Make it compile. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13418746#comment-13418746 ] Hudson commented on MAPREDUCE-3868: --- Integrated in Hadoop-Common-trunk-Commit #2504 (See [https://builds.apache.org/job/Hadoop-Common-trunk-Commit/2504/]) Revert MAPREDUCE-3868. Reenable Raid. (Revision 1363572) Result = SUCCESS eli : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1363572 Files : * /hadoop/common/trunk/hadoop-assemblies/src/main/resources/assemblies/hadoop-raid-dist.xml * /hadoop/common/trunk/hadoop-dist/pom.xml * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid * /hadoop/common/trunk/hadoop-hdfs-project/pom.xml * /hadoop/common/trunk/hadoop-mapreduce-project/build.xml * /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/build.xml * /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/raid * /hadoop/common/trunk/hadoop-project/pom.xml Reenable Raid - Key: MAPREDUCE-3868 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868 Project: Hadoop Map/Reduce Issue Type: Bug Components: contrib/raid Reporter: Scott Chen Assignee: Weiyan Wang Attachments: MAPREDUCE-3868-1.patch, MAPREDUCE-3868-2.patch, MAPREDUCE-3868-3.patch, MAPREDUCE-3868.patch, MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh Currently Raid is outdated and not compiled. Make it compile. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13418786#comment-13418786 ] Hudson commented on MAPREDUCE-3868: --- Integrated in Hadoop-Mapreduce-trunk-Commit #2525 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/2525/]) Revert MAPREDUCE-3868. Reenable Raid. (Revision 1363572) Result = FAILURE eli : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1363572 Files : * /hadoop/common/trunk/hadoop-assemblies/src/main/resources/assemblies/hadoop-raid-dist.xml * /hadoop/common/trunk/hadoop-dist/pom.xml * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid * /hadoop/common/trunk/hadoop-hdfs-project/pom.xml * /hadoop/common/trunk/hadoop-mapreduce-project/build.xml * /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/build.xml * /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/raid * /hadoop/common/trunk/hadoop-project/pom.xml Reenable Raid - Key: MAPREDUCE-3868 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868 Project: Hadoop Map/Reduce Issue Type: Bug Components: contrib/raid Reporter: Scott Chen Assignee: Weiyan Wang Attachments: MAPREDUCE-3868-1.patch, MAPREDUCE-3868-2.patch, MAPREDUCE-3868-3.patch, MAPREDUCE-3868.patch, MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh Currently Raid is outdated and not compiled. Make it compile. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13413067#comment-13413067 ] Eli Collins commented on MAPREDUCE-3868: TestRaidNode is still consistently failing, I filed HDFS-3648 for this. Weiyan/Scott - can you guys address the findbugs and test failures soon? Reenable Raid - Key: MAPREDUCE-3868 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868 Project: Hadoop Map/Reduce Issue Type: Bug Components: contrib/raid Reporter: Scott Chen Assignee: Weiyan Wang Attachments: MAPREDUCE-3868-1.patch, MAPREDUCE-3868-2.patch, MAPREDUCE-3868-3.patch, MAPREDUCE-3868.patch, MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh Currently Raid is outdated and not compiled. Make it compile. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13398770#comment-13398770 ] Jason Lowe commented on MAPREDUCE-3868: --- I updated the patch in HDFS-3549 to fix the findbugs build failures, and apparently there are 31 new findbugs warnings being reported. Also TestRaidNode is consistently failing, were the raid unit tests passing before this was committed? Reenable Raid - Key: MAPREDUCE-3868 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868 Project: Hadoop Map/Reduce Issue Type: Bug Components: contrib/raid Reporter: Scott Chen Assignee: Weiyan Wang Attachments: MAPREDUCE-3868-1.patch, MAPREDUCE-3868-2.patch, MAPREDUCE-3868-3.patch, MAPREDUCE-3868.patch, MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh Currently Raid is outdated and not compiled. Make it compile. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13399016#comment-13399016 ] Scott Chen commented on MAPREDUCE-3868: --- Yes, the tests passed before checked in. Maybe it is something non-deterministic. Reenable Raid - Key: MAPREDUCE-3868 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868 Project: Hadoop Map/Reduce Issue Type: Bug Components: contrib/raid Reporter: Scott Chen Assignee: Weiyan Wang Attachments: MAPREDUCE-3868-1.patch, MAPREDUCE-3868-2.patch, MAPREDUCE-3868-3.patch, MAPREDUCE-3868.patch, MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh Currently Raid is outdated and not compiled. Make it compile. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13397859#comment-13397859 ] Thomas Graves commented on MAPREDUCE-3868: -- this also introduced a bunch of javadoc warnings - see HDFS-3550 if you don't have findbugs to exclude remove that from the pom file. If you do put the file in svn. You can test by running test-patch manually. Reenable Raid - Key: MAPREDUCE-3868 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868 Project: Hadoop Map/Reduce Issue Type: Bug Components: contrib/raid Reporter: Scott Chen Assignee: Weiyan Wang Attachments: MAPREDUCE-3868-1.patch, MAPREDUCE-3868-2.patch, MAPREDUCE-3868-3.patch, MAPREDUCE-3868.patch, MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh Currently Raid is outdated and not compiled. Make it compile. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13397974#comment-13397974 ] Jason Lowe commented on MAPREDUCE-3868: --- This also broke the dist tar build - see HDFS-3549. Reenable Raid - Key: MAPREDUCE-3868 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868 Project: Hadoop Map/Reduce Issue Type: Bug Components: contrib/raid Reporter: Scott Chen Assignee: Weiyan Wang Attachments: MAPREDUCE-3868-1.patch, MAPREDUCE-3868-2.patch, MAPREDUCE-3868-3.patch, MAPREDUCE-3868.patch, MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh Currently Raid is outdated and not compiled. Make it compile. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13398178#comment-13398178 ] Scott Chen commented on MAPREDUCE-3868: --- Sorry for causing the trouble. I should have run findbugs before checking this in. Reenable Raid - Key: MAPREDUCE-3868 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868 Project: Hadoop Map/Reduce Issue Type: Bug Components: contrib/raid Reporter: Scott Chen Assignee: Weiyan Wang Attachments: MAPREDUCE-3868-1.patch, MAPREDUCE-3868-2.patch, MAPREDUCE-3868-3.patch, MAPREDUCE-3868.patch, MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh Currently Raid is outdated and not compiled. Make it compile. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13396785#comment-13396785 ] Hudson commented on MAPREDUCE-3868: --- Integrated in Hadoop-Mapreduce-trunk #1114 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1114/]) MAPREDUCE-3868. Make Raid Compile. (Weiyan Wang via schen) (Revision 1351548) Result = FAILURE schen : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1351548 Files : * /hadoop/common/trunk/hadoop-assemblies/src/main/resources/assemblies/hadoop-raid-dist.xml * /hadoop/common/trunk/hadoop-dist/pom.xml * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/pom.xml * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/conf * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/hdfs/server/datanode/RaidBlockSender.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeRaidUtil.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/raid/BlockFixer.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/raid/DirectoryTraversal.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/raid/DistRaid.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/raid/GaloisField.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/raid/JobMonitor.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/raid/RaidNode.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/raid/RaidShell.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/raid/ReedSolomonCode.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/sbin * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/hdfs/TestRaidDfs.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestBlockFixer.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestDirectoryTraversal.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestErasureCodes.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestRaidFilter.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestRaidHar.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestRaidNode.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestRaidPurge.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestRaidShell.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestRaidShellFsck.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestReedSolomonDecoder.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestReedSolomonEncoder.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/INodeFile.java * /hadoop/common/trunk/hadoop-hdfs-project/pom.xml * /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt * /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/raid/bin * /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/raid/conf * /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/raid/src/java/org * /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/raid/src/test/org * /hadoop/common/trunk/hadoop-project/pom.xml Reenable Raid - Key: MAPREDUCE-3868 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868 Project: Hadoop Map/Reduce Issue Type: Bug Components: contrib/raid Reporter: Scott Chen Assignee:
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
[
https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13396817#comment-13396817
]
Eli Collins commented on MAPREDUCE-3868:
The hdfs trunk jenkins job is failing with the following now, looks like some
dev-support files are missing.
{noformat}
[INFO]
[INFO] BUILD FAILURE
[INFO]
...
[ERROR] Could not find resource
'/home/jenkins/jenkins-slave/workspace/Hadoop-Hdfs-trunk/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/dev-support/findbugsExcludeFile.xml'.
- [Help 1]
{noformat}
Reenable Raid
-
Key: MAPREDUCE-3868
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: contrib/raid
Reporter: Scott Chen
Assignee: Weiyan Wang
Attachments: MAPREDUCE-3868-1.patch, MAPREDUCE-3868-2.patch,
MAPREDUCE-3868-3.patch, MAPREDUCE-3868.patch, MAPREDUCE-3868v1.patch,
MAPREDUCE-3868v1.sh
Currently Raid is outdated and not compiled. Make it compile.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13396979#comment-13396979 ] Weiyan Wang commented on MAPREDUCE-3868: @Eli, sorry I don't know this is needed. How could I test jenkins jobs manually when I test my fix? Reenable Raid - Key: MAPREDUCE-3868 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868 Project: Hadoop Map/Reduce Issue Type: Bug Components: contrib/raid Reporter: Scott Chen Assignee: Weiyan Wang Attachments: MAPREDUCE-3868-1.patch, MAPREDUCE-3868-2.patch, MAPREDUCE-3868-3.patch, MAPREDUCE-3868.patch, MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh Currently Raid is outdated and not compiled. Make it compile. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13396434#comment-13396434 ] Hudson commented on MAPREDUCE-3868: --- Integrated in Hadoop-Common-trunk-Commit #2369 (See [https://builds.apache.org/job/Hadoop-Common-trunk-Commit/2369/]) MAPREDUCE-3868. Make Raid Compile. (Weiyan Wang via schen) (Revision 1351548) Result = SUCCESS schen : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1351548 Files : * /hadoop/common/trunk/hadoop-assemblies/src/main/resources/assemblies/hadoop-raid-dist.xml * /hadoop/common/trunk/hadoop-dist/pom.xml * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/pom.xml * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/conf * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/hdfs/server/datanode/RaidBlockSender.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeRaidUtil.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/raid/BlockFixer.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/raid/DirectoryTraversal.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/raid/DistRaid.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/raid/GaloisField.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/raid/JobMonitor.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/raid/RaidNode.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/raid/RaidShell.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/raid/ReedSolomonCode.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/sbin * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/hdfs/TestRaidDfs.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestBlockFixer.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestDirectoryTraversal.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestErasureCodes.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestRaidFilter.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestRaidHar.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestRaidNode.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestRaidPurge.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestRaidShell.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestRaidShellFsck.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestReedSolomonDecoder.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestReedSolomonEncoder.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/INodeFile.java * /hadoop/common/trunk/hadoop-hdfs-project/pom.xml * /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt * /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/raid/bin * /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/raid/conf * /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/raid/src/java/org * /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/raid/src/test/org * /hadoop/common/trunk/hadoop-project/pom.xml Reenable Raid - Key: MAPREDUCE-3868 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868 Project: Hadoop Map/Reduce Issue Type: Bug Components: contrib/raid Reporter: Scott Chen
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13396437#comment-13396437 ] Hudson commented on MAPREDUCE-3868: --- Integrated in Hadoop-Hdfs-trunk-Commit #2439 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/2439/]) MAPREDUCE-3868. Make Raid Compile. (Weiyan Wang via schen) (Revision 1351548) Result = SUCCESS schen : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1351548 Files : * /hadoop/common/trunk/hadoop-assemblies/src/main/resources/assemblies/hadoop-raid-dist.xml * /hadoop/common/trunk/hadoop-dist/pom.xml * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/pom.xml * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/conf * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/hdfs/server/datanode/RaidBlockSender.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeRaidUtil.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/raid/BlockFixer.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/raid/DirectoryTraversal.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/raid/DistRaid.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/raid/GaloisField.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/raid/JobMonitor.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/raid/RaidNode.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/raid/RaidShell.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/raid/ReedSolomonCode.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/sbin * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/hdfs/TestRaidDfs.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestBlockFixer.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestDirectoryTraversal.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestErasureCodes.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestRaidFilter.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestRaidHar.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestRaidNode.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestRaidPurge.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestRaidShell.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestRaidShellFsck.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestReedSolomonDecoder.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestReedSolomonEncoder.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/INodeFile.java * /hadoop/common/trunk/hadoop-hdfs-project/pom.xml * /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt * /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/raid/bin * /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/raid/conf * /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/raid/src/java/org * /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/raid/src/test/org * /hadoop/common/trunk/hadoop-project/pom.xml Reenable Raid - Key: MAPREDUCE-3868 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868 Project: Hadoop Map/Reduce Issue Type: Bug Components: contrib/raid Reporter: Scott Chen Assignee:
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13396454#comment-13396454 ] Hudson commented on MAPREDUCE-3868: --- Integrated in Hadoop-Mapreduce-trunk-Commit #2388 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/2388/]) MAPREDUCE-3868. Make Raid Compile. (Weiyan Wang via schen) (Revision 1351548) Result = FAILURE schen : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1351548 Files : * /hadoop/common/trunk/hadoop-assemblies/src/main/resources/assemblies/hadoop-raid-dist.xml * /hadoop/common/trunk/hadoop-dist/pom.xml * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/pom.xml * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/conf * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/hdfs/server/datanode/RaidBlockSender.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeRaidUtil.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/raid/BlockFixer.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/raid/DirectoryTraversal.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/raid/DistRaid.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/raid/GaloisField.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/raid/JobMonitor.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/raid/RaidNode.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/raid/RaidShell.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/raid/ReedSolomonCode.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/sbin * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/hdfs/TestRaidDfs.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestBlockFixer.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestDirectoryTraversal.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestErasureCodes.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestRaidFilter.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestRaidHar.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestRaidNode.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestRaidPurge.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestRaidShell.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestRaidShellFsck.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestReedSolomonDecoder.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestReedSolomonEncoder.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/INodeFile.java * /hadoop/common/trunk/hadoop-hdfs-project/pom.xml * /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt * /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/raid/bin * /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/raid/conf * /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/raid/src/java/org * /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/raid/src/test/org * /hadoop/common/trunk/hadoop-project/pom.xml Reenable Raid - Key: MAPREDUCE-3868 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868 Project: Hadoop Map/Reduce Issue Type: Bug Components: contrib/raid Reporter: Scott Chen
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13396462#comment-13396462 ] Andrew Purtell commented on MAPREDUCE-3868: --- Can we get this on branch-2? Reenable Raid - Key: MAPREDUCE-3868 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868 Project: Hadoop Map/Reduce Issue Type: Bug Components: contrib/raid Reporter: Scott Chen Assignee: Weiyan Wang Attachments: MAPREDUCE-3868-1.patch, MAPREDUCE-3868-2.patch, MAPREDUCE-3868-3.patch, MAPREDUCE-3868.patch, MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh Currently Raid is outdated and not compiled. Make it compile. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13393520#comment-13393520 ] Weiyan Wang commented on MAPREDUCE-3868: Move to svn, @Scott, please follow below steps to apply the patch: 1. run MAPREDUCE-3868v1.sh svn (you may need to modify the script to use MKPARENT=--parents) 2. patch -p0 -i MAPREDUCE-3868-3.patch 3. svn add hadoop-assemblies/src/main/resources/assemblies/hadoop-raid-dist.xml 4. svn add hadoop-hdfs-project/hadoop-hdfs-raid/pom.xml Reenable Raid - Key: MAPREDUCE-3868 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868 Project: Hadoop Map/Reduce Issue Type: New Feature Components: contrib/raid Reporter: Scott Chen Assignee: Weiyan Wang Attachments: MAPREDUCE-3868-1.patch, MAPREDUCE-3868-2.patch, MAPREDUCE-3868-3.patch, MAPREDUCE-3868.patch, MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh Currently Raid is outdated and not compiled. Make it compile. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13393358#comment-13393358 ] Weiyan Wang commented on MAPREDUCE-3868: My new patch is MAPREDUCE-3868-2.patch, you could check the log using git log --follow Filename Reenable Raid - Key: MAPREDUCE-3868 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868 Project: Hadoop Map/Reduce Issue Type: New Feature Components: contrib/raid Reporter: Scott Chen Assignee: Weiyan Wang Attachments: MAPREDUCE-3868-1.patch, MAPREDUCE-3868-2.patch, MAPREDUCE-3868.patch, MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh Currently Raid is outdated and not compiled. Make it compile. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13393407#comment-13393407 ] Alejandro Abdelnur commented on MAPREDUCE-3868: --- @Weiyan, if we would use GIT I would have said nothing, but Apache Hadoop uses SVN, GIT is just a mirror. thx Reenable Raid - Key: MAPREDUCE-3868 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868 Project: Hadoop Map/Reduce Issue Type: New Feature Components: contrib/raid Reporter: Scott Chen Assignee: Weiyan Wang Attachments: MAPREDUCE-3868-1.patch, MAPREDUCE-3868-2.patch, MAPREDUCE-3868.patch, MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh Currently Raid is outdated and not compiled. Make it compile. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13295940#comment-13295940 ] Scott Chen commented on MAPREDUCE-3868: --- Patch doesn't apply. Can you rebase? Reenable Raid - Key: MAPREDUCE-3868 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868 Project: Hadoop Map/Reduce Issue Type: New Feature Components: contrib/raid Reporter: Scott Chen Assignee: Weiyan Wang Attachments: MAPREDUCE-3868.patch, MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh Currently Raid is outdated and not compiled. Make it compile. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13295944#comment-13295944 ] Weiyan Wang commented on MAPREDUCE-3868: rebase, the patch is generated from git diff. Reenable Raid - Key: MAPREDUCE-3868 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868 Project: Hadoop Map/Reduce Issue Type: New Feature Components: contrib/raid Reporter: Scott Chen Assignee: Weiyan Wang Attachments: MAPREDUCE-3868-1.patch, MAPREDUCE-3868.patch, MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh Currently Raid is outdated and not compiled. Make it compile. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13295964#comment-13295964 ] Scott Chen commented on MAPREDUCE-3868: --- +1 The patch looks good to me. I will commit this later. Reenable Raid - Key: MAPREDUCE-3868 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868 Project: Hadoop Map/Reduce Issue Type: New Feature Components: contrib/raid Reporter: Scott Chen Assignee: Weiyan Wang Attachments: MAPREDUCE-3868-1.patch, MAPREDUCE-3868.patch, MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh Currently Raid is outdated and not compiled. Make it compile. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13295986#comment-13295986 ] Alejandro Abdelnur commented on MAPREDUCE-3868: --- @Weiyan, the latest patch size is 651K, it seems it is not using the script of the original patch to move things around (and keep history). Would you mind doing a script/patch update so we don't lose the history? thx Reenable Raid - Key: MAPREDUCE-3868 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868 Project: Hadoop Map/Reduce Issue Type: New Feature Components: contrib/raid Reporter: Scott Chen Assignee: Weiyan Wang Attachments: MAPREDUCE-3868-1.patch, MAPREDUCE-3868.patch, MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh Currently Raid is outdated and not compiled. Make it compile. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
[
https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13295999#comment-13295999
]
Scott Chen commented on MAPREDUCE-3868:
---
There are compilation failures
{code}
[INFO]
[INFO] BUILD FAILURE
[INFO]
[INFO] Total time: 1:59.229s
[INFO] Finished at: Fri Jun 15 16:03:11 PDT 2012
[INFO] Final Memory: 45M/123M
[INFO]
[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-compiler-plugin:2.3.2:compile (default-compile)
on project hadoop-hdfs-raid: Compilation failure: Compilation failure:
[ERROR]
/Users/schen/Work/hadoop-apache-commit/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/hdfs/server/datanode/RaidBlockSender.java:[251,26]
cannot find symbol
[ERROR] symbol : constructor PacketHeader(int,long,long,boolean,int)
[ERROR] location: class
org.apache.hadoop.hdfs.protocol.datatransfer.PacketHeader
[ERROR]
/Users/schen/Work/hadoop-apache-commit/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeRaidUtil.java:[52,21]
cannot find symbol
[ERROR] symbol : method
getBlockLocations(java.lang.String,long,long,boolean,boolean)
[ERROR] location: class org.apache.hadoop.hdfs.server.namenode.FSNamesystem
[ERROR] - [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please
read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn goals -rf :hadoop-hdfs-raid
{code}
Reenable Raid
-
Key: MAPREDUCE-3868
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868
Project: Hadoop Map/Reduce
Issue Type: New Feature
Components: contrib/raid
Reporter: Scott Chen
Assignee: Weiyan Wang
Attachments: MAPREDUCE-3868-1.patch, MAPREDUCE-3868.patch,
MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh
Currently Raid is outdated and not compiled. Make it compile.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13296009#comment-13296009 ] Weiyan Wang commented on MAPREDUCE-3868: Alejandro Abdelnur, sorry I don't get it, what history you want to keep? and how can I verify the history is not lost? Reenable Raid - Key: MAPREDUCE-3868 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868 Project: Hadoop Map/Reduce Issue Type: New Feature Components: contrib/raid Reporter: Scott Chen Assignee: Weiyan Wang Attachments: MAPREDUCE-3868-1.patch, MAPREDUCE-3868.patch, MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh Currently Raid is outdated and not compiled. Make it compile. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13296072#comment-13296072 ] Alejandro Abdelnur commented on MAPREDUCE-3868: --- most of the patch is just moving files around, doing that with 'patch' will delete/create those files and subversion will not know bind them. This means that all changes prior this this JIRA will be lost as all the moved files will be (from SVN perspective) new files. you won't be able to track previous changes directly. The original patch I've submitted as a script/combo patch, the script does 'svn mv' which tells SVN to bind the files in the new location with the old location thus allowing you to trace changes to the first commit of the files. the script works both in filesystem and SVN mode. Reenable Raid - Key: MAPREDUCE-3868 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868 Project: Hadoop Map/Reduce Issue Type: New Feature Components: contrib/raid Reporter: Scott Chen Assignee: Weiyan Wang Attachments: MAPREDUCE-3868-1.patch, MAPREDUCE-3868.patch, MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh Currently Raid is outdated and not compiled. Make it compile. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13296093#comment-13296093 ] Weiyan Wang commented on MAPREDUCE-3868: Thanks! I will use git mv to keep the history. It seems changes in the recent two weeks break some tests. I am going to fix them, sigh... Reenable Raid - Key: MAPREDUCE-3868 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868 Project: Hadoop Map/Reduce Issue Type: New Feature Components: contrib/raid Reporter: Scott Chen Assignee: Weiyan Wang Attachments: MAPREDUCE-3868-1.patch, MAPREDUCE-3868.patch, MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh Currently Raid is outdated and not compiled. Make it compile. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13296097#comment-13296097 ] Alejandro Abdelnur commented on MAPREDUCE-3868: --- with GIT you just move things and GIT finds out that is a move, so nothing special there. The thing is, when committing this to Apache, it is an SVN repo, that is why the script (which locally I use it in 'fs' mode because I use GIT) Reenable Raid - Key: MAPREDUCE-3868 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868 Project: Hadoop Map/Reduce Issue Type: New Feature Components: contrib/raid Reporter: Scott Chen Assignee: Weiyan Wang Attachments: MAPREDUCE-3868-1.patch, MAPREDUCE-3868.patch, MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh Currently Raid is outdated and not compiled. Make it compile. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13278999#comment-13278999 ] Weiyan Wang commented on MAPREDUCE-3868: Alejandro, I just pick up the task recently. And thanks for your instruction, I already fixed some bugs. But still working on the remaining ones. Reenable Raid - Key: MAPREDUCE-3868 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868 Project: Hadoop Map/Reduce Issue Type: New Feature Components: contrib/raid Reporter: Scott Chen Assignee: Weiyan Wang Attachments: MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh Currently Raid is outdated and not compiled. Make it compile. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13278232#comment-13278232 ] Alejandro Abdelnur commented on MAPREDUCE-3868: --- Weiyang, FYI MAPREDUCE-4266 is going to clean up all ANT not used stuff. This means that you'll have to get the RAID code from SVN from the commit prior to MAPREDUCE-4266 when doing you integration. Reenable Raid - Key: MAPREDUCE-3868 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868 Project: Hadoop Map/Reduce Issue Type: New Feature Components: contrib/raid Reporter: Scott Chen Assignee: Weiyan Wang Attachments: MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh Currently Raid is outdated and not compiled. Make it compile. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13276381#comment-13276381 ] Scott Chen commented on MAPREDUCE-3868: --- Weiyang: Thanks for volunteering on this. Looking forward to your patch :) Reenable Raid - Key: MAPREDUCE-3868 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868 Project: Hadoop Map/Reduce Issue Type: New Feature Components: contrib/raid Reporter: Scott Chen Assignee: Weiyan Wang Attachments: MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh Currently Raid is outdated and not compiled. Make it compile. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13237557#comment-13237557 ] Alejandro Abdelnur commented on MAPREDUCE-3868: --- Ram, Dhruba, any update on this? Thxs Reenable Raid - Key: MAPREDUCE-3868 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868 Project: Hadoop Map/Reduce Issue Type: New Feature Components: contrib/raid Reporter: Scott Chen Assignee: Ramkumar Vadali Attachments: MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh Currently Raid is outdated and not compiled. Make it compile. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13212044#comment-13212044 ] Ramkumar Vadali commented on MAPREDUCE-3868: Thanks Alejandro! I have started with your patch, and am starting to look with TestRaidDfs, which does not need a MiniMRCluster. Reenable Raid - Key: MAPREDUCE-3868 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868 Project: Hadoop Map/Reduce Issue Type: New Feature Components: contrib/raid Reporter: Scott Chen Assignee: Ramkumar Vadali Attachments: MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh Currently Raid is outdated and not compiled. Make it compile. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13212047#comment-13212047 ] dhruba borthakur commented on MAPREDUCE-3868: - If we can make Raid run wel with MR2, that should be good. Reenable Raid - Key: MAPREDUCE-3868 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868 Project: Hadoop Map/Reduce Issue Type: New Feature Components: contrib/raid Reporter: Scott Chen Assignee: Ramkumar Vadali Attachments: MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh Currently Raid is outdated and not compiled. Make it compile. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13209614#comment-13209614 ] Alejandro Abdelnur commented on MAPREDUCE-3868: --- Ram, A few tips that may be useful when doing the integration: * If using and IDE (I use Idea) you may have to change the scope of hadoop-minicluster to compile for the IDE to pick all necessary JARs (Idea seems to get confused otherwise). From the command line (Maven) things work fine with the (correct) test scope. * You don't need to build the whole Hadoop project every time. Instead do the following: ** Run once, from root level 'mvn install -DskipTests' ** then CD to hadoop-hdfs-project/hadoop-hdsf-raid and work from there. ** You can do Maven command or point your IDE to the POM there. ** Make sure you are using -offline with Maven command and in your IDE (else you may pick up newer snapshot JARs/POMs from Apache that don't have the changes this patch added) * The new YARN base MiniCluster still has some issues, on failures you have runaway processes (the shutdown logic is broken, a JIRA to fix that is in the works MAPREDUCE-3634) ** What i do is a 'ps -ef | grep java' and then kill the dangling processes * Sometimes (at least in Mac OS) MiniDFS finds some local files and things it is locked and testcases fail because of that. If that is the case, delete those files. * After doing a build javadocs stuff sometimes creates a dir api at src level, ignore that DIR (don't add it to your patch) * the distribution layout follows the new layout, I've put the scripts in the right places, but I have not modified the scripts to look for things in the right places * the full distribution must be done from root level, do 'mvn clean package -DskipTests -Pdist', the full distribution will be in hadoop-dist/target/ * the testcases that start MR jobs (and maybe the main code) will have to setup the framework to YARN, you have to set in your job conf the following property: mapreduce.framework.name=yarn (the streaming porting did this HADOOP-7590) * in the testcases, you may have to add your classes as attached JAR, use the JarFinder.getJar() class to get the RAID JAR (the streaming porting did this HADOOP-7590). * Some MiniMRCluster methods related to MR1 throw UnsupportedOperationExceptions, you may have to find other ways of getting the right info. For example: MiniMRCluster.getJobTrackerPort() now throws UOE, you should use instead MiniMRCluster.createJobConf().get(JTConfig.JT_IPC_ADDRESS) * I've modified the TestBlockFixer with the last 2 items and TestBlockFixerBlockFixDist.testBlockFixDist() test get to start and run for long before failing. Reenable Raid - Key: MAPREDUCE-3868 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868 Project: Hadoop Map/Reduce Issue Type: New Feature Components: contrib/raid Reporter: Scott Chen Assignee: Ramkumar Vadali Attachments: MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh Currently Raid is outdated and not compiled. Make it compile. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
