[jira] [Commented] (HBASE-5346) Fix testColumnFamilyCompression and test_TIMERANGE in TestHFileOutputFormat
[ https://issues.apache.org/jira/browse/HBASE-5346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13211136#comment-13211136 ] Hudson commented on HBASE-5346: --- Integrated in HBase-TRUNK #2665 (See [https://builds.apache.org/job/HBase-TRUNK/2665/]) HBASE-5346 Fix testColumnFamilyCompression and test_TIMERANGE in TestHFileOutputFormat (Revision 1245280) Result = FAILURE stack : Files : * /hbase/trunk/src/test/java/org/apache/hadoop/hbase/mapreduce/TestHFileOutputFormat.java Fix testColumnFamilyCompression and test_TIMERANGE in TestHFileOutputFormat Key: HBASE-5346 URL: https://issues.apache.org/jira/browse/HBASE-5346 Project: HBase Issue Type: Sub-task Components: mapreduce, test Affects Versions: 0.94.0, 0.92.0 Reporter: Gregory Chanan Assignee: Gregory Chanan Fix For: 0.94.0, 0.92.0 Attachments: HBASE-5346-v0.patch Running mvn -Dhadoop.profile=23 test -P localTests -Dtest=org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat yields this on 0.92 (for testColumnFamilyCompression and test_TIMERANGE): Failed tests: testColumnFamilyCompression(org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat): HFile for column family info-A not found Tests in error: test_TIMERANGE(org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat): /home/gchanan/workspace/apache92/target/test-data/276cbd0c-c771-4f81-9ba8-c464c9dd7486/test_TIMERANGE_present/_temporary/0/_temporary/_attempt_200707121733_0001_m_00_0 (Is a directory) The problem is that these tests make incorrect assumptions about the output of mapreduce jobs. Prior to 0.23, temporary data was in, for example: ./_temporary/_attempt___r_00_0/b/1979617994050536795 Now that has changed. The correct way to get that path is based on getDefaultWorkFile. Also, the data is not moved into the outputPath until both the Task and Job are committed. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5346) Fix testColumnFamilyCompression and test_TIMERANGE in TestHFileOutputFormat
[ https://issues.apache.org/jira/browse/HBASE-5346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13209952#comment-13209952 ] Gregory Chanan commented on HBASE-5346: --- Thanks! Can we get this into 0.92 as well? Do I have to do anything to make that happen? Fix testColumnFamilyCompression and test_TIMERANGE in TestHFileOutputFormat Key: HBASE-5346 URL: https://issues.apache.org/jira/browse/HBASE-5346 Project: HBase Issue Type: Sub-task Components: mapreduce, test Affects Versions: 0.94.0, 0.92.0 Reporter: Gregory Chanan Assignee: Gregory Chanan Fix For: 0.94.0 Attachments: HBASE-5346-v0.patch Running mvn -Dhadoop.profile=23 test -P localTests -Dtest=org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat yields this on 0.92 (for testColumnFamilyCompression and test_TIMERANGE): Failed tests: testColumnFamilyCompression(org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat): HFile for column family info-A not found Tests in error: test_TIMERANGE(org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat): /home/gchanan/workspace/apache92/target/test-data/276cbd0c-c771-4f81-9ba8-c464c9dd7486/test_TIMERANGE_present/_temporary/0/_temporary/_attempt_200707121733_0001_m_00_0 (Is a directory) The problem is that these tests make incorrect assumptions about the output of mapreduce jobs. Prior to 0.23, temporary data was in, for example: ./_temporary/_attempt___r_00_0/b/1979617994050536795 Now that has changed. The correct way to get that path is based on getDefaultWorkFile. Also, the data is not moved into the outputPath until both the Task and Job are committed. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5346) Fix testColumnFamilyCompression and test_TIMERANGE in TestHFileOutputFormat
[ https://issues.apache.org/jira/browse/HBASE-5346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13210074#comment-13210074 ] Hudson commented on HBASE-5346: --- Integrated in HBase-TRUNK-security #113 (See [https://builds.apache.org/job/HBase-TRUNK-security/113/]) HBASE-5346 Fix testColumnFamilyCompression and test_TIMERANGE in TestHFileOutputFormat (Revision 1245280) Result = FAILURE stack : Files : * /hbase/trunk/src/test/java/org/apache/hadoop/hbase/mapreduce/TestHFileOutputFormat.java Fix testColumnFamilyCompression and test_TIMERANGE in TestHFileOutputFormat Key: HBASE-5346 URL: https://issues.apache.org/jira/browse/HBASE-5346 Project: HBase Issue Type: Sub-task Components: mapreduce, test Affects Versions: 0.94.0, 0.92.0 Reporter: Gregory Chanan Assignee: Gregory Chanan Fix For: 0.94.0 Attachments: HBASE-5346-v0.patch Running mvn -Dhadoop.profile=23 test -P localTests -Dtest=org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat yields this on 0.92 (for testColumnFamilyCompression and test_TIMERANGE): Failed tests: testColumnFamilyCompression(org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat): HFile for column family info-A not found Tests in error: test_TIMERANGE(org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat): /home/gchanan/workspace/apache92/target/test-data/276cbd0c-c771-4f81-9ba8-c464c9dd7486/test_TIMERANGE_present/_temporary/0/_temporary/_attempt_200707121733_0001_m_00_0 (Is a directory) The problem is that these tests make incorrect assumptions about the output of mapreduce jobs. Prior to 0.23, temporary data was in, for example: ./_temporary/_attempt___r_00_0/b/1979617994050536795 Now that has changed. The correct way to get that path is based on getDefaultWorkFile. Also, the data is not moved into the outputPath until both the Task and Job are committed. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5346) Fix testColumnFamilyCompression and test_TIMERANGE in TestHFileOutputFormat
[ https://issues.apache.org/jira/browse/HBASE-5346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13209019#comment-13209019 ] Gregory Chanan commented on HBASE-5346: --- @stack: Any comment on my previous message? It looks like this can be committed, but my reading of the results could be wrong. Fix testColumnFamilyCompression and test_TIMERANGE in TestHFileOutputFormat Key: HBASE-5346 URL: https://issues.apache.org/jira/browse/HBASE-5346 Project: HBase Issue Type: Sub-task Components: mapreduce, test Affects Versions: 0.90.4, 0.92.0 Reporter: Gregory Chanan Assignee: Gregory Chanan Attachments: HBASE-5346-v0.patch Running mvn -Dhadoop.profile=23 test -P localTests -Dtest=org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat yields this on 0.92 (for testColumnFamilyCompression and test_TIMERANGE): Failed tests: testColumnFamilyCompression(org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat): HFile for column family info-A not found Tests in error: test_TIMERANGE(org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat): /home/gchanan/workspace/apache92/target/test-data/276cbd0c-c771-4f81-9ba8-c464c9dd7486/test_TIMERANGE_present/_temporary/0/_temporary/_attempt_200707121733_0001_m_00_0 (Is a directory) The problem is that these tests make incorrect assumptions about the output of mapreduce jobs. Prior to 0.23, temporary data was in, for example: ./_temporary/_attempt___r_00_0/b/1979617994050536795 Now that has changed. The correct way to get that path is based on getDefaultWorkFile. Also, the data is not moved into the outputPath until both the Task and Job are committed. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5346) Fix testColumnFamilyCompression and test_TIMERANGE in TestHFileOutputFormat
[ https://issues.apache.org/jira/browse/HBASE-5346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13204775#comment-13204775 ] Gregory Chanan commented on HBASE-5346: --- It looks like the tests testColumnFamilyCompression and test_TIMERANGE passed, if my reading of the results is correct. Fix testColumnFamilyCompression and test_TIMERANGE in TestHFileOutputFormat Key: HBASE-5346 URL: https://issues.apache.org/jira/browse/HBASE-5346 Project: HBase Issue Type: Sub-task Components: mapreduce, test Affects Versions: 0.90.4, 0.92.0 Reporter: Gregory Chanan Assignee: Gregory Chanan Attachments: HBASE-5346-v0.patch Running mvn -Dhadoop.profile=23 test -P localTests -Dtest=org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat yields this on 0.92 (for testColumnFamilyCompression and test_TIMERANGE): Failed tests: testColumnFamilyCompression(org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat): HFile for column family info-A not found Tests in error: test_TIMERANGE(org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat): /home/gchanan/workspace/apache92/target/test-data/276cbd0c-c771-4f81-9ba8-c464c9dd7486/test_TIMERANGE_present/_temporary/0/_temporary/_attempt_200707121733_0001_m_00_0 (Is a directory) The problem is that these tests make incorrect assumptions about the output of mapreduce jobs. Prior to 0.23, temporary data was in, for example: ./_temporary/_attempt___r_00_0/b/1979617994050536795 Now that has changed. The correct way to get that path is based on getDefaultWorkFile. Also, the data is not moved into the outputPath until both the Task and Job are committed. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5346) Fix testColumnFamilyCompression and test_TIMERANGE in TestHFileOutputFormat
[ https://issues.apache.org/jira/browse/HBASE-5346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13202986#comment-13202986 ] stack commented on HBASE-5346: -- Patch looks good to me. Let me submit the patch to see if it breaks when we run on 1.0.0 hadoop. Fix testColumnFamilyCompression and test_TIMERANGE in TestHFileOutputFormat Key: HBASE-5346 URL: https://issues.apache.org/jira/browse/HBASE-5346 Project: HBase Issue Type: Sub-task Components: mapreduce, test Affects Versions: 0.90.4, 0.92.0 Reporter: Gregory Chanan Assignee: Gregory Chanan Attachments: HBASE-5346-v0.patch Running mvn -Dhadoop.profile=23 test -P localTests -Dtest=org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat yields this on 0.92 (for testColumnFamilyCompression and test_TIMERANGE): Failed tests: testColumnFamilyCompression(org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat): HFile for column family info-A not found Tests in error: test_TIMERANGE(org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat): /home/gchanan/workspace/apache92/target/test-data/276cbd0c-c771-4f81-9ba8-c464c9dd7486/test_TIMERANGE_present/_temporary/0/_temporary/_attempt_200707121733_0001_m_00_0 (Is a directory) The problem is that these tests make incorrect assumptions about the output of mapreduce jobs. Prior to 0.23, temporary data was in, for example: ./_temporary/_attempt___r_00_0/b/1979617994050536795 Now that has changed. The correct way to get that path is based on getDefaultWorkFile. Also, the data is not moved into the outputPath until both the Task and Job are committed. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5346) Fix testColumnFamilyCompression and test_TIMERANGE in TestHFileOutputFormat
[ https://issues.apache.org/jira/browse/HBASE-5346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13203039#comment-13203039 ] Hadoop QA commented on HBASE-5346: -- -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12513691/HBASE-5346-v0.patch against trunk revision . +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 3 new or modified tests. -1 javadoc. The javadoc tool appears to have generated -136 warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. -1 findbugs. The patch appears to introduce 156 new Findbugs (version 1.3.9) warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. -1 core tests. The patch failed these unit tests: org.apache.hadoop.hbase.io.hfile.TestHFileBlock org.apache.hadoop.hbase.mapreduce.TestImportTsv org.apache.hadoop.hbase.mapred.TestTableMapReduce org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/918//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/918//artifact/trunk/patchprocess/newPatchFindbugsWarnings.html Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/918//console This message is automatically generated. Fix testColumnFamilyCompression and test_TIMERANGE in TestHFileOutputFormat Key: HBASE-5346 URL: https://issues.apache.org/jira/browse/HBASE-5346 Project: HBase Issue Type: Sub-task Components: mapreduce, test Affects Versions: 0.90.4, 0.92.0 Reporter: Gregory Chanan Assignee: Gregory Chanan Attachments: HBASE-5346-v0.patch Running mvn -Dhadoop.profile=23 test -P localTests -Dtest=org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat yields this on 0.92 (for testColumnFamilyCompression and test_TIMERANGE): Failed tests: testColumnFamilyCompression(org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat): HFile for column family info-A not found Tests in error: test_TIMERANGE(org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat): /home/gchanan/workspace/apache92/target/test-data/276cbd0c-c771-4f81-9ba8-c464c9dd7486/test_TIMERANGE_present/_temporary/0/_temporary/_attempt_200707121733_0001_m_00_0 (Is a directory) The problem is that these tests make incorrect assumptions about the output of mapreduce jobs. Prior to 0.23, temporary data was in, for example: ./_temporary/_attempt___r_00_0/b/1979617994050536795 Now that has changed. The correct way to get that path is based on getDefaultWorkFile. Also, the data is not moved into the outputPath until both the Task and Job are committed. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
