[
https://issues.apache.org/jira/browse/HBASE-5317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13205982#comment-13205982
]
Gregory Chanan commented on HBASE-5317:
---------------------------------------
Ok, did some more digging.
In 0.23 the MRAppMaster tries to load up the OutputFileFormat, so we have to
load that, which we didn't have to do prior to 0.23.
It looks like: TableMapReduceUtil.addDependencyJars(job)
is supposed to do this, but when I run it, no jars can be found for the classes
associated with the job.
By default, it looks like the classpath in the test is:
{basedir}/target/test-classes:{basedir}/target/classes:...
but the relevant jars are in:
target/
target/hbase-{VERSION}/hbase-{VERSION}/
By the way, when I add hbase jars manually to "tmpjars" [which is what
addDependencyJars does], the test passes.
So it seems like the solution is either:
1) Modify the classpath to include those jars
2) Build a jar myself of the relevant classes
I'm not sure what the correct answer is; please advise.
> Fix TestHFileOutputFormat to work against hadoop 0.23
> -----------------------------------------------------
>
> Key: HBASE-5317
> URL: https://issues.apache.org/jira/browse/HBASE-5317
> Project: HBase
> Issue Type: Bug
> Components: test
> Affects Versions: 0.94.0, 0.92.0
> Reporter: Gregory Chanan
> Assignee: Gregory Chanan
> Attachments: HBASE-5317-v0.patch, HBASE-5317-v1.patch
>
>
> Running
> mvn -Dhadoop.profile=23 test -P localTests
> -Dtest=org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat
> yields this on 0.92:
> Failed tests:
> testColumnFamilyCompression(org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat):
> HFile for column family info-A not found
> Tests in error:
> test_TIMERANGE(org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat):
> /home/gchanan/workspace/apache92/target/test-data/276cbd0c-c771-4f81-9ba8-c464c9dd7486/test_TIMERANGE_present/_temporary/0/_temporary/_attempt_200707121733_0001_m_000000_0
> (Is a directory)
>
> testMRIncrementalLoad(org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat):
> TestTable
>
> testMRIncrementalLoadWithSplit(org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat):
> TestTable
> It looks like on trunk, this also results in an error:
>
> testExcludeMinorCompaction(org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat):
> TestTable
> I have a patch that fixes testColumnFamilyCompression and test_TIMERANGE, but
> haven't fixed the other 3 yet.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
