Nathan Schile created CRUNCH-664:
------------------------------------
Summary: [crunch-hbase] HBase configuration properties overwritten
Key: CRUNCH-664
URL: https://issues.apache.org/jira/browse/CRUNCH-664
Project: Crunch
Issue Type: Improvement
Affects Versions: 0.14.0
Reporter: Nathan Schile
Fix For: 1.0.0
When constructing a MRPipeline with a Hadoop Configuration that contains HBase
configuration properties, those properties are overwritten by the default
values from hbase-default.xml and hbase-site.xml. This is because the
HBaseTarget and HFileTarget classes take the Hadoop configuration and then
applies the HBase defaults [1]. Patch for the fix is attached.
[1]
{code:java}
public void configureForMapReduce(Job job, PType<?> ptype, Path outputPath,
String name) {
Configuration conf = job.getConfiguration();
HBaseConfiguration.addHbaseResources(conf);
...
}
{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
