[ https://issues.apache.org/jira/browse/PIG-2115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13065634#comment-13065634 ]
Dmitriy V. Ryaboy commented on PIG-2115: ---------------------------------------- ifn' you don't mind. I can do it if you are unable to, but I am about to go offline for a week, and have a bunch of other patches in flight :). > Pig HBaseStorage configuration and setup issues > ----------------------------------------------- > > Key: PIG-2115 > URL: https://issues.apache.org/jira/browse/PIG-2115 > Project: Pig > Issue Type: Bug > Affects Versions: 0.9.0 > Reporter: Greg Bowyer > Labels: hbase, load, storage > Attachments: HBaseStorage-correctly-configure-child-MapR-task-v1.patch > > > HBase storage currently configures child MapR jobs assuming that the HBase > jars and cluster configuration are present on the hadoop cluster that will > run the pig program. In some circumstances, and for some configurations this > causes problems with both the configuration suddenly becoming defaulted > during a job run as well as ClassNotFound exceptions occurring due to the > child MapReduce job being incorrectly configured. > As such, the hbase built in configuration is merged with the job > configuration using the inbuilt pig classes for this functionality, this > prevents the jobs configuration from being overwritten by defaults. > At the same time this change has been mirrored in the relevant setup methods > called when the HBaseStorage is used as a StoreFunc; this means that the > StoreFunc also correctly sets up the relevant classpath preventing > ClassNotFound exceptions in clusters that are not adding the HBase classes to > the HADOOP_CLASSPATH. > Attached is a patch that hopefully fixes these issues for others. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira