[
https://issues.apache.org/jira/browse/PIG-2220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13085988#comment-13085988
]
Roman Shaposhnik commented on PIG-2220:
---------------------------------------
Hi Dmitry,
I thought of that and did modify the class-path during the Pig execution time.
Somehow it didn't make any difference. Here's an exact command of how I ran it
(notice the last 2 elements of the CP that I added -- the path names there are
verbatim from what I was registering):
{noformat}
/usr/java/64/jdk1.6.0_22/bin/java -Xmx1000m
-Djavax.xml.parsers.DocumentBuilderFactory=com.sun.org.apache.xerces.internal.jaxp.DocumentBuilderFactoryImpl
-Dpig.log.dir=/usr/lib/pig/bin/../logs -Dpig.log.file=pig.log
-Dpig.home.dir=/usr/lib/pig/bin/.. -Dpig.root.logger=INFO,console,DRFA
-classpath
/etc/hbase/conf:/usr/lib/pig/bin/../conf:/usr/java/64/jdk1.6.0_22/lib/tools.jar:/usr/lib/pig/bin/../pig-0.8.1-cdh3u1-core.jar:/usr/lib/pig/bin/../build/pig-*-SNAPSHOT.jar:/usr/lib/pig/bin/../lib/ant-contrib-1.0b3.jar:/usr/lib/pig/bin/../lib/automaton.jar:/usr/lib/pig/bin/../build/ivy/lib/Pig/*.jar:/usr/lib/hadoop/hadoop-core-0.20.2-cdh3u1.jar:/usr/lib/hadoop/lib/ant-contrib-1.0b3.jar:/usr/lib/hadoop/lib/aspectjrt-1.6.5.jar:/usr/lib/hadoop/lib/aspectjtools-1.6.5.jar:/usr/lib/hadoop/lib/commons-cli-1.2.jar:/usr/lib/hadoop/lib/commons-codec-1.4.jar:/usr/lib/hadoop/lib/commons-daemon-1.0.1.jar:/usr/lib/hadoop/lib/commons-el-1.0.jar:/usr/lib/hadoop/lib/commons-httpclient-3.0.1.jar:/usr/lib/hadoop/lib/commons-logging-1.0.4.jar:/usr/lib/hadoop/lib/commons-logging-api-1.0.4.jar:/usr/lib/hadoop/lib/commons-net-1.4.1.jar:/usr/lib/hadoop/lib/core-3.1.1.jar:/usr/lib/hadoop/lib/hadoop-fairscheduler-0.20.2-cdh3u1.jar:/usr/lib/hadoop/lib/hsqldb-1.8.0.10.jar:/usr/lib/hadoop/lib/jackson-core-asl-1.5.2.jar:/usr/lib/hadoop/lib/jackson-mapper-asl-1.5.2.jar:/usr/lib/hadoop/lib/jasper-compiler-5.5.12.jar:/usr/lib/hadoop/lib/jasper-runtime-5.5.12.jar:/usr/lib/hadoop/lib/jdiff:/usr/lib/hadoop/lib/jets3t-0.6.1.jar:/usr/lib/hadoop/lib/jetty-6.1.26.jar:/usr/lib/hadoop/lib/jetty-servlet-tester-6.1.26.jar:/usr/lib/hadoop/lib/jetty-util-6.1.26.jar:/usr/lib/hadoop/lib/jsch-0.1.42.jar:/usr/lib/hadoop/lib/jsp-2.1:/usr/lib/hadoop/lib/junit-4.5.jar:/usr/lib/hadoop/lib/kfs-0.2.2.jar:/usr/lib/hadoop/lib/log4j-1.2.15.jar:/usr/lib/hadoop/lib/mockito-all-1.8.2.jar:/usr/lib/hadoop/lib/native:/usr/lib/hadoop/lib/oro-2.0.8.jar:/usr/lib/hadoop/lib/servlet-api-2.5-20081211.jar:/usr/lib/hadoop/lib/servlet-api-2.5-6.1.14.jar:/usr/lib/hadoop/lib/slf4j-api-1.4.3.jar:/usr/lib/hadoop/lib/slf4j-log4j12-1.4.3.jar:/usr/lib/hadoop/lib/xmlenc-0.52.jar:/usr/lib/hadoop/conf:/usr/lib/zookeeper/zookeeper-3.3.3-cdh3u1.jar:/usr/lib/hbase/hbase-0.90.3-cdh3u1.jar
org.apache.pig.Main
{noformat}
Thanks,
Roman.
> Pig/HBase integration could be improved
> ---------------------------------------
>
> Key: PIG-2220
> URL: https://issues.apache.org/jira/browse/PIG-2220
> Project: Pig
> Issue Type: Improvement
> Components: grunt
> Affects Versions: 0.9.0, 0.10
> Reporter: Roman Shaposhnik
> Priority: Minor
>
> For now any Pig/HBase queries would require the following jars to be
> explicitly added via Pig's register command:
> register /usr/lib/hbase/lib/zookeeper-3.3.3-cdh3u1.jar;
> register /usr/lib/hbase/hbase-0.90.3-cdh3u1.jar;
> register /usr/lib/hbase/lib/guava-r06.jar;
> the longer term solution, perhaps, should be to have the code at submit time
> call hbase's
> TableMapREduceUtil.addDependencyJar(job, HBaseStorageHandler.class) to ship
> it in distributedcache.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
