[
https://issues.apache.org/jira/browse/PIG-2891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13466255#comment-13466255
]
Cheolsoo Park commented on PIG-2891:
------------------------------------
Hi Ionut,
Please let me summarize what the current issues are with using pig 0.10.0 and
hbase 0.94. Hopefully, this will help you to understand better.
1) Pig.jar embeds hbase-0.90; therefore, if you use it with any upper versions
of hbase, you will get an incompatibility exception. We could upgrade the hbase
dependency in pig.jar to 0.94; however, that will cause the same problem to
people who are using hbase-90. In addition, that breaks 2 unit tests (PIG-2885).
2) The suggested workaround is using pig-withouthadoop.jar. Since
pig-withouthadoop.jar doesn't contain hadoop and hbase, you have to install
them and set HADOOP_HOME and HBASE_HOME. The current pig-wihtouthadoop.jar
works fine with habse-0.90, 0.92, and 0.94. In fact, there was a question on
the user mailing list regarding how to get pig 0.10.0 working with hbase-0.94:
http://mail-archives.apache.org/mod_mbox/pig-user/201209.mbox/%3ccao8aty13+cxcz8fks_jsgh_fwyxh3zb_sxjv7ix-og5yeqi...@mail.gmail.com%3E
That being said, I don't see why this is a blocking issue. Is there any reason
why you cannot use pig-withouthadoop.jar?
Thanks!
> HBaseStorage can't work with HBase 0.94, as the connect method changed
> ----------------------------------------------------------------------
>
> Key: PIG-2891
> URL: https://issues.apache.org/jira/browse/PIG-2891
> Project: Pig
> Issue Type: Bug
> Components: build, internal-udfs
> Affects Versions: 0.10.0, 0.11
> Environment: Mac OS X, HBase on local mode, Pig on local mode
> Reporter: Russell Jurney
> Assignee: Alan Gates
> Labels: builtin, fun, happy, hbase, pants, udf
> Fix For: 0.11, 0.10.1
>
> Attachments: PIG-2891.patch
>
>
> Pig HBaseStorage doesn't work against a local mode HBase 0.94.1.
> Updating the JAR in ivy/libraries.properties addresses the issue, which is
> pasted here:
> 2012-08-24 23:27:07,431 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR
> 2999: Unexpected internal error. Not a host:port pair:
> ?'58971@russell-jurneys-macbook-pro.local10.0.1.11,55171,1345873780529
> 2012-08-24 23:27:07,431 [main] ERROR org.apache.pig.tools.grunt.Grunt -
> java.lang.IllegalArgumentException: Not a host:port pair:
> ?'58971@russell-jurneys-macbook-pro.local10.0.1.11,55171,1345873780529
> at org.apache.hadoop.hbase.HServerAddress.<init>(HServerAddress.java:60)
> at
> org.apache.hadoop.hbase.zookeeper.RootRegionTracker.dataToHServerAddress(RootRegionTracker.java:82)
> at
> org.apache.hadoop.hbase.zookeeper.RootRegionTracker.waitRootRegionLocation(RootRegionTracker.java:73)
> at
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:575)
> at
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:555)
> at
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegionInMeta(HConnectionManager.java:684)
> at
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:586)
> at
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:555)
> at
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegionInMeta(HConnectionManager.java:684)
> at
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:590)
> at
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:555)
> at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:171)
> at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:145)
> at
> org.apache.hadoop.hbase.mapreduce.TableOutputFormat.setConf(TableOutputFormat.java:196)
> at
> org.apache.pig.backend.hadoop.hbase.HBaseStorage.getOutputFormat(HBaseStorage.java:593)
> at
> org.apache.pig.newplan.logical.rules.InputOutputFileValidator$InputOutputFileVisitor.visit(InputOutputFileValidator.java:80)
> at
> org.apache.pig.newplan.logical.relational.LOStore.accept(LOStore.java:66)
> at
> org.apache.pig.newplan.DepthFirstWalker.depthFirst(DepthFirstWalker.java:64)
> at
> org.apache.pig.newplan.DepthFirstWalker.depthFirst(DepthFirstWalker.java:66)
> at
> org.apache.pig.newplan.DepthFirstWalker.depthFirst(DepthFirstWalker.java:66)
> at
> org.apache.pig.newplan.DepthFirstWalker.walk(DepthFirstWalker.java:53)
> at org.apache.pig.newplan.PlanVisitor.visit(PlanVisitor.java:50)
> at
> org.apache.pig.newplan.logical.rules.InputOutputFileValidator.validate(InputOutputFileValidator.java:45)
> at
> org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.compile(HExecutionEngine.java:288)
> at org.apache.pig.PigServer.compilePp(PigServer.java:1310)
> at
> org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1247)
> at org.apache.pig.PigServer.execute(PigServer.java:1239)
> at org.apache.pig.PigServer.executeBatch(PigServer.java:333)
> at
> org.apache.pig.tools.grunt.GruntParser.executeBatch(GruntParser.java:136)
> at
> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:197)
> at
> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:169)
> at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:84)
> at org.apache.pig.Main.run(Main.java:602)
> at org.apache.pig.Main.main(Main.java:154)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
