Hi all,
1- I couldn't get TestHBaseStorage unit test running with hadoop-1.2.1 and
hbase-0.94.12. Is it supposed to work with those versions? The test hangs for
some time and fails with the exception below.
2- Is there any Pig function for deleting rows from an existing HBase
table? With some research I couldn't find one and I am implementing a store
function for that purpose. If anyone is interested I will be happy to
contribute it. The delete functionality can also be imitated with the existing
HBaseStorage function by storing the filtered tuples to a new HBase table, but
this has quite some overhead for large datasets.
Thanks,
Nezih
[junit] java.io.IOException: Shutting down
[junit] at
org.apache.hadoop.hbase.MiniHBaseCluster.init(MiniHBaseCluster.java:203)
[junit] at
org.apache.hadoop.hbase.MiniHBaseCluster.<init>(MiniHBaseCluster.java:76)
[junit] at
org.apache.hadoop.hbase.HBaseTestingUtility.startMiniHBaseCluster(HBaseTestingUtility.java:632)
[junit] at
org.apache.pig.test.TestHBaseStorage.setUp(TestHBaseStorage.java:86)
[junit] Caused by: java.lang.RuntimeException: Failed construction of
Master: class org.apache.hadoop.hbase.master.HMasterKeeperErrorCode =
ConnectionLoss for /hbase
[junit] at
org.apache.hadoop.hbase.util.JVMClusterUtil.createMasterThread(JVMClusterUtil.java:134)
[junit] at
org.apache.hadoop.hbase.LocalHBaseCluster.addMaster(LocalHBaseCluster.java:197)
[junit] at
org.apache.hadoop.hbase.LocalHBaseCluster.<init>(LocalHBaseCluster.java:147)
[junit] at
org.apache.hadoop.hbase.MiniHBaseCluster.init(MiniHBaseCluster.java:185)
[junit] Caused by: org.apache.hadoop.hbase.ZooKeeperConnectionException:
master:57543-0x143b26706a80000-0x143b26706a80000-0x143b26706a80000-0x143b26706a80000
Unexpected KeeperException creating base node
[junit] at
org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.createBaseZNodes(ZooKeeperWatcher.java:169)
[junit] at
org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.<init>(ZooKeeperWatcher.java:154)
[junit] at
org.apache.hadoop.hbase.master.HMaster.<init>(HMaster.java:282)
[junit] at
java.lang.reflect.Constructor.newInstance(Constructor.java:525)
[junit] at
org.apache.hadoop.hbase.util.JVMClusterUtil.createMasterThread(JVMClusterUtil.java:131)
[junit] Caused by:
org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode =
ConnectionLoss for /hbase
[junit] at
org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
[junit] at
org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit] at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1036)
[junit] at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1064)
[junit] at
org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper.exists(RecoverableZooKeeper.java:176)
[junit] at
org.apache.hadoop.hbase.zookeeper.ZKUtil.createAndFailSilent(ZKUtil.java:903)
[junit] at
org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.createBaseZNodes(ZooKeeperWatcher.java:161)
[junit]
[junit] Test org.apache.pig.test.TestHBaseStorage FAILED