This is caused by the Hbase configuration is not in the class path of pig script. I work around this by jar up hbase config directory and pass as additional jar to pig.
Sent from my iPhone On Aug 15, 2012, at 12:45 AM, "dengyule" <[email protected]> wrote: > Eric: > Thank you for your valuable reply。According to your tips, now my > collecor can collect data,and my hbase and chukwa also all normal。but when i > use the pig to run the ClusterSummary.pig . Always occur the following error > message： > org.apache.hadoop.hbase.ZooKeeperConnectionException: HBase is able to > connect to ZooKeeper but the connection closes immediately. This could be a > sign that the server has too many connections (30 is the default). Consider > inspecting your ZK server logs for that error and then make sure you are > reusing HBaseConfiguration as often as you can. See HTable's javadoc for more > information. > at > org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.<init>(ZooKeeperWatcher.java:155) > at > org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getZooKeeperWatcher(HConnectionManager.java:1002) > at > org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.setupZookeeperTrackers(HConnectionManager.java:304) > at > org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.<init>(HConnectionManager.java:295) > at > org.apache.hadoop.hbase.client.HConnectionManager.getConnection(HConnectionManager.java:157) > at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:169) > at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:147) > at > org.apache.pig.backend.hadoop.hbase.HBaseStorage.setLocation(HBaseStorage.java:438) > at > org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigInputFormat.mergeSplitSpecificConf(PigInputFormat.java:134) > at > org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigInputFormat.createRecordReader(PigInputFormat.java:112) > at > org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.<init>(MapTask.java:489) > at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:731) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370) > at org.apache.hadoop.mapred.Child$4.run(Child.java:255) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:396) > Ｉusing HBase provided ZooKeeper. this is my hbase-site.xml file: > <configuration> > <property> > <name>hbase.rootdir</name> > <value>hdfs://master:9000/hbase</value> > </property> > <property> > <name>hbase.cluster.distributed</name> > <value>true</value> > </property> > <property> > <name>hbase.master.port</name> > <value>6000</value> > </property> > <property> > <name>hbase.zookeeper.quorum</name> > <value>master</value> > </property> > <property> > <name>hbase.master.maxclockskew</name> > <value>360000</value> > </property> > <property> > <name>hbase.zookeeper.property.maxClientCnxns</name> > <value>0</value> > </property> > </configuration> > Reference to some of tips. say may be host problem .this is my > /etc/hosts file(master and slave are the same ) > 192.168.10.15 master > 192.168.10.47 h1 > 192.168.10.46 h2 > 192.168.10.41 h3 > 192.168.10.68 h4 > 192.168.10.79 h5 > 192.168.10.76 h6 > 192.168.10.86 h7 > Can you tell me how to solve this problem? thanks again. > > > best regards : > mason > > > ------------------ Original ------------------ > From: "Eric Yang"<[email protected]>; > Date: Tue, Aug 14, 2012 01:51 PM > To: "chukwa-user"<[email protected]>; > Subject: Re: Connector error > > Hi Mason, > > Are you using HBase provided ZooKeeper or standalone ZooKeeper? HBase > client in collector is trying to access ZooKeeper at port 21818, and > unable to connect because there is no ZooKeeper running on port 21818. > Standalone ZooKeeper is running at port 2181, and hbase-site.xml may > not have been configured correctly on the class path of collector. > HBASE_CONF_DIR should be defined in chukwa-env.sh for this to work > properly. Hope this helps. > > regards, > Eric > >
