Eric:
I understand what you mean??
jar cf $CHUKWA_HOME/hbase-env.jar $HBASE_CONF_DIR
pig
-Dpig.additional.jars=${HBASE_HOME}/hbase-0.90.4.jar:${HBASE_HOME}/lib/zookeeper-3.3.2.jar:${PIG_PATH}/pig.jar:${CHUKWA_HOME}/hbase-env.jar
${CHUKWA_HOME}/script/pig/ClusterSummary.pig
I also set it. in the single node model. I can run the pig and view hicc's
chart. in cluster model,my hbase and chukwa are running normally. but always
error in pig running:
org.apache.hadoop.hbase.ZooKeeperConnectionException: HBase is able to
connect to ZooKeeper but the connection closes immediately. This could be a
sign that the server has too many connections (30 is the
default).....................
I wonder whether you encountered such a situation. thanks.
best regards
mason
------------------ Original ------------------
From: "Eric Yang"<[email protected]>;
Date: Wed, Aug 15, 2012 10:35 PM
To: "[email protected]"<[email protected]>;
Cc: "chukwa-user"<[email protected]>;
Subject: Re: Connector error
This is caused by the Hbase configuration is not in the class path of pig
script. I work around this by jar up hbase config directory and pass as
additional jar to pig.
Sent from my iPhone
On Aug 15, 2012, at 12:45 AM, "dengyule" <[email protected]> wrote:
Eric:
Thank you for your valuable reply??According to your tips, now my
collecor can collect data,and my hbase and chukwa also all normal??but when i
use the pig to run the ClusterSummary.pig . Always occur the following error
message??
org.apache.hadoop.hbase.ZooKeeperConnectionException: HBase is able to connect
to ZooKeeper but the connection closes immediately. This could be a sign that
the server has too many connections (30 is the default). Consider inspecting
your ZK server logs for that error and then make sure you are reusing
HBaseConfiguration as often as you can. See HTable's javadoc for more
information.
at
org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.<init>(ZooKeeperWatcher.java:155)
at
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getZooKeeperWatcher(HConnectionManager.java:1002)
at
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.setupZookeeperTrackers(HConnectionManager.java:304)
at
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.<init>(HConnectionManager.java:295)
at
org.apache.hadoop.hbase.client.HConnectionManager.getConnection(HConnectionManager.java:157)
at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:169)
at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:147)
at
org.apache.pig.backend.hadoop.hbase.HBaseStorage..setLocation(HBaseStorage.java:438)
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigInputFormat.mergeSplitSpecificConf(PigInputFormat.java:134)
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigInputFormat.createRecordReader(PigInputFormat.java:112)
at
org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.<init>(MapTask.java:489)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:731)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)
at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
????using HBase provided ZooKeeper. this is my hbase-site.xml file:
<configuration>
<property>
<name>hbase.rootdir</name>
<value>hdfs://master:9000/hbase</value>
</property>
<property>
<name>hbase.cluster.distributed</name>
<value>true</value>
</property>
<property>
<name>hbase.master.port</name>
<value>6000</value>
</property>
<property>
<name>hbase.zookeeper.quorum</name>
<value>master</value>
</property>
<property>
<name>hbase.master.maxclockskew</name>
<value>360000</value>
</property>
<property>
<name>hbase.zookeeper.property.maxClientCnxns</name>
<value>0</value>
</property>
</configuration>
Undo edits
Reference to some of tips. say may be host problem .this is my
/etc/hosts file(master and slave are the same )
192.168.10.15 master
192.168.10.47 h1
192.168.10.46 h2
192.168.10.41 h3
192.168.10.68 h4
192.168.10.79 h5
192.168.10.76 h6
192.168.10.86 h7
Can you tell me how to solve this problem? thanks again.
best regards :
mason
automatically translated by Google
verb
can ????, ??, ??, ????, ??, ??
be able to ????, ????, ??, ??
be capable of ????
adjective
able ????, ??, ????, ??????, ??, ??
------------------ Original ------------------
From: "Eric Yang"<[email protected]>;
Date: Tue, Aug 14, 2012 01:51 PM
To: "chukwa-user"<[email protected]>;
Subject: Re: Connector error
Hi Mason,
Are you using HBase provided ZooKeeper or standalone ZooKeeper? HBase
client in collector is trying to access ZooKeeper at port 21818, and
unable to connect because there is no ZooKeeper running on port 21818.
Standalone ZooKeeper is running at port 2181, and hbase-site.xml may
not have been configured correctly on the class path of collector.
HBASE_CONF_DIR should be defined in chukwa-env.sh for this to work
properly. Hope this helps.
regards,
Eric
