Hi Vamshi,
Before running HBase withing eclipse, did you successfully run it from a distribution?
To achieve this, you can download the dist, or if you like, run 'mvn package' on a fresh svn checkout (tar.gz will be in target folder).
Btw, it is not recommended to run hbase on hadoop-0.20.203 (you can loose data):
- http://hbase.apache.org/book/hadoop.html - http://markmail.org/message/yro25zqfjqvajeby - http://markmail.org/message/jfub7b4noqf32j2iIf you really want to test/hack agains 0.20.203, you can build hbase with 'mvn package -Dhadoop.profile=23'
The logic for 0.20.203 and 0.20 should be the same: replace the hadoop jar with the one shipped by hbase.
So better to try first with a dist (downloaded or packaged), and then from eclipse. Could be easier as it will serialize/split the problems.
Thx. On 12/09/11 03:14, vamshi krishna wrote:
Yes, i have successfully ran word count example on hadoop both from terminal (running scripts explicitly) and from eclipse after building the whole hadoop code source code. Now i want to do same thing for hbase i.e getting hbase code in to eclipse , build it, and then start modifying habse code according to my requirement. This is my actual goal. For that i just wanted to see whether hbase works from terminal over already running hadoop,which is in other terminal. then i got all those errors,which i posted in last mail. By the way i am using hbase-0.90.4, advise me about this also,whether i can go with this version. can u please suggest me which version of hadoop and hbase i can use so that no problems will arise. Any how i followed the apache book, and i replaced hadoop-0.20.append in hbase/lib with my hadoop jar i.e hadoop-0.20.203.jar, so , i thoght it shud not create any problems. but , still will create any problems? And i tested all creating , listing, displaying the contents of hdfs using hdfs shell commands. all are working perfectly. The main thing now i need help is how to make hbase work over already running hadoop in eclipse. please help me for this.. On Sun, Sep 11, 2011 at 7:08 PM, Eric Charles<eric.umg.char...@gmail.com>wrote:PS: Vamshi, you said hadoop is running successfully. Double-check you can create files, folders... On 11/09/11 06:19, Eric Charles wrote:Hi Vamshi, Are you launching HBase from eclipse or from the standard scripts? The stacktrace shows something is wrong while HMaster tries to connect Hadoop, and Hadoop checks the security. I'm confused by the java.lang.**NoClassDefFoundError:org/**apache/commons/configuration/** Configuration which seems to be the cause. I don't need apache-commons jar here, but try to add it in your classpath and retry. If this still doesn't work, probably security is not what it should be. I would first try running hbase/hadoop under the same user to make things easier. Thx. On 11/09/11 03:22, vamshi krishna wrote:Hi Eric, i am using hadoop-0.20.203, installed at /usr/local/hadoop . Its running successfully by user called 'hduser'. Its conf/core-site.xml has <property> <name>hadoop.tmp.dir</name> <value>/home/vamshi/Documents/ hadoop_directory</value> <description>A base for other temporary directories.</description> </property> <property> <name>fs.default.name</name> <value>hdfs://localhost:54310<**/value> <description>The name of the default file system. A URI whose scheme and authority determine the FileSystem implementation. The uri's scheme determines the config property (fs.SCHEME.impl) naming the FileSystem implementation class. The uri's authority is used to determine the host, port, etc. for a filesystem.</description> </property> I am trying to run hbase-0.90.4 in psuedo distributed mode (installed at /home/vamshi/Documents/HBASE/**hbase-0.90.4) by user called 'vamshi'. So in the file /etc/security/limits.conf , i added two lines as hduser - nofile 32768 vamshi - nofile 32768 Both users hduser and vamshi have rwx permissions to the directory /home/vamshi/Documents/hadoop_**directory, which is hadoop.tmp.dir . As per hbase book , i changed the config and xml files in both hdfs and hbase. (hbase-site.xml, hbase-default.xml,) Now , when i am trying to execute ./bin/start-hbase.sh in ${HBASE_HOME}, nothing is happening for 1 or 2 minutes, and after that following thing is displayed. vamshi@vamshi-laptop:~/**Documents/HBASE_SOFTWARE/**hbase-0.90.4$ ./bin/start-hbase.sh cat: /home/vamshi/Documents/HBASE_**SOFTWARE/hbase-0.90.4/bin/../** target/cached_classpath.txt: No such file or directory starting master, logging to /home/vamshi/Documents/HBASE_**SOFTWARE/hbase-0.90.4/bin/../** logs/hbase-vamshi-master-**vamshi-laptop.out vamshi@vamshi-laptop:~/**Documents/HBASE_SOFTWARE/**hbase-0.90.4$ At this point log content is Sun Sep 11 15:24:13 IST 2011 Starting master on vamshi-laptop ulimit -n 32768 2011-09-11 15:25:56,900 INFO org.apache.zookeeper.server.** ZooKeeperServer: Server environment:zookeeper.version=**3.3.2-1031432, built on 11/05/2010 05:32 GMT 2011-09-11 15:25:56,901 INFO org.apache.zookeeper.server.** ZooKeeperServer: Server environment:host.name=vamshi-**laptop 2011-09-11 15:25:56,901 INFO org.apache.zookeeper.server.** ZooKeeperServer: Server environment:java.version=1.6.**0_26 2011-09-11 15:25:56,901 INFO org.apache.zookeeper.server.** ZooKeeperServer: Server environment:java.vendor=Sun Microsystems Inc. 2011-09-11 15:25:56,901 INFO org.apache.zookeeper.server.** ZooKeeperServer: Server environment:java.home=/usr/**lib/jvm/java-6-sun-1.6.0.26/**jre 2011-09-11 15:25:56,901 INFO org.apache.zookeeper.server.** ZooKeeperServer: Server environment:java.class.path=/**home/vamshi/Documents/HBASE_** SOFTWARE/hbase-0.90.4/bin/../**conf:/usr/lib/jvm/java-6-sun/** lib/tools.jar::/home/vamshi/**Documents/HBASE_SOFTWARE/** hbase-0.90.4/bin/../target/**classes:/home/vamshi/** Documents/HBASE_SOFTWARE/**hbase-0.90.4/bin/../target/** test-classes:/home/vamshi/**Documents/HBASE_SOFTWARE/** hbase-0.90.4/bin/..:/home/**vamshi/Documents/HBASE_** SOFTWARE/hbase-0.90.4/bin/../**target:/home/vamshi/Documents/** HBASE_SOFTWARE/hbase-0.90.4/**bin/../hbase-0.90.4.jar:/home/** vamshi/Documents/HBASE_**SOFTWARE/hbase-0.90.4/bin/../** hbase-0.90.4-tests.jar:/home/**vamshi/Documents/HBASE_** SOFTWARE/hbase-0.90.4/bin/../**lib/activation-1.1.jar:/home/** vamshi/Documents/HBASE_**SOFTWARE/hbase-0.90.4/bin/../** lib/asm-3.1.jar:/home/vamshi/**Documents/HBASE_SOFTWARE/** hbase-0.90.4/bin/../lib/avro-**1.3.3.jar:/home/vamshi/** Documents/HBASE_SOFTWARE/**hbase-0.90.4/bin/../lib/** commons-cli-1.2.jar:/home/**vamshi/Documents/HBASE_** SOFTWARE/hbase-0.90.4/bin/../**lib/commons-codec-1.4.jar:/** home/vamshi/Documents/HBASE_SOFTWARE/hbase-0.90.4/bin/../**lib/commons-el-1.0.jar:/home/**vamshi/Documents/HBASE_**SOFTWARE/hbase-0.90.4/bin/../** lib/commons-httpclient-3.1.**jar:/home/vamshi/Documents/** HBASE_SOFTWARE/hbase-0.90.4/**bin/../lib/commons-lang-2.5.** jar:/home/vamshi/Documents/**HBASE_SOFTWARE/hbase-0.90.4/** bin/../lib/commons-logging-1.**1.1.jar:/home/vamshi/** Documents/HBASE_SOFTWARE/**hbase-0.90.4/bin/../lib/** commons-net-1.4.1.jar:/home/**vamshi/Documents/HBASE_** SOFTWARE/hbase-0.90.4/bin/../**lib/core-3.1.1.jar:/home/** vamshi/Documents/HBASE_**SOFTWARE/hbase-0.90.4/bin/../** lib/guava-r06.jar:/home/**vamshi/Documents/HBASE_** SOFTWARE/hbase-0.90.4/bin/../**lib/hadoop-core-0.20.203.0.** jar:/home/vamshi/Documents/**HBASE_SOFTWARE/hbase-0.90.4/** bin/../lib/jackson-core-asl-1.**5.5.jar:/home/vamshi/** Documents/HBASE_SOFTWARE/**hbase-0.90.4/bin/../lib/** jackson-jaxrs-1.5.5.jar:/home/**vamshi/Documents/HBASE_** SOFTWARE/hbase-0.90.4/bin/../**lib/jackson-mapper-asl-1.4.2.** jar:/home/vamshi/Documents/**HBASE_SOFTWARE/hbase-0.90.4/** bin/../lib/jackson-xc-1.5.5.**jar:/home/vamshi/Documents/HBASE_**SOFTWARE/hbase-0.90.4/bin/../** lib/jasper-compiler-5.5.23.**jar:/home/vamshi/Documents/** HBASE_SOFTWARE/hbase-0.90.4/**bin/../lib/jasper-runtime-5.5.** 23.jar:/home/vamshi/Documents/**HBASE_SOFTWARE/hbase-0.90.4/** bin/../lib/jaxb-api-2.1.jar:/**home/vamshi/Documents/HBASE_** SOFTWARE/hbase-0.90.4/bin/../**lib/jaxb-impl-2.1.12.jar:/** home/vamshi/Documents/HBASE_**SOFTWARE/hbase-0.90.4/bin/../** lib/jersey-core-1.4.jar:/home/**vamshi/Documents/HBASE_** SOFTWARE/hbase-0.90.4/bin/../**lib/jersey-json-1.4.jar:/home/** vamshi/Documents/HBASE_**SOFTWARE/hbase-0.90.4/bin/../** lib/jersey-server-1.4.jar:/**home/vamshi/Documents/HBASE_** SOFTWARE/hbase-0.90.4/bin/../**lib/jettison-1.1.jar:/home/** vamshi/Documents/HBASE_**SOFTWARE/hbase-0.90.4/bin/../** lib/jetty-6.1.26.jar:/home/**vamshi/Documents/HBASE_** SOFTWARE/hbase-0.90.4/bin/../**lib/jetty-util-6.1.26.jar:/** home/vamshi/Documents/HBASE_**SOFTWARE/hbase-0.90.4/bin/../** lib/jruby-complete-1.6.0.jar:/**home/vamshi/Documents/HBASE_** SOFTWARE/hbase-0.90.4/bin/../**lib/jsp-2.1-6.1.14.jar:/home/vamshi/Documents/**HBASE_SOFTWARE/hbase-0.90.4/** bin/../lib/jsp-api-2.1-6.1.14.**jar:/home/vamshi/Documents/** HBASE_SOFTWARE/hbase-0.90.4/**bin/../lib/jsr311-api-1.1.1.** jar:/home/vamshi/Documents/**HBASE_SOFTWARE/hbase-0.90.4/** bin/../lib/log4j-1.2.16.jar:/**home/vamshi/Documents/HBASE_** SOFTWARE/hbase-0.90.4/bin/../**lib/protobuf-java-2.3.0.jar:/** home/vamshi/Documents/HBASE_**SOFTWARE/hbase-0.90.4/bin/../** lib/servlet-api-2.5-6.1.14.**jar:/home/vamshi/Documents/** HBASE_SOFTWARE/hbase-0.90.4/**bin/../lib/slf4j-api-1.5.8.** jar:/home/vamshi/Documents/**HBASE_SOFTWARE/hbase-0.90.4/** bin/../lib/slf4j-log4j12-1.5.**8.jar:/home/vamshi/Documents/** HBASE_SOFTWARE/hbase-0.90.4/**bin/../lib/stax-api-1.0.1.jar:** /home/vamshi/Documents/HBASE_**SOFTWARE/hbase-0.90.4/bin/../** lib/thrift-0.2.0.jar:/home/**vamshi/Documents/HBASE_** SOFTWARE/hbase-0.90.4/bin/../**lib/xmlenc-0.52.jar:/home/** vamshi/Documents/HBASE_**SOFTWARE/hbase-0.90.4/bin/../** lib/zookeeper-3.3.2.jar 2011-09-11 15:25:56,901 INFO org.apache.zookeeper.server.**ZooKeeperServer: Server environment:java.library.path=**/usr/lib/jvm/java-6-sun-1.6.0.** 26/jre/lib/i386/server:/usr/**lib/jvm/java-6-sun-1.6.0.26/** jre/lib/i386:/usr/lib/jvm/**java-6-sun-1.6.0.26/jre/../** lib/i386:/usr/java/packages/**lib/i386:/lib:/usr/lib 2011-09-11 15:25:56,901 INFO org.apache.zookeeper.server.** ZooKeeperServer: Server environment:java.io.tmpdir=/**tmp 2011-09-11 15:25:56,901 INFO org.apache.zookeeper.server.** ZooKeeperServer: Server environment:java.compiler=<NA> 2011-09-11 15:25:56,901 INFO org.apache.zookeeper.server.** ZooKeeperServer: Server environment:os.name=Linux 2011-09-11 15:25:56,901 INFO org.apache.zookeeper.server.** ZooKeeperServer: Server environment:os.arch=i386 2011-09-11 15:25:56,901 INFO org.apache.zookeeper.server.** ZooKeeperServer: Server environment:os.version=2.6.32-**33-generic 2011-09-11 15:25:56,901 INFO org.apache.zookeeper.server.** ZooKeeperServer: Server environment:user.name=vamshi 2011-09-11 15:25:56,901 INFO org.apache.zookeeper.server.** ZooKeeperServer: Server environment:user.home=/home/**vamshi 2011-09-11 15:25:56,901 INFO org.apache.zookeeper.server.** ZooKeeperServer: Server environment:user.dir=/home/**vamshi/Documents/HBASE_** SOFTWARE/hbase-0.90.4 2011-09-11 15:25:56,931 INFO org.apache.zookeeper.server.** ZooKeeperServer: Created server with tickTime 2000 minSessionTimeout 4000 maxSessionTimeout 40000 datadir /tmp/hbase-vamshi/zookeeper/**zookeeper/version-2 snapdir /tmp/hbase-vamshi/zookeeper/**zookeeper/version-2 2011-09-11 15:25:56,974 INFO org.apache.zookeeper.server.** NIOServerCnxn: binding to port 0.0.0.0/0.0.0.0:2181 2011-09-11 15:25:56,986 INFO org.apache.zookeeper.server.**persistence.FileTxnSnapLog: Snapshotting: 0 2011-09-11 15:25:57,107 INFO org.apache.zookeeper.server.** NIOServerCnxn: Accepted socket connection from /127.0.0.1:38647 2011-09-11 15:25:57,112 INFO org.apache.zookeeper.server.** NIOServerCnxn: Processing stat command from /127.0.0.1:38647 2011-09-11 15:25:57,115 INFO org.apache.zookeeper.server.**NIOServerCnxn: Stat command output 2011-09-11 15:25:57,116 INFO org.apache.zookeeper.server.** NIOServerCnxn: Closed socket connection for client /127.0.0.1:38647 (no session established for client) 2011-09-11 15:25:57,116 INFO org.apache.hadoop.hbase.**zookeeper.**MiniZooKeeperCluster: Started MiniZK Server on client port: 2181 2011-09-11 15:25:57,218 INFO org.apache.hadoop.hbase.ipc.** HBaseRpcMetrics: Initializing RPC Metrics with hostName=HMasterCommandLine$** LocalHMaster, port=46252 2011-09-11 15:25:57,267 INFO org.apache.hadoop.ipc.**HBaseServer: IPC Server Responder: starting 2011-09-11 15:25:57,270 INFO org.apache.hadoop.ipc.**HBaseServer: IPC Server listener on 46252: starting 2011-09-11 15:25:57,270 INFO org.apache.hadoop.ipc.**HBaseServer: IPC Server handler 1 on 46252: starting 2011-09-11 15:25:57,270 INFO org.apache.hadoop.ipc.**HBaseServer: IPC Server handler 0 on 46252: starting 2011-09-11 15:25:57,270 INFO org.apache.hadoop.ipc.**HBaseServer: IPC Server handler 2 on 46252: starting 2011-09-11 15:25:57,271 INFO org.apache.hadoop.ipc.**HBaseServer: IPC Server handler 4 on 46252: starting 2011-09-11 15:25:57,271 INFO org.apache.hadoop.ipc.**HBaseServer: IPC Server handler 3 on 46252: starting 2011-09-11 15:25:57,271 INFO org.apache.hadoop.ipc.**HBaseServer: IPC Server handler 5 on 46252: starting 2011-09-11 15:25:57,271 INFO org.apache.hadoop.ipc.**HBaseServer: IPC Server handler 6 on 46252: starting 2011-09-11 15:25:57,271 INFO org.apache.hadoop.ipc.**HBaseServer: IPC Server handler 8 on 46252: starting 2011-09-11 15:25:57,271 INFO org.apache.hadoop.ipc.**HBaseServer: IPC Server handler 7 on 46252: starting 2011-09-11 15:25:57,271 INFO org.apache.hadoop.ipc.**HBaseServer: IPC Server handler 9 on 46252: starting 2011-09-11 15:25:57,347 INFO org.apache.zookeeper.**ZooKeeper: Client environment:zookeeper.version=**3.3.2-1031432, built on 11/05/2010 05:32 GMT 2011-09-11 15:25:57,347 INFO org.apache.zookeeper.**ZooKeeper: Client environment:host.name=vamshi-**laptop 2011-09-11 15:25:57,347 INFO org.apache.zookeeper.**ZooKeeper: Client environment:java.version=1.6.**0_26 2011-09-11 15:25:57,347 INFO org.apache.zookeeper.**ZooKeeper: Client environment:java.vendor=Sun Microsystems Inc. 2011-09-11 15:25:57,347 INFO org.apache.zookeeper.**ZooKeeper: Client environment:java.home=/usr/**lib/jvm/java-6-sun-1.6.0.26/**jre 2011-09-11 15:25:57,347 INFO org.apache.zookeeper.**ZooKeeper: Client environment:java.class.path=/**home/vamshi/Documents/HBASE_** SOFTWARE/hbase-0.90.4/bin/../**conf:/usr/lib/jvm/java-6-sun/** lib/tools.jar::/home/vamshi/**Documents/HBASE_SOFTWARE/** hbase-0.90.4/bin/../target/**classes:/home/vamshi/** Documents/HBASE_SOFTWARE/**hbase-0.90.4/bin/../target/** test-classes:/home/vamshi/**Documents/HBASE_SOFTWARE/** hbase-0.90.4/bin/..:/home/**vamshi/Documents/HBASE_** SOFTWARE/hbase-0.90.4/bin/../**target:/home/vamshi/Documents/** HBASE_SOFTWARE/hbase-0.90.4/**bin/../hbase-0.90.4.jar:/home/** vamshi/Documents/HBASE_**SOFTWARE/hbase-0.90.4/bin/../** hbase-0.90.4-tests.jar:/home/**vamshi/Documents/HBASE_** SOFTWARE/hbase-0.90.4/bin/../**lib/activation-1.1.jar:/home/** vamshi/Documents/HBASE_**SOFTWARE/hbase-0.90.4/bin/../** lib/asm-3.1.jar:/home/vamshi/**Documents/HBASE_SOFTWARE/** hbase-0.90.4/bin/../lib/avro-**1.3.3.jar:/home/vamshi/** Documents/HBASE_SOFTWARE/**hbase-0.90.4/bin/../lib/** commons-cli-1.2.jar:/home/**vamshi/Documents/HBASE_** SOFTWARE/hbase-0.90.4/bin/../**lib/commons-codec-1.4.jar:/** home/vamshi/Documents/HBASE_SOFTWARE/hbase-0.90.4/bin/../**lib/commons-el-1.0.jar:/home/**vamshi/Documents/HBASE_**SOFTWARE/hbase-0.90.4/bin/../** lib/commons-httpclient-3.1.**jar:/home/vamshi/Documents/** HBASE_SOFTWARE/hbase-0.90.4/**bin/../lib/commons-lang-2.5.** jar:/home/vamshi/Documents/**HBASE_SOFTWARE/hbase-0.90.4/** bin/../lib/commons-logging-1.**1.1.jar:/home/vamshi/** Documents/HBASE_SOFTWARE/**hbase-0.90.4/bin/../lib/** commons-net-1.4.1.jar:/home/**vamshi/Documents/HBASE_** SOFTWARE/hbase-0.90.4/bin/../**lib/core-3.1.1.jar:/home/** vamshi/Documents/HBASE_**SOFTWARE/hbase-0.90.4/bin/../** lib/guava-r06.jar:/home/**vamshi/Documents/HBASE_** SOFTWARE/hbase-0.90.4/bin/../**lib/hadoop-core-0.20.203.0.** jar:/home/vamshi/Documents/**HBASE_SOFTWARE/hbase-0.90.4/** bin/../lib/jackson-core-asl-1.**5.5.jar:/home/vamshi/** Documents/HBASE_SOFTWARE/**hbase-0.90.4/bin/../lib/** jackson-jaxrs-1.5.5.jar:/home/**vamshi/Documents/HBASE_** SOFTWARE/hbase-0.90.4/bin/../**lib/jackson-mapper-asl-1.4.2.** jar:/home/vamshi/Documents/**HBASE_SOFTWARE/hbase-0.90.4/** bin/../lib/jackson-xc-1.5.5.**jar:/home/vamshi/Documents/HBASE_**SOFTWARE/hbase-0.90.4/bin/../** lib/jasper-compiler-5.5.23.**jar:/home/vamshi/Documents/** HBASE_SOFTWARE/hbase-0.90.4/**bin/../lib/jasper-runtime-5.5.** 23.jar:/home/vamshi/Documents/**HBASE_SOFTWARE/hbase-0.90.4/** bin/../lib/jaxb-api-2.1.jar:/**home/vamshi/Documents/HBASE_** SOFTWARE/hbase-0.90.4/bin/../**lib/jaxb-impl-2.1.12.jar:/** home/vamshi/Documents/HBASE_**SOFTWARE/hbase-0.90.4/bin/../** lib/jersey-core-1.4.jar:/home/**vamshi/Documents/HBASE_** SOFTWARE/hbase-0.90.4/bin/../**lib/jersey-json-1.4.jar:/home/** vamshi/Documents/HBASE_**SOFTWARE/hbase-0.90.4/bin/../** lib/jersey-server-1.4.jar:/**home/vamshi/Documents/HBASE_** SOFTWARE/hbase-0.90.4/bin/../**lib/jettison-1.1.jar:/home/** vamshi/Documents/HBASE_**SOFTWARE/hbase-0.90.4/bin/../** lib/jetty-6.1.26.jar:/home/**vamshi/Documents/HBASE_** SOFTWARE/hbase-0.90.4/bin/../**lib/jetty-util-6.1.26.jar:/** home/vamshi/Documents/HBASE_**SOFTWARE/hbase-0.90.4/bin/../** lib/jruby-complete-1.6.0.jar:/**home/vamshi/Documents/HBASE_** SOFTWARE/hbase-0.90.4/bin/../**lib/jsp-2.1-6.1.14.jar:/home/vamshi/Documents/**HBASE_SOFTWARE/hbase-0.90.4/** bin/../lib/jsp-api-2.1-6.1.14.**jar:/home/vamshi/Documents/** HBASE_SOFTWARE/hbase-0.90.4/**bin/../lib/jsr311-api-1.1.1.** jar:/home/vamshi/Documents/**HBASE_SOFTWARE/hbase-0.90.4/** bin/../lib/log4j-1.2.16.jar:/**home/vamshi/Documents/HBASE_** SOFTWARE/hbase-0.90.4/bin/../**lib/protobuf-java-2.3.0.jar:/** home/vamshi/Documents/HBASE_**SOFTWARE/hbase-0.90.4/bin/../** lib/servlet-api-2.5-6.1.14.**jar:/home/vamshi/Documents/** HBASE_SOFTWARE/hbase-0.90.4/**bin/../lib/slf4j-api-1.5.8.** jar:/home/vamshi/Documents/**HBASE_SOFTWARE/hbase-0.90.4/** bin/../lib/slf4j-log4j12-1.5.**8.jar:/home/vamshi/Documents/** HBASE_SOFTWARE/hbase-0.90.4/**bin/../lib/stax-api-1.0.1.jar:** /home/vamshi/Documents/HBASE_**SOFTWARE/hbase-0.90.4/bin/../** lib/thrift-0.2.0.jar:/home/**vamshi/Documents/HBASE_** SOFTWARE/hbase-0.90.4/bin/../**lib/xmlenc-0.52.jar:/home/** vamshi/Documents/HBASE_**SOFTWARE/hbase-0.90.4/bin/../** lib/zookeeper-3.3.2.jar 2011-09-11 15:25:57,347 INFO org.apache.zookeeper.**ZooKeeper: Clientenvironment:java.library.path=**/usr/lib/jvm/java-6-sun-1.6.0.** 26/jre/lib/i386/server:/usr/**lib/jvm/java-6-sun-1.6.0.26/** jre/lib/i386:/usr/lib/jvm/**java-6-sun-1.6.0.26/jre/../** lib/i386:/usr/java/packages/**lib/i386:/lib:/usr/lib 2011-09-11 15:25:57,347 INFO org.apache.zookeeper.**ZooKeeper: Client environment:java.io.tmpdir=/**tmp 2011-09-11 15:25:57,347 INFO org.apache.zookeeper.**ZooKeeper: Client environment:java.compiler=<NA> 2011-09-11 15:25:57,347 INFO org.apache.zookeeper.**ZooKeeper: Client environment:os.name=Linux 2011-09-11 15:25:57,347 INFO org.apache.zookeeper.**ZooKeeper: Client environment:os.arch=i386 2011-09-11 15:25:57,347 INFO org.apache.zookeeper.**ZooKeeper: Client environment:os.version=2.6.32-**33-generic 2011-09-11 15:25:57,347 INFO org.apache.zookeeper.**ZooKeeper: Client environment:user.name=vamshi 2011-09-11 15:25:57,347 INFO org.apache.zookeeper.**ZooKeeper: Client environment:user.home=/home/**vamshi 2011-09-11 15:25:57,347 INFO org.apache.zookeeper.**ZooKeeper: Client environment:user.dir=/home/**vamshi/Documents/HBASE_** SOFTWARE/hbase-0.90.4 2011-09-11 15:25:57,350 INFO org.apache.zookeeper.**ZooKeeper: Initiating client connection, connectString=localhost:2181 sessionTimeout=180000 watcher=master:46252 2011-09-11 15:25:57,373 INFO org.apache.zookeeper.**ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181 2011-09-11 15:25:57,374 INFO org.apache.zookeeper.server.** NIOServerCnxn: Accepted socket connection from /127.0.0.1:38648 2011-09-11 15:25:57,375 INFO org.apache.zookeeper.**ClientCnxn: Socket connection established to localhost/127.0.0.1:2181, initiating session 2011-09-11 15:25:57,380 INFO org.apache.zookeeper.server.** NIOServerCnxn: Client attempting to establish new session at /127.0.0.1:38648 2011-09-11 15:25:57,385 INFO org.apache.zookeeper.server.**persistence.FileTxnLog: Creating new log file: log.1 2011-09-11 15:25:57,483 INFO org.apache.zookeeper.server.** NIOServerCnxn: Established session 0x13257ea2bc90000 with negotiated timeout 40000 for client /127.0.0.1:38648 2011-09-11 15:25:57,484 INFO org.apache.zookeeper.**ClientCnxn: Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x13257ea2bc90000, negotiated timeout = 40000 2011-09-11 15:25:57,609 INFO org.apache.hadoop.metrics.jvm.**JvmMetrics: Initializing JVM Metrics with processName=Master, sessionId=vamshi-laptop:46252 2011-09-11 15:25:57,620 INFO org.apache.hadoop.hbase.**metrics: MetricsString added: revision 2011-09-11 15:25:57,620 INFO org.apache.hadoop.hbase.**metrics: MetricsString added: hdfsUser 2011-09-11 15:25:57,620 INFO org.apache.hadoop.hbase.**metrics: MetricsString added: hdfsDate 2011-09-11 15:25:57,620 INFO org.apache.hadoop.hbase.**metrics: MetricsString added: hdfsUrl 2011-09-11 15:25:57,620 INFO org.apache.hadoop.hbase.**metrics: MetricsString added: date 2011-09-11 15:25:57,620 INFO org.apache.hadoop.hbase.**metrics: MetricsString added: hdfsRevision 2011-09-11 15:25:57,620 INFO org.apache.hadoop.hbase.**metrics: MetricsString added: user 2011-09-11 15:25:57,620 INFO org.apache.hadoop.hbase.**metrics: MetricsString added: hdfsVersion 2011-09-11 15:25:57,620 INFO org.apache.hadoop.hbase.**metrics: MetricsString added: url 2011-09-11 15:25:57,620 INFO org.apache.hadoop.hbase.**metrics: MetricsString added: version 2011-09-11 15:25:57,620 INFO org.apache.hadoop.hbase.**metrics: new MBeanInfo 2011-09-11 15:25:57,621 INFO org.apache.hadoop.hbase.**metrics: new MBeanInfo 2011-09-11 15:25:57,622 INFO org.apache.hadoop.hbase.**master.metrics.MasterMetrics: Initialized 2011-09-11 15:25:57,666 INFO org.apache.zookeeper.**ZooKeeper: Initiating client connection, connectString=localhost:2181 sessionTimeout=180000 watcher=hconnection 2011-09-11 15:25:57,667 INFO org.apache.zookeeper.**ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181 2011-09-11 15:25:57,667 INFO org.apache.zookeeper.**ClientCnxn: Socket connection established to localhost/127.0.0.1:2181, initiating session 2011-09-11 15:25:57,667 INFO org.apache.zookeeper.server.** NIOServerCnxn: Accepted socket connection from /127.0.0.1:38649 2011-09-11 15:25:57,668 INFO org.apache.zookeeper.server.** NIOServerCnxn: Client attempting to establish new session at /127.0.0.1:38649 2011-09-11 15:25:57,680 INFO org.apache.zookeeper.server.** NIOServerCnxn: Established session 0x13257ea2bc90001 with negotiated timeout 40000 for client /127.0.0.1:38649 2011-09-11 15:25:57,681 INFO org.apache.zookeeper.**ClientCnxn: Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x13257ea2bc90001, negotiated timeout = 40000 2011-09-11 15:25:57,702 INFO org.apache.hadoop.hbase.ipc.** HBaseRpcMetrics: Initializing RPC Metrics with hostName=HRegionServer, port=54774 2011-09-11 15:25:57,727 INFO org.apache.zookeeper.**ZooKeeper: Initiating client connection, connectString=localhost:2181 sessionTimeout=180000 watcher=regionserver:54774 2011-09-11 15:25:57,729 INFO org.apache.zookeeper.**ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181 2011-09-11 15:25:57,729 INFO org.apache.zookeeper.**ClientCnxn: Socket connection established to localhost/127.0.0.1:2181, initiating session 2011-09-11 15:25:57,729 INFO org.apache.zookeeper.server.** NIOServerCnxn: Accepted socket connection from /127.0.0.1:38650 2011-09-11 15:25:57,729 INFO org.apache.zookeeper.server.** NIOServerCnxn: Client attempting to establish new session at /127.0.0.1:38650 2011-09-11 15:25:57,748 INFO org.apache.hadoop.hbase.**master.ActiveMasterManager: Master=vamshi-laptop:46252 2011-09-11 15:25:57,769 INFO org.apache.zookeeper.server.** NIOServerCnxn: Established session 0x13257ea2bc90002 with negotiated timeout 40000 for client /127.0.0.1:38650 2011-09-11 15:25:57,770 INFO org.apache.zookeeper.**ClientCnxn: Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x13257ea2bc90002, negotiated timeout = 40000 2011-09-11 15:25:57,925 FATAL org.apache.hadoop.hbase.**master.HMaster: Unhandled exception. Starting shutdown. java.lang.**NoClassDefFoundError: org/apache/commons/**configuration/Configuration at org.apache.hadoop.metrics2.**lib.DefaultMetricsSystem.<** init>(DefaultMetricsSystem.**java:37) at org.apache.hadoop.metrics2.**lib.DefaultMetricsSystem.<** clinit>(DefaultMetricsSystem.**java:34) at org.apache.hadoop.security.**UgiInstrumentation.create(** UgiInstrumentation.java:51) at org.apache.hadoop.security.**UserGroupInformation.**initialize(** UserGroupInformation.java:196) at org.apache.hadoop.security.**UserGroupInformation.**ensureInitialized(** UserGroupInformation.java:159) at org.apache.hadoop.security.**UserGroupInformation.**isSecurityEnabled(** UserGroupInformation.java:216) at org.apache.hadoop.security.**KerberosName.<clinit>(** KerberosName.java:83) at org.apache.hadoop.security.**UserGroupInformation.**initialize(** UserGroupInformation.java:189) at org.apache.hadoop.security.**UserGroupInformation.**ensureInitialized(** UserGroupInformation.java:159) at org.apache.hadoop.security.**UserGroupInformation.**isSecurityEnabled(** UserGroupInformation.java:216) at org.apache.hadoop.security.**UserGroupInformation.**getLoginUser(** UserGroupInformation.java:409) at org.apache.hadoop.security.**UserGroupInformation.**getCurrentUser(** UserGroupInformation.java:395) at org.apache.hadoop.fs.**FileSystem$Cache$Key.<init>(** FileSystem.java:1418) at org.apache.hadoop.fs.**FileSystem$Cache.get(**FileSystem.java:1319) at org.apache.hadoop.fs.**FileSystem.get(FileSystem.**java:226) at org.apache.hadoop.fs.Path.**getFileSystem(Path.java:187) at org.apache.hadoop.hbase.util.**FSUtils.getRootDir(FSUtils.**java:364) at org.apache.hadoop.hbase.**master.MasterFileSystem.<init>** (MasterFileSystem.java:81) at org.apache.hadoop.hbase.**master.HMaster.**finishInitialization(HMaster. **java:346) at org.apache.hadoop.hbase.**master.HMaster.run(HMaster.**java:282) at org.apache.hadoop.hbase.**master.HMasterCommandLine$**LocalHMaster.run(* *HMasterCommandLine.java:193) at java.lang.Thread.run(Thread.**java:662) Caused by: java.lang.**ClassNotFoundException: org.apache.commons.**configuration.Configuration at java.net.URLClassLoader$1.run(**URLClassLoader.java:202) at java.security.**AccessController.doPrivileged(**Native Method) at java.net.URLClassLoader.**findClass(URLClassLoader.java:**190) at java.lang.ClassLoader.**loadClass(ClassLoader.java:**306) at sun.misc.Launcher$**AppClassLoader.loadClass(**Launcher.java:301) at java.lang.ClassLoader.**loadClass(ClassLoader.java:**247) ... 22 more 2011-09-11 15:25:57,928 INFO org.apache.hadoop.hbase.**master.HMaster: Aborting 2011-09-11 15:25:57,929 DEBUG org.apache.hadoop.hbase.**master.HMaster: Stopping service threads 2011-09-11 15:25:57,929 INFO org.apache.hadoop.ipc.**HBaseServer: Stopping server on 46252 2011-09-11 15:25:57,929 INFO org.apache.hadoop.ipc.**HBaseServer: IPC Server handler 0 on 46252: exiting 2011-09-11 15:25:57,929 INFO org.apache.hadoop.ipc.**HBaseServer: IPC Server handler 1 on 46252: exiting 2011-09-11 15:25:57,929 INFO org.apache.hadoop.ipc.**HBaseServer: IPC Server handler 2 on 46252: exiting 2011-09-11 15:25:57,929 INFO org.apache.hadoop.ipc.**HBaseServer: IPC Server handler 3 on 46252: exiting 2011-09-11 15:25:57,930 INFO org.apache.hadoop.ipc.**HBaseServer: IPC Server handler 4 on 46252: exiting 2011-09-11 15:25:57,930 INFO org.apache.hadoop.ipc.**HBaseServer: IPC Server handler 5 on 46252: exiting 2011-09-11 15:25:57,930 INFO org.apache.hadoop.ipc.**HBaseServer: IPC Server handler 6 on 46252: exiting 2011-09-11 15:25:57,930 INFO org.apache.hadoop.ipc.**HBaseServer: IPC Server handler 7 on 46252: exiting 2011-09-11 15:25:57,930 INFO org.apache.hadoop.ipc.**HBaseServer: IPC Server handler 8 on 46252: exiting 2011-09-11 15:25:57,931 INFO org.apache.hadoop.ipc.**HBaseServer: IPC Server handler 9 on 46252: exiting 2011-09-11 15:25:57,931 INFO org.apache.hadoop.ipc.**HBaseServer: Stopping IPC Server listener on 46252 2011-09-11 15:25:57,935 INFO org.apache.hadoop.ipc.**HBaseServer: Stopping IPC Server Responder 2011-09-11 15:25:57,959 INFO org.apache.zookeeper.server.**PrepRequestProcessor: Processed session termination for sessionid: 0x13257ea2bc90000 2011-09-11 15:25:57,981 INFO org.apache.zookeeper.server.** NIOServerCnxn: Closed socket connection for client /127.0.0.1:38648 which had sessionid 0x13257ea2bc90000 2011-09-11 15:25:57,981 INFO org.apache.zookeeper.**ZooKeeper: Session: 0x13257ea2bc90000 closed 2011-09-11 15:25:57,981 INFO org.apache.hadoop.hbase.**master.HMaster: HMaster main thread exiting 2011-09-11 15:25:57,982 INFO org.apache.zookeeper.**ClientCnxn: EventThread shut down 2011-09-11 15:25:57,983 INFO org.apache.zookeeper.server.** NIOServerCnxn: Closed socket connection for client /127.0.0.1:38649 which had sessionid 0x13257ea2bc90001 2011-09-11 15:25:57,983 INFO org.apache.zookeeper.**ClientCnxn: Unable to read additional data from server sessionid 0x13257ea2bc90001, likely server has closed socket, closing socket connection and attempting reconnect 2011-09-11 15:25:57,984 INFO org.apache.zookeeper.server.** NIOServerCnxn: Closed socket connection for client /127.0.0.1:38650 which had sessionid 0x13257ea2bc90002 2011-09-11 15:25:57,984 INFO org.apache.zookeeper.**ClientCnxn: Unable to read additional data from server sessionid 0x13257ea2bc90002, likely server has closed socket, closing socket connection and attempting reconnect 2011-09-11 15:25:57,984 INFO org.apache.zookeeper.server.** NIOServerCnxn: NIOServerCnxn factory exited run method 2011-09-11 15:25:57,984 INFO org.apache.zookeeper.server.**PrepRequestProcessor: PrepRequestProcessor exited loop! 2011-09-11 15:25:57,984 INFO org.apache.zookeeper.server.**SyncRequestProcessor: SyncRequestProcessor exited! 2011-09-11 15:25:57,985 INFO org.apache.zookeeper.server.**FinalRequestProcessor: shutdown of request processor complete 2011-09-11 15:25:58,000 INFO org.apache.zookeeper.server.**SessionTrackerImpl: SessionTrackerImpl exited loop! 2011-09-11 15:25:58,144 INFO org.apache.zookeeper.**ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181 2011-09-11 15:25:58,144 WARN org.apache.zookeeper.**ClientCnxn: Session 0x13257ea2bc90001 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused at sun.nio.ch.SocketChannelImpl.**checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.**finishConnect(** SocketChannelImpl.java:567) at org.apache.zookeeper.**ClientCnxn$SendThread.run(** ClientCnxn.java:1119) 2011-09-11 15:25:58,674 INFO org.apache.zookeeper.**ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181 2011-09-11 15:25:58,675 WARN org.apache.zookeeper.**ClientCnxn: Session 0x13257ea2bc90002 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused at sun.nio.ch.SocketChannelImpl.**checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.**finishConnect(** SocketChannelImpl.java:567) at org.apache.zookeeper.**ClientCnxn$SendThread.run(** ClientCnxn.java:1119) 2011-09-11 15:25:59,262 INFO org.apache.zookeeper.**ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181 2011-09-11 15:25:59,263 WARN org.apache.zookeeper.**ClientCnxn: Session 0x13257ea2bc90001 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused at sun.nio.ch.SocketChannelImpl.**checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.**finishConnect(** SocketChannelImpl.java:567) at org.apache.zookeeper.**ClientCnxn$SendThread.run(** ClientCnxn.java:1119) 2011-09-11 15:26:00,292 INFO org.apache.zookeeper.**ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181 2011-09-11 15:26:00,293 WARN org.apache.zookeeper.**ClientCnxn: Session 0x13257ea2bc90001 for server null, unexpected error, closing socket connection and attempting reconnect --------------------------**while stopping hbase, it is infinitely putting dots and is not stopping. vamshi@vamshi-laptop:~/**Documents/HBASE_SOFTWARE/**hbase-0.90.4$ ./bin/stop-hbase.sh stopping hbase.........................**..............................** ..............................**..............................**.. ..............................**..............................** ..............................**..............................** ..............................**............ On Sat, Sep 10, 2011 at 9:52 AM, Eric Charles<eric.umg.charles@**gmail.com<eric.umg.char...@gmail.com>>wrote: Hi Vamshi,If you want to change source in eclipse, you need to create an eclipse project as documented on http://hbase.apache.org/book/****ides.html#eclipse<http://hbase.apache.org/book/**ides.html#eclipse> <http://**hbase.apache.org/book/ides.**html#eclipse<http://hbase.apache.org/book/ides.html#eclipse>.The sources follow a standard maven structure that has no lib folder at the root. Now, when your source is changed and you want to get a full distribution, you can invoke 'mvn package -DskipTests=true', and a tar.gz will be assembled in the target folder. You can now the tar.gz, and there you will find the lib folder with all needed jars, and also the bin... If you want to avoid the pain to create a tar.gz each time to test against a real hadoop cluster, you can use another maven project (that depends on the hbase project) with a class to launch zookeper and the master (something like [1]). You can put a hbase-site.xml in your classpath with the configuration you want. Maybe someone on mailing list has a more canonical way to launch/debug hbase in eclipse? I'm always interested to learn how other folks play :) Thx. Eric [1] https://github.com/echarles/****t4f-hbase/blob/master/server/****<https://github.com/echarles/**t4f-hbase/blob/master/server/**> src/main/java/aos/t4f/hbase/****server/HBaseServerLauncher.****java< https://github.com/**echarles/t4f-hbase/blob/** master/server/src/main/java/**aos/t4f/hbase/server/** HBaseServerLauncher.java<https://github.com/echarles/t4f-hbase/blob/master/server/src/main/java/aos/t4f/hbase/server/HBaseServerLauncher.java>On 09/09/11 20:57, vamshi krishna wrote: Hi folks,i noticed one thing that, in the checked out version of hbase from the link http://svn.apache.org/repos/****asf/hbase/trunk<http://svn.apache.org/repos/**asf/hbase/trunk> <http://svn.**apache.org/repos/asf/hbase/**trunk<http://svn.apache.org/repos/asf/hbase/trunk>,we cannot find the jar files and lib directory. instead we can directly get the actual source code for hbase from http://apache.mesi.com.ar//****hbase/<http://apache.mesi.com.ar//**hbase/> <http://apache.mesi.com.**ar//hbase/<http://apache.mesi.com.ar//hbase/>.so, please once verify and update the svn checkout link in the hbase book. plz let me now if i am wrong. thank you. On Fri, Sep 9, 2011 at 9:22 AM, vamshi krishna<vamshi2...@gmail.com> wrote: Hi all,i am trying to change hbase code and rebuilt it, for that i already built hadoop code successfully in eclipse IDE(helios). i am using ubuntu 10.04, hadoop 0.20.203 and i cheked out hbase code from the link mentioned in the hbase book( http://svn.apache.org/repos/** asf/hbase/trunk<http://svn.**apache.org/repos/asf/hbase/**trunk<http://svn.apache.org/repos/asf/hbase/trunk>> ) after that i did the following Added the $HBASE_HOME/conf directory to the CLASSPATH in eclipse: Project Properites -> Java Build Path -> Libraries -> Add Class Folder. and i also added jars: the project's properties dialog, in Java Build Path -> Libraries, click Add External Jars , selected {HADOOP_HOME}/hadoop-0.20.203-****core.jar , {HADOOP_HOME}/lib/commons-****logging-api-1.0.4.jar, {HADOOP_HOME}/lib/log4j-1.2.****15.jar . But i could not find lib direcctory in the checked out code of hbase, i.e i couldn't find the {HBASE_HOME}/lib. And more over i could not find the 2 jars ,zookeeper-3.2.2.jar, hadoop-core.jar in the hbase code. *Infact there are no jar files in the hbase code checked out.* Am i following correct steps or should i do some thing else? please can anyone help? -- *Regards* * Vamshi Krishna *--Eric http://about.echarles.net-- Eric http://about.echarles.net
-- Eric http://about.echarles.net
