OK... Think is, I installed a distribution a while ago on this server and there is still config files even if the distribution is not running. bin/hbase catches them with HADOOP_JAVA_LIBRARY_PATH and add them all to the classpath, which mess everything. Using export HBASE_DISABLE_HADOOP_CLASSPATH_LOOKUP=true I can skip this and I'm now able to start HBase correctly...
Thanks guys. Starting the tests... 2015-08-13 21:33 GMT-04:00 Jean-Marc Spaggiari <jean-m...@spaggiari.org>: > @Ted: Very interesting point! This should not be there at all! It seems to > be taking another config file form somewhere else even if I setup > HBASE_HOME... > > @Nick: Running fully local. No HDFS: > hbase@hbasetest1:~/ > dist.apache.org/repos/dist/dev/hbase/hbase-1.1.2RC0/hbase-1.1.2$ ps -eaf > UID PID PPID C STIME TTY TIME CMD > root 1 0 0 17:48 ? 00:00:00 /sbin/init > root 2 0 0 17:48 ? 00:00:00 [kthreadd] > root 3 2 0 17:48 ? 00:00:00 [ksoftirqd/0] > root 5 2 0 17:48 ? 00:00:00 [kworker/0:0H] > root 7 2 0 17:48 ? 00:00:03 [rcu_sched] > root 8 2 0 17:48 ? 00:00:00 [rcu_bh] > root 9 2 0 17:48 ? 00:00:00 [migration/0] > root 10 2 0 17:48 ? 00:00:00 [watchdog/0] > root 11 2 0 17:48 ? 00:00:00 [watchdog/1] > root 12 2 0 17:48 ? 00:00:00 [migration/1] > root 13 2 0 17:48 ? 00:00:00 [ksoftirqd/1] > root 15 2 0 17:48 ? 00:00:00 [kworker/1:0H] > root 16 2 0 17:48 ? 00:00:00 [watchdog/2] > root 17 2 0 17:48 ? 00:00:00 [migration/2] > root 18 2 0 17:48 ? 00:00:00 [ksoftirqd/2] > root 20 2 0 17:48 ? 00:00:00 [kworker/2:0H] > root 21 2 0 17:48 ? 00:00:00 [watchdog/3] > root 22 2 0 17:48 ? 00:00:00 [migration/3] > root 23 2 0 17:48 ? 00:00:00 [ksoftirqd/3] > root 25 2 0 17:48 ? 00:00:00 [kworker/3:0H] > root 26 2 0 17:48 ? 00:00:00 [khelper] > root 27 2 0 17:48 ? 00:00:00 [kdevtmpfs] > root 28 2 0 17:48 ? 00:00:00 [netns] > root 29 2 0 17:48 ? 00:00:00 [khungtaskd] > root 30 2 0 17:48 ? 00:00:00 [writeback] > root 31 2 0 17:48 ? 00:00:00 [ksmd] > root 32 2 0 17:48 ? 00:00:00 [khugepaged] > root 33 2 0 17:48 ? 00:00:00 [crypto] > root 34 2 0 17:48 ? 00:00:00 [kintegrityd] > root 35 2 0 17:48 ? 00:00:00 [bioset] > root 36 2 0 17:48 ? 00:00:00 [kblockd] > root 37 2 0 17:48 ? 00:00:01 [kworker/2:1] > root 38 2 0 17:48 ? 00:00:00 [kswapd0] > root 39 2 0 17:48 ? 00:00:00 [fsnotify_mark] > root 45 2 0 17:48 ? 00:00:00 [kthrotld] > root 46 2 0 17:48 ? 00:00:00 [kworker/0:1] > root 47 2 0 17:48 ? 00:00:00 [ipv6_addrconf] > root 48 2 0 17:48 ? 00:00:00 [deferwq] > root 88 2 0 17:48 ? 00:00:00 [khubd] > root 89 2 0 17:48 ? 00:00:00 [ata_sff] > root 93 2 0 17:48 ? 00:00:00 [scsi_eh_0] > root 94 2 0 17:48 ? 00:00:00 [scsi_tmf_0] > root 95 2 0 17:48 ? 00:00:00 [scsi_eh_1] > root 96 2 0 17:48 ? 00:00:00 [scsi_tmf_1] > root 97 2 0 17:48 ? 00:00:00 [scsi_eh_2] > root 98 2 0 17:48 ? 00:00:00 [scsi_tmf_2] > root 99 2 0 17:48 ? 00:00:00 [scsi_eh_3] > root 100 2 0 17:48 ? 00:00:00 [scsi_tmf_3] > root 103 2 0 17:48 ? 00:00:00 [kworker/u16:4] > root 104 2 0 17:48 ? 00:00:00 [kworker/u16:5] > root 105 2 0 17:48 ? 00:00:00 [scsi_eh_4] > root 106 2 0 17:48 ? 00:00:00 [scsi_tmf_4] > root 107 2 0 17:48 ? 00:00:00 [scsi_eh_5] > root 108 2 0 17:48 ? 00:00:00 [scsi_tmf_5] > root 115 2 0 17:48 ? 00:00:00 [kworker/3:1H] > root 116 2 0 17:48 ? 00:00:00 [kworker/2:1H] > root 117 2 0 17:48 ? 00:00:00 [kworker/0:1H] > root 118 2 0 17:48 ? 00:00:00 [kworker/1:1H] > root 119 2 0 17:48 ? 00:00:00 [kworker/1:2] > root 133 2 0 17:48 ? 00:00:00 [jbd2/sdb1-8] > root 134 2 0 17:48 ? 00:00:00 [ext4-rsv-conver] > root 165 1 0 17:48 ? 00:00:00 > /lib/systemd/systemd-journald > root 166 2 0 17:48 ? 00:00:00 [kauditd] > root 188 1 0 17:48 ? 00:00:00 /lib/systemd/systemd-udevd > root 240 2 0 17:48 ? 00:00:00 [edac-poller] > root 250 2 0 17:48 ? 00:00:00 [hd-audio0] > root 458 1 0 17:48 ? 00:00:00 /sbin/rpcbind -w > statd 468 1 0 17:48 ? 00:00:00 /sbin/rpc.statd > root 473 2 0 17:48 ? 00:00:00 [rpciod] > root 475 2 0 17:48 ? 00:00:00 [nfsiod] > root 482 1 0 17:48 ? 00:00:00 /usr/sbin/rpc.idmapd > daemon 486 1 0 17:48 ? 00:00:00 /usr/sbin/atd -f > message+ 499 1 0 17:48 ? 00:00:00 /usr/bin/dbus-daemon > --system --address=systemd: --nofork --nopidfile --systemd-activation > root 502 1 0 17:48 ? 00:00:00 /usr/sbin/cron -f > root 508 1 0 17:48 ? 00:00:00 /lib/systemd/systemd-logind > root 513 1 0 17:48 ? 00:00:00 /usr/sbin/rsyslogd -n > root 523 1 0 17:48 tty1 00:00:00 /sbin/agetty --noclear tty1 > ntp 558 1 0 17:48 ? 00:00:00 /usr/sbin/ntpd -p > /var/run/ntpd.pid -g -u 111:118 > root 564 1 0 17:48 ? 00:00:00 /lib/systemd/systemd --user > root 567 564 0 17:48 ? 00:00:00 (sd-pam) > root 572 1 0 17:48 ? 00:00:00 > /usr/sbin/console-kit-daemon --no-daemon > root 650 1 0 17:48 ? 00:00:00 > /usr/lib/policykit-1/polkitd --no-debug > root 1361 1 0 17:48 ? 00:00:00 dhclient -v -pf > /run/dhclient.eth0.pid -lf /var/lib/dhcp/dhclient.eth0.leases eth0 > root 1420 1 0 17:48 ? 00:00:00 /usr/sbin/sshd -D > hbase 1857 1 0 18:01 ? 00:00:00 /lib/systemd/systemd --user > hbase 1858 1857 0 18:01 ? 00:00:00 (sd-pam) > root 2010 2 0 18:06 ? 00:00:00 [kworker/3:3] > root 2033 1420 0 18:08 ? 00:00:00 sshd: hbase [priv] > hbase 2038 2033 0 18:08 ? 00:00:00 sshd: hbase@pts/0 > hbase 2039 2038 0 18:08 pts/0 00:00:01 -bash > root 3613 2 0 19:12 ? 00:00:00 [kworker/3:0] > root 3664 2 0 19:13 ? 00:00:00 [kworker/2:0] > root 3672 2 0 19:13 ? 00:00:00 [kworker/1:1] > root 3793 2 0 19:13 ? 00:00:00 [kworker/0:0] > root 8247 1420 0 21:30 ? 00:00:00 sshd: hbase [priv] > hbase 8252 8247 0 21:30 ? 00:00:00 sshd: hbase@pts/1 > hbase 8253 8252 0 21:30 pts/1 00:00:00 -bash > root 8372 2 0 21:31 ? 00:00:00 [kworker/0:2] > root 8375 2 0 21:31 ? 00:00:00 [kworker/1:0] > root 8378 2 0 21:31 ? 00:00:00 [kworker/2:2] > hbase 8390 8253 0 21:31 pts/1 00:00:00 ps -eaf > > Did not changed any files from the JAR I have downloaded. > > I wlil dig on Ted's direction pointing to path which is not correct and > see if I have a config file somewhere conflicting... > > More to come. > > JM > > 2015-08-13 21:08 GMT-04:00 Nick Dimiduk <ndimi...@apache.org>: > >> On Thu, Aug 13, 2015 at 4:56 PM, Jean-Marc Spaggiari < >> jean-m...@spaggiari.org> wrote: >> >> > I tried by exporting both HBASE_HOME and JAVA_HOME but still fail. >> > >> > Here are the logs: >> > >> > http://pastebin.com/SCXfsA4c >> > >> > hbase@hbasetest1:~/ >> > dist.apache.org/repos/dist/dev/hbase/hbase-1.1.2RC0/hbase-1.1.2$ echo >> > $JAVA_HOME >> > /usr/local/jdk1.8.0_45/ >> > hbase@hbasetest1:~/ >> > dist.apache.org/repos/dist/dev/hbase/hbase-1.1.2RC0/hbase-1.1.2$ echo >> > $HBASE_HOME >> > /home/hbase/ >> > dist.apache.org/repos/dist/dev/hbase/hbase-1.1.2RC0/hbase-1.1.2 >> > >> > I extract each and every release in its own directory... >> > >> >> How about HBASE_CONF_DIR? Is that pointed someplace else? >> >> From your paste bin, looks like minizk is started, bound to localhost >> >> 2015-08-13 19:48:21,312 INFO [main] server.NIOServerCnxnFactory: binding >> to port 0.0.0.0/0.0.0.0:2181 >> >> But master fails to become active due to exception coming out of >> DFSClient. >> You running totally local mode or pseudo-distributed? Maybe check HDFS? >> >> 2015-08-13 19:48:23,435 FATAL [hbasetest1:33774.activeMasterManager] >> master.HMaster: Failed to become active master >> java.net.ConnectException: Call From hbasetest1/192.168.23.51 to >> hbasetest1.distparser.com:8020 failed on connection exception: >> java.net.ConnectException: Connection refused; For more details see: >> http://wiki.apache.org/hadoop/ConnectionRefused >> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) >> at >> >> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) >> at >> >> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) >> at java.lang.reflect.Constructor.newInstance(Constructor.java:422) >> at org.apache.hadoop.net.NetUtils.wrapWithMessage(NetUtils.java:783) >> at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:730) >> at org.apache.hadoop.ipc.Client.call(Client.java:1415) >> at org.apache.hadoop.ipc.Client.call(Client.java:1364) >> at >> >> org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:206) >> at com.sun.proxy.$Proxy16.setSafeMode(Unknown Source) >> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >> at >> >> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) >> at >> >> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >> at java.lang.reflect.Method.invoke(Method.java:497) >> at >> >> org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187) >> at >> >> org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102) >> at com.sun.proxy.$Proxy16.setSafeMode(Unknown Source) >> at >> >> org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.setSafeMode(ClientNamenodeProtocolTranslatorPB.java:602) >> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >> at >> >> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) >> at >> >> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >> at java.lang.reflect.Method.invoke(Method.java:497) >> at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:279) >> at com.sun.proxy.$Proxy17.setSafeMode(Unknown Source) >> at org.apache.hadoop.hdfs.DFSClient.setSafeMode(DFSClient.java:2264) >> at >> >> org.apache.hadoop.hdfs.DistributedFileSystem.setSafeMode(DistributedFileSystem.java:986) >> at >> >> org.apache.hadoop.hdfs.DistributedFileSystem.setSafeMode(DistributedFileSystem.java:970) >> at org.apache.hadoop.hbase.util.FSUtils.isInSafeMode(FSUtils.java:524) >> at org.apache.hadoop.hbase.util.FSUtils.waitOnSafeMode(FSUtils.java:970) >> at >> >> org.apache.hadoop.hbase.master.MasterFileSystem.checkRootDir(MasterFileSystem.java:417) >> at >> >> org.apache.hadoop.hbase.master.MasterFileSystem.createInitialFileSystemLayout(MasterFileSystem.java:146) >> at >> >> org.apache.hadoop.hbase.master.MasterFileSystem.<init>(MasterFileSystem.java:126) >> at >> >> org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:649) >> at org.apache.hadoop.hbase.master.HMaster.access$500(HMaster.java:182) >> at org.apache.hadoop.hbase.master.HMaster$1.run(HMaster.java:1646) >> at java.lang.Thread.run(Thread.java:745) >> Caused by: java.net.ConnectException: Connection refused >> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) >> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717) >> at >> >> org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206) >> at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:529) >> at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:493) >> at >> org.apache.hadoop.ipc.Client$Connection.setupConnection(Client.java:606) >> at org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:700) >> at org.apache.hadoop.ipc.Client$Connection.access$2800(Client.java:367) >> at org.apache.hadoop.ipc.Client.getConnection(Client.java:1463) >> at org.apache.hadoop.ipc.Client.call(Client.java:1382) >> ... 29 more >> >> >> 2015-08-13 19:41 GMT-04:00 Nick Dimiduk <ndimi...@apache.org>: >> > >> > > On Thu, Aug 13, 2015 at 4:35 PM, Jean-Marc Spaggiari < >> > > jean-m...@spaggiari.org> wrote: >> > > >> > > > Quick question here. Are we supposed to be able to start the >> standalone >> > > > mode just by doing the extract, export JAVA_HOME and >> start-hbase.sh? It >> > > > doesn't work anymore for me. >> > > > >> > > > So just running start-hbase.sh doesn't allow me to run HBase >> anymore. >> > Is >> > > > that expected? >> > > > >> > > >> > > Should work, yes. You may also need to set HBASE_HOM and/or >> > HBASE_CONF_DIR >> > > if you've set them for other installations. >> > > >> > > I verified this with both bin and a build from src tgz before posting. >> > What >> > > are you seeing JM? Any helpful logs? I tend to give my stand-alone >> > > instances their own working directory, via the logic outlined in this >> > post >> > > [0]. From my history, looks like i unpack to /tmp/hbase-1.1.2 and edit >> > > config such that hbase.tmp.dir=/tmp/hbase-1.1.2/data. >> > > >> > > -n >> > > >> > > [0]: http://www.n10k.com/blog/hbase-root-dir/ >> > > >> > > 2015-08-13 19:27 GMT-04:00 Andrew Purtell <apurt...@apache.org>: >> > > > >> > > > > What is hdp-2.3.0.0-2556? Doesn't look like any artifact this >> project >> > > has >> > > > > released. >> > > > > >> > > > > >> > > > > >> > > > > On Thu, Aug 13, 2015 at 4:07 PM, Ted Yu <yuzhih...@gmail.com> >> wrote: >> > > > > >> > > > > > I replaced the hbase/lib dir of an existing 1.1.1 deployment >> with >> > lib >> > > > dir >> > > > > > built from 1.1.2 RC0 >> > > > > > >> > > > > > I tried to use hbase shell and encountered the following: >> > > > > > >> > > > > > ArgumentError: wrong number of arguments (3 for 2) >> > > > > > (root) at /usr/hdp/2.3.0.0-2556/hbase/bin/hirb.rb:134 >> > > > > > >> > > > > > >> > > > > > After the following copy, I was able to use hbase shell: >> > > > > > >> > > > > > cp ~/hbase-1.1.2/bin/hirb.rb bin >> > > > > > >> > > > > > I am currently testing RC0 in a 6 node cluster with master >> running >> > > > 1.1.2 >> > > > > > and some region servers running 1.1.1 >> > > > > > >> > > > > > Will report back my progress. >> > > > > > >> > > > > > On Thu, Aug 13, 2015 at 2:21 PM, Nick Dimiduk < >> ndimi...@apache.org >> > > >> > > > > wrote: >> > > > > > >> > > > > > > I'm happy to announce the first release candidate of HBase >> 1.1.2 >> > > > > > > (HBase-1.1.2RC0) is available for download at >> > > > > > > https://dist.apache.org/repos/dist/dev/hbase/hbase-1.1.2RC0/ >> > > > > > > >> > > > > > > Maven artifacts are also available in the staging repository >> > > > > > > >> > > > >> https://repository.apache.org/content/repositories/orgapachehbase-1090 >> > > > > > > >> > > > > > > Artifacts are signed with my code signing subkey >> > > 0xAD9039071C3489BD, >> > > > > > > available in the Apache keys directory >> > > > > > > https://people.apache.org/keys/committer/ndimiduk.asc >> > > > > > > >> > > > > > > There's also a signed tag for this release at >> > > > > > > >> > > > > > > >> > > > > > >> > > > > >> > > > >> > > >> > >> https://git-wip-us.apache.org/repos/asf?p=hbase.git;a=tag;h=c4b4a91620639fd964444e59171369c630dc51e3 >> > > > > > > >> > > > > > > The detailed source and binary compatibility report vs 1.1.0 >> has >> > > been >> > > > > > > published for your review, at >> > > > > > > >> > > http://people.apache.org/~ndimiduk/1.1.0_1.1.2RC0_compat_report.html >> > > > > > > >> > > > > > > HBase 1.1.2 is the second patch release in the HBase 1.1 line, >> > > > > continuing >> > > > > > > on the theme of bringing a stable, reliable database to the >> > Hadoop >> > > > and >> > > > > > > NoSQL communities. This release includes over 70 bug fixes >> since >> > > the >> > > > > > 1.1.1 >> > > > > > > release. Notable correctness fixes include HBASE-14054, >> > > HBASE-12865, >> > > > > > > HBASE-13993, HBASE-13337, HBASE-14013, HBASE-13895. >> > > > > > > >> > > > > > > The full list of fixes included in this release is available >> at >> > > > > > > >> > > > > > > >> > > > > > >> > > > > >> > > > >> > > >> > >> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12332793 >> > > > > > > and in the CHANGES.txt file included in the distribution. >> > > > > > > >> > > > > > > Please try out this candidate and vote +/-1 by midnight >> Pacific >> > > time >> > > > on >> > > > > > > Monday, 2015-08-17 as to whether we should release these >> > artifacts >> > > as >> > > > > > HBase >> > > > > > > 1.1.2. >> > > > > > > >> > > > > > > Thanks, >> > > > > > > Nick >> > > > > > > >> > > > > > >> > > > > >> > > > > >> > > > > >> > > > > -- >> > > > > Best regards, >> > > > > >> > > > > - Andy >> > > > > >> > > > > Problems worthy of attack prove their worth by hitting back. - >> Piet >> > > Hein >> > > > > (via Tom White) >> > > > > >> > > > >> > > >> > >> > >
