Re: HBase failing to restart in single-user mode
The randomshit is generated per user. /var/folders has multiple
subdirectories and each one contains subdirs of the users. Also there are
some rules under /etc/defaults/periodic.conf and
/etc/periodic/daily/110.clean-tmps that define how frequently the tmp
directories are cleaned so its rare people change that on Mac OS X but
thats something to consider.
I tried to reproduce Benoit's issue few times following the same steps and
changing TMPDIR and no luck, perhaps there is something else in Benoit's
environment.
esteban.
--
Cloudera, Inc.
On Tue, May 19, 2015 at 9:03 PM, Nick Dimiduk ndimi...@gmail.com wrote:
On Tue, May 19, 2015 at 4:45 PM, tsuna tsuna...@gmail.com wrote:
On Tue, May 19, 2015 at 11:27 AM, Esteban Gutierrez
este...@cloudera.com wrote:
Something that works for me is to set manually
-Djava.io.tmpdir=/User/esteban/tmp in the jvm arguments, otherwise Mac
OS
X will use /var/folders/c2/some kind of hash/T for TMPDIR causing all
kind of weird issues. You could also set TMPDIR to point to another
location but you will have to remember that all the time.
How do we explain this? What does ZK care whether it uses
/Users/foo/blah or /var/folders/c2/randomshit/T or anything else?
Is the randomshit a hash of the processID, for instance? I don't know what
OSX is doing under the hood with this /tmp mapping. Hence I explicitly tell
hbase to use /tmp instead of ${java.io.tmpdir}. I guess Esteban's
-Djava.io.tmpdir override would achieve similar results.
Re: HBase failing to restart in single-user mode
On Mon, May 18, 2015 at 10:07 PM, Nick Dimiduk ndimi...@gmail.com wrote: Wait. Benoit, you mean restart the laptop or stop/start HBase? I agree that contents of /tmp are not stable across system reboot, across stop/start of HBase process there should be no problems. Should. I mean restart HBase. I almost never restart my laptop (only for OS X upgrades). On Tue, May 19, 2015 at 11:27 AM, Esteban Gutierrez este...@cloudera.com wrote: Something that works for me is to set manually -Djava.io.tmpdir=/User/esteban/tmp in the jvm arguments, otherwise Mac OS X will use /var/folders/c2/some kind of hash/T for TMPDIR causing all kind of weird issues. You could also set TMPDIR to point to another location but you will have to remember that all the time. How do we explain this? What does ZK care whether it uses /Users/foo/blah or /var/folders/c2/randomshit/T or anything else? This has nothing to do with the OS cleaning up files or anything. I can start HBase, kill it, restart it within the span of less than 2 minutes, and the restart fails. -- Benoit tsuna Sigoure
Re: HBase failing to restart in single-user mode
Something that works for me is to set manually
-Djava.io.tmpdir=/User/esteban/tmp in the jvm arguments, otherwise Mac OS
X will use /var/folders/c2/some kind of hash/T for TMPDIR causing all
kind of weird issues. You could also set TMPDIR to point to another
location but you will have to remember that all the time.
esteban.
--
Cloudera, Inc.
On Mon, May 18, 2015 at 10:07 PM, Nick Dimiduk ndimi...@gmail.com wrote:
Wait. Benoit, you mean restart the laptop or stop/start HBase? I agree that
contents of /tmp are not stable across system reboot, across stop/start of
HBase process there should be no problems. Should.
For what it's worth, on the Mac and local mode testing, I usually use
$HBASE_HOME/data. This is usually not on /tmp.
On Monday, May 18, 2015, anil gupta anilgupt...@gmail.com wrote:
Hi Benoit,
I think you need to move the directory out of /tmp and give it a shot.
/tmp/hbase-${user.name}
/zk will get cleaned up during restart.
~Anil
On Mon, May 18, 2015 at 9:45 PM, tsuna tsuna...@gmail.com
javascript:;
wrote:
I added this to hbase-site.xml:
property
namehbase.zookeeper.property.dataDir/name
value/tmp/hbase-${user.name}/zk/value
/property
Didn’t change anything. Once I kill/shutdown HBase, it won’t come back
up.
On Mon, May 18, 2015 at 1:14 AM, Viral Bajaria
viral.baja...@gmail.com
javascript:;
wrote:
Same for me, I had faced similar issues especially on my virtual
machines
since I would restart them more often than my host machine.
Moving ZK from /tmp which could get cleared on reboots fixed the
issue
for
me.
Thanks,
Viral
On Sun, May 17, 2015 at 10:39 PM, Lars George lars.geo...@gmail.com
javascript:;
wrote:
I noticed similar ZK related issues but those went away after
changing
the
ZK directory to a permanent directory along with the HBase root
directory.
Both point now to a location in my home folder and restarts work
fine
now.
Not much help but wanted to at least state that.
Lars
Sent from my iPhone
On 18 May 2015, at 05:55, tsuna tsuna...@gmail.com
javascript:;
wrote:
Hi all,
For testing on my laptop (OSX with JDK 1.7.0_45) I usually build
the
latest version from branch-1.0 and use the following config:
configuration
property
namehbase.rootdir/name
valuefile:///tmp/hbase-${user.name}/value
/property
property
namehbase.online.schema.update.enable/name
valuetrue/value
/property
property
namezookeeper.session.timeout/name
value30/value
/property
property
namehbase.zookeeper.property.tickTime/name
value200/value
/property
property
namehbase.zookeeper.dns.interface/name
valuelo0/value
/property
property
namehbase.regionserver.dns.interface/name
valuelo0/value
/property
property
namehbase.master.dns.interface/name
valuelo0/value
/property
/configuration
Since at least a month ago (perhaps longer, I don’t remember
exactly)
I can’t restart HBase. The very first time it starts up fine, but
subsequent startup attempts all fail with:
2015-05-17 20:39:19,024 INFO [RpcServer.responder] ipc.RpcServer:
RpcServer.responder: starting
2015-05-17 20:39:19,024 INFO [RpcServer.listener,port=49809]
ipc.RpcServer: RpcServer.listener,port=49809: starting
2015-05-17 20:39:19,029 INFO [main] http.HttpRequestLog: Http
request
log for http.requests.regionserver is not defined
2015-05-17 20:39:19,030 INFO [main] http.HttpServer: Added global
filter 'safety'
(class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter)
2015-05-17 20:39:19,031 INFO [main] http.HttpServer: Added filter
static_user_filter
(class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter)
to context regionserver
2015-05-17 20:39:19,031 INFO [main] http.HttpServer: Added filter
static_user_filter
(class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter)
to context static
2015-05-17 20:39:19,031 INFO [main] http.HttpServer: Added filter
static_user_filter
(class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter)
to context logs
2015-05-17 20:39:19,033 INFO [main] http.HttpServer: Jetty bound
to
port 49811
2015-05-17 20:39:19,033 INFO [main] mortbay.log: jetty-6.1.26
2015-05-17 20:39:19,157 INFO [main] mortbay.log: Started
SelectChannelConnector@0.0.0.0:49811
2015-05-17 20:39:19,222 INFO [M:0;localhost:49807]
zookeeper.RecoverableZooKeeper: Process
identifier=hconnection-0x4f708099 connecting to ZooKeeper
ensemble=localhost:2181
2015-05-17 20:39:19,222 INFO
Re: HBase failing to restart in single-user mode
Same for me, I had faced similar issues especially on my virtual machines
since I would restart them more often than my host machine.
Moving ZK from /tmp which could get cleared on reboots fixed the issue for
me.
Thanks,
Viral
On Sun, May 17, 2015 at 10:39 PM, Lars George lars.geo...@gmail.com wrote:
I noticed similar ZK related issues but those went away after changing the
ZK directory to a permanent directory along with the HBase root directory.
Both point now to a location in my home folder and restarts work fine now.
Not much help but wanted to at least state that.
Lars
Sent from my iPhone
On 18 May 2015, at 05:55, tsuna tsuna...@gmail.com wrote:
Hi all,
For testing on my laptop (OSX with JDK 1.7.0_45) I usually build the
latest version from branch-1.0 and use the following config:
configuration
property
namehbase.rootdir/name
valuefile:///tmp/hbase-${user.name}/value
/property
property
namehbase.online.schema.update.enable/name
valuetrue/value
/property
property
namezookeeper.session.timeout/name
value30/value
/property
property
namehbase.zookeeper.property.tickTime/name
value200/value
/property
property
namehbase.zookeeper.dns.interface/name
valuelo0/value
/property
property
namehbase.regionserver.dns.interface/name
valuelo0/value
/property
property
namehbase.master.dns.interface/name
valuelo0/value
/property
/configuration
Since at least a month ago (perhaps longer, I don’t remember exactly)
I can’t restart HBase. The very first time it starts up fine, but
subsequent startup attempts all fail with:
2015-05-17 20:39:19,024 INFO [RpcServer.responder] ipc.RpcServer:
RpcServer.responder: starting
2015-05-17 20:39:19,024 INFO [RpcServer.listener,port=49809]
ipc.RpcServer: RpcServer.listener,port=49809: starting
2015-05-17 20:39:19,029 INFO [main] http.HttpRequestLog: Http request
log for http.requests.regionserver is not defined
2015-05-17 20:39:19,030 INFO [main] http.HttpServer: Added global
filter 'safety'
(class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter)
2015-05-17 20:39:19,031 INFO [main] http.HttpServer: Added filter
static_user_filter
(class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter)
to context regionserver
2015-05-17 20:39:19,031 INFO [main] http.HttpServer: Added filter
static_user_filter
(class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter)
to context static
2015-05-17 20:39:19,031 INFO [main] http.HttpServer: Added filter
static_user_filter
(class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter)
to context logs
2015-05-17 20:39:19,033 INFO [main] http.HttpServer: Jetty bound to
port 49811
2015-05-17 20:39:19,033 INFO [main] mortbay.log: jetty-6.1.26
2015-05-17 20:39:19,157 INFO [main] mortbay.log: Started
SelectChannelConnector@0.0.0.0:49811
2015-05-17 20:39:19,222 INFO [M:0;localhost:49807]
zookeeper.RecoverableZooKeeper: Process
identifier=hconnection-0x4f708099 connecting to ZooKeeper
ensemble=localhost:2181
2015-05-17 20:39:19,222 INFO [M:0;localhost:49807]
zookeeper.ZooKeeper: Initiating client connection,
connectString=localhost:2181 sessionTimeout=1
watcher=hconnection-0x4f7080990x0, quorum=localhost:2181,
baseZNode=/hbase
2015-05-17 20:39:19,223 INFO
[M:0;localhost:49807-SendThread(localhost:2181)] zookeeper.ClientCnxn:
Opening socket connection to server localhost/127.0.0.1:2181. Will not
attempt to authenticate using SASL (unknown error)
2015-05-17 20:39:19,223 INFO
[M:0;localhost:49807-SendThread(localhost:2181)] zookeeper.ClientCnxn:
Socket connection established to localhost/127.0.0.1:2181, initiating
session
2015-05-17 20:39:19,223 INFO
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181]
server.NIOServerCnxnFactory: Accepted socket connection from
/127.0.0.1:49812
2015-05-17 20:39:19,223 INFO
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181] server.ZooKeeperServer:
Client attempting to establish new session at /127.0.0.1:49812
2015-05-17 20:39:19,224 INFO [SyncThread:0] server.ZooKeeperServer:
Established session 0x14d651aaec2 with negotiated timeout 400
for client /127.0.0.1:49812
2015-05-17 20:39:19,224 INFO
[M:0;localhost:49807-SendThread(localhost:2181)] zookeeper.ClientCnxn:
Session establishment complete on server localhost/127.0.0.1:2181,
sessionid = 0x14d651aaec2, negotiated timeout = 400
2015-05-17 20:39:19,249 INFO [M:0;localhost:49807]
regionserver.HRegionServer: ClusterId :
6ad7eddd-2886-4ff0-b377-a2ff42c8632f
2015-05-17 20:39:49,208 ERROR [main] master.HMasterCommandLine: Master
exiting
java.lang.RuntimeException: Master not active after 30 seconds
at
org.apache.hadoop.hbase.util.JVMClusterUtil.startup(JVMClusterUtil.java:194)
at
Re: HBase failing to restart in single-user mode
Hi Benoit,
I think you need to move the directory out of /tmp and give it a shot.
/tmp/hbase-${user.name}
/zk will get cleaned up during restart.
~Anil
On Mon, May 18, 2015 at 9:45 PM, tsuna tsuna...@gmail.com wrote:
I added this to hbase-site.xml:
property
namehbase.zookeeper.property.dataDir/name
value/tmp/hbase-${user.name}/zk/value
/property
Didn’t change anything. Once I kill/shutdown HBase, it won’t come back up.
On Mon, May 18, 2015 at 1:14 AM, Viral Bajaria viral.baja...@gmail.com
wrote:
Same for me, I had faced similar issues especially on my virtual machines
since I would restart them more often than my host machine.
Moving ZK from /tmp which could get cleared on reboots fixed the issue
for
me.
Thanks,
Viral
On Sun, May 17, 2015 at 10:39 PM, Lars George lars.geo...@gmail.com
wrote:
I noticed similar ZK related issues but those went away after changing
the
ZK directory to a permanent directory along with the HBase root
directory.
Both point now to a location in my home folder and restarts work fine
now.
Not much help but wanted to at least state that.
Lars
Sent from my iPhone
On 18 May 2015, at 05:55, tsuna tsuna...@gmail.com wrote:
Hi all,
For testing on my laptop (OSX with JDK 1.7.0_45) I usually build the
latest version from branch-1.0 and use the following config:
configuration
property
namehbase.rootdir/name
valuefile:///tmp/hbase-${user.name}/value
/property
property
namehbase.online.schema.update.enable/name
valuetrue/value
/property
property
namezookeeper.session.timeout/name
value30/value
/property
property
namehbase.zookeeper.property.tickTime/name
value200/value
/property
property
namehbase.zookeeper.dns.interface/name
valuelo0/value
/property
property
namehbase.regionserver.dns.interface/name
valuelo0/value
/property
property
namehbase.master.dns.interface/name
valuelo0/value
/property
/configuration
Since at least a month ago (perhaps longer, I don’t remember exactly)
I can’t restart HBase. The very first time it starts up fine, but
subsequent startup attempts all fail with:
2015-05-17 20:39:19,024 INFO [RpcServer.responder] ipc.RpcServer:
RpcServer.responder: starting
2015-05-17 20:39:19,024 INFO [RpcServer.listener,port=49809]
ipc.RpcServer: RpcServer.listener,port=49809: starting
2015-05-17 20:39:19,029 INFO [main] http.HttpRequestLog: Http request
log for http.requests.regionserver is not defined
2015-05-17 20:39:19,030 INFO [main] http.HttpServer: Added global
filter 'safety'
(class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter)
2015-05-17 20:39:19,031 INFO [main] http.HttpServer: Added filter
static_user_filter
(class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter)
to context regionserver
2015-05-17 20:39:19,031 INFO [main] http.HttpServer: Added filter
static_user_filter
(class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter)
to context static
2015-05-17 20:39:19,031 INFO [main] http.HttpServer: Added filter
static_user_filter
(class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter)
to context logs
2015-05-17 20:39:19,033 INFO [main] http.HttpServer: Jetty bound to
port 49811
2015-05-17 20:39:19,033 INFO [main] mortbay.log: jetty-6.1.26
2015-05-17 20:39:19,157 INFO [main] mortbay.log: Started
SelectChannelConnector@0.0.0.0:49811
2015-05-17 20:39:19,222 INFO [M:0;localhost:49807]
zookeeper.RecoverableZooKeeper: Process
identifier=hconnection-0x4f708099 connecting to ZooKeeper
ensemble=localhost:2181
2015-05-17 20:39:19,222 INFO [M:0;localhost:49807]
zookeeper.ZooKeeper: Initiating client connection,
connectString=localhost:2181 sessionTimeout=1
watcher=hconnection-0x4f7080990x0, quorum=localhost:2181,
baseZNode=/hbase
2015-05-17 20:39:19,223 INFO
[M:0;localhost:49807-SendThread(localhost:2181)] zookeeper.ClientCnxn:
Opening socket connection to server localhost/127.0.0.1:2181. Will
not
attempt to authenticate using SASL (unknown error)
2015-05-17 20:39:19,223 INFO
[M:0;localhost:49807-SendThread(localhost:2181)] zookeeper.ClientCnxn:
Socket connection established to localhost/127.0.0.1:2181, initiating
session
2015-05-17 20:39:19,223 INFO
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181]
server.NIOServerCnxnFactory: Accepted socket connection from
/127.0.0.1:49812
2015-05-17 20:39:19,223 INFO
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181] server.ZooKeeperServer:
Client attempting to establish new session at /127.0.0.1:49812
2015-05-17 20:39:19,224 INFO [SyncThread:0] server.ZooKeeperServer:
Established session 0x14d651aaec2 with negotiated timeout 400
for client /127.0.0.1:49812
2015-05-17
Re: HBase failing to restart in single-user mode
I added this to hbase-site.xml:
property
namehbase.zookeeper.property.dataDir/name
value/tmp/hbase-${user.name}/zk/value
/property
Didn’t change anything. Once I kill/shutdown HBase, it won’t come back up.
On Mon, May 18, 2015 at 1:14 AM, Viral Bajaria viral.baja...@gmail.com wrote:
Same for me, I had faced similar issues especially on my virtual machines
since I would restart them more often than my host machine.
Moving ZK from /tmp which could get cleared on reboots fixed the issue for
me.
Thanks,
Viral
On Sun, May 17, 2015 at 10:39 PM, Lars George lars.geo...@gmail.com wrote:
I noticed similar ZK related issues but those went away after changing the
ZK directory to a permanent directory along with the HBase root directory.
Both point now to a location in my home folder and restarts work fine now.
Not much help but wanted to at least state that.
Lars
Sent from my iPhone
On 18 May 2015, at 05:55, tsuna tsuna...@gmail.com wrote:
Hi all,
For testing on my laptop (OSX with JDK 1.7.0_45) I usually build the
latest version from branch-1.0 and use the following config:
configuration
property
namehbase.rootdir/name
valuefile:///tmp/hbase-${user.name}/value
/property
property
namehbase.online.schema.update.enable/name
valuetrue/value
/property
property
namezookeeper.session.timeout/name
value30/value
/property
property
namehbase.zookeeper.property.tickTime/name
value200/value
/property
property
namehbase.zookeeper.dns.interface/name
valuelo0/value
/property
property
namehbase.regionserver.dns.interface/name
valuelo0/value
/property
property
namehbase.master.dns.interface/name
valuelo0/value
/property
/configuration
Since at least a month ago (perhaps longer, I don’t remember exactly)
I can’t restart HBase. The very first time it starts up fine, but
subsequent startup attempts all fail with:
2015-05-17 20:39:19,024 INFO [RpcServer.responder] ipc.RpcServer:
RpcServer.responder: starting
2015-05-17 20:39:19,024 INFO [RpcServer.listener,port=49809]
ipc.RpcServer: RpcServer.listener,port=49809: starting
2015-05-17 20:39:19,029 INFO [main] http.HttpRequestLog: Http request
log for http.requests.regionserver is not defined
2015-05-17 20:39:19,030 INFO [main] http.HttpServer: Added global
filter 'safety'
(class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter)
2015-05-17 20:39:19,031 INFO [main] http.HttpServer: Added filter
static_user_filter
(class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter)
to context regionserver
2015-05-17 20:39:19,031 INFO [main] http.HttpServer: Added filter
static_user_filter
(class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter)
to context static
2015-05-17 20:39:19,031 INFO [main] http.HttpServer: Added filter
static_user_filter
(class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter)
to context logs
2015-05-17 20:39:19,033 INFO [main] http.HttpServer: Jetty bound to
port 49811
2015-05-17 20:39:19,033 INFO [main] mortbay.log: jetty-6.1.26
2015-05-17 20:39:19,157 INFO [main] mortbay.log: Started
SelectChannelConnector@0.0.0.0:49811
2015-05-17 20:39:19,222 INFO [M:0;localhost:49807]
zookeeper.RecoverableZooKeeper: Process
identifier=hconnection-0x4f708099 connecting to ZooKeeper
ensemble=localhost:2181
2015-05-17 20:39:19,222 INFO [M:0;localhost:49807]
zookeeper.ZooKeeper: Initiating client connection,
connectString=localhost:2181 sessionTimeout=1
watcher=hconnection-0x4f7080990x0, quorum=localhost:2181,
baseZNode=/hbase
2015-05-17 20:39:19,223 INFO
[M:0;localhost:49807-SendThread(localhost:2181)] zookeeper.ClientCnxn:
Opening socket connection to server localhost/127.0.0.1:2181. Will not
attempt to authenticate using SASL (unknown error)
2015-05-17 20:39:19,223 INFO
[M:0;localhost:49807-SendThread(localhost:2181)] zookeeper.ClientCnxn:
Socket connection established to localhost/127.0.0.1:2181, initiating
session
2015-05-17 20:39:19,223 INFO
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181]
server.NIOServerCnxnFactory: Accepted socket connection from
/127.0.0.1:49812
2015-05-17 20:39:19,223 INFO
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181] server.ZooKeeperServer:
Client attempting to establish new session at /127.0.0.1:49812
2015-05-17 20:39:19,224 INFO [SyncThread:0] server.ZooKeeperServer:
Established session 0x14d651aaec2 with negotiated timeout 400
for client /127.0.0.1:49812
2015-05-17 20:39:19,224 INFO
[M:0;localhost:49807-SendThread(localhost:2181)] zookeeper.ClientCnxn:
Session establishment complete on server localhost/127.0.0.1:2181,
sessionid = 0x14d651aaec2, negotiated timeout = 400
2015-05-17 20:39:19,249 INFO [M:0;localhost:49807]
regionserver.HRegionServer: ClusterId :
6ad7eddd-2886-4ff0-b377-a2ff42c8632f
Re: HBase failing to restart in single-user mode
Wait. Benoit, you mean restart the laptop or stop/start HBase? I agree that
contents of /tmp are not stable across system reboot, across stop/start of
HBase process there should be no problems. Should.
For what it's worth, on the Mac and local mode testing, I usually use
$HBASE_HOME/data. This is usually not on /tmp.
On Monday, May 18, 2015, anil gupta anilgupt...@gmail.com wrote:
Hi Benoit,
I think you need to move the directory out of /tmp and give it a shot.
/tmp/hbase-${user.name}
/zk will get cleaned up during restart.
~Anil
On Mon, May 18, 2015 at 9:45 PM, tsuna tsuna...@gmail.com javascript:;
wrote:
I added this to hbase-site.xml:
property
namehbase.zookeeper.property.dataDir/name
value/tmp/hbase-${user.name}/zk/value
/property
Didn’t change anything. Once I kill/shutdown HBase, it won’t come back
up.
On Mon, May 18, 2015 at 1:14 AM, Viral Bajaria viral.baja...@gmail.com
javascript:;
wrote:
Same for me, I had faced similar issues especially on my virtual
machines
since I would restart them more often than my host machine.
Moving ZK from /tmp which could get cleared on reboots fixed the issue
for
me.
Thanks,
Viral
On Sun, May 17, 2015 at 10:39 PM, Lars George lars.geo...@gmail.com
javascript:;
wrote:
I noticed similar ZK related issues but those went away after changing
the
ZK directory to a permanent directory along with the HBase root
directory.
Both point now to a location in my home folder and restarts work fine
now.
Not much help but wanted to at least state that.
Lars
Sent from my iPhone
On 18 May 2015, at 05:55, tsuna tsuna...@gmail.com javascript:;
wrote:
Hi all,
For testing on my laptop (OSX with JDK 1.7.0_45) I usually build the
latest version from branch-1.0 and use the following config:
configuration
property
namehbase.rootdir/name
valuefile:///tmp/hbase-${user.name}/value
/property
property
namehbase.online.schema.update.enable/name
valuetrue/value
/property
property
namezookeeper.session.timeout/name
value30/value
/property
property
namehbase.zookeeper.property.tickTime/name
value200/value
/property
property
namehbase.zookeeper.dns.interface/name
valuelo0/value
/property
property
namehbase.regionserver.dns.interface/name
valuelo0/value
/property
property
namehbase.master.dns.interface/name
valuelo0/value
/property
/configuration
Since at least a month ago (perhaps longer, I don’t remember
exactly)
I can’t restart HBase. The very first time it starts up fine, but
subsequent startup attempts all fail with:
2015-05-17 20:39:19,024 INFO [RpcServer.responder] ipc.RpcServer:
RpcServer.responder: starting
2015-05-17 20:39:19,024 INFO [RpcServer.listener,port=49809]
ipc.RpcServer: RpcServer.listener,port=49809: starting
2015-05-17 20:39:19,029 INFO [main] http.HttpRequestLog: Http
request
log for http.requests.regionserver is not defined
2015-05-17 20:39:19,030 INFO [main] http.HttpServer: Added global
filter 'safety'
(class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter)
2015-05-17 20:39:19,031 INFO [main] http.HttpServer: Added filter
static_user_filter
(class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter)
to context regionserver
2015-05-17 20:39:19,031 INFO [main] http.HttpServer: Added filter
static_user_filter
(class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter)
to context static
2015-05-17 20:39:19,031 INFO [main] http.HttpServer: Added filter
static_user_filter
(class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter)
to context logs
2015-05-17 20:39:19,033 INFO [main] http.HttpServer: Jetty bound to
port 49811
2015-05-17 20:39:19,033 INFO [main] mortbay.log: jetty-6.1.26
2015-05-17 20:39:19,157 INFO [main] mortbay.log: Started
SelectChannelConnector@0.0.0.0:49811
2015-05-17 20:39:19,222 INFO [M:0;localhost:49807]
zookeeper.RecoverableZooKeeper: Process
identifier=hconnection-0x4f708099 connecting to ZooKeeper
ensemble=localhost:2181
2015-05-17 20:39:19,222 INFO [M:0;localhost:49807]
zookeeper.ZooKeeper: Initiating client connection,
connectString=localhost:2181 sessionTimeout=1
watcher=hconnection-0x4f7080990x0, quorum=localhost:2181,
baseZNode=/hbase
2015-05-17 20:39:19,223 INFO
[M:0;localhost:49807-SendThread(localhost:2181)]
zookeeper.ClientCnxn:
Opening socket connection to server localhost/127.0.0.1:2181. Will
not
attempt to authenticate using SASL (unknown error)
2015-05-17 20:39:19,223 INFO
[M:0;localhost:49807-SendThread(localhost:2181)]
zookeeper.ClientCnxn:
Socket connection
Re: HBase failing to restart in single-user mode
I noticed similar ZK related issues but those went away after changing the ZK
directory to a permanent directory along with the HBase root directory. Both
point now to a location in my home folder and restarts work fine now. Not much
help but wanted to at least state that.
Lars
Sent from my iPhone
On 18 May 2015, at 05:55, tsuna tsuna...@gmail.com wrote:
Hi all,
For testing on my laptop (OSX with JDK 1.7.0_45) I usually build the
latest version from branch-1.0 and use the following config:
configuration
property
namehbase.rootdir/name
valuefile:///tmp/hbase-${user.name}/value
/property
property
namehbase.online.schema.update.enable/name
valuetrue/value
/property
property
namezookeeper.session.timeout/name
value30/value
/property
property
namehbase.zookeeper.property.tickTime/name
value200/value
/property
property
namehbase.zookeeper.dns.interface/name
valuelo0/value
/property
property
namehbase.regionserver.dns.interface/name
valuelo0/value
/property
property
namehbase.master.dns.interface/name
valuelo0/value
/property
/configuration
Since at least a month ago (perhaps longer, I don’t remember exactly)
I can’t restart HBase. The very first time it starts up fine, but
subsequent startup attempts all fail with:
2015-05-17 20:39:19,024 INFO [RpcServer.responder] ipc.RpcServer:
RpcServer.responder: starting
2015-05-17 20:39:19,024 INFO [RpcServer.listener,port=49809]
ipc.RpcServer: RpcServer.listener,port=49809: starting
2015-05-17 20:39:19,029 INFO [main] http.HttpRequestLog: Http request
log for http.requests.regionserver is not defined
2015-05-17 20:39:19,030 INFO [main] http.HttpServer: Added global
filter 'safety'
(class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter)
2015-05-17 20:39:19,031 INFO [main] http.HttpServer: Added filter
static_user_filter
(class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter)
to context regionserver
2015-05-17 20:39:19,031 INFO [main] http.HttpServer: Added filter
static_user_filter
(class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter)
to context static
2015-05-17 20:39:19,031 INFO [main] http.HttpServer: Added filter
static_user_filter
(class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter)
to context logs
2015-05-17 20:39:19,033 INFO [main] http.HttpServer: Jetty bound to port
49811
2015-05-17 20:39:19,033 INFO [main] mortbay.log: jetty-6.1.26
2015-05-17 20:39:19,157 INFO [main] mortbay.log: Started
SelectChannelConnector@0.0.0.0:49811
2015-05-17 20:39:19,222 INFO [M:0;localhost:49807]
zookeeper.RecoverableZooKeeper: Process
identifier=hconnection-0x4f708099 connecting to ZooKeeper
ensemble=localhost:2181
2015-05-17 20:39:19,222 INFO [M:0;localhost:49807]
zookeeper.ZooKeeper: Initiating client connection,
connectString=localhost:2181 sessionTimeout=1
watcher=hconnection-0x4f7080990x0, quorum=localhost:2181,
baseZNode=/hbase
2015-05-17 20:39:19,223 INFO
[M:0;localhost:49807-SendThread(localhost:2181)] zookeeper.ClientCnxn:
Opening socket connection to server localhost/127.0.0.1:2181. Will not
attempt to authenticate using SASL (unknown error)
2015-05-17 20:39:19,223 INFO
[M:0;localhost:49807-SendThread(localhost:2181)] zookeeper.ClientCnxn:
Socket connection established to localhost/127.0.0.1:2181, initiating
session
2015-05-17 20:39:19,223 INFO
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181]
server.NIOServerCnxnFactory: Accepted socket connection from
/127.0.0.1:49812
2015-05-17 20:39:19,223 INFO
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181] server.ZooKeeperServer:
Client attempting to establish new session at /127.0.0.1:49812
2015-05-17 20:39:19,224 INFO [SyncThread:0] server.ZooKeeperServer:
Established session 0x14d651aaec2 with negotiated timeout 400
for client /127.0.0.1:49812
2015-05-17 20:39:19,224 INFO
[M:0;localhost:49807-SendThread(localhost:2181)] zookeeper.ClientCnxn:
Session establishment complete on server localhost/127.0.0.1:2181,
sessionid = 0x14d651aaec2, negotiated timeout = 400
2015-05-17 20:39:19,249 INFO [M:0;localhost:49807]
regionserver.HRegionServer: ClusterId :
6ad7eddd-2886-4ff0-b377-a2ff42c8632f
2015-05-17 20:39:49,208 ERROR [main] master.HMasterCommandLine: Master exiting
java.lang.RuntimeException: Master not active after 30 seconds
at
org.apache.hadoop.hbase.util.JVMClusterUtil.startup(JVMClusterUtil.java:194)
at
org.apache.hadoop.hbase.LocalHBaseCluster.startup(LocalHBaseCluster.java:445)
at
org.apache.hadoop.hbase.master.HMasterCommandLine.startMaster(HMasterCommandLine.java:197)
at
org.apache.hadoop.hbase.master.HMasterCommandLine.run(HMasterCommandLine.java:139)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at
org.apache.hadoop.hbase.util.ServerCommandLine.doMain(ServerCommandLine.java:126)
at
