Re: Issue in running hbase-2.2.3 in cygwin
Hi Prakash, The error is reg connection loss with ZK. Where is Zookeeper running? Are you using standalone or pseudo distributed mode? Also, where is hbase.rootdir pointing to? Is it local FileSystem or HDFS? If local FileSystem, have you provided the path that exists on your system? I haven't used cygwin, but if you could refer to HBase book https://hbase.apache.org/book.html for setting up local cluster with properties as mentioned, I am sure you would be able to make good progress. Please spend some time and you wouldn't regret it :) On 2020/03/01 06:31:50, PRAKASH GOPALSAMY wrote: > Hi Team, > I am trying to run the hbase-2.2.3 in cygwint in windows. While running the > hbase shell, I am getting the below exception. Kindly help me to solve this > issue > > Mar 01, 2020 11:46:01 AM > org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$ZKTask$1 exec > WARNING: 0x434c186b to localhost:2181 failed for get of /hbase/hbaseid, > code = CONNECTIONLOSS, retries = 14 > Mar 01, 2020 11:46:02 AM org.apache.zookeeper.ClientCnxn$SendThread > logStartConnect > INFO: Opening socket connection to server kubernetes.docker.internal/ > 127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error) > Mar 01, 2020 11:46:03 AM org.apache.zookeeper.ClientCnxn$SendThread run > WARNING: Session 0x0 for server null, unexpected error, closing socket > connection and attempting reconnect > java.net.ConnectException: Connection refused: no further information > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) > at > sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717) > at > org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361) > at > org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1141) >
Re: Issue in running hbase-2.2.3 in cygwin
Please be aware that running in Windows is not well tested by the rest of the community as far as I know. That error looks like hbase couldn't talk to the zookeeper quorum. Are you following a specific set of instructions for getting things started? It'll be easier to work from a common base rather then go through all the possible configuration issues that could cause an issue. On Sun, Mar 1, 2020, 00:32 PRAKASH GOPALSAMY wrote: > Hi Team, > I am trying to run the hbase-2.2.3 in cygwint in windows. While running the > hbase shell, I am getting the below exception. Kindly help me to solve this > issue > > Mar 01, 2020 11:46:01 AM > org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$ZKTask$1 exec > WARNING: 0x434c186b to localhost:2181 failed for get of /hbase/hbaseid, > code = CONNECTIONLOSS, retries = 14 > Mar 01, 2020 11:46:02 AM org.apache.zookeeper.ClientCnxn$SendThread > logStartConnect > INFO: Opening socket connection to server kubernetes.docker.internal/ > 127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown > error) > Mar 01, 2020 11:46:03 AM org.apache.zookeeper.ClientCnxn$SendThread run > WARNING: Session 0x0 for server null, unexpected error, closing socket > connection and attempting reconnect > java.net.ConnectException: Connection refused: no further information > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) > at > sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717) > at > > org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361) > at > org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1141) >
Re: Is there any way to check the system stop is requested in performCompaction over time?
HBase version is 1.2.9 The region was closed after a few minutes of about 1min. I use a coprocessor that implements BaseRegionObserver. The purpose is for deleting data with an expired retention period. My coprocessor return Custom scanner in BaseRegionObserver.preCompact and when scan type is COMPACT_DROP_DELETES. The custom scanner does only check row key (row key contain time) and if row key range is expired retention period, scanner returns empty List result. While the region does performCompaction[1], the region got a request that is a close region. writesEnabled is changed false. and then performCompaction is stopped only if writing bytes is over hbase.hstore.close.check.interval config[2]. In my case, there are too many expired retention period data. therefore the scanner returns nothing. so writing bytes is zero. It occurs pending close. The reason why I do not use a TTL. Because the retention period changed dynamically by users. [1]: https://github.com/apache/hbase/blob/master/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/compactions/Compactor.java#L367 [2]: https://github.com/apache/hbase/blob/master/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/compactions/Compactor.java#L420-L429 Best regards, Minwoo Kang 보낸 사람: Stack 보낸 날짜: 2020년 2월 29일 토요일 02:07 받는 사람: Hbase-User 제목: Re: Is there any way to check the system stop is requested in performCompaction over time? On Mon, Feb 24, 2020 at 8:20 PM Kang Minwoo wrote: > Hello Users. > > Is there any way to check the system stop is requested in > performCompaction over time? > > When the region got a close request, the region should wait there is no > compaction and flush. > However, in performCompaction method checked periodically only by write > bytes. > If write bytes is too small or scanner returns empty cells, the region > status persists pending close. > > Best regards, > Minwoo Kang > Please provide a bit more context. Link to code. Version. Is Region not closing? Thanks, S
