[jira] [Created] (HBASE-14222) Improve DrainBarrier
Hiroshi Ikeda created HBASE-14222:
-
Summary: Improve DrainBarrier
Key: HBASE-14222
URL: https://issues.apache.org/jira/browse/HBASE-14222
Project: HBase
Issue Type: Bug
Components: util
Reporter: Hiroshi Ikeda
Assignee: Hiroshi Ikeda
Priority: Minor
1. {{DrainBarrier.stopAndDrainOps}} may wait forever if {{DrainBarrier.endOp}}
changes its state and calls {{Object.notifyAll}} just before
{{stopAndDrainOps}} enters the synchronized block to call {{Object.wait}}.
Moreover, {{Object.wait}} may wake up false-positively, and {{stopAndDrainOps}}
may break the block before outstanding operations are complete.
2. Some tests for {{DrainBarrier}} catch and ignore {{AssertionError}}
explicitly thrown JUnit's {{fail}} method.
The implementation of {{DrainBarrier}} is a little complex, and I'll fix and
refactor it.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (HBASE-14221) Reduce the number of time row comparison is done in a Scan
ramkrishna.s.vasudevan created HBASE-14221:
--
Summary: Reduce the number of time row comparison is done in a Scan
Key: HBASE-14221
URL: https://issues.apache.org/jira/browse/HBASE-14221
Project: HBase
Issue Type: Sub-task
Reporter: ramkrishna.s.vasudevan
Assignee: ramkrishna.s.vasudevan
Fix For: 2.0.0
When we tried to do some profiling with the PE tool found this.
Currently we do row comparisons in 3 places in a simple Scan case.
1) ScanQueryMatcher
{code}
int ret = this.rowComparator.compareRows(curCell, cell);
if (!this.isReversed) {
if (ret <= -1) {
return MatchCode.DONE;
} else if (ret >= 1) {
// could optimize this, if necessary?
// Could also be called SEEK_TO_CURRENT_ROW, but this
// should be rare/never happens.
return MatchCode.SEEK_NEXT_ROW;
}
} else {
if (ret <= -1) {
return MatchCode.SEEK_NEXT_ROW;
} else if (ret >= 1) {
return MatchCode.DONE;
}
}
{code}
2) In StoreScanner next() while starting to scan the row
{code}
if (!scannerContext.hasAnyLimit(LimitScope.BETWEEN_CELLS) ||
matcher.curCell == null ||
isNewRow || !CellUtil.matchingRow(peeked, matcher.curCell)) {
this.countPerRow = 0;
matcher.setToNewRow(peeked);
}
{code}
Particularly to see if we are in a new row.
3) In HRegion
{code}
scannerContext.setKeepProgress(true);
heap.next(results, scannerContext);
scannerContext.setKeepProgress(tmpKeepProgress);
nextKv = heap.peek();
moreCellsInRow = moreCellsInRow(nextKv, currentRowCell);
{code}
Here again there are cases where we need to careful for a MultiCF case. Was
trying to solve this for the MultiCF case but is having lot of cases to solve.
But atleast for a single CF case I think these comparison can be reduced.
So for a single CF case in the SQM we are able to find if we have crossed a row
using the code pasted above in SQM. That comparison is definitely needed.
Now in case of a single CF the HRegion is going to have only one element in the
heap and so the 3rd comparison can surely be avoided if the StoreScanner.next()
was over due to MatchCode.DONE caused by SQM.
Coming to the 2nd compareRows that we do in StoreScanner. next() - even that
can be avoided if we know that the previous next() call was over due to a new
row. Doing all this I found that the compareRows in the profiler which was 19%
got reduced to 13%. Initially we can solve for single CF case which can be
extended to MultiCF cases.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
Re: [VOTE] First release candidate for HBase 1.1.2 (RC0) is available
OK... Think is, I installed a distribution a while ago on this server and there is still config files even if the distribution is not running. bin/hbase catches them with HADOOP_JAVA_LIBRARY_PATH and add them all to the classpath, which mess everything. Using export HBASE_DISABLE_HADOOP_CLASSPATH_LOOKUP=true I can skip this and I'm now able to start HBase correctly... Thanks guys. Starting the tests... 2015-08-13 21:33 GMT-04:00 Jean-Marc Spaggiari : > @Ted: Very interesting point! This should not be there at all! It seems to > be taking another config file form somewhere else even if I setup > HBASE_HOME... > > @Nick: Running fully local. No HDFS: > hbase@hbasetest1:~/ > dist.apache.org/repos/dist/dev/hbase/hbase-1.1.2RC0/hbase-1.1.2$ ps -eaf > UIDPID PPID C STIME TTY TIME CMD > root 1 0 0 17:48 ?00:00:00 /sbin/init > root 2 0 0 17:48 ?00:00:00 [kthreadd] > root 3 2 0 17:48 ?00:00:00 [ksoftirqd/0] > root 5 2 0 17:48 ?00:00:00 [kworker/0:0H] > root 7 2 0 17:48 ?00:00:03 [rcu_sched] > root 8 2 0 17:48 ?00:00:00 [rcu_bh] > root 9 2 0 17:48 ?00:00:00 [migration/0] > root10 2 0 17:48 ?00:00:00 [watchdog/0] > root11 2 0 17:48 ?00:00:00 [watchdog/1] > root12 2 0 17:48 ?00:00:00 [migration/1] > root13 2 0 17:48 ?00:00:00 [ksoftirqd/1] > root15 2 0 17:48 ?00:00:00 [kworker/1:0H] > root16 2 0 17:48 ?00:00:00 [watchdog/2] > root17 2 0 17:48 ?00:00:00 [migration/2] > root18 2 0 17:48 ?00:00:00 [ksoftirqd/2] > root20 2 0 17:48 ?00:00:00 [kworker/2:0H] > root21 2 0 17:48 ?00:00:00 [watchdog/3] > root22 2 0 17:48 ?00:00:00 [migration/3] > root23 2 0 17:48 ?00:00:00 [ksoftirqd/3] > root25 2 0 17:48 ?00:00:00 [kworker/3:0H] > root26 2 0 17:48 ?00:00:00 [khelper] > root27 2 0 17:48 ?00:00:00 [kdevtmpfs] > root28 2 0 17:48 ?00:00:00 [netns] > root29 2 0 17:48 ?00:00:00 [khungtaskd] > root30 2 0 17:48 ?00:00:00 [writeback] > root31 2 0 17:48 ?00:00:00 [ksmd] > root32 2 0 17:48 ?00:00:00 [khugepaged] > root33 2 0 17:48 ?00:00:00 [crypto] > root34 2 0 17:48 ?00:00:00 [kintegrityd] > root35 2 0 17:48 ?00:00:00 [bioset] > root36 2 0 17:48 ?00:00:00 [kblockd] > root37 2 0 17:48 ?00:00:01 [kworker/2:1] > root38 2 0 17:48 ?00:00:00 [kswapd0] > root39 2 0 17:48 ?00:00:00 [fsnotify_mark] > root45 2 0 17:48 ?00:00:00 [kthrotld] > root46 2 0 17:48 ?00:00:00 [kworker/0:1] > root47 2 0 17:48 ?00:00:00 [ipv6_addrconf] > root48 2 0 17:48 ?00:00:00 [deferwq] > root88 2 0 17:48 ?00:00:00 [khubd] > root89 2 0 17:48 ?00:00:00 [ata_sff] > root93 2 0 17:48 ?00:00:00 [scsi_eh_0] > root94 2 0 17:48 ?00:00:00 [scsi_tmf_0] > root95 2 0 17:48 ?00:00:00 [scsi_eh_1] > root96 2 0 17:48 ?00:00:00 [scsi_tmf_1] > root97 2 0 17:48 ?00:00:00 [scsi_eh_2] > root98 2 0 17:48 ?00:00:00 [scsi_tmf_2] > root99 2 0 17:48 ?00:00:00 [scsi_eh_3] > root 100 2 0 17:48 ?00:00:00 [scsi_tmf_3] > root 103 2 0 17:48 ?00:00:00 [kworker/u16:4] > root 104 2 0 17:48 ?00:00:00 [kworker/u16:5] > root 105 2 0 17:48 ?00:00:00 [scsi_eh_4] > root 106 2 0 17:48 ?00:00:00 [scsi_tmf_4] > root 107 2 0 17:48 ?00:00:00 [scsi_eh_5] > root 108 2 0 17:48 ?00:00:00 [scsi_tmf_5] > root 115 2 0 17:48 ?00:00:00 [kworker/3:1H] > root 116 2 0 17:48 ?00:00:00 [kworker/2:1H] > root 117 2 0 17:48 ?00:00:00 [kworker/0:1H] > root 118 2 0 17:48 ?00:00:00 [kworker/1:1H] > root 119 2 0 17:48 ?00:00:00 [kworker/1:2] > root 133 2 0 17:48 ?00:00:00 [jbd2/sdb1-8] > root 134 2 0 17:48 ?00:00:00 [ext4-rsv-conver] > root 165 1 0 17:48 ?00:00:00 > /lib/systemd/systemd-journald > root 166 2 0 17:48 ?00:00:00 [kauditd] > root 188 1 0 17:48 ?00:00:00 /lib/systemd/systemd-udevd > root 240 2 0 17:48 ?00:00:00 [edac-poller] > root 250 2 0 17:48 ?00:00:00 [hd-audio0] > root
Re: [VOTE] First release candidate for HBase 1.1.2 (RC0) is available
@Ted: Very interesting point! This should not be there at all! It seems to be taking another config file form somewhere else even if I setup HBASE_HOME... @Nick: Running fully local. No HDFS: hbase@hbasetest1:~/ dist.apache.org/repos/dist/dev/hbase/hbase-1.1.2RC0/hbase-1.1.2$ ps -eaf UIDPID PPID C STIME TTY TIME CMD root 1 0 0 17:48 ?00:00:00 /sbin/init root 2 0 0 17:48 ?00:00:00 [kthreadd] root 3 2 0 17:48 ?00:00:00 [ksoftirqd/0] root 5 2 0 17:48 ?00:00:00 [kworker/0:0H] root 7 2 0 17:48 ?00:00:03 [rcu_sched] root 8 2 0 17:48 ?00:00:00 [rcu_bh] root 9 2 0 17:48 ?00:00:00 [migration/0] root10 2 0 17:48 ?00:00:00 [watchdog/0] root11 2 0 17:48 ?00:00:00 [watchdog/1] root12 2 0 17:48 ?00:00:00 [migration/1] root13 2 0 17:48 ?00:00:00 [ksoftirqd/1] root15 2 0 17:48 ?00:00:00 [kworker/1:0H] root16 2 0 17:48 ?00:00:00 [watchdog/2] root17 2 0 17:48 ?00:00:00 [migration/2] root18 2 0 17:48 ?00:00:00 [ksoftirqd/2] root20 2 0 17:48 ?00:00:00 [kworker/2:0H] root21 2 0 17:48 ?00:00:00 [watchdog/3] root22 2 0 17:48 ?00:00:00 [migration/3] root23 2 0 17:48 ?00:00:00 [ksoftirqd/3] root25 2 0 17:48 ?00:00:00 [kworker/3:0H] root26 2 0 17:48 ?00:00:00 [khelper] root27 2 0 17:48 ?00:00:00 [kdevtmpfs] root28 2 0 17:48 ?00:00:00 [netns] root29 2 0 17:48 ?00:00:00 [khungtaskd] root30 2 0 17:48 ?00:00:00 [writeback] root31 2 0 17:48 ?00:00:00 [ksmd] root32 2 0 17:48 ?00:00:00 [khugepaged] root33 2 0 17:48 ?00:00:00 [crypto] root34 2 0 17:48 ?00:00:00 [kintegrityd] root35 2 0 17:48 ?00:00:00 [bioset] root36 2 0 17:48 ?00:00:00 [kblockd] root37 2 0 17:48 ?00:00:01 [kworker/2:1] root38 2 0 17:48 ?00:00:00 [kswapd0] root39 2 0 17:48 ?00:00:00 [fsnotify_mark] root45 2 0 17:48 ?00:00:00 [kthrotld] root46 2 0 17:48 ?00:00:00 [kworker/0:1] root47 2 0 17:48 ?00:00:00 [ipv6_addrconf] root48 2 0 17:48 ?00:00:00 [deferwq] root88 2 0 17:48 ?00:00:00 [khubd] root89 2 0 17:48 ?00:00:00 [ata_sff] root93 2 0 17:48 ?00:00:00 [scsi_eh_0] root94 2 0 17:48 ?00:00:00 [scsi_tmf_0] root95 2 0 17:48 ?00:00:00 [scsi_eh_1] root96 2 0 17:48 ?00:00:00 [scsi_tmf_1] root97 2 0 17:48 ?00:00:00 [scsi_eh_2] root98 2 0 17:48 ?00:00:00 [scsi_tmf_2] root99 2 0 17:48 ?00:00:00 [scsi_eh_3] root 100 2 0 17:48 ?00:00:00 [scsi_tmf_3] root 103 2 0 17:48 ?00:00:00 [kworker/u16:4] root 104 2 0 17:48 ?00:00:00 [kworker/u16:5] root 105 2 0 17:48 ?00:00:00 [scsi_eh_4] root 106 2 0 17:48 ?00:00:00 [scsi_tmf_4] root 107 2 0 17:48 ?00:00:00 [scsi_eh_5] root 108 2 0 17:48 ?00:00:00 [scsi_tmf_5] root 115 2 0 17:48 ?00:00:00 [kworker/3:1H] root 116 2 0 17:48 ?00:00:00 [kworker/2:1H] root 117 2 0 17:48 ?00:00:00 [kworker/0:1H] root 118 2 0 17:48 ?00:00:00 [kworker/1:1H] root 119 2 0 17:48 ?00:00:00 [kworker/1:2] root 133 2 0 17:48 ?00:00:00 [jbd2/sdb1-8] root 134 2 0 17:48 ?00:00:00 [ext4-rsv-conver] root 165 1 0 17:48 ?00:00:00 /lib/systemd/systemd-journald root 166 2 0 17:48 ?00:00:00 [kauditd] root 188 1 0 17:48 ?00:00:00 /lib/systemd/systemd-udevd root 240 2 0 17:48 ?00:00:00 [edac-poller] root 250 2 0 17:48 ?00:00:00 [hd-audio0] root 458 1 0 17:48 ?00:00:00 /sbin/rpcbind -w statd 468 1 0 17:48 ?00:00:00 /sbin/rpc.statd root 473 2 0 17:48 ?00:00:00 [rpciod] root 475 2 0 17:48 ?00:00:00 [nfsiod] root 482 1 0 17:48 ?00:00:00 /usr/sbin/rpc.idmapd daemon 486 1 0 17:48 ?00:00:00 /usr/sbin/atd -f message+ 499 1 0 17:48 ?00:00:00 /usr/bin/dbus-daemon --system --address=systemd: --nofork --nopidfile --systemd-activation root 502 1 0 17:48 ?00:00:00 /usr/sbin/cron -f root 508 1 0 17:48 ?
Re: [VOTE] First release candidate for HBase 1.1.2 (RC0) is available
On Thu, Aug 13, 2015 at 4:56 PM, Jean-Marc Spaggiari < jean-m...@spaggiari.org> wrote: > I tried by exporting both HBASE_HOME and JAVA_HOME but still fail. > > Here are the logs: > > http://pastebin.com/SCXfsA4c > > hbase@hbasetest1:~/ > dist.apache.org/repos/dist/dev/hbase/hbase-1.1.2RC0/hbase-1.1.2$ echo > $JAVA_HOME > /usr/local/jdk1.8.0_45/ > hbase@hbasetest1:~/ > dist.apache.org/repos/dist/dev/hbase/hbase-1.1.2RC0/hbase-1.1.2$ echo > $HBASE_HOME > /home/hbase/ > dist.apache.org/repos/dist/dev/hbase/hbase-1.1.2RC0/hbase-1.1.2 > > I extract each and every release in its own directory... > How about HBASE_CONF_DIR? Is that pointed someplace else? >From your paste bin, looks like minizk is started, bound to localhost 2015-08-13 19:48:21,312 INFO [main] server.NIOServerCnxnFactory: binding to port 0.0.0.0/0.0.0.0:2181 But master fails to become active due to exception coming out of DFSClient. You running totally local mode or pseudo-distributed? Maybe check HDFS? 2015-08-13 19:48:23,435 FATAL [hbasetest1:33774.activeMasterManager] master.HMaster: Failed to become active master java.net.ConnectException: Call From hbasetest1/192.168.23.51 to hbasetest1.distparser.com:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:422) at org.apache.hadoop.net.NetUtils.wrapWithMessage(NetUtils.java:783) at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:730) at org.apache.hadoop.ipc.Client.call(Client.java:1415) at org.apache.hadoop.ipc.Client.call(Client.java:1364) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:206) at com.sun.proxy.$Proxy16.setSafeMode(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102) at com.sun.proxy.$Proxy16.setSafeMode(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.setSafeMode(ClientNamenodeProtocolTranslatorPB.java:602) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:279) at com.sun.proxy.$Proxy17.setSafeMode(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.setSafeMode(DFSClient.java:2264) at org.apache.hadoop.hdfs.DistributedFileSystem.setSafeMode(DistributedFileSystem.java:986) at org.apache.hadoop.hdfs.DistributedFileSystem.setSafeMode(DistributedFileSystem.java:970) at org.apache.hadoop.hbase.util.FSUtils.isInSafeMode(FSUtils.java:524) at org.apache.hadoop.hbase.util.FSUtils.waitOnSafeMode(FSUtils.java:970) at org.apache.hadoop.hbase.master.MasterFileSystem.checkRootDir(MasterFileSystem.java:417) at org.apache.hadoop.hbase.master.MasterFileSystem.createInitialFileSystemLayout(MasterFileSystem.java:146) at org.apache.hadoop.hbase.master.MasterFileSystem.(MasterFileSystem.java:126) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:649) at org.apache.hadoop.hbase.master.HMaster.access$500(HMaster.java:182) at org.apache.hadoop.hbase.master.HMaster$1.run(HMaster.java:1646) at java.lang.Thread.run(Thread.java:745) Caused by: java.net.ConnectException: Connection refused at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717) at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206) at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:529) at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:493) at org.apache.hadoop.ipc.Client$Connection.setupConnection(Client.java:606) at org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:700) at org.apache.hadoop.ipc.Client$Connection.access$2800(Client.java:367) at org.apache.hadoop.ipc.Client.getConnection(Client.java:1463) at org.apache.hadoop.ipc.Client.call(Client.java:1382) ... 29 more 2015-08-13 19:41 GMT-04:00 Nick Dimiduk : > > > On Thu, Aug 13, 2015 at 4:35 PM, Jean-Marc Spaggiari < > > jean-m...@spaggiari.org> wrote: > > > > > Quick q
Re: [VOTE] First release candidate for HBase 1.1.2 (RC0) is available
J-M: There is more than one place in the log where CDH showed up. Looking at logs/hbase-tyu-master-TYus-MacBook-Pro.local.log I found jackson-jaxrs-1.9.3.jar coming from local maven repo (I built from source). Can you try building from source and try again ? Cheers On Thu, Aug 13, 2015 at 4:56 PM, Jean-Marc Spaggiari < jean-m...@spaggiari.org> wrote: > I tried by exporting both HBASE_HOME and JAVA_HOME but still fail. > > Here are the logs: > > http://pastebin.com/SCXfsA4c > > hbase@hbasetest1:~/ > dist.apache.org/repos/dist/dev/hbase/hbase-1.1.2RC0/hbase-1.1.2$ echo > $JAVA_HOME > /usr/local/jdk1.8.0_45/ > hbase@hbasetest1:~/ > dist.apache.org/repos/dist/dev/hbase/hbase-1.1.2RC0/hbase-1.1.2$ echo > $HBASE_HOME > /home/hbase/ > dist.apache.org/repos/dist/dev/hbase/hbase-1.1.2RC0/hbase-1.1.2 > > I extract each and every release in its own directory... > > 2015-08-13 19:41 GMT-04:00 Nick Dimiduk : > > > On Thu, Aug 13, 2015 at 4:35 PM, Jean-Marc Spaggiari < > > jean-m...@spaggiari.org> wrote: > > > > > Quick question here. Are we supposed to be able to start the standalone > > > mode just by doing the extract, export JAVA_HOME and start-hbase.sh? It > > > doesn't work anymore for me. > > > > > > So just running start-hbase.sh doesn't allow me to run HBase anymore. > Is > > > that expected? > > > > > > > Should work, yes. You may also need to set HBASE_HOM and/or > HBASE_CONF_DIR > > if you've set them for other installations. > > > > I verified this with both bin and a build from src tgz before posting. > What > > are you seeing JM? Any helpful logs? I tend to give my stand-alone > > instances their own working directory, via the logic outlined in this > post > > [0]. From my history, looks like i unpack to /tmp/hbase-1.1.2 and edit > > config such that hbase.tmp.dir=/tmp/hbase-1.1.2/data. > > > > -n > > > > [0]: http://www.n10k.com/blog/hbase-root-dir/ > > > > 2015-08-13 19:27 GMT-04:00 Andrew Purtell : > > > > > > > What is hdp-2.3.0.0-2556? Doesn't look like any artifact this project > > has > > > > released. > > > > > > > > > > > > > > > > On Thu, Aug 13, 2015 at 4:07 PM, Ted Yu wrote: > > > > > > > > > I replaced the hbase/lib dir of an existing 1.1.1 deployment with > lib > > > dir > > > > > built from 1.1.2 RC0 > > > > > > > > > > I tried to use hbase shell and encountered the following: > > > > > > > > > > ArgumentError: wrong number of arguments (3 for 2) > > > > > (root) at /usr/hdp/2.3.0.0-2556/hbase/bin/hirb.rb:134 > > > > > > > > > > > > > > > After the following copy, I was able to use hbase shell: > > > > > > > > > > cp ~/hbase-1.1.2/bin/hirb.rb bin > > > > > > > > > > I am currently testing RC0 in a 6 node cluster with master running > > > 1.1.2 > > > > > and some region servers running 1.1.1 > > > > > > > > > > Will report back my progress. > > > > > > > > > > On Thu, Aug 13, 2015 at 2:21 PM, Nick Dimiduk > > > > > wrote: > > > > > > > > > > > I'm happy to announce the first release candidate of HBase 1.1.2 > > > > > > (HBase-1.1.2RC0) is available for download at > > > > > > https://dist.apache.org/repos/dist/dev/hbase/hbase-1.1.2RC0/ > > > > > > > > > > > > Maven artifacts are also available in the staging repository > > > > > > > > > https://repository.apache.org/content/repositories/orgapachehbase-1090 > > > > > > > > > > > > Artifacts are signed with my code signing subkey > > 0xAD9039071C3489BD, > > > > > > available in the Apache keys directory > > > > > > https://people.apache.org/keys/committer/ndimiduk.asc > > > > > > > > > > > > There's also a signed tag for this release at > > > > > > > > > > > > > > > > > > > > > > > > > > > https://git-wip-us.apache.org/repos/asf?p=hbase.git;a=tag;h=c4b4a91620639fd96e59171369c630dc51e3 > > > > > > > > > > > > The detailed source and binary compatibility report vs 1.1.0 has > > been > > > > > > published for your review, at > > > > > > > > http://people.apache.org/~ndimiduk/1.1.0_1.1.2RC0_compat_report.html > > > > > > > > > > > > HBase 1.1.2 is the second patch release in the HBase 1.1 line, > > > > continuing > > > > > > on the theme of bringing a stable, reliable database to the > Hadoop > > > and > > > > > > NoSQL communities. This release includes over 70 bug fixes since > > the > > > > > 1.1.1 > > > > > > release. Notable correctness fixes include HBASE-14054, > > HBASE-12865, > > > > > > HBASE-13993, HBASE-13337, HBASE-14013, HBASE-13895. > > > > > > > > > > > > The full list of fixes included in this release is available at > > > > > > > > > > > > > > > > > > > > > > > > > > > https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12332793 > > > > > > and in the CHANGES.txt file included in the distribution. > > > > > > > > > > > > Please try out this candidate and vote +/-1 by midnight Pacific > > time > > > on > > > > > > Monday, 2015-08-17 as to whether we should release these > artifacts > > as > > > > > HBase > > > > > > 1.1.2. > > > > > > > > > > > > Thanks, > > > > > > Nick > > > > > > > >
Re: [VOTE] First release candidate for HBase 1.1.2 (RC0) is available
I tried by exporting both HBASE_HOME and JAVA_HOME but still fail. Here are the logs: http://pastebin.com/SCXfsA4c hbase@hbasetest1:~/ dist.apache.org/repos/dist/dev/hbase/hbase-1.1.2RC0/hbase-1.1.2$ echo $JAVA_HOME /usr/local/jdk1.8.0_45/ hbase@hbasetest1:~/ dist.apache.org/repos/dist/dev/hbase/hbase-1.1.2RC0/hbase-1.1.2$ echo $HBASE_HOME /home/hbase/dist.apache.org/repos/dist/dev/hbase/hbase-1.1.2RC0/hbase-1.1.2 I extract each and every release in its own directory... 2015-08-13 19:41 GMT-04:00 Nick Dimiduk : > On Thu, Aug 13, 2015 at 4:35 PM, Jean-Marc Spaggiari < > jean-m...@spaggiari.org> wrote: > > > Quick question here. Are we supposed to be able to start the standalone > > mode just by doing the extract, export JAVA_HOME and start-hbase.sh? It > > doesn't work anymore for me. > > > > So just running start-hbase.sh doesn't allow me to run HBase anymore. Is > > that expected? > > > > Should work, yes. You may also need to set HBASE_HOM and/or HBASE_CONF_DIR > if you've set them for other installations. > > I verified this with both bin and a build from src tgz before posting. What > are you seeing JM? Any helpful logs? I tend to give my stand-alone > instances their own working directory, via the logic outlined in this post > [0]. From my history, looks like i unpack to /tmp/hbase-1.1.2 and edit > config such that hbase.tmp.dir=/tmp/hbase-1.1.2/data. > > -n > > [0]: http://www.n10k.com/blog/hbase-root-dir/ > > 2015-08-13 19:27 GMT-04:00 Andrew Purtell : > > > > > What is hdp-2.3.0.0-2556? Doesn't look like any artifact this project > has > > > released. > > > > > > > > > > > > On Thu, Aug 13, 2015 at 4:07 PM, Ted Yu wrote: > > > > > > > I replaced the hbase/lib dir of an existing 1.1.1 deployment with lib > > dir > > > > built from 1.1.2 RC0 > > > > > > > > I tried to use hbase shell and encountered the following: > > > > > > > > ArgumentError: wrong number of arguments (3 for 2) > > > > (root) at /usr/hdp/2.3.0.0-2556/hbase/bin/hirb.rb:134 > > > > > > > > > > > > After the following copy, I was able to use hbase shell: > > > > > > > > cp ~/hbase-1.1.2/bin/hirb.rb bin > > > > > > > > I am currently testing RC0 in a 6 node cluster with master running > > 1.1.2 > > > > and some region servers running 1.1.1 > > > > > > > > Will report back my progress. > > > > > > > > On Thu, Aug 13, 2015 at 2:21 PM, Nick Dimiduk > > > wrote: > > > > > > > > > I'm happy to announce the first release candidate of HBase 1.1.2 > > > > > (HBase-1.1.2RC0) is available for download at > > > > > https://dist.apache.org/repos/dist/dev/hbase/hbase-1.1.2RC0/ > > > > > > > > > > Maven artifacts are also available in the staging repository > > > > > > > https://repository.apache.org/content/repositories/orgapachehbase-1090 > > > > > > > > > > Artifacts are signed with my code signing subkey > 0xAD9039071C3489BD, > > > > > available in the Apache keys directory > > > > > https://people.apache.org/keys/committer/ndimiduk.asc > > > > > > > > > > There's also a signed tag for this release at > > > > > > > > > > > > > > > > > > > > https://git-wip-us.apache.org/repos/asf?p=hbase.git;a=tag;h=c4b4a91620639fd96e59171369c630dc51e3 > > > > > > > > > > The detailed source and binary compatibility report vs 1.1.0 has > been > > > > > published for your review, at > > > > > > http://people.apache.org/~ndimiduk/1.1.0_1.1.2RC0_compat_report.html > > > > > > > > > > HBase 1.1.2 is the second patch release in the HBase 1.1 line, > > > continuing > > > > > on the theme of bringing a stable, reliable database to the Hadoop > > and > > > > > NoSQL communities. This release includes over 70 bug fixes since > the > > > > 1.1.1 > > > > > release. Notable correctness fixes include HBASE-14054, > HBASE-12865, > > > > > HBASE-13993, HBASE-13337, HBASE-14013, HBASE-13895. > > > > > > > > > > The full list of fixes included in this release is available at > > > > > > > > > > > > > > > > > > > > https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12332793 > > > > > and in the CHANGES.txt file included in the distribution. > > > > > > > > > > Please try out this candidate and vote +/-1 by midnight Pacific > time > > on > > > > > Monday, 2015-08-17 as to whether we should release these artifacts > as > > > > HBase > > > > > 1.1.2. > > > > > > > > > > Thanks, > > > > > Nick > > > > > > > > > > > > > > > > > > > > > -- > > > Best regards, > > > > > >- Andy > > > > > > Problems worthy of attack prove their worth by hitting back. - Piet > Hein > > > (via Tom White) > > > > > >
Re: [VOTE] First release candidate for HBase 1.1.2 (RC0) is available
I don't think my statement deserves a derisive "uh...". Agreed, it would be good to stick with Apache HBase release artifacts when evaluating Apache HBase release candidates. On Thu, Aug 13, 2015 at 4:36 PM, Ted Yu wrote: > Uh ... > That is equivalent to HBase 1.1.1 > > Will filter out such information in subsequent emails. > > On Thu, Aug 13, 2015 at 4:27 PM, Andrew Purtell > wrote: > > > What is hdp-2.3.0.0-2556? Doesn't look like any artifact this project has > > released. > > > > > > > > On Thu, Aug 13, 2015 at 4:07 PM, Ted Yu wrote: > > > > > I replaced the hbase/lib dir of an existing 1.1.1 deployment with lib > dir > > > built from 1.1.2 RC0 > > > > > > I tried to use hbase shell and encountered the following: > > > > > > ArgumentError: wrong number of arguments (3 for 2) > > > (root) at /usr/hdp/2.3.0.0-2556/hbase/bin/hirb.rb:134 > > > > > > > > > After the following copy, I was able to use hbase shell: > > > > > > cp ~/hbase-1.1.2/bin/hirb.rb bin > > > > > > I am currently testing RC0 in a 6 node cluster with master running > 1.1.2 > > > and some region servers running 1.1.1 > > > > > > Will report back my progress. > > > > > > On Thu, Aug 13, 2015 at 2:21 PM, Nick Dimiduk > > wrote: > > > > > > > I'm happy to announce the first release candidate of HBase 1.1.2 > > > > (HBase-1.1.2RC0) is available for download at > > > > https://dist.apache.org/repos/dist/dev/hbase/hbase-1.1.2RC0/ > > > > > > > > Maven artifacts are also available in the staging repository > > > > > https://repository.apache.org/content/repositories/orgapachehbase-1090 > > > > > > > > Artifacts are signed with my code signing subkey 0xAD9039071C3489BD, > > > > available in the Apache keys directory > > > > https://people.apache.org/keys/committer/ndimiduk.asc > > > > > > > > There's also a signed tag for this release at > > > > > > > > > > > > > > https://git-wip-us.apache.org/repos/asf?p=hbase.git;a=tag;h=c4b4a91620639fd96e59171369c630dc51e3 > > > > > > > > The detailed source and binary compatibility report vs 1.1.0 has been > > > > published for your review, at > > > > http://people.apache.org/~ndimiduk/1.1.0_1.1.2RC0_compat_report.html > > > > > > > > HBase 1.1.2 is the second patch release in the HBase 1.1 line, > > continuing > > > > on the theme of bringing a stable, reliable database to the Hadoop > and > > > > NoSQL communities. This release includes over 70 bug fixes since the > > > 1.1.1 > > > > release. Notable correctness fixes include HBASE-14054, HBASE-12865, > > > > HBASE-13993, HBASE-13337, HBASE-14013, HBASE-13895. > > > > > > > > The full list of fixes included in this release is available at > > > > > > > > > > > > > > https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12332793 > > > > and in the CHANGES.txt file included in the distribution. > > > > > > > > Please try out this candidate and vote +/-1 by midnight Pacific time > on > > > > Monday, 2015-08-17 as to whether we should release these artifacts as > > > HBase > > > > 1.1.2. > > > > > > > > Thanks, > > > > Nick > > > > > > > > > > > > > > > -- > > Best regards, > > > >- Andy > > > > Problems worthy of attack prove their worth by hitting back. - Piet Hein > > (via Tom White) > > > -- Best regards, - Andy Problems worthy of attack prove their worth by hitting back. - Piet Hein (via Tom White)
Re: [VOTE] First release candidate for HBase 1.1.2 (RC0) is available
+1 Ran test suite using Java 1.8.0_45 - passed Checked signature Cluster testing involving 1.1.2 master and 1.1.1 region servers was positive Verified on Mac that standalone mode works Will continue with cluster testing On Thu, Aug 13, 2015 at 2:21 PM, Nick Dimiduk wrote: > I'm happy to announce the first release candidate of HBase 1.1.2 > (HBase-1.1.2RC0) is available for download at > https://dist.apache.org/repos/dist/dev/hbase/hbase-1.1.2RC0/ > > Maven artifacts are also available in the staging repository > https://repository.apache.org/content/repositories/orgapachehbase-1090 > > Artifacts are signed with my code signing subkey 0xAD9039071C3489BD, > available in the Apache keys directory > https://people.apache.org/keys/committer/ndimiduk.asc > > There's also a signed tag for this release at > > https://git-wip-us.apache.org/repos/asf?p=hbase.git;a=tag;h=c4b4a91620639fd96e59171369c630dc51e3 > > The detailed source and binary compatibility report vs 1.1.0 has been > published for your review, at > http://people.apache.org/~ndimiduk/1.1.0_1.1.2RC0_compat_report.html > > HBase 1.1.2 is the second patch release in the HBase 1.1 line, continuing > on the theme of bringing a stable, reliable database to the Hadoop and > NoSQL communities. This release includes over 70 bug fixes since the 1.1.1 > release. Notable correctness fixes include HBASE-14054, HBASE-12865, > HBASE-13993, HBASE-13337, HBASE-14013, HBASE-13895. > > The full list of fixes included in this release is available at > > https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12332793 > and in the CHANGES.txt file included in the distribution. > > Please try out this candidate and vote +/-1 by midnight Pacific time on > Monday, 2015-08-17 as to whether we should release these artifacts as HBase > 1.1.2. > > Thanks, > Nick >
Re: [VOTE] First release candidate for HBase 1.1.2 (RC0) is available
On Thu, Aug 13, 2015 at 4:35 PM, Jean-Marc Spaggiari < jean-m...@spaggiari.org> wrote: > Quick question here. Are we supposed to be able to start the standalone > mode just by doing the extract, export JAVA_HOME and start-hbase.sh? It > doesn't work anymore for me. > > So just running start-hbase.sh doesn't allow me to run HBase anymore. Is > that expected? > Should work, yes. You may also need to set HBASE_HOM and/or HBASE_CONF_DIR if you've set them for other installations. I verified this with both bin and a build from src tgz before posting. What are you seeing JM? Any helpful logs? I tend to give my stand-alone instances their own working directory, via the logic outlined in this post [0]. From my history, looks like i unpack to /tmp/hbase-1.1.2 and edit config such that hbase.tmp.dir=/tmp/hbase-1.1.2/data. -n [0]: http://www.n10k.com/blog/hbase-root-dir/ 2015-08-13 19:27 GMT-04:00 Andrew Purtell : > > > What is hdp-2.3.0.0-2556? Doesn't look like any artifact this project has > > released. > > > > > > > > On Thu, Aug 13, 2015 at 4:07 PM, Ted Yu wrote: > > > > > I replaced the hbase/lib dir of an existing 1.1.1 deployment with lib > dir > > > built from 1.1.2 RC0 > > > > > > I tried to use hbase shell and encountered the following: > > > > > > ArgumentError: wrong number of arguments (3 for 2) > > > (root) at /usr/hdp/2.3.0.0-2556/hbase/bin/hirb.rb:134 > > > > > > > > > After the following copy, I was able to use hbase shell: > > > > > > cp ~/hbase-1.1.2/bin/hirb.rb bin > > > > > > I am currently testing RC0 in a 6 node cluster with master running > 1.1.2 > > > and some region servers running 1.1.1 > > > > > > Will report back my progress. > > > > > > On Thu, Aug 13, 2015 at 2:21 PM, Nick Dimiduk > > wrote: > > > > > > > I'm happy to announce the first release candidate of HBase 1.1.2 > > > > (HBase-1.1.2RC0) is available for download at > > > > https://dist.apache.org/repos/dist/dev/hbase/hbase-1.1.2RC0/ > > > > > > > > Maven artifacts are also available in the staging repository > > > > > https://repository.apache.org/content/repositories/orgapachehbase-1090 > > > > > > > > Artifacts are signed with my code signing subkey 0xAD9039071C3489BD, > > > > available in the Apache keys directory > > > > https://people.apache.org/keys/committer/ndimiduk.asc > > > > > > > > There's also a signed tag for this release at > > > > > > > > > > > > > > https://git-wip-us.apache.org/repos/asf?p=hbase.git;a=tag;h=c4b4a91620639fd96e59171369c630dc51e3 > > > > > > > > The detailed source and binary compatibility report vs 1.1.0 has been > > > > published for your review, at > > > > http://people.apache.org/~ndimiduk/1.1.0_1.1.2RC0_compat_report.html > > > > > > > > HBase 1.1.2 is the second patch release in the HBase 1.1 line, > > continuing > > > > on the theme of bringing a stable, reliable database to the Hadoop > and > > > > NoSQL communities. This release includes over 70 bug fixes since the > > > 1.1.1 > > > > release. Notable correctness fixes include HBASE-14054, HBASE-12865, > > > > HBASE-13993, HBASE-13337, HBASE-14013, HBASE-13895. > > > > > > > > The full list of fixes included in this release is available at > > > > > > > > > > > > > > https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12332793 > > > > and in the CHANGES.txt file included in the distribution. > > > > > > > > Please try out this candidate and vote +/-1 by midnight Pacific time > on > > > > Monday, 2015-08-17 as to whether we should release these artifacts as > > > HBase > > > > 1.1.2. > > > > > > > > Thanks, > > > > Nick > > > > > > > > > > > > > > > -- > > Best regards, > > > >- Andy > > > > Problems worthy of attack prove their worth by hitting back. - Piet Hein > > (via Tom White) > > >
Re: [VOTE] First release candidate for HBase 1.1.2 (RC0) is available
Uh ... That is equivalent to HBase 1.1.1 Will filter out such information in subsequent emails. On Thu, Aug 13, 2015 at 4:27 PM, Andrew Purtell wrote: > What is hdp-2.3.0.0-2556? Doesn't look like any artifact this project has > released. > > > > On Thu, Aug 13, 2015 at 4:07 PM, Ted Yu wrote: > > > I replaced the hbase/lib dir of an existing 1.1.1 deployment with lib dir > > built from 1.1.2 RC0 > > > > I tried to use hbase shell and encountered the following: > > > > ArgumentError: wrong number of arguments (3 for 2) > > (root) at /usr/hdp/2.3.0.0-2556/hbase/bin/hirb.rb:134 > > > > > > After the following copy, I was able to use hbase shell: > > > > cp ~/hbase-1.1.2/bin/hirb.rb bin > > > > I am currently testing RC0 in a 6 node cluster with master running 1.1.2 > > and some region servers running 1.1.1 > > > > Will report back my progress. > > > > On Thu, Aug 13, 2015 at 2:21 PM, Nick Dimiduk > wrote: > > > > > I'm happy to announce the first release candidate of HBase 1.1.2 > > > (HBase-1.1.2RC0) is available for download at > > > https://dist.apache.org/repos/dist/dev/hbase/hbase-1.1.2RC0/ > > > > > > Maven artifacts are also available in the staging repository > > > https://repository.apache.org/content/repositories/orgapachehbase-1090 > > > > > > Artifacts are signed with my code signing subkey 0xAD9039071C3489BD, > > > available in the Apache keys directory > > > https://people.apache.org/keys/committer/ndimiduk.asc > > > > > > There's also a signed tag for this release at > > > > > > > > > https://git-wip-us.apache.org/repos/asf?p=hbase.git;a=tag;h=c4b4a91620639fd96e59171369c630dc51e3 > > > > > > The detailed source and binary compatibility report vs 1.1.0 has been > > > published for your review, at > > > http://people.apache.org/~ndimiduk/1.1.0_1.1.2RC0_compat_report.html > > > > > > HBase 1.1.2 is the second patch release in the HBase 1.1 line, > continuing > > > on the theme of bringing a stable, reliable database to the Hadoop and > > > NoSQL communities. This release includes over 70 bug fixes since the > > 1.1.1 > > > release. Notable correctness fixes include HBASE-14054, HBASE-12865, > > > HBASE-13993, HBASE-13337, HBASE-14013, HBASE-13895. > > > > > > The full list of fixes included in this release is available at > > > > > > > > > https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12332793 > > > and in the CHANGES.txt file included in the distribution. > > > > > > Please try out this candidate and vote +/-1 by midnight Pacific time on > > > Monday, 2015-08-17 as to whether we should release these artifacts as > > HBase > > > 1.1.2. > > > > > > Thanks, > > > Nick > > > > > > > > > -- > Best regards, > >- Andy > > Problems worthy of attack prove their worth by hitting back. - Piet Hein > (via Tom White) >
Re: [VOTE] First release candidate for HBase 1.1.2 (RC0) is available
Quick question here. Are we supposed to be able to start the standalone mode just by doing the extract, export JAVA_HOME and start-hbase.sh? It doesn't work anymore for me. So just running start-hbase.sh doesn't allow me to run HBase anymore. Is that expected? 2015-08-13 19:27 GMT-04:00 Andrew Purtell : > What is hdp-2.3.0.0-2556? Doesn't look like any artifact this project has > released. > > > > On Thu, Aug 13, 2015 at 4:07 PM, Ted Yu wrote: > > > I replaced the hbase/lib dir of an existing 1.1.1 deployment with lib dir > > built from 1.1.2 RC0 > > > > I tried to use hbase shell and encountered the following: > > > > ArgumentError: wrong number of arguments (3 for 2) > > (root) at /usr/hdp/2.3.0.0-2556/hbase/bin/hirb.rb:134 > > > > > > After the following copy, I was able to use hbase shell: > > > > cp ~/hbase-1.1.2/bin/hirb.rb bin > > > > I am currently testing RC0 in a 6 node cluster with master running 1.1.2 > > and some region servers running 1.1.1 > > > > Will report back my progress. > > > > On Thu, Aug 13, 2015 at 2:21 PM, Nick Dimiduk > wrote: > > > > > I'm happy to announce the first release candidate of HBase 1.1.2 > > > (HBase-1.1.2RC0) is available for download at > > > https://dist.apache.org/repos/dist/dev/hbase/hbase-1.1.2RC0/ > > > > > > Maven artifacts are also available in the staging repository > > > https://repository.apache.org/content/repositories/orgapachehbase-1090 > > > > > > Artifacts are signed with my code signing subkey 0xAD9039071C3489BD, > > > available in the Apache keys directory > > > https://people.apache.org/keys/committer/ndimiduk.asc > > > > > > There's also a signed tag for this release at > > > > > > > > > https://git-wip-us.apache.org/repos/asf?p=hbase.git;a=tag;h=c4b4a91620639fd96e59171369c630dc51e3 > > > > > > The detailed source and binary compatibility report vs 1.1.0 has been > > > published for your review, at > > > http://people.apache.org/~ndimiduk/1.1.0_1.1.2RC0_compat_report.html > > > > > > HBase 1.1.2 is the second patch release in the HBase 1.1 line, > continuing > > > on the theme of bringing a stable, reliable database to the Hadoop and > > > NoSQL communities. This release includes over 70 bug fixes since the > > 1.1.1 > > > release. Notable correctness fixes include HBASE-14054, HBASE-12865, > > > HBASE-13993, HBASE-13337, HBASE-14013, HBASE-13895. > > > > > > The full list of fixes included in this release is available at > > > > > > > > > https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12332793 > > > and in the CHANGES.txt file included in the distribution. > > > > > > Please try out this candidate and vote +/-1 by midnight Pacific time on > > > Monday, 2015-08-17 as to whether we should release these artifacts as > > HBase > > > 1.1.2. > > > > > > Thanks, > > > Nick > > > > > > > > > -- > Best regards, > >- Andy > > Problems worthy of attack prove their worth by hitting back. - Piet Hein > (via Tom White) >
Re: [VOTE] First release candidate for HBase 1.1.2 (RC0) is available
What is hdp-2.3.0.0-2556? Doesn't look like any artifact this project has released. On Thu, Aug 13, 2015 at 4:07 PM, Ted Yu wrote: > I replaced the hbase/lib dir of an existing 1.1.1 deployment with lib dir > built from 1.1.2 RC0 > > I tried to use hbase shell and encountered the following: > > ArgumentError: wrong number of arguments (3 for 2) > (root) at /usr/hdp/2.3.0.0-2556/hbase/bin/hirb.rb:134 > > > After the following copy, I was able to use hbase shell: > > cp ~/hbase-1.1.2/bin/hirb.rb bin > > I am currently testing RC0 in a 6 node cluster with master running 1.1.2 > and some region servers running 1.1.1 > > Will report back my progress. > > On Thu, Aug 13, 2015 at 2:21 PM, Nick Dimiduk wrote: > > > I'm happy to announce the first release candidate of HBase 1.1.2 > > (HBase-1.1.2RC0) is available for download at > > https://dist.apache.org/repos/dist/dev/hbase/hbase-1.1.2RC0/ > > > > Maven artifacts are also available in the staging repository > > https://repository.apache.org/content/repositories/orgapachehbase-1090 > > > > Artifacts are signed with my code signing subkey 0xAD9039071C3489BD, > > available in the Apache keys directory > > https://people.apache.org/keys/committer/ndimiduk.asc > > > > There's also a signed tag for this release at > > > > > https://git-wip-us.apache.org/repos/asf?p=hbase.git;a=tag;h=c4b4a91620639fd96e59171369c630dc51e3 > > > > The detailed source and binary compatibility report vs 1.1.0 has been > > published for your review, at > > http://people.apache.org/~ndimiduk/1.1.0_1.1.2RC0_compat_report.html > > > > HBase 1.1.2 is the second patch release in the HBase 1.1 line, continuing > > on the theme of bringing a stable, reliable database to the Hadoop and > > NoSQL communities. This release includes over 70 bug fixes since the > 1.1.1 > > release. Notable correctness fixes include HBASE-14054, HBASE-12865, > > HBASE-13993, HBASE-13337, HBASE-14013, HBASE-13895. > > > > The full list of fixes included in this release is available at > > > > > https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12332793 > > and in the CHANGES.txt file included in the distribution. > > > > Please try out this candidate and vote +/-1 by midnight Pacific time on > > Monday, 2015-08-17 as to whether we should release these artifacts as > HBase > > 1.1.2. > > > > Thanks, > > Nick > > > -- Best regards, - Andy Problems worthy of attack prove their worth by hitting back. - Piet Hein (via Tom White)
Re: [VOTE] First release candidate for HBase 1.1.2 (RC0) is available
I replaced the hbase/lib dir of an existing 1.1.1 deployment with lib dir built from 1.1.2 RC0 I tried to use hbase shell and encountered the following: ArgumentError: wrong number of arguments (3 for 2) (root) at /usr/hdp/2.3.0.0-2556/hbase/bin/hirb.rb:134 After the following copy, I was able to use hbase shell: cp ~/hbase-1.1.2/bin/hirb.rb bin I am currently testing RC0 in a 6 node cluster with master running 1.1.2 and some region servers running 1.1.1 Will report back my progress. On Thu, Aug 13, 2015 at 2:21 PM, Nick Dimiduk wrote: > I'm happy to announce the first release candidate of HBase 1.1.2 > (HBase-1.1.2RC0) is available for download at > https://dist.apache.org/repos/dist/dev/hbase/hbase-1.1.2RC0/ > > Maven artifacts are also available in the staging repository > https://repository.apache.org/content/repositories/orgapachehbase-1090 > > Artifacts are signed with my code signing subkey 0xAD9039071C3489BD, > available in the Apache keys directory > https://people.apache.org/keys/committer/ndimiduk.asc > > There's also a signed tag for this release at > > https://git-wip-us.apache.org/repos/asf?p=hbase.git;a=tag;h=c4b4a91620639fd96e59171369c630dc51e3 > > The detailed source and binary compatibility report vs 1.1.0 has been > published for your review, at > http://people.apache.org/~ndimiduk/1.1.0_1.1.2RC0_compat_report.html > > HBase 1.1.2 is the second patch release in the HBase 1.1 line, continuing > on the theme of bringing a stable, reliable database to the Hadoop and > NoSQL communities. This release includes over 70 bug fixes since the 1.1.1 > release. Notable correctness fixes include HBASE-14054, HBASE-12865, > HBASE-13993, HBASE-13337, HBASE-14013, HBASE-13895. > > The full list of fixes included in this release is available at > > https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12332793 > and in the CHANGES.txt file included in the distribution. > > Please try out this candidate and vote +/-1 by midnight Pacific time on > Monday, 2015-08-17 as to whether we should release these artifacts as HBase > 1.1.2. > > Thanks, > Nick >
Re: In Windows, cannot capture HBase prompt('hbase(main):001:0>') from neither standard output nor standard error using process API
dev to bcc
Hi Dinesh,
I'm not sure what you mean by "process API". Are you launching the hbase
shell as an external process? Would be better to use an HBase client. We
have a nice one in Java. We also have REST and Thrift gateways, which are
launched as separate processes. There's also Apache Phoenix, which will
give you JDBC access to HBase, though again, it's Java only at this point.
Maybe one of these will work for you?
Good luck,
-n
http://hbase.apache.org/apidocs/org/apache/hadoop/hbase/client/package-summary.html#package_description
http://hbase.apache.org/apidocs/org/apache/hadoop/hbase/rest/package-summary.html
http://hbase.apache.org/apidocs/org/apache/hadoop/hbase/thrift/package-summary.html
http://phoenix.apache.org
On Thu, Aug 13, 2015 at 4:39 AM, wrote:
> I have configured HBase(hbase-0.98.13-hadoop2-bin.tar) in windows. It
> works well when started as shell in cmd.exe;
>
>
> When I try to run HBase through Process api in c# or java, hbase
> prompt('hbase(main):001:0>') is not received, but I could able to run HBase
> shell, execute commands and receive error/output for the same;
>
>
> Only thing is I am unable to get HBase prompt('hbase(main):001:0>');
> Please suggest the correct way.
>
>
> Thanks,
>
> Dinesh Kumar P
[jira] [Resolved] (HBASE-13376) Improvements to Stochastic load balancer
[ https://issues.apache.org/jira/browse/HBASE-13376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved HBASE-13376. Resolution: Fixed Fix Version/s: 1.3.0 > Improvements to Stochastic load balancer > > > Key: HBASE-13376 > URL: https://issues.apache.org/jira/browse/HBASE-13376 > Project: HBase > Issue Type: Improvement > Components: Balancer >Affects Versions: 1.0.0, 0.98.12 >Reporter: Vandana Ayyalasomayajula >Assignee: Vandana Ayyalasomayajula >Priority: Minor > Fix For: 2.0.0, 1.3.0 > > Attachments: 13376-v2.txt, 13376-v5.patch, 13376_4.patch, > HBASE-13376.patch, HBASE-13376_0.98.txt, HBASE-13376_0.txt, > HBASE-13376_1.txt, HBASE-13376_1_1.txt, HBASE-13376_2.patch, > HBASE-13376_2_branch-1.patch, HBASE-13376_3.patch, HBASE-13376_3.patch, > HBASE-13376_4.patch, HBASE-13376_5_branch-1.patch, > HBASE-13376_6_branch-1.patch, HBASE-13376_98.patch, HBASE-13376_branch-1.patch > > > There are two things this jira tries to address: > 1. The locality picker in the stochastic balancer does not pick regions with > least locality as candidates for swap/move. So when any user configures > locality cost in the configs, the balancer does not always seems to move > regions with bad locality. > 2. When a cluster has equal number of loaded regions, it always picks the > first one. It should pick a random region on one of the equally loaded > servers. This improves a chance of finding a good candidate, when load picker > is invoked several times. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[VOTE] First release candidate for HBase 1.1.2 (RC0) is available
I'm happy to announce the first release candidate of HBase 1.1.2 (HBase-1.1.2RC0) is available for download at https://dist.apache.org/repos/dist/dev/hbase/hbase-1.1.2RC0/ Maven artifacts are also available in the staging repository https://repository.apache.org/content/repositories/orgapachehbase-1090 Artifacts are signed with my code signing subkey 0xAD9039071C3489BD, available in the Apache keys directory https://people.apache.org/keys/committer/ndimiduk.asc There's also a signed tag for this release at https://git-wip-us.apache.org/repos/asf?p=hbase.git;a=tag;h=c4b4a91620639fd96e59171369c630dc51e3 The detailed source and binary compatibility report vs 1.1.0 has been published for your review, at http://people.apache.org/~ndimiduk/1.1.0_1.1.2RC0_compat_report.html HBase 1.1.2 is the second patch release in the HBase 1.1 line, continuing on the theme of bringing a stable, reliable database to the Hadoop and NoSQL communities. This release includes over 70 bug fixes since the 1.1.1 release. Notable correctness fixes include HBASE-14054, HBASE-12865, HBASE-13993, HBASE-13337, HBASE-14013, HBASE-13895. The full list of fixes included in this release is available at https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12332793 and in the CHANGES.txt file included in the distribution. Please try out this candidate and vote +/-1 by midnight Pacific time on Monday, 2015-08-17 as to whether we should release these artifacts as HBase 1.1.2. Thanks, Nick
[jira] [Created] (HBASE-14220) test-patch.sh should verify src tgz generates and builds correctly
Nick Dimiduk created HBASE-14220: Summary: test-patch.sh should verify src tgz generates and builds correctly Key: HBASE-14220 URL: https://issues.apache.org/jira/browse/HBASE-14220 Project: HBase Issue Type: Task Components: build Reporter: Nick Dimiduk Priority: Minor Fix For: 2.0.0 Twice at release time I've bumped into broken src tgz packaging. This is somewhat expected as builds tend to have dark, hidden corners. Let's add a check to our build bot so we find these issues earlier. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Resolved] (HBASE-12952) Seek with prefixtree may hang
[ https://issues.apache.org/jira/browse/HBASE-12952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Purtell resolved HBASE-12952. Resolution: Incomplete Fix Version/s: (was: 1.1.3) (was: 1.0.3) (was: 1.2.1) (was: 1.3.0) (was: 0.98.14) (was: 2.0.0) Resolving as incomplete. Reopen if progess > Seek with prefixtree may hang > - > > Key: HBASE-12952 > URL: https://issues.apache.org/jira/browse/HBASE-12952 > Project: HBase > Issue Type: Bug > Components: regionserver >Affects Versions: 1.0.0, 0.98.7, 0.98.8, 0.98.6.1, 0.98.9, 0.98.10 >Reporter: sinfox > Attachments: hbase_0.98.6.1.patch > > > I have upgraded my hbase cluster from hbase-0.96 to hbase-0.98.6.1,then i > found some compaction hang on many regionserver, and the cpu costed100%. > It looks like there is an infinite loop somewhere. > From the log, i found StoreFileScanner.java : reseekAtOrAfter(HFileScanner s, > KeyValue k) enterd an infinite loop. > Read source code, I found en error on PrefixTreeArrayReversibleScanner.java : > previousRowInternal() > eg: > A:fan:12, numCell:1 > A : 1 -> B > A : 2 -> C > > C: 3 -> D > C: 4 -> E > > A: fan:12, numCell:1 > B: fan,numCell:1 > C: fan:34,numCell: 0 > D: fan,numCell:1 > E: fan,numCell:1 > when currentNode is D, its previous node is B , but this function will return > A. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-14219) src tgz no longer builds after HBASE-14085
Nick Dimiduk created HBASE-14219: Summary: src tgz no longer builds after HBASE-14085 Key: HBASE-14219 URL: https://issues.apache.org/jira/browse/HBASE-14219 Project: HBase Issue Type: Bug Components: build Reporter: Nick Dimiduk Priority: Minor Encountered on branch-1.1 while spinning RC. Presumably this applies to all branches where HBASE-14085 was applied. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
In Windows, cannot capture HBase prompt('hbase(main):001:0>') from neither standard output nor standard error using process API
I have configured HBase(hbase-0.98.13-hadoop2-bin.tar) in windows. It works
well when started as shell in cmd.exe;
When I try to run HBase through Process api in c# or java, hbase
prompt('hbase(main):001:0>') is not received, but I could able to run HBase
shell, execute commands and receive error/output for the same;
Only thing is I am unable to get HBase prompt('hbase(main):001:0>'); Please
suggest the correct way.
Thanks,
Dinesh Kumar P
