Thanks Nick, Looking at this matrix <http://hbase.apache.org/book.html#hadoop>, I upgraded Hadoop from 3.1 to 3.1.1. This should allow me to used Hbase 2.1.8
So I did both. One needs to change few hbase-site.xml setting etc to make it work. Also the addition of htrace-core-3.1.0-incubating.jar to $HBASE_HOME/lib. So both the HMaster and HRegionServer are running on master node and HRegionServer on another node. The drawback is that one cannot use snappy compression in create table command, something like below create 'trading:MARKETDATAHBASESPEED', {NAME=> 'PRICE_INFO', COMPRESSION => 'SNAPPY'} This is the error I get on HRegionServer log org.apache.hadoop.hbase.DoNotRetryIOException: Compression algorithm 'snappy' previously failed test. Eventually table is sort of created but mot complete. Also getting rid of this table becomes problematic hbase(main):002:0> drop 'trading:MARKETDATAHBASESPEED' ERROR: The procedure 31 is still running For usage try 'help "drop"' Took 668.3693 seconds hbase(main):003:0> drop 'trading:MARKETDATAHBASESPEED' ERROR: The procedure 32 is still running For usage try 'help "drop"' Took 668.2910 seconds So the table cannot be dropped. All fun and games Cheers, Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>* http://talebzadehmich.wordpress.com *Disclaimer:* Use it at your own risk. Any and all responsibility for any loss, damage or destruction of data or any other property which may arise from relying on this email's technical content is explicitly disclaimed. The author will in no case be liable for any monetary damages arising from such loss, damage or destruction. On Thu, 20 Feb 2020 at 18:54, Nick Dimiduk <ndimi...@apache.org> wrote: > changed subject, dropped dev > > Hello Mich, > > The HBase binary distribution includes all Hadoop client jars necessary for > HBase to function on top of HDFS. The version of those Hadoop jars is that > of Hadoop 2.8.5. Duo is saying that the Hadoop 2.8.5 client works against a > HDFS 3.1.x cluster. Thus, this binary release of HBase is expected to work > with HDFS 3.1. > > Alternatively, you can choose to recompile HBase using Hadoop 3.1.x as the > dependency. In that case, you'll need to retrieve the source, establish a > build environment, and perform the build yourself -- the HBase project does > not distribute a binary artifact compiled against Hadoop 3. > > Thanks, > Nick > > On Thu, Feb 20, 2020 at 3:20 AM Mich Talebzadeh <mich.talebza...@gmail.com > > > wrote: > > > Thank you. > > > > In your points below > > > > If you want to run HBase on top of a 3.1.x HDFS cluster, you can just use > > the binaries, hadoop 2.8.5 client can communicate with 3.1.x server. > > > > If you want HBase to use hadoop 3.1.x, then you need to build the > binaries > > by yourself, use the hadoop 3 profile. > > > > Could you please clarify (since Hbase can work with Hadoop), which > version > > of new release has been tested against which version of Hadoop. > > > > Also it is not very clear which binaries you are referring to? "Hadoop > > 2.8.5 client can communicate with "Hadoop" 3.1 server. So basically > > download Hadoop 2.8.5 client for Hbase use? > > > > > > Regards, > > > > > > > > Dr Mich Talebzadeh > > > > > > > > LinkedIn * > > > https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw > > < > > > https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw > > >* > > > > > > > > http://talebzadehmich.wordpress.com > > > > > > *Disclaimer:* Use it at your own risk. Any and all responsibility for any > > loss, damage or destruction of data or any other property which may arise > > from relying on this email's technical content is explicitly disclaimed. > > The author will in no case be liable for any monetary damages arising > from > > such loss, damage or destruction. > > > > > > > > > > On Thu, 20 Feb 2020 at 09:45, 张铎(Duo Zhang) <palomino...@gmail.com> > wrote: > > > > > If you want to run HBase on top of a 3.1.x HDFS cluster, you can just > use > > > the binaries, hadoop 2.8.5 client can communicate with 3.1.x server. > > > > > > If you want HBase to use hadoop 3.1.x, then you need to build the > > binaries > > > by yourself, use the hadoop 3 profile. > > > > > > Mich Talebzadeh <mich.talebza...@gmail.com> 于2020年2月20日周四 下午5:15写道: > > > > > > > Hi, > > > > > > > > Thanks. > > > > > > > > Does this version of Hbase work with Hadoop 3.1? I am still stuck > with > > > > Hbase 1.2.7 > > > > > > > > Hadoop 3.1.0 > > > > Source code repository https://github.com/apache/hadoop -r > > > > 16b70619a24cdcf5d3b0fcf4b58ca77238ccbe6d > > > > Compiled by centos on 2018-03-30T00:00Z > > > > Compiled with protoc 2.5.0 > > > > > > > > Regards, > > > > > > > > Dr Mich Talebzadeh > > > > > > > > > > > > > > > > LinkedIn * > > > > > > > > > > https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw > > > > < > > > > > > > > > > https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw > > > > >* > > > > > > > > > > > > > > > > http://talebzadehmich.wordpress.com > > > > > > > > > > > > *Disclaimer:* Use it at your own risk. Any and all responsibility for > > any > > > > loss, damage or destruction of data or any other property which may > > arise > > > > from relying on this email's technical content is explicitly > > disclaimed. > > > > The author will in no case be liable for any monetary damages arising > > > from > > > > such loss, damage or destruction. > > > > > > > > > > > > > > > > > > > > On Thu, 20 Feb 2020 at 08:48, Duo Zhang <zhang...@apache.org> wrote: > > > > > > > > > The HBase team is happy to announce the immediate availability of > > > Apache > > > > > HBase 2.1.9. > > > > > > > > > > Download from https://hbase.apache.org/downloads.html > > > > > > > > > > Apache HBase is an open-source, distributed, versioned, > > non-relational > > > > > database. Apache HBase gives you low latency random access to > > billions > > > of > > > > > rows with millions of columns atop non-specialized hardware. To > learn > > > > more > > > > > about HBase, see https://hbase.apache.org/. > > > > > > > > > > HBase 2.1.9 is the latest release of the HBase 2.1 line, continuing > > on > > > > the > > > > > theme of bringing a stable, reliable database to the Apache Big > Data > > > > > ecosystem and beyond. 2.1.9 includes ~62 bug and improvement fixes > > done > > > > > since the 2.1.8. > > > > > > > > > > For instructions on verifying ASF release downloads, please see > > > > > > > > > > https://www.apache.org/dyn/closer.cgi#verify > > > > > > > > > > Project member signature keys can be found at > > > > > > > > > > https://www.apache.org/dist/hbase/KEYS > > > > > > > > > > Thanks to all the contributors who made this release possible! > > > > > > > > > > Best, > > > > > The HBase Dev Team > > > > > > > > > > > > > > >