Re: version of haddop in hbase binary download
got it fixed, unsure why, but JAVA_HOME was unset, sorry for the noise. Michael Am 18.12.2023 um 17:10 schrieb Michael: ok, thank you for the answer, very helpful. Are the parameters to mvn correct? I got a build error (mvn 3.9.6, java 11.0.16):
Re: version of haddop in hbase binary download
ok, thank you for the answer, very helpful. Are the parameters to mvn correct? I got a build error (mvn 3.9.6, java 11.0.16): Michael [INFO] Reactor Summary for Apache HBase 2.5.6: [INFO] [INFO] Apache HBase ... SUCCESS [ 12.053 s] [INFO] Apache HBase - Checkstyle .. SUCCESS [ 2.031 s] [INFO] Apache HBase - Annotations . SUCCESS [ 1.255 s] [INFO] Apache HBase - Build Configuration . SUCCESS [ 0.205 s] [INFO] Apache HBase - Logging . SUCCESS [ 1.454 s] [INFO] Apache HBase - Shaded Protocol . SUCCESS [ 43.482 s] [INFO] Apache HBase - Common .. SUCCESS [ 14.674 s] [INFO] Apache HBase - Metrics API . SUCCESS [ 1.911 s] [INFO] Apache HBase - Hadoop Compatibility SUCCESS [ 2.600 s] [INFO] Apache HBase - Metrics Implementation .. SUCCESS [ 1.843 s] [INFO] Apache HBase - Hadoop Two Compatibility SUCCESS [ 3.423 s] [INFO] Apache HBase - Protocol SUCCESS [ 14.304 s] [INFO] Apache HBase - Client .. SUCCESS [ 13.120 s] [INFO] Apache HBase - Zookeeper ... SUCCESS [ 3.584 s] [INFO] Apache HBase - Replication . SUCCESS [ 2.597 s] [INFO] Apache HBase - Resource Bundle . SUCCESS [ 0.197 s] [INFO] Apache HBase - HTTP SUCCESS [ 5.986 s] [INFO] Apache HBase - Asynchronous FileSystem . SUCCESS [ 4.986 s] [INFO] Apache HBase - Procedure ... SUCCESS [ 3.859 s] [INFO] Apache HBase - Server .. SUCCESS [ 53.384 s] [INFO] Apache HBase - MapReduce ... SUCCESS [ 9.302 s] [INFO] Apache HBase - Testing Util SUCCESS [ 4.897 s] [INFO] Apache HBase - Thrift .. SUCCESS [ 13.517 s] [INFO] Apache HBase - RSGroup . SUCCESS [ 6.774 s] [INFO] Apache HBase - Shell ... SUCCESS [ 5.111 s] [INFO] Apache HBase - Coprocessor Endpoint SUCCESS [ 6.976 s] [INFO] Apache HBase - Integration Tests ... SUCCESS [ 11.474 s] [INFO] Apache HBase - Rest SUCCESS [ 7.699 s] [INFO] Apache HBase - Examples SUCCESS [ 6.130 s] [INFO] Apache HBase - Shaded .. SUCCESS [ 0.490 s] [INFO] Apache HBase - Shaded - Client (with Hadoop bundled) SUCCESS [ 27.708 s] [INFO] Apache HBase - Shaded - Client . SUCCESS [ 14.487 s] [INFO] Apache HBase - Shaded - MapReduce .. SUCCESS [ 23.678 s] [INFO] Apache HBase - External Block Cache SUCCESS [ 2.998 s] [INFO] Apache HBase - HBTop ... SUCCESS [ 2.455 s] [INFO] Apache HBase - Compression . SUCCESS [ 0.076 s] [INFO] Apache HBase - Compression - Aircompressor . SUCCESS [ 3.604 s] [INFO] Apache HBase - Compression - Brotli SUCCESS [ 3.058 s] [INFO] Apache HBase - Compression - LZ4 ... SUCCESS [ 3.512 s] [INFO] Apache HBase - Compression - Snappy SUCCESS [ 3.368 s] [INFO] Apache HBase - Compression - XZ SUCCESS [ 3.046 s] [INFO] Apache HBase - Compression - ZStandard . SUCCESS [ 3.436 s] [INFO] Apache HBase - Assembly SUCCESS [ 16.603 s] [INFO] Apache HBase - Shaded - Testing Util ... SUCCESS [ 59.956 s] [INFO] Apache HBase - Shaded - Testing Util Tester SUCCESS [ 4.324 s] [INFO] Apache HBase Shaded Packaging Invariants ... FAILURE [ 2.297 s] [INFO] Apache HBase Shaded Packaging Invariants (with Hadoop bundled) SKIPPED [INFO] Apache HBase - Archetypes .. SKIPPED [INFO] Apache HBase - Exemplar for hbase-client archetype . SKIPPED [INFO] Apache HBase - Exemplar for hbase-shaded-client archetype SKIPPED [INFO] Apache HBase - Archetype builder ... SKIPPED [INFO] [INFO] BUILD FAILURE [INFO] [INFO] Total time: 07:18 min [INFO] Finished at: 2023-12-18T17:04:00+01:00 [INFO] [ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:3.1.0:exec (check-jar-contents) on project hbase-shaded-check-invariants: Command execution failed.: Process exited with an error: 1 (Exit value: 1) -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible
Re: version of haddop in hbase binary download
In general, HBase will bundle the oldest hadoop binaries it could support by default. It does not mean that you should have your hadoop servers, like HDFS or YARN, has the same version. You are free to use newer version of hadoop to setup HDFS or YARN, as a hadoop client with lower version can communicate with hadoop server with higher version. If you want to use hadoop client with higher version, it is recommended to build HBase binaries by your own. You can check the 'Building Apache HBase' section in our ref guide https://hbase.apache.org/book.html#build The command is like this mvn -DskipTests -Dhadoop.profile=3.0 -Dhadoop-three.version=3.3.6 clean install && mvn -DskipTests -Dhadoop.profile=3.0 -Dhadoop-three.version=3.3.6 package assembly:single Thanks. Michael 于2023年12月18日周一 19:44写道： > > Hi, > > the version of hadoop which is included in the binary download of hbase > 2.5.6 is slightly older than that of hadoop on the apache webside. > > Does it matter? It differs in the minor version. > Or is it recommended to use the same version of hadoop as is included in > the hbase binary? > > Thanks > Michael
version of haddop in hbase binary download
Hi, the version of hadoop which is included in the binary download of hbase 2.5.6 is slightly older than that of hadoop on the apache webside. Does it matter? It differs in the minor version. Or is it recommended to use the same version of hadoop as is included in the hbase binary? Thanks Michael
