Re: upgrade hadoop , keep hbase

2021-12-23 Thread Duo Zhang
HBase 2.1.x had been EOL before hadoop 3.3.0 was out... HBASE-22953 is only landed on branch-2.3+. The client API between 2.1.x and 2.4.x should be very small, and you can access a 2.4.x cluster with 2.1.x client, usually. And typically there is no problem when rolling upgrading a cluster from

Re: upgrade hadoop , keep hbase

2021-12-21 Thread Michael Wohlwend
Am Dienstag, 21. Dezember 2021, 04:00:01 CET schrieb Bryan Beaudreault: > I have to agree anecdotally that when I first upgraded to 3.3.1 I got a > bunch of NoSuchMethodExceptions (or similar). This was a while ago so I > don't have specifics. It was an easy fix -- recompile hbase with >

Re: upgrade hadoop , keep hbase

2021-12-21 Thread Michael Wohlwend
Thanks for all your answers. In particular I didn't know that HBase uses private Hadoop API calls, so I will recompile it. Michael

Re: upgrade hadoop , keep hbase

2021-12-20 Thread Bryan Beaudreault
I have to agree anecdotally that when I first upgraded to 3.3.1 I got a bunch of NoSuchMethodExceptions (or similar). This was a while ago so I don't have specifics. It was an easy fix -- recompile hbase with -Dhadoop.version=3.3.1. On Mon, Dec 20, 2021 at 9:46 PM Wei-Chiu Chuang wrote: > tl;

Re: upgrade hadoop , keep hbase

2021-12-20 Thread Wei-Chiu Chuang
tl; dr: Pretty sure it won't run. Looking at the Hadoop 3.3 support jira (HBASE-22953 ), most of the work was to whitelist additional dependencies. However, the biggest change was inside the asyncwall HBASE-23833

Re: upgrade hadoop , keep hbase

2021-12-20 Thread Josh Elser
Hi Michael! I have to give you the "default" HBase, but defer you to the Hadoop community (or someone from there who is paying attention to this list) for the precise answer. The question you are asking is: does the binary compatibility of Hadoop jars changes between Hadoop 3.1.2 and 3.3.0.

upgrade hadoop , keep hbase

2021-12-20 Thread Michael Wohlwend
Hello all, I have hadoop 3.1.2 running, with hbase 2.1.4 If I want to update to hadoop 3.3.0, is it sufficient to replace all the hadoop 3.1.2 jars in the hbase folder tree with the 3.3.0 version? Or do I have to make a new hbase build? Thanks for answering Michael