Hi Cheng Pan, There is long running Hive mail thread discussing this here: https://lists.apache.org/thread/sxcrcf4v9j630tl9domp0bn4m33bdq0s
On Thu, Apr 18, 2024 at 11:15 AM Cheng Pan <pan3...@gmail.com> wrote: > Hi Ayush, > > > Hive is already in discussion of marking Hive-2.x EOL, so at very best > we would have one release and immediately after that we will announce it EOL > > Does the discussion happen in public? Is there an ETA for the final > release of branch-2.3? > > Thanks, > Cheng Pan > > > > On Apr 17, 2024, at 18:03, Ayush Saxena <ayush...@gmail.com> wrote: > > > > Thanx Cheng Pan for sharing the pointers, Do you have any list of issues > or pointers on what are the challenges for Spark to move to a higher Hive > version? I know upgrading libraries is quite challenging but it is > inevitable. > > > > Hive is already in discussion of marking Hive-2.x EOL, so at very best > we would have one release and immediately after that we will announce it > EOL, maintaining a release line is quite an effort for us at Hive & doing > it because other projects doesn't want to upgrade isn't a convincing reason > for most of us. The best we can do is or are trying is to address issues > for Spark whatever we can do as part of Hive code & would definitely need > help/support from Spark side as well, since the move is from 2.x to 4.x, it > would be a big change and would offer resistance on both sides. > > > > So, it would be great help if any pointers can be shared from Spark side > for the move, if there is no help/interest from Spark then we can't do > anything & there is no need for Hive-2.x either in that case :-) > > > > -Ayush > > > > On Wed, 17 Apr 2024 at 15:00, Cheng Pan <pan3...@gmail.com> wrote: > > > … we are exploring ways to get Spark move from 2.3.9 to 4.0, Our > initial hunch is that it would be quite challenging without a hive-exec > slim jar … > > > > It should be challenging to upgrade Spark’s built-in Hive version. > Actually, we already did lots of work on branch-2.3 which focuses on CVE > reduction, for example, allowing Spark to upgrade Guava to modern versions > to get rid of Guava 14, it was tested with the latest Spark master > branch[1], maybe we need a release for 2.3.10 now. > > > > [1] https://github.com/apache/spark/pull/45372 > > > > Thanks, > > Cheng Pan > > > > > >
