MR3 1.8 released On behalf of the MR3 team, I am pleased to announce the release of MR3 1.8.
MR3 is an execution engine similar in spirit to MapReduce and Tez which has been under development since 2015. Its main application is Hive on MR3. You can run Hive on MR3 on Hadoop, on Kubernetes, in standalone mode (which does not require Hadoop/Kubernetes), or on a local machine. You can also test Hive on MR3 in a single Docker container. >From MR3 1.8, we assume Java 17 by default. For running Hive on MR3 on Hadoop, we continue to support Java 8 as well. For Kubernetes and standalone mode, we release Hive on MR3 built with Java 17 only. Please see the release notes for changes new in MR3 1.8. A major new feature is that Hive on MR3 can use Apache Celeborn for remote shuffle service. https://mr3docs.datamonad.com/docs/release/ For the performance of Hive on MR3 1.8, please see a blog article "Hive on MR3 - from Java 8 to Java 17 (and beating Trino)". On the 10TB TPC-DS benchmark, Hive on MR3 1.8 finishes all the queries faster than Trino 418. https://www.datamonad.com/post/2023-12-09-hivemr3-java17-1.8/ Thank you, --- Sungwoo