Upgrading the internal version of ORC that is bundled into Hive 1.2 will be a lot of work. To be honest, you should strongly consider moving to Hive 2.3 (or later), which uses the standalone ORC 1.3. Upgrading that to ORC 1.5 or 1.6 would be relatively straightforward.
The short answer is that there have been a lot of performance improvements and bug fixes, but I've never run benchmarks between those particular versions. .. Owen On Thu, Aug 26, 2021 at 5:52 AM Purshotam Shah <purus...@verizonmedia.com.invalid> wrote: > Hi Dongjoon, > > Thanks for your reply. > > Yes, we are planning to build hive-1.2 with Apache ORC 1.5.12. > We realized that it's a lot of work as we have to merge multiple patches. > Hive-1.2 has been very stable for us. We are wondering if it's worth > building hive-1.2 with Apache ORC 1.5.12. We can't migrate to hive-2.x or > hive-3.x, as we have built some of our features on top of hive-1.2. > > We looked at orc commit logs and didn't find much information on > performance improvement. This is where we need some input. > Do you think that we will get some performance improvement? If yes, it will > be nice if you can share some details. > > Yes, if we decided to proceed with hive-1.2 with ORC 1.5.12, we would run > some performance tests. > > Thanks, > > > On Wed, Aug 25, 2021 at 11:08 AM Dongjoon Hyun <dongjoon.h...@gmail.com> > wrote: > > > What is the baseline for your comparison? > > > > FYI, the community status is like the following. > > > > - Apache Hive 1.2.2 is not using Apache ORC. > > - Apache Hive 2.3.9 is using Apache ORC 1.3.4. > > - Apache Hive 3.1.2 is using Apache ORC 1.5.6. > > - Apache Hive 4.0.0-SNAPSHOT is using Apache ORC 1.6.9. > > > > So, specifically, are you going to build from the Hive 1.2 source with > > Apache ORC 1.5.12 and compare it with Apache Hive 1.2.2? > > > > Dongjoon. > > > > > > On Tue, Aug 24, 2021 at 11:54 PM Purshotam Shah > > <purus...@verizonmedia.com.invalid> wrote: > > > > > Hi, > > > > > > We have been running hive 1.2 successfully for few years. Hive-1.2 has > > > been very stable for us. > > > > > > We are planning to migrate to apache orc-1.5.12 thinking that we might > > get > > > better performance. > > > The plan is to keep hive-1.2 and replace orc with apache orc-1.5.12. > > > > > > We looked at the orc commit logs and didn't find much information on > > > performance improvement. > > > > > > Would you mind sharing some of the performance improvements we might > get > > > after upgrading to orc-1.5.12 with hive-1.2? > > > > > > Thanks, > > > > > >
