Hey, Thanks for the input.
FYI. Cloudera (Cloudera + Hortonworks) have removed HoS from their latest offering. "Tez is now the only supported execution engine, existing queries that change execution mode to Spark or MapReduce within a session, for example, fail." https://docs.cloudera.com/cdp/latest/upgrade-post/topics/ug_hive_configuration_changes.html So I don't know who will be supporting this feature moving forward, but there has been a lot of work done to make this change as painless as possible. Simply set the engine to 'tez' and remove the HoS-related settings should address many use cases. Thanks. On Tue, Jul 21, 2020 at 11:36 AM Xuefu Z <usxu...@gmail.com> wrote: > Sorry for chiming in late. However, I don't think we should remove Hive on > Spark just because of a technical problem. This is rather a big decision > that we need to be careful about. There are users that will be left high > and dry by this move. > > If the community decides to desupport and eventually remove it, I think we > need to have a due process. We also need a deprecation plan if that's we > decide to do. Before that, I'm -1 on this proposal. > > Thanks, > Xuefu > > On Tue, Jul 21, 2020 at 7:57 AM David <dam6...@gmail.com> wrote: > > > Hello Team, > > > > https://github.com/apache/hive/pull/1285 > > > > Thanks. > > > > On Wed, Jun 3, 2020 at 11:49 PM Gopal V <gop...@apache.org> wrote: > > > > > > > > +1 > > > > > > Cheers, > > > Gopal > > > > > > On 6/3/20 7:48 PM, Jesus Camacho Rodriguez wrote: > > > > +1 > > > > > > > > -Jesús > > > > > > > > On Wed, Jun 3, 2020 at 1:58 PM Alan Gates <alanfga...@gmail.com> > > wrote: > > > > > > > >> +1. > > > >> > > > >> Alan. > > > >> > > > >> On Wed, Jun 3, 2020 at 1:40 PM Prasanth Jayachandran > > > >> <pjayachand...@cloudera.com.invalid> wrote: > > > >> > > > >>> +1 > > > >>> > > > >>>> On Jun 3, 2020, at 1:38 PM, Ashutosh Chauhan < > hashut...@apache.org> > > > >>> wrote: > > > >>>> > > > >>>> +1 > > > >>>> > > > >>>> On Wed, Jun 3, 2020 at 1:23 PM David Mollitor <dam6...@gmail.com> > > > >> wrote: > > > >>>> > > > >>>>> Hello Gang, > > > >>>>> > > > >>>>> I have spent some time working on upgrading Avro (far less than > > > >> others): > > > >>>>> > > > >>>>> https://issues.apache.org/jira/browse/HIVE-21737 > > > >>>>> > > > >>>>> This should be a relatively easy thing to do, but is blocked by > > > >>>>> Hive-on-Spark. HoS has a weird thing where it downloads some > > > >>>>> cloud-storage-hosted file of Spark-Hadoop as part of its maven > run. > > > >>>>> > > > >>>>> Since HoS is not going to receive updates from the major vendors, > > is > > > >> it > > > >>>>> time to simply remove it? > > > >>>>> > > > >>>>> Tests are currently disabled: > > > >>>>> https://issues.apache.org/jira/browse/HIVE-23137 > > > >>>>> > > > >>>>> Thanks. > > > >>>>> > > > >>> > > > >>> > > > >> > > > > > > > > > > > > -- > Xuefu Zhang > > "In Honey We Trust!" >
