The logs said I have to deal with tez shuffle as this page: https://tez.apache.org/shuffle-handler.html
But yarn always can't find the path. Do you know how to deal with this statement? The Tez Shuffle Handler jar artifact org.apache.org:tez-aux-services needs to be placed into the Node Manager classpath and restarted Thanks. On Sat, May 14, 2022 at 6:30 AM Pau Tallada <tall...@pic.es> wrote: > there is no info there to extract any conclusion. you have too look at the > logs > > On Sat, May 14, 2022, 00:12 wilson <wil...@4shield.net> wrote: > >> I then installed tez-0.9.2 for hive 3. But still get this execution error: >> >> hive> select * from books order by price desc limit 10; >> >> Query ID = pyh_20220514061049_da0bd690-080d-4acc-8ef8-d2a2c04b75c6 >> >> Total jobs = 1 >> >> Launching Job 1 out of 1 >> >> FAILED: Execution Error, return code 1 from >> org.apache.hadoop.hive.ql.exec.tez.TezTask >> >> >> >> Can you help? >> >> >> Thank you. >> >> >> >> On Sat, May 14, 2022 at 5:26 AM Pau Tallada <tall...@pic.es> wrote: >> >>> we are using HDP 3.1.4 on production, with comes with tez 0.9.1 >>> and we are testing an in-house hadoop distro with tez 0.10.0. >>> we are deploying/testing using docker for the moment >>> >>> On Fri, May 13, 2022, 23:17 <wil...@4shield.net> wrote: >>> >>>> What tez version should I use? >>>> Can you share the deployment details? >>>> >>>> Thanks >>>> >>>> >>>> > Hi, >>>> > >>>> > AFAIK, Hive3 is not compatible with Tez 0.10.1. >>>> > We are testing a deployment with Tez 0.10.0, and it seems to work >>>> fine. >>>> > >>>> > Best regards, >>>> > >>>> > Pau. >>>> > >>>> > Missatge de wilson <wil...@4shield.net> del dia dv., 13 de maig 2022 >>>> a les >>>> > 12:52: >>>> > >>>> >> I am these packages in a single node VM: >>>> >> >>>> >> apache-tez-0.10.1-bin.tar.gz >>>> >> >>>> >> apache-hive-3.1.2-bin.tar.gz >>>> >> >>>> >> hadoop-3.3.2.tar.gz >>>> >> >>>> >> >>>> >> And java: >>>> >> >>>> >> >>>> >> $ java -version >>>> >> >>>> >> java version "1.8.0_321" >>>> >> >>>> >> Java(TM) SE Runtime Environment (build 1.8.0_321-b07) >>>> >> >>>> >> Java HotSpot(TM) 64-Bit Server VM (build 25.321-b07, mixed mode) >>>> >> >>>> >> >>>> >> >>>> >> But I can't enable tez execution engine for hive-3.1.2. >>>> >> >>>> >> Do you have a guide for this? >>>> >> >>>> >> >>>> >> Thanks in advance. >>>> >> >>>> > >>>> > >>>> > -- >>>> > ---------------------------------- >>>> > Pau Tallada Crespí >>>> > Departament de Serveis >>>> > Port d'Informació Científica (PIC) >>>> > Tel: +34 93 170 2729 >>>> > ---------------------------------- >>>> > >>>> >>>> >>>>
