Hi all. When I execute a query on hive I got an error below.(so do in hive cli) no more detailed log found.
what should I check? any advice will be appreciated. versions - tez-0.8.2 - hadoop 2.6.0 ----------------------------------- hive > set hive.execution.engine=tez; hive > select count(*) from contents; WARNING: org.apache.hadoop.metrics.jvm.EventCounter is deprecated. Please use org.apache.hadoop.log.metrics.EventCounter in all the log4j.properties files. Logging initialized using configuration in file:/home1/eco/hive/conf/hive-log4j.properties hive> set hive.execution.engine=tez; hive> select count(*) from agg_band_contents; Query ID = irteam_20160212145903_9300f3b2-3942-4423-8586-73d2eaff9e58 Total jobs = 1 Launching Job 1 out of 1 Exception in thread "Thread-10" java.lang.RuntimeException: org.apache.tez.dag.api.SessionNotRunning: TezSession has already shutdown. Application application_1452243782005_0292 failed 2 times due to AM Container for appattempt_1452243782005_0292_000002 exited with exitCode: 1 For more detailed output, check application tracking page: http://xstathn003:8088/proxy/application_1452243782005_0292/Then, click on links to logs of each attempt. Diagnostics: Exception from container-launch. Container id: container_1452243782005_0292_02_000001 Exit code: 1 Stack trace: ExitCodeException exitCode=1: at org.apache.hadoop.util.Shell.runCommand(Shell.java:538) at org.apache.hadoop.util.Shell.run(Shell.java:455) at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715) at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211) at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302) at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Container exited with a non-zero exit code 1 Failing this attempt. Failing the application. at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:535) at org.apache.hadoop.hive.ql.exec.TaskRunner.run(TaskRunner.java:74) Caused by: org.apache.tez.dag.api.SessionNotRunning: TezSession has already shutdown. Application application_1452243782005_0292 failed 2 times due to AM Container for appattempt_1452243782005_0292_000002 exited with exitCode: 1 For more detailed output, check application tracking page: http://xstathn003:8088/proxy/application_1452243782005_0292/Then, click on links to logs of each attempt. Diagnostics: Exception from container-launch. Container id: container_1452243782005_0292_02_000001 Exit code: 1 Stack trace: ExitCodeException exitCode=1: at org.apache.hadoop.util.Shell.runCommand(Shell.java:538) at org.apache.hadoop.util.Shell.run(Shell.java:455) at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715) at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211) at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302) at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Container exited with a non-zero exit code 1 Failing this attempt. Failing the application. at org.apache.tez.client.TezClient.waitTillReady(TezClient.java:784) at org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:205) at org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:116) at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:532) ... 1 more Interrupting... Be patient, this might take some time. ------------------- tez example.jar works well. $ hadoop jar ~/apps/tez-0.8.2/tez-examples-0.8.2.jar orderedwordcount /tmp/set_webapps.sh /tmp/set_webapps.result $ ok. ------------------- my setup. upload tez to hdfs. $ hadoop fs -mkdir /apps $ hadoop fs -mkdir /apps/tez-0.8.2 $ hadoop fs -put tez-dist/target/tez-0.8.2.tar.gz /apps/tez-0.8.2/ env export export TEZ_JARS=/home1/irteam/apps/tez-0.8.2 export TEZ_CONF_DIR=$TEZ_JARS/conf export HADOOP_CLASSPATH=$TEZ_CONF_DIR:$TEZ_JARS/*:$TEZ_JARS/lib/*:$HADOOP_CLASSPATH export HADOOP_USER_CLASSPATH_FIRST=true $ source ~/.bashrc $ mkdir tez-dist/target/tez-0.8.2/conf $ vi tez-dist/target/tez-0.8.2/conf/tez-site.xml <?xml version="1.0" encoding="UTF-8"?> <?xml-stylesheet type="text/xsl" href="configuration.xsl"?> <configuration> <property> <name>tez.lib.uris</name> <value>${fs.defaultFS}/apps/tez-0.8.2/tez-0.8.2.tar.gz</value> </property> </configuration>
