And,also the log is in yarn container. I try to solve this problem by packaging nbconf/ to a jar file under $HIVE_HOME,then put it under $HIVE_HOME/nblib, it was uploaded to /tmp/hadoop_yarn/root/_tez_session_dir/,but did not work.
Best regards. LLBian 01-14-2016 At 2016-01-14 10:47:18, "LLBian" <[email protected]> wrote: >Hi,all > I'm a green hand in using apache tez. Recently,I met some of the > difficulty: > our team has developed a plug-in on hive. It is similar to the function of > HBaseHandler,but customized code. Now my task is to ensure it can be > compatible with tez. while that is the background.My question is: >（1）I have a directory named nbconf,it is created under $HIVE_HOME, under >it,there is a sub-directory named conf/hbasetable. >（2）I also have a directory named nblib,it is created under $HIVE_HOME,used >for Tez JARs. >（3）when I set hive.compute.splits.in.am=true,it throws Exception in hive log: > …… >[map1]java.lang.ExceptionInInitializerError: >…… >…… >Caused by java.lang.RuntimeException:[conf/hbasetable/] path not exsit or is >not a directory >…… > >But actually it exists！It is under local $HIVE_HOME/nbconf. When I set >hive.compute.splits.in.am=FALSE,it works well. So, I guess,maybe because >computing splits in Cluster AM,not in localdisk. Mybe I should load some files >or directory(eg.conf/hbasetable)HDFS,If tez wish to do so,where should I put >them？: >the tez session dirctory? > /tmp/hadoop_yarn/root/_tez_session_dir/? > /tmp/hadoop_yarn/root/_tez_session_dir/.tez/? > /tmp/hadoop_yarn/root/_tez_session_dir/.tez/AppId/? >I tryed these,but they all didn't work. > >becase it is OK when debugging, so I don`t know how to take up the matter. I >don't know where to put this customed directory "[conf/hbasetable]" on HDFS. > >I am eager to get your guidance. Any help is greatly appreciated . >(Please forgive my poor English) > >LLBian
