Hi,all
    I'm a green hand in using apache tez. Recently,I met some of the difficulty:
    our team has developed a plug-in on hive. It is similar to the function of 
HBaseHandler,but customized code. Now my task is to ensure it can be compatible 
with tez.  while that is the background.My question is:
(1)I have a directory named nbconf,it is created under $HIVE_HOME, under 
it,there is a sub-directory named conf/hbasetable. 
(2)I also have a directory named nblib,it is  created under $HIVE_HOME,used for 
Tez JARs.
(3)when I set  hive.compute.splits.in.am=true,it throws Exception in hive log:
   ……
[map1]java.lang.ExceptionInInitializerError:
……
……
Caused by java.lang.RuntimeException:[conf/hbasetable/] path not exsit or is 
not a directory
……

But actually it exists!It is under local $HIVE_HOME/nbconf. When I set  
hive.compute.splits.in.am=FALSE,it works well. So, I guess,maybe because 
computing splits in Cluster AM,not in localdisk. Mybe I should load some files 
or directory(eg.conf/hbasetable)HDFS,If tez wish to do so,where should I put 
them?:
the tez session dirctory?
 /tmp/hadoop_yarn/root/_tez_session_dir/? 
 /tmp/hadoop_yarn/root/_tez_session_dir/.tez/?
 /tmp/hadoop_yarn/root/_tez_session_dir/.tez/AppId/?
I tryed these,but they all didn't work.

becase it is OK when debugging, so I don`t know how to take up the matter.  I 
don't know where to put this customed directory "[conf/hbasetable]" on HDFS.

I am eager to get your guidance. Any help is greatly appreciated .
(Please forgive my poor English)

LLBian

Reply via email to