I cannot find the base directory in Hive warehouse in HDFS, so I raised this
question. Can you find the base directory in your Hive?
Wantao
At 2014-12-02 15:50:47, "unmesha sreeveni" <unmeshab...@gmail.com> wrote:
Check the base directory in Hive warehouse.
On Tue, Dec 2, 2014 at 12:42 PM, vic0777 <vic0...@163.com> wrote:
Hi All,
I am trying to use the new transaction feature in Hive-0.14. According to its
document, every transaction table have a base directory and one delta directory
for each transaction in HDFS for data storage. But I can not find where the
base directory is in HDFS, there is only delta directories. Following is the
commands I used.
create table test_txn (id int ,name string ) clustered by (id) into 2 buckets
stored as orc TBLPROPERTIES('transactional'='true');
insert into table test_txn select * from test_text;
update test_txn set name="liu" where id = 10;
P.S. I have configured the parameters required by the transaction feature:
hive.support.concurrency,
hive.enforce.bucketing,
hive.exec.dynamic.partition.mode,
hive.txn.manager,
hive.compactor.initiator.on
hive.compactor.worker.threads.
Although I cannot find the base directory in HDFS, all SELECT, UPDATE and
DELETE statements works fine and the data in the table is correct. I am
wondering where the base directory is.
Any help is appreciated.
Thanks,
Wantao
--
Thanks & Regards
Unmesha Sreeveni U.B
Hadoop, Bigdata Developer
Centre for Cyber Security | Amrita Vishwa Vidyapeetham
http://www.unmeshasreeveni.blogspot.in/
