Re: Where is the base directory of a transaction table?

2014-12-03 Thread Alan Gates
Are you running a stand alone metastore process? The compactor runs in a stand alone metastore, not in the client. Alan. vic0777 December 2, 2014 at 23:13 Hi Alan, Thans for your help. I set the hive.compactor.initiator.on(= true) and hive.compactor.worker.threads(=2

Re:Re: Where is the base directory of a transaction table?

2014-12-02 Thread vic0777
Hi Alan, Thans for your help. I set the hive.compactor.initiator.on(= true) and hive.compactor.worker.threads(=2) in hive-site.xml. After the configuration, I started Hive for its first run. what do you mean by "When you say you set hive.compactor.initiator.on (=true I hope) and hive.compactor

Re: Where is the base directory of a transaction table?

2014-12-02 Thread Alan Gates
The base directories will only exist after compaction has run. When you say you set hive.compactor.initiator.on (=true I hope) and hive.compactor.worker.threads, did you did that in your metastore process? If so, did you restart the metastore after changing the config values? Alan. vic0777

Re:Re: Where is the base directory of a transaction table?

2014-12-02 Thread vic0777
I cannot find the base directory in Hive warehouse in HDFS, so I raised this question. Can you find the base directory in your Hive? Wantao At 2014-12-02 15:50:47, "unmesha sreeveni" wrote: Check the base directory in Hive warehouse. On Tue, Dec 2, 2014 at 12:42 PM, vic0777 wrote: H

Re: Where is the base directory of a transaction table?

2014-12-01 Thread unmesha sreeveni
Check the base directory in Hive warehouse. On Tue, Dec 2, 2014 at 12:42 PM, vic0777 wrote: > Hi All, > > I am trying to use the new transaction feature in Hive-0.14. According to > its document, every transaction table have a base directory and one delta > directory for each transaction in HDFS

Where is the base directory of a transaction table?

2014-12-01 Thread vic0777
Hi All, I am trying to use the new transaction feature in Hive-0.14. According to its document, every transaction table have a base directory and one delta directory for each transaction in HDFS for data storage. But I can not find where the base directory is in HDFS, there is only delta direct