Re: Re: delta file compact take no effect

2015-06-22 Thread r7raul1...@163.com
My hive version is 1.1.0 r7raul1...@163.com From: Alan Gates Date: 2015-06-18 23:25 To: user Subject: Re: delta file compact take no effect Which version of Hive are you running? A number of deadlock issues were resolved in HIVE-10500 which was released in Hive 1.2. Based on your log it

Re: delta file compact take no effect

2015-06-18 Thread Alan Gates
Which version of Hive are you running? A number of deadlock issues were resolved in HIVE-10500 which was released in Hive 1.2. Based on your log it appears it recovered properly from the deadlocks and did manage to compact. Alan. r7raul1...@163.com June 17, 2015

Re: Re: delta file compact take no effect

2015-06-17 Thread r7raul1...@163.com
s: 30 r7raul1...@163.com From: r7raul1...@163.com Date: 2015-06-18 08:37 To: user Subject: Re: Re: delta file compact take no effect Thank you! I will try r7raul1...@163.com From: Alan Gates Date: 2015-06-18 08:33 To: user Subject: Re: delta file compact take no effect See https://cwiki.apach

Re: Re: delta file compact take no effect

2015-06-17 Thread r7raul1...@163.com
Thank you! I will try r7raul1...@163.com From: Alan Gates Date: 2015-06-18 08:33 To: user Subject: Re: delta file compact take no effect See https://cwiki.apache.org/confluence/display/Hive/Hive+Transactions#HiveTransactions-Configuration Compaction is initiated by the thrift metastore

Re: delta file compact take no effect

2015-06-17 Thread Alan Gates
See https://cwiki.apache.org/confluence/display/Hive/Hive+Transactions#HiveTransactions-Configuration Compaction is initiated by the thrift metastore server. You need to set the values labeled metastore in the above page in the hive-site.xml for your metastore server. Alan. r7raul1...@163

Re: Re: delta file compact take no effect

2015-06-16 Thread r7raul1...@163.com
My config is on my client. What is metastore config? r7raul1...@163.com From: Alan Gates Date: 2015-06-17 13:42 To: user Subject: Re: delta file compact take no effect Is the config you give on your metastore or your client? The worker thread and initiator must be started on the metastore

Re: delta file compact take no effect

2015-06-16 Thread Alan Gates
Is the config you give on your metastore or your client? The worker thread and initiator must be started on the metastore. Alan. r7raul1...@163.com June 16, 2015 at 22:38 Any help? r7raul1...

Re: Re: delta file compact take no effect

2015-06-16 Thread r7raul1...@163.com
Any help? r7raul1...@163.com From: r7raul1...@163.com Date: 2015-06-11 15:53 To: user Subject: Re: Re: delta file compact take no effect SHOW COMPACTIONS; I can see some info Database Table Partition Type State Worker Start Time default u_data_txn NULL MAJOR initiated NULL 0 Time taken

Re: delta file compact take no effect

2015-06-12 Thread Eugene Koifman
lt;mailto:user@hive.apache.org>" mailto:user@hive.apache.org>> Date: Thursday, June 11, 2015 at 12:53 AM To: "user@hive.apache.org<mailto:user@hive.apache.org>" mailto:user@hive.apache.org>> Subject: Re: Re: delta file compact take no effect SHOW COMPACTIONS; I can se

Re: Re: delta file compact take no effect

2015-06-11 Thread r7raul1...@163.com
To: user@hive.apache.org Subject: Re: delta file compact take no effect What do you see if you issue: SHOW COMPACTIONS; On Thursday, 11 June 2015, r7raul1...@163.com wrote: I use hive 1.1.0 on hadoop 2.5.0 After I do some update operation on table u_data_txn. My table create many delta file like

Re: delta file compact take no effect

2015-06-11 Thread Elliot West
What do you see if you issue: SHOW COMPACTIONS; On Thursday, 11 June 2015, r7raul1...@163.com wrote: > > I use hive 1.1.0 on hadoop 2.5.0 > After I do some update operation on table u_data_txn. > My table create many delta file like: > drwxr-xr-x - hdfs hive 0 2015-02-06 22:52 > /user/hive/ware