Re: Using Hive with WebHCat

2013-12-10 Thread Jonathan Hodges
Would it be advisable to try 0.12, maybe this issue is resolved? On Wed, Dec 4, 2013 at 6:17 PM, Jonathan Hodges hodg...@gmail.com wrote: Hi Thejas, Thanks for your reply. The 'templeton.storage.root' property is set to the default value, '/templeton-hadoop'. Sorry I wasn't clear above

Getting table path within storage handler

2013-12-10 Thread Ed Kohlwey
What is considered the right way to get the table path is a HIVE storage handler? The MetaHook interface gives you a Table object which has a getSd() method, but its not clear that this method is invoked outside of lifecycle events (I assume it is not). It seems that if you write a StorageHandler

Re: Versioninfo and platformName issue.

2013-12-10 Thread Adam Kawa
Hi, Do you have Hadoop libs properly installed? Does $ hadoop version command run successfully? If true, then It sounds like some classpath issue... 2013/12/10 Manish Bhoge manishbh...@rocketmail.com Sent from Rocket Mail via Android -- * From: * Manish Bhoge

Question on correlation optimizer

2013-12-10 Thread Avrilia Floratou
Hi, I'm running TPCH query 21 on Hive. 0.12 and have enabled hive.optimize.correlation. I could see the effect of the correlation optimizer on query 17 but when running query 21 I don't actually see the optimizer being used. I used the publicly available tpc-h queries for hive and merged all the

Re: requesting access to hive confluence wiki

2013-12-10 Thread Navis류승우
Is there someone who knows how to do this? 2013/11/30 Xiao Meng xi...@simba.com Hi, I would like update/fix some contents on the performance test part. My user name is xiaom. Thanks, Xiao

Re: requesting access to hive confluence wiki

2013-12-10 Thread Ashutosh Chauhan
Sorry, I missed this one. Xiao you should now have perms to edit cwiki. Thanks, Ashutosh On Tue, Dec 10, 2013 at 6:26 PM, Navis류승우 navis@nexr.com wrote: Is there someone who knows how to do this? 2013/11/30 Xiao Meng xi...@simba.com Hi, I would like update/fix some contents on

Re: Question on correlation optimizer

2013-12-10 Thread Yin Huai
Hi Avrilia, It is caused by distinct aggregations in TPC-H Q21. Because Hive adds those distinct columns in the key columns of ReduceSinkOperators and correlation optimizer only check exact same key columns right now, this query will not be optimized. The jira of this issue is

Re: Question on correlation optimizer

2013-12-10 Thread Avrilia Floratou
Hi Yin, Thanks for the detailed explanation. I have one more question for the correlation optimizer. When I ran explain in query 17 I get the plan for stage 1 where the bulk of the time goes. I can understand what is happening in the map phase but the reduce phase confuses me when the optimizer