Re: Hcatalog for Hadoop2

2013-12-13 Thread Nitin Pawar
you may have to build it yourself. On Fri, Dec 13, 2013 at 12:56 PM, Sathwik B P sath...@apache.org wrote: Hi, I have Hive 0.12 and Hadoop 2.2. Hcatalog that has been packaged with Hive 0.12 is built for Hadoop 1. Is there a distribution of Hcatalog built for Hadoop 2 ? regards,

Re: Hcatalog for Hadoop2

2013-12-13 Thread Sathwik B P
Hi Nithin, Where can I find the instructions to build from source. I would like to build the current hive trunk. regards, sathwik On Fri, Dec 13, 2013 at 2:22 PM, Nitin Pawar nitinpawar...@gmail.comwrote: you may have to build it yourself. On Fri, Dec 13, 2013 at 12:56 PM, Sathwik B P

Re: Hcatalog for Hadoop2

2013-12-13 Thread Nitin Pawar
here are the instructions https://cwiki.apache.org/confluence/display/Hive/GettingStarted#GettingStarted-BuildingHivefromSource In the build command you can specify the hadoop version you want to use. On Fri, Dec 13, 2013 at 3:17 PM, Sathwik B P sath...@apache.org wrote: Hi Nithin, Where

Re: Hcatalog for Hadoop2

2013-12-13 Thread Sathwik B P
The wiki is probably no more valid as the build is based on maven now. Can you kindly provide the details for building the Hive Distrib. On Fri, Dec 13, 2013 at 3:18 PM, Nitin Pawar nitinpawar...@gmail.comwrote: here are the instructions

Re: Hcatalog for Hadoop2

2013-12-13 Thread Nitin Pawar
sure. Once you checkout trunk, inside the pom there is profile called hadoop-2 which basically currently looks up to hadoop version of 2.2.0 If you want to change from that version then change the line in pom.xml ( hadoop-23.version2.2.0/hadoop-23.version) after that, you can just do a normal

Re: Hcatalog for Hadoop2

2013-12-13 Thread Sathwik B P
Found this document https://cwiki.apache.org/confluence/display/Hive/HiveDeveloperFAQ#HiveDeveloperFAQ-Building On Fri, Dec 13, 2013 at 4:39 PM, Nitin Pawar nitinpawar...@gmail.comwrote: sure. Once you checkout trunk, inside the pom there is profile called hadoop-2 which basically

Re: handling joins in Hive 0.11.0

2013-12-13 Thread Adrian Popescu
Hello, I found out that the dependency graph among task stages is incorrect for the skewed join optimized plan. In particular, the conditional task in the optimized plan maintains no dependency with the child tasks of the common join task in the original plan. The conditional task is

Question about running Hive on Tez

2013-12-13 Thread Zhenxiao Luo
Hi, Excuse me. May I ask a question about running Hive on Tez? I've installed Hive on Tez, and running a simple query from hiveCli, hive set hive.optimize.tez=true; hive select * from table order by title_id limit 5; While, each time, I could see from the TezJobMonitor that, all the map jobs

hive monitoring

2013-12-13 Thread Biswajit Nayak
Hi All, Could any one help me in identifying the data points for monitoring the hive server and metastore. Or any tool that could help. Saw tool name HAWK in slideshare, but could find any anywhere its source code has been shared. Thanks Biswajit --

Re: Question about running Hive on Tez

2013-12-13 Thread Gunther Hagleitner
dev on bcc Zhenxiao, Cool you got it set up. The query runs a full order by before the limit - are you sure it's not just still running? Hive on Tez prints total tasks/completed tasks, so no update may mean none of the reduce tasks have finished yet. If not, it'd be great to see the yarn logs