Getting weird error after M/R job completes with status as 100%

2014-06-27 Thread shouvanik.haldar
Hi Nitin, I have a M/R job which gets executed as soon as a hive query runs. This hive query has many complex joins. Both the Map/Reduce jobs complete with status at 100%, after which I get the below error 2014-06-27 23:42:06,396 INFO org.apache.hadoop.hive.ql.exec.Task (SessionState.java:p

Re: Write access to wiki

2014-06-27 Thread Ashutosh Chauhan
Done. On Fri, Jun 27, 2014 at 6:26 PM, Sudarshan Rangarajan < tr.sudars...@gmail.com> wrote: > 'tr.sudarshan

Write access to wiki

2014-06-27 Thread Sudarshan Rangarajan
Hi there, Can my user account 'tr.sudarshan' get write access to this wiki ? ref: https://issues.apache.org/jira/browse/HIVE-3628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14046400#comment-14046400 Tha

Re: [ANNOUNCE] New Hive Committers - Gopal Vijayaraghavan and Szehon Ho

2014-06-27 Thread Sergey Shelukhin
Congrats! On Mon, Jun 23, 2014 at 11:05 AM, Jayesh Senjaliya wrote: > Congratulations Gopal and Szehon !! > > > On Mon, Jun 23, 2014 at 10:35 AM, Vikram Dixit > wrote: > > > Congrats Gopal and Szehon! > > > > > > On Mon, Jun 23, 2014 at 10:34 AM, Jason Dere > > wrote: > > > >> Congrats! > >>

Skewed vs ListBucketing

2014-06-27 Thread Steven Willis
I'm having trouble understanding the difference between a skewed table and a list bucketed table: https://cwiki.apache.org/confluence/display/Hive/ListBucketing Is the only difference that ListBucketing stores the data as directories and a "plain" skewed table stores them as files? I think that

Re: Hive metastore error

2014-06-27 Thread Rishabh Bhardwaj
Thank you all for your concern.I found the problem.It was while setting up the mysql metastore. On Friday, 27 June 2014 6:05 PM, Nagarjuna Vissarapu wrote: can u please attach hive-site.xml file. On Thu, Jun 26, 2014 at 2:11 PM, Rishabh Bhardwaj wrote: HI all, >I have changed my hive

Error in adding Hive UDF

2014-06-27 Thread Rishabh Bhardwaj
Hi all, I have a udf namely gwudf.jar I have it on my local dir at /tmp/gwudf.jar ,and also at hdfs at /user/hive/lib/gwudf.jar so when I am adding this jar, The following error comes Adding like this, hive> add jar /tmp/gwudf.jar;  Added /tmp/gwudf.jar to class

Basic question regarding calculating number of reducers

2014-06-27 Thread KayVajj
Hi, I have a basic question regarding the calculation of the number of reducers in hive. I know that is computed as /. In case of compressed files it is not clear whether total input size is calculated when compressed or decompressed. Doesn't it make a significant difference if calculated when co