Get arguments' names in Hive's UDF

Hi all, Is there any api to retrieve the parameter's column name in GenericUDF? For example: Select UDFTEST(columnA,columnB) from test; I want to get the column names(columnA and columnB) in UDFTEST's initialize function via ObjectInspector but I did not find any viable solution.

Possible to specify reducers for each stage?

Hi all, Is it possible to specify reducer number for each stage ? how? thanks!

Re: Performance difference between tuning reducer num and partition table

overhead could matter. Another clue is the size of the files the first run produced, i.e., do you have 30 small (much less than a block size) files? On Sat, Jun 29, 2013 at 12:27 AM, Felix.徐 ygnhz...@gmail.com wrote: Hi Stephen, My query is actually more complex , hive will generate 2 mapreduces

Performance difference between tuning reducer num and partition table

Hi all, Here is the scenario, suppose I have 2 tables A and B, I would like to perform a simple join on them, We can do it like this: INSERT OVERWRITE TABLE C SELECT FROM A JOIN B on A.id=B.id In order to speed up this query since table A and B have lots of data, another approach is :

Re: Performance difference between tuning reducer num and partition table

on your cluster for these two scenarios? I'd be curious if there are the same. On Fri, Jun 28, 2013 at 8:40 AM, Felix.徐 ygnhz...@gmail.com wrote: Hi all, Here is the scenario, suppose I have 2 tables A and B, I would like to perform a simple join on them, We can do it like this: INSERT

How to change the separator of input reocrd in TRANSFORM of Hive

Hi all, I am trying to use Transform in Hive, but I do not find a way to change the separator between fields of input records in Transform. I create a table A by specify ROW FORMAT DELIMITED FIELDS TERMINATED BY '\0' However, while using SELECT TRANSFORM(id,name) USING 'python script.py' AS

Re: How to change the separator of input reocrd in TRANSFORM of Hive

Oh sorry , I find the solution on wiki: https://cwiki.apache.org/Hive/languagemanual-transform.html by specifying the inrowformat and outrowformat . 2013/5/24 Felix.徐 ygnhz...@gmail.com Hi all, I am trying to use Transform in Hive, but I do not find a way to change the separator between

What is the rule of job name generation in Hive?

Hi,all..I find that the job names of Hive are like this INSERT OVERWRITE TABLE u...userID,neighborid(Stage-4) What is the rule of generating such a name?

Re: How to get job names and stages of a query?

. Thanks, Manish Sent from my BlackBerry, pls excuse typo -- *From: * Felix.徐 ygnhz...@gmail.com *Date: *Tue, 20 Mar 2012 12:58:53 +0800 *To: *user@hive.apache.org *ReplyTo: * user@hive.apache.org *Subject: *How to get job names and stages of a query? Hi,all I want

How to track query status in hive via thrift or anything else?

Hi,all .. I didn't find any helpful api in ThriftHive that can track the execution status of hive(or job progress).I want to get execution progress of queries from hive?How to do that?Thanks!

Is it possible to get the progress of a query through thrift server?

Hi all, I want to build a website to monitor the execution of queries sent to hive , is there any way to realize it?

Re: Is it possible to get the progress of a query through thrift server?

Can you provide some references? Thanks very much! 在 2012年3月12日 下午11:28，Edward Capriolo edlinuxg...@gmail.com写道： Yes. You have access to the job counters through thrift, as well as a method to test if query is done. Edward On Mon, Mar 12, 2012 at 11:12 AM, Felix.徐 ygnhz...@gmail.com wrote

Re: Showing wrong count after importing table in Hive

Hi, I meet the same problem once, then I change the amount of imported columns it works fine. Sometimes blank rows would be generated by sqoop..I do not actually know what the problem really is.. 2012/2/9 Bhavesh Shah bhavesh25s...@gmail.com Hello All, I have imported near about 10