Re: Change existing location of Hive Warehouse

2013-02-13 Thread Kugathasan Abimaran
If you don't have the following property in hive-site.xml, add it and change the location where you want. property namehive.metastore.warehouse.dir/name value/user/hive/warehouse/value descriptionlocation of default database for the warehouse/description /property On Wed, Feb 13, 2013 at

Re: Change existing location of Hive Warehouse

2013-02-13 Thread Hamza Asad
thnx.. done it successfully.. Now i want to transfer my data from old location to new location, how can i do that On Wed, Feb 13, 2013 at 1:24 PM, Kugathasan Abimaran abimar...@hsenidmobile.com wrote: If you don't have the following property in hive-site.xml, add it and change the location

Re: Change existing location of Hive Warehouse

2013-02-13 Thread Kugathasan Abimaran
Try to use following http://hadoop.apache.org/docs/r0.18.2/hdfs_shell.html#cp On Wed, Feb 13, 2013 at 2:01 PM, Hamza Asad hamza.asa...@gmail.com wrote: thnx.. done it successfully.. Now i want to transfer my data from old location to new location, how can i do that On Wed, Feb 13, 2013 at

Change timestamp format in hive

2013-02-13 Thread Chunky Gupta
Hi, I have a log file which has timestamp in format -MM-DD-HH:MM:SS. But since the timestamp datatype format in hive is -MM-DD HH:MM:SS. I created a table with datatype of that column as TIMESTAMP. But when I load the data it is throwing error. I think it is because of difference in

Re: Change timestamp format in hive

2013-02-13 Thread Alexander Alten-Lorenz
May https://cwiki.apache.org/Hive/languagemanual-udf.html#LanguageManualUDF-DateFunctions help you? - Alex On Feb 13, 2013, at 10:43 AM, Chunky Gupta chunky.gu...@vizury.com wrote: Hi, I have a log file which has timestamp in format -MM-DD-HH:MM:SS. But since the timestamp datatype

Re: Change timestamp format in hive

2013-02-13 Thread Dean Wampler
I'll mention some workarounds, but they all add overhead: 1. Use STRING for the column, then parse it with the date functions Alexander mentioned. 2. Use STRING, then replace the offending '-' with a space, e.g., select printf(%s %s, substr('2013-02-13-08:11:22', 0, 10),

hive-0.10 and nullpointerexception

2013-02-13 Thread Marcin Cylke
Hi I'm experiencing the following problem when running a simple query under hive-0.10. I'm using the stock release package with CDH-4.1 The query need to execute map-reduce job for this to happen. For me something along this one is sufficient: select count(*) from sample_table; The error I get

Re: INSERT INTO table with STRUCT, SELECT FROM

2013-02-13 Thread Dean Wampler
Hmm. I tried the following hacks, but all wouldn't parse. Ideas? I changed: ... select struct(x,y) ... to ... select struct(x,y) as structa:int,b:int ... ... select cast(struct(x,y) as structa:int,b:int) ... ... select struct(x as a,y as b) ... Okay, but there is a hack that does

Re: INSERT INTO table with STRUCT, SELECT FROM

2013-02-13 Thread Michael Malak
Figured it out fromhttps://cwiki.apache.org/Hive/languagemanual-udf.html#LanguageManualUDF-ComplexTypeConstructors It should beINSERT INTO TABLE oc SELECT named_struct('a', x, 'b', y) FROM tc; --- On Wed, 2/13/13, Dean Wampler dean.wamp...@thinkbiganalytics.com wrote: From: Dean Wampler

Re: INSERT INTO table with STRUCT, SELECT FROM

2013-02-13 Thread Edward Capriolo
I developed the inline udtf. Seems to work: http://svn.apache.org/repos/asf/hive/trunk/ql/src/test/queries/clientpositive/udf_inline.q as (id, text) FROM SRC limit 2; SELECT inline( ARRAY( STRUCT (1,'dude!'), STRUCT (2,'Wheres'), STRUCT (3,'my car?') ) ) as (id, text) FROM

Re: Help to solve UDAF errors!

2013-02-13 Thread Robin Morris
Hi, You might well have found the error yourself by now, but if not, the problem is that you missed the static keyword off the declaration of TopNPercentEvaluator. Line 18 of your code should read public static class TopNPercentEvaluator implements UDAFEvaluator { then this error

Re: Help to solve UDAF errors!

2013-02-13 Thread Abhishek Bhattacharya
Hi Robin, Thanks for the response. The point mentioned by you is one of the many other serious issues in the code. I have fixed all of them and it is pretty much in a good shape presently after some testing. You can find it at:

Guaranteeing Partition Statistics Deprecating Table Statistics

2013-02-13 Thread Bhushan Mandhani
Hi All, In HIVE-3959, I'm working actively on guaranteeing accuracy of physical stats. For context, the status quo in Hive is that both Table stats and Partition stats exist but are quite unreliable (even with hive.stats.reliable set to true). Either stats should be reliable or they should

Using Reflect: A thread for ideas

2013-02-13 Thread John Omernik
I stumbled across the little documented reflect function today. I've always known about it, but java scares me if it's not in a cup so I didn't dig. Well today I dug, and found an awesome use case for reflect (for me) and wanted to share. I also thought it would be nice to validate some thoughts

CHAN (Comprehensive Hive Archive Network) (Was Re: Using Reflect: A thread for ideas)

2013-02-13 Thread Robin Morris
I think we need to think a little bigger than this. Recently I've been thinking that what would be most useful to the Hive user community would be a CHAN – Comprehensive Hive Archive Network, (analogous to CPAN, CRAN, CTAN etc.). A central place where user-contributed UD[A,T]Fs could be

Re: [ hive ] Re: hive-0.10 and nullpointerexception

2013-02-13 Thread Marcin Cylke
On 13/02/13 17:34, Mark Grover wrote: Hi Marcin, Sorry to hear that you ran into this. My guess is you are using Yarn and this is, in fact, a known issue. The culprit line here is