NoClassDefFoundError when creating a custom hive UDF

2013-07-01 Thread Rupinder Singh
Hi, I have created a custom Hive UDF that has external JAR dependencies. I have added those jars to the Hive session using 'add jar' but when I try to create my function, I get a NoClassDefFoundError on the dependency class. I am on Hive 0.81 running in Amazon EMR. This is what happens when I t

Pls unsubscribe

2013-07-01 Thread Liz Lee-Red Oak
Sent from my iPhone

Request perm to edit wiki

2013-07-01 Thread Sanjay Subramanian
Hi I'd like to add documentation on how to use LZO compression in Hive May I get edit permissions? Thanks. Sanjay Confluence username: sanjaysubraman...@yahoo.com Apache JIRA username - sanjaysubramanian From: Lefty Leverenz mailto:le...@hortonworks.com

Re: Hive Table to CSV file

2013-07-01 Thread Raj Hadoop
Sorry. Its my bad.  I see the files now. I was looking in a different directory earlier. From: Mohammad Tariq To: user Sent: Monday, July 1, 2013 8:26 PM Subject: Re: Hive Table to CSV file Do you have permissions to write to this path?And make sure you

Re: Hive Table to CSV file

2013-07-01 Thread Mohammad Tariq
Do you have permissions to write to this path?And make sure you are looking into the local FS, as Stephen has specified. Warm Regards, Tariq cloudfront.blogspot.com On Tue, Jul 2, 2013 at 5:25 AM, Stephen Sprague wrote: > you gotta admit that's kinda funny. Your stderr output shows not only >

Re: 回复: different outer join plan between hive 0.9 and hive 0.10

2013-07-01 Thread Navis류승우
Yes, a little bit. IMHO, these flags could be assigned only for aliases with condition on 'on' clause. Then, I think, even a byte (8 flags) could be enough in most cases. I'll do that if time permits. 2013/7/1 wzc1989 : > hi navis: > look at the patches in (HIVE-3411, HIVE-4206, HIVE-4212, HIVE-

Re: Hive Table to CSV file

2013-07-01 Thread Stephen Sprague
you gotta admit that's kinda funny. Your stderr output shows not only once but three times where it put the output and in fact how many rows it put there. and to top it off it reported 'SUCCESS'. but you're saying there's nothing there? now. call me crazy but i would tend to believe hive over y

Hive Table to CSV file

2013-07-01 Thread Raj Hadoop
Hi, My requirement is to load data from a (one column) Hive view to a CSV file. After loading it, I dont see any file generated. I used the following commands to load data to file from a view v_june1 hive > set hive.io.output.fileformat=CSVTextFile;  hive > insert overwrite local directory '/u

Re: Correct way of using regexserde

2013-07-01 Thread Mohammad Tariq
Hello there, Thanks a lot for the response. Do you mean creating an external table?I have also tried deleting "ouputregex", but same result. And the jar is also added. Warm Regards, Tariq cloudfront.blogspot.com On Mon, Jul 1, 2013 at 1:39 PM, Matouk IFTISSEN wrote: > Hello, > try to

Re: unable to partition the table

2013-07-01 Thread Stephen Sprague
sorry for the spam. but one correction. json_pp appears to be part of the perl core so if you have a modern perl you may already have it installed. On Mon, Jul 1, 2013 at 1:31 PM, Stephen Sprague wrote: > ok. so i just learned of a perl script called "json_pp" (for json > pretty_prrint) that

Re: unable to partition the table

2013-07-01 Thread Stephen Sprague
ok. so i just learned of a perl script called "json_pp" (for json pretty_prrint) that is a binary included in the distro for the perl JSON module. You gotta figure there are analogous tools in other languages as well but given this is a binary it doesn't matter much what language its written in -

Re: hiveserver2 Thrift Interface With Perl

2013-07-01 Thread Dave Cardwell
I just wanted to update the list to let future searchers know that I found a solution—David Morel of booking.com kindly shared some code with me to get this working, which he has now released as a Perl library that has been working well: https://github.com/dmorel/Thrift-API-HiveClient2 https://met

Re: Correct way of using regexserde

2013-07-01 Thread Matouk IFTISSEN
Hello, try to delete "output.regex" = "%1$s" and store your data in file then pricise where the file is located STORED AS TEXTFILE LOCATION '/..'; and assure that you add the jar "hive-contrib-0.10.0.jar" in the session or you have it in all Hadoop tasktrackers like this: add jar path_where_i

Experience of Hive local mode execution style

2013-07-01 Thread Guillaume Allain
Hi all, Would anybody have any comments or feedback about the hive local mode execution? It is advertised as providing a boost to performance for small data sets. It seem to fit nicely when running unit/integration tests on single node or virtual machine. My exact questions are the following :

FW: Continuing/FAILED/ATTEMPT error with udf

2013-07-01 Thread Guillaume Allain
Hi all, I ran into errors that I cannot explain when using a java User Defined Function: - The UDF runs fine on smallquery, I am therefore confident on my ADD JAR/CREATE TEMPORARY code; - The error is only raised on complex queries/ high volume data sets; - The jobs complain first about a "java.

回复: different outer join plan between hive 0.9 and hive 0.10

2013-07-01 Thread wzc1989
hi navis: look at the patches in (HIVE-3411, HIVE-4206, HIVE-4212, HIVE-3464), I understand what you mean by "hive tags rows a filter mask as a short for outer join, which can contain 16 flags. " . I wonder why not choose Long or int which can contain 64/32 tags. Does adding one Long/int in eve