RE: NoClassDefFoundError when creating a custom hive UDF

2013-07-02 Thread Rupinder Singh
So I found the getRequiredFiles() and getRequiredJars() methods that were added in HIVE-2561, and implemented getRequiredJars() to provide the full local paths to the jars. Still the same error. Is there a built-in UDF that uses these functions or is there an example from someone who has

Re: Correct way of using regexserde

2013-07-02 Thread Matouk IFTISSEN
Yes it is to create an external table that points your data with the regexp passed with the SERDE. good day 2013/7/2 Mohammad Tariq donta...@gmail.com Hello there, Thanks a lot for the response. Do you mean creating an external table?I have also tried deleting ouputregex, but same

Re: Correct way of using regexserde

2013-07-02 Thread Mohammad Tariq
No luck. Warm Regards, Tariq cloudfront.blogspot.com On Tue, Jul 2, 2013 at 1:03 PM, Matouk IFTISSEN matouk.iftis...@ysance.comwrote: Yes it is to create an external table that points your data with the regexp passed with the SERDE. good day 2013/7/2 Mohammad Tariq donta...@gmail.com

Re: Override COUNT() function

2013-07-02 Thread Navis류승우
MetadataOnlyOptimizer changes GBY on partition columns to simple TableScan with one line dummy. I think similar things can be done with stats. 2013/6/28 Peter Marron peter.mar...@trilliumsoftware.com: Hi, I feel sure that someone has asked for this before, but here goes… In the case

Re:

2013-07-02 Thread m_muthukumar
http://hmydesign.ca/wel.come.phpcjvode30331761

RE:

2013-07-02 Thread Siddharth Tiwari
Please stop spamming the list. ** Cheers !!! Siddharth Tiwari Have a refreshing day !!! Every duty is holy, and devotion to duty is the highest form of worship of God.” Maybe other people will try to limit me but I don't limit myself Date: Tue, 2 Jul 2013 01:18:17

RE: Override COUNT() function

2013-07-02 Thread Peter Marron
Thanks Navis, This is a very interesting class which I feel pretty sure that I would never have found. Are there any descriptions, motivations, documentation or examples anywhere? I suspect that there's nothing other than the source itself, but I had to ask. Regards, Z -Original

RE: Partition performance

2013-07-02 Thread Peter Marron
Hi Owen, I’m curious about this advice about partitioning. Is there some fundamental reason why Hive is slow when the number of partitions is 10,000 rather than 1,000? And the improvements that you mention are they going to be in version 12? Is there a JIRA raised so that I can track them?

Dealing with differents date format

2013-07-02 Thread Jérôme Verdier
Hi, i trying to translate some PL/SQL script in HiveQL, and dealing with unusual date format. i added a variable in my hive script : '${hiveconf:in_co_an_mois}' which is a year/month date format, like this : 201307 (INT format). I would like to transform this in date format, because i have to

Help in ROW_NUMBER() OVER (PARTITION BY) in Hive

2013-07-02 Thread dyuti a
Hi Experts, I'm working with Teradata query conversion to hive environment (Hive version 0.10.0).The challenge that am facing here is in converting the below line in query. In SELECT clause: ROW_NUMBER() OVER (PARTITION BY CLMST_KEY2 ORDER BY COUNTER) AS CLMST_ORDR_NBR When searched found like

Re: Need urgent help in hive query

2013-07-02 Thread dyuti a
sure will check to that Robin -Thanks On Sat, Jun 29, 2013 at 1:11 AM, Robin Morris r...@baynote.com wrote: It probably won't make a difference to performance — the subqueries will be executed in separate map-reduce jobs, and the output put on disk anyway. First, get it to work;

Help in ROW_NUMBER() OVER (PARTITION BY) in Hive

2013-07-02 Thread dyuti a
Hi Experts, I'm working with Teradata query conversion to hive environment (Hive version 0.10.0).The challenge that am facing here is in converting the below line in query. In SELECT clause: ROW_NUMBER() OVER (PARTITION BY CLMST_KEY2 ORDER BY COUNTER) AS CLMST_ORDR_NBR When searched found like

Re: Partition performance

2013-07-02 Thread Owen O'Malley
On Tue, Jul 2, 2013 at 2:34 AM, Peter Marron peter.mar...@trilliumsoftware.com wrote: Hi Owen, ** ** I’m curious about this advice about partitioning. Is there some fundamental reason why Hive is slow when the number of partitions is 10,000 rather than 1,000? The precise

Re: Help in ROW_NUMBER() OVER (PARTITION BY) in Hive

2013-07-02 Thread Ashutosh Chauhan
Windowing functions (over clause) were introduced in 0.11 You need to upgrade to 0.11 to make use of them. Ashutosh On Tue, Jul 2, 2013 at 7:19 AM, dyuti a hadoop.hiv...@gmail.com wrote: Hi Experts, I'm working with Teradata query conversion to hive environment (Hive version 0.10.0).The

Re: Dealing with differents date format

2013-07-02 Thread Stephen Sprague
not sure i fully understand your dilemma.have you investigated any of the date functions listed here? https://cwiki.apache.org/confluence/display/Hive/LanguageManual+UDF#LanguageManualUDF-DateFunctions seems to me you could pull the year and month from a date. or if you have an int then do

Re: Experience of Hive local mode execution style

2013-07-02 Thread Edward Capriolo
Local mode is fast. In particular older version pf hadoop take a lot of time scheduling tasks and a delay betwen map and reduce phase. Local mode really helps with those little delays. On Monday, July 1, 2013, Guillaume Allain guillau...@blinkbox.com wrote: Hi all, Would anybody have any

Re: Override COUNT() function

2013-07-02 Thread Navis류승우
As you expected, there is no documentation on it (like other optimizers) Javadoc of the class might be helpful but seemed not in detail enough. 2013/7/2 Peter Marron peter.mar...@trilliumsoftware.com: Thanks Navis, This is a very interesting class which I feel pretty sure that I would never

Re: Hive Compile Error: WrappedRuntimeException

2013-07-02 Thread Xun Tang
To close the loop, I think the problem comes from running 32 bit ubuntu VM on vmware inside windows 7 host. After replacing the 32 bit vm with a 64 bit one, problem is gone... On Sun, Jun 30, 2013 at 9:18 AM, Xun Tang tangxun.al...@gmail.com wrote: Hi, ** ** I am trying to compile hive

Unsubscribe

2013-07-02 Thread Sundar
Unsubscribe

Possible to specify reducers for each stage?

2013-07-02 Thread Felix . 徐
Hi all, Is it possible to specify reducer number for each stage ? how? thanks!

Re: Unsubscribe

2013-07-02 Thread tofunmibabatunde
Unsubscribe Sent from my BlackBerry® wireless handheld from Glo Mobile. -Original Message- From: Sundar ssundarsur...@gmail.com Date: Wed, 3 Jul 2013 09:32:22 To: user@hive.apache.org Reply-To: user@hive.apache.org Subject: Unsubscribe Unsubscribe

Re: Possible to specify reducers for each stage?

2013-07-02 Thread Navis류승우
Currently it's not. https://issues.apache.org/jira/browse/HIVE-3946 2013/7/3 Felix.徐 ygnhz...@gmail.com: Hi all, Is it possible to specify reducer number for each stage ? how? thanks!