RE: Table Wrapper

2013-06-28 Thread Peter Marron
Yes indeed. Thank you for prompting me to post again. It is always helpful to get a response, any response. There is nothing worse than posting and getting absolutely nothing in reply. As you say I have now got quite a few suggestions and even if they don't all pan out I will have learnt a lot.

Hive help on the update

2013-06-28 Thread Kumar Chinnakali
Hi Hive Team, I have Teradata Query as below and my intention is to convert in to Hive Query(HQL). Tried but it's vain. SELECT Col_1, Col_2, Col_3, MIN(Col_3) OVER(Partition by Col_1 ORDER BY Col_3, Col_2 rows between 1 preceding and 1 preceding) prev_Col_3 FROM work_table ; Example: Actual

Override COUNT() function

2013-06-28 Thread Peter Marron
Hi, I feel sure that someone has asked for this before, but here goes... In the case where I have the query SELECT COUNT(*) FROM table; There are many cases where I can determine the count immediately. (For example if I have run something like: ANALYZE TABLE tablename

Performance difference between tuning reducer num and partition table

2013-06-28 Thread Felix . 徐
Hi all, Here is the scenario, suppose I have 2 tables A and B, I would like to perform a simple join on them, We can do it like this: INSERT OVERWRITE TABLE C SELECT FROM A JOIN B on A.id=B.id In order to speed up this query since table A and B have lots of data, another approach is :

Re: Hive help on the update

2013-06-28 Thread Stephen Sprague
what version of hive are you running? and show us your attempts - don't be shy! On Fri, Jun 28, 2013 at 5:52 AM, Kumar Chinnakali kumar_chinnak...@infosys.com wrote: Hi Hive Team, ** ** I have Teradata Query as below and my intention is to convert in to Hive Query(HQL). Tried but

RE: Hive help on the update

2013-06-28 Thread Christopher Wirt
To emulate the RANK function you will need a custom UDF Edward Capriolo has a nice one here https://github.com/edwardcapriolo/hive-rank Philip Tromans has another here https://github.com/philiptromans/hive-udf If you're on 0.11 already there is a native version.

Re: Fwd: Need urgent help in hive query

2013-06-28 Thread Michael Malak
Just copy and paste the whole long expressions to their second occurrences. From: dyuti a hadoop.hiv...@gmail.com To: user@hive.apache.org Sent: Friday, June 28, 2013 10:58 AM Subject: Fwd: Need urgent help in hive query Hi Experts, I'm trying with the

Re: Fwd: Need urgent help in hive query

2013-06-28 Thread dyuti a
Hi Michael, Thanks for your help, is there any other possible options apart from this. On Fri, Jun 28, 2013 at 10:33 PM, Michael Malak michaelma...@yahoo.comwrote: Just copy and paste the whole long expressions to their second occurrences. -- *From:* dyuti a

Build hadoop in eclipse.

2013-06-28 Thread Bharati Adkar
Hi Folks, I did not have success using http://wiki.apache.org/hadoop/EclipseEnvironment . I followed the tutorial http://blog.shiftehfar.org/?p=647 to build hadoop in eclipse. I get this error when I build hadoop-1.0.4 in eclipse juno. Description ResourcePathLocation

Re: Need urgent help in hive query

2013-06-28 Thread Robin Morris
Split up the query – put results of the subquery into a table, run the final query on that, then drop the temporary table. Robin From: dyuti a hadoop.hiv...@gmail.commailto:hadoop.hiv...@gmail.com Reply-To: user@hive.apache.orgmailto:user@hive.apache.org

[ANNOUNCE] July Hive User Group Meetup @ LinkedIn

2013-06-28 Thread Carl Steinbach
The next Bay Area Hive User Group Meetup is happening on Wednesday, July 24th at LinkedIn's offices in Mountain View. The format will be a series of short (15 min) talks preceded by refreshments and networking. Please join me in thanking LinkedIn for providing the meeting space and refreshments.

Re: Need urgent help in hive query

2013-06-28 Thread Robin Morris
It probably won't make a difference to performance — the subqueries will be executed in separate map-reduce jobs, and the output put on disk anyway. First, get it to work; second, optimize. Robin From: dyuti a hadoop.hiv...@gmail.commailto:hadoop.hiv...@gmail.com Reply-To:

Review improvement request: Hive indexing doc

2013-06-28 Thread Lefty Leverenz
The stub of an Indexing user doc in the Hive wiki's Language Manual now includes some simple examples, adapted from the test suite. Would someone who uses Hive indexes please review it and make any necessary corrections additions? For example, I omitted examples of indexes on partitioned

Re: Performance difference between tuning reducer num and partition table

2013-06-28 Thread Felix . 徐
Hi Stephen, My query is actually more complex , hive will generate 2 mapreduces, in the first solution , it runs 17 mappers / 30 reducers and 10 mappers / 30 reducers (reducer num is set manually) in the second solution , it runs 6 mappers / 1 reducer and 4 mappers / 1 reducers for each partition