Fw: need help to write a query that does same as BETWEEN operator

2012-10-11 Thread Praveenkumar Ch
Hi I am new to hive and we have a requirement for converting terra-data queries to hive queries. So i was successful converting them.. so far. but now i have a teradata query that has BETWEEN operator in it, i don't know how to convert using hive equi-joins.. can someone help me?? here is

Re: Any advice about complex Hive tables?

2012-10-11 Thread Sadananda Hegde
Hi Chuck, I have a similar complex hive tables with many fields and some are nested like array of structs (but only upto 3 levels). How did you define you ROW FORMAT as to separate the items? The COLLECTION ITEMS TERMINATED BY clause works only for the first level.How did you handle level 2 , 3, e

Re: View Partition Pruning not Occurring during transform

2012-10-11 Thread John Omernik
I did try nesting, the problem is that I am trying to do it in a view and I think something gets lost in translation... On Thu, Oct 11, 2012 at 8:32 AM, Edward Capriolo wrote: > Have you considered rewriting the query using nested from clauses. > Generally if hive is not 'pushing down' as you wou

Re: Need Help in Hive storage format

2012-10-11 Thread Bejoy KS
Hi Yogesh. It should be a simple delimited file with ^A character as the field delimiter. Regards Bejoy KS Sent from handheld, please excuse typos. -Original Message- From: yogesh dhari Date: Thu, 11 Oct 2012 23:18:35 To: hive request Reply-To: user@hive.apache.org Subject: Need Help

Need Help in Hive storage format

2012-10-11 Thread yogesh dhari
Hi all, If we run this query insert overwrite local directory '/home/yogesh/Downloads/demoyy' select * from NYSE_LOCAL; { ( describe NYSE_LOCAL ; exchangestring symbolstring ddatestring openfloat highfloat lowfloat ) } ls /home/yogesh/Downloa

Re: View Partition Pruning not Occurring during transform

2012-10-11 Thread Edward Capriolo
Have you considered rewriting the query using nested from clauses. Generally if hive is not 'pushing down' as you would assume nesting froms make the query happen in a specific way. On Wednesday, October 10, 2012, John Omernik wrote: > Agreed. That's the conclusion we came to as well. So it's les

Re: Book 'Programming Hive' from O'Reilly now available!

2012-10-11 Thread John Omernik
Read the book cover to cover. I feel like so many different areas have been filled in with my Hive knowledge. WONDERFUL book. One question: With RCFile, does Block compression with GZIP work like SequenceFiles where by using RCFILE + BLOCK + GZIP you actually get some of the benefits of splitabl