Cannot use explode with sub queries?

2011-11-03 Thread Vijay
I can't seem to use explode with subqueries. This is what I'm trying: select user, requestid from ( select user, requestid_list from logs where ... ) t lateral view explode(requestid_list) as requestid; I tried a few similar variations but none of them seem to work. I can't find any examples

The Elephant in the Room: You are invited

2011-11-03 Thread Milind.Bhandarkar
Hello Hadoopers ! Are you attending Hadoop World in New York on November 8? This is your invitation to join Greenplum and other industry innovators in celebrating the Hadoop Movement. The Elephant in the Room - A Hadoop World Party Extravaganza! Enjoy bowling, shooting pool, and a few surprises

Re: Difference between Apache Hadoop and Cloudera Hadoop

2011-11-03 Thread Bejoy Ks
Hi Ravindra     Adding cdh-user goups in cc.  You are also copied as you may not have registered with cdh groups.     I'm sharing you my experience with CDH.(it is jpurely a personal recommendation) CDH source code is basically from the apache svn itself,but not mirrored to apache releases

Difference between Apache Hadoop and Cloudera Hadoop

2011-11-03 Thread Agarwal, Ravindra (ASG)
(a)I would like to know what are the key differences between Hadoop distributed by Apache and Hadoop distributed by Cloudera (i.e. CDH). (b) When should one go for Apache's distribution of Hadoop and when for Cloudera (CDH)? Regards, Ravi Confidential: This electronic message and all conte

Hive merge map reduce files - need help in understanding the parameters and full flow

2011-11-03 Thread Bejoy Ks
Hi Experts    I'm struck with a problem with merging the smaller output files produced as part of hive jobs. To test  merging I did set the following parameters set hive.merge.mapredfiles=true; set hive.merge.size.per.task=800; set hive.merge.smallfiles.avgsize=200; My understanding

Re: High number of input files problems

2011-11-03 Thread Florin Diaconeasa
:( Upgrading is not really an option at this point. However, any idea if there was any bug like this solved? Maybe i could port the patch to the 0.6 version. On 2 November 2011 04:16, Steven Wong wrote: > I suspect very few people are still using Hive 0.6 or older. Try upgrading. > > > ** *