Connection Refused error on using hive on Amazon EC2 cluster

2009-07-17 Thread Gaurav Chandalia
Hi, I am using EC2 to start a hadoop cluster (cloudera's distribution) and setup hive on it (specifically, the hive client is on the master/jobtracker). I am using the latest version of hive (with hadoop 0.18.3) and have setup a mysql metastore on an EBS mount for persistence. The HDFS is also per

Re: Error in running group-by and join hive query...

2009-07-17 Thread Eva Tse
Ashish, it is in the attached file. Thanks, Eva. On 7/17/09 1:27 PM, "Ashish Thusoo" wrote: > Looks like pathToPartitionInfo array did not get populated in your case. > > Can you also send the output of > > explain extended > > That will tell us the value of pathToPartitionInfo. > > A

RE: Error in running group-by and join hive query...

2009-07-17 Thread Ashish Thusoo
Looks like pathToPartitionInfo array did not get populated in your case. Can you also send the output of explain extended That will tell us the value of pathToPartitionInfo. Ashish From: Eva Tse [mailto:e...@netflix.com] Sent: Friday, July 17, 2009 12:24 PM To

RE: Creating a UDF (was Hive SerDe?)

2009-07-17 Thread Ashish Thusoo
You should try it. Eva though mentioned that there was something wrong with group by and joins in the trunk but we should be able to figure that out if that is a problem soon. We have already deployed the trunk to our adhoc users within FB so it should be stable enough. Ashish

Re: Error in running group-by and join hive query...

2009-07-17 Thread Eva Tse
I believe this is the relevant section. Please let me know if we need add¹l info. Thanks, Eva. 2009-07-17 13:59:30,953 ERROR ql.Driver (SessionState.java:printError(279)) - FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.ExecDriver 2009-07-17 15:16:00,718 ERROR JPOX.Plu

RE: create tables question

2009-07-17 Thread Ashish Thusoo
Are you running the HiveServer? What have you configured the metastore variable to in hive-site.xml? Ashish From: chen keven [mailto:cke...@gmail.com] Sent: Friday, July 17, 2009 10:49 AM To: hive-user@hadoop.apache.org Subject: Fwd: create tables question I'm

RE: Error in running group-by and join hive query...

2009-07-17 Thread Ashish Thusoo
what does /tmp//hive.log contain? Ashish From: Eva Tse [mailto:e...@netflix.com] Sent: Friday, July 17, 2009 11:07 AM To: hive-user@hadoop.apache.org Subject: Error in running group-by and join hive query... Hive version: r786648 w/ HIVE-487 2nd patch. However,

Re: create tables question

2009-07-17 Thread Prasad Chakka
It may be because you may be using the default config which creates metadata in a directory relative to current directory. Check whether you have multiple 'metastore_db' directories. If so then try to set up a common metastore by changing config (conf/hive-default.xml --> conf/hive-site.xml) or

Error in running group-by and join hive query...

2009-07-17 Thread Eva Tse
Hive version: r786648 w/ HIVE-487 2nd patch. However, it is working on Hive 0.3. Thanks, Eva. Running the script in this email gives the following errors: Hive history file=/tmp/dataeng/hive_job_log_dataeng_200907171359_1511035858.txt OK Time taken: 3.419 seconds OK Time taken: 0.211 seconds

Fwd: create tables question

2009-07-17 Thread chen keven
I'm trying to create tables pragmatically using JDBC. However, I can't really see the table I created from the hive shell. What's worse, when i access hive shell from different directories, i see different tables in the database. Is any setting i need to configure? Thanks in advance. -- Thank y

RE: NPEs when using map-side join

2009-07-17 Thread Namit Jain
This should be fixed as part of https://issues.apache.org/jira/browse/HIVE-405 Can you try in the trunk version and let us know if you still see any problems ? From: Jason Michael [mailto:jmich...@videoegg.com] Sent: Tuesday, July 14, 2009 3:01 PM To: hive mailing list Subject: NPEs when usi

Re: Selecting data based on the clustered columns

2009-07-17 Thread Deepak A
That would be great.!Thanks a lot. -Deepak On Fri, Jul 17, 2009 at 11:46 AM, Prasad Chakka wrote: > Yeah, we know of this optimization and and will add it as we start > optimizing filter queries using indexes. > > -- > *From: *Namit Jain > *Reply-To: * > *Date: *Thu