RE: S3/EMR Hive: Load contents of a single file

2013-03-27 Thread Tony Burton
findings? Tony -Original Message- From: Keith Wiley [mailto:kwi...@keithwiley.com] Sent: 26 March 2013 19:40 To: user@hive.apache.org Subject: Re: S3/EMR Hive: Load contents of a single file Are you sure this is doing what you think it's doing? Since Hive associates tables

RE: S3/EMR Hive: Load contents of a single file

2013-03-27 Thread Tony Burton
/path/to/data/ From: Tony Burton [mailto:tbur...@sportingindex.com] Sent: 27 March 2013 08:46 To: 'user@hive.apache.org' Subject: RE: S3/EMR Hive: Load contents of a single file Thanks for the reply Keith. you could have dispensed with the additional alter table business and simply created

Re: S3/EMR Hive: Load contents of a single file

2013-03-27 Thread Keith Wiley
Okay, I also saw your previous response which analyzed queries into two tables built around two files in the same directory. I guess I was simply wrong in my understanding that a Hive table is fundamentally associated with a directory instead of a file. Turns out, it be can either one. A

RE: S3/EMR Hive: Load contents of a single file

2013-03-27 Thread Tony Burton
No problem Keith - it was a worthwhile exercise for me to go back and double check everything was working as expected. -Original Message- From: Keith Wiley [mailto:kwi...@keithwiley.com] Sent: 27 March 2013 17:03 To: user@hive.apache.org Subject: Re: S3/EMR Hive: Load contents

Re: S3/EMR Hive: Load contents of a single file

2013-03-26 Thread Sanjay Subramanian
Hi Tony Can u create the table without any location. After that you could do an ALTER TABLE add location and partition ALTER TABLE myData ADD PARTITION (partitionColumn1='$value1' , partitionColumn2='$value2') LOCATION '/path/to/your/directory/in/hdfs'; An example Without Partitions

RE: S3/EMR Hive: Load contents of a single file

2013-03-26 Thread Tony Burton
March 2013 17:22 To: user@hive.apache.org Subject: Re: S3/EMR Hive: Load contents of a single file Hi Tony Can u create the table without any location. After that you could do an ALTER TABLE add location and partition ALTER TABLE myData ADD PARTITION (partitionColumn1='$value1

Re: S3/EMR Hive: Load contents of a single file

2013-03-26 Thread Ramki Palle
First of all, you cannot point a table to a file. Each table will have a corresponding table. If you want to have all the in the table contains in only one file, simply copy that one file into the directory. The table does not need to know the name of the file. It only matters whether the

Re: S3/EMR Hive: Load contents of a single file

2013-03-26 Thread Keith Wiley
[mailto:sanjay.subraman...@wizecommerce.com] Sent: 26 March 2013 17:22 To: user@hive.apache.org Subject: Re: S3/EMR Hive: Load contents of a single file Hi Tony Can u create the table without any location. After that you could do an ALTER TABLE add location and partition ALTER TABLE myData