Basic question for Create Table and SequenceFile

2010-07-21 Thread Rodriguez, John
I have some Hadoop SequenceFiles that contain key/value pairs of 2 Java classes. The 2 classes each have many Java primitive types. Class A - this is the key Class B - this is the value I need to store this in a table. As I understand it, I have to: 1) Store this in an external t

Is deserialize(Writable field) able to handle any writable class

2010-09-14 Thread Rodriguez, John
I have a custom Writable called DigestWritable. The DigestWritable is stored in a SequenceFile. For illustration, assume it is like this: public class DigestWritable implements org.apache.hadoop.io.Writable { String str; int I; } I started to write a SerDe in order to read the Diges

question about reading a sequencefile

2010-09-14 Thread Rodriguez, John
I have a sequence file that has custom Writables in it. For illustration, assume the value in the SequenceFile is like this: public class DigestWritable implements org.apache.hadoop.io.Writable { String str; int I; } I wrote a SerDe, expecting that the value passed into deseriali

multiple LOCATIONs for external table possible?

2010-09-15 Thread Rodriguez, John
Is it possible to specify multiple LOCATIONs for an external table. For example, if I have sequence files in the following locations: /user/abc /user/def How can I specify 2 or more hdfs_paths in the following. create external table if not exists t8 ( str string, flagWord int )

RE: question about reading a sequencefile

2010-09-15 Thread Rodriguez, John
e sequence file does not need to be specified. From: Rodriguez, John [mailto:jrodrig...@verisign.com] Sent: Tuesday, September 14, 2010 11:08 PM To: hive-user@hadoop.apache.org Subject: question about reading a sequencefile I have a sequence file that has custom Writables in it. For illu

RE: multiple LOCATIONs for external table possible?

2010-09-15 Thread Rodriguez, John
g...@gmail.com] Sent: Wednesday, September 15, 2010 11:58 AM To: hive-user@hadoop.apache.org Subject: Re: multiple LOCATIONs for external table possible? On Wed, Sep 15, 2010 at 12:45 PM, Rodriguez, John wrote: > Is it possible to specify multiple LOCATIONs for an external table. > > >

RE: Is deserialize(Writable field) able to handle any writable class

2010-09-15 Thread Rodriguez, John
TORED AS inputformat 'org.apache.hadoop.mapred.SequenceFileInputFormat' outputformat 'org.apache.hadoop.mapred.SequenceFileOutputFormat' location '/user/jrodrigu/hiveTables'; ALTER TABLE t10 ADD PARTITION (id=1) LOCATION '/user/jrodrigu/hiveTables' PARTITION (id=2) LOCA