Re: how to parse a sequence file in my local filesystem

2011-06-28 Thread Joey Echeverria
If you want to write your own parser, you can always use the SequenceFile.Reader[1] class. That will let you scan through all of the key, value pairs in the file and perform whatever operation you need. The SequenceFile.Reader uses the Hadoop APIs for reading files. For a local file, that means you

Re: how to parse a sequence file in my local filesystem

2011-06-27 Thread ling cao
Maybe i didn't describe my question clearly, i know the hadoop fs command can do it but i need to parse it without hdfs environment, the file is on my disk(for example: D://test.seq), and how to write a java class to parse it? 2011/6/27 Joey Echeverria > If the data is text you can always prin

Re: how to parse a sequence file in my local filesystem

2011-06-27 Thread Joey Echeverria
If the data is text you can always print out the sequence file using this command: hadoop fs -text file:///my/directory/file.seq This will parse the sequence file, convert each key and value to a string and print it to stdout. Notice the file:// in the path, that will cause hadoop to access the l

how to parse a sequence file in my local filesystem

2011-06-27 Thread ling cao
hi i have a small sequence file (about 1k) which is produced by a hive job, and i need to parse it in my local filesystem,not in hdfs is there any easy way to do it ? Thanks