Re: HDFS files naming convention

2009-04-25 Thread Pankil Doshi
009 at 10:57 AM, Aaron Kimball > wrote: > > > I think you can do this with MultiFileOutputFormat; specifically override > > the getLeafFileName() method. > > - Aaron > > > > > > On Sat, Apr 25, 2009 at 4:29 AM, Parul Kudtarkar < > > parul_kudtar

Re: HDFS files naming convention

2009-04-24 Thread Aaron Kimball
gt; On Sat, Apr 25, 2009 at 4:29 AM, Parul Kudtarkar < > parul_kudtar...@hms.harvard.edu> wrote: > >> >> The HDFS files generated after mapreduce run are strored in HDFS as >> part-0 and so on.part-n >> >> Is it possible to name these output files

Re: HDFS files naming convention

2009-04-24 Thread Aaron Kimball
I think you can do this with MultiFileOutputFormat; specifically override the getLeafFileName() method. - Aaron On Sat, Apr 25, 2009 at 4:29 AM, Parul Kudtarkar < parul_kudtar...@hms.harvard.edu> wrote: > > The HDFS files generated after mapreduce run are strored in HDFS as > pa

HDFS files naming convention

2009-04-24 Thread Parul Kudtarkar
The HDFS files generated after mapreduce run are strored in HDFS as part-0 and so on.part-n Is it possible to name these output files stored in HDFS as per my own convention i.e. I would like to name these files my_file_1 and so onmy_files_n Please advice how this can be

Re: HDFS files

2008-07-09 Thread Bryan Duxbury
Unfortunately you have to use FSDataInputStream, not FileInputStream, to interact with HDFS files. Does this image processing code have a constructor that accepts InputStreams? If so, just pass that. -Bryan On Jul 8, 2008, at 10:48 AM, Kayla Jay wrote: Hi I am using code for a reader

Re: HDFS files

2008-07-08 Thread Kayla Jay
: core-user@hadoop.apache.org Sent: Tuesday, July 8, 2008 1:48:30 PM Subject: HDFS files Hi I am using code for a reader that must pass in a filename in order to create a FileInputStream instance that uses the getChannel to read the file. I have to use FileInputStream because it is processing

HDFS files

2008-07-08 Thread Kayla Jay
Hi I am using code for a reader that must pass in a filename in order to create a FileInputStream instance that uses the getChannel to read the file. I have to use FileInputStream because it is processing image files and it's faster than InputStream. I can run this code locally, but when I mo