hello,
i have a problem in reading the children of a directory in the
distributed file system of hadoop:
when I read the results of the reduce, I know the output folder (which i
have specified using JobConf), but I don't know the file names inside
it, and i still does not know how to access them using Java code
I have tried this:
Configuration conf = new Configuration();
FileSystem fs = FileSystem.get(conf);
String outputDir = ....
Path inDir = new Path("");
if (!fs.exists(inDir))
throw new Exception("Directory does not exist");
File jInDir = new RawLocalFileSystem().pathToFile(inDir);
String[] files = jInDir.list();
for (int i=0; i<files.length; i++) {
Path inFile = new Path(inDir, files[i]);
but the files array is null, and i get a null pointer exception when
files.length.
any suggestions? I have searched on the internet, wiki and the archive,
but could not find something useful.
thanks for the help
Deyaa