Re: Error in FileSystem.get()

2009-10-15 Thread Aaron Kimball
Bhupesh: If you use FileSystem.newInstance(), does that return the correct object type? This sidesteps CACHE. - A On Thu, Oct 15, 2009 at 3:07 PM, Bhupesh Bansal wrote: > This code is not map/reduce code and run only on single machine and > Also each node prints the right value for "fs.default.na

Re: Error in FileSystem.get()

2009-10-15 Thread Bhupesh Bansal
This code is not map/reduce code and run only on single machine and Also each node prints the right value for "fs.default.name" so it is Reading the right configuration file too .. The issue looks like use of CACHE in filesystem and someplace my code is setting up a wrong value If that is possible.

Re: Error in FileSystem.get()

2009-10-15 Thread Ashutosh Chauhan
Each node reads its own conf files (mapred-site.xml, hdfs-site.xml etc.) Make sure your configs are consistent on all nodes across entire cluster and are pointing to correct fs. Hope it helps, Ashutosh On Thu, Oct 15, 2009 at 16:36, Bhupesh Bansal wrote: > Hey Folks, > > I am seeing a very weir

Error in FileSystem.get()

2009-10-15 Thread Bhupesh Bansal
Hey Folks, I am seeing a very weird problem in FileSystem.get(Configuration). I want to get a FileSystem given the configuration, so I am using Configuration conf = new Configuration(); _fs = FileSystem.get(conf); The problem is I am getting LocalFileSystem on some machines and Di