On 29/09/2011 18:02, Joey Echeverria wrote:
Do you close your FileSystem instances at all? IIRC, the FileSystem instance you use is a singleton and if you close it once, it's closed for everybody. My guess is you close it in your cleanup method and you have JVM reuse turned on.
I've hit this in the past. In 0.21+ you can ask for a new instance explicity.
For 0.20.20x, set "fs.hdfs.impl.disable.cache" to true in the conf, and new instances don't get cached.
