ailed.task.files=true or
>> keep.task.files.pattern= prevents CleanupQueue from getting
>> called which seems to solve my issues. You get junk left in .staging but
>> that can be dealt with.
>>
>> ** **
>>
>> -Marcin
>>
>> ** **
>&g
*Sent:* Tuesday, April 16, 2013 1:47 PM
> *To:* user@hadoop.apache.org
> *Subject:* Jobtracker memory issues due to FileSystem$Cache
>
> ** **
>
> We’ve recently run into jobtracker memory issues on our new hadoop
> cluster. A heap dump shows that there are thousands of cop
]
Sent: Tuesday, April 16, 2013 1:47 PM
To: user@hadoop.apache.org
Subject: Jobtracker memory issues due to FileSystem$Cache
We've recently run into jobtracker memory issues on our new hadoop cluster. A
heap dump shows that there are thousands of copies of DistributedFileSystem
kept in Fil
We've recently run into jobtracker memory issues on our new hadoop cluster. A
heap dump shows that there are thousands of copies of DistributedFileSystem
kept in FileSystem$Cache, a bit over one for each job run on the cluster and
their jobconf objects support this view. I believe these are crea
