[ https://issues.apache.org/jira/browse/YARN-6277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15896662#comment-15896662 ]
Feng Yuan edited comment on YARN-6277 at 3/6/17 2:46 AM: --------------------------------------------------------- Hi [~Naganarasimha],Like this: In LocalDirAllocator#confChanged will check local-dir configuration if changed. The RLS will timing change this conf because local disk breakdown. And ShuffleHandler will also use LocalDirAllocator#confChanged because the AllocatorPerContext is singleton, but the conf of shuffleHandler is a clone version,so if the conf changed is nm the sh`s conf is still old. So if shuffleHandler invoke LocalDirAllocator#confChanged once nm will create a FileSystem.. was (Author: feng yuan): Hi [~Naganarasimha],Like this: In LocalDirAllocator#confChanged will check local-dir configuration if changed. The RLS will timing change this conf because local disk breakdown. And ShuffleHandler will also use LocalDirAllocator#confChanged because the AllocatorPerContext is singleton, but the conf of shuffleHandler is a clone version,so if the conf changed is nm the sh`s conf is still old. So if shuffleHandler invoke LocalDirAllocator#confChanged once nm will create a FileSystem.. > Nodemanager heap memory leak > ---------------------------- > > Key: YARN-6277 > URL: https://issues.apache.org/jira/browse/YARN-6277 > Project: Hadoop YARN > Issue Type: Bug > Components: nodemanager > Affects Versions: 3.0.0-alpha2 > Reporter: Feng Yuan > Assignee: Feng Yuan > > Because LocalDirHandlerService@LocalDirAllocator`s mechanism,they will create > massive LocalFileSystem.So lead to heap leak. -- This message was sent by Atlassian JIRA (v6.3.15#6346) --------------------------------------------------------------------- To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org