[ https://issues.apache.org/jira/browse/YARN-2183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14183571#comment-14183571 ]
Karthik Kambatla commented on YARN-2183: ---------------------------------------- Ah, now I get it. I missed the executor serializing the tasks already. I think it is okay to use 2 threads in the executor. Otherwise, we are having to differentiate between scheduled and impromptu cleaner tasks, which is probably an overkill to achieve this. We should probably add a comment to explain the choice of 2 threads, which is "to reduce the chances of running cleaner-tasks back-to-back". > Cleaner service for cache manager > --------------------------------- > > Key: YARN-2183 > URL: https://issues.apache.org/jira/browse/YARN-2183 > Project: Hadoop YARN > Issue Type: Sub-task > Reporter: Chris Trezzo > Assignee: Chris Trezzo > Attachments: YARN-2183-trunk-v1.patch, YARN-2183-trunk-v2.patch, > YARN-2183-trunk-v3.patch, YARN-2183-trunk-v4.patch, YARN-2183-trunk-v5.patch, > YARN-2183-trunk-v6.patch, on-demand-cleaner.patch > > > Implement the cleaner service for the cache manager along with metrics for > the service. This service is responsible for cleaning up old resource > references in the manager and removing stale entries from the cache. -- This message was sent by Atlassian JIRA (v6.3.4#6332)