[ 
https://issues.apache.org/jira/browse/YARN-2183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14183571#comment-14183571
 ] 

Karthik Kambatla commented on YARN-2183:
----------------------------------------

Ah, now I get it. I missed the executor serializing the tasks already. I think 
it is okay to use 2 threads in the executor. Otherwise, we are having to 
differentiate between scheduled and impromptu cleaner tasks, which is probably 
an overkill to achieve this.

We should probably add a comment to explain the choice of 2 threads, which is 
"to reduce the chances of running cleaner-tasks back-to-back". 

> Cleaner service for cache manager
> ---------------------------------
>
>                 Key: YARN-2183
>                 URL: https://issues.apache.org/jira/browse/YARN-2183
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>            Reporter: Chris Trezzo
>            Assignee: Chris Trezzo
>         Attachments: YARN-2183-trunk-v1.patch, YARN-2183-trunk-v2.patch, 
> YARN-2183-trunk-v3.patch, YARN-2183-trunk-v4.patch, YARN-2183-trunk-v5.patch, 
> YARN-2183-trunk-v6.patch, on-demand-cleaner.patch
>
>
> Implement the cleaner service for the cache manager along with metrics for 
> the service. This service is responsible for cleaning up old resource 
> references in the manager and removing stale entries from the cache.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to