[ 
https://issues.apache.org/jira/browse/HDFS-15618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17211046#comment-17211046
 ] 

Ahmed Hussein commented on HDFS-15618:
--------------------------------------

I added a configuration key {{dfs.block.scanner.volume.join.timeout.ms}} that 
controls the duration the thread times out waiting to join on a 
{{VolumeScanner}} thread. This value is only used within 
{{BlockScanner.removeAllVolumeScanners()}}.
This parameter can be used to switch between "fast mode" vs "slow mode".
A small value guarantees that the {{Datanode}} will proceed to shutdown without 
waiting for the {{VolumeScanner}} to finish.

> Improve datanode shutdown latency
> ---------------------------------
>
>                 Key: HDFS-15618
>                 URL: https://issues.apache.org/jira/browse/HDFS-15618
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: datanode
>            Reporter: Ahmed Hussein
>            Assignee: Ahmed Hussein
>            Priority: Major
>         Attachments: HDFS-15618.001.patch
>
>
> The shutdown of Datanode is a very long latency. A block scanner waits for 5 
> minutes to join on each VolumeScanner thread.
> Since the scanners are daemon threads and do not alter the block content, it 
> is safe to ignore such conditions on shutdown of Datanode.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org

Reply via email to