[jira] [Updated] (HDFS-15899) Remove rpcThreadPool from DeadNodeDetector.

2021-03-17 Thread Jinglun (Jira)


 [ 
https://issues.apache.org/jira/browse/HDFS-15899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jinglun updated HDFS-15899:
---
Attachment: HDFS-15899.002.patch

> Remove rpcThreadPool from DeadNodeDetector.
> ---
>
> Key: HDFS-15899
> URL: https://issues.apache.org/jira/browse/HDFS-15899
> Project: Hadoop HDFS
>  Issue Type: Improvement
>Reporter: Jinglun
>Assignee: Jinglun
>Priority: Major
> Attachments: HDFS-15899.001.patch, HDFS-15899.002.patch
>
>
> The DeadNodeDetector uses a thread pool to do all the probe rpc calls. The 
> purpose is to use the thread pool timeout to monitor the probe timeout. But 
> the rpc client already has a timeout. We can use the rpc client timeout 
> instead of the thread pool timeout and remove the rpcThreadPool.
> The rpcThreadPool introduces additional complexity for probing the DataNode. 
> The probe task waiting in the busy rpcThreadPool might exceed the configured 
> timeout. The probe task will be marked as failed even it is not scheduled.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDFS-15899) Remove rpcThreadPool from DeadNodeDetector.

2021-03-16 Thread Jinglun (Jira)


 [ 
https://issues.apache.org/jira/browse/HDFS-15899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jinglun updated HDFS-15899:
---
Attachment: HDFS-15899.001.patch
Status: Patch Available  (was: Open)

> Remove rpcThreadPool from DeadNodeDetector.
> ---
>
> Key: HDFS-15899
> URL: https://issues.apache.org/jira/browse/HDFS-15899
> Project: Hadoop HDFS
>  Issue Type: Improvement
>Reporter: Jinglun
>Assignee: Jinglun
>Priority: Major
> Attachments: HDFS-15899.001.patch
>
>
> The DeadNodeDetector uses a thread pool to do all the probe rpc calls. The 
> purpose is to use the thread pool timeout to monitor the probe timeout. But 
> the rpc client already has a timeout. We can use the rpc client timeout 
> instead of the thread pool timeout and remove the rpcThreadPool.
> The rpcThreadPool introduces additional complexity for probing the DataNode. 
> The probe task waiting in the busy rpcThreadPool might exceed the configured 
> timeout. The probe task will be marked as failed even it is not scheduled.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org