[ 
https://issues.apache.org/jira/browse/HDFS-14403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16821375#comment-16821375
 ] 

Chao Sun edited comment on HDFS-14403 at 4/18/19 6:15 PM:
----------------------------------------------------------

Very much looking forward to this feature as it could help a lot to our 
clusters as well. Will take a look at [~cgregori]'s new patch as well.

Looking at [~daryn]'s patch, I'm wondering whether it makes sense to separate 
the work into two parts: 1) adding more detailed RPC processing timing metrics 
(e.g., enqueue, queue, lock free/hold/read/write, etc) which can help to better 
understand RPC lifetime, and 2) cost-based fair call queue based on 1).


was (Author: csun):
Very much looking forward to this feature as it could help a lot to our 
clusters as well. Will take a look at [~cgregori]'s new patch as well.

Looking at [~daryn]'s patch, I'm wondering whether it makes sense to separate 
the work into two parts: 1) add detailed RPC processing timing metrics (e.g., 
enqueue, queue, lock free/hold/read/write, etc), and 2) cost-based fair call 
queue. 

> Cost-Based RPC FairCallQueue
> ----------------------------
>
>                 Key: HDFS-14403
>                 URL: https://issues.apache.org/jira/browse/HDFS-14403
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: ipc, namenode
>            Reporter: Erik Krogen
>            Assignee: Christopher Gregorian
>            Priority: Major
>              Labels: qos, rpc
>         Attachments: CostBasedFairCallQueueDesign_v0.pdf, 
> HDFS-14403.001.patch, HDFS-14403.002.patch, HDFS-14403.003.patch, 
> HDFS-14403.004.patch, HDFS-14403.branch-2.8.patch
>
>
> HADOOP-15016 initially described extensions to the Hadoop FairCallQueue 
> encompassing both cost-based analysis of incoming RPCs, as well as support 
> for reservations of RPC capacity for system/platform users. This JIRA intends 
> to track the former, as HADOOP-15016 was repurposed to more specifically 
> focus on the reservation portion of the work.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org

Reply via email to