Ravindra Dingankar created HDFS-16956:
-----------------------------------------
Summary: Introduce inverse quantiles for metrics where higher
numeric value is better
Key: HDFS-16956
URL: https://issues.apache.org/jira/browse/HDFS-16956
Project: Hadoop HDFS
Issue Type: Bug
Components: datanode, metrics
Affects Versions: 3.3.0, 3.4.0
Reporter: Ravindra Dingankar
Currently quantiles are used for latencies, where lower numeric value is better.
Hence p90 gives us a value val(p90) such that 90% of our sample set has a value
better (lower) than val(p90)
However for metrics such as calculating transfer rates (eg : HDFS-16917 )
higher numeric value is better. Thus for such metrics the current quantiles
dont work.
For these metrics in order for p90 to give a value val(p90) where 90% of the
sample set is better (higher) than val(p90) we need to inverse the selection by
choosing a value at the (100 - 90)th location instead of the usual 90th
position.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
