[
https://issues.apache.org/jira/browse/HDFS-15711?focusedWorklogId=521949&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-521949
]
ASF GitHub Bot logged work on HDFS-15711:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 09/Dec/20 00:12
Start Date: 09/Dec/20 00:12
Worklog Time Spent: 10m
Work Description: amahussein commented on a change in pull request #2521:
URL: https://github.com/apache/hadoop/pull/2521#discussion_r538905542
##########
File path:
hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/fs/http/server/TestHttpFSServer.java
##########
@@ -120,6 +122,25 @@
*/
public class TestHttpFSServer extends HFSTestCase {
+ /**
+ * define metric getters for unit tests.
+ */
+ private static Callable<Long> defaultEntryMetricGetter = () -> 0L;
+ private static Callable<Long> defaultExitMetricGetter = () -> 1L;
+ private static HashMap<String, Callable<Long>> metricsGetter =
+ new HashMap<String, Callable<Long>>() {
+ {
+ put("LISTSTATUS",
+ () -> HttpFSServerWebApp.get().getMetrics().getOpsListing());
+ put("MKDIRS",
+ () -> HttpFSServerWebApp.get().getMetrics().getOpsMkdir());
+ put("GETFILESTATUS",
+ () -> HttpFSServerWebApp.get().getMetrics().getOpsStat());
+ }
+ };
+
Review comment:
I found that the best way to check the metrics is to inject code in
`getStatus`. This reduced the diff significantly. getStatus() accepts the cmd
as a string, so adding if-then-else for each cmd will be more difficult to
maintain. Finally, it is easier to add a command to the metricsGetter to extend
the set of tests.
Also, the default callable saves NPE in case the command is not mapped to a
metricGetter.
##########
File path:
hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/fs/http/server/TestHttpFSServer.java
##########
@@ -542,8 +572,12 @@ private void createDirWithHttp(String dirname, String
perms,
conn.setRequestMethod("PUT");
conn.connect();
Assert.assertEquals(HttpURLConnection.HTTP_OK, conn.getResponseCode());
+ Assert.assertEquals(1 + oldOpsMkdir,
+ HttpFSServerWebApp.get().getMetrics().getOpsMkdir());
}
+
+
Review comment:
done
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
-------------------
Worklog Id: (was: 521949)
Time Spent: 1h (was: 50m)
> Add Metrics to HttpFS Server
> ----------------------------
>
> Key: HDFS-15711
> URL: https://issues.apache.org/jira/browse/HDFS-15711
> Project: Hadoop HDFS
> Issue Type: New Feature
> Components: httpfs
> Reporter: Ahmed Hussein
> Assignee: Ahmed Hussein
> Priority: Major
> Labels: pull-request-available
> Time Spent: 1h
> Remaining Estimate: 0h
>
> Currently HttpFS Server does not have any metrics.
> [~kihwal] has implemented serverMetrics for HttpFs on our internal grid.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
