HDFS-11864. Document Metrics to track usage of memory for writes. Contributed by Yiqun Lin.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/52661e09 Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/52661e09 Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/52661e09 Branch: refs/heads/YARN-1011 Commit: 52661e0912a79d1e851afc2b46c941ce952ca63f Parents: 1b5451b Author: Brahma Reddy Battula <bra...@apache.org> Authored: Tue May 23 23:52:42 2017 +0800 Committer: Brahma Reddy Battula <bra...@apache.org> Committed: Tue May 23 23:52:42 2017 +0800 ---------------------------------------------------------------------- .../hadoop-common/src/site/markdown/Metrics.md | 15 +++++++++++++++ 1 file changed, 15 insertions(+) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/hadoop/blob/52661e09/hadoop-common-project/hadoop-common/src/site/markdown/Metrics.md ---------------------------------------------------------------------- diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/Metrics.md b/hadoop-common-project/hadoop-common/src/site/markdown/Metrics.md index bd44f74..a14c86d 100644 --- a/hadoop-common-project/hadoop-common/src/site/markdown/Metrics.md +++ b/hadoop-common-project/hadoop-common/src/site/markdown/Metrics.md @@ -283,6 +283,21 @@ Each metrics record contains tags such as SessionId and Hostname as additional i | `WritesFromLocalClient` | Total number of write operations from local client | | `WritesFromRemoteClient` | Total number of write operations from remote client | | `BlocksGetLocalPathInfo` | Total number of operations to get local path names of blocks | +| `RamDiskBlocksWrite` | Total number of blocks written to memory | +| `RamDiskBlocksWriteFallback` | Total number of blocks written to memory but not satisfied (failed-over to disk) | +| `RamDiskBytesWrite` | Total number of bytes written to memory | +| `RamDiskBlocksReadHits` | Total number of times a block in memory was read | +| `RamDiskBlocksEvicted` | Total number of blocks evicted in memory | +| `RamDiskBlocksEvictedWithoutRead` | Total number of blocks evicted in memory without ever being read from memory | +| `RamDiskBlocksEvictionWindowMsNumOps` | Number of blocks evicted in memory| +| `RamDiskBlocksEvictionWindowMsAvgTime` | Average time of blocks in memory before being evicted in milliseconds | +| `RamDiskBlocksEvictionWindows`*num*`s(50|75|90|95|99)thPercentileLatency` | The 50/75/90/95/99th percentile of latency between memory write and eviction in milliseconds. Percentile measurement is off by default, by watching no intervals. The intervals are specified by `dfs.metrics.percentiles.intervals`. | +| `RamDiskBlocksLazyPersisted` | Total number of blocks written to disk by lazy writer | +| `RamDiskBlocksDeletedBeforeLazyPersisted` | Total number of blocks deleted by application before being persisted to disk | +| `RamDiskBytesLazyPersisted` | Total number of bytes written to disk by lazy writer | +| `RamDiskBlocksLazyPersistWindowMsNumOps` | Number of blocks written to disk by lazy writer | +| `RamDiskBlocksLazyPersistWindowMsAvgTime` | Average time of blocks written to disk by lazy writer in milliseconds | +| `RamDiskBlocksLazyPersistWindows`*num*`s(50|75|90|95|99)thPercentileLatency` | The 50/75/90/95/99th percentile of latency between memory write and disk persist in milliseconds. Percentile measurement is off by default, by watching no intervals. The intervals are specified by `dfs.metrics.percentiles.intervals`. | | `FsyncCount` | Total number of fsync | | `VolumeFailures` | Total number of volume failures occurred | | `ReadBlockOpNumOps` | Total number of read operations | --------------------------------------------------------------------- To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-commits-h...@hadoop.apache.org
