Haohui Mai created HDFS-5196:
Summary: Provide more snapshot information in WebUI
Key: HDFS-5196
URL: https://issues.apache.org/jira/browse/HDFS-5196
Project: Hadoop HDFS
Issue Type: Improvement
Hi,
Is there any way that we could measure the actual bandwidth used by the
nodes when running MapReduce jobs (For example, when the mappers are
sending data to the reducers during the shuffle phase).
Thanks
--
~Hilfi Alkaff~
vnstat should be able to do this. It has a live mode or can
generate hourly reports much like sar. Google for vnstat to find it.
On 9/13/13, hilfi alkaff hilfialk...@gmail.com wrote:
Hi,
Is there any way that we could measure the actual bandwidth used by the
nodes when running MapReduce
See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/729/
--
[...truncated 7677 lines...]
[ERROR] symbol : class Parser
[ERROR] location: package com.google.protobuf
[ERROR]
See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/729/
###
## LAST 60 LINES OF THE CONSOLE
###
[...truncated 7870 lines...]
[ERROR] location: class
Chris Nauroth created HDFS-5197:
---
Summary: Document dfs.cachereport.intervalMsec in hdfs-default.xml.
Key: HDFS-5197
URL: https://issues.apache.org/jira/browse/HDFS-5197
Project: Hadoop HDFS
Yes, I'm aware of the tool. I was thinking of using this for real-time
network bandwidth management. Using vnstat won't be able to distinguish,
let's say, monitoring bandwidth of multiple maps running on the same
machine.
On Fri, Sep 13, 2013 at 12:26 PM, Chris Embree cemb...@gmail.com wrote:
Brandon Li created HDFS-5199:
Summary: Add more debug trace for NFS READ and WRITE
Key: HDFS-5199
URL: https://issues.apache.org/jira/browse/HDFS-5199
Project: Hadoop HDFS
Issue Type: Sub-task
See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1521/changes
Changes:
[stevel] HADOOP-9350. Hadoop not building against Java7 on OSX
[jing9] HDFS-5192. NameNode may fail to start when
dfs.client.test.drop.namenode.response.number is set. Contributed by Jing Zhao.
[brandonli] HDFS-5067
See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1521/
###
## LAST 60 LINES OF THE CONSOLE
###
[...truncated 11436 lines...]
[INFO] ---
Arpit Agarwal created HDFS-5200:
---
Summary: Datanode should have compatibility mode for sending
combined block reports
Key: HDFS-5200
URL: https://issues.apache.org/jira/browse/HDFS-5200
Project: Hadoop
[
https://issues.apache.org/jira/browse/HDFS-5198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Colin Patrick McCabe resolved HDFS-5198.
Resolution: Fixed
committed to branch
NameNodeRpcServer must not
Colin Patrick McCabe created HDFS-5201:
--
Summary: NativeIO: consolidate getrlimit into
NativeIO#getMemlockLimit
Key: HDFS-5201
URL: https://issues.apache.org/jira/browse/HDFS-5201
Project:
Colin Patrick McCabe created HDFS-5202:
--
Summary: umbrella JIRA for Windows support in HDFS caching
Key: HDFS-5202
URL: https://issues.apache.org/jira/browse/HDFS-5202
Project: Hadoop HDFS
[
https://issues.apache.org/jira/browse/HDFS-5195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Nauroth resolved HDFS-5195.
-
Resolution: Fixed
Fix Version/s: HDFS-4949
Hadoop Flags: Reviewed
I committed this to
Chris Nauroth created HDFS-5203:
---
Summary: Concurrent clients that add a cache directive on the same
path may prematurely uncache from each other.
Key: HDFS-5203
URL: https://issues.apache.org/jira/browse/HDFS-5203
Chris Nauroth created HDFS-5204:
---
Summary: Stub implementation of getrlimit for Windows.
Key: HDFS-5204
URL: https://issues.apache.org/jira/browse/HDFS-5204
Project: Hadoop HDFS
Issue Type:
[
https://issues.apache.org/jira/browse/HDFS-4952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arun C Murthy resolved HDFS-4952.
-
Resolution: Fixed
Duplicate of HDFS-3983
dfs -ls hftp:// fails on secure
Mark Grover created HDFS-5205:
-
Summary: Include NFS jars in the maven assembly
Key: HDFS-5205
URL: https://issues.apache.org/jira/browse/HDFS-5205
Project: Hadoop HDFS
Issue Type: Bug
[
https://issues.apache.org/jira/browse/HDFS-5201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Colin Patrick McCabe resolved HDFS-5201.
Resolution: Fixed
NativeIO: consolidate getrlimit into
Kousuke Saruta created HDFS-5206:
Summary: Some unreferred constants in DFSConfigKeys should be
cleanuped
Key: HDFS-5206
URL: https://issues.apache.org/jira/browse/HDFS-5206
Project: Hadoop HDFS
Junping Du created HDFS-5207:
Summary: In BlockPlacementPolicy, the type of writer in parameters
of chooseTarget() should be updated from DatanodeDescriptor to Node
Key: HDFS-5207
URL:
22 matches
Mail list logo