[jira] [Created] (HDFS-5196) Provide more snapshot information in WebUI

2013-09-13 Thread Haohui Mai (JIRA)
Haohui Mai created HDFS-5196: Summary: Provide more snapshot information in WebUI Key: HDFS-5196 URL: https://issues.apache.org/jira/browse/HDFS-5196 Project: Hadoop HDFS Issue Type: Improvement

Measuring bandwidth in 2.1.x

2013-09-13 Thread hilfi alkaff
Hi, Is there any way that we could measure the actual bandwidth used by the nodes when running MapReduce jobs (For example, when the mappers are sending data to the reducers during the shuffle phase). Thanks -- ~Hilfi Alkaff~

Re: Measuring bandwidth in 2.1.x

2013-09-13 Thread Chris Embree
vnstat should be able to do this. It has a live mode or can generate hourly reports much like sar. Google for vnstat to find it. On 9/13/13, hilfi alkaff hilfialk...@gmail.com wrote: Hi, Is there any way that we could measure the actual bandwidth used by the nodes when running MapReduce

Build failed in Jenkins: Hadoop-Hdfs-0.23-Build #729

2013-09-13 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/729/ -- [...truncated 7677 lines...] [ERROR] symbol : class Parser [ERROR] location: package com.google.protobuf [ERROR]

Hadoop-Hdfs-0.23-Build - Build # 729 - Still Failing

2013-09-13 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/729/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 7870 lines...] [ERROR] location: class

[jira] [Created] (HDFS-5197) Document dfs.cachereport.intervalMsec in hdfs-default.xml.

2013-09-13 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-5197: --- Summary: Document dfs.cachereport.intervalMsec in hdfs-default.xml. Key: HDFS-5197 URL: https://issues.apache.org/jira/browse/HDFS-5197 Project: Hadoop HDFS

Re: Measuring bandwidth in 2.1.x

2013-09-13 Thread hilfi alkaff
Yes, I'm aware of the tool. I was thinking of using this for real-time network bandwidth management. Using vnstat won't be able to distinguish, let's say, monitoring bandwidth of multiple maps running on the same machine. On Fri, Sep 13, 2013 at 12:26 PM, Chris Embree cemb...@gmail.com wrote:

[jira] [Created] (HDFS-5199) Add more debug trace for NFS READ and WRITE

2013-09-13 Thread Brandon Li (JIRA)
Brandon Li created HDFS-5199: Summary: Add more debug trace for NFS READ and WRITE Key: HDFS-5199 URL: https://issues.apache.org/jira/browse/HDFS-5199 Project: Hadoop HDFS Issue Type: Sub-task

Build failed in Jenkins: Hadoop-Hdfs-trunk #1521

2013-09-13 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1521/changes Changes: [stevel] HADOOP-9350. Hadoop not building against Java7 on OSX [jing9] HDFS-5192. NameNode may fail to start when dfs.client.test.drop.namenode.response.number is set. Contributed by Jing Zhao. [brandonli] HDFS-5067

Hadoop-Hdfs-trunk - Build # 1521 - Failure

2013-09-13 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1521/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 11436 lines...] [INFO] ---

[jira] [Created] (HDFS-5200) Datanode should have compatibility mode for sending combined block reports

2013-09-13 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-5200: --- Summary: Datanode should have compatibility mode for sending combined block reports Key: HDFS-5200 URL: https://issues.apache.org/jira/browse/HDFS-5200 Project: Hadoop

[jira] [Resolved] (HDFS-5198) NameNodeRpcServer must not send back DNA_FINALIZE in reply to a cache report

2013-09-13 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HDFS-5198. Resolution: Fixed committed to branch NameNodeRpcServer must not

[jira] [Created] (HDFS-5201) NativeIO: consolidate getrlimit into NativeIO#getMemlockLimit

2013-09-13 Thread Colin Patrick McCabe (JIRA)
Colin Patrick McCabe created HDFS-5201: -- Summary: NativeIO: consolidate getrlimit into NativeIO#getMemlockLimit Key: HDFS-5201 URL: https://issues.apache.org/jira/browse/HDFS-5201 Project:

[jira] [Created] (HDFS-5202) umbrella JIRA for Windows support in HDFS caching

2013-09-13 Thread Colin Patrick McCabe (JIRA)
Colin Patrick McCabe created HDFS-5202: -- Summary: umbrella JIRA for Windows support in HDFS caching Key: HDFS-5202 URL: https://issues.apache.org/jira/browse/HDFS-5202 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-5195) Prevent passing null pointer to mlock and munlock.

2013-09-13 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved HDFS-5195. - Resolution: Fixed Fix Version/s: HDFS-4949 Hadoop Flags: Reviewed I committed this to

[jira] [Created] (HDFS-5203) Concurrent clients that add a cache directive on the same path may prematurely uncache from each other.

2013-09-13 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-5203: --- Summary: Concurrent clients that add a cache directive on the same path may prematurely uncache from each other. Key: HDFS-5203 URL: https://issues.apache.org/jira/browse/HDFS-5203

[jira] [Created] (HDFS-5204) Stub implementation of getrlimit for Windows.

2013-09-13 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-5204: --- Summary: Stub implementation of getrlimit for Windows. Key: HDFS-5204 URL: https://issues.apache.org/jira/browse/HDFS-5204 Project: Hadoop HDFS Issue Type:

[jira] [Resolved] (HDFS-4952) dfs -ls hftp:// fails on secure hadoop2 cluster

2013-09-13 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy resolved HDFS-4952. - Resolution: Fixed Duplicate of HDFS-3983 dfs -ls hftp:// fails on secure

[jira] [Created] (HDFS-5205) Include NFS jars in the maven assembly

2013-09-13 Thread Mark Grover (JIRA)
Mark Grover created HDFS-5205: - Summary: Include NFS jars in the maven assembly Key: HDFS-5205 URL: https://issues.apache.org/jira/browse/HDFS-5205 Project: Hadoop HDFS Issue Type: Bug

[jira] [Resolved] (HDFS-5201) NativeIO: consolidate getrlimit into NativeIO#getMemlockLimit

2013-09-13 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HDFS-5201. Resolution: Fixed NativeIO: consolidate getrlimit into

[jira] [Created] (HDFS-5206) Some unreferred constants in DFSConfigKeys should be cleanuped

2013-09-13 Thread Kousuke Saruta (JIRA)
Kousuke Saruta created HDFS-5206: Summary: Some unreferred constants in DFSConfigKeys should be cleanuped Key: HDFS-5206 URL: https://issues.apache.org/jira/browse/HDFS-5206 Project: Hadoop HDFS

[jira] [Created] (HDFS-5207) In BlockPlacementPolicy, the type of writer in parameters of chooseTarget() should be updated from DatanodeDescriptor to Node

2013-09-13 Thread Junping Du (JIRA)
Junping Du created HDFS-5207: Summary: In BlockPlacementPolicy, the type of writer in parameters of chooseTarget() should be updated from DatanodeDescriptor to Node Key: HDFS-5207 URL: