Build failed in Jenkins: Hadoop-Common-trunk #985

2013-12-18 Thread Apache Jenkins Server
See Changes: [szetszwo] HDFS-5674. Editlog code cleanup: remove @SuppressWarnings("deprecation") in FSEditLogOp; change FSEditLogOpCodes.fromByte(..) to be more efficient; and change Some fields in FSEditLog to final. [vinodkv] M

[jira] [Resolved] (HADOOP-9079) LocalDirAllocator throws ArithmeticException

2013-12-18 Thread Jimmy Xiang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-9079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jimmy Xiang resolved HADOOP-9079. - Resolution: Duplicate > LocalDirAllocator throws ArithmeticException > -

Regarding moving specific blocks of data in HDFS

2013-12-18 Thread Karthiek C
Hi all, I am working on a research project where we are looking at algorithms to "optimally" distribute data blocks in HDFS nodes. The definition of what is optimal is omitted for brevity. I want to move specific blocks of a file that is *already* in HDFS. I am able to achieve it using data trans

Re: Regarding moving specific blocks of data in HDFS

2013-12-18 Thread Andrew Wang
Hi Karthiek, I haven't checked 1.0.4, but in 2.2.0 and onwards, there's this setting you can tweak up: dfs.datanode.balance.bandwidthPerSec By default, it's set to just 1MB/s, which is pretty slow. Again at least in 2.2.0, there's also `hdfs dfsadmin -setBalancerBandwidth` which can be used to a

Re: Regarding moving specific blocks of data in HDFS

2013-12-18 Thread Karthiek C
Hi Andrew, Thank you for the quick response. I changed the bandwidth using "hadoop dfsadmin -setBalancerBandwidth" command and it works like a charm! Time to transfer data is now proportional to the bandwidth I set. Thanks again! Best, Karthiek On Wed, Dec 18, 2013 at 6:23 PM, Andrew Wang wrot

[jira] [Created] (HADOOP-10175) Har files system authority should preserve userinfo

2013-12-18 Thread Chuan Liu (JIRA)
Chuan Liu created HADOOP-10175: -- Summary: Har files system authority should preserve userinfo Key: HADOOP-10175 URL: https://issues.apache.org/jira/browse/HADOOP-10175 Project: Hadoop Common Iss