Re: libhdfs installation

Hello Abhishek, You can build libhdfs from source by running mvn with the "native" profile activated, as described in BUILDING.txt here: https://github.com/apache/hadoop/blob/trunk/BUILDING.txt#L187-189 Pasting the content here for convenience: Create binary distribution with native code and w

libhdfs installation

Hi, I am trying to install libhdfs from the source. Can anyone point me to the proper instruction. I am using hadoop 2.3. Regards, Abhishek

[jira] [Created] (HDFS-8202) Improve end to end stirpping file test to add erasure recovering test

Kai Zheng created HDFS-8202: --- Summary: Improve end to end stirpping file test to add erasure recovering test Key: HDFS-8202 URL: https://issues.apache.org/jira/browse/HDFS-8202 Project: Hadoop HDFS

[jira] [Created] (HDFS-8201) Add an end to end test for stripping file writing and reading

Kai Zheng created HDFS-8201: --- Summary: Add an end to end test for stripping file writing and reading Key: HDFS-8201 URL: https://issues.apache.org/jira/browse/HDFS-8201 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-8200) Refactor FSDirStatAndListingOp

Haohui Mai created HDFS-8200: Summary: Refactor FSDirStatAndListingOp Key: HDFS-8200 URL: https://issues.apache.org/jira/browse/HDFS-8200 Project: Hadoop HDFS Issue Type: Improvement

[RESULT][VOTE] Release Apache Hadoop 2.7.0 RC0

With 22 +1s (7 binding), one +0 and no -1s the vote passes. Thanks for everyone who tried the release and voted. I'll push the bits and send out an announcement. Thanks +Vinod On Apr 10, 2015, at 4:44 PM, Vinod Kumar Vavilapalli wrote: > Hi all, > > I've created a release candidate RC0 for A

[jira] [Created] (HDFS-8199) Erasure Coding: System test of creating ECZone and EC files.

Kai Sasaki created HDFS-8199: Summary: Erasure Coding: System test of creating ECZone and EC files. Key: HDFS-8199 URL: https://issues.apache.org/jira/browse/HDFS-8199 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-8198) Erasure Coding: system test of TeraSort

Kai Sasaki created HDFS-8198: Summary: Erasure Coding: system test of TeraSort Key: HDFS-8198 URL: https://issues.apache.org/jira/browse/HDFS-8198 Project: Hadoop HDFS Issue Type: Bug Affects

[jira] [Created] (HDFS-8197) System tests for EC feature

Kai Sasaki created HDFS-8197: Summary: System tests for EC feature Key: HDFS-8197 URL: https://issues.apache.org/jira/browse/HDFS-8197 Project: Hadoop HDFS Issue Type: Sub-task Affects Versio

[jira] [Created] (HDFS-8196) Erasure Coding related information on NameNode UI

Kai Sasaki created HDFS-8196: Summary: Erasure Coding related information on NameNode UI Key: HDFS-8196 URL: https://issues.apache.org/jira/browse/HDFS-8196 Project: Hadoop HDFS Issue Type: Sub-t

[jira] [Created] (HDFS-8195) Erasure coding: Fix file quota change when we complete/commit the striped blocks

Takuya Fukudome created HDFS-8195: - Summary: Erasure coding: Fix file quota change when we complete/commit the striped blocks Key: HDFS-8195 URL: https://issues.apache.org/jira/browse/HDFS-8195 Projec

[jira] [Created] (HDFS-8194) Add administrative tool to be able to examine the NN's view of DN storages

Aaron T. Myers created HDFS-8194: Summary: Add administrative tool to be able to examine the NN's view of DN storages Key: HDFS-8194 URL: https://issues.apache.org/jira/browse/HDFS-8194 Project: Hadoo

[jira] [Created] (HDFS-8193) Add the ability to delay replica deletion for a period of time

Aaron T. Myers created HDFS-8193: Summary: Add the ability to delay replica deletion for a period of time Key: HDFS-8193 URL: https://issues.apache.org/jira/browse/HDFS-8193 Project: Hadoop HDFS

[jira] [Created] (HDFS-8192) Eviction should key off used locked memory instead of ram disk free space

Arpit Agarwal created HDFS-8192: --- Summary: Eviction should key off used locked memory instead of ram disk free space Key: HDFS-8192 URL: https://issues.apache.org/jira/browse/HDFS-8192 Project: Hadoop H

[jira] [Resolved] (HDFS-8190) StripedBlockUtil.getInternalBlockLength may have overflow error

[ https://issues.apache.org/jira/browse/HDFS-8190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-8190. --- Resolution: Fixed Fix Version/s: HDFS-7285 Hadoop Flags: Reviewed Thanks Ji

[jira] [Created] (HDFS-8191) Fix byte to integer casting in SimulatedFSDataset#simulatedByte

Zhe Zhang created HDFS-8191: --- Summary: Fix byte to integer casting in SimulatedFSDataset#simulatedByte Key: HDFS-8191 URL: https://issues.apache.org/jira/browse/HDFS-8191 Project: Hadoop HDFS Issu

[jira] [Created] (HDFS-8190) StripedBlockUtil.getInternalBlockLength may have overflow error

Tsz Wo Nicholas Sze created HDFS-8190: - Summary: StripedBlockUtil.getInternalBlockLength may have overflow error Key: HDFS-8190 URL: https://issues.apache.org/jira/browse/HDFS-8190 Project: Hadoop

[jira] [Resolved] (HDFS-8188) Erasure coding: refactor client-related code to sync with HDFS-8082 and HDFS-8169

[ https://issues.apache.org/jira/browse/HDFS-8188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang resolved HDFS-8188. - Resolution: Fixed Fix Version/s: HDFS-7285 Thanks Nicholas for the prompt feedback! I've committed t

[jira] [Reopened] (HDFS-8162) Stack trace routed to standard out

[ https://issues.apache.org/jira/browse/HDFS-8162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rod reopened HDFS-8162: --- > Stack trace routed to standard out > -- > > Key: HDFS-8162 >

[jira] [Created] (HDFS-8189) ClientProtocol#createErasureCodingZone API was wrongly annotated as Idempotent

Uma Maheswara Rao G created HDFS-8189: - Summary: ClientProtocol#createErasureCodingZone API was wrongly annotated as Idempotent Key: HDFS-8189 URL: https://issues.apache.org/jira/browse/HDFS-8189

Re: How to make MiniDFSCluster available in tests in Hadoop's code base?

Hello, thanks for pointing this out. I added this dependency and it works as I expect it to. > Am 19.04.2015 um 20:02 schrieb Steve Loughran : > > >> On 19 Apr 2015, at 09:21, Jens Rabe wrote: >> >> Hello, >> >> I wanted to write a fix for MAPREDUCE-6320, and for this, I need a mini >> clu

[jira] [Created] (HDFS-8188) Erasure coding: refactor client-related code to sync with HDFS-8082 and HDFS-8169

Zhe Zhang created HDFS-8188: --- Summary: Erasure coding: refactor client-related code to sync with HDFS-8082 and HDFS-8169 Key: HDFS-8188 URL: https://issues.apache.org/jira/browse/HDFS-8188 Project: Hadoop H

Hadoop-Hdfs-trunk-Java8 - Build # 160 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/160/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 5185 lines...] main: [mkdir] Created dir: /hom

Build failed in Jenkins: Hadoop-Hdfs-trunk-Java8 #160

See Changes: [arp] HDFS-8152. Refactoring of lazy persist storage cases. (Arpit Agarwal) [wheat9] HDFS-8169. Move LocatedBlocks and related classes to hdfs-client. Contributed by Haohui Mai. [vinayakumarb] HDFS-8173. NPE throw

Build failed in Jenkins: Hadoop-Hdfs-trunk #2101

See Changes: [arp] HDFS-8152. Refactoring of lazy persist storage cases. (Arpit Agarwal) [wheat9] HDFS-8169. Move LocatedBlocks and related classes to hdfs-client. Contributed by Haohui Mai. [vinayakumarb] HDFS-8173. NPE thrown at

Hadoop-Hdfs-trunk - Build # 2101 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2101/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 5184 lines...] main: [mkdir] Created dir: /home/jen

[jira] [Resolved] (HDFS-8181) createErasureCodingZone sets retryCache state as false always

[ https://issues.apache.org/jira/browse/HDFS-8181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B resolved HDFS-8181. - Resolution: Fixed Fix Version/s: HDFS-7285 Hadoop Flags: Reviewed > createErasureCoding

[jira] [Created] (HDFS-8187) Remove usage of "-setStoragePolicy" and "-getStoragePolicy" using dfsadmin cmd (as it is not been supported)

J.Andreina created HDFS-8187: Summary: Remove usage of "-setStoragePolicy" and "-getStoragePolicy" using dfsadmin cmd (as it is not been supported) Key: HDFS-8187 URL: https://issues.apache.org/jira/browse/HDFS-8187

[jira] [Created] (HDFS-8186) Erasure coding: Make block placement policy for EC file configurable

Walter Su created HDFS-8186: --- Summary: Erasure coding: Make block placement policy for EC file configurable Key: HDFS-8186 URL: https://issues.apache.org/jira/browse/HDFS-8186 Project: Hadoop HDFS

[jira] [Created] (HDFS-8185) Separate client related routines in HAUtil into a new class

Haohui Mai created HDFS-8185: Summary: Separate client related routines in HAUtil into a new class Key: HDFS-8185 URL: https://issues.apache.org/jira/browse/HDFS-8185 Project: Hadoop HDFS Issue