[jira] [Commented] (HDFS-7621) Erasure Coding: update the Balancer/Mover data migration logic

2015-05-14 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543305#comment-14543305 ] Walter Su commented on HDFS-7621: - >...moveBlockAcrossStorage requires Mover send correct n

[jira] [Commented] (HDFS-1605) Convert DFSInputStream synchronized sections to a ReadWrite lock

2015-05-14 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543306#comment-14543306 ] Vinayakumar B commented on HDFS-1605: - [~kartheek], Thanks for the patch. It would be l

[jira] [Commented] (HDFS-8294) Erasure Coding: Fix Findbug warnings present in erasure coding

2015-05-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543309#comment-14543309 ] Hadoop QA commented on HDFS-8294: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-8382) Remove chunkSize parameter from initialize method of raw erasure coder

2015-05-14 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-8382: Attachment: HDFS-8382-HDFS-7285-v1.patch Uploaded a patch based on HADOOP-11938. > Remove chunkSize paramete

[jira] [Work started] (HDFS-8382) Remove chunkSize parameter from initialize method of raw erasure coder

2015-05-14 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-8382 started by Kai Zheng. --- > Remove chunkSize parameter from initialize method of raw erasure coder > -

[jira] [Created] (HDFS-8399) Erasure Coding: BlockManager is unnecessarily computing recovery work for the deleted blocks

2015-05-14 Thread Rakesh R (JIRA)
Rakesh R created HDFS-8399: -- Summary: Erasure Coding: BlockManager is unnecessarily computing recovery work for the deleted blocks Key: HDFS-8399 URL: https://issues.apache.org/jira/browse/HDFS-8399 Project:

[jira] [Commented] (HDFS-8399) Erasure Coding: BlockManager is unnecessarily computing recovery work for the deleted blocks

2015-05-14 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543370#comment-14543370 ] Rakesh R commented on HDFS-8399: IIUC the cause is, {{INodeFile#destroyAndCollectBlocks()}

[jira] [Commented] (HDFS-8394) Move getAdditionalBlock() and related functionalities into a separate class

2015-05-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543387#comment-14543387 ] Hadoop QA commented on HDFS-8394: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8210) Ozone: Implement storage container manager

2015-05-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543392#comment-14543392 ] Hadoop QA commented on HDFS-8210: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-8131) Implement a space balanced block placement policy

2015-05-14 Thread Liu Shaohui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liu Shaohui updated HDFS-8131: -- Attachment: HDFS-8131-v3.diff Rebase on trunk > Implement a space balanced block placement policy >

[jira] [Commented] (HDFS-8390) merge BlockPlacementPolicyWithNodeGroup with default policy

2015-05-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543415#comment-14543415 ] Hadoop QA commented on HDFS-8390: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-6348) Secondary namenode - RMI Thread prevents JVM from exiting after main() completes

2015-05-14 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543422#comment-14543422 ] Vinayakumar B commented on HDFS-6348: - bq. Since it involves System.exit(), I couldn't

[jira] [Updated] (HDFS-8186) Erasure coding: Make block placement policy for EC file configurable

2015-05-14 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-8186: Attachment: HDFS-8186-HDFS-7285.002.patch > Erasure coding: Make block placement policy for EC file configura

[jira] [Updated] (HDFS-8399) Erasure Coding: BlockManager is unnecessarily computing recovery work for the deleted blocks

2015-05-14 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-8399: --- Target Version/s: HDFS-7285 > Erasure Coding: BlockManager is unnecessarily computing recovery work for the >

[jira] [Updated] (HDFS-8399) Erasure Coding: BlockManager is unnecessarily computing recovery work for the deleted blocks

2015-05-14 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-8399: --- Status: Patch Available (was: Open) > Erasure Coding: BlockManager is unnecessarily computing recovery work fo

[jira] [Updated] (HDFS-8399) Erasure Coding: BlockManager is unnecessarily computing recovery work for the deleted blocks

2015-05-14 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-8399: --- Attachment: HDFS-8399-HDFS-7285-00.patch > Erasure Coding: BlockManager is unnecessarily computing recovery wor

[jira] [Commented] (HDFS-8270) create() always retried with hardcoded timeout when file already exists

2015-05-14 Thread Andrey Stepachev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543428#comment-14543428 ] Andrey Stepachev commented on HDFS-8270: I'd remove that at all. I think that this

[jira] [Commented] (HDFS-8399) Erasure Coding: BlockManager is unnecessarily computing recovery work for the deleted blocks

2015-05-14 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543427#comment-14543427 ] Rakesh R commented on HDFS-8399: I have tried re-producing it through unit test case, pleas

[jira] [Commented] (HDFS-8186) Erasure coding: Make block placement policy for EC file configurable

2015-05-14 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543430#comment-14543430 ] Walter Su commented on HDFS-8186: - 1. >...Balancer and NamenodeFsck. Should we address thes

[jira] [Updated] (HDFS-8186) Erasure coding: Make block placement policy for EC file configurable

2015-05-14 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-8186: Status: Patch Available (was: Open) > Erasure coding: Make block placement policy for EC file configurable >

[jira] [Commented] (HDFS-6888) Allow selectively audit logging ops

2015-05-14 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543431#comment-14543431 ] Vinayakumar B commented on HDFS-6888: - This is nice. Changes looks nice. One nit. chan

[jira] [Commented] (HDFS-6348) Secondary namenode - RMI Thread prevents JVM from exiting after main() completes

2015-05-14 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543450#comment-14543450 ] Rakesh R commented on HDFS-6348: [~vinayrpet] Thank you for the reviews. I'll do the sugges

[jira] [Updated] (HDFS-6348) SecondaryNameNode not terminating properly on runtime exceptions

2015-05-14 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-6348: --- Summary: SecondaryNameNode not terminating properly on runtime exceptions (was: Secondary namenode - RMI Thre

[jira] [Commented] (HDFS-8366) Erasure Coding: Make the timeout parameter of polling blocking queue configurable in DFSStripedOutputStream

2015-05-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543458#comment-14543458 ] Hadoop QA commented on HDFS-8366: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8186) Erasure coding: Make block placement policy for EC file configurable

2015-05-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543462#comment-14543462 ] Hadoop QA commented on HDFS-8186: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8150) Make getFileChecksum fail for blocks under construction

2015-05-14 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543463#comment-14543463 ] Vinayakumar B commented on HDFS-8150: - +1 for latest patch. Jenkins has already run on

[jira] [Updated] (HDFS-8150) Make getFileChecksum fail for blocks under construction

2015-05-14 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-8150: Labels: (was: BB2015-05-RFC) > Make getFileChecksum fail for blocks under construction > --

[jira] [Updated] (HDFS-8150) Make getFileChecksum fail for blocks under construction

2015-05-14 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-8150: Resolution: Fixed Fix Version/s: 2.8.0 Hadoop Flags: Reviewed Status: Resolved

[jira] [Updated] (HDFS-8390) merge BlockPlacementPolicyWithNodeGroup with default policy

2015-05-14 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-8390: Attachment: HDFS-8390.003.patch > merge BlockPlacementPolicyWithNodeGroup with default policy > -

[jira] [Commented] (HDFS-8294) Erasure Coding: Fix Findbug warnings present in erasure coding

2015-05-14 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543483#comment-14543483 ] Rakesh R commented on HDFS-8294: Latest patch addressing the review comments. Recently it g

[jira] [Commented] (HDFS-8199) Erasure Coding: System test of creating ECZone and EC files.

2015-05-14 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543488#comment-14543488 ] Walter Su commented on HDFS-8199: - Nodes: 1NN + 9DN + 1 Client Client node writes 100G (1G

[jira] [Commented] (HDFS-8150) Make getFileChecksum fail for blocks under construction

2015-05-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543493#comment-14543493 ] Hudson commented on HDFS-8150: -- FAILURE: Integrated in Hadoop-trunk-Commit #7831 (See [https:

[jira] [Commented] (HDFS-8380) Always call addStoredBlock on blocks which have been shifted from one storage to another

2015-05-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543515#comment-14543515 ] Hudson commented on HDFS-8380: -- FAILURE: Integrated in Hadoop-Yarn-trunk #927 (See [https://b

[jira] [Commented] (HDFS-8150) Make getFileChecksum fail for blocks under construction

2015-05-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543519#comment-14543519 ] Hudson commented on HDFS-8150: -- FAILURE: Integrated in Hadoop-Yarn-trunk #927 (See [https://b

[jira] [Commented] (HDFS-8243) Files written by TestHostsFiles and TestNameNodeMXBean are causing Release Audit Warnings.

2015-05-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543512#comment-14543512 ] Hudson commented on HDFS-8243: -- FAILURE: Integrated in Hadoop-Yarn-trunk #927 (See [https://b

[jira] [Commented] (HDFS-7728) Avoid updating quota usage while loading edits

2015-05-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543526#comment-14543526 ] Hudson commented on HDFS-7728: -- FAILURE: Integrated in Hadoop-Yarn-trunk #927 (See [https://b

[jira] [Commented] (HDFS-8143) HDFS Mover tool should exit after some retry when failed to move blocks.

2015-05-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543521#comment-14543521 ] Hudson commented on HDFS-8143: -- FAILURE: Integrated in Hadoop-Yarn-trunk #927 (See [https://b

[jira] [Commented] (HDFS-6300) Prevent multiple balancers from running simultaneously

2015-05-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543523#comment-14543523 ] Hudson commented on HDFS-6300: -- FAILURE: Integrated in Hadoop-Yarn-trunk #927 (See [https://b

[jira] [Commented] (HDFS-8358) TestTraceAdmin fails

2015-05-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543520#comment-14543520 ] Hudson commented on HDFS-8358: -- FAILURE: Integrated in Hadoop-Yarn-trunk #927 (See [https://b

[jira] [Updated] (HDFS-8131) Implement a space balanced block placement policy

2015-05-14 Thread Priyank Rastogi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Priyank Rastogi updated HDFS-8131: -- Labels: BlockPlacementPolicy (was: BB2015-05-TBR BlockPlacementPolicy) > Implement a space balan

[jira] [Updated] (HDFS-8041) Consider remaining space during block blockplacement if dfs space is highly utilized

2015-05-14 Thread Priyank Rastogi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Priyank Rastogi updated HDFS-8041: -- Labels: (was: BB2015-05-TBR) > Consider remaining space during block blockplacement if dfs spac

[jira] [Updated] (HDFS-8041) Consider remaining space during block blockplacement if dfs space is highly utilized

2015-05-14 Thread Priyank Rastogi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Priyank Rastogi updated HDFS-8041: -- Labels: BlockPlacementPolicy (was: ) > Consider remaining space during block blockplacement if d

[jira] [Updated] (HDFS-8342) Erasure Coding: test skip in TestDFSStripedInputStream

2015-05-14 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-8342: Attachment: HDFS-8342-HDFS-7285.001.repost.patch > Erasure Coding: test skip in TestDFSStripedInputStream > -

[jira] [Commented] (HDFS-8243) Files written by TestHostsFiles and TestNameNodeMXBean are causing Release Audit Warnings.

2015-05-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543568#comment-14543568 ] Hudson commented on HDFS-8243: -- SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #196 (See [htt

[jira] [Commented] (HDFS-6300) Prevent multiple balancers from running simultaneously

2015-05-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543579#comment-14543579 ] Hudson commented on HDFS-6300: -- SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #196 (See [htt

[jira] [Commented] (HDFS-8150) Make getFileChecksum fail for blocks under construction

2015-05-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543575#comment-14543575 ] Hudson commented on HDFS-8150: -- SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #196 (See [htt

[jira] [Commented] (HDFS-8143) HDFS Mover tool should exit after some retry when failed to move blocks.

2015-05-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543577#comment-14543577 ] Hudson commented on HDFS-8143: -- SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #196 (See [htt

[jira] [Commented] (HDFS-8380) Always call addStoredBlock on blocks which have been shifted from one storage to another

2015-05-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543571#comment-14543571 ] Hudson commented on HDFS-8380: -- SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #196 (See [htt

[jira] [Commented] (HDFS-7728) Avoid updating quota usage while loading edits

2015-05-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543582#comment-14543582 ] Hudson commented on HDFS-7728: -- SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #196 (See [htt

[jira] [Commented] (HDFS-8358) TestTraceAdmin fails

2015-05-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543576#comment-14543576 ] Hudson commented on HDFS-8358: -- SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #196 (See [htt

[jira] [Updated] (HDFS-8352) Erasure Coding: test webhdfs read write stripe file

2015-05-14 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-8352: Attachment: HDFS-8352-HDFS-7285.001.repost.patch > Erasure Coding: test webhdfs read write stripe file >

[jira] [Updated] (HDFS-8390) merge BlockPlacementPolicyWithNodeGroup with default policy

2015-05-14 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-8390: Description: We saw requirements for adding new policies.( HDFS-7613, HDFS-7892, HDFS-8131, maybe HDFS-4894

[jira] [Commented] (HDFS-8131) Implement a space balanced block placement policy

2015-05-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543620#comment-14543620 ] Hadoop QA commented on HDFS-8131: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8131) Implement a space balanced block placement policy

2015-05-14 Thread Liu Shaohui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543640#comment-14543640 ] Liu Shaohui commented on HDFS-8131: --- The failed test: TestHdfsConfigFields has no relatio

[jira] [Commented] (HDFS-6888) Allow selectively audit logging ops

2015-05-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543646#comment-14543646 ] Hadoop QA commented on HDFS-6888: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-8131) Implement a space balanced block placement policy

2015-05-14 Thread Liu Shaohui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liu Shaohui updated HDFS-8131: -- Attachment: HDFS-8131.004.patch Fix problems of javadoc and remove while space > Implement a space balan

[jira] [Commented] (HDFS-8399) Erasure Coding: BlockManager is unnecessarily computing recovery work for the deleted blocks

2015-05-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543659#comment-14543659 ] Hadoop QA commented on HDFS-8399: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8342) Erasure Coding: test skip in TestDFSStripedInputStream

2015-05-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543662#comment-14543662 ] Hadoop QA commented on HDFS-8342: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8352) Erasure Coding: test webhdfs read write stripe file

2015-05-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543663#comment-14543663 ] Hadoop QA commented on HDFS-8352: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Created] (HDFS-8400) Fix failed TestHdfsConfigFields

2015-05-14 Thread Liu Shaohui (JIRA)
Liu Shaohui created HDFS-8400: - Summary: Fix failed TestHdfsConfigFields Key: HDFS-8400 URL: https://issues.apache.org/jira/browse/HDFS-8400 Project: Hadoop HDFS Issue Type: Bug Compone

[jira] [Updated] (HDFS-8400) Fix failed TestHdfsConfigFields

2015-05-14 Thread Liu Shaohui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liu Shaohui updated HDFS-8400: -- Attachment: HDFS-8400.001.patch Skip htrace config keys in TestHdfsConfigFields > Fix failed TestHdfsCon

[jira] [Updated] (HDFS-8400) Fix failed TestHdfsConfigFields

2015-05-14 Thread Liu Shaohui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liu Shaohui updated HDFS-8400: -- Fix Version/s: 3.0.0 > Fix failed TestHdfsConfigFields > --- > >

[jira] [Updated] (HDFS-8400) Fix failed TestHdfsConfigFields

2015-05-14 Thread Liu Shaohui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liu Shaohui updated HDFS-8400: -- Status: Patch Available (was: Open) > Fix failed TestHdfsConfigFields > ---

[jira] [Commented] (HDFS-8113) Add check for null BlockCollection pointers in BlockInfoContiguous structures

2015-05-14 Thread Chengbing Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543749#comment-14543749 ] Chengbing Liu commented on HDFS-8113: - Just an update: I have done a NN-failover and th

[jira] [Updated] (HDFS-8266) Erasure Coding: Test of snapshot/.trash with EC files

2015-05-14 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-8266: --- Attachment: HDFS-8266-HDFS-7285-00.patch > Erasure Coding: Test of snapshot/.trash with EC files >

[jira] [Commented] (HDFS-8358) TestTraceAdmin fails

2015-05-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543795#comment-14543795 ] Hudson commented on HDFS-8358: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #195 (See

[jira] [Commented] (HDFS-8380) Always call addStoredBlock on blocks which have been shifted from one storage to another

2015-05-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543789#comment-14543789 ] Hudson commented on HDFS-8380: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #195 (See

[jira] [Commented] (HDFS-8243) Files written by TestHostsFiles and TestNameNodeMXBean are causing Release Audit Warnings.

2015-05-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543787#comment-14543787 ] Hudson commented on HDFS-8243: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #195 (See

[jira] [Commented] (HDFS-8150) Make getFileChecksum fail for blocks under construction

2015-05-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543812#comment-14543812 ] Hudson commented on HDFS-8150: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2125 (See [https://

[jira] [Commented] (HDFS-8143) HDFS Mover tool should exit after some retry when failed to move blocks.

2015-05-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543814#comment-14543814 ] Hudson commented on HDFS-8143: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2125 (See [https://

[jira] [Commented] (HDFS-8143) HDFS Mover tool should exit after some retry when failed to move blocks.

2015-05-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543796#comment-14543796 ] Hudson commented on HDFS-8143: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #195 (See

[jira] [Commented] (HDFS-8358) TestTraceAdmin fails

2015-05-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543813#comment-14543813 ] Hudson commented on HDFS-8358: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2125 (See [https://

[jira] [Commented] (HDFS-8380) Always call addStoredBlock on blocks which have been shifted from one storage to another

2015-05-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543808#comment-14543808 ] Hudson commented on HDFS-8380: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2125 (See [https://

[jira] [Commented] (HDFS-8266) Erasure Coding: Test of snapshot/.trash with EC files

2015-05-14 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543820#comment-14543820 ] Rakesh R commented on HDFS-8266: Hi [~demongaorui], I've tried few snapshot related test ca

[jira] [Commented] (HDFS-8266) Erasure Coding: Test of snapshot/.trash with EC files

2015-05-14 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543821#comment-14543821 ] Rakesh R commented on HDFS-8266: Hi All, I've one observation while writing snapshot relat

[jira] [Commented] (HDFS-6300) Prevent multiple balancers from running simultaneously

2015-05-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543816#comment-14543816 ] Hudson commented on HDFS-6300: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2125 (See [https://

[jira] [Commented] (HDFS-8150) Make getFileChecksum fail for blocks under construction

2015-05-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543794#comment-14543794 ] Hudson commented on HDFS-8150: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #195 (See

[jira] [Commented] (HDFS-7728) Avoid updating quota usage while loading edits

2015-05-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543800#comment-14543800 ] Hudson commented on HDFS-7728: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #195 (See

[jira] [Commented] (HDFS-7728) Avoid updating quota usage while loading edits

2015-05-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543819#comment-14543819 ] Hudson commented on HDFS-7728: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2125 (See [https://

[jira] [Commented] (HDFS-8243) Files written by TestHostsFiles and TestNameNodeMXBean are causing Release Audit Warnings.

2015-05-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543805#comment-14543805 ] Hudson commented on HDFS-8243: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2125 (See [https://

[jira] [Commented] (HDFS-8390) merge BlockPlacementPolicyWithNodeGroup with default policy

2015-05-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543828#comment-14543828 ] Hadoop QA commented on HDFS-8390: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8358) TestTraceAdmin fails

2015-05-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543851#comment-14543851 ] Hudson commented on HDFS-8358: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #185 (See [htt

[jira] [Commented] (HDFS-8143) HDFS Mover tool should exit after some retry when failed to move blocks.

2015-05-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543852#comment-14543852 ] Hudson commented on HDFS-8143: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #185 (See [htt

[jira] [Commented] (HDFS-6300) Prevent multiple balancers from running simultaneously

2015-05-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543854#comment-14543854 ] Hudson commented on HDFS-6300: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #185 (See [htt

[jira] [Commented] (HDFS-8150) Make getFileChecksum fail for blocks under construction

2015-05-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543850#comment-14543850 ] Hudson commented on HDFS-8150: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #185 (See [htt

[jira] [Commented] (HDFS-8243) Files written by TestHostsFiles and TestNameNodeMXBean are causing Release Audit Warnings.

2015-05-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543843#comment-14543843 ] Hudson commented on HDFS-8243: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #185 (See [htt

[jira] [Commented] (HDFS-7728) Avoid updating quota usage while loading edits

2015-05-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543857#comment-14543857 ] Hudson commented on HDFS-7728: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #185 (See [htt

[jira] [Commented] (HDFS-8380) Always call addStoredBlock on blocks which have been shifted from one storage to another

2015-05-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543846#comment-14543846 ] Hudson commented on HDFS-8380: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #185 (See [htt

[jira] [Resolved] (HDFS-8391) NN should consider current EC tasks handling count from DN while assigning new tasks

2015-05-14 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G resolved HDFS-8391. --- Resolution: Fixed Fix Version/s: HDFS-7285 Hadoop Flags: Reviewed > NN shou

[jira] [Updated] (HDFS-6888) Allow selectively audit logging ops

2015-05-14 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He updated HDFS-6888: -- Attachment: HDFS-6888.008.patch > Allow selectively audit logging ops > > >

[jira] [Commented] (HDFS-8243) Files written by TestHostsFiles and TestNameNodeMXBean are causing Release Audit Warnings.

2015-05-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543892#comment-14543892 ] Hudson commented on HDFS-8243: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2143 (See [htt

[jira] [Commented] (HDFS-8358) TestTraceAdmin fails

2015-05-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543900#comment-14543900 ] Hudson commented on HDFS-8358: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2143 (See [htt

[jira] [Commented] (HDFS-8380) Always call addStoredBlock on blocks which have been shifted from one storage to another

2015-05-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543894#comment-14543894 ] Hudson commented on HDFS-8380: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2143 (See [htt

[jira] [Commented] (HDFS-8143) HDFS Mover tool should exit after some retry when failed to move blocks.

2015-05-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543901#comment-14543901 ] Hudson commented on HDFS-8143: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2143 (See [htt

[jira] [Commented] (HDFS-7728) Avoid updating quota usage while loading edits

2015-05-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543905#comment-14543905 ] Hudson commented on HDFS-7728: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2143 (See [htt

[jira] [Commented] (HDFS-8150) Make getFileChecksum fail for blocks under construction

2015-05-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543899#comment-14543899 ] Hudson commented on HDFS-8150: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2143 (See [htt

[jira] [Commented] (HDFS-6888) Allow selectively audit logging ops

2015-05-14 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543908#comment-14543908 ] Chen He commented on HDFS-6888: --- patch updated. Thank you for the review [~vinayrpet]. > All

[jira] [Created] (HDFS-8401) Memfs - a layered file system for in-memory storage in HDFS

2015-05-14 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-8401: --- Summary: Memfs - a layered file system for in-memory storage in HDFS Key: HDFS-8401 URL: https://issues.apache.org/jira/browse/HDFS-8401 Project: Hadoop HDFS

[jira] [Commented] (HDFS-8401) Memfs - a layered file system for in-memory storage in HDFS

2015-05-14 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543927#comment-14543927 ] Arpit Agarwal commented on HDFS-8401: - The layered file system idea was first proposed

[jira] [Updated] (HDFS-8401) Memfs - a layered file system for in-memory storage in HDFS

2015-05-14 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8401: Description: We propose creating a layered filesystem that can provide in-memory storage using exist

  1   2   3   >