[jira] [Commented] (HDFS-7652) Process block reports for erasure coded blocks

2015-02-06 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310154#comment-14310154 ] Jing Zhao commented on HDFS-7652: - Thanks for working on this, Zhe! Basically to process a

[jira] [Updated] (HDFS-7652) Process block reports for erasure coded blocks

2015-02-06 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-7652: Attachment: HDFS-7652.002.patch bq. 1) the reported block that contains the block id seen by DN, and 2) the

[jira] [Commented] (HDFS-1497) Write pipeline sequence numbers should be sequential with no skips or duplicates

2015-02-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310248#comment-14310248 ] Hadoop QA commented on HDFS-1497: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-2306) NameNode web UI should show information about recent checkpoints

2015-02-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310267#comment-14310267 ] Hadoop QA commented on HDFS-2306: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-5324) Make Namespace implementation pluggable in the namenode

2015-02-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310268#comment-14310268 ] Hadoop QA commented on HDFS-5324: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7285) Erasure Coding Support inside HDFS

2015-02-06 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310282#comment-14310282 ] Zhe Zhang commented on HDFS-7285: - Thanks [~szetszwo] for adding more details to the design

[jira] [Commented] (HDFS-7744) Fix potential NPE in DFSInputStream after setDropBehind or setReadahead is called

2015-02-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310258#comment-14310258 ] Hadoop QA commented on HDFS-7744: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-7647) DatanodeManager.sortLocatedBlocks() sorts DatanodeInfos but not StorageIDs

2015-02-06 Thread Milan Desai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Milan Desai updated HDFS-7647: -- Status: In Progress (was: Patch Available) DatanodeManager.sortLocatedBlocks() sorts DatanodeInfos but

[jira] [Updated] (HDFS-7647) DatanodeManager.sortLocatedBlocks() sorts DatanodeInfos but not StorageIDs

2015-02-06 Thread Milan Desai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Milan Desai updated HDFS-7647: -- Attachment: HDFS-7647-5.patch Attached patch should resolve the failing unit tests.

[jira] [Updated] (HDFS-7647) DatanodeManager.sortLocatedBlocks() sorts DatanodeInfos but not StorageIDs

2015-02-06 Thread Milan Desai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Milan Desai updated HDFS-7647: -- Status: Patch Available (was: In Progress) DatanodeManager.sortLocatedBlocks() sorts DatanodeInfos but

[jira] [Created] (HDFS-7750) Fix findbugs warnings in hdfs-bkjournal module

2015-02-06 Thread Akira AJISAKA (JIRA)
Akira AJISAKA created HDFS-7750: --- Summary: Fix findbugs warnings in hdfs-bkjournal module Key: HDFS-7750 URL: https://issues.apache.org/jira/browse/HDFS-7750 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-6133) Make Balancer support exclude specified path

2015-02-06 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310533#comment-14310533 ] Yongjun Zhang commented on HDFS-6133: - Thanks Yunjiong for the continuous effort on

[jira] [Commented] (HDFS-7750) Fix findbugs warnings in hdfs-bkjournal module

2015-02-06 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310544#comment-14310544 ] Rakesh R commented on HDFS-7750: Thats great! Fix findbugs warnings in hdfs-bkjournal

[jira] [Commented] (HDFS-7684) The host:port settings of dfs.namenode.secondary.http-address should be trimmed before use

2015-02-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310557#comment-14310557 ] Hadoop QA commented on HDFS-7684: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-7652) Process block reports for erasure coded blocks

2015-02-06 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-7652: Attachment: HDFS-7652.005.patch Process block reports for erasure coded blocks

[jira] [Updated] (HDFS-7670) HDFS Quota guide has typos, incomplete command lines

2015-02-06 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-7670: --- Attachment: HDFS-7670.patch Attached the patch..[~aw] can you please review..? HDFS

[jira] [Created] (HDFS-7751) Fix TestHDFSCLI

2015-02-06 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-7751: Summary: Fix TestHDFSCLI Key: HDFS-7751 URL: https://issues.apache.org/jira/browse/HDFS-7751 Project: Hadoop HDFS Issue Type: Sub-task Components: test

[jira] [Commented] (HDFS-4265) BKJM doesn't take advantage of speculative reads

2015-02-06 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310571#comment-14310571 ] Rakesh R commented on HDFS-4265: Thanks [~ajisakaa] for the comments. Attached latest patch

[jira] [Updated] (HDFS-4265) BKJM doesn't take advantage of speculative reads

2015-02-06 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-4265: --- Attachment: 0009-HDFS-4265.patch BKJM doesn't take advantage of speculative reads

[jira] [Commented] (HDFS-4265) BKJM doesn't take advantage of speculative reads

2015-02-06 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310585#comment-14310585 ] Rakesh R commented on HDFS-4265: Could someone help me to push this in. Thanks! BKJM

[jira] [Commented] (HDFS-7692) DataStorage#addStorageLocations(...) should support MultiThread to speedup the upgrade of block pool at multi storage directories.

2015-02-06 Thread Leitao Guo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310587#comment-14310587 ] Leitao Guo commented on HDFS-7692: -- [~eddyxu], thanks for your review and comments! When

[jira] [Commented] (HDFS-7708) Balancer should delete its pid file when it completes rebalance

2015-02-06 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310542#comment-14310542 ] Rakesh R commented on HDFS-7708: Thanks [~cmccabe] for correcting me, let me try out an

[jira] [Commented] (HDFS-4265) BKJM doesn't take advantage of speculative reads

2015-02-06 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310554#comment-14310554 ] Akira AJISAKA commented on HDFS-4265: - Here are some trivial comments: * Some inserted

[jira] [Commented] (HDFS-7738) Add more negative tests for truncate

2015-02-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310562#comment-14310562 ] Hadoop QA commented on HDFS-7738: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7647) DatanodeManager.sortLocatedBlocks() sorts DatanodeInfos but not StorageIDs

2015-02-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310561#comment-14310561 ] Hadoop QA commented on HDFS-7647: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-4265) BKJM doesn't take advantage of speculative reads

2015-02-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310581#comment-14310581 ] Hadoop QA commented on HDFS-4265: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7692) DataStorage#addStorageLocations(...) should support MultiThread to speedup the upgrade of block pool at multi storage directories.

2015-02-06 Thread Leitao Guo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310591#comment-14310591 ] Leitao Guo commented on HDFS-7692: -- When upgrading before the patch, I find there is high

[jira] [Commented] (HDFS-6743) Put IP address into a new column on the new NN webUI

2015-02-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310530#comment-14310530 ] Hadoop QA commented on HDFS-6743: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7720) Quota by Storage Type API, tools and ClientNameNode Protocol changes

2015-02-06 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310536#comment-14310536 ] Xiaoyu Yao commented on HDFS-7720: -- Thanks [~arpitagarwal] for reviewing and committing

[jira] [Updated] (HDFS-7736) Typos in dfsadmin/fsck/snapshotDiff Commands

2015-02-06 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-7736: --- Attachment: HDFS-7736-branch-2-002.patch Attached branch-2 patch also Typos in

[jira] [Commented] (HDFS-5862) NameNode.NAMENODE_SPECIFIC_KEYS includes DFS_HA_FENCE_METHODS_KEY twice.

2015-02-06 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310539#comment-14310539 ] Akira AJISAKA commented on HDFS-5862: - Thanks [~ikeda] for the report and [~davidluo]

[jira] [Commented] (HDFS-7652) Process block reports for erasure coded blocks

2015-02-06 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310558#comment-14310558 ] Zhe Zhang commented on HDFS-7652: - [~jingzhao] Your implementation of {{getStoredBlock}} in

[jira] [Updated] (HDFS-7751) Fix TestHDFSCLI

2015-02-06 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7751: - Status: Patch Available (was: Open) Fix TestHDFSCLI --- Key: HDFS-7751

[jira] [Updated] (HDFS-7670) HDFS Quota guide has typos, incomplete command lines

2015-02-06 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-7670: --- Assignee: Brahma Reddy Battula Status: Patch Available (was: Open) HDFS Quota

[jira] [Updated] (HDFS-7751) Fix TestHDFSCLI

2015-02-06 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7751: - Attachment: HDFS-7751.0.patch Fix TestHDFSCLI --- Key: HDFS-7751

[jira] [Updated] (HDFS-7701) Support quota by storage type output with hadoop fs -count -q

2015-02-06 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7701: - Description: hadoop fs -count -q currently shows name space/disk space quota and remaining quota

[jira] [Commented] (HDFS-7692) DataStorage#addStorageLocations(...) should support MultiThread to speedup the upgrade of block pool at multi storage directories.

2015-02-06 Thread Leitao Guo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310592#comment-14310592 ] Leitao Guo commented on HDFS-7692: -- [~szetszwo] thanks for your comments, I will update

[jira] [Commented] (HDFS-7670) HDFS Quota guide has typos, incomplete command lines

2015-02-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310601#comment-14310601 ] Hadoop QA commented on HDFS-7670: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7736) Typos in dfsadmin/fsck/snapshotDiff Commands

2015-02-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310603#comment-14310603 ] Hadoop QA commented on HDFS-7736: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-7736) Typos in dfsadmin/fsck/snapshotDiff Commands

2015-02-06 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-7736: --- Attachment: HDFS-7736-002.patch [~ajisakaa] Thanks for review,, Please check the

[jira] [Assigned] (HDFS-7750) Fix findbugs warnings in hdfs-bkjournal module

2015-02-06 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R reassigned HDFS-7750: -- Assignee: Rakesh R Fix findbugs warnings in hdfs-bkjournal module

[jira] [Commented] (HDFS-7750) Fix findbugs warnings in hdfs-bkjournal module

2015-02-06 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310538#comment-14310538 ] Rakesh R commented on HDFS-7750: Hi [~ajisakaa], I've fixed the findbug warnings of

[jira] [Resolved] (HDFS-7750) Fix findbugs warnings in hdfs-bkjournal module

2015-02-06 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA resolved HDFS-7750. - Resolution: Duplicate Fix findbugs warnings in hdfs-bkjournal module

[jira] [Commented] (HDFS-7750) Fix findbugs warnings in hdfs-bkjournal module

2015-02-06 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310541#comment-14310541 ] Akira AJISAKA commented on HDFS-7750: - Thanks [~rakeshr] for pointing out. I'll close

[jira] [Commented] (HDFS-6133) Make Balancer support exclude specified path

2015-02-06 Thread Benoy Antony (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310564#comment-14310564 ] Benoy Antony commented on HDFS-6133: I know that there are different ways to accomplish

[jira] [Commented] (HDFS-7736) Typos in dfsadmin/fsck/snapshotDiff Commands

2015-02-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310594#comment-14310594 ] Hadoop QA commented on HDFS-7736: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7471) TestDatanodeManager#testNumVersionsReportedCorrect occasionally fails

2015-02-06 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310232#comment-14310232 ] Tsz Wo Nicholas Sze commented on HDFS-7471: --- [~kihwal], do you want to take a

[jira] [Commented] (HDFS-7322) deprecate sbin/*.sh

2015-02-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310251#comment-14310251 ] Hadoop QA commented on HDFS-7322: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-2084) Sometimes backup node/secondary name node stops with exception

2015-02-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310249#comment-14310249 ] Hadoop QA commented on HDFS-2084: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7694) FSDataInputStream should support unbuffer

2015-02-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310259#comment-14310259 ] Hadoop QA commented on HDFS-7694: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-7684) The host:port settings of dfs.namenode.secondary.http-address should be trimmed before use

2015-02-06 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-7684: --- Attachment: HDFS.7684.002.patch update : 1) Added Lic. to test code file 2) Fixed the Tabs side The

[jira] [Assigned] (HDFS-7692) DataStorage#addStorageLocations(...) should support MultiThread to speedup the upgrade of block pool at multi storage directories.

2015-02-06 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers reassigned HDFS-7692: Assignee: Leitao Guo DataStorage#addStorageLocations(...) should support MultiThread to

[jira] [Commented] (HDFS-7738) Add more negative tests for truncate

2015-02-06 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310394#comment-14310394 ] Konstantin Shvachko commented on HDFS-7738: --- # Since you kept TestHAAppend in the

[jira] [Commented] (HDFS-7377) [ DataNode Web UI ] Metric page will not display anything..

2015-02-06 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310481#comment-14310481 ] Akira AJISAKA commented on HDFS-7377: - This issue was fixed by HADOOP-9907. You can

[jira] [Commented] (HDFS-6908) incorrect snapshot directory diff generated by snapshot deletion

2015-02-06 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310489#comment-14310489 ] Harsh J commented on HDFS-6908: --- bq. and since it doesn't fix the corrupt fsimage on disk,

[jira] [Resolved] (HDFS-2628) Remove Mapred filenames from HDFS findbugsExcludeFile.xml file

2015-02-06 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA resolved HDFS-2628. - Resolution: Duplicate This issue was fixed by HDFS-6025. Closing. Remove Mapred filenames from

[jira] [Commented] (HDFS-7723) Quota By Storage Type namenode implemenation

2015-02-06 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310515#comment-14310515 ] Xiaoyu Yao commented on HDFS-7723: -- The patch has a dependency on HDFS-7720 and is for

[jira] [Commented] (HDFS-7723) Quota By Storage Type namenode implemenation

2015-02-06 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310517#comment-14310517 ] Xiaoyu Yao commented on HDFS-7723: -- Just found HDFS-7720 is committed to trunk. I will

[jira] [Updated] (HDFS-7056) Snapshot support for truncate

2015-02-06 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-7056: -- Attachment: HDFSSnapshotWithTruncateDesign.docx HDFSSnapshotWithTruncateDesign.docx:

[jira] [Updated] (HDFS-7322) deprecate sbin/*.sh

2015-02-06 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-7322: --- Attachment: HDFS-7322-00.patch -00: * initial version deprecate sbin/*.sh

[jira] [Updated] (HDFS-2145) Add tests for FsShell -copyFromLocal/put without dst path

2015-02-06 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-2145: --- Status: Patch Available (was: Open) Add tests for FsShell -copyFromLocal/put without dst

[jira] [Updated] (HDFS-1951) Null pointer exception comes when Namenode recovery happens and there is no response from client to NN more than the hardlimit for NN recovery and the current block is mor

2015-02-06 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-1951: --- Status: Open (was: Patch Available) Patch no longer applies. Null pointer exception comes

[jira] [Updated] (HDFS-7749) Erasure Coding: Add stripped block support in INodeFile

2015-02-06 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7749: Summary: Erasure Coding: Add stripped block support in INodeFile (was: Add stripped block support in

[jira] [Commented] (HDFS-7749) Add stripped block support in INodeFile

2015-02-06 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310172#comment-14310172 ] Aaron T. Myers commented on HDFS-7749: -- s/stripped/striped? Add stripped block

[jira] [Commented] (HDFS-7749) Add stripped block support in INodeFile

2015-02-06 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310173#comment-14310173 ] Allen Wittenauer commented on HDFS-7749: stripped or striped? Add stripped block

[jira] [Updated] (HDFS-5324) Make Namespace implementation pluggable in the namenode

2015-02-06 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-5324: --- Status: Patch Available (was: Open) Make Namespace implementation pluggable in the namenode

[jira] [Updated] (HDFS-7723) Quota By Storage Type namenode implemenation

2015-02-06 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-7723: Status: Patch Available (was: Open) Quota By Storage Type namenode implemenation

[jira] [Commented] (HDFS-7037) Using distcp to copy data from insecure to secure cluster via hftp doesn't work (branch-2 only)

2015-02-06 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310388#comment-14310388 ] Yongjun Zhang commented on HDFS-7037: - Hi [~wheat9], Thanks a lot for your comment,

[jira] [Updated] (HDFS-7652) Process block reports for erasure coded blocks

2015-02-06 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-7652: Attachment: HDFS-7652.004.patch Process block reports for erasure coded blocks

[jira] [Commented] (HDFS-7710) Remove dead code in BackupImage.java

2015-02-06 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310493#comment-14310493 ] Akira AJISAKA commented on HDFS-7710: - +1. Checking this in. Remove dead code in

[jira] [Updated] (HDFS-7597) Clients seeking over webhdfs may crash the NN

2015-02-06 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-7597: Status: Patch Available (was: Open) Re-submitting to run Jenkins. Clients seeking over webhdfs

[jira] [Updated] (HDFS-7597) Clients seeking over webhdfs may crash the NN

2015-02-06 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-7597: Status: Open (was: Patch Available) Clients seeking over webhdfs may crash the NN

[jira] [Commented] (HDFS-7716) Erasure Coding: extend BlockInfo to handle EC info

2015-02-06 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310354#comment-14310354 ] Zhe Zhang commented on HDFS-7716: - bq. Actually I do not think we need that sanity check

[jira] [Updated] (HDFS-7720) Quota by Storage Type API, tools and ClientNameNode Protocol changes

2015-02-06 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-7720: Resolution: Fixed Fix Version/s: 3.0.0 Hadoop Flags: Reviewed Status: Resolved

[jira] [Commented] (HDFS-6908) incorrect snapshot directory diff generated by snapshot deletion

2015-02-06 Thread Abhishek Rai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310377#comment-14310377 ] Abhishek Rai commented on HDFS-6908: We have an HDFS installation in production where

[jira] [Updated] (HDFS-7652) Process block reports for erasure coded blocks

2015-02-06 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7652: Attachment: HDFS-7652.003.patch Hi Zhe, I guess we should not change the id of the reported block since we

[jira] [Commented] (HDFS-7743) Code cleanup of BlockInfo and rename BlockInfo to BlockReplicationInfo

2015-02-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310412#comment-14310412 ] Hadoop QA commented on HDFS-7743: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7285) Erasure Coding Support inside HDFS

2015-02-06 Thread Kai Zheng (JIRA)
, HDFSErasureCodingDesign-20141217.pdf, HDFSErasureCodingDesign-20150204.pdf, HDFSErasureCodingDesign-20150206.pdf, fsimage-analysis-20150105.pdf Erasure Coding (EC) can greatly reduce the storage overhead without sacrifice of data reliability, comparing to the existing HDFS 3-replica approach

[jira] [Updated] (HDFS-7710) Remove dead code in BackupImage.java

2015-02-06 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-7710: Resolution: Fixed Fix Version/s: 2.7.0 Target Version/s: 2.7.0 Hadoop Flags:

[jira] [Commented] (HDFS-7744) Fix potential NPE in DFSInputStream after setDropBehind or setReadahead is called

2015-02-06 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310342#comment-14310342 ] Akira AJISAKA commented on HDFS-7744: - Thanks Colin for the report and the patch.

[jira] [Commented] (HDFS-7652) Process block reports for erasure coded blocks

2015-02-06 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310406#comment-14310406 ] Zhe Zhang commented on HDFS-7652: - Good points Jing! I've updated the patch incorporating

[jira] [Commented] (HDFS-7723) Quota By Storage Type namenode implemenation

2015-02-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310420#comment-14310420 ] Hadoop QA commented on HDFS-7723: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7743) Code cleanup of BlockInfo and rename BlockInfo to BlockReplicationInfo

2015-02-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310417#comment-14310417 ] Hadoop QA commented on HDFS-7743: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7720) Quota by Storage Type API, tools and ClientNameNode Protocol changes

2015-02-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310419#comment-14310419 ] Hudson commented on HDFS-7720: -- FAILURE: Integrated in Hadoop-trunk-Commit #7046 (See

[jira] [Commented] (HDFS-7738) Add more negative tests for truncate

2015-02-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310425#comment-14310425 ] Hadoop QA commented on HDFS-7738: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-7738) Add more negative tests for truncate

2015-02-06 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-7738: -- Attachment: h7738_20150206c.patch # nextInt(right - left) + left; does not work well

[jira] [Updated] (HDFS-7285) Erasure Coding Support inside HDFS

2015-02-06 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-7285: -- Attachment: HDFSErasureCodingDesign-20150206.pdf ... I see you are still editing so

[jira] [Commented] (HDFS-7718) DFSClient objects created by AbstractFileSystem objects created by FileContext are not closed and results in thread leakage

2015-02-06 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310483#comment-14310483 ] Colin Patrick McCabe commented on HDFS-7718: I apologize for the review delay.

[jira] [Commented] (HDFS-7710) Remove dead code in BackupImage.java

2015-02-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310505#comment-14310505 ] Hudson commented on HDFS-7710: -- SUCCESS: Integrated in Hadoop-trunk-Commit #7047 (See

[jira] [Updated] (HDFS-7743) Code cleanup of BlockInfo and rename BlockInfo to BlockReplicationInfo

2015-02-06 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7743: Status: Patch Available (was: Open) Code cleanup of BlockInfo and rename BlockInfo to BlockReplicationInfo

[jira] [Updated] (HDFS-7684) The host:port settings of dfs.namenode.secondary.http-address should be trimmed before use

2015-02-06 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-7684: --- Attachment: HDFS.7684.001.patch Trims the Configuration values before reading them in. The host:port

[jira] [Commented] (HDFS-7732) Fix the order of the parameters in DFSConfigKeys

2015-02-06 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14309697#comment-14309697 ] Akira AJISAKA commented on HDFS-7732: - Thanks [~brahmareddy] for taking this. +1. Fix

[jira] [Commented] (HDFS-7732) Fix the order of the parameters in DFSConfigKeys

2015-02-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14309721#comment-14309721 ] Hudson commented on HDFS-7732: -- FAILURE: Integrated in Hadoop-trunk-Commit #7041 (See

[jira] [Commented] (HDFS-7720) Quota by Storage Type API, tools and ClientNameNode Protocol changes

2015-02-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14308884#comment-14308884 ] Hadoop QA commented on HDFS-7720: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7709) Fix findbug warnings in httpfs

2015-02-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14308955#comment-14308955 ] Hudson commented on HDFS-7709: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #96 (See

[jira] [Commented] (HDFS-7698) Fix locking on HDFS read statistics and add a method for clearing them.

2015-02-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14308962#comment-14308962 ] Hudson commented on HDFS-7698: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #96 (See

[jira] [Commented] (HDFS-7741) Remove unnecessary synchronized in FSDataInputStream and HdfsDataInputStream

2015-02-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14308950#comment-14308950 ] Hudson commented on HDFS-7741: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #96 (See

[jira] [Commented] (HDFS-7655) Expose truncate API for Web HDFS

2015-02-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14308958#comment-14308958 ] Hudson commented on HDFS-7655: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #96 (See

[jira] [Commented] (HDFS-7270) Add congestion signaling capability to DataNode write protocol

2015-02-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14308954#comment-14308954 ] Hudson commented on HDFS-7270: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #96 (See

[jira] [Commented] (HDFS-7270) Add congestion signaling capability to DataNode write protocol

2015-02-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14309015#comment-14309015 ] Hudson commented on HDFS-7270: -- FAILURE: Integrated in Hadoop-Yarn-trunk #830 (See

<    1   2   3   >