[jira] [Commented] (HDFS-8020) Erasure Coding: restore BlockGroup and schema info from stripping coding command

2015-04-03 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394119#comment-14394119 ] Kai Sasaki commented on HDFS-8020: -- According to design

[jira] [Updated] (HDFS-7889) Subclass DFSOutputStream to support writing striping layout files

2015-04-03 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-7889: Attachment: HDFS-7889-008.patch Subclass DFSOutputStream to support writing striping layout files

[jira] [Commented] (HDFS-8025) Addendum for HDFS-3087

2015-04-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394185#comment-14394185 ] Hadoop QA commented on HDFS-8025: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7889) Subclass DFSOutputStream to support writing striping layout files

2015-04-03 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394178#comment-14394178 ] Li Bo commented on HDFS-7889: - Patch 008 fix problems mentioned above. Currently I have not

[jira] [Commented] (HDFS-7715) Implement the Hitchhiker erasure coding algorithm

2015-04-03 Thread jack liuquan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394113#comment-14394113 ] jack liuquan commented on HDFS-7715: Hi Kai, Thanks for your suggestions. But I think

[jira] [Updated] (HDFS-7782) Erasure coding: pread from files in striped layout

2015-04-03 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7782: Attachment: HDFS-7782.007.patch So I just extended Zhe's 005 and 006 patch and tried to demo the idea that

[jira] [Commented] (HDFS-7889) Subclass DFSOutputStream to support writing striping layout files

2015-04-03 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394148#comment-14394148 ] Walter Su commented on HDFS-7889: - HDFS-7839 removed HdfsConstants.EC_STORAGE_POLICY_ID

[jira] [Commented] (HDFS-7889) Subclass DFSOutputStream to support writing striping layout files

2015-04-03 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394134#comment-14394134 ] Li Bo commented on HDFS-7889: - OK, I will upload a new patch later Subclass DFSOutputStream

[jira] [Commented] (HDFS-8020) Erasure Coding: restore BlockGroup and schema info from stripping coding command

2015-04-03 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394271#comment-14394271 ] Kai Zheng commented on HDFS-8020: - Good catch ! I thought you're right, so please propose

[jira] [Commented] (HDFS-7715) Implement the Hitchhiker erasure coding algorithm

2015-04-03 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394278#comment-14394278 ] Kai Zheng commented on HDFS-7715: - bq.I think in HH, we can also read chunk by chunk I

[jira] [Commented] (HDFS-7954) TestBalancer#testBalancerWithPinnedBlocks failed on Windows

2015-04-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394306#comment-14394306 ] Hudson commented on HDFS-7954: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #152 (See

[jira] [Commented] (HDFS-7888) Change DataStreamer/DFSOutputStream/DFSPacket for convenience of subclassing

2015-04-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394309#comment-14394309 ] Hudson commented on HDFS-7888: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #152 (See

[jira] [Commented] (HDFS-7893) Update the POM to create a separate hdfs-client jar

2015-04-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394312#comment-14394312 ] Hudson commented on HDFS-7893: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #152 (See

[jira] [Commented] (HDFS-8035) Move checkBlocksProperlyReplicated() in FSNamesystem to BlockManager

2015-04-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394315#comment-14394315 ] Hudson commented on HDFS-8035: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #152 (See

[jira] [Commented] (HDFS-7811) Avoid recursive call getStoragePolicyID in INodeFile#computeQuotaUsage

2015-04-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394308#comment-14394308 ] Hudson commented on HDFS-7811: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #152 (See

[jira] [Commented] (HDFS-7893) Update the POM to create a separate hdfs-client jar

2015-04-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394334#comment-14394334 ] Hudson commented on HDFS-7893: -- FAILURE: Integrated in Hadoop-Yarn-trunk #886 (See

[jira] [Commented] (HDFS-7811) Avoid recursive call getStoragePolicyID in INodeFile#computeQuotaUsage

2015-04-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394330#comment-14394330 ] Hudson commented on HDFS-7811: -- FAILURE: Integrated in Hadoop-Yarn-trunk #886 (See

[jira] [Commented] (HDFS-7888) Change DataStreamer/DFSOutputStream/DFSPacket for convenience of subclassing

2015-04-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394331#comment-14394331 ] Hudson commented on HDFS-7888: -- FAILURE: Integrated in Hadoop-Yarn-trunk #886 (See

[jira] [Commented] (HDFS-7954) TestBalancer#testBalancerWithPinnedBlocks failed on Windows

2015-04-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394328#comment-14394328 ] Hudson commented on HDFS-7954: -- FAILURE: Integrated in Hadoop-Yarn-trunk #886 (See

[jira] [Commented] (HDFS-8035) Move checkBlocksProperlyReplicated() in FSNamesystem to BlockManager

2015-04-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394337#comment-14394337 ] Hudson commented on HDFS-8035: -- FAILURE: Integrated in Hadoop-Yarn-trunk #886 (See

[jira] [Work started] (HDFS-8059) Move dataBlockNum and parityBlockNum from BlockInfoStriped to INodeFile

2015-04-03 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-8059 started by Yi Liu. Move dataBlockNum and parityBlockNum from BlockInfoStriped to INodeFile

[jira] [Created] (HDFS-8059) Move dataBlockNum and parityBlockNum from BlockInfoStriped to INodeFile

2015-04-03 Thread Yi Liu (JIRA)
Yi Liu created HDFS-8059: Summary: Move dataBlockNum and parityBlockNum from BlockInfoStriped to INodeFile Key: HDFS-8059 URL: https://issues.apache.org/jira/browse/HDFS-8059 Project: Hadoop HDFS

[jira] [Updated] (HDFS-8059) Erasure coding: move dataBlockNum and parityBlockNum from BlockInfoStriped to INodeFile

2015-04-03 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-8059: - Summary: Erasure coding: move dataBlockNum and parityBlockNum from BlockInfoStriped to INodeFile (was: Move

[jira] [Created] (HDFS-8060) org.apache.hadoop.fs.FileUtil.copyMerge should merge all files in recursive sub directories

2015-04-03 Thread Umesh Kacha (JIRA)
Umesh Kacha created HDFS-8060: - Summary: org.apache.hadoop.fs.FileUtil.copyMerge should merge all files in recursive sub directories Key: HDFS-8060 URL: https://issues.apache.org/jira/browse/HDFS-8060

[jira] [Updated] (HDFS-274) Add the current time to all the pages in the user interface

2015-04-03 Thread Gabor Liptak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Liptak updated HDFS-274: -- Release Note: Added timestamp to jobtracker.jsp,tasktracker.jsp and dfshealth.jsp Status: Patch

[jira] [Updated] (HDFS-2203) Add additional fields to the JMX output on NameNode

2015-04-03 Thread Gabor Liptak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Liptak updated HDFS-2203: --- Release Note: Adding the following attributes for each live data node: capacity nonDFSUsed remaining

[jira] [Commented] (HDFS-274) Add the current time to all the pages in the user interface

2015-04-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394551#comment-14394551 ] Hadoop QA commented on HDFS-274: {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-2203) Add additional fields to the JMX output on NameNode

2015-04-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394552#comment-14394552 ] Hadoop QA commented on HDFS-2203: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-3233) Move IP to FQDN conversion from DatanodeJSPHelper to DatanodeID

2015-04-03 Thread Gabor Liptak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394560#comment-14394560 ] Gabor Liptak commented on HDFS-3233: Eli, are you referencing to code in

[jira] [Commented] (HDFS-7811) Avoid recursive call getStoragePolicyID in INodeFile#computeQuotaUsage

2015-04-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394502#comment-14394502 ] Hudson commented on HDFS-7811: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #143 (See

[jira] [Commented] (HDFS-7888) Change DataStreamer/DFSOutputStream/DFSPacket for convenience of subclassing

2015-04-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394503#comment-14394503 ] Hudson commented on HDFS-7888: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #143 (See

[jira] [Commented] (HDFS-7954) TestBalancer#testBalancerWithPinnedBlocks failed on Windows

2015-04-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394500#comment-14394500 ] Hudson commented on HDFS-7954: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #143 (See

[jira] [Commented] (HDFS-7893) Update the POM to create a separate hdfs-client jar

2015-04-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394506#comment-14394506 ] Hudson commented on HDFS-7893: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #143 (See

[jira] [Commented] (HDFS-8035) Move checkBlocksProperlyReplicated() in FSNamesystem to BlockManager

2015-04-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394509#comment-14394509 ] Hudson commented on HDFS-8035: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #143 (See

[jira] [Commented] (HDFS-8035) Move checkBlocksProperlyReplicated() in FSNamesystem to BlockManager

2015-04-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394524#comment-14394524 ] Hudson commented on HDFS-8035: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2084 (See

[jira] [Commented] (HDFS-7888) Change DataStreamer/DFSOutputStream/DFSPacket for convenience of subclassing

2015-04-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394518#comment-14394518 ] Hudson commented on HDFS-7888: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2084 (See

[jira] [Commented] (HDFS-7954) TestBalancer#testBalancerWithPinnedBlocks failed on Windows

2015-04-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394515#comment-14394515 ] Hudson commented on HDFS-7954: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2084 (See

[jira] [Commented] (HDFS-7893) Update the POM to create a separate hdfs-client jar

2015-04-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394521#comment-14394521 ] Hudson commented on HDFS-7893: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2084 (See

[jira] [Commented] (HDFS-7811) Avoid recursive call getStoragePolicyID in INodeFile#computeQuotaUsage

2015-04-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394517#comment-14394517 ] Hudson commented on HDFS-7811: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2084 (See

[jira] [Created] (HDFS-8058) Erasure coding: use BlockInfo[] for both striped and contiguous blocks in INodeFile

2015-04-03 Thread Yi Liu (JIRA)
Yi Liu created HDFS-8058: Summary: Erasure coding: use BlockInfo[] for both striped and contiguous blocks in INodeFile Key: HDFS-8058 URL: https://issues.apache.org/jira/browse/HDFS-8058 Project: Hadoop HDFS

[jira] [Updated] (HDFS-8058) Erasure coding: use BlockInfo[] for both striped and contiguous blocks in INodeFile

2015-04-03 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-8058: - Attachment: HDFS-8058.001.patch Attach the patch. In current logic, If file is striped, only

[jira] [Comment Edited] (HDFS-8058) Erasure coding: use BlockInfo[] for both striped and contiguous blocks in INodeFile

2015-04-03 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394532#comment-14394532 ] Yi Liu edited comment on HDFS-8058 at 4/3/15 2:59 PM: -- Attach the

[jira] [Work started] (HDFS-8058) Erasure coding: use BlockInfo[] for both striped and contiguous blocks in INodeFile

2015-04-03 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-8058 started by Yi Liu. Erasure coding: use BlockInfo[] for both striped and contiguous blocks in INodeFile

[jira] [Commented] (HDFS-8020) Erasure Coding: restore BlockGroup and schema info from stripping coding command

2015-04-03 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394272#comment-14394272 ] Kai Zheng commented on HDFS-8020: - I mean while you're working on this please keep all the

[jira] [Updated] (HDFS-8058) Erasure coding: use BlockInfo[] for both striped and contiguous blocks in INodeFile

2015-04-03 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-8058: - Description: This JIRA is to use {{BlockInfo[] blocks}} for both striped and contiguous blocks in INodeFile.

[jira] [Created] (HDFS-8061) Create an Offline FSImage Viewer tool

2015-04-03 Thread Mike Drob (JIRA)
Mike Drob created HDFS-8061: --- Summary: Create an Offline FSImage Viewer tool Key: HDFS-8061 URL: https://issues.apache.org/jira/browse/HDFS-8061 Project: Hadoop HDFS Issue Type: New Feature

[jira] [Updated] (HDFS-8038) Fix TestOfflineImageViewer#testPBDelimitedWriter on Windows

2015-04-03 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-8038: Component/s: tools Target Version/s: 2.7.0 Fix

[jira] [Commented] (HDFS-77) the permissions are not documented well enough and should be integrated with the hdfs user guide

2015-04-03 Thread Gabor Liptak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-77?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394616#comment-14394616 ] Gabor Liptak commented on HDFS-77: -- Are the details on the current page correct?

[jira] [Commented] (HDFS-8059) Erasure coding: move dataBlockNum and parityBlockNum from BlockInfoStriped to INodeFile

2015-04-03 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394642#comment-14394642 ] Yi Liu commented on HDFS-8059: -- Will upload the patch later. Erasure coding: move

[jira] [Commented] (HDFS-7715) Implement the Hitchhiker erasure coding algorithm

2015-04-03 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394695#comment-14394695 ] Kai Zheng commented on HDFS-7715: - HADOOP-11803 was just opened to work on the idea

[jira] [Updated] (HDFS-8043) NPE in MiniDFSCluster teardown

2015-04-03 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-8043: --- Status: Patch Available (was: Open) NPE in MiniDFSCluster teardown

[jira] [Updated] (HDFS-8043) NPE in MiniDFSCluster teardown

2015-04-03 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-8043: --- Attachment: HDFS-8043.patch NPE in MiniDFSCluster teardown

[jira] [Commented] (HDFS-8038) Fix TestOfflineImageViewer#testPBDelimitedWriter on Windows

2015-04-03 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394737#comment-14394737 ] Chris Nauroth commented on HDFS-8038: - Hi Xiaoyu. I wonder if this one is actually a

[jira] [Commented] (HDFS-5215) dfs.datanode.du.reserved is not taking effect as it's not considered while getting the available space

2015-04-03 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394783#comment-14394783 ] Brahma Reddy Battula commented on HDFS-5215: Updated the patch...[~yzhangal]

[jira] [Commented] (HDFS-8035) Move checkBlocksProperlyReplicated() in FSNamesystem to BlockManager

2015-04-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394824#comment-14394824 ] Hudson commented on HDFS-8035: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #153 (See

[jira] [Commented] (HDFS-7888) Change DataStreamer/DFSOutputStream/DFSPacket for convenience of subclassing

2015-04-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394818#comment-14394818 ] Hudson commented on HDFS-7888: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #153 (See

[jira] [Commented] (HDFS-7954) TestBalancer#testBalancerWithPinnedBlocks failed on Windows

2015-04-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394815#comment-14394815 ] Hudson commented on HDFS-7954: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #153 (See

[jira] [Commented] (HDFS-7893) Update the POM to create a separate hdfs-client jar

2015-04-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394821#comment-14394821 ] Hudson commented on HDFS-7893: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #153 (See

[jira] [Commented] (HDFS-7811) Avoid recursive call getStoragePolicyID in INodeFile#computeQuotaUsage

2015-04-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394817#comment-14394817 ] Hudson commented on HDFS-7811: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #153 (See

[jira] [Commented] (HDFS-7937) Erasure Coding: INodeFile quota computation unit tests

2015-04-03 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394852#comment-14394852 ] Zhe Zhang commented on HDFS-7937: - Thanks Kai for the work so far. Please note that

[jira] [Commented] (HDFS-4838) HDFS should use the new methods added in HADOOP-9574

2015-04-03 Thread Dongming Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394914#comment-14394914 ] Dongming Liang commented on HDFS-4838: -- Hi Jian [~ jianhe], I've attached a patch for

[jira] [Updated] (HDFS-8034) Fix TestDFSClientRetries#testDFSClientConfigurationLocateFollowingBlockInitialDelay for Windows

2015-04-03 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-8034: Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch Available) +1

[jira] [Updated] (HDFS-8034) Fix TestDFSClientRetries#testDFSClientConfigurationLocateFollowingBlockInitialDelay for Windows

2015-04-03 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-8034: Component/s: test Target Version/s: 2.7.0 Hadoop Flags: Reviewed Fix

[jira] [Updated] (HDFS-8034) Fix TestDFSClientRetries#testDFSClientConfigurationLocateFollowingBlockInitialDelay for Windows

2015-04-03 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-8034: Target Version/s: 2.8.0 (was: 2.7.0) Fix

[jira] [Commented] (HDFS-7715) Implement the Hitchhiker erasure coding algorithm

2015-04-03 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394713#comment-14394713 ] Kai Zheng commented on HDFS-7715: - Jack, I will review your patch in the following

[jira] [Commented] (HDFS-8034) Fix TestDFSClientRetries#testDFSClientConfigurationLocateFollowingBlockInitialDelay for Windows

2015-04-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394726#comment-14394726 ] Hudson commented on HDFS-8034: -- FAILURE: Integrated in Hadoop-trunk-Commit #7505 (See

[jira] [Commented] (HDFS-8043) NPE in MiniDFSCluster teardown

2015-04-03 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394727#comment-14394727 ] Brahma Reddy Battula commented on HDFS-8043: [~ste...@apache.org] Thanks a lot

[jira] [Commented] (HDFS-6673) Add delimited format support to PB OIV tool

2015-04-03 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394742#comment-14394742 ] Chris Nauroth commented on HDFS-6673: - I suspect this does not work correctly on

[jira] [Updated] (HDFS-8039) Fix TestDebugAdmin#testRecoverLease and testVerfiyBlockChecksumCommand on Windows

2015-04-03 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-8039: Component/s: test Fix TestDebugAdmin#testRecoverLease and testVerfiyBlockChecksumCommand on

[jira] [Commented] (HDFS-6917) Add an hdfs debug command to validate blocks, call recoverlease, etc.

2015-04-03 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394774#comment-14394774 ] Chris Nauroth commented on HDFS-6917: - I just committed HDFS-8039, which is a follow-on

[jira] [Commented] (HDFS-8035) Move checkBlocksProperlyReplicated() in FSNamesystem to BlockManager

2015-04-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394878#comment-14394878 ] Hudson commented on HDFS-8035: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2102 (See

[jira] [Commented] (HDFS-7893) Update the POM to create a separate hdfs-client jar

2015-04-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394875#comment-14394875 ] Hudson commented on HDFS-7893: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2102 (See

[jira] [Updated] (HDFS-8058) Erasure coding: use BlockInfo[] for both striped and contiguous blocks in INodeFile

2015-04-03 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-8058: - Attachment: HDFS-8058.002.patch Fix test failure of original code and NPE. Erasure coding: use BlockInfo[] for

[jira] [Commented] (HDFS-8060) org.apache.hadoop.fs.FileUtil.copyMerge should merge all files in recursive sub directories

2015-04-03 Thread Umesh Kacha (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394660#comment-14394660 ] Umesh Kacha commented on HDFS-8060: --- Hi Chrish thanks for the prompt response. Let me

[jira] [Commented] (HDFS-8039) Fix TestDebugAdmin#testRecoverLease and testVerfiyBlockChecksumCommand on Windows

2015-04-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394788#comment-14394788 ] Hudson commented on HDFS-8039: -- FAILURE: Integrated in Hadoop-trunk-Commit #7507 (See

[jira] [Commented] (HDFS-7811) Avoid recursive call getStoragePolicyID in INodeFile#computeQuotaUsage

2015-04-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394870#comment-14394870 ] Hudson commented on HDFS-7811: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2102 (See

[jira] [Commented] (HDFS-7954) TestBalancer#testBalancerWithPinnedBlocks failed on Windows

2015-04-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394868#comment-14394868 ] Hudson commented on HDFS-7954: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2102 (See

[jira] [Commented] (HDFS-7888) Change DataStreamer/DFSOutputStream/DFSPacket for convenience of subclassing

2015-04-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394871#comment-14394871 ] Hudson commented on HDFS-7888: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2102 (See

[jira] [Commented] (HDFS-7715) Implement the Hitchhiker erasure coding algorithm

2015-04-03 Thread Rashmi Vinayak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394709#comment-14394709 ] Rashmi Vinayak commented on HDFS-7715: -- Hi Kai, Thanks for the detailed explanation.

[jira] [Updated] (HDFS-8039) Fix TestDebugAdmin#testRecoverLease and testVerfiyBlockChecksumCommand on Windows

2015-04-03 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-8039: Resolution: Fixed Fix Version/s: 2.7.0 Hadoop Flags: Reviewed Status: Resolved

[jira] [Updated] (HDFS-7782) Erasure coding: pread from files in striped layout

2015-04-03 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-7782: Attachment: HDFS-7782-008.patch Thanks Jing a lot for the update! {{planReadPortions}} looks much cleaner

[jira] [Commented] (HDFS-7715) Implement the Hitchhiker erasure coding algorithm

2015-04-03 Thread Rashmi Vinayak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394624#comment-14394624 ] Rashmi Vinayak commented on HDFS-7715: -- Reg. the above three comments on adapting

[jira] [Commented] (HDFS-7715) Implement the Hitchhiker erasure coding algorithm

2015-04-03 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394657#comment-14394657 ] Kai Zheng commented on HDFS-7715: - Hi [~rashmikv], I thought you made good point, we

[jira] [Updated] (HDFS-5215) dfs.datanode.du.reserved is not taking effect as it's not considered while getting the available space

2015-04-03 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-5215: --- Attachment: HDFS-5215-004.patch dfs.datanode.du.reserved is not taking effect as it's

[jira] [Commented] (HDFS-7949) WebImageViewer need support file size calculation with striped blocks

2015-04-03 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394848#comment-14394848 ] Zhe Zhang commented on HDFS-7949: - To maintain a consistent way of calculating this, I

[jira] [Updated] (HDFS-4838) HDFS should use the new methods added in HADOOP-9574

2015-04-03 Thread Dongming Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongming Liang updated HDFS-4838: - Attachment: HDFS-4838.patch Remove addPersistedDelegationToken from hdfs as there is one in common

[jira] [Commented] (HDFS-8020) Erasure Coding: restore BlockGroup and schema info from stripping coding command

2015-04-03 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395059#comment-14395059 ] Zhe Zhang commented on HDFS-8020: - Actually {{DNA_CODEC}} is sufficient because we can

[jira] [Updated] (HDFS-8038) PBImageDelimitedTextWriter#getEntry output HDFS path in platform-specific format.

2015-04-03 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8038: - Summary: PBImageDelimitedTextWriter#getEntry output HDFS path in platform-specific format. (was:

[jira] [Updated] (HDFS-8038) PBImageDelimitedTextWriter#getEntry output HDFS path in platform specific format.

2015-04-03 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8038: - Summary: PBImageDelimitedTextWriter#getEntry output HDFS path in platform specific format. (was:

[jira] [Commented] (HDFS-5215) dfs.datanode.du.reserved is not taking effect as it's not considered while getting the available space

2015-04-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395120#comment-14395120 ] Hadoop QA commented on HDFS-5215: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-8023) Erasure Coding: retrieve eraure coding policy and schema for a block or file from NameNode

2015-04-03 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395129#comment-14395129 ] Zhe Zhang commented on HDFS-8023: - NameNode needs to represent schemas first. Erasure

[jira] [Created] (HDFS-8062) Remove hard-coded values in favor of EC schema

2015-04-03 Thread Kai Zheng (JIRA)
Kai Zheng created HDFS-8062: --- Summary: Remove hard-coded values in favor of EC schema Key: HDFS-8062 URL: https://issues.apache.org/jira/browse/HDFS-8062 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-8043) NPE in MiniDFSCluster teardown

2015-04-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395073#comment-14395073 ] Hadoop QA commented on HDFS-8043: - {color:green}+1 overall{color}. Here are the results of

[jira] [Comment Edited] (HDFS-7996) After swapping a volume, BlockReceiver reports ReplicaNotFoundException

2015-04-03 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14387466#comment-14387466 ] Colin Patrick McCabe edited comment on HDFS-7996 at 4/3/15 9:13 PM:

[jira] [Updated] (HDFS-8038) PBImageDelimitedTextWriter#getEntry output HDFS path in platform-specific format.

2015-04-03 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8038: - Attachment: HDFS-8038.01.patch Good catch, [~cnauroth]! That is the real cause. I've updated bug and the

[jira] [Commented] (HDFS-7996) After swapping a volume, BlockReceiver reports ReplicaNotFoundException

2015-04-03 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395112#comment-14395112 ] Lei (Eddy) Xu commented on HDFS-7996: - Thanks a lot for reviewing and committing this,

[jira] [Updated] (HDFS-7889) Subclass DFSOutputStream to support writing striping layout files

2015-04-03 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-7889: Attachment: HDFS-7889-009.patch Thanks Bo for updating the patch! It looks good overall. # The current

[jira] [Commented] (HDFS-7859) Erasure Coding: Persist EC schemas in NameNode

2015-04-03 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395186#comment-14395186 ] Kai Zheng commented on HDFS-7859: - When we have this work done, we may also have the idea

[jira] [Updated] (HDFS-8041) Consider remaining space during block blockplacement if dfs space is highly utilized

2015-04-03 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-8041: - Attachment: HDFS-8041.v3.patch Attaching a new patch Consider remaining space during block

[jira] [Updated] (HDFS-7866) Erasure coding: NameNode manages EC schemas

2015-04-03 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-7866: Summary: Erasure coding: NameNode manages EC schemas (was: Erasure coding: Allow NameNode to load, list and

  1   2   >