[jira] [Commented] (HDFS-8328) Follow-on to update decode for DataNode striped blocks reconstruction

2015-05-21 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14555697#comment-14555697 ] Yi Liu commented on HDFS-8328: -- I will also do some refinement and improvement for blocks reco

[jira] [Commented] (HDFS-8382) Remove chunkSize parameter from initialize method of raw erasure coder

2015-05-21 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14555688#comment-14555688 ] Vinayakumar B commented on HDFS-8382: - [~drankye] and [~aw], I think the problem is, wh

[jira] [Created] (HDFS-8461) Erasure coding: fix priority level of UnderReplicatedBlocks for striped block

2015-05-21 Thread Walter Su (JIRA)
Walter Su created HDFS-8461: --- Summary: Erasure coding: fix priority level of UnderReplicatedBlocks for striped block Key: HDFS-8461 URL: https://issues.apache.org/jira/browse/HDFS-8461 Project: Hadoop HDFS

[jira] [Commented] (HDFS-7116) Add a command to get the bandwidth of balancer

2015-05-21 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14555674#comment-14555674 ] Rakesh R commented on HDFS-7116: Thanks! In case-1, we should have a mechanism to send the

[jira] [Updated] (HDFS-8449) Add ec recovery tasks count metric to DataNode

2015-05-21 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-8449: Attachment: HDFS-8449-001.patch > Add ec recovery tasks count metric to DataNode > --

[jira] [Commented] (HDFS-7116) Add a command to get the bandwidth of balancer

2015-05-21 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14555661#comment-14555661 ] Akira AJISAKA commented on HDFS-7116: - case2 is good to me because case1 adds extra inf

[jira] [Commented] (HDFS-8399) Erasure Coding: BlockManager is unnecessarily computing recovery work for the deleted blocks

2015-05-21 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14555655#comment-14555655 ] Rakesh R commented on HDFS-8399: ping [~hitliuyi] It would be great to see your feedback on

[jira] [Commented] (HDFS-8343) Erasure Coding: test failed in TestDFSStripedInputStream.testStatefulRead() when use ByteBuffer

2015-05-21 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14555649#comment-14555649 ] Walter Su commented on HDFS-8343: - It happens again. Occasionally. > Erasure Coding: test

[jira] [Updated] (HDFS-8343) Erasure Coding: test failed in TestDFSStripedInputStream.testStatefulRead() when use ByteBuffer

2015-05-21 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-8343: Description: It's failed since last commit {code} commit c61c9c855e7cd1d20f654c061ff16341ce2d9936 {code}

[jira] [Updated] (HDFS-8460) Erasure Coding: stateful result doesn't match data occasionally

2015-05-21 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-8460: - Description: I found this issue in TestDFSStripedInputStream, {{testStatefulRead}} failed occasionally shows that r

[jira] [Created] (HDFS-8460) Erasure Coding: stateful result doesn't match data occasionally

2015-05-21 Thread Yi Liu (JIRA)
Yi Liu created HDFS-8460: Summary: Erasure Coding: stateful result doesn't match data occasionally Key: HDFS-8460 URL: https://issues.apache.org/jira/browse/HDFS-8460 Project: Hadoop HDFS Issue Type

[jira] [Commented] (HDFS-7116) Add a command to get the bandwidth of balancer

2015-05-21 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14555625#comment-14555625 ] Rakesh R commented on HDFS-7116: *Initial design thoughts:* Case-1) Datanode will inform N

[jira] [Commented] (HDFS-8220) Erasure Coding: StripedDataStreamer fails to handle the blocklocations which doesn't satisfy BlockGroupSize

2015-05-21 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14555623#comment-14555623 ] Walter Su commented on HDFS-8220: - {code} public DatanodeStorageInfo[] chooseTarget4NewBl

[jira] [Updated] (HDFS-8459) Question: Why Namenode doesn't judge the status of replicas when convert block status from commited to complete?

2015-05-21 Thread cuiyang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cuiyang updated HDFS-8459: -- Description: Why Namenode doesn't judge the status of replicas when convert block status from commited to comp

[jira] [Updated] (HDFS-8459) Question: Why Namenode doesn't judge the status of replicas when convert block status from commited to complete?

2015-05-21 Thread cuiyang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cuiyang updated HDFS-8459: -- Description: Why Namenode doesn't judge the status of replicas when convert block status from commited to comp

[jira] [Updated] (HDFS-8459) Question: Why Namenode doesn't judge the status of replicas when convert block status from commited to complete?

2015-05-21 Thread cuiyang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cuiyang updated HDFS-8459: -- Description: Why Namenode doesn't judge the status of replicas when convert block status from commited to comp

[jira] [Updated] (HDFS-8459) Question: Why Namenode doesn't judge the status of replicas when convert block status from commited to complete?

2015-05-21 Thread cuiyang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cuiyang updated HDFS-8459: -- Description: Why Namenode doesn't judge the status of replicas when convert block status from commited to comp

[jira] [Updated] (HDFS-8459) Question: Why Namenode doesn't judge the status of replicas when convert block status from commited to complete?

2015-05-21 Thread cuiyang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cuiyang updated HDFS-8459: -- Description: Why Namenode doesn't judge the status of replicas when convert block status from commited to comp

[jira] [Created] (HDFS-8459) Question: Why Namenode doesn't judge the status of replicas when convert block status from commited to complete?

2015-05-21 Thread cuiyang (JIRA)
cuiyang created HDFS-8459: - Summary: Question: Why Namenode doesn't judge the status of replicas when convert block status from commited to complete? Key: HDFS-8459 URL: https://issues.apache.org/jira/browse/HDFS-8459

[jira] [Commented] (HDFS-8342) Erasure Coding: test skip in TestDFSStripedInputStream

2015-05-21 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1474#comment-1474 ] Zhe Zhang commented on HDFS-8342: - Sounds good; agreed — Sent from Mailbox > Erasure

[jira] [Updated] (HDFS-8342) Erasure Coding: test skip in TestDFSStripedInputStream

2015-05-21 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-8342: Priority: Trivial (was: Major) > Erasure Coding: test skip in TestDFSStripedInputStream > --

[jira] [Commented] (HDFS-8342) Erasure Coding: test skip in TestDFSStripedInputStream

2015-05-21 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1472#comment-1472 ] Walter Su commented on HDFS-8342: - {{TestWriteReadStripedFile.verifySeek()}} has similar te

[jira] [Assigned] (HDFS-8452) In WebHDFS, duplicate directory creation is not throwing exception.

2015-05-21 Thread Arshad Mohammad (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arshad Mohammad reassigned HDFS-8452: - Assignee: (was: Arshad Mohammad) > In WebHDFS, duplicate directory creation is not thr

[jira] [Assigned] (HDFS-8452) In WebHDFS, duplicate directory creation is not throwing exception.

2015-05-21 Thread Arshad Mohammad (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arshad Mohammad reassigned HDFS-8452: - Assignee: Arshad Mohammad > In WebHDFS, duplicate directory creation is not throwing excep

[jira] [Commented] (HDFS-8409) HDFS client RPC call throws "java.lang.IllegalStateException"

2015-05-21 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1441#comment-1441 ] Juan Yu commented on HDFS-8409: --- Client.callId is only reset to null when a new RPC call obje

[jira] [Updated] (HDFS-8409) HDFS client RPC call throws "java.lang.IllegalStateException"

2015-05-21 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Yu updated HDFS-8409: -- Status: Patch Available (was: Open) > HDFS client RPC call throws "java.lang.IllegalStateException" > --

[jira] [Updated] (HDFS-8409) HDFS client RPC call throws "java.lang.IllegalStateException"

2015-05-21 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Yu updated HDFS-8409: -- Attachment: HDFS-8409.001.patch > HDFS client RPC call throws "java.lang.IllegalStateException" > ---

[jira] [Updated] (HDFS-7991) Allow users to skip checkpoint when stopping NameNode

2015-05-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-7991: --- Attachment: HDFS-7991-shellpart.patch -shellpart: * remove the hdfs nn shutdown bits * add plug

[jira] [Commented] (HDFS-8454) Remove unnecessary throttling in TestDatanodeDeath

2015-05-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1436#comment-1436 ] Hudson commented on HDFS-8454: -- FAILURE: Integrated in Hadoop-trunk-Commit #7888 (See [https:

[jira] [Updated] (HDFS-8454) Remove unnecessary throttling in TestDatanodeDeath

2015-05-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8454: Resolution: Fixed Fix Version/s: 2.8.0 Target Version/s: (was: 2.8.0) Hadoo

[jira] [Commented] (HDFS-8342) Erasure Coding: test skip in TestDFSStripedInputStream

2015-05-21 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1423#comment-1423 ] Zhe Zhang commented on HDFS-8342: - Should we move it under HDFS-8031 or is it actually a wo

[jira] [Commented] (HDFS-8306) Generate ACL and Xattr outputs in OIV XML outputs

2015-05-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1409#comment-1409 ] Hadoop QA commented on HDFS-8306: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8439) Adding more slow action log in critical read path

2015-05-21 Thread Liu Shaohui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1405#comment-1405 ] Liu Shaohui commented on HDFS-8439: --- [~stack] {quote} sometimes you log at INFO level and

[jira] [Commented] (HDFS-8294) Erasure Coding: Fix Findbug warnings present in erasure coding

2015-05-21 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1403#comment-1403 ] Rakesh R commented on HDFS-8294: Thanks [~zhz], [~drankye] for the help. It would be great

[jira] [Updated] (HDFS-8439) Adding more slow action log in critical read path

2015-05-21 Thread Liu Shaohui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liu Shaohui updated HDFS-8439: -- Attachment: HDFS-8439.003.patch Update for [~stack]'s review - Change log level from info to warn - Fix t

[jira] [Commented] (HDFS-8306) Generate ACL and Xattr outputs in OIV XML outputs

2015-05-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14555487#comment-14555487 ] Hadoop QA commented on HDFS-8306: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-8186) Erasure coding: Make block placement policy for EC file configurable

2015-05-21 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-8186: Attachment: HDFS-8186-HDFS-7285.002.txt HDFS-8186.001.txt history patch. > Erasure coding: M

[jira] [Updated] (HDFS-8342) Erasure Coding: test skip in TestDFSStripedInputStream

2015-05-21 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-8342: Resolution: Won't Fix Status: Resolved (was: Patch Available) > Erasure Coding: test skip in TestDFS

[jira] [Commented] (HDFS-8456) Introduce STORAGE_CONTAINER_SERVICE as a new NodeType.

2015-05-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14555477#comment-14555477 ] Hadoop QA commented on HDFS-8456: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8441) Erasure Coding: make condition check earlier for setReplication

2015-05-21 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14555476#comment-14555476 ] Walter Su commented on HDFS-8441: - Thanks Kai. I commited this. > Erasure Coding: make con

[jira] [Updated] (HDFS-8441) Erasure Coding: make condition check earlier for setReplication

2015-05-21 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-8441: Resolution: Fixed Fix Version/s: HDFS-7285 Status: Resolved (was: Patch Available) > Erasu

[jira] [Commented] (HDFS-8447) Decouple information of files in GetLocatedBlocks

2015-05-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14555470#comment-14555470 ] Hadoop QA commented on HDFS-8447: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-6261) Add document for enabling node group layer in HDFS

2015-05-21 Thread Binglin Chang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14555460#comment-14555460 ] Binglin Chang commented on HDFS-6261: - Sorry... will see if I can get this done this we

[jira] [Commented] (HDFS-8392) DataNode support for multiple datasets

2015-05-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14555459#comment-14555459 ] Hadoop QA commented on HDFS-8392: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8433) blockToken is not set in constructInternalBlock and parseStripedBlockGroup in StripedBlockUtil

2015-05-21 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14555454#comment-14555454 ] Walter Su commented on HDFS-8433: - Hi, [~szetszwo]! I'm wiling to work on this if you are t

[jira] [Commented] (HDFS-7609) startup used too much time to load edits

2015-05-21 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14555402#comment-14555402 ] Jing Zhao commented on HDFS-7609: - Spent some further time digging into the issue. Besides

[jira] [Created] (HDFS-8458) Abstract an application layer in DataNode WebHdfs implementation

2015-05-21 Thread zhangduo (JIRA)
zhangduo created HDFS-8458: -- Summary: Abstract an application layer in DataNode WebHdfs implementation Key: HDFS-8458 URL: https://issues.apache.org/jira/browse/HDFS-8458 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-8454) Remove unnecessary throttling in TestDatanodeDeath

2015-05-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14555371#comment-14555371 ] Hadoop QA commented on HDFS-8454: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8377) Support HTTP/2 in datanode

2015-05-21 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14555360#comment-14555360 ] zhangduo commented on HDFS-8377: So let me open a new issue to abstract an application laye

[jira] [Commented] (HDFS-8344) NameNode doesn't recover lease for files with missing blocks

2015-05-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14555342#comment-14555342 ] Hadoop QA commented on HDFS-8344: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8450) Erasure Coding: Consolidate erasure coding zone related implementation into a single class

2015-05-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14555317#comment-14555317 ] Hadoop QA commented on HDFS-8450: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-7991) Allow users to skip checkpoint when stopping NameNode

2015-05-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14555300#comment-14555300 ] Allen Wittenauer commented on HDFS-7991: bq. Then if we also let this java program

[jira] [Comment Edited] (HDFS-8392) DataNode support for multiple datasets

2015-05-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14555264#comment-14555264 ] Arpit Agarwal edited comment on HDFS-8392 at 5/21/15 11:27 PM: --

[jira] [Commented] (HDFS-8392) DataNode support for multiple datasets

2015-05-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14555264#comment-14555264 ] Arpit Agarwal commented on HDFS-8392: - The attached patch is the first step to supporti

[jira] [Commented] (HDFS-8452) In WebHDFS, duplicate directory creation is not throwing exception.

2015-05-21 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14555253#comment-14555253 ] Haohui Mai commented on HDFS-8452: -- {{mkdirs()}} in HDFS is idempotent. Looks like we have

[jira] [Resolved] (HDFS-8452) In WebHDFS, duplicate directory creation is not throwing exception.

2015-05-21 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash resolved HDFS-8452. Resolution: Not A Problem > In WebHDFS, duplicate directory creation is not throwing exception. > ---

[jira] [Commented] (HDFS-8452) In WebHDFS, duplicate directory creation is not throwing exception.

2015-05-21 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14555242#comment-14555242 ] Ravi Prakash commented on HDFS-8452: Actually you are right! The exception should be ra

[jira] [Updated] (HDFS-8306) Generate ACL and Xattr outputs in OIV XML outputs

2015-05-21 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-8306: Attachment: HDFS-8306.004.patch Thanks a lot for this quick review, [~andrew.wang]. Fixed typos as yo

[jira] [Created] (HDFS-8457) Refactor FsDatasetSpi to pull up HDFS-agnostic functionality into parent interface

2015-05-21 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-8457: --- Summary: Refactor FsDatasetSpi to pull up HDFS-agnostic functionality into parent interface Key: HDFS-8457 URL: https://issues.apache.org/jira/browse/HDFS-8457 Project:

[jira] [Commented] (HDFS-8306) Generate ACL and Xattr outputs in OIV XML outputs

2015-05-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14555223#comment-14555223 ] Andrew Wang commented on HDFS-8306: --- I like it! Just a few nitty review comments: * Some

[jira] [Reopened] (HDFS-8452) In WebHDFS, duplicate directory creation is not throwing exception.

2015-05-21 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash reopened HDFS-8452: Are you sure that's true [~wheat9]? https://hadoop.apache.org/docs/current2/hadoop-project-dist/hadoop-co

[jira] [Updated] (HDFS-8306) Generate ACL and Xattr outputs in OIV XML outputs

2015-05-21 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-8306: Attachment: HDFS-8306.003.patch Hi, [~andrew.wang] I added a layout version in the XML outputs and t

[jira] [Updated] (HDFS-8456) Introduce STORAGE_CONTAINER_SERVICE as a new NodeType.

2015-05-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8456: Status: Patch Available (was: Open) > Introduce STORAGE_CONTAINER_SERVICE as a new NodeType. > -

[jira] [Updated] (HDFS-8456) Introduce STORAGE_CONTAINER_SERVICE as a new NodeType.

2015-05-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8456: Target Version/s: HDFS-7240 > Introduce STORAGE_CONTAINER_SERVICE as a new NodeType. > --

[jira] [Updated] (HDFS-8456) Introduce STORAGE_CONTAINER_SERVICE as a new NodeType.

2015-05-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8456: Attachment: HDFS-8456-HDFS-7240.01.patch > Introduce STORAGE_CONTAINER_SERVICE as a new NodeType. > -

[jira] [Updated] (HDFS-8210) Ozone: Implement storage container manager

2015-05-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8210: -- Fix Version/s: HDFS-7240 > Ozone: Implement storage container manager >

[jira] [Commented] (HDFS-8382) Remove chunkSize parameter from initialize method of raw erasure coder

2015-05-21 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14555176#comment-14555176 ] Kai Zheng commented on HDFS-8382: - Hello [~aw], do you have any idea why the building looks

[jira] [Updated] (HDFS-8392) DataNode support for multiple datasets

2015-05-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8392: Status: Patch Available (was: Open) > DataNode support for multiple datasets > -

[jira] [Updated] (HDFS-8392) DataNode support for multiple datasets

2015-05-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8392: Attachment: HDFS-8392-HDFS-7240.01.patch > DataNode support for multiple datasets > -

[jira] [Created] (HDFS-8456) Introduce STORAGE_CONTAINER_SERVICE as a new NodeType.

2015-05-21 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-8456: --- Summary: Introduce STORAGE_CONTAINER_SERVICE as a new NodeType. Key: HDFS-8456 URL: https://issues.apache.org/jira/browse/HDFS-8456 Project: Hadoop HDFS Issue

[jira] [Comment Edited] (HDFS-7991) Allow users to skip checkpoint when stopping NameNode

2015-05-21 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14555112#comment-14555112 ] Suresh Srinivas edited comment on HDFS-7991 at 5/21/15 9:56 PM: -

[jira] [Updated] (HDFS-8373) Ec files can't be deleted into Trash because of that Trash isn't EC zone.

2015-05-21 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8373: Parent Issue: HDFS-8031 (was: HDFS-7285) > Ec files can't be deleted into Trash because of that Trash isn't

[jira] [Updated] (HDFS-8294) Erasure Coding: Fix Findbug warnings present in erasure coding

2015-05-21 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8294: Resolution: Fixed Fix Version/s: HDFS-7285 Hadoop Flags: Reviewed Status: Resolved (wa

[jira] [Commented] (HDFS-8294) Erasure Coding: Fix Findbug warnings present in erasure coding

2015-05-21 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14555116#comment-14555116 ] Zhe Zhang commented on HDFS-8294: - Latest patch looks good to me, +1. > Erasure Coding: F

[jira] [Commented] (HDFS-7991) Allow users to skip checkpoint when stopping NameNode

2015-05-21 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14555112#comment-14555112 ] Suresh Srinivas commented on HDFS-7991: --- bq. bash code sees exit with failure and sen

[jira] [Updated] (HDFS-8447) Decouple information of files in GetLocatedBlocks

2015-05-21 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8447: - Attachment: HDFS-8447.001.patch > Decouple information of files in GetLocatedBlocks > -

[jira] [Commented] (HDFS-8454) Remove unnecessary throttling in TestDatanodeDeath

2015-05-21 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14555063#comment-14555063 ] Haohui Mai commented on HDFS-8454: -- +1 pending jenkins > Remove unnecessary throttling in

[jira] [Commented] (HDFS-8455) Consider skipping stress tests for precommit builds

2015-05-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14555050#comment-14555050 ] Arpit Agarwal commented on HDFS-8455: - Based on [~busbey]'s suggestion on HDFS-8381. >

[jira] [Updated] (HDFS-8454) Remove unnecessary throttling in TestDatanodeDeath

2015-05-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8454: Status: Patch Available (was: Open) > Remove unnecessary throttling in TestDatanodeDeath > -

[jira] [Updated] (HDFS-8454) Remove unnecessary throttling in TestDatanodeDeath

2015-05-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8454: Target Version/s: 2.8.0 > Remove unnecessary throttling in TestDatanodeDeath > --

[jira] [Updated] (HDFS-8454) Remove unnecessary throttling in TestDatanodeDeath

2015-05-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8454: Attachment: HDFS-8454.01.patch Reduces the test run time from 160 to ~60 seconds on my dev machine.

[jira] [Commented] (HDFS-7991) Allow users to skip checkpoint when stopping NameNode

2015-05-21 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14555038#comment-14555038 ] Jing Zhao commented on HDFS-7991: - Thanks for the further explanation, Allen. Now I get you

[jira] [Updated] (HDFS-8455) Consider skipping stress tests for precommit builds

2015-05-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8455: Description: Our test suite includes a few stress-test type of tests. We should consider skipping in

[jira] [Commented] (HDFS-8455) Consider skipping stress tests for Jenkins runs

2015-05-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14555033#comment-14555033 ] Arpit Agarwal commented on HDFS-8455: - We could consider moving the stress tests to a s

[jira] [Created] (HDFS-8455) Consider skipping stress tests for Jenkins runs

2015-05-21 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-8455: --- Summary: Consider skipping stress tests for Jenkins runs Key: HDFS-8455 URL: https://issues.apache.org/jira/browse/HDFS-8455 Project: Hadoop HDFS Issue Type: S

[jira] [Updated] (HDFS-8455) Consider skipping stress tests for precommit builds

2015-05-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8455: Summary: Consider skipping stress tests for precommit builds (was: Consider skipping stress tests fo

[jira] [Assigned] (HDFS-8454) Remove unnecessary throttling in TestDatanodeDeath

2015-05-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reassigned HDFS-8454: --- Assignee: Arpit Agarwal > Remove unnecessary throttling in TestDatanodeDeath > ---

[jira] [Commented] (HDFS-7609) startup used too much time to load edits

2015-05-21 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14555024#comment-14555024 ] Jing Zhao commented on HDFS-7609: - Thanks for the response, Ming! Yes I agree that in most

[jira] [Updated] (HDFS-8454) Remove unnecessary throttling in TestDatanodeDeath

2015-05-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8454: Description: The testSimple* test cases use artificial throttling in the output stream. The throttli

[jira] [Updated] (HDFS-8454) Remove unnecessary throttling in TestDatanodeDeath

2015-05-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8454: Summary: Remove unnecessary throttling in TestDatanodeDeath (was: Remove unnecessary throttling in T

[jira] [Created] (HDFS-8454) Remove unnecessary throttling in TestData

2015-05-21 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-8454: --- Summary: Remove unnecessary throttling in TestData Key: HDFS-8454 URL: https://issues.apache.org/jira/browse/HDFS-8454 Project: Hadoop HDFS Issue Type: Sub-tas

[jira] [Updated] (HDFS-8344) NameNode doesn't recover lease for files with missing blocks

2015-05-21 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated HDFS-8344: --- Attachment: HDFS-8344.04.patch Fixing checkstyle -1. The test failure is not because of this patch. I w

[jira] [Commented] (HDFS-7609) startup used too much time to load edits

2015-05-21 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14555003#comment-14555003 ] Ming Ma commented on HDFS-7609: --- Thanks, [~jingzhao]. In the scenario you described, IIUC, in

[jira] [Commented] (HDFS-8377) Support HTTP/2 in datanode

2015-05-21 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14555002#comment-14555002 ] Haohui Mai commented on HDFS-8377: -- Thanks for working on this. A couple high-level commen

[jira] [Updated] (HDFS-8451) DFSClient probe for encryption testing interprets empty URI property for "enabled"

2015-05-21 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8451: - Resolution: Fixed Fix Version/s: 2.7.1 Hadoop Flags: Reviewed Status: Resolved (was:

[jira] [Updated] (HDFS-8450) Erasure Coding: Consolidate erasure coding zone related implementation into a single class

2015-05-21 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-8450: --- Attachment: HDFS-8450-HDFS-7285-02.patch > Erasure Coding: Consolidate erasure coding zone related implementati

[jira] [Commented] (HDFS-8451) DFSClient probe for encryption testing interprets empty URI property for "enabled"

2015-05-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14554879#comment-14554879 ] Hudson commented on HDFS-8451: -- FAILURE: Integrated in Hadoop-trunk-Commit #7884 (See [https:

[jira] [Resolved] (HDFS-8452) In WebHDFS, duplicate directory creation is not throwing exception.

2015-05-21 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai resolved HDFS-8452. -- Resolution: Not A Problem The behavior is expected. in HDFS {{mkdirs()}} is an idempotent operation, mea

[jira] [Commented] (HDFS-8451) DFSClient probe for encryption testing interprets empty URI property for "enabled"

2015-05-21 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14554846#comment-14554846 ] Xiaoyu Yao commented on HDFS-8451: -- I will commit it shortly. > DFSClient probe for encry

[jira] [Commented] (HDFS-7991) Allow users to skip checkpoint when stopping NameNode

2015-05-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14554842#comment-14554842 ] Allen Wittenauer commented on HDFS-7991: bq. The same question here is what if this

  1   2   >