[jira] [Updated] (HDFS-7715) Implement the Hitchhiker erasure coding algorithm

2015-03-25 Thread jack liuquan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack liuquan updated HDFS-7715: --- Attachment: HDFS-7715-hhxor-decoder.patch HDFS-7715-hhxor-encoder.patch > Implement the

[jira] [Updated] (HDFS-7715) Implement the Hitchhiker erasure coding algorithm

2015-03-25 Thread jack liuquan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack liuquan updated HDFS-7715: --- Attachment: (was: HDFS-7715.zip) > Implement the Hitchhiker erasure coding algorithm >

[jira] [Updated] (HDFS-7988) Replace usage of ExactSizeInputStream with LimitInputStream.

2015-03-25 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-7988: Status: Patch Available (was: Open) > Replace usage of ExactSizeInputStream with LimitInputStream. > ---

[jira] [Commented] (HDFS-7344) Erasure Coding worker and support in DataNode

2015-03-25 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14379428#comment-14379428 ] Li Bo commented on HDFS-7344: - Hi Nicholas, Thanks for the heads up on this task. Once after fi

[jira] [Commented] (HDFS-7715) Implement the Hitchhiker erasure coding algorithm

2015-03-25 Thread jack liuquan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14379446#comment-14379446 ] jack liuquan commented on HDFS-7715: Hi Kai, Thanks for your comments! 1. the pom file

[jira] [Commented] (HDFS-7715) Implement the Hitchhiker erasure coding algorithm

2015-03-25 Thread jack liuquan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14379445#comment-14379445 ] jack liuquan commented on HDFS-7715: Hi Kai, Thanks for your comments! 1. the pom file

[jira] [Commented] (HDFS-7344) Erasure Coding worker and support in DataNode

2015-03-25 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14379472#comment-14379472 ] Tsz Wo Nicholas Sze commented on HDFS-7344: --- Since you are working on the client,

[jira] [Commented] (HDFS-7980) Incremental BlockReport will dramatically slow down the startup of a namenode

2015-03-25 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14379484#comment-14379484 ] Tsz Wo Nicholas Sze commented on HDFS-7980: --- As mentioned by [~huizane] in the de

[jira] [Commented] (HDFS-7891) A block placement policy with best fault tolerance

2015-03-25 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14379598#comment-14379598 ] Tsz Wo Nicholas Sze commented on HDFS-7891: --- Hi Walter, thanks for working on thi

[jira] [Updated] (HDFS-7616) Change FSImage to support BlockGroup

2015-03-25 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-7616: -- Hadoop Flags: Reviewed +1 patch looks good. > Change FSImage to support BlockGroup > ---

[jira] [Resolved] (HDFS-7616) Change FSImage to support BlockGroup

2015-03-25 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-7616. --- Resolution: Fixed Fix Version/s: HDFS-7285 I have committed this. Thanks, Takuy

[jira] [Updated] (HDFS-7616) Add a test for BlockGroup support in FSImage

2015-03-25 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-7616: -- Component/s: (was: namenode) test > Add a test for BlockGroup suppor

[jira] [Updated] (HDFS-7616) Add a test for BlockGroup support in FSImage

2015-03-25 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-7616: -- Description: We need to test the FSImage change for support BlockGroup and other new stru

[jira] [Updated] (HDFS-5019) Cleanup imports in HDFS project

2015-03-25 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J updated HDFS-5019: -- Affects Version/s: 2.6.0 Status: Open (was: Patch Available) > Cleanup imports in HDFS project >

[jira] [Updated] (HDFS-4789) redirectToRandomDataNode tries to get a delegation token without verifying security is enabled

2015-03-25 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J updated HDFS-4789: -- Target Version/s: (was: 2.1.0-beta) > redirectToRandomDataNode tries to get a delegation token without verifyin

[jira] [Updated] (HDFS-4789) redirectToRandomDataNode tries to get a delegation token without verifying security is enabled

2015-03-25 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J updated HDFS-4789: -- Resolution: Not a Problem Status: Resolved (was: Patch Available) This is not a problem anymore in branc

[jira] [Commented] (HDFS-7988) Replace usage of ExactSizeInputStream with LimitInputStream.

2015-03-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14379690#comment-14379690 ] Hadoop QA commented on HDFS-7988: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7713) Implement mkdirs in the HDFS Web UI

2015-03-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14379723#comment-14379723 ] Hudson commented on HDFS-7713: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #143 (See [htt

[jira] [Commented] (HDFS-7985) WebHDFS should be always enabled

2015-03-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14379715#comment-14379715 ] Hudson commented on HDFS-7985: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #143 (See [htt

[jira] [Commented] (HDFS-7977) NFS couldn't take percentile intervals

2015-03-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14379717#comment-14379717 ] Hudson commented on HDFS-7977: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #143 (See [htt

[jira] [Commented] (HDFS-6826) Plugin interface to enable delegation of HDFS authorization assertions

2015-03-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14379727#comment-14379727 ] Hudson commented on HDFS-6826: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #143 (See [htt

[jira] [Commented] (HDFS-7976) Update NFS user guide for mount option "sync" to minimize or avoid reordered writes

2015-03-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14379718#comment-14379718 ] Hudson commented on HDFS-7976: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #143 (See [htt

[jira] [Commented] (HDFS-7961) Trigger full block report after hot swapping disk

2015-03-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14379716#comment-14379716 ] Hudson commented on HDFS-7961: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #143 (See [htt

[jira] [Commented] (HDFS-7875) Improve log message when wrong value configured for dfs.datanode.failed.volumes.tolerated

2015-03-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14379714#comment-14379714 ] Hudson commented on HDFS-7875: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #143 (See [htt

[jira] [Commented] (HDFS-7854) Separate class DataStreamer out of DFSOutputStream

2015-03-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14379729#comment-14379729 ] Hudson commented on HDFS-7854: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #143 (See [htt

[jira] [Commented] (HDFS-7875) Improve log message when wrong value configured for dfs.datanode.failed.volumes.tolerated

2015-03-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14379743#comment-14379743 ] Hudson commented on HDFS-7875: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #877 (See [https://b

[jira] [Commented] (HDFS-7961) Trigger full block report after hot swapping disk

2015-03-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14379745#comment-14379745 ] Hudson commented on HDFS-7961: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #877 (See [https://b

[jira] [Commented] (HDFS-7985) WebHDFS should be always enabled

2015-03-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14379744#comment-14379744 ] Hudson commented on HDFS-7985: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #877 (See [https://b

[jira] [Commented] (HDFS-7977) NFS couldn't take percentile intervals

2015-03-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14379746#comment-14379746 ] Hudson commented on HDFS-7977: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #877 (See [https://b

[jira] [Commented] (HDFS-7976) Update NFS user guide for mount option "sync" to minimize or avoid reordered writes

2015-03-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14379747#comment-14379747 ] Hudson commented on HDFS-7976: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #877 (See [https://b

[jira] [Commented] (HDFS-6826) Plugin interface to enable delegation of HDFS authorization assertions

2015-03-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14379757#comment-14379757 ] Hudson commented on HDFS-6826: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #877 (See [https://b

[jira] [Commented] (HDFS-7854) Separate class DataStreamer out of DFSOutputStream

2015-03-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14379759#comment-14379759 ] Hudson commented on HDFS-7854: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #877 (See [https://b

[jira] [Commented] (HDFS-7713) Implement mkdirs in the HDFS Web UI

2015-03-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14379752#comment-14379752 ] Hudson commented on HDFS-7713: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #877 (See [https://b

[jira] [Commented] (HDFS-7344) Erasure Coding worker and support in DataNode

2015-03-25 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14379785#comment-14379785 ] Kai Zheng commented on HDFS-7344: - Hello [~szetszwo], Thanks for taking care of this. Let

[jira] [Commented] (HDFS-7350) WebHDFS: Support EC commands through webhdfs

2015-03-25 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14379818#comment-14379818 ] Uma Maheswara Rao G commented on HDFS-7350: --- Hi Nicholas, I think I raised it to

[jira] [Commented] (HDFS-7337) Configurable and pluggable Erasure Codec and schema

2015-03-25 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14379823#comment-14379823 ] Kai Zheng commented on HDFS-7337: - As inspired with discussion in HDFS-7344 with [~szetszwo

[jira] [Commented] (HDFS-6994) libhdfs3 - A native C/C++ HDFS client

2015-03-25 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14379854#comment-14379854 ] Bob Hansen commented on HDFS-6994: -- We are evaluating libhdfs3 for use in our product, and

[jira] [Commented] (HDFS-7985) WebHDFS should be always enabled

2015-03-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14379928#comment-14379928 ] Hudson commented on HDFS-7985: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2075 (See [https://

[jira] [Commented] (HDFS-7977) NFS couldn't take percentile intervals

2015-03-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14379930#comment-14379930 ] Hudson commented on HDFS-7977: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2075 (See [https://

[jira] [Commented] (HDFS-7713) Implement mkdirs in the HDFS Web UI

2015-03-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14379936#comment-14379936 ] Hudson commented on HDFS-7713: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2075 (See [https://

[jira] [Commented] (HDFS-7854) Separate class DataStreamer out of DFSOutputStream

2015-03-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14379942#comment-14379942 ] Hudson commented on HDFS-7854: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2075 (See [https://

[jira] [Commented] (HDFS-6826) Plugin interface to enable delegation of HDFS authorization assertions

2015-03-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14379940#comment-14379940 ] Hudson commented on HDFS-6826: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2075 (See [https://

[jira] [Commented] (HDFS-7875) Improve log message when wrong value configured for dfs.datanode.failed.volumes.tolerated

2015-03-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14379927#comment-14379927 ] Hudson commented on HDFS-7875: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2075 (See [https://

[jira] [Commented] (HDFS-7961) Trigger full block report after hot swapping disk

2015-03-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14379929#comment-14379929 ] Hudson commented on HDFS-7961: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2075 (See [https://

[jira] [Commented] (HDFS-7976) Update NFS user guide for mount option "sync" to minimize or avoid reordered writes

2015-03-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14379931#comment-14379931 ] Hudson commented on HDFS-7976: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2075 (See [https://

[jira] [Commented] (HDFS-7715) Implement the Hitchhiker erasure coding algorithm

2015-03-25 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14379957#comment-14379957 ] Kai Zheng commented on HDFS-7715: - Hi Jack, bq.I just modify it for building in my machine.

[jira] [Commented] (HDFS-7961) Trigger full block report after hot swapping disk

2015-03-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14379963#comment-14379963 ] Hudson commented on HDFS-7961: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #134 (See [htt

[jira] [Commented] (HDFS-7875) Improve log message when wrong value configured for dfs.datanode.failed.volumes.tolerated

2015-03-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14379961#comment-14379961 ] Hudson commented on HDFS-7875: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #134 (See [htt

[jira] [Commented] (HDFS-7977) NFS couldn't take percentile intervals

2015-03-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14379964#comment-14379964 ] Hudson commented on HDFS-7977: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #134 (See [htt

[jira] [Commented] (HDFS-7713) Implement mkdirs in the HDFS Web UI

2015-03-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14379970#comment-14379970 ] Hudson commented on HDFS-7713: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #134 (See [htt

[jira] [Commented] (HDFS-7985) WebHDFS should be always enabled

2015-03-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14379962#comment-14379962 ] Hudson commented on HDFS-7985: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #134 (See [htt

[jira] [Commented] (HDFS-6826) Plugin interface to enable delegation of HDFS authorization assertions

2015-03-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14379974#comment-14379974 ] Hudson commented on HDFS-6826: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #134 (See [htt

[jira] [Commented] (HDFS-7976) Update NFS user guide for mount option "sync" to minimize or avoid reordered writes

2015-03-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14379965#comment-14379965 ] Hudson commented on HDFS-7976: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #134 (See [htt

[jira] [Commented] (HDFS-6353) Handle checkpoint failure more gracefully

2015-03-25 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380003#comment-14380003 ] Kihwal Lee commented on HDFS-6353: -- +1 The command and the protorol change look fine. Than

[jira] [Commented] (HDFS-7854) Separate class DataStreamer out of DFSOutputStream

2015-03-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14379976#comment-14379976 ] Hudson commented on HDFS-7854: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #134 (See [htt

[jira] [Commented] (HDFS-7976) Update NFS user guide for mount option "sync" to minimize or avoid reordered writes

2015-03-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380019#comment-14380019 ] Hudson commented on HDFS-7976: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #143 (See

[jira] [Commented] (HDFS-7875) Improve log message when wrong value configured for dfs.datanode.failed.volumes.tolerated

2015-03-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380015#comment-14380015 ] Hudson commented on HDFS-7875: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #143 (See

[jira] [Commented] (HDFS-7977) NFS couldn't take percentile intervals

2015-03-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380018#comment-14380018 ] Hudson commented on HDFS-7977: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #143 (See

[jira] [Commented] (HDFS-7713) Implement mkdirs in the HDFS Web UI

2015-03-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380024#comment-14380024 ] Hudson commented on HDFS-7713: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #143 (See

[jira] [Commented] (HDFS-7985) WebHDFS should be always enabled

2015-03-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380016#comment-14380016 ] Hudson commented on HDFS-7985: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #143 (See

[jira] [Commented] (HDFS-7854) Separate class DataStreamer out of DFSOutputStream

2015-03-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380029#comment-14380029 ] Hudson commented on HDFS-7854: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #143 (See

[jira] [Commented] (HDFS-6826) Plugin interface to enable delegation of HDFS authorization assertions

2015-03-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380027#comment-14380027 ] Hudson commented on HDFS-6826: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #143 (See

[jira] [Commented] (HDFS-7961) Trigger full block report after hot swapping disk

2015-03-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380017#comment-14380017 ] Hudson commented on HDFS-7961: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #143 (See

[jira] [Commented] (HDFS-7891) A block placement policy with best fault tolerance

2015-03-25 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380038#comment-14380038 ] Walter Su commented on HDFS-7891: - Thanks Tsz for analysis so deeply. This is a great thoug

[jira] [Commented] (HDFS-7875) Improve log message when wrong value configured for dfs.datanode.failed.volumes.tolerated

2015-03-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380072#comment-14380072 ] Hudson commented on HDFS-7875: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2093 (See [htt

[jira] [Commented] (HDFS-7976) Update NFS user guide for mount option "sync" to minimize or avoid reordered writes

2015-03-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380076#comment-14380076 ] Hudson commented on HDFS-7976: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2093 (See [htt

[jira] [Commented] (HDFS-6826) Plugin interface to enable delegation of HDFS authorization assertions

2015-03-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380084#comment-14380084 ] Hudson commented on HDFS-6826: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2093 (See [htt

[jira] [Commented] (HDFS-7961) Trigger full block report after hot swapping disk

2015-03-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380074#comment-14380074 ] Hudson commented on HDFS-7961: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2093 (See [htt

[jira] [Commented] (HDFS-7854) Separate class DataStreamer out of DFSOutputStream

2015-03-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380086#comment-14380086 ] Hudson commented on HDFS-7854: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2093 (See [htt

[jira] [Commented] (HDFS-7713) Implement mkdirs in the HDFS Web UI

2015-03-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380081#comment-14380081 ] Hudson commented on HDFS-7713: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2093 (See [htt

[jira] [Commented] (HDFS-7977) NFS couldn't take percentile intervals

2015-03-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380075#comment-14380075 ] Hudson commented on HDFS-7977: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2093 (See [htt

[jira] [Commented] (HDFS-7985) WebHDFS should be always enabled

2015-03-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380073#comment-14380073 ] Hudson commented on HDFS-7985: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2093 (See [htt

[jira] [Commented] (HDFS-7471) TestDatanodeManager#testNumVersionsReportedCorrect occasionally fails

2015-03-25 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380097#comment-14380097 ] Kihwal Lee commented on HDFS-7471: -- We've seen this in HDFS-7433. [~daryn] and I thought H

[jira] [Commented] (HDFS-7985) WebHDFS should be always enabled

2015-03-25 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380130#comment-14380130 ] Allen Wittenauer commented on HDFS-7985: (Just so no one else has to look, no, this

[jira] [Updated] (HDFS-2964) No notice in any logs if dfs.datanode.du.reserved is greater than available disk space

2015-03-25 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J updated HDFS-2964: -- Attachment: HDFS-2964-2.patch +1 on this. I cleaned up the message to be more informative (print path and bytes

[jira] [Updated] (HDFS-2964) No notice in any logs if dfs.datanode.du.reserved is greater than available disk space

2015-03-25 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J updated HDFS-2964: -- Affects Version/s: (was: 0.20.2) 2.6.0 > No notice in any logs if dfs.datanode.du.rese

[jira] [Updated] (HDFS-2964) No notice in any logs if dfs.datanode.du.reserved is greater than available disk space

2015-03-25 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J updated HDFS-2964: -- Component/s: (was: namenode) > No notice in any logs if dfs.datanode.du.reserved is greater than available >

[jira] [Commented] (HDFS-2964) No notice in any logs if dfs.datanode.du.reserved is greater than available disk space

2015-03-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380294#comment-14380294 ] Hadoop QA commented on HDFS-2964: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-2964) No notice in any logs if dfs.datanode.du.reserved is greater than available disk space

2015-03-25 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J updated HDFS-2964: -- Attachment: HDFS-2964-3.patch > No notice in any logs if dfs.datanode.du.reserved is greater than available > di

[jira] [Updated] (HDFS-6353) Check and make checkpoint before stopping the NameNode

2015-03-25 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6353: Summary: Check and make checkpoint before stopping the NameNode (was: Handle checkpoint failure more gracefu

[jira] [Comment Edited] (HDFS-7985) WebHDFS should be always enabled

2015-03-25 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14379293#comment-14379293 ] Haohui Mai edited comment on HDFS-7985 at 3/25/15 5:39 PM: --- I've

[jira] [Commented] (HDFS-7713) Implement mkdirs in the HDFS Web UI

2015-03-25 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380385#comment-14380385 ] Ravi Prakash commented on HDFS-7713: Thanks a lot for your detailed and persistent revi

[jira] [Commented] (HDFS-6353) Check and make checkpoint before stopping the NameNode

2015-03-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380390#comment-14380390 ] Hudson commented on HDFS-6353: -- FAILURE: Integrated in Hadoop-trunk-Commit #7433 (See [https:

[jira] [Updated] (HDFS-7782) Read a striping layout file from client side

2015-03-25 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-7782: Attachment: HDFS-7782-004.patch The new patch has several updates: # Disabled hedged read, leaving it as a TO

[jira] [Updated] (HDFS-6353) Check and make checkpoint before stopping the NameNode

2015-03-25 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6353: Resolution: Fixed Fix Version/s: 3.0.0 Hadoop Flags: Reviewed Status: Resolved (was: P

[jira] [Commented] (HDFS-6353) Check and make checkpoint before stopping the NameNode

2015-03-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380405#comment-14380405 ] Hudson commented on HDFS-6353: -- FAILURE: Integrated in Hadoop-trunk-Commit #7434 (See [https:

[jira] [Commented] (HDFS-7959) WebHdfs logging is missing on Datanode

2015-03-25 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380413#comment-14380413 ] Kihwal Lee commented on HDFS-7959: -- It is probably a good idea to sanitize the tokens in t

[jira] [Commented] (HDFS-5796) The file system browser in the namenode UI requires SPNEGO.

2015-03-25 Thread Ryan Sasson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380429#comment-14380429 ] Ryan Sasson commented on HDFS-5796: --- This sounds reasonable, my only question is why not

[jira] [Commented] (HDFS-7959) WebHdfs logging is missing on Datanode

2015-03-25 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380427#comment-14380427 ] Haohui Mai commented on HDFS-7959: -- bq. Besides, not all the components in the current jet

[jira] [Commented] (HDFS-7782) Read a striping layout file from client side

2015-03-25 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380435#comment-14380435 ] Jing Zhao commented on HDFS-7782: - Thanks for updating the patch, [~zhz]! I think finally

[jira] [Commented] (HDFS-7782) Read a striping layout file from client side

2015-03-25 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380457#comment-14380457 ] Zhe Zhang commented on HDFS-7782: - Thanks Jing for the quick feedback! bq. We can first on

[jira] [Commented] (HDFS-7891) A block placement policy with best fault tolerance

2015-03-25 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380482#comment-14380482 ] Zhe Zhang commented on HDFS-7891: - Thanks Nicholas and Walter for the discussion! bq. I th

[jira] [Commented] (HDFS-7891) A block placement policy with best fault tolerance

2015-03-25 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380569#comment-14380569 ] Zhe Zhang commented on HDFS-7891: - [~walter.k.su] Below are my comments about 004 patch: #

[jira] [Commented] (HDFS-7616) Add a test for BlockGroup support in FSImage

2015-03-25 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380574#comment-14380574 ] Zhe Zhang commented on HDFS-7616: - Thanks Takuya for the work and Nicholas for the review!

[jira] [Commented] (HDFS-7959) WebHdfs logging is missing on Datanode

2015-03-25 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380576#comment-14380576 ] Kihwal Lee commented on HDFS-7959: -- >I think that the right fix is to move delegation toke

[jira] [Commented] (HDFS-7617) Add editlog transactions for EC

2015-03-25 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380588#comment-14380588 ] Zhe Zhang commented on HDFS-7617: - Thanks for the patch Hui. The 2 tests in the patch look

[jira] [Updated] (HDFS-7471) TestDatanodeManager#testNumVersionsReportedCorrect occasionally fails

2015-03-25 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated HDFS-7471: --- Attachment: PreCommit-HDFS-Build #9898 test - testNumVersionsReportedCorrect [Jenkins].html Thanks for

[jira] [Created] (HDFS-7989) NFS gateway should shutdown when it can't bind the serivce ports

2015-03-25 Thread Brandon Li (JIRA)
Brandon Li created HDFS-7989: Summary: NFS gateway should shutdown when it can't bind the serivce ports Key: HDFS-7989 URL: https://issues.apache.org/jira/browse/HDFS-7989 Project: Hadoop HDFS I

[jira] [Commented] (HDFS-7928) Scanning blocks from disk during rolling upgrade startup takes a lot of time if disks are busy

2015-03-25 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380642#comment-14380642 ] Kihwal Lee commented on HDFS-7928: -- +1 the latest patch looks good. > Scanning blocks fro

[jira] [Updated] (HDFS-7928) Scanning blocks from disk during rolling upgrade startup takes a lot of time if disks are busy

2015-03-25 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-7928: - Resolution: Fixed Fix Version/s: 2.8.0 Hadoop Flags: Reviewed Status: Resolved (was:

  1   2   >