[jira] [Commented] (HDFS-8694) Expose the stats of IOErrors on each FsVolume through JMX
[
https://issues.apache.org/jira/browse/HDFS-8694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14614132#comment-14614132
]
Hadoop QA commented on HDFS-8694:
-
\\
\\
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:red}-1{color} | pre-patch | 18m 5s | Pre-patch trunk has 1 extant
Findbugs (version 3.0.0) warnings. |
| {color:green}+1{color} | @author | 0m 0s | The patch does not contain any
@author tags. |
| {color:green}+1{color} | tests included | 0m 0s | The patch appears to
include 8 new or modified test files. |
| {color:green}+1{color} | javac | 7m 32s | There were no new javac warning
messages. |
| {color:green}+1{color} | javadoc | 9m 40s | There were no new javadoc
warning messages. |
| {color:green}+1{color} | release audit | 0m 23s | The applied patch does
not increase the total number of release audit warnings. |
| {color:red}-1{color} | checkstyle | 2m 16s | The applied patch generated 2
new checkstyle issues (total was 446, now 440). |
| {color:green}+1{color} | whitespace | 0m 5s | The patch has no lines that
end in whitespace. |
| {color:green}+1{color} | install | 1m 36s | mvn install still works. |
| {color:green}+1{color} | eclipse:eclipse | 0m 34s | The patch built with
eclipse:eclipse. |
| {color:green}+1{color} | findbugs | 3m 17s | The patch does not introduce
any new Findbugs (version 3.0.0) warnings. |
| {color:green}+1{color} | native | 3m 16s | Pre-build of native portion |
| {color:red}-1{color} | hdfs tests | 158m 48s | Tests failed in hadoop-hdfs. |
| | | 205m 35s | |
\\
\\
|| Reason || Tests ||
| Failed unit tests | hadoop.hdfs.server.namenode.ha.TestStandbyIsHot |
\\
\\
|| Subsystem || Report/Notes ||
| Patch URL |
http://issues.apache.org/jira/secure/attachment/12743409/HDFS-8694.001.patch |
| Optional Tests | javadoc javac unit findbugs checkstyle |
| git revision | trunk / 2eae130 |
| Pre-patch Findbugs warnings |
https://builds.apache.org/job/PreCommit-HDFS-Build/11574/artifact/patchprocess/trunkFindbugsWarningshadoop-hdfs.html
|
| checkstyle |
https://builds.apache.org/job/PreCommit-HDFS-Build/11574/artifact/patchprocess/diffcheckstylehadoop-hdfs.txt
|
| hadoop-hdfs test log |
https://builds.apache.org/job/PreCommit-HDFS-Build/11574/artifact/patchprocess/testrun_hadoop-hdfs.txt
|
| Test Results |
https://builds.apache.org/job/PreCommit-HDFS-Build/11574/testReport/ |
| Java | 1.7.0_55 |
| uname | Linux asf909.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP
PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux |
| Console output |
https://builds.apache.org/job/PreCommit-HDFS-Build/11574/console |
This message was automatically generated.
> Expose the stats of IOErrors on each FsVolume through JMX
> -
>
> Key: HDFS-8694
> URL: https://issues.apache.org/jira/browse/HDFS-8694
> Project: Hadoop HDFS
> Issue Type: Improvement
> Components: datanode, HDFS
>Affects Versions: 2.7.0
>Reporter: Lei (Eddy) Xu
>Assignee: Lei (Eddy) Xu
> Attachments: HDFS-8694.000.patch, HDFS-8694.001.patch
>
>
> Currently, once DataNode hits an {{IOError}} when writing / reading block
> files, it starts a background {{DiskChecker.checkDirs()}} thread. But if this
> thread successfully finishes, DN does not record this {{IOError}}.
> We need one measurement to count all {{IOErrors}} for each volume.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (HDFS-8710) Always read DU value from the cached "dfsUsed" file on datanode startup
[ https://issues.apache.org/jira/browse/HDFS-8710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-8710: --- Resolution: Won't Fix Status: Resolved (was: Patch Available) > Always read DU value from the cached "dfsUsed" file on datanode startup > --- > > Key: HDFS-8710 > URL: https://issues.apache.org/jira/browse/HDFS-8710 > Project: Hadoop HDFS > Issue Type: Improvement >Reporter: Xinwei Qin >Assignee: Xinwei Qin > Attachments: HDFS-8710.001.patch > > > Currently, DataNode will cache DU value in "dfsUsed" file termly. When > DataNode starts or restarts, it will read in the cached DU value from > "dfsUsed" file if the value is less than 600 seconds old, otherwise, it will > run DU command, which is a very time-consuming operation(may up to dozens of > minutes) when DataNode has huge number of blocks. > Since slight imprecision of dfsUsed is not critical, and the DU value will be > updated every 600 seconds (the default DU interval) after DataNode started, > we can always read DU value from the cached file (Regardless of whether this > value is less than 600 seconds old or not) and skip DU operation on DataNode > startup to significantly shorten the startup time. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HDFS-8710) Always read DU value from the cached "dfsUsed" file on datanode startup
[ https://issues.apache.org/jira/browse/HDFS-8710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14613975#comment-14613975 ] Allen Wittenauer commented on HDFS-8710: bq. In a large cluster, the DU can even cost several or tens of minutes, which slows down startup speed of the whole cluster, so quick startup is necessary. You don't need to tell me about large clusters. If start up time is a concern, then one should be using rolling upgrade or some other decayed stop/start on DN bring up. -1 on the change. It's ultimately confusing to operations folks to have to wait 10 minutes for their change to take place. Closing as won't fix. > Always read DU value from the cached "dfsUsed" file on datanode startup > --- > > Key: HDFS-8710 > URL: https://issues.apache.org/jira/browse/HDFS-8710 > Project: Hadoop HDFS > Issue Type: Improvement >Reporter: Xinwei Qin >Assignee: Xinwei Qin > Attachments: HDFS-8710.001.patch > > > Currently, DataNode will cache DU value in "dfsUsed" file termly. When > DataNode starts or restarts, it will read in the cached DU value from > "dfsUsed" file if the value is less than 600 seconds old, otherwise, it will > run DU command, which is a very time-consuming operation(may up to dozens of > minutes) when DataNode has huge number of blocks. > Since slight imprecision of dfsUsed is not critical, and the DU value will be > updated every 600 seconds (the default DU interval) after DataNode started, > we can always read DU value from the cached file (Regardless of whether this > value is less than 600 seconds old or not) and skip DU operation on DataNode > startup to significantly shorten the startup time. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HDFS-8706) Fix typo in datanode startup options in HDFSCommands.html
[
https://issues.apache.org/jira/browse/HDFS-8706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14613947#comment-14613947
]
Hudson commented on HDFS-8706:
--
FAILURE: Integrated in Hadoop-Mapreduce-trunk #2192 (See
[https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2192/])
HDFS-8706. Fix typo in datanode startup options in HDFSCommands.html.
(Controibuted by Brahma Reddy Battula) (arp: rev
ec0dc71cabb2b243a83fe4a7f6ba744907367666)
* hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSCommands.md
* hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
> Fix typo in datanode startup options in HDFSCommands.html
> -
>
> Key: HDFS-8706
> URL: https://issues.apache.org/jira/browse/HDFS-8706
> Project: Hadoop HDFS
> Issue Type: Bug
>Reporter: Brahma Reddy Battula
>Assignee: Brahma Reddy Battula
> Fix For: 2.8.0
>
> Attachments: HDFS-8706.patch
>
>
> *Option provided in the #HDFSCommands.html*
> Usage: hdfs datanode [-regular | -rollback |
> -rollingupgra{color:red}c{color}e rollback]
> *Should be like following.*
> Usage: hdfs datanode [-regular | -rollback |
> -rollingupgra{color:green}d{color}e rollback]
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HDFS-8666) speedup TestMover
[ https://issues.apache.org/jira/browse/HDFS-8666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14613939#comment-14613939 ] Hudson commented on HDFS-8666: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2192 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2192/]) HDFS-8666. Speedup the TestMover test. Contributed by Walter Su. (jing9: rev 152e5df3b65394c2939d6de3c4a649a207bb58d3) * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/mover/TestMover.java * hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt > speedup TestMover > - > > Key: HDFS-8666 > URL: https://issues.apache.org/jira/browse/HDFS-8666 > Project: Hadoop HDFS > Issue Type: Bug > Components: test >Reporter: Walter Su >Assignee: Walter Su > Fix For: 2.8.0 > > Attachments: HDFS-8666.01.patch > > > TestMover is one of the most time consuming tests.(See > [TestReport#1|https://builds.apache.org/job/PreCommit-HDFS-Build/11450/testReport/] > ) > It often timeout. (See > [TestReport#2|https://issues.apache.org/jira/browse/HDFS-8652?focusedCommentId=14598394&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-14598394] > ) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HDFS-8709) Clarify automatic sync in FSEditLog#logEdit
[ https://issues.apache.org/jira/browse/HDFS-8709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14613945#comment-14613945 ] Hudson commented on HDFS-8709: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2192 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2192/]) HDFS-8709. Clarify automatic sync in FSEditLog#logEdit. (wang: rev 5fddc5177ddad07a735d49c15a63cfc5f74d0891) * hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSEditLog.java > Clarify automatic sync in FSEditLog#logEdit > --- > > Key: HDFS-8709 > URL: https://issues.apache.org/jira/browse/HDFS-8709 > Project: Hadoop HDFS > Issue Type: Improvement >Affects Versions: 2.0.6-alpha >Reporter: Andrew Wang >Assignee: Andrew Wang >Priority: Minor > Fix For: 2.8.0 > > Attachments: hdfs-8709.001.patch > > > The code flow and comments regarding the logSync() in logEdit() is a little > messy, could be improved. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HDFS-8703) Merge refactor of DFSInputStream from ErasureCoding branch
[ https://issues.apache.org/jira/browse/HDFS-8703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14613952#comment-14613952 ] Hudson commented on HDFS-8703: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2192 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2192/]) HDFS-8703. Merge refactor of DFSInputStream from ErasureCoding branch (Contributed by Vinayakumar B) (vinayakumarb: rev bff5999d07e9416a22846c849487e509ede55040) * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSClient.java * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSClientRetries.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSInputStream.java * hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt > Merge refactor of DFSInputStream from ErasureCoding branch > -- > > Key: HDFS-8703 > URL: https://issues.apache.org/jira/browse/HDFS-8703 > Project: Hadoop HDFS > Issue Type: Improvement >Reporter: Vinayakumar B >Assignee: Vinayakumar B > Fix For: 2.8.0 > > Attachments: HDFS-8703-01.patch, HDFS-8703-02.patch > > > There were some refactors done in DFSInputStream for the support of > ErasureCoding in branch HDFS-7285. > These refactors are generic and applicable to current trunk > This Jira targets to merge them back to trunk to reduce size of the final > merge patch for the branch. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HDFS-8577) Avoid retrying to recover lease on a file which does not exist
[
https://issues.apache.org/jira/browse/HDFS-8577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14613940#comment-14613940
]
Hudson commented on HDFS-8577:
--
FAILURE: Integrated in Hadoop-Mapreduce-trunk #2192 (See
[https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2192/])
HDFS-8577. Avoid retrying to recover lease on a file which does not exist
(Contributed by J.Andreina) (vinayakumarb: rev
2eae130ab9edd318c82503c2306f610f2b5a3e51)
*
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/tools/DebugAdmin.java
* hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
*
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/tools/TestDebugAdmin.java
> Avoid retrying to recover lease on a file which does not exist
> --
>
> Key: HDFS-8577
> URL: https://issues.apache.org/jira/browse/HDFS-8577
> Project: Hadoop HDFS
> Issue Type: Bug
>Reporter: J.Andreina
>Assignee: J.Andreina
> Fix For: 2.8.0
>
> Attachments: HDFS-8577.1.patch, HDFS-8577.2.patch
>
>
> 1. Avoid retrying to recover lease on a file which does not exist
> {noformat}
> recoverLease got exception:
> java.io.FileNotFoundException: File does not exist: /hello_hi
> at
> org.apache.hadoop.hdfs.server.namenode.INodeFile.valueOf(INodeFile.java:71)
> Retrying in 5000 ms...
> Retry #1
> recoverLease got exception:
> java.io.FileNotFoundException: File does not exist: /hello_hi
> at
> org.apache.hadoop.hdfs.server.namenode.INodeFile.valueOf(INodeFile.java:71)
> {noformat}
> 2. Avoid populating huge stack trace for each retry for recovering lease on a
> file , being displayed on CLI .
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HDFS-8703) Merge refactor of DFSInputStream from ErasureCoding branch
[ https://issues.apache.org/jira/browse/HDFS-8703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14613907#comment-14613907 ] Hudson commented on HDFS-8703: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #2173 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/2173/]) HDFS-8703. Merge refactor of DFSInputStream from ErasureCoding branch (Contributed by Vinayakumar B) (vinayakumarb: rev bff5999d07e9416a22846c849487e509ede55040) * hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSClientRetries.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSInputStream.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSClient.java > Merge refactor of DFSInputStream from ErasureCoding branch > -- > > Key: HDFS-8703 > URL: https://issues.apache.org/jira/browse/HDFS-8703 > Project: Hadoop HDFS > Issue Type: Improvement >Reporter: Vinayakumar B >Assignee: Vinayakumar B > Fix For: 2.8.0 > > Attachments: HDFS-8703-01.patch, HDFS-8703-02.patch > > > There were some refactors done in DFSInputStream for the support of > ErasureCoding in branch HDFS-7285. > These refactors are generic and applicable to current trunk > This Jira targets to merge them back to trunk to reduce size of the final > merge patch for the branch. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HDFS-8577) Avoid retrying to recover lease on a file which does not exist
[
https://issues.apache.org/jira/browse/HDFS-8577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14613895#comment-14613895
]
Hudson commented on HDFS-8577:
--
SUCCESS: Integrated in Hadoop-Hdfs-trunk #2173 (See
[https://builds.apache.org/job/Hadoop-Hdfs-trunk/2173/])
HDFS-8577. Avoid retrying to recover lease on a file which does not exist
(Contributed by J.Andreina) (vinayakumarb: rev
2eae130ab9edd318c82503c2306f610f2b5a3e51)
*
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/tools/DebugAdmin.java
* hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
*
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/tools/TestDebugAdmin.java
> Avoid retrying to recover lease on a file which does not exist
> --
>
> Key: HDFS-8577
> URL: https://issues.apache.org/jira/browse/HDFS-8577
> Project: Hadoop HDFS
> Issue Type: Bug
>Reporter: J.Andreina
>Assignee: J.Andreina
> Fix For: 2.8.0
>
> Attachments: HDFS-8577.1.patch, HDFS-8577.2.patch
>
>
> 1. Avoid retrying to recover lease on a file which does not exist
> {noformat}
> recoverLease got exception:
> java.io.FileNotFoundException: File does not exist: /hello_hi
> at
> org.apache.hadoop.hdfs.server.namenode.INodeFile.valueOf(INodeFile.java:71)
> Retrying in 5000 ms...
> Retry #1
> recoverLease got exception:
> java.io.FileNotFoundException: File does not exist: /hello_hi
> at
> org.apache.hadoop.hdfs.server.namenode.INodeFile.valueOf(INodeFile.java:71)
> {noformat}
> 2. Avoid populating huge stack trace for each retry for recovering lease on a
> file , being displayed on CLI .
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HDFS-8706) Fix typo in datanode startup options in HDFSCommands.html
[
https://issues.apache.org/jira/browse/HDFS-8706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14613902#comment-14613902
]
Hudson commented on HDFS-8706:
--
SUCCESS: Integrated in Hadoop-Hdfs-trunk #2173 (See
[https://builds.apache.org/job/Hadoop-Hdfs-trunk/2173/])
HDFS-8706. Fix typo in datanode startup options in HDFSCommands.html.
(Controibuted by Brahma Reddy Battula) (arp: rev
ec0dc71cabb2b243a83fe4a7f6ba744907367666)
* hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
* hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSCommands.md
> Fix typo in datanode startup options in HDFSCommands.html
> -
>
> Key: HDFS-8706
> URL: https://issues.apache.org/jira/browse/HDFS-8706
> Project: Hadoop HDFS
> Issue Type: Bug
>Reporter: Brahma Reddy Battula
>Assignee: Brahma Reddy Battula
> Fix For: 2.8.0
>
> Attachments: HDFS-8706.patch
>
>
> *Option provided in the #HDFSCommands.html*
> Usage: hdfs datanode [-regular | -rollback |
> -rollingupgra{color:red}c{color}e rollback]
> *Should be like following.*
> Usage: hdfs datanode [-regular | -rollback |
> -rollingupgra{color:green}d{color}e rollback]
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HDFS-8709) Clarify automatic sync in FSEditLog#logEdit
[ https://issues.apache.org/jira/browse/HDFS-8709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14613900#comment-14613900 ] Hudson commented on HDFS-8709: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #2173 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/2173/]) HDFS-8709. Clarify automatic sync in FSEditLog#logEdit. (wang: rev 5fddc5177ddad07a735d49c15a63cfc5f74d0891) * hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSEditLog.java > Clarify automatic sync in FSEditLog#logEdit > --- > > Key: HDFS-8709 > URL: https://issues.apache.org/jira/browse/HDFS-8709 > Project: Hadoop HDFS > Issue Type: Improvement >Affects Versions: 2.0.6-alpha >Reporter: Andrew Wang >Assignee: Andrew Wang >Priority: Minor > Fix For: 2.8.0 > > Attachments: hdfs-8709.001.patch > > > The code flow and comments regarding the logSync() in logEdit() is a little > messy, could be improved. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HDFS-8666) speedup TestMover
[ https://issues.apache.org/jira/browse/HDFS-8666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14613894#comment-14613894 ] Hudson commented on HDFS-8666: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #2173 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/2173/]) HDFS-8666. Speedup the TestMover test. Contributed by Walter Su. (jing9: rev 152e5df3b65394c2939d6de3c4a649a207bb58d3) * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/mover/TestMover.java * hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt > speedup TestMover > - > > Key: HDFS-8666 > URL: https://issues.apache.org/jira/browse/HDFS-8666 > Project: Hadoop HDFS > Issue Type: Bug > Components: test >Reporter: Walter Su >Assignee: Walter Su > Fix For: 2.8.0 > > Attachments: HDFS-8666.01.patch > > > TestMover is one of the most time consuming tests.(See > [TestReport#1|https://builds.apache.org/job/PreCommit-HDFS-Build/11450/testReport/] > ) > It often timeout. (See > [TestReport#2|https://issues.apache.org/jira/browse/HDFS-8652?focusedCommentId=14598394&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-14598394] > ) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HDFS-8703) Merge refactor of DFSInputStream from ErasureCoding branch
[ https://issues.apache.org/jira/browse/HDFS-8703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14613891#comment-14613891 ] Hudson commented on HDFS-8703: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #234 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/234/]) HDFS-8703. Merge refactor of DFSInputStream from ErasureCoding branch (Contributed by Vinayakumar B) (vinayakumarb: rev bff5999d07e9416a22846c849487e509ede55040) * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSClientRetries.java * hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSClient.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSInputStream.java > Merge refactor of DFSInputStream from ErasureCoding branch > -- > > Key: HDFS-8703 > URL: https://issues.apache.org/jira/browse/HDFS-8703 > Project: Hadoop HDFS > Issue Type: Improvement >Reporter: Vinayakumar B >Assignee: Vinayakumar B > Fix For: 2.8.0 > > Attachments: HDFS-8703-01.patch, HDFS-8703-02.patch > > > There were some refactors done in DFSInputStream for the support of > ErasureCoding in branch HDFS-7285. > These refactors are generic and applicable to current trunk > This Jira targets to merge them back to trunk to reduce size of the final > merge patch for the branch. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HDFS-8709) Clarify automatic sync in FSEditLog#logEdit
[ https://issues.apache.org/jira/browse/HDFS-8709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14613884#comment-14613884 ] Hudson commented on HDFS-8709: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #234 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/234/]) HDFS-8709. Clarify automatic sync in FSEditLog#logEdit. (wang: rev 5fddc5177ddad07a735d49c15a63cfc5f74d0891) * hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSEditLog.java > Clarify automatic sync in FSEditLog#logEdit > --- > > Key: HDFS-8709 > URL: https://issues.apache.org/jira/browse/HDFS-8709 > Project: Hadoop HDFS > Issue Type: Improvement >Affects Versions: 2.0.6-alpha >Reporter: Andrew Wang >Assignee: Andrew Wang >Priority: Minor > Fix For: 2.8.0 > > Attachments: hdfs-8709.001.patch > > > The code flow and comments regarding the logSync() in logEdit() is a little > messy, could be improved. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HDFS-8666) speedup TestMover
[ https://issues.apache.org/jira/browse/HDFS-8666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14613878#comment-14613878 ] Hudson commented on HDFS-8666: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #234 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/234/]) HDFS-8666. Speedup the TestMover test. Contributed by Walter Su. (jing9: rev 152e5df3b65394c2939d6de3c4a649a207bb58d3) * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/mover/TestMover.java * hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt > speedup TestMover > - > > Key: HDFS-8666 > URL: https://issues.apache.org/jira/browse/HDFS-8666 > Project: Hadoop HDFS > Issue Type: Bug > Components: test >Reporter: Walter Su >Assignee: Walter Su > Fix For: 2.8.0 > > Attachments: HDFS-8666.01.patch > > > TestMover is one of the most time consuming tests.(See > [TestReport#1|https://builds.apache.org/job/PreCommit-HDFS-Build/11450/testReport/] > ) > It often timeout. (See > [TestReport#2|https://issues.apache.org/jira/browse/HDFS-8652?focusedCommentId=14598394&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-14598394] > ) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HDFS-8706) Fix typo in datanode startup options in HDFSCommands.html
[
https://issues.apache.org/jira/browse/HDFS-8706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14613886#comment-14613886
]
Hudson commented on HDFS-8706:
--
FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #234 (See
[https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/234/])
HDFS-8706. Fix typo in datanode startup options in HDFSCommands.html.
(Controibuted by Brahma Reddy Battula) (arp: rev
ec0dc71cabb2b243a83fe4a7f6ba744907367666)
* hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSCommands.md
* hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
> Fix typo in datanode startup options in HDFSCommands.html
> -
>
> Key: HDFS-8706
> URL: https://issues.apache.org/jira/browse/HDFS-8706
> Project: Hadoop HDFS
> Issue Type: Bug
>Reporter: Brahma Reddy Battula
>Assignee: Brahma Reddy Battula
> Fix For: 2.8.0
>
> Attachments: HDFS-8706.patch
>
>
> *Option provided in the #HDFSCommands.html*
> Usage: hdfs datanode [-regular | -rollback |
> -rollingupgra{color:red}c{color}e rollback]
> *Should be like following.*
> Usage: hdfs datanode [-regular | -rollback |
> -rollingupgra{color:green}d{color}e rollback]
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HDFS-8577) Avoid retrying to recover lease on a file which does not exist
[
https://issues.apache.org/jira/browse/HDFS-8577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14613879#comment-14613879
]
Hudson commented on HDFS-8577:
--
FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #234 (See
[https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/234/])
HDFS-8577. Avoid retrying to recover lease on a file which does not exist
(Contributed by J.Andreina) (vinayakumarb: rev
2eae130ab9edd318c82503c2306f610f2b5a3e51)
*
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/tools/DebugAdmin.java
* hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
*
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/tools/TestDebugAdmin.java
> Avoid retrying to recover lease on a file which does not exist
> --
>
> Key: HDFS-8577
> URL: https://issues.apache.org/jira/browse/HDFS-8577
> Project: Hadoop HDFS
> Issue Type: Bug
>Reporter: J.Andreina
>Assignee: J.Andreina
> Fix For: 2.8.0
>
> Attachments: HDFS-8577.1.patch, HDFS-8577.2.patch
>
>
> 1. Avoid retrying to recover lease on a file which does not exist
> {noformat}
> recoverLease got exception:
> java.io.FileNotFoundException: File does not exist: /hello_hi
> at
> org.apache.hadoop.hdfs.server.namenode.INodeFile.valueOf(INodeFile.java:71)
> Retrying in 5000 ms...
> Retry #1
> recoverLease got exception:
> java.io.FileNotFoundException: File does not exist: /hello_hi
> at
> org.apache.hadoop.hdfs.server.namenode.INodeFile.valueOf(INodeFile.java:71)
> {noformat}
> 2. Avoid populating huge stack trace for each retry for recovering lease on a
> file , being displayed on CLI .
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HDFS-8703) Merge refactor of DFSInputStream from ErasureCoding branch
[ https://issues.apache.org/jira/browse/HDFS-8703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14613875#comment-14613875 ] Hudson commented on HDFS-8703: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #244 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/244/]) HDFS-8703. Merge refactor of DFSInputStream from ErasureCoding branch (Contributed by Vinayakumar B) (vinayakumarb: rev bff5999d07e9416a22846c849487e509ede55040) * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSClientRetries.java * hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSClient.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSInputStream.java > Merge refactor of DFSInputStream from ErasureCoding branch > -- > > Key: HDFS-8703 > URL: https://issues.apache.org/jira/browse/HDFS-8703 > Project: Hadoop HDFS > Issue Type: Improvement >Reporter: Vinayakumar B >Assignee: Vinayakumar B > Fix For: 2.8.0 > > Attachments: HDFS-8703-01.patch, HDFS-8703-02.patch > > > There were some refactors done in DFSInputStream for the support of > ErasureCoding in branch HDFS-7285. > These refactors are generic and applicable to current trunk > This Jira targets to merge them back to trunk to reduce size of the final > merge patch for the branch. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HDFS-8666) speedup TestMover
[ https://issues.apache.org/jira/browse/HDFS-8666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14613862#comment-14613862 ] Hudson commented on HDFS-8666: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #244 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/244/]) HDFS-8666. Speedup the TestMover test. Contributed by Walter Su. (jing9: rev 152e5df3b65394c2939d6de3c4a649a207bb58d3) * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/mover/TestMover.java * hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt > speedup TestMover > - > > Key: HDFS-8666 > URL: https://issues.apache.org/jira/browse/HDFS-8666 > Project: Hadoop HDFS > Issue Type: Bug > Components: test >Reporter: Walter Su >Assignee: Walter Su > Fix For: 2.8.0 > > Attachments: HDFS-8666.01.patch > > > TestMover is one of the most time consuming tests.(See > [TestReport#1|https://builds.apache.org/job/PreCommit-HDFS-Build/11450/testReport/] > ) > It often timeout. (See > [TestReport#2|https://issues.apache.org/jira/browse/HDFS-8652?focusedCommentId=14598394&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-14598394] > ) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HDFS-8709) Clarify automatic sync in FSEditLog#logEdit
[ https://issues.apache.org/jira/browse/HDFS-8709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14613869#comment-14613869 ] Hudson commented on HDFS-8709: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #244 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/244/]) HDFS-8709. Clarify automatic sync in FSEditLog#logEdit. (wang: rev 5fddc5177ddad07a735d49c15a63cfc5f74d0891) * hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSEditLog.java > Clarify automatic sync in FSEditLog#logEdit > --- > > Key: HDFS-8709 > URL: https://issues.apache.org/jira/browse/HDFS-8709 > Project: Hadoop HDFS > Issue Type: Improvement >Affects Versions: 2.0.6-alpha >Reporter: Andrew Wang >Assignee: Andrew Wang >Priority: Minor > Fix For: 2.8.0 > > Attachments: hdfs-8709.001.patch > > > The code flow and comments regarding the logSync() in logEdit() is a little > messy, could be improved. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HDFS-8577) Avoid retrying to recover lease on a file which does not exist
[
https://issues.apache.org/jira/browse/HDFS-8577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14613863#comment-14613863
]
Hudson commented on HDFS-8577:
--
FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #244 (See
[https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/244/])
HDFS-8577. Avoid retrying to recover lease on a file which does not exist
(Contributed by J.Andreina) (vinayakumarb: rev
2eae130ab9edd318c82503c2306f610f2b5a3e51)
* hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
*
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/tools/TestDebugAdmin.java
*
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/tools/DebugAdmin.java
> Avoid retrying to recover lease on a file which does not exist
> --
>
> Key: HDFS-8577
> URL: https://issues.apache.org/jira/browse/HDFS-8577
> Project: Hadoop HDFS
> Issue Type: Bug
>Reporter: J.Andreina
>Assignee: J.Andreina
> Fix For: 2.8.0
>
> Attachments: HDFS-8577.1.patch, HDFS-8577.2.patch
>
>
> 1. Avoid retrying to recover lease on a file which does not exist
> {noformat}
> recoverLease got exception:
> java.io.FileNotFoundException: File does not exist: /hello_hi
> at
> org.apache.hadoop.hdfs.server.namenode.INodeFile.valueOf(INodeFile.java:71)
> Retrying in 5000 ms...
> Retry #1
> recoverLease got exception:
> java.io.FileNotFoundException: File does not exist: /hello_hi
> at
> org.apache.hadoop.hdfs.server.namenode.INodeFile.valueOf(INodeFile.java:71)
> {noformat}
> 2. Avoid populating huge stack trace for each retry for recovering lease on a
> file , being displayed on CLI .
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HDFS-8706) Fix typo in datanode startup options in HDFSCommands.html
[
https://issues.apache.org/jira/browse/HDFS-8706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14613870#comment-14613870
]
Hudson commented on HDFS-8706:
--
FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #244 (See
[https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/244/])
HDFS-8706. Fix typo in datanode startup options in HDFSCommands.html.
(Controibuted by Brahma Reddy Battula) (arp: rev
ec0dc71cabb2b243a83fe4a7f6ba744907367666)
* hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSCommands.md
* hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
> Fix typo in datanode startup options in HDFSCommands.html
> -
>
> Key: HDFS-8706
> URL: https://issues.apache.org/jira/browse/HDFS-8706
> Project: Hadoop HDFS
> Issue Type: Bug
>Reporter: Brahma Reddy Battula
>Assignee: Brahma Reddy Battula
> Fix For: 2.8.0
>
> Attachments: HDFS-8706.patch
>
>
> *Option provided in the #HDFSCommands.html*
> Usage: hdfs datanode [-regular | -rollback |
> -rollingupgra{color:red}c{color}e rollback]
> *Should be like following.*
> Usage: hdfs datanode [-regular | -rollback |
> -rollingupgra{color:green}d{color}e rollback]
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HDFS-8577) Avoid retrying to recover lease on a file which does not exist
[
https://issues.apache.org/jira/browse/HDFS-8577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14613824#comment-14613824
]
Hudson commented on HDFS-8577:
--
SUCCESS: Integrated in Hadoop-Yarn-trunk #976 (See
[https://builds.apache.org/job/Hadoop-Yarn-trunk/976/])
HDFS-8577. Avoid retrying to recover lease on a file which does not exist
(Contributed by J.Andreina) (vinayakumarb: rev
2eae130ab9edd318c82503c2306f610f2b5a3e51)
*
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/tools/DebugAdmin.java
* hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
*
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/tools/TestDebugAdmin.java
> Avoid retrying to recover lease on a file which does not exist
> --
>
> Key: HDFS-8577
> URL: https://issues.apache.org/jira/browse/HDFS-8577
> Project: Hadoop HDFS
> Issue Type: Bug
>Reporter: J.Andreina
>Assignee: J.Andreina
> Fix For: 2.8.0
>
> Attachments: HDFS-8577.1.patch, HDFS-8577.2.patch
>
>
> 1. Avoid retrying to recover lease on a file which does not exist
> {noformat}
> recoverLease got exception:
> java.io.FileNotFoundException: File does not exist: /hello_hi
> at
> org.apache.hadoop.hdfs.server.namenode.INodeFile.valueOf(INodeFile.java:71)
> Retrying in 5000 ms...
> Retry #1
> recoverLease got exception:
> java.io.FileNotFoundException: File does not exist: /hello_hi
> at
> org.apache.hadoop.hdfs.server.namenode.INodeFile.valueOf(INodeFile.java:71)
> {noformat}
> 2. Avoid populating huge stack trace for each retry for recovering lease on a
> file , being displayed on CLI .
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HDFS-8709) Clarify automatic sync in FSEditLog#logEdit
[ https://issues.apache.org/jira/browse/HDFS-8709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14613829#comment-14613829 ] Hudson commented on HDFS-8709: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #976 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk/976/]) HDFS-8709. Clarify automatic sync in FSEditLog#logEdit. (wang: rev 5fddc5177ddad07a735d49c15a63cfc5f74d0891) * hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSEditLog.java > Clarify automatic sync in FSEditLog#logEdit > --- > > Key: HDFS-8709 > URL: https://issues.apache.org/jira/browse/HDFS-8709 > Project: Hadoop HDFS > Issue Type: Improvement >Affects Versions: 2.0.6-alpha >Reporter: Andrew Wang >Assignee: Andrew Wang >Priority: Minor > Fix For: 2.8.0 > > Attachments: hdfs-8709.001.patch > > > The code flow and comments regarding the logSync() in logEdit() is a little > messy, could be improved. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HDFS-8703) Merge refactor of DFSInputStream from ErasureCoding branch
[ https://issues.apache.org/jira/browse/HDFS-8703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14613836#comment-14613836 ] Hudson commented on HDFS-8703: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #976 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk/976/]) HDFS-8703. Merge refactor of DFSInputStream from ErasureCoding branch (Contributed by Vinayakumar B) (vinayakumarb: rev bff5999d07e9416a22846c849487e509ede55040) * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSInputStream.java * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSClientRetries.java * hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSClient.java > Merge refactor of DFSInputStream from ErasureCoding branch > -- > > Key: HDFS-8703 > URL: https://issues.apache.org/jira/browse/HDFS-8703 > Project: Hadoop HDFS > Issue Type: Improvement >Reporter: Vinayakumar B >Assignee: Vinayakumar B > Fix For: 2.8.0 > > Attachments: HDFS-8703-01.patch, HDFS-8703-02.patch > > > There were some refactors done in DFSInputStream for the support of > ErasureCoding in branch HDFS-7285. > These refactors are generic and applicable to current trunk > This Jira targets to merge them back to trunk to reduce size of the final > merge patch for the branch. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HDFS-8706) Fix typo in datanode startup options in HDFSCommands.html
[
https://issues.apache.org/jira/browse/HDFS-8706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14613831#comment-14613831
]
Hudson commented on HDFS-8706:
--
SUCCESS: Integrated in Hadoop-Yarn-trunk #976 (See
[https://builds.apache.org/job/Hadoop-Yarn-trunk/976/])
HDFS-8706. Fix typo in datanode startup options in HDFSCommands.html.
(Controibuted by Brahma Reddy Battula) (arp: rev
ec0dc71cabb2b243a83fe4a7f6ba744907367666)
* hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
* hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSCommands.md
> Fix typo in datanode startup options in HDFSCommands.html
> -
>
> Key: HDFS-8706
> URL: https://issues.apache.org/jira/browse/HDFS-8706
> Project: Hadoop HDFS
> Issue Type: Bug
>Reporter: Brahma Reddy Battula
>Assignee: Brahma Reddy Battula
> Fix For: 2.8.0
>
> Attachments: HDFS-8706.patch
>
>
> *Option provided in the #HDFSCommands.html*
> Usage: hdfs datanode [-regular | -rollback |
> -rollingupgra{color:red}c{color}e rollback]
> *Should be like following.*
> Usage: hdfs datanode [-regular | -rollback |
> -rollingupgra{color:green}d{color}e rollback]
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HDFS-8666) speedup TestMover
[ https://issues.apache.org/jira/browse/HDFS-8666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14613823#comment-14613823 ] Hudson commented on HDFS-8666: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #976 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk/976/]) HDFS-8666. Speedup the TestMover test. Contributed by Walter Su. (jing9: rev 152e5df3b65394c2939d6de3c4a649a207bb58d3) * hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/mover/TestMover.java > speedup TestMover > - > > Key: HDFS-8666 > URL: https://issues.apache.org/jira/browse/HDFS-8666 > Project: Hadoop HDFS > Issue Type: Bug > Components: test >Reporter: Walter Su >Assignee: Walter Su > Fix For: 2.8.0 > > Attachments: HDFS-8666.01.patch > > > TestMover is one of the most time consuming tests.(See > [TestReport#1|https://builds.apache.org/job/PreCommit-HDFS-Build/11450/testReport/] > ) > It often timeout. (See > [TestReport#2|https://issues.apache.org/jira/browse/HDFS-8652?focusedCommentId=14598394&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-14598394] > ) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HDFS-8577) Avoid retrying to recover lease on a file which does not exist
[
https://issues.apache.org/jira/browse/HDFS-8577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14613807#comment-14613807
]
Hudson commented on HDFS-8577:
--
FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #246 (See
[https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/246/])
HDFS-8577. Avoid retrying to recover lease on a file which does not exist
(Contributed by J.Andreina) (vinayakumarb: rev
2eae130ab9edd318c82503c2306f610f2b5a3e51)
*
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/tools/DebugAdmin.java
*
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/tools/TestDebugAdmin.java
* hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
> Avoid retrying to recover lease on a file which does not exist
> --
>
> Key: HDFS-8577
> URL: https://issues.apache.org/jira/browse/HDFS-8577
> Project: Hadoop HDFS
> Issue Type: Bug
>Reporter: J.Andreina
>Assignee: J.Andreina
> Fix For: 2.8.0
>
> Attachments: HDFS-8577.1.patch, HDFS-8577.2.patch
>
>
> 1. Avoid retrying to recover lease on a file which does not exist
> {noformat}
> recoverLease got exception:
> java.io.FileNotFoundException: File does not exist: /hello_hi
> at
> org.apache.hadoop.hdfs.server.namenode.INodeFile.valueOf(INodeFile.java:71)
> Retrying in 5000 ms...
> Retry #1
> recoverLease got exception:
> java.io.FileNotFoundException: File does not exist: /hello_hi
> at
> org.apache.hadoop.hdfs.server.namenode.INodeFile.valueOf(INodeFile.java:71)
> {noformat}
> 2. Avoid populating huge stack trace for each retry for recovering lease on a
> file , being displayed on CLI .
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HDFS-8703) Merge refactor of DFSInputStream from ErasureCoding branch
[ https://issues.apache.org/jira/browse/HDFS-8703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14613819#comment-14613819 ] Hudson commented on HDFS-8703: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #246 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/246/]) HDFS-8703. Merge refactor of DFSInputStream from ErasureCoding branch (Contributed by Vinayakumar B) (vinayakumarb: rev bff5999d07e9416a22846c849487e509ede55040) * hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSClient.java * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSClientRetries.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSInputStream.java > Merge refactor of DFSInputStream from ErasureCoding branch > -- > > Key: HDFS-8703 > URL: https://issues.apache.org/jira/browse/HDFS-8703 > Project: Hadoop HDFS > Issue Type: Improvement >Reporter: Vinayakumar B >Assignee: Vinayakumar B > Fix For: 2.8.0 > > Attachments: HDFS-8703-01.patch, HDFS-8703-02.patch > > > There were some refactors done in DFSInputStream for the support of > ErasureCoding in branch HDFS-7285. > These refactors are generic and applicable to current trunk > This Jira targets to merge them back to trunk to reduce size of the final > merge patch for the branch. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HDFS-8706) Fix typo in datanode startup options in HDFSCommands.html
[
https://issues.apache.org/jira/browse/HDFS-8706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14613814#comment-14613814
]
Hudson commented on HDFS-8706:
--
FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #246 (See
[https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/246/])
HDFS-8706. Fix typo in datanode startup options in HDFSCommands.html.
(Controibuted by Brahma Reddy Battula) (arp: rev
ec0dc71cabb2b243a83fe4a7f6ba744907367666)
* hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
* hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSCommands.md
> Fix typo in datanode startup options in HDFSCommands.html
> -
>
> Key: HDFS-8706
> URL: https://issues.apache.org/jira/browse/HDFS-8706
> Project: Hadoop HDFS
> Issue Type: Bug
>Reporter: Brahma Reddy Battula
>Assignee: Brahma Reddy Battula
> Fix For: 2.8.0
>
> Attachments: HDFS-8706.patch
>
>
> *Option provided in the #HDFSCommands.html*
> Usage: hdfs datanode [-regular | -rollback |
> -rollingupgra{color:red}c{color}e rollback]
> *Should be like following.*
> Usage: hdfs datanode [-regular | -rollback |
> -rollingupgra{color:green}d{color}e rollback]
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HDFS-8709) Clarify automatic sync in FSEditLog#logEdit
[ https://issues.apache.org/jira/browse/HDFS-8709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14613812#comment-14613812 ] Hudson commented on HDFS-8709: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #246 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/246/]) HDFS-8709. Clarify automatic sync in FSEditLog#logEdit. (wang: rev 5fddc5177ddad07a735d49c15a63cfc5f74d0891) * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSEditLog.java * hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt > Clarify automatic sync in FSEditLog#logEdit > --- > > Key: HDFS-8709 > URL: https://issues.apache.org/jira/browse/HDFS-8709 > Project: Hadoop HDFS > Issue Type: Improvement >Affects Versions: 2.0.6-alpha >Reporter: Andrew Wang >Assignee: Andrew Wang >Priority: Minor > Fix For: 2.8.0 > > Attachments: hdfs-8709.001.patch > > > The code flow and comments regarding the logSync() in logEdit() is a little > messy, could be improved. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HDFS-8666) speedup TestMover
[ https://issues.apache.org/jira/browse/HDFS-8666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14613806#comment-14613806 ] Hudson commented on HDFS-8666: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #246 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/246/]) HDFS-8666. Speedup the TestMover test. Contributed by Walter Su. (jing9: rev 152e5df3b65394c2939d6de3c4a649a207bb58d3) * hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/mover/TestMover.java > speedup TestMover > - > > Key: HDFS-8666 > URL: https://issues.apache.org/jira/browse/HDFS-8666 > Project: Hadoop HDFS > Issue Type: Bug > Components: test >Reporter: Walter Su >Assignee: Walter Su > Fix For: 2.8.0 > > Attachments: HDFS-8666.01.patch > > > TestMover is one of the most time consuming tests.(See > [TestReport#1|https://builds.apache.org/job/PreCommit-HDFS-Build/11450/testReport/] > ) > It often timeout. (See > [TestReport#2|https://issues.apache.org/jira/browse/HDFS-8652?focusedCommentId=14598394&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-14598394] > ) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HDFS-7285) Erasure Coding Support inside HDFS
[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-7285: Attachment: HDFS-7285-merge-consolidated.trunk.04.patch > Erasure Coding Support inside HDFS > -- > > Key: HDFS-7285 > URL: https://issues.apache.org/jira/browse/HDFS-7285 > Project: Hadoop HDFS > Issue Type: New Feature >Reporter: Weihua Jiang >Assignee: Zhe Zhang > Attachments: ECAnalyzer.py, ECParser.py, HDFS-7285-initial-PoC.patch, > HDFS-7285-merge-consolidated-01.patch, > HDFS-7285-merge-consolidated-trunk-01.patch, > HDFS-7285-merge-consolidated.trunk.03.patch, > HDFS-7285-merge-consolidated.trunk.04.patch, > HDFS-EC-Merge-PoC-20150624.patch, HDFS-EC-merge-consolidated-01.patch, > HDFS-bistriped.patch, HDFSErasureCodingDesign-20141028.pdf, > HDFSErasureCodingDesign-20141217.pdf, HDFSErasureCodingDesign-20150204.pdf, > HDFSErasureCodingDesign-20150206.pdf, HDFSErasureCodingPhaseITestPlan.pdf, > fsimage-analysis-20150105.pdf > > > Erasure Coding (EC) can greatly reduce the storage overhead without sacrifice > of data reliability, comparing to the existing HDFS 3-replica approach. For > example, if we use a 10+4 Reed Solomon coding, we can allow loss of 4 blocks, > with storage overhead only being 40%. This makes EC a quite attractive > alternative for big data storage, particularly for cold data. > Facebook had a related open source project called HDFS-RAID. It used to be > one of the contribute packages in HDFS but had been removed since Hadoop 2.0 > for maintain reason. The drawbacks are: 1) it is on top of HDFS and depends > on MapReduce to do encoding and decoding tasks; 2) it can only be used for > cold files that are intended not to be appended anymore; 3) the pure Java EC > coding implementation is extremely slow in practical use. Due to these, it > might not be a good idea to just bring HDFS-RAID back. > We (Intel and Cloudera) are working on a design to build EC into HDFS that > gets rid of any external dependencies, makes it self-contained and > independently maintained. This design lays the EC feature on the storage type > support and considers compatible with existing HDFS features like caching, > snapshot, encryption, high availability and etc. This design will also > support different EC coding schemes, implementations and policies for > different deployment scenarios. By utilizing advanced libraries (e.g. Intel > ISA-L library), an implementation can greatly improve the performance of EC > encoding/decoding and makes the EC solution even more attractive. We will > post the design document soon. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HDFS-8710) Always read DU value from the cached "dfsUsed" file on datanode startup
[
https://issues.apache.org/jira/browse/HDFS-8710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14613692#comment-14613692
]
Hadoop QA commented on HDFS-8710:
-
\\
\\
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:red}-1{color} | pre-patch | 17m 53s | Pre-patch trunk has 1 extant
Findbugs (version 3.0.0) warnings. |
| {color:green}+1{color} | @author | 0m 0s | The patch does not contain any
@author tags. |
| {color:red}-1{color} | tests included | 0m 0s | The patch doesn't appear
to include any new or modified tests. Please justify why no new tests are
needed for this patch. Also please list what manual steps were performed to
verify this patch. |
| {color:green}+1{color} | javac | 7m 33s | There were no new javac warning
messages. |
| {color:green}+1{color} | javadoc | 9m 40s | There were no new javadoc
warning messages. |
| {color:green}+1{color} | release audit | 0m 22s | The applied patch does
not increase the total number of release audit warnings. |
| {color:green}+1{color} | checkstyle | 2m 20s | There were no new checkstyle
issues. |
| {color:green}+1{color} | whitespace | 0m 0s | The patch has no lines that
end in whitespace. |
| {color:green}+1{color} | install | 1m 35s | mvn install still works. |
| {color:green}+1{color} | eclipse:eclipse | 0m 33s | The patch built with
eclipse:eclipse. |
| {color:green}+1{color} | findbugs | 3m 19s | The patch does not introduce
any new Findbugs (version 3.0.0) warnings. |
| {color:green}+1{color} | native | 3m 16s | Pre-build of native portion |
| {color:red}-1{color} | hdfs tests | 158m 10s | Tests failed in hadoop-hdfs. |
| | | 204m 44s | |
\\
\\
|| Reason || Tests ||
| Failed unit tests |
hadoop.hdfs.server.balancer.TestBalancerWithMultipleNameNodes |
\\
\\
|| Subsystem || Report/Notes ||
| Patch URL |
http://issues.apache.org/jira/secure/attachment/12743258/HDFS-8710.001.patch |
| Optional Tests | javadoc javac unit findbugs checkstyle |
| git revision | trunk / 2eae130 |
| Pre-patch Findbugs warnings |
https://builds.apache.org/job/PreCommit-HDFS-Build/11571/artifact/patchprocess/trunkFindbugsWarningshadoop-hdfs.html
|
| hadoop-hdfs test log |
https://builds.apache.org/job/PreCommit-HDFS-Build/11571/artifact/patchprocess/testrun_hadoop-hdfs.txt
|
| Test Results |
https://builds.apache.org/job/PreCommit-HDFS-Build/11571/testReport/ |
| Java | 1.7.0_55 |
| uname | Linux asf909.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP
PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux |
| Console output |
https://builds.apache.org/job/PreCommit-HDFS-Build/11571/console |
This message was automatically generated.
> Always read DU value from the cached "dfsUsed" file on datanode startup
> ---
>
> Key: HDFS-8710
> URL: https://issues.apache.org/jira/browse/HDFS-8710
> Project: Hadoop HDFS
> Issue Type: Improvement
>Reporter: Xinwei Qin
>Assignee: Xinwei Qin
> Attachments: HDFS-8710.001.patch
>
>
> Currently, DataNode will cache DU value in "dfsUsed" file termly. When
> DataNode starts or restarts, it will read in the cached DU value from
> "dfsUsed" file if the value is less than 600 seconds old, otherwise, it will
> run DU command, which is a very time-consuming operation(may up to dozens of
> minutes) when DataNode has huge number of blocks.
> Since slight imprecision of dfsUsed is not critical, and the DU value will be
> updated every 600 seconds (the default DU interval) after DataNode started,
> we can always read DU value from the cached file (Regardless of whether this
> value is less than 600 seconds old or not) and skip DU operation on DataNode
> startup to significantly shorten the startup time.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HDFS-8703) Merge refactor of DFSInputStream from ErasureCoding branch
[ https://issues.apache.org/jira/browse/HDFS-8703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14613657#comment-14613657 ] Hudson commented on HDFS-8703: -- FAILURE: Integrated in Hadoop-trunk-Commit #8112 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/8112/]) HDFS-8703. Merge refactor of DFSInputStream from ErasureCoding branch (Contributed by Vinayakumar B) (vinayakumarb: rev bff5999d07e9416a22846c849487e509ede55040) * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSClientRetries.java * hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSInputStream.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSClient.java > Merge refactor of DFSInputStream from ErasureCoding branch > -- > > Key: HDFS-8703 > URL: https://issues.apache.org/jira/browse/HDFS-8703 > Project: Hadoop HDFS > Issue Type: Improvement >Reporter: Vinayakumar B >Assignee: Vinayakumar B > Fix For: 2.8.0 > > Attachments: HDFS-8703-01.patch, HDFS-8703-02.patch > > > There were some refactors done in DFSInputStream for the support of > ErasureCoding in branch HDFS-7285. > These refactors are generic and applicable to current trunk > This Jira targets to merge them back to trunk to reduce size of the final > merge patch for the branch. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HDFS-8709) Clarify automatic sync in FSEditLog#logEdit
[ https://issues.apache.org/jira/browse/HDFS-8709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14613654#comment-14613654 ] Hudson commented on HDFS-8709: -- FAILURE: Integrated in Hadoop-trunk-Commit #8112 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/8112/]) HDFS-8709. Clarify automatic sync in FSEditLog#logEdit. (wang: rev 5fddc5177ddad07a735d49c15a63cfc5f74d0891) * hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSEditLog.java > Clarify automatic sync in FSEditLog#logEdit > --- > > Key: HDFS-8709 > URL: https://issues.apache.org/jira/browse/HDFS-8709 > Project: Hadoop HDFS > Issue Type: Improvement >Affects Versions: 2.0.6-alpha >Reporter: Andrew Wang >Assignee: Andrew Wang >Priority: Minor > Fix For: 2.8.0 > > Attachments: hdfs-8709.001.patch > > > The code flow and comments regarding the logSync() in logEdit() is a little > messy, could be improved. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HDFS-8577) Avoid retrying to recover lease on a file which does not exist
[
https://issues.apache.org/jira/browse/HDFS-8577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14613655#comment-14613655
]
Hudson commented on HDFS-8577:
--
FAILURE: Integrated in Hadoop-trunk-Commit #8112 (See
[https://builds.apache.org/job/Hadoop-trunk-Commit/8112/])
HDFS-8577. Avoid retrying to recover lease on a file which does not exist
(Contributed by J.Andreina) (vinayakumarb: rev
2eae130ab9edd318c82503c2306f610f2b5a3e51)
*
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/tools/DebugAdmin.java
*
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/tools/TestDebugAdmin.java
* hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
> Avoid retrying to recover lease on a file which does not exist
> --
>
> Key: HDFS-8577
> URL: https://issues.apache.org/jira/browse/HDFS-8577
> Project: Hadoop HDFS
> Issue Type: Bug
>Reporter: J.Andreina
>Assignee: J.Andreina
> Fix For: 2.8.0
>
> Attachments: HDFS-8577.1.patch, HDFS-8577.2.patch
>
>
> 1. Avoid retrying to recover lease on a file which does not exist
> {noformat}
> recoverLease got exception:
> java.io.FileNotFoundException: File does not exist: /hello_hi
> at
> org.apache.hadoop.hdfs.server.namenode.INodeFile.valueOf(INodeFile.java:71)
> Retrying in 5000 ms...
> Retry #1
> recoverLease got exception:
> java.io.FileNotFoundException: File does not exist: /hello_hi
> at
> org.apache.hadoop.hdfs.server.namenode.INodeFile.valueOf(INodeFile.java:71)
> {noformat}
> 2. Avoid populating huge stack trace for each retry for recovering lease on a
> file , being displayed on CLI .
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HDFS-8711) setSpaceQuota command should print the available storage type when input storage type is wrong
[
https://issues.apache.org/jira/browse/HDFS-8711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14613646#comment-14613646
]
Hadoop QA commented on HDFS-8711:
-
\\
\\
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:red}-1{color} | pre-patch | 21m 12s | Pre-patch trunk has 1 extant
Findbugs (version 3.0.0) warnings. |
| {color:green}+1{color} | @author | 0m 0s | The patch does not contain any
@author tags. |
| {color:green}+1{color} | tests included | 0m 0s | The patch appears to
include 1 new or modified test files. |
| {color:green}+1{color} | javac | 8m 30s | There were no new javac warning
messages. |
| {color:green}+1{color} | javadoc | 11m 42s | There were no new javadoc
warning messages. |
| {color:green}+1{color} | release audit | 0m 28s | The applied patch does
not increase the total number of release audit warnings. |
| {color:red}-1{color} | checkstyle | 3m 0s | The applied patch generated 1
new checkstyle issues (total was 228, now 228). |
| {color:green}+1{color} | whitespace | 0m 0s | The patch has no lines that
end in whitespace. |
| {color:green}+1{color} | install | 2m 23s | mvn install still works. |
| {color:green}+1{color} | eclipse:eclipse | 0m 42s | The patch built with
eclipse:eclipse. |
| {color:green}+1{color} | findbugs | 4m 50s | The patch does not introduce
any new Findbugs (version 3.0.0) warnings. |
| {color:green}+1{color} | native | 4m 25s | Pre-build of native portion |
| {color:red}-1{color} | hdfs tests | 84m 51s | Tests failed in hadoop-hdfs. |
| | | 142m 6s | |
\\
\\
|| Reason || Tests ||
| Timed out tests | org.apache.hadoop.hdfs.server.datanode.TestRefreshNamenodes
|
\\
\\
|| Subsystem || Report/Notes ||
| Patch URL |
http://issues.apache.org/jira/secure/attachment/12743457/HDFS-8711-01.patch |
| Optional Tests | javadoc javac unit findbugs checkstyle |
| git revision | trunk / 2eae130 |
| Pre-patch Findbugs warnings |
https://builds.apache.org/job/PreCommit-HDFS-Build/11570/artifact/patchprocess/trunkFindbugsWarningshadoop-hdfs.html
|
| checkstyle |
https://builds.apache.org/job/PreCommit-HDFS-Build/11570/artifact/patchprocess/diffcheckstylehadoop-hdfs.txt
|
| hadoop-hdfs test log |
https://builds.apache.org/job/PreCommit-HDFS-Build/11570/artifact/patchprocess/testrun_hadoop-hdfs.txt
|
| Test Results |
https://builds.apache.org/job/PreCommit-HDFS-Build/11570/testReport/ |
| Java | 1.7.0_55 |
| uname | Linux asf904.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP
PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux |
| Console output |
https://builds.apache.org/job/PreCommit-HDFS-Build/11570/console |
This message was automatically generated.
> setSpaceQuota command should print the available storage type when input
> storage type is wrong
> --
>
> Key: HDFS-8711
> URL: https://issues.apache.org/jira/browse/HDFS-8711
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: hdfs-client
>Affects Versions: 2.7.0
>Reporter: Surendra Singh Lilhore
>Assignee: Surendra Singh Lilhore
> Attachments: HDFS-8711-01.patch, HDFS-8711.patch
>
>
> If input storage type is wrong then currently *setSpaceQuota* give exception
> like this.
> {code}
> ./hdfs dfsadmin -setSpaceQuota 1000 -storageType COLD /testDir
> setSpaceQuota: No enum constant org.apache.hadoop.fs.StorageType.COLD
> {code}
> It should be
> {code}
> setSpaceQuota: Storage type COLD not available. Available storage type are
> [SSD, DISK, ARCHIVE]
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HDFS-8620) Clean up the checkstyle warinings about ClientProtocol
[
https://issues.apache.org/jira/browse/HDFS-8620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14613621#comment-14613621
]
Hadoop QA commented on HDFS-8620:
-
\\
\\
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | pre-patch | 15m 30s | Pre-patch trunk compilation is
healthy. |
| {color:green}+1{color} | @author | 0m 0s | The patch does not contain any
@author tags. |
| {color:red}-1{color} | tests included | 0m 0s | The patch doesn't appear
to include any new or modified tests. Please justify why no new tests are
needed for this patch. Also please list what manual steps were performed to
verify this patch. |
| {color:green}+1{color} | javac | 7m 36s | There were no new javac warning
messages. |
| {color:green}+1{color} | javadoc | 9m 42s | There were no new javadoc
warning messages. |
| {color:green}+1{color} | release audit | 0m 23s | The applied patch does
not increase the total number of release audit warnings. |
| {color:red}-1{color} | checkstyle | 0m 22s | The applied patch generated 1
new checkstyle issues (total was 162, now 41). |
| {color:red}-1{color} | whitespace | 0m 1s | The patch has 15 line(s) that
end in whitespace. Use git apply --whitespace=fix. |
| {color:green}+1{color} | install | 1m 33s | mvn install still works. |
| {color:green}+1{color} | eclipse:eclipse | 0m 33s | The patch built with
eclipse:eclipse. |
| {color:green}+1{color} | findbugs | 0m 51s | The patch does not introduce
any new Findbugs (version 3.0.0) warnings. |
| {color:green}+1{color} | native | 3m 16s | Pre-build of native portion |
| {color:green}+1{color} | hdfs tests | 0m 16s | Tests passed in
hadoop-hdfs-client. |
| | | 40m 6s | |
\\
\\
|| Subsystem || Report/Notes ||
| Patch URL |
http://issues.apache.org/jira/secure/attachment/12743427/HDFS-8620.2.patch |
| Optional Tests | javadoc javac unit findbugs checkstyle |
| git revision | trunk / 2eae130 |
| checkstyle |
https://builds.apache.org/job/PreCommit-HDFS-Build/11572/artifact/patchprocess/diffcheckstylehadoop-hdfs-client.txt
|
| whitespace |
https://builds.apache.org/job/PreCommit-HDFS-Build/11572/artifact/patchprocess/whitespace.txt
|
| hadoop-hdfs-client test log |
https://builds.apache.org/job/PreCommit-HDFS-Build/11572/artifact/patchprocess/testrun_hadoop-hdfs-client.txt
|
| Test Results |
https://builds.apache.org/job/PreCommit-HDFS-Build/11572/testReport/ |
| Java | 1.7.0_55 |
| uname | Linux asf900.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP
PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux |
| Console output |
https://builds.apache.org/job/PreCommit-HDFS-Build/11572/console |
This message was automatically generated.
> Clean up the checkstyle warinings about ClientProtocol
> --
>
> Key: HDFS-8620
> URL: https://issues.apache.org/jira/browse/HDFS-8620
> Project: Hadoop HDFS
> Issue Type: Sub-task
>Reporter: Takanobu Asanuma
>Assignee: Takanobu Asanuma
> Attachments: HDFS-8620.1.patch, HDFS-8620.2.patch
>
>
> These warnings were generated in HDFS-8238.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
