[jira] [Commented] (HDFS-7784) load fsimage in parallel

2015-02-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14319717#comment-14319717 ] Hadoop QA commented on HDFS-7784: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7410) Support CreateFlags with append() to support hsync() for appending streams

2015-02-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14319807#comment-14319807 ] Hadoop QA commented on HDFS-7410: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7784) load fsimage in parallel

2015-02-13 Thread Hadoop QA (JIRA)
of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12698691/test-20150213.pdf against trunk revision ba3c80a. {color:red}-1 patch{color}. The patch command could not apply the patch. Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/9573

[jira] [Commented] (HDFS-7322) deprecate sbin/hadoop-daemon.sh

2015-02-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14319876#comment-14319876 ] Hudson commented on HDFS-7322: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #103 (See

[jira] [Commented] (HDFS-7704) DN heartbeat to Active NN may be blocked and expire if connection to Standby NN continues to time out.

2015-02-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14319882#comment-14319882 ] Hudson commented on HDFS-7704: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #103 (See

[jira] [Commented] (HDFS-7404) Remove o.a.h.hdfs.server.datanode.web.resources

2015-02-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14319872#comment-14319872 ] Hudson commented on HDFS-7404: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #103 (See

[jira] [Commented] (HDFS-7694) FSDataInputStream should support unbuffer

2015-02-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14319853#comment-14319853 ] Hudson commented on HDFS-7694: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #103 (See

[jira] [Commented] (HDFS-7790) Do not create optional fields in DFSInputStream unless they are needed

2015-02-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14319865#comment-14319865 ] Hudson commented on HDFS-7790: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #103 (See

[jira] [Commented] (HDFS-7668) Convert site documentation from apt to markdown

2015-02-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14319862#comment-14319862 ] Hudson commented on HDFS-7668: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #103 (See

[jira] [Commented] (HDFS-7684) The host:port settings of the daemons should be trimmed before use

2015-02-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14319871#comment-14319871 ] Hudson commented on HDFS-7684: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #103 (See

[jira] [Commented] (HDFS-7584) Enable Quota Support for Storage Types

2015-02-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14319873#comment-14319873 ] Hudson commented on HDFS-7584: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #103 (See

[jira] [Commented] (HDFS-7711) Fix various typos in ClusterSetup.md

2015-02-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14319864#comment-14319864 ] Hudson commented on HDFS-7711: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #103 (See

[jira] [Commented] (HDFS-7684) The host:port settings of the daemons should be trimmed before use

2015-02-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14319905#comment-14319905 ] Hudson commented on HDFS-7684: -- FAILURE: Integrated in Hadoop-Yarn-trunk #837 (See

[jira] [Commented] (HDFS-7584) Enable Quota Support for Storage Types

2015-02-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14319907#comment-14319907 ] Hudson commented on HDFS-7584: -- FAILURE: Integrated in Hadoop-Yarn-trunk #837 (See

[jira] [Commented] (HDFS-7704) DN heartbeat to Active NN may be blocked and expire if connection to Standby NN continues to time out.

2015-02-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14319916#comment-14319916 ] Hudson commented on HDFS-7704: -- FAILURE: Integrated in Hadoop-Yarn-trunk #837 (See

[jira] [Updated] (HDFS-7784) load fsimage in parallel

2015-02-13 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-7784: Attachment: test-20150213.pdf load fsimage in parallel Key

[jira] [Commented] (HDFS-7404) Remove o.a.h.hdfs.server.datanode.web.resources

2015-02-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14319906#comment-14319906 ] Hudson commented on HDFS-7404: -- FAILURE: Integrated in Hadoop-Yarn-trunk #837 (See

[jira] [Commented] (HDFS-7790) Do not create optional fields in DFSInputStream unless they are needed

2015-02-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14319899#comment-14319899 ] Hudson commented on HDFS-7790: -- FAILURE: Integrated in Hadoop-Yarn-trunk #837 (See

[jira] [Commented] (HDFS-7322) deprecate sbin/hadoop-daemon.sh

2015-02-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14319910#comment-14319910 ] Hudson commented on HDFS-7322: -- FAILURE: Integrated in Hadoop-Yarn-trunk #837 (See

[jira] [Commented] (HDFS-7711) Fix various typos in ClusterSetup.md

2015-02-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14319898#comment-14319898 ] Hudson commented on HDFS-7711: -- FAILURE: Integrated in Hadoop-Yarn-trunk #837 (See

[jira] [Commented] (HDFS-7668) Convert site documentation from apt to markdown

2015-02-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14319896#comment-14319896 ] Hudson commented on HDFS-7668: -- FAILURE: Integrated in Hadoop-Yarn-trunk #837 (See

[jira] [Commented] (HDFS-7694) FSDataInputStream should support unbuffer

2015-02-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14319887#comment-14319887 ] Hudson commented on HDFS-7694: -- FAILURE: Integrated in Hadoop-Yarn-trunk #837 (See

[jira] [Commented] (HDFS-6133) Make Balancer support exclude specified path

2015-02-13 Thread Jingcheng Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14319737#comment-14319737 ] Jingcheng Du commented on HDFS-6133: Hi [~zhaoyunjiong]. The release note mentions that

[jira] [Commented] (HDFS-7711) Fix various typos in ClusterSetup.md

2015-02-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14320235#comment-14320235 ] Hudson commented on HDFS-7711: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #104 (See

[jira] [Commented] (HDFS-7704) DN heartbeat to Active NN may be blocked and expire if connection to Standby NN continues to time out.

2015-02-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14320252#comment-14320252 ] Hudson commented on HDFS-7704: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #104 (See

[jira] [Commented] (HDFS-7668) Convert site documentation from apt to markdown

2015-02-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14320233#comment-14320233 ] Hudson commented on HDFS-7668: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #104 (See

[jira] [Commented] (HDFS-7793) Refactor DFSOutputStream separating DataStreamer out

2015-02-13 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14320050#comment-14320050 ] Li Bo commented on HDFS-7793: - For patch 001: I split {{DFSOutputStream}} into 3 classes,

[jira] [Commented] (HDFS-7694) FSDataInputStream should support unbuffer

2015-02-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14320225#comment-14320225 ] Hudson commented on HDFS-7694: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #104 (See

[jira] [Commented] (HDFS-7584) Enable Quota Support for Storage Types

2015-02-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14320244#comment-14320244 ] Hudson commented on HDFS-7584: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #104 (See

[jira] [Commented] (HDFS-7684) The host:port settings of the daemons should be trimmed before use

2015-02-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14320242#comment-14320242 ] Hudson commented on HDFS-7684: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #104 (See

[jira] [Commented] (HDFS-7584) Enable Quota Support for Storage Types

2015-02-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14320149#comment-14320149 ] Hudson commented on HDFS-7584: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #2035 (See

[jira] [Commented] (HDFS-7684) The host:port settings of the daemons should be trimmed before use

2015-02-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14320147#comment-14320147 ] Hudson commented on HDFS-7684: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #2035 (See

[jira] [Commented] (HDFS-7790) Do not create optional fields in DFSInputStream unless they are needed

2015-02-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14320141#comment-14320141 ] Hudson commented on HDFS-7790: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #2035 (See

[jira] [Commented] (HDFS-7704) DN heartbeat to Active NN may be blocked and expire if connection to Standby NN continues to time out.

2015-02-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14320157#comment-14320157 ] Hudson commented on HDFS-7704: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #2035 (See

[jira] [Commented] (HDFS-6994) libhdfs3 - A native C/C++ HDFS client

2015-02-13 Thread Zhanwei Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14320190#comment-14320190 ] Zhanwei Wang commented on HDFS-6994: Hi [~thanhdo] bq. As the existing native code in

[jira] [Commented] (HDFS-7790) Do not create optional fields in DFSInputStream unless they are needed

2015-02-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14320236#comment-14320236 ] Hudson commented on HDFS-7790: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #104 (See

[jira] [Commented] (HDFS-7787) Wrong priorty of replication

2015-02-13 Thread Frode Halvorsen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14320169#comment-14320169 ] Frode Halvorsen commented on HDFS-7787: --- Actually, I had the situation that the node

[jira] [Updated] (HDFS-7784) load fsimage in parallel

2015-02-13 Thread Walter Su (JIRA)
-7784.001.patch, test-20150213.pdf When single Namenode has huge amount of files, without using federation, the startup/restart speed is slow. The fsimage loading step takes the most of the time. fsimage loading can seperate to two parts, deserialization and object construction(mostly map

[jira] [Commented] (HDFS-7322) deprecate sbin/hadoop-daemon.sh

2015-02-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14320247#comment-14320247 ] Hudson commented on HDFS-7322: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #104 (See

[jira] [Updated] (HDFS-7787) Wrong priorty of replication

2015-02-13 Thread Frode Halvorsen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Frode Halvorsen updated HDFS-7787: -- Description: Each file has a setting of 3 replicas. split on different racks. After a simulated

[jira] [Commented] (HDFS-7694) FSDataInputStream should support unbuffer

2015-02-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14320130#comment-14320130 ] Hudson commented on HDFS-7694: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #2035 (See

[jira] [Commented] (HDFS-7784) load fsimage in parallel

2015-02-13 Thread Walter Su (JIRA)
: Hadoop HDFS Issue Type: Improvement Components: namenode Reporter: Walter Su Assignee: Walter Su Priority: Minor Attachments: HDFS-7784.001.patch, test-20150213.pdf When single Namenode has huge amount of files, without using federation

[jira] [Updated] (HDFS-7793) Refactor DFSOutputStream separating DataStreamer out

2015-02-13 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-7793: Attachment: HDFS-7793-001.patch Refactor DFSOutputStream separating DataStreamer out

[jira] [Commented] (HDFS-7784) load fsimage in parallel

2015-02-13 Thread Walter Su (JIRA)
Components: namenode Reporter: Walter Su Assignee: Walter Su Priority: Minor Attachments: HDFS-7784.001.patch, test-20150213.pdf When single Namenode has huge amount of files, without using federation, the startup/restart speed is slow. The fsimage loading

[jira] [Commented] (HDFS-7784) load fsimage in parallel

2015-02-13 Thread Walter Su (JIRA)
: https://issues.apache.org/jira/browse/HDFS-7784 Project: Hadoop HDFS Issue Type: Improvement Components: namenode Reporter: Walter Su Assignee: Walter Su Priority: Minor Attachments: HDFS-7784.001.patch, test-20150213.pdf

[jira] [Commented] (HDFS-7322) deprecate sbin/hadoop-daemon.sh

2015-02-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14320152#comment-14320152 ] Hudson commented on HDFS-7322: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #2035 (See

[jira] [Commented] (HDFS-7668) Convert site documentation from apt to markdown

2015-02-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14320138#comment-14320138 ] Hudson commented on HDFS-7668: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #2035 (See

[jira] [Commented] (HDFS-7711) Fix various typos in ClusterSetup.md

2015-02-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14320140#comment-14320140 ] Hudson commented on HDFS-7711: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #2035 (See

[jira] [Commented] (HDFS-7404) Remove o.a.h.hdfs.server.datanode.web.resources

2015-02-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14320148#comment-14320148 ] Hudson commented on HDFS-7404: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #2035 (See

[jira] [Commented] (HDFS-7404) Remove o.a.h.hdfs.server.datanode.web.resources

2015-02-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14320243#comment-14320243 ] Hudson commented on HDFS-7404: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #104 (See

[jira] [Commented] (HDFS-7404) Remove o.a.h.hdfs.server.datanode.web.resources

2015-02-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14320288#comment-14320288 ] Hudson commented on HDFS-7404: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2054 (See

[jira] [Updated] (HDFS-7794) Update httpfs documentation

2015-02-13 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-7794: --- Attachment: HDFS-7794-00.patch -00: * Initial version Update httpfs documentation

[jira] [Created] (HDFS-7794) Update httpfs documentation

2015-02-13 Thread Allen Wittenauer (JIRA)
Allen Wittenauer created HDFS-7794: -- Summary: Update httpfs documentation Key: HDFS-7794 URL: https://issues.apache.org/jira/browse/HDFS-7794 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Updated] (HDFS-7795) Show warning if not all favored nodes were chosen by namenode

2015-02-13 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-7795: - Attachment: HDFS-7795.patch No test case added since it only adds log messages. Manual testing has

[jira] [Commented] (HDFS-7322) deprecate sbin/hadoop-daemon.sh

2015-02-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14320292#comment-14320292 ] Hudson commented on HDFS-7322: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2054 (See

[jira] [Commented] (HDFS-7694) FSDataInputStream should support unbuffer

2015-02-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14320270#comment-14320270 ] Hudson commented on HDFS-7694: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2054 (See

[jira] [Commented] (HDFS-7790) Do not create optional fields in DFSInputStream unless they are needed

2015-02-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14320281#comment-14320281 ] Hudson commented on HDFS-7790: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2054 (See

[jira] [Commented] (HDFS-7711) Fix various typos in ClusterSetup.md

2015-02-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14320280#comment-14320280 ] Hudson commented on HDFS-7711: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2054 (See

[jira] [Commented] (HDFS-7684) The host:port settings of the daemons should be trimmed before use

2015-02-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14320287#comment-14320287 ] Hudson commented on HDFS-7684: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2054 (See

[jira] [Commented] (HDFS-7704) DN heartbeat to Active NN may be blocked and expire if connection to Standby NN continues to time out.

2015-02-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14320297#comment-14320297 ] Hudson commented on HDFS-7704: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2054 (See

[jira] [Commented] (HDFS-7668) Convert site documentation from apt to markdown

2015-02-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14320278#comment-14320278 ] Hudson commented on HDFS-7668: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2054 (See

[jira] [Updated] (HDFS-7795) Show warning if not all favored nodes were chosen by namenode

2015-02-13 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-7795: - Priority: Minor (was: Major) Show warning if not all favored nodes were chosen by namenode

[jira] [Updated] (HDFS-7795) Show warning if not all favored nodes were chosen by namenode

2015-02-13 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-7795: - Assignee: Kihwal Lee Status: Patch Available (was: Open) Show warning if not all favored nodes

[jira] [Commented] (HDFS-7584) Enable Quota Support for Storage Types

2015-02-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14320289#comment-14320289 ] Hudson commented on HDFS-7584: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2054 (See

[jira] [Created] (HDFS-7795) Show warning if not all favored nodes were chosen by namenode

2015-02-13 Thread Kihwal Lee (JIRA)
Kihwal Lee created HDFS-7795: Summary: Show warning if not all favored nodes were chosen by namenode Key: HDFS-7795 URL: https://issues.apache.org/jira/browse/HDFS-7795 Project: Hadoop HDFS

[jira] [Commented] (HDFS-7684) The host:port settings of the daemons should be trimmed before use

2015-02-13 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14320474#comment-14320474 ] Chris Nauroth commented on HDFS-7684: - [~ajisakaa], thank you for the commit! The

[jira] [Assigned] (HDFS-7791) dfs count -v should be added to quota documentation

2015-02-13 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA reassigned HDFS-7791: --- Assignee: Akira AJISAKA dfs count -v should be added to quota documentation

[jira] [Updated] (HDFS-7791) dfs count -v should be added to quota documentation

2015-02-13 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-7791: Target Version/s: 3.0.0 Status: Patch Available (was: Open) dfs count -v should be

[jira] [Commented] (HDFS-7780) Update use of Iterator to Iterable

2015-02-13 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14320435#comment-14320435 ] Ray Chiang commented on HDFS-7780: -- Thanks for the feedback. I will update the patch.

[jira] [Commented] (HDFS-7686) Re-add rapid rescan of possibly corrupt block feature to the block scanner

2015-02-13 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14320497#comment-14320497 ] Akira AJISAKA commented on HDFS-7686: - lgtm, +1. Thanks Colin, Andrew and Rushabh.

[jira] [Updated] (HDFS-7791) dfs count -v should be added to quota documentation

2015-02-13 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-7791: Attachment: HDFS-7791-001.patch Attaching a patch to add -h option and -v option. dfs count -v

[jira] [Updated] (HDFS-7791) dfs count -v should be added to quota documentation

2015-02-13 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-7791: --- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-7324) haadmin command usage prints incorrect command name

2015-02-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14320657#comment-14320657 ] Hadoop QA commented on HDFS-7324: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7776) Adding additional unit tests for Quota By Storage Type

2015-02-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14320710#comment-14320710 ] Hudson commented on HDFS-7776: -- FAILURE: Integrated in Hadoop-trunk-Commit #7106 (See

[jira] [Commented] (HDFS-7576) TestPipelinesFailover#testFailoverRightBeforeCommitSynchronization sometimes fails in Java 8 build

2015-02-13 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14320713#comment-14320713 ] Kihwal Lee commented on HDFS-7576: -- I saw this in

[jira] [Reopened] (HDFS-7576) TestPipelinesFailover#testFailoverRightBeforeCommitSynchronization sometimes fails in Java 8 build

2015-02-13 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee reopened HDFS-7576: -- TestPipelinesFailover#testFailoverRightBeforeCommitSynchronization sometimes fails in Java 8 build

[jira] [Commented] (HDFS-7795) Show warning if not all favored nodes were chosen by namenode

2015-02-13 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14320719#comment-14320719 ] Kihwal Lee commented on HDFS-7795: -- Test failure is unrelated. It is the same thing

[jira] [Commented] (HDFS-7795) Show warning if not all favored nodes were chosen by namenode

2015-02-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14320668#comment-14320668 ] Hadoop QA commented on HDFS-7795: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7776) Adding additional unit tests for Quota By Storage Type

2015-02-13 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14320665#comment-14320665 ] Arpit Agarwal commented on HDFS-7776: - +1 for the patch. The test failure is unrelated.

[jira] [Commented] (HDFS-7009) Active NN and standby NN have different live nodes

2015-02-13 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14320640#comment-14320640 ] Arpit Agarwal commented on HDFS-7009: - bq. The patch seems to be useful even after

[jira] [Commented] (HDFS-7791) dfs count -v should be added to quota documentation

2015-02-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14320577#comment-14320577 ] Hudson commented on HDFS-7791: -- FAILURE: Integrated in Hadoop-trunk-Commit #7105 (See

[jira] [Commented] (HDFS-7324) haadmin command usage prints incorrect command name

2015-02-13 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14320612#comment-14320612 ] Brahma Reddy Battula commented on HDFS-7324: Hi [~sureshms] Thanks for

[jira] [Commented] (HDFS-7009) Active NN and standby NN have different live nodes

2015-02-13 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14320670#comment-14320670 ] Chris Nauroth commented on HDFS-7009: - Hi [~mingma]. Thanks for giving me the

[jira] [Updated] (HDFS-7776) Adding additional unit tests for Quota By Storage Type

2015-02-13 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-7776: Resolution: Fixed Fix Version/s: 2.7.0 Hadoop Flags: Reviewed Status: Resolved

[jira] [Updated] (HDFS-7492) If multiple threads call FsVolumeList#checkDirs at the same time, we should only do checkDirs once and give the results to all waiting threads

2015-02-13 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-7492: -- Component/s: datanode Priority: Minor (was: Major) If multiple threads call

[jira] [Updated] (HDFS-7773) Additional metrics in HDFS to be accessed via jmx.

2015-02-13 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-7773: --- Attachment: hdfs-7773.001.patch Added counter that tracks time spent reading and writing. This is

[jira] [Commented] (HDFS-7430) Rewrite the BlockScanner to use O(1) memory and use multiple threads

2015-02-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14320927#comment-14320927 ] Andrew Wang commented on HDFS-7430: --- I'm +1 for merging too Rewrite the BlockScanner to

[jira] [Commented] (HDFS-7686) Re-add rapid rescan of possibly corrupt block feature to the block scanner

2015-02-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14320940#comment-14320940 ] Hudson commented on HDFS-7686: -- FAILURE: Integrated in Hadoop-trunk-Commit #7108 (See

[jira] [Commented] (HDFS-4265) BKJM doesn't take advantage of speculative reads

2015-02-13 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14320943#comment-14320943 ] Akira AJISAKA commented on HDFS-4265: - +1, committing this. BKJM doesn't take

[jira] [Commented] (HDFS-4265) BKJM doesn't take advantage of speculative reads

2015-02-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14320976#comment-14320976 ] Hudson commented on HDFS-4265: -- FAILURE: Integrated in Hadoop-trunk-Commit #7110 (See

[jira] [Updated] (HDFS-7772) Document hdfs balancer -exclude/-include option in HDFSCommands.html

2015-02-13 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-7772: Hadoop Flags: Reviewed Thank you, Xiaoyu. This looks good to me. +1 pending Jenkins. I'll also

[jira] [Updated] (HDFS-7537) fsck is confusing when dfs.namenode.replication.min 1 missing replicas NN restart

2015-02-13 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-7537: -- Summary: fsck is confusing when dfs.namenode.replication.min 1 missing replicas NN

[jira] [Updated] (HDFS-7686) Re-add rapid rescan of possibly corrupt block feature to the block scanner

2015-02-13 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7686: --- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch

[jira] [Updated] (HDFS-7773) Additional metrics in HDFS to be accessed via jmx.

2015-02-13 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-7773: --- Status: Patch Available (was: Open) Additional metrics in HDFS to be accessed via jmx.

[jira] [Updated] (HDFS-7795) Show warning if not all favored nodes were chosen by namenode

2015-02-13 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-7795: Hadoop Flags: Reviewed Show warning if not all favored nodes were chosen by namenode

[jira] [Updated] (HDFS-7686) Re-add rapid rescan of possibly corrupt block feature to the block scanner

2015-02-13 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7686: --- Target Version/s: 2.7.0 (was: 3.0.0) Affects Version/s: (was: 3.0.0)

[jira] [Commented] (HDFS-7430) Rewrite the BlockScanner to use O(1) memory and use multiple threads

2015-02-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14320962#comment-14320962 ] Hudson commented on HDFS-7430: -- SUCCESS: Integrated in Hadoop-trunk-Commit #7109 (See

[jira] [Commented] (HDFS-7721) The HDFS BlockScanner may run fast during the first hour

2015-02-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14320961#comment-14320961 ] Hudson commented on HDFS-7721: -- SUCCESS: Integrated in Hadoop-trunk-Commit #7109 (See

[jira] [Commented] (HDFS-7795) Show warning if not all favored nodes were chosen by namenode

2015-02-13 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14320925#comment-14320925 ] Akira AJISAKA commented on HDFS-7795: - LGTM, +1. Thanks Kihwal. Show warning if not

[jira] [Updated] (HDFS-7430) Rewrite the BlockScanner to use O(1) memory and use multiple threads

2015-02-13 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7430: --- Fix Version/s: (was: 3.0.0) 2.7.0 Rewrite the BlockScanner to

  1   2   >