[jira] [Commented] (HDFS-8920) Erasure Coding: when recovering lost blocks, logs can be too verbose and hurt performance

2015-08-23 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14708868#comment-14708868 ] Rui Li commented on HDFS-8920: -- Hi [~cmccabe] and [~zhz], thanks for your inputs. I agree that

[jira] [Commented] (HDFS-8942) Update hyperlink to rack awareness page in HDFS Architecture documentation

2015-08-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14708841#comment-14708841 ] Hudson commented on HDFS-8942: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1031 (See [https://

[jira] [Updated] (HDFS-8889) Erasure Coding: cover more test situations of datanode failure during client writing

2015-08-23 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-8889: Attachment: HDFS-8889-HDFS-7285-001.patch > Erasure Coding: cover more test situations of datanode failure during cli

[jira] [Commented] (HDFS-8935) Erasure Coding: createErasureCodingZone api should accept the policyname as argument instead of ErasureCodingPolicy

2015-08-23 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14708822#comment-14708822 ] Zhe Zhang commented on HDFS-8935: - I agree with Vinay. Moving it under HDFS-8031 since mult

[jira] [Updated] (HDFS-8935) Erasure Coding: createErasureCodingZone api should accept the policyname as argument instead of ErasureCodingPolicy

2015-08-23 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8935: Parent Issue: HDFS-8031 (was: HDFS-7285) > Erasure Coding: createErasureCodingZone api should accept the pol

[jira] [Updated] (HDFS-8900) Compact XAttrs to optimize memory footprint.

2015-08-23 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-8900: - Attachment: HDFS-8900.003.patch > Compact XAttrs to optimize memory footprint. > --

[jira] [Commented] (HDFS-8900) Compact XAttrs to optimize memory footprint.

2015-08-23 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14708819#comment-14708819 ] Yi Liu commented on HDFS-8900: -- Thanks [~andrew.wang] and [~cmccabe]! I will create a follow-o

[jira] [Commented] (HDFS-8942) Update hyperlink to rack awareness page in HDFS Architecture documentation

2015-08-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14708817#comment-14708817 ] Hudson commented on HDFS-8942: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #302 (See [htt

[jira] [Commented] (HDFS-8942) Update hyperlink to rack awareness page in HDFS Architecture documentation

2015-08-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14708803#comment-14708803 ] Hudson commented on HDFS-8942: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #298 (See

[jira] [Updated] (HDFS-8944) Make dfsadmin command options case insensitive

2015-08-23 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-8944: Release Note: Now hdfs dfsadmin command options are case insensitive. For example, both "hdfs dfsadmi

[jira] [Commented] (HDFS-8944) Make dfsadmin command options case insensitive

2015-08-23 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14708801#comment-14708801 ] Akira AJISAKA commented on HDFS-8944: - Thanks [~rakeshr] for the comment. Updated the r

[jira] [Updated] (HDFS-8944) Make dfsadmin command options case insensitive

2015-08-23 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-8944: Priority: Major (was: Minor) Release Note: Now hdfs dfsadmin command options are case insensi

[jira] [Commented] (HDFS-8944) Make dfsadmin command options case insensitive

2015-08-23 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14708788#comment-14708788 ] Rakesh R commented on HDFS-8944: Thanks [~ajisakaa] for the quick updates. With this change

[jira] [Commented] (HDFS-8388) Time and Date format need to be in sync in Namenode UI page

2015-08-23 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14708784#comment-14708784 ] Vinayakumar B commented on HDFS-8388: - 1. {code} var HELPERS = { 'helper_dat

[jira] [Commented] (HDFS-8942) Update hyperlink to rack awareness page in HDFS Architecture documentation

2015-08-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14708779#comment-14708779 ] Hudson commented on HDFS-8942: -- FAILURE: Integrated in Hadoop-trunk-Commit #8342 (See [https:

[jira] [Updated] (HDFS-8942) Update hyperlink to rack awareness page in HDFS Architecture documentation

2015-08-23 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-8942: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Commented] (HDFS-8942) Update hyperlink to rack awareness page in HDFS Architecture documentation

2015-08-23 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14708775#comment-14708775 ] Akira AJISAKA commented on HDFS-8942: - LGTM, +1. > Update hyperlink to rack awareness

[jira] [Commented] (HDFS-7116) Add a metric to expose the bandwidth of balancer

2015-08-23 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14708762#comment-14708762 ] Akira AJISAKA commented on HDFS-7116: - Filed HDFS-8944 for make them case insensitive.

[jira] [Updated] (HDFS-8944) Make dfsadmin command options case insensitive

2015-08-23 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-8944: Target Version/s: 2.8.0 Status: Patch Available (was: Open) > Make dfsadmin command op

[jira] [Updated] (HDFS-8944) Make dfsadmin command options case insensitive

2015-08-23 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-8944: Attachment: HDFS-8944.001.patch Attaching a patch that replaces String.equals with String.equalsIgnor

[jira] [Updated] (HDFS-8944) Make dfsadmin command options case insensitive

2015-08-23 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-8944: Assignee: Akira AJISAKA Summary: Make dfsadmin command options case insensitive (was: Make dfsa

[jira] [Created] (HDFS-8944) Make dfsadmin command option case insensitive

2015-08-23 Thread Akira AJISAKA (JIRA)
Akira AJISAKA created HDFS-8944: --- Summary: Make dfsadmin command option case insensitive Key: HDFS-8944 URL: https://issues.apache.org/jira/browse/HDFS-8944 Project: Hadoop HDFS Issue Type: Imp

[jira] [Updated] (HDFS-8943) Read apis in ByteRangeInputStream does not read all the bytes specified when chunked transfer-encoding is used in the server

2015-08-23 Thread Shradha Revankar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shradha Revankar updated HDFS-8943: --- Description: With the default Webhdfs server implementation the read apis in ByteRangeInputStr

[jira] [Updated] (HDFS-8943) Read apis in ByteRangeInputStream does not read all the bytes specified when chunked transfer-encoding is used in the server

2015-08-23 Thread Shradha Revankar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shradha Revankar updated HDFS-8943: --- Description: With the default Webhdfs server implementation the read apis in ByteRangeInputStr

[jira] [Updated] (HDFS-8943) Read apis in ByteRangeInputStream does not read all the bytes specified when chunked transfer-encoding is used in the server

2015-08-23 Thread Shradha Revankar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shradha Revankar updated HDFS-8943: --- Description: With the default Webhdfs server implementation the read apis in ByteRangeInputStr

[jira] [Updated] (HDFS-8943) Read apis in ByteRangeInputStream does not read all the bytes specified when chunked transfer-encoding is used in the server

2015-08-23 Thread Shradha Revankar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shradha Revankar updated HDFS-8943: --- Description: With the default Webhdfs server implementation the read apis in ByteRangeInputStr

[jira] [Created] (HDFS-8943) Read apis in ByteRangeInputStream does not read all the bytes specified when chunked transfer-encoding is used in the server

2015-08-23 Thread Shradha Revankar (JIRA)
Shradha Revankar created HDFS-8943: -- Summary: Read apis in ByteRangeInputStream does not read all the bytes specified when chunked transfer-encoding is used in the server Key: HDFS-8943 URL: https://issues.apache

[jira] [Commented] (HDFS-8763) Incremental blockreport order may replicate unnecessary block

2015-08-23 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14708732#comment-14708732 ] Walter Su commented on HDFS-8763: - Another solution is to increase {{dfs.namenode.replicati

[jira] [Commented] (HDFS-8763) Incremental blockreport order may replicate unnecessary block

2015-08-23 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14708726#comment-14708726 ] Walter Su commented on HDFS-8763: - The description gives good logs but not a good reason. I

[jira] [Commented] (HDFS-7116) Add a metric to expose the bandwidth of balancer

2015-08-23 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14708696#comment-14708696 ] Akira AJISAKA commented on HDFS-7116: - bq. This seems wrong to show it in metric since

[jira] [Updated] (HDFS-8942) Update hyperlink to rack awareness page in HDFS Architecture documentation

2015-08-23 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-8942: --- Status: Patch Available (was: Open) > Update hyperlink to rack awareness page in HDFS Architec

[jira] [Updated] (HDFS-8942) Update hyperlink to rack awareness page in HDFS Architecture documentation

2015-08-23 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-8942: --- Attachment: HDFS-8942.001.patch > Update hyperlink to rack awareness page in HDFS Architecture

[jira] [Created] (HDFS-8942) Update hyperlink to rack awareness page in HDFS Architecture documentation

2015-08-23 Thread Masatake Iwasaki (JIRA)
Masatake Iwasaki created HDFS-8942: -- Summary: Update hyperlink to rack awareness page in HDFS Architecture documentation Key: HDFS-8942 URL: https://issues.apache.org/jira/browse/HDFS-8942 Project: H

[jira] [Commented] (HDFS-8287) DFSStripedOutputStream.writeChunk should not wait for writing parity

2015-08-23 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14708691#comment-14708691 ] Kai Sasaki commented on HDFS-8287: -- [~rakeshr] Thank you for reviewing! Can other someone

[jira] [Updated] (HDFS-7285) Erasure Coding Support inside HDFS

2015-08-23 Thread GAO Rui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] GAO Rui updated HDFS-7285: -- Attachment: HDFSErasureCodingSystemTestPlan-20150824.pdf Inspired by [^HDFSErasureCodingPhaseITestPlan.pdf] crea

[jira] [Updated] (HDFS-8931) Erasure Coding: Notify exception to client side from ParityGenerator.

2015-08-23 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki updated HDFS-8931: - Summary: Erasure Coding: Notify exception to client side from ParityGenerator. (was: Notify exception to c

[jira] [Commented] (HDFS-7116) Add a metric to expose the bandwidth of balancer

2015-08-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14708546#comment-14708546 ] Tsz Wo Nicholas Sze commented on HDFS-7116: --- Command options are case insensitive

[jira] [Commented] (HDFS-7116) Add a metric to expose the bandwidth of balancer

2015-08-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14708464#comment-14708464 ] Allen Wittenauer commented on HDFS-7116: Could we please stop adding camel case opt