[jira] [Commented] (HDFS-10885) [SPS]: Mover tool should not be allowed to run when Storage Policy Satisfier is on

2016-10-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15587911#comment-15587911 ] Hadoop QA commented on HDFS-10885: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Created] (HDFS-11032) [SPS]: Handling of block movement failure at the coordinator datanode

2016-10-19 Thread Rakesh R (JIRA)
Rakesh R created HDFS-11032: --- Summary: [SPS]: Handling of block movement failure at the coordinator datanode Key: HDFS-11032 URL: https://issues.apache.org/jira/browse/HDFS-11032 Project: Hadoop HDFS

[jira] [Updated] (HDFS-11032) [SPS]: Handling of block movement failure at the coordinator datanode

2016-10-19 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11032: Component/s: (was: namenode) > [SPS]: Handling of block movement failure at the coordinator datanode > -

[jira] [Commented] (HDFS-10885) [SPS]: Mover tool should not be allowed to run when Storage Policy Satisfier is on

2016-10-19 Thread Wei Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15587938#comment-15587938 ] Wei Zhou commented on HDFS-10885: - The failed test {{hadoop.hdfs.server.blockmanagement.Te

[jira] [Updated] (HDFS-8410) Add computation time metrics to datanode for ECWorker

2016-10-19 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-8410: Attachment: HDFS-8410-004.patch > Add computation time metrics to datanode for ECWorker > ---

[jira] [Commented] (HDFS-8410) Add computation time metrics to datanode for ECWorker

2016-10-19 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15587987#comment-15587987 ] SammiChen commented on HDFS-8410: - Thanks Andrew, for taking time review the patch and give

[jira] [Created] (HDFS-11033) Add documents for native raw eraure coder in XOR codes

2016-10-19 Thread SammiChen (JIRA)
SammiChen created HDFS-11033: Summary: Add documents for native raw eraure coder in XOR codes Key: HDFS-11033 URL: https://issues.apache.org/jira/browse/HDFS-11033 Project: Hadoop HDFS Issue Type

[jira] [Commented] (HDFS-9096) Issue in Rollback (after rolling upgrade) from hadoop 2.7.1 to 2.4.0

2016-10-19 Thread Dinesh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15588098#comment-15588098 ] Dinesh commented on HDFS-9096: -- Hi [~kihwal], *With journal nodes and zookeeper instances run

[jira] [Updated] (HDFS-11033) Add documents for native raw eraure coder in XOR codes

2016-10-19 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11033: - Attachment: HDFS-11033-v1.patch Initial patch > Add documents for native raw eraure coder in XOR codes >

[jira] [Updated] (HDFS-11033) Add documents for native raw erasure coder in XOR codes

2016-10-19 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11033: - Summary: Add documents for native raw erasure coder in XOR codes (was: Add documents for native raw eraur

[jira] [Updated] (HDFS-11033) Add documents for native raw eraure coder in XOR codes

2016-10-19 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11033: - Description: Add document for native raw erasure coder in XOR codes. > Add documents for native raw eraure

[jira] [Assigned] (HDFS-8411) Add bytes count metrics to datanode for ECWorker

2016-10-19 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen reassigned HDFS-8411: --- Assignee: SammiChen (was: Li Bo) > Add bytes count metrics to datanode for ECWorker > ---

[jira] [Commented] (HDFS-10999) Use more generic "low redundancy" blocks instead of "under replicated" blocks

2016-10-19 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15588153#comment-15588153 ] Yuanbo Liu commented on HDFS-10999: --- I guess some monitor scripts are based on "fsck" co

[jira] [Commented] (HDFS-8410) Add computation time metrics to datanode for ECWorker

2016-10-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15588186#comment-15588186 ] Hadoop QA commented on HDFS-8410: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

[jira] [Updated] (HDFS-11026) Convert BlockTokenIdentifier to use Protobuf

2016-10-19 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-11026: -- Attachment: blocktokenidentifier-protobuf.patch Attaching a patch that converts the {{BlockTokenIdentifi

[jira] [Updated] (HDFS-11026) Convert BlockTokenIdentifier to use Protobuf

2016-10-19 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-11026: -- Fix Version/s: 3.0.0-alpha2 Status: Patch Available (was: Open) > Convert BlockTokenIdentifi

[jira] [Updated] (HDFS-11033) Add documents for native raw erasure coder in XOR codes

2016-10-19 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11033: --- Component/s: erasure-coding documentation > Add documents for native raw eras

[jira] [Updated] (HDFS-11033) Add documents for native raw erasure coder in XOR codes

2016-10-19 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11033: --- Affects Version/s: 3.0.0-alpha1 > Add documents for native raw erasure coder in XOR codes > --

[jira] [Commented] (HDFS-11026) Convert BlockTokenIdentifier to use Protobuf

2016-10-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15588360#comment-15588360 ] Hadoop QA commented on HDFS-11026: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-8411) Add bytes count metrics to datanode for ECWorker

2016-10-19 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-8411: Attachment: HDFS-8411-004.patch Rebase and refactor the patch > Add bytes count metrics to datanode for ECWo

[jira] [Updated] (HDFS-8411) Add bytes count metrics to datanode for ECWorker

2016-10-19 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-8411: Status: Patch Available (was: Open) > Add bytes count metrics to datanode for ECWorker > ---

[jira] [Updated] (HDFS-11033) Add documents for native raw erasure coder in XOR codes

2016-10-19 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11033: - Status: Patch Available (was: Open) > Add documents for native raw erasure coder in XOR codes > -

[jira] [Updated] (HDFS-10905) Refactor DataStreamer#createBlockOutputStream

2016-10-19 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated HDFS-10905: -- Status: Patch Available (was: Open) > Refactor DataStreamer#createBlockOutputStream > -

[jira] [Updated] (HDFS-10905) Refactor DataStreamer#createBlockOutputStream

2016-10-19 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated HDFS-10905: -- Attachment: HDFS-10905.001.patch uploaded v1 patch > Refactor DataStreamer#createBlockOutputStream > --

[jira] [Commented] (HDFS-10905) Refactor DataStreamer#createBlockOutputStream

2016-10-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15588640#comment-15588640 ] Hadoop QA commented on HDFS-10905: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-8411) Add bytes count metrics to datanode for ECWorker

2016-10-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15588653#comment-15588653 ] Hadoop QA commented on HDFS-8411: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-11033) Add documents for native raw erasure coder in XOR codes

2016-10-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15588693#comment-15588693 ] Hadoop QA commented on HDFS-11033: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-11026) Convert BlockTokenIdentifier to use Protobuf

2016-10-19 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15588694#comment-15588694 ] Ewan Higgs commented on HDFS-11026: --- No new tests were added to the patch because this i

[jira] [Commented] (HDFS-11025) TestDiskspaceQuotaUpdate fails in trunk due to Bind exception

2016-10-19 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15588702#comment-15588702 ] Eric Badger commented on HDFS-11025: +1 non binding > TestDiskspaceQuotaUpdate fails

[jira] [Commented] (HDFS-9096) Issue in Rollback (after rolling upgrade) from hadoop 2.7.1 to 2.4.0

2016-10-19 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15588854#comment-15588854 ] Kihwal Lee commented on HDFS-9096: -- Were you issuing rollback with 2.7.1? > Issue in Roll

[jira] [Commented] (HDFS-11026) Convert BlockTokenIdentifier to use Protobuf

2016-10-19 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15588835#comment-15588835 ] Daryn Sharp commented on HDFS-11026: -1 While it's a long needed change, there must be

[jira] [Updated] (HDFS-10905) Refactor DataStreamer#createBlockOutputStream

2016-10-19 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated HDFS-10905: -- Attachment: HDFS-10905.002.patch uploaded v2 patch to address check style failure. Since it's a code ref

[jira] [Comment Edited] (HDFS-9096) Issue in Rollback (after rolling upgrade) from hadoop 2.7.1 to 2.4.0

2016-10-19 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15588854#comment-15588854 ] Kihwal Lee edited comment on HDFS-9096 at 10/19/16 2:05 PM: Wer

[jira] [Commented] (HDFS-10905) Refactor DataStreamer#createBlockOutputStream

2016-10-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15588936#comment-15588936 ] Hadoop QA commented on HDFS-10905: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-11026) Convert BlockTokenIdentifier to use Protobuf

2016-10-19 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15589050#comment-15589050 ] Ewan Higgs commented on HDFS-11026: --- Hi Daryn, Thanks for taking a look. The patch targ

[jira] [Commented] (HDFS-11026) Convert BlockTokenIdentifier to use Protobuf

2016-10-19 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15589177#comment-15589177 ] Daryn Sharp commented on HDFS-11026: IMHO, a major upgrade shouldn't be a sufficient r

[jira] [Comment Edited] (HDFS-11019) Inconsistent number of corrupt replicas if a corrupt replica is reported multiple times

2016-10-19 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15589190#comment-15589190 ] Kuhu Shukla edited comment on HDFS-11019 at 10/19/16 4:36 PM: --

[jira] [Updated] (HDFS-11019) Inconsistent number of corrupt replicas if a corrupt replica is reported multiple times

2016-10-19 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-11019: --- Attachment: HDFS-11019.test.patch [~jojochuang] Thank you reporting this. In Hadoop 2.6(CDH 5.7.2) Th

[jira] [Created] (HDFS-11034) Provide a command line tool to clear decommissioned DataNode information from the NameNode without restarting.

2016-10-19 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-11034: Summary: Provide a command line tool to clear decommissioned DataNode information from the NameNode without restarting. Key: HDFS-11034 URL: https://issues.apache.org/jira/browse/

[jira] [Commented] (HDFS-11034) Provide a command line tool to clear decommissioned DataNode information from the NameNode without restarting.

2016-10-19 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15589341#comment-15589341 ] Chris Nauroth commented on HDFS-11034: -- We can add a new dfsadmin command to clear th

[jira] [Commented] (HDFS-11033) Add documents for native raw erasure coder in XOR codes

2016-10-19 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15589370#comment-15589370 ] Wei-Chiu Chuang commented on HDFS-11033: Looks mostly good to me. bq. For defaul

[jira] [Updated] (HDFS-10997) Reduce number of path resolving methods

2016-10-19 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-10997: --- Attachment: HDFS-10997.2.patch Updating. > Reduce number of path resolving methods >

[jira] [Created] (HDFS-11035) Better documentation for maintenace mode and upgrade domain

2016-10-19 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-11035: -- Summary: Better documentation for maintenace mode and upgrade domain Key: HDFS-11035 URL: https://issues.apache.org/jira/browse/HDFS-11035 Project: Hadoop HDFS

[jira] [Commented] (HDFS-10872) Add MutableRate metrics for FSNamesystemLock operations

2016-10-19 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15589506#comment-15589506 ] Zhe Zhang commented on HDFS-10872: -- Thanks for the discussion Andrew and Erik. I agree t

[jira] [Commented] (HDFS-10975) fsck -list-corruptfileblocks does not report corrupt EC files

2016-10-19 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15589514#comment-15589514 ] Wei-Chiu Chuang commented on HDFS-10975: Thanks very much for the explanation. But

[jira] [Updated] (HDFS-10976) Fsck should mark EC files explicitly

2016-10-19 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10976: --- Attachment: HDFS-10976.002.patch Thanks for the review. Attach a v002 patch to address your co

[jira] [Updated] (HDFS-11027) libhdfs++: Make sure HA retry policy is aware of authentication failures

2016-10-19 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-11027: --- Assignee: (was: James Clampffer) > libhdfs++: Make sure HA retry policy is aware of authen

[jira] [Updated] (HDFS-11027) libhdfs++: Make sure HA retry policy is aware of authentication failures

2016-10-19 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-11027: --- Assignee: James Clampffer > libhdfs++: Make sure HA retry policy is aware of authentication fa

[jira] [Commented] (HDFS-10997) Reduce number of path resolving methods

2016-10-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15589735#comment-15589735 ] Hadoop QA commented on HDFS-10997: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10976) Fsck should mark EC files explicitly

2016-10-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15589785#comment-15589785 ] Hadoop QA commented on HDFS-10976: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10976) Fsck should mark EC files explicitly

2016-10-19 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15589817#comment-15589817 ] Andrew Wang commented on HDFS-10976: LGTM +1 > Fsck should mark EC files explicitly >

[jira] [Updated] (HDFS-6984) In Hadoop 3, make FileStatus serialize itself via protobuf

2016-10-19 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-6984: Attachment: HDFS-6984.003.patch Rebased [~cmccabe]'s patch. * Changed {{FileStatus}} to be {{Serializ

[jira] [Commented] (HDFS-10872) Add MutableRate metrics for FSNamesystemLock operations

2016-10-19 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15589917#comment-15589917 ] Andrew Wang commented on HDFS-10872: Thanks for the replies, Erik, Zhe, inline: bq. A

[jira] [Commented] (HDFS-9952) Expose FSNamesystem lock wait time as metrics

2016-10-19 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15589969#comment-15589969 ] Zhe Zhang commented on HDFS-9952: - Just noticed this work. It's related to the FSN lock met

[jira] [Commented] (HDFS-9952) Expose FSNamesystem lock wait time as metrics

2016-10-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15589976#comment-15589976 ] Hadoop QA commented on HDFS-9952: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-10976) Fsck should mark EC files explicitly

2016-10-19 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15589977#comment-15589977 ] Wei-Chiu Chuang commented on HDFS-10976: Thanks [~andrew.wang]. The failed tests d

[jira] [Updated] (HDFS-11027) libhdfs++: Don't retry if there is an authentication failure

2016-10-19 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-11027: --- Summary: libhdfs++: Don't retry if there is an authentication failure (was: libhdfs++: Make s

[jira] [Updated] (HDFS-11027) libhdfs++: Don't retry if there is an authentication failure

2016-10-19 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-11027: --- Attachment: HDFS-11027.HDFS-8707.000.patch Uploading patch on behalf of [~xiaowei.zhu], can't

[jira] [Commented] (HDFS-9820) Improve distcp to support efficient restore to an earlier snapshot

2016-10-19 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15590004#comment-15590004 ] Andrew Wang commented on HDFS-9820: --- One little nit then, this code block: {code} 80

[jira] [Created] (HDFS-11036) Ozone : reuse Xceiver connection

2016-10-19 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11036: - Summary: Ozone : reuse Xceiver connection Key: HDFS-11036 URL: https://issues.apache.org/jira/browse/HDFS-11036 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Updated] (HDFS-11036) Ozone : reuse Xceiver connection

2016-10-19 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11036: -- Attachment: HDFS-11036-HDFS-7240.001.patch > Ozone : reuse Xceiver connection >

[jira] [Updated] (HDFS-11036) Ozone : reuse Xceiver connection

2016-10-19 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11036: -- Description: Currently for every IO operation a connection is opened/closed, this JIRA proposes to reuse

[jira] [Updated] (HDFS-11036) Ozone : reuse Xceiver connection

2016-10-19 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11036: -- Status: Patch Available (was: Open) > Ozone : reuse Xceiver connection > --

[jira] [Updated] (HDFS-11036) Ozone : reuse Xceiver connection

2016-10-19 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11036: -- Description: Currently for every IO operation calling into XceiverClientManager will open/close a connec

[jira] [Updated] (HDFS-11027) libhdfs++: Don't retry if there is an authentication failure

2016-10-19 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-11027: --- Status: Patch Available (was: Open) > libhdfs++: Don't retry if there is an authentication fa

[jira] [Commented] (HDFS-10943) rollEditLog expects empty EditsDoubleBuffer.bufCurrent which is not guaranteed

2016-10-19 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15590079#comment-15590079 ] Daryn Sharp commented on HDFS-10943: Unless something has changed semi-recently, you d

[jira] [Commented] (HDFS-11018) Incorrect check and message in FsDatasetImpl#invalidate

2016-10-19 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15590094#comment-15590094 ] Wei-Chiu Chuang commented on HDFS-11018: LGTM +1 on the 003 patch. > Incorrect ch

[jira] [Updated] (HDFS-11011) Add unit tests for HDFS command 'dfsadmin -set/clrSpaceQuota'

2016-10-19 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11011: - Attachment: HDFS-11011.004.patch The v3 patch looks good to me overall. {code} 1454ne

[jira] [Commented] (HDFS-11036) Ozone : reuse Xceiver connection

2016-10-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15590100#comment-15590100 ] Hadoop QA commented on HDFS-11036: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-8410) Add computation time metrics to datanode for ECWorker

2016-10-19 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15590103#comment-15590103 ] Andrew Wang commented on HDFS-8410: --- Sorry I didn't mention this in the previous review,

[jira] [Created] (HDFS-11037) DiskBalancer: redirect stdout/stderr stream for easy tests

2016-10-19 Thread Xiaobing Zhou (JIRA)
Xiaobing Zhou created HDFS-11037: Summary: DiskBalancer: redirect stdout/stderr stream for easy tests Key: HDFS-11037 URL: https://issues.apache.org/jira/browse/HDFS-11037 Project: Hadoop HDFS

[jira] [Commented] (HDFS-10999) Use more generic "low redundancy" blocks instead of "under replicated" blocks

2016-10-19 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15590122#comment-15590122 ] Andrew Wang commented on HDFS-10999: [~jojochuang] thanks for sharing that output. All

[jira] [Updated] (HDFS-11036) Ozone : reuse Xceiver connection

2016-10-19 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11036: -- Attachment: HDFS-11036-HDFS-7240.002.patch submit v002 patch to fix findbug and checkstyle warnings. >

[jira] [Created] (HDFS-11038) DiskBalancer: support running multiple commands under one setup of disk balancer

2016-10-19 Thread Xiaobing Zhou (JIRA)
Xiaobing Zhou created HDFS-11038: Summary: DiskBalancer: support running multiple commands under one setup of disk balancer Key: HDFS-11038 URL: https://issues.apache.org/jira/browse/HDFS-11038 Projec

[jira] [Commented] (HDFS-11036) Ozone : reuse Xceiver connection

2016-10-19 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15590168#comment-15590168 ] Chen Liang commented on HDFS-11036: --- [~cnauroth] do you mind taking a look at the patch

[jira] [Commented] (HDFS-11019) Inconsistent number of corrupt replicas if a corrupt replica is reported multiple times

2016-10-19 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15590180#comment-15590180 ] Wei-Chiu Chuang commented on HDFS-11019: Thanks [~kshukla] for that information! I

[jira] [Updated] (HDFS-11037) DiskBalancer: redirect stdout/stderr stream for easy tests

2016-10-19 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-11037: - Fix Version/s: (was: 2.9.0) > DiskBalancer: redirect stdout/stderr stream for easy tests > ---

[jira] [Updated] (HDFS-11038) DiskBalancer: support running multiple commands under one setup of disk balancer

2016-10-19 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-11038: - Fix Version/s: (was: 2.9.0) > DiskBalancer: support running multiple commands under one setup

[jira] [Commented] (HDFS-10943) rollEditLog expects empty EditsDoubleBuffer.bufCurrent which is not guaranteed

2016-10-19 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15590210#comment-15590210 ] Yongjun Zhang commented on HDFS-10943: -- Thanks a lot [~daryn]! Sorry a follow-up que

[jira] [Updated] (HDFS-9820) Improve distcp to support efficient restore to an earlier snapshot

2016-10-19 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-9820: Attachment: HDFS-9820.009.patch Thanks [~andrew.wang]. New rev 009 to fix the comments. > Improve

[jira] [Commented] (HDFS-11027) libhdfs++: Don't retry if there is an authentication failure

2016-10-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15590216#comment-15590216 ] Hadoop QA commented on HDFS-11027: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-11036) Ozone : reuse Xceiver connection

2016-10-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15590220#comment-15590220 ] Hadoop QA commented on HDFS-11036: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10885) [SPS]: Mover tool should not be allowed to run when Storage Policy Satisfier is on

2016-10-19 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15590227#comment-15590227 ] Uma Maheswara Rao G commented on HDFS-10885: HI [~zhouwei], Thank you for work

[jira] [Commented] (HDFS-6984) In Hadoop 3, make FileStatus serialize itself via protobuf

2016-10-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15590249#comment-15590249 ] Hadoop QA commented on HDFS-6984: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HDFS-11036) Ozone : reuse Xceiver connection

2016-10-19 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11036: -- Attachment: HDFS-11036-HDFS-7240.003.patch v003 fix the check style warning, the reset of the warnings a

[jira] [Commented] (HDFS-9820) Improve distcp to support efficient restore to an earlier snapshot

2016-10-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15590280#comment-15590280 ] Hadoop QA commented on HDFS-9820: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

[jira] [Commented] (HDFS-11011) Add unit tests for HDFS command 'dfsadmin -set/clrSpaceQuota'

2016-10-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15590323#comment-15590323 ] Hadoop QA commented on HDFS-11011: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-10752) Several log refactoring/improvement suggestion in HDFS

2016-10-19 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10752: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Commented] (HDFS-11036) Ozone : reuse Xceiver connection

2016-10-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15590349#comment-15590349 ] Hadoop QA commented on HDFS-11036: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-11018) Incorrect check and message in FsDatasetImpl#invalidate

2016-10-19 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15590359#comment-15590359 ] Yiqun Lin commented on HDFS-11018: -- Thanks [~jojochuang] for the review. One point that I

[jira] [Commented] (HDFS-10752) Several log refactoring/improvement suggestion in HDFS

2016-10-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15590371#comment-15590371 ] Hudson commented on HDFS-10752: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Created] (HDFS-11039) Expose more configuration properties to hdfs-default.xml

2016-10-19 Thread Yi Liu (JIRA)
Yi Liu created HDFS-11039: - Summary: Expose more configuration properties to hdfs-default.xml Key: HDFS-11039 URL: https://issues.apache.org/jira/browse/HDFS-11039 Project: Hadoop HDFS Issue Type: Im

[jira] [Commented] (HDFS-9820) Improve distcp to support efficient restore to an earlier snapshot

2016-10-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15590412#comment-15590412 ] Hudson commented on HDFS-9820: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1064

[jira] [Commented] (HDFS-10975) fsck -list-corruptfileblocks does not report corrupt EC files

2016-10-19 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15590450#comment-15590450 ] Takanobu Asanuma commented on HDFS-10975: - I agree that it is counter-intuitive. B

[jira] [Commented] (HDFS-10976) Fsck should mark EC files explicitly

2016-10-19 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15590457#comment-15590457 ] Takanobu Asanuma commented on HDFS-10976: - +1 (non-binding). Thanks again. > Fsck

[jira] [Updated] (HDFS-9820) Improve distcp to support efficient restore to an earlier snapshot

2016-10-19 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-9820: Attachment: HDFS-9820.branch-2.002.patch > Improve distcp to support efficient restore to an earlier

[jira] [Commented] (HDFS-9820) Improve distcp to support efficient restore to an earlier snapshot

2016-10-19 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15590464#comment-15590464 ] Yongjun Zhang commented on HDFS-9820: - Many thanks again [~andrew.wang], I have committ

[jira] [Commented] (HDFS-9820) Improve distcp to support efficient restore to an earlier snapshot

2016-10-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15590514#comment-15590514 ] Hadoop QA commented on HDFS-9820: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

[jira] [Commented] (HDFS-8410) Add computation time metrics to datanode for ECWorker

2016-10-19 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15590592#comment-15590592 ] SammiChen commented on HDFS-8410: - Hi Andrew, thanks for the comments. Yea, It's better to

[jira] [Commented] (HDFS-10905) Refactor DataStreamer#createBlockOutputStream

2016-10-19 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15590595#comment-15590595 ] Yuanbo Liu commented on HDFS-10905: --- I have a little concern about the test cases. Jenki

  1   2   >