[jira] [Updated] (HDFS-8270) create() always retried with hardcoded timeout when file already exists with open lease

[ https://issues.apache.org/jira/browse/HDFS-8270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-8270: Resolution: Fixed Fix Version/s: 2.7.1 Release Note: Proxy level retries will not be done

[jira] [Updated] (HDFS-8523) Remove usage information on unsupported operation "fsck -showprogress"

[ https://issues.apache.org/jira/browse/HDFS-8523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] J.Andreina updated HDFS-8523: - Status: Patch Available (was: Open) > Remove usage information on unsupported operation "fsck -showprogres

[jira] [Updated] (HDFS-8523) Remove usage information on unsupported operation "fsck -showprogress"

[ https://issues.apache.org/jira/browse/HDFS-8523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] J.Andreina updated HDFS-8523: - Attachment: HDFS-8523.1-branch-2.7.0.patch Attached an initial patch. Please review. > Remove usage inform

[jira] [Updated] (HDFS-8270) create() always retried with hardcoded timeout when file already exists with open lease

[ https://issues.apache.org/jira/browse/HDFS-8270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-8270: Summary: create() always retried with hardcoded timeout when file already exists with open lease (wa

[jira] [Commented] (HDFS-8270) create() always retried with hardcoded timeout when file already exists

[ https://issues.apache.org/jira/browse/HDFS-8270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14570366#comment-14570366 ] Vinayakumar B commented on HDFS-8270: - Thanks [~jingzhao] for the confirmation. > crea

[jira] [Commented] (HDFS-8270) create() always retried with hardcoded timeout when file already exists

[ https://issues.apache.org/jira/browse/HDFS-8270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14570365#comment-14570365 ] Vinayakumar B commented on HDFS-8270: - Latest patch looks good to me. Checkstyle is re

[jira] [Updated] (HDFS-3716) Purger should remove stale fsimage ckpt files

[ https://issues.apache.org/jira/browse/HDFS-3716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] J.Andreina updated HDFS-3716: - Attachment: HDFS-3716.3.patch Thanks [~vinayrpet] for the review comments. Attached an updated patch . Plea

[jira] [Commented] (HDFS-8270) create() always retried with hardcoded timeout when file already exists

[ https://issues.apache.org/jira/browse/HDFS-8270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14570362#comment-14570362 ] Jing Zhao commented on HDFS-8270: - bq. In that case I don't think removing would be problem

[jira] [Commented] (HDFS-8270) create() always retried with hardcoded timeout when file already exists

[ https://issues.apache.org/jira/browse/HDFS-8270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14570345#comment-14570345 ] Hadoop QA commented on HDFS-8270: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Created] (HDFS-8523) Remove usage information on unsupported operation "fsck -showprogress"

J.Andreina created HDFS-8523: Summary: Remove usage information on unsupported operation "fsck -showprogress" Key: HDFS-8523 URL: https://issues.apache.org/jira/browse/HDFS-8523 Project: Hadoop HDFS

[jira] [Commented] (HDFS-8470) fsimage loading progress should update inode, delegation token and cache pool count.

[ https://issues.apache.org/jira/browse/HDFS-8470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14570343#comment-14570343 ] Vinayakumar B commented on HDFS-8470: - {{prog.getCounter(Phase.LOADING_FSIMAGE, current

[jira] [Commented] (HDFS-3716) Purger should remove stale fsimage ckpt files

[ https://issues.apache.org/jira/browse/HDFS-3716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14570333#comment-14570333 ] Vinayakumar B commented on HDFS-3716: - Latest patch and test looks fine. Just small nit

[jira] [Commented] (HDFS-8410) Add to Datanode the time taken for computations during EC reconstruction

[ https://issues.apache.org/jira/browse/HDFS-8410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14570331#comment-14570331 ] Li Bo commented on HDFS-8410: - The patch is based on HDFS-8449 > Add to Datanode the time take

[jira] [Updated] (HDFS-7874) Even-though rollback image is created, after restarting namenode with "rollingUpgrade started" option , createdRollbackImages is set to false.

[ https://issues.apache.org/jira/browse/HDFS-7874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] J.Andreina updated HDFS-7874: - Resolution: Implemented Status: Resolved (was: Patch Available) Issue is been implemented and fixe

[jira] [Updated] (HDFS-3716) Purger should remove stale fsimage ckpt files

[ https://issues.apache.org/jira/browse/HDFS-3716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] J.Andreina updated HDFS-3716: - Attachment: HDFS-3716.2.patch Thanks [~vinayrpet] for reviewing the patch. Have updated the patch with a te

[jira] [Updated] (HDFS-8328) Follow-on to update decode for DataNode striped blocks reconstruction

[ https://issues.apache.org/jira/browse/HDFS-8328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-8328: - Attachment: HDFS-8328-HDFS-7285.003.patch Update the patch to add more docs. > Follow-on to update decode for Data

[jira] [Commented] (HDFS-8319) Erasure Coding: support decoding for stateful read

[ https://issues.apache.org/jira/browse/HDFS-8319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14570265#comment-14570265 ] Zhe Zhang commented on HDFS-8319: - bq. Did you miss the break statement too? It only prepa

[jira] [Updated] (HDFS-8470) fsimage loading progress should update inode, delegation token and cache pool count.

[ https://issues.apache.org/jira/browse/HDFS-8470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] surendra singh lilhore updated HDFS-8470: - Attachment: HDFS-8470_2.patch Fixed checkstyle error and attached updated patch. Pl

[jira] [Commented] (HDFS-8497) ErasureCodingWorker fails to do decode work

[ https://issues.apache.org/jira/browse/HDFS-8497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14570218#comment-14570218 ] Li Bo commented on HDFS-8497: - Sorry for the late reply due to my annual leave from work. I run

[jira] [Commented] (HDFS-8521) Add @VisibleForTesting annotation to {{BlockPoolSlice#selectReplicaToDelete}}

[ https://issues.apache.org/jira/browse/HDFS-8521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14570208#comment-14570208 ] Hudson commented on HDFS-8521: -- FAILURE: Integrated in Hadoop-trunk-Commit #7946 (See [https:

[jira] [Updated] (HDFS-8521) Add @VisibleForTesting annotation to {{BlockPoolSlice#selectReplicaToDelete}}

[ https://issues.apache.org/jira/browse/HDFS-8521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8521: --- Resolution: Fixed Fix Version/s: 2.7.1 Target Version/s: 2.7.1 (was: 2

[jira] [Commented] (HDFS-7240) Object store in HDFS

[ https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14570203#comment-14570203 ] Colin Patrick McCabe commented on HDFS-7240: Thanks, Jitendra. I think it make

[jira] [Commented] (HDFS-8328) Follow-on to update decode for DataNode striped blocks reconstruction

[ https://issues.apache.org/jira/browse/HDFS-8328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14570204#comment-14570204 ] Walter Su commented on HDFS-8328: - I see. The logic of scheduleNewRead(..) is correct. > F

[jira] [Commented] (HDFS-8328) Follow-on to update decode for DataNode striped blocks reconstruction

[ https://issues.apache.org/jira/browse/HDFS-8328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14570199#comment-14570199 ] Kai Zheng commented on HDFS-8328: - Yi HDFS-8517 borrowed the utility function and had got c

[jira] [Commented] (HDFS-8494) Remove hard-coded chunk size in favor of ECZone

[ https://issues.apache.org/jira/browse/HDFS-8494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14570196#comment-14570196 ] Kai Zheng commented on HDFS-8494: - bq. is it possible to restore ECZone when restoring file

[jira] [Updated] (HDFS-8270) create() always retried with hardcoded timeout when file already exists

[ https://issues.apache.org/jira/browse/HDFS-8270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] J.Andreina updated HDFS-8270: - Attachment: HDFS-8270.3.patch Fixed checkstyle error and attached updated patch. Please review. > create()

[jira] [Commented] (HDFS-8453) Erasure coding: properly handle start offset for internal blocks in a block group

[ https://issues.apache.org/jira/browse/HDFS-8453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14570179#comment-14570179 ] Hadoop QA commented on HDFS-8453: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-7661) Support read when a EC file is being written

[ https://issues.apache.org/jira/browse/HDFS-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14570176#comment-14570176 ] GAO Rui commented on HDFS-7661: --- Hi [~szetszwo]. I have finished the basic reading tests of E

[jira] [Commented] (HDFS-8504) Some hdfs admin operations from client should have audit logs

[ https://issues.apache.org/jira/browse/HDFS-8504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14570172#comment-14570172 ] Bob commented on HDFS-8504: --- [~aw], Thanks for your quick reply. We can close it. > Some hdfs ad

[jira] [Comment Edited] (HDFS-8328) Follow-on to update decode for DataNode striped blocks reconstruction

[ https://issues.apache.org/jira/browse/HDFS-8328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14570144#comment-14570144 ] Yi Liu edited comment on HDFS-8328 at 6/3/15 2:22 AM: -- Thanks for Zhe,

[jira] [Commented] (HDFS-8328) Follow-on to update decode for DataNode striped blocks reconstruction

[ https://issues.apache.org/jira/browse/HDFS-8328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14570144#comment-14570144 ] Yi Liu commented on HDFS-8328: -- Thanks for Zhe, Walter and Kai's comments. My reply to you gu

[jira] [Commented] (HDFS-8494) Remove hard-coded chunk size in favor of ECZone

[ https://issues.apache.org/jira/browse/HDFS-8494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14570123#comment-14570123 ] Kai Sasaki commented on HDFS-8494: -- [~drankye] Thank you for reviewing. I can update 1. Ho

[jira] [Commented] (HDFS-8517) Fix a decoding issue in stripped block recovering in client side

[ https://issues.apache.org/jira/browse/HDFS-8517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14570111#comment-14570111 ] Hadoop QA commented on HDFS-8517: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8319) Erasure Coding: support decoding for stateful read

[ https://issues.apache.org/jira/browse/HDFS-8319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14570102#comment-14570102 ] Walter Su commented on HDFS-8319: - bq. We can rename prepareParityChunk to prepareAdditiona

[jira] [Assigned] (HDFS-8266) Erasure Coding: Test of snapshot with EC files

[ https://issues.apache.org/jira/browse/HDFS-8266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] GAO Rui reassigned HDFS-8266: - Assignee: Rakesh R > Erasure Coding: Test of snapshot with EC files >

[jira] [Commented] (HDFS-8457) Refactor FsDatasetSpi to pull up HDFS-agnostic functionality into parent interface

[ https://issues.apache.org/jira/browse/HDFS-8457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14570087#comment-14570087 ] Hadoop QA commented on HDFS-8457: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8494) Remove hard-coded chunk size in favor of ECZone

[ https://issues.apache.org/jira/browse/HDFS-8494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14570027#comment-14570027 ] Kai Zheng commented on HDFS-8494: - Thanks Kai for the hard work. The patch looks good. Some

[jira] [Commented] (HDFS-8450) Erasure Coding: Consolidate erasure coding zone related implementation into a single class

[ https://issues.apache.org/jira/browse/HDFS-8450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14569998#comment-14569998 ] Kai Zheng commented on HDFS-8450: - Thanks Rakesh again for the update! Some minor comments

[jira] [Commented] (HDFS-8319) Erasure Coding: support decoding for stateful read

[ https://issues.apache.org/jira/browse/HDFS-8319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14569977#comment-14569977 ] Kai Zheng commented on HDFS-8319: - Looks like the involved change is a little big. Maybe we

[jira] [Commented] (HDFS-8453) Erasure coding: properly handle start offset for internal blocks in a block group

[ https://issues.apache.org/jira/browse/HDFS-8453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14569964#comment-14569964 ] Zhe Zhang commented on HDFS-8453: - Thanks Jing! > Erasure coding: properly handle start of

[jira] [Updated] (HDFS-8453) Erasure coding: properly handle start offset for internal blocks in a block group

[ https://issues.apache.org/jira/browse/HDFS-8453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8453: Resolution: Fixed Fix Version/s: HDFS-7285 Hadoop Flags: Reviewed Status: Resolved (wa

[jira] [Commented] (HDFS-8453) Erasure coding: properly handle start offset for internal blocks in a block group

[ https://issues.apache.org/jira/browse/HDFS-8453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14569955#comment-14569955 ] Jing Zhao commented on HDFS-8453: - +1 for the 01 patch. > Erasure coding: properly handle

[jira] [Commented] (HDFS-8513) Rename BlockPlacementPolicyRackFaultTolarent to BlockPlacementPolicyRackFaultTolerant

[ https://issues.apache.org/jira/browse/HDFS-8513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14569947#comment-14569947 ] Hudson commented on HDFS-8513: -- FAILURE: Integrated in Hadoop-trunk-Commit #7945 (See [https:

[jira] [Commented] (HDFS-8386) Improve synchronization of 'streamer' reference in DFSOutputStream

[ https://issues.apache.org/jira/browse/HDFS-8386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14569946#comment-14569946 ] Hudson commented on HDFS-8386: -- FAILURE: Integrated in Hadoop-trunk-Commit #7945 (See [https:

[jira] [Updated] (HDFS-8453) Erasure coding: properly handle start offset for internal blocks in a block group

[ https://issues.apache.org/jira/browse/HDFS-8453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8453: Attachment: HDFS-8453-HDFS-7285.01.patch Thanks Jing for reviewing again! Uploading 01 patch to add a test wi

[jira] [Commented] (HDFS-8319) Erasure Coding: support decoding for stateful read

[ https://issues.apache.org/jira/browse/HDFS-8319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14569927#comment-14569927 ] Kai Zheng commented on HDFS-8319: - Thanks Jing and Zhe for the good work and discussion her

[jira] [Commented] (HDFS-8522) Change heavily recorded NN logs from INFO level to DEBUG level

[ https://issues.apache.org/jira/browse/HDFS-8522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14569925#comment-14569925 ] Xiaoyu Yao commented on HDFS-8522: -- RollingWindowManager.java:getTopUsersForMetric issue h

[jira] [Commented] (HDFS-8453) Erasure coding: properly handle start offset for internal blocks in a block group

[ https://issues.apache.org/jira/browse/HDFS-8453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14569924#comment-14569924 ] Jing Zhao commented on HDFS-8453: - The patch looks pretty good to me. +1 after making the t

[jira] [Updated] (HDFS-8513) Rename BlockPlacementPolicyRackFaultTolarent to BlockPlacementPolicyRackFaultTolerant

[ https://issues.apache.org/jira/browse/HDFS-8513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8513: -- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch Available) Committ

[jira] [Updated] (HDFS-8386) Improve synchronization of 'streamer' reference in DFSOutputStream

[ https://issues.apache.org/jira/browse/HDFS-8386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8386: -- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch Available) Thanks

[jira] [Created] (HDFS-8522) Change heavily recorded NN logs from INFO level to DEBUG level

Xiaoyu Yao created HDFS-8522: Summary: Change heavily recorded NN logs from INFO level to DEBUG level Key: HDFS-8522 URL: https://issues.apache.org/jira/browse/HDFS-8522 Project: Hadoop HDFS Iss

[jira] [Updated] (HDFS-8386) Improve synchronization of 'streamer' reference in DFSOutputStream

[ https://issues.apache.org/jira/browse/HDFS-8386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8386: -- Summary: Improve synchronization of 'streamer' reference in DFSOutputStream (was: Improve synchronizatio

[jira] [Updated] (HDFS-8517) Fix a decoding issue in stripped block recovering in client side

[ https://issues.apache.org/jira/browse/HDFS-8517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8517: Resolution: Fixed Fix Version/s: HDFS-7285 Hadoop Flags: Reviewed Status: Resolved (wa

[jira] [Commented] (HDFS-8517) Fix a decoding issue in stripped block recovering in client side

[ https://issues.apache.org/jira/browse/HDFS-8517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14569903#comment-14569903 ] Jing Zhao commented on HDFS-8517: - Thanks for the quick review, Zhe and Kai! I will commit

[jira] [Commented] (HDFS-7240) Object store in HDFS

[ https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14569888#comment-14569888 ] Jitendra Nath Pandey commented on HDFS-7240: I was planning to do it on webex o

[jira] [Commented] (HDFS-8521) Add @VisibleForTesting annotation to {{BlockPoolSlice#selectReplicaToDelete}}

[ https://issues.apache.org/jira/browse/HDFS-8521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14569884#comment-14569884 ] Hadoop QA commented on HDFS-8521: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-8457) Refactor FsDatasetSpi to pull up HDFS-agnostic functionality into parent interface

[ https://issues.apache.org/jira/browse/HDFS-8457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8457: Attachment: HDFS-8457-HDFS-7240.04.patch > Refactor FsDatasetSpi to pull up HDFS-agnostic functionali

[jira] [Updated] (HDFS-8517) Fix a decoding issue in stripped block recovering in client side

[ https://issues.apache.org/jira/browse/HDFS-8517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-8517: Description: [~jingzhao] reported a decoding issue in HDFS-8481 in the comment copied below: bq. While debugg

[jira] [Commented] (HDFS-8386) Improve synchronization of 'streamer' reference in DFSOutputStream - accessed inconsistently with respect to synchronization

[ https://issues.apache.org/jira/browse/HDFS-8386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14569864#comment-14569864 ] Hadoop QA commented on HDFS-8386: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8517) Fix a decoding issue in stripped block recovering in client side

[ https://issues.apache.org/jira/browse/HDFS-8517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14569862#comment-14569862 ] Kai Zheng commented on HDFS-8517: - Thanks [~zhz] for the review, and [~jingzhao] for the gr

[jira] [Commented] (HDFS-8517) Fix a decoding issue in stripped block recovering in client side

[ https://issues.apache.org/jira/browse/HDFS-8517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14569848#comment-14569848 ] Zhe Zhang commented on HDFS-8517: - Thanks Jing for the quick update. +1 on the latest patch

[jira] [Updated] (HDFS-8517) Fix a decoding issue in stripped block recovering in client side

[ https://issues.apache.org/jira/browse/HDFS-8517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8517: Attachment: HDFS-8517-HDFS-7285.v2.patch Since the remaining issues are mostly minor, I just made these chang

[jira] [Commented] (HDFS-8328) Follow-on to update decode for DataNode striped blocks reconstruction

[ https://issues.apache.org/jira/browse/HDFS-8328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14569817#comment-14569817 ] Zhe Zhang commented on HDFS-8328: - bq. paddingBufferToLen(..) for multiple zeroStripeBuffer

[jira] [Commented] (HDFS-8517) Fix a decoding issue in stripped block recovering in client side

[ https://issues.apache.org/jira/browse/HDFS-8517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14569798#comment-14569798 ] Jing Zhao commented on HDFS-8517: - Thanks for the fix, Kai! The patch looks good to me. Jus

[jira] [Commented] (HDFS-8319) Erasure Coding: support decoding for stateful read

[ https://issues.apache.org/jira/browse/HDFS-8319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14569792#comment-14569792 ] Zhe Zhang commented on HDFS-8319: - Great work Jing! {{StripeReader}} is a very good abstrac

[jira] [Commented] (HDFS-8521) Add @VisibleForTesting annotation to {{BlockPoolSlice#selectReplicaToDelete}}

[ https://issues.apache.org/jira/browse/HDFS-8521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14569776#comment-14569776 ] Andrew Wang commented on HDFS-8521: --- +1 pending > Add @VisibleForTesting annotation to {

[jira] [Commented] (HDFS-8513) Rename BlockPlacementPolicyRackFaultTolarent to BlockPlacementPolicyRackFaultTolerant

[ https://issues.apache.org/jira/browse/HDFS-8513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14569736#comment-14569736 ] Hadoop QA commented on HDFS-8513: - \\ \\ | (/) *{color:green}+1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8513) Rename BlockPlacementPolicyRackFaultTolarent to BlockPlacementPolicyRackFaultTolerant

[ https://issues.apache.org/jira/browse/HDFS-8513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14569705#comment-14569705 ] Colin Patrick McCabe commented on HDFS-8513: +1. > Rename BlockPlacementPolicy

[jira] [Commented] (HDFS-8517) Fix a decoding issue in stripped block recovering in client side

[ https://issues.apache.org/jira/browse/HDFS-8517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14569666#comment-14569666 ] Zhe Zhang commented on HDFS-8517: - Thanks Kai for the work. So basically we need to put par

[jira] [Commented] (HDFS-8495) Consolidate append() related implementation into a single class

[ https://issues.apache.org/jira/browse/HDFS-8495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14569664#comment-14569664 ] Hadoop QA commented on HDFS-8495: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-8521) Add @VisibleForTesting annotation to {{BlockPoolSlice#selectReplicaToDelete}}

[ https://issues.apache.org/jira/browse/HDFS-8521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8521: --- Assignee: Colin Patrick McCabe Target Version/s: 2.8.0 Affects Version

[jira] [Updated] (HDFS-8521) Add @VisibleForTesting annotation to {{BlockPoolSlice#selectReplicaToDelete}}

[ https://issues.apache.org/jira/browse/HDFS-8521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8521: --- Attachment: HDFS-8521.001.patch > Add @VisibleForTesting annotation to {{BlockPoolSlice

[jira] [Created] (HDFS-8521) Add @VisibleForTesting annotation to {{BlockPoolSlice#selectReplicaToDelete}}

Colin Patrick McCabe created HDFS-8521: -- Summary: Add @VisibleForTesting annotation to {{BlockPoolSlice#selectReplicaToDelete}} Key: HDFS-8521 URL: https://issues.apache.org/jira/browse/HDFS-8521

[jira] [Commented] (HDFS-8486) DN startup may cause severe data loss

[ https://issues.apache.org/jira/browse/HDFS-8486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14569562#comment-14569562 ] Hudson commented on HDFS-8486: -- FAILURE: Integrated in Hadoop-trunk-Commit #7944 (See [https:

[jira] [Updated] (HDFS-8486) DN startup may cause severe data loss

[ https://issues.apache.org/jira/browse/HDFS-8486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8486: --- Resolution: Fixed Fix Version/s: 2.7.1 Status: Resolved (was: Patch A

[jira] [Commented] (HDFS-8386) Improve synchronization of 'streamer' reference in DFSOutputStream - accessed inconsistently with respect to synchronization

[ https://issues.apache.org/jira/browse/HDFS-8386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14569553#comment-14569553 ] Rakesh R commented on HDFS-8386: Thanks [~andrew.wang]. I've uploaded another patch by expo

[jira] [Updated] (HDFS-8386) Improve synchronization of 'streamer' reference in DFSOutputStream - accessed inconsistently with respect to synchronization

[ https://issues.apache.org/jira/browse/HDFS-8386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-8386: --- Attachment: HDFS-8386-01.patch > Improve synchronization of 'streamer' reference in DFSOutputStream - accessed

[jira] [Commented] (HDFS-8486) DN startup may cause severe data loss

[ https://issues.apache.org/jira/browse/HDFS-8486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14569547#comment-14569547 ] Colin Patrick McCabe commented on HDFS-8486: Since the only change I was reques

[jira] [Commented] (HDFS-8450) Erasure Coding: Consolidate erasure coding zone related implementation into a single class

[ https://issues.apache.org/jira/browse/HDFS-8450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14569514#comment-14569514 ] Hadoop QA commented on HDFS-8450: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-7542) Add an option to DFSAdmin -safemode wait to ignore connection failures

[ https://issues.apache.org/jira/browse/HDFS-7542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7542: -- Resolution: Later Status: Resolved (was: Patch Available) Some internal discussion, we don't thi

[jira] [Commented] (HDFS-8470) fsimage loading progress should update inode, delegation token and cache pool count.

[ https://issues.apache.org/jira/browse/HDFS-8470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14569502#comment-14569502 ] Hadoop QA commented on HDFS-8470: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8319) Erasure Coding: support decoding for stateful read

[ https://issues.apache.org/jira/browse/HDFS-8319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14569501#comment-14569501 ] Zhe Zhang commented on HDFS-8319: - Thanks Jing for the updates! I'm taking a look at it now

[jira] [Commented] (HDFS-8386) Improve synchronization of 'streamer' reference in DFSOutputStream - accessed inconsistently with respect to synchronization

[ https://issues.apache.org/jira/browse/HDFS-8386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14569494#comment-14569494 ] Andrew Wang commented on HDFS-8386: --- Thanks [~rakeshr] for the update. I like the getter

[jira] [Resolved] (HDFS-8514) hadoop archive command looks at local files when using wildcard

[ https://issues.apache.org/jira/browse/HDFS-8514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter resolved HDFS-8514. - Resolution: Invalid Nevermind. It was bash. If you put quotes around the {{*}} it works correctly

[jira] [Commented] (HDFS-8516) The 'hdfs crypto -listZones' should not print an extra newline at end of output

[ https://issues.apache.org/jira/browse/HDFS-8516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14569474#comment-14569474 ] Andrew Wang commented on HDFS-8516: --- LGTM thanks Harsh. Should we also trim a newline fro

[jira] [Commented] (HDFS-8517) Fix a decoding issue in stripped block recovering in client side

[ https://issues.apache.org/jira/browse/HDFS-8517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14569472#comment-14569472 ] Hadoop QA commented on HDFS-8517: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8319) Erasure Coding: support decoding for stateful read

[ https://issues.apache.org/jira/browse/HDFS-8319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14569471#comment-14569471 ] Jing Zhao commented on HDFS-8319: - Thanks for the comments, Walter! Actually this has been

[jira] [Commented] (HDFS-8516) The 'hdfs crypto -listZones' should not print an extra newline at end of output

[ https://issues.apache.org/jira/browse/HDFS-8516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14569448#comment-14569448 ] Hadoop QA commented on HDFS-8516: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-8513) Rename BlockPlacementPolicyRackFaultTolarent to BlockPlacementPolicyRackFaultTolerant

[ https://issues.apache.org/jira/browse/HDFS-8513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8513: -- Status: Patch Available (was: Open) > Rename BlockPlacementPolicyRackFaultTolarent to > BlockPlacementP

[jira] [Commented] (HDFS-8494) Remove hard-coded chunk size in favor of ECZone

[ https://issues.apache.org/jira/browse/HDFS-8494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14569418#comment-14569418 ] Hadoop QA commented on HDFS-8494: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-8495) Consolidate append() related implementation into a single class

[ https://issues.apache.org/jira/browse/HDFS-8495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-8495: --- Attachment: HDFS-8495-001.patch > Consolidate append() related implementation into a single class > ---

[jira] [Commented] (HDFS-8489) Subclass BlockInfo to represent contiguous blocks

[ https://issues.apache.org/jira/browse/HDFS-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14569337#comment-14569337 ] Hudson commented on HDFS-8489: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2162 (See [htt

[jira] [Commented] (HDFS-8256) "-storagepolicies , -blockId ,-replicaDetails " options are missed out in usage and from documentation

[ https://issues.apache.org/jira/browse/HDFS-8256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14569340#comment-14569340 ] Hudson commented on HDFS-8256: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2162 (See [htt

[jira] [Commented] (HDFS-8256) "-storagepolicies , -blockId ,-replicaDetails " options are missed out in usage and from documentation

[ https://issues.apache.org/jira/browse/HDFS-8256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14569319#comment-14569319 ] Hudson commented on HDFS-8256: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #214 (See

[jira] [Commented] (HDFS-8489) Subclass BlockInfo to represent contiguous blocks

[ https://issues.apache.org/jira/browse/HDFS-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14569318#comment-14569318 ] Hudson commented on HDFS-8489: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #214 (See

[jira] [Updated] (HDFS-8520) Patch for PPC64

[ https://issues.apache.org/jira/browse/HDFS-8520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tony Reix updated HDFS-8520: Attachment: HDFS-8520.patch Proposed patch. > Patch for PPC64 > --- > > Key: HDF

[jira] [Resolved] (HDFS-8519) Patch for PPC64

[ https://issues.apache.org/jira/browse/HDFS-8519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tony Reix resolved HDFS-8519. - Resolution: Invalid > Patch for PPC64 > --- > > Key: HDFS-8519 >

[jira] [Commented] (HDFS-8519) Patch for PPC64

[ https://issues.apache.org/jira/browse/HDFS-8519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14569229#comment-14569229 ] Tony Reix commented on HDFS-8519: - Damned. I received "JIRA issue" and I recreated this JIR

[jira] [Commented] (HDFS-8518) Patch for PPC64

[ https://issues.apache.org/jira/browse/HDFS-8518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14569228#comment-14569228 ] Tony Reix commented on HDFS-8518: - Damned. I received "JIRA issue" and I recreated this JIR

[jira] [Resolved] (HDFS-8518) Patch for PPC64

[ https://issues.apache.org/jira/browse/HDFS-8518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tony Reix resolved HDFS-8518. - Resolution: Invalid > Patch for PPC64 > --- > > Key: HDFS-8518 >

  1   2   >