[jira] [Updated] (HDFS-13677) Dynamic refresh Disk configuration results in overwriting VolumeMap

[ https://issues.apache.org/jira/browse/HDFS-13677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-13677: - Fix Version/s: (was: 2.10.0) 2.10.2 > Dynamic refresh Disk configu

[jira] [Commented] (HDFS-13677) Dynamic refresh Disk configuration results in overwriting VolumeMap

[ https://issues.apache.org/jira/browse/HDFS-13677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17293891#comment-17293891 ] Stephen O'Donnell commented on HDFS-13677: -- Huum, this change is in branch 2.8,

[jira] [Updated] (HDFS-14013) Skip any credentials stored in HDFS when starting ZKFC

[ https://issues.apache.org/jira/browse/HDFS-14013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-14013: - Resolution: Fixed Status: Resolved (was: Patch Available) Committed from trunk d

[jira] [Updated] (HDFS-14013) Skip any credentials stored in HDFS when starting ZKFC

[ https://issues.apache.org/jira/browse/HDFS-14013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-14013: - Fix Version/s: 3.2.3 3.1.5 3.4.0

[jira] [Commented] (HDFS-14013) Skip any credentials stored in HDFS when starting ZKFC

[ https://issues.apache.org/jira/browse/HDFS-14013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17290071#comment-17290071 ] Stephen O'Donnell commented on HDFS-14013: -- This Yetus run looks much better. Th

[jira] [Updated] (HDFS-15422) Reported IBR is partially replaced with stored info when queuing.

[ https://issues.apache.org/jira/browse/HDFS-15422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15422: - Resolution: Fixed Status: Resolved (was: Patch Available) Committed from trunk d

[jira] [Updated] (HDFS-15422) Reported IBR is partially replaced with stored info when queuing.

[ https://issues.apache.org/jira/browse/HDFS-15422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15422: - Fix Version/s: 2.10.2 > Reported IBR is partially replaced with stored info when queuing.

[jira] [Commented] (HDFS-15422) Reported IBR is partially replaced with stored info when queuing.

[ https://issues.apache.org/jira/browse/HDFS-15422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17289872#comment-17289872 ] Stephen O'Donnell commented on HDFS-15422: -- Thanks for the review [~weichiu]. I

[jira] [Updated] (HDFS-15422) Reported IBR is partially replaced with stored info when queuing.

[ https://issues.apache.org/jira/browse/HDFS-15422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15422: - Attachment: HDFS-15422-branch-2.10.002.patch > Reported IBR is partially replaced with st

[jira] [Updated] (HDFS-15422) Reported IBR is partially replaced with stored info when queuing.

[ https://issues.apache.org/jira/browse/HDFS-15422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15422: - Fix Version/s: 3.2.3 3.1.5 3.4.0

[jira] [Commented] (HDFS-14013) Skip any credentials stored in HDFS when starting ZKFC

[ https://issues.apache.org/jira/browse/HDFS-14013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17289830#comment-17289830 ] Stephen O'Donnell commented on HDFS-14013: -- [~weichiu] Thanks for taking a look.

[jira] [Updated] (HDFS-14013) Skip any credentials stored in HDFS when starting ZKFC

[ https://issues.apache.org/jira/browse/HDFS-14013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-14013: - Description: HADOOP-15157 added the ability to use a jceks credential provider to store t

[jira] [Updated] (HDFS-14013) Skip any credentials stored in HDFS when starting ZKFC

[ https://issues.apache.org/jira/browse/HDFS-14013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-14013: - Description: HADOOP-15157 added the ability to use a jceks credential provider to store t

[jira] [Updated] (HDFS-14013) Skip any credentials stored in HDFS when starting ZKFC

[ https://issues.apache.org/jira/browse/HDFS-14013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-14013: - Summary: Skip any credentials stored in HDFS when starting ZKFC (was: HDFS ZKFC on stand

[jira] [Updated] (HDFS-14013) HDFS ZKFC on standby NN not starting with credentials stored in hdfs

[ https://issues.apache.org/jira/browse/HDFS-14013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-14013: - Target Version/s: 3.4.0 Status: Patch Available (was: Open) > HDFS ZKFC on

[jira] [Updated] (HDFS-14013) HDFS ZKFC on standby NN not starting with credentials stored in hdfs

[ https://issues.apache.org/jira/browse/HDFS-14013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-14013: - Attachment: HDFS-14013.001.patch > HDFS ZKFC on standby NN not starting with credentials

[jira] [Assigned] (HDFS-14013) HDFS ZKFC on standby NN not starting with credentials stored in hdfs

[ https://issues.apache.org/jira/browse/HDFS-14013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell reassigned HDFS-14013: Assignee: Stephen O'Donnell > HDFS ZKFC on standby NN not starting with credential

[jira] [Commented] (HDFS-15422) Reported IBR is partially replaced with stored info when queuing.

[ https://issues.apache.org/jira/browse/HDFS-15422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17289016#comment-17289016 ] Stephen O'Donnell commented on HDFS-15422: -- [~kihwal] Have you been running the

[jira] [Commented] (HDFS-15422) Reported IBR is partially replaced with stored info when queuing.

[ https://issues.apache.org/jira/browse/HDFS-15422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17287710#comment-17287710 ] Stephen O'Donnell commented on HDFS-15422: -- The test TestUnderReplicatedBlocks.t

[jira] [Updated] (HDFS-15422) Reported IBR is partially replaced with stored info when queuing.

[ https://issues.apache.org/jira/browse/HDFS-15422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15422: - Attachment: HDFS-15422.001.patch > Reported IBR is partially replaced with stored info wh

[jira] [Assigned] (HDFS-15422) Reported IBR is partially replaced with stored info when queuing.

[ https://issues.apache.org/jira/browse/HDFS-15422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell reassigned HDFS-15422: Assignee: Stephen O'Donnell > Reported IBR is partially replaced with stored info

[jira] [Updated] (HDFS-15422) Reported IBR is partially replaced with stored info when queuing.

[ https://issues.apache.org/jira/browse/HDFS-15422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15422: - Target Version/s: 3.4.0 (was: 2.10.2) > Reported IBR is partially replaced with stored i

[jira] [Commented] (HDFS-15422) Reported IBR is partially replaced with stored info when queuing.

[ https://issues.apache.org/jira/browse/HDFS-15422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17287194#comment-17287194 ] Stephen O'Donnell commented on HDFS-15422: -- We have had a report of something th

[jira] [Commented] (HDFS-15830) Support to make dfs.image.parallel.load reconfigurable

[ https://issues.apache.org/jira/browse/HDFS-15830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17281826#comment-17281826 ] Stephen O'Donnell commented on HDFS-15830: -- [~ferhui] Thanks for alerting me. Ju

[jira] [Resolved] (HDFS-15818) Fix TestFsDatasetImpl.testReadLockCanBeDisabledByConfig

[ https://issues.apache.org/jira/browse/HDFS-15818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell resolved HDFS-15818. -- Resolution: Fixed > Fix TestFsDatasetImpl.testReadLockCanBeDisabledByConfig > -

[jira] [Updated] (HDFS-15818) Fix TestFsDatasetImpl.testReadLockCanBeDisabledByConfig

[ https://issues.apache.org/jira/browse/HDFS-15818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15818: - Fix Version/s: 3.4.0 > Fix TestFsDatasetImpl.testReadLockCanBeDisabledByConfig >

[jira] [Commented] (HDFS-15792) ClasscastException while loading FSImage

[ https://issues.apache.org/jira/browse/HDFS-15792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17279994#comment-17279994 ] Stephen O'Donnell commented on HDFS-15792: -- If we commit a patch with checkstyle

[jira] [Commented] (HDFS-15792) ClasscastException while loading FSImage

[ https://issues.apache.org/jira/browse/HDFS-15792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17279755#comment-17279755 ] Stephen O'Donnell commented on HDFS-15792: -- I think the changes for 2.10 look go

[jira] [Commented] (HDFS-15798) EC: Reconstruct task failed, and It would be XmitsInProgress of DN has negative number

[ https://issues.apache.org/jira/browse/HDFS-15798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17278113#comment-17278113 ] Stephen O'Donnell commented on HDFS-15798: -- +1 on HDFS-15798.003.patch from me t

[jira] [Commented] (HDFS-15798) EC: Reconstruct task failed, and It would be XmitsInProgress of DN has negative number

[ https://issues.apache.org/jira/browse/HDFS-15798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17277067#comment-17277067 ] Stephen O'Donnell commented on HDFS-15798: -- Yes I had wondered about that too. I

[jira] [Resolved] (HDFS-15795) EC: Wrong checksum when reconstruction was failed by exception

[ https://issues.apache.org/jira/browse/HDFS-15795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell resolved HDFS-15795. -- Resolution: Fixed > EC: Wrong checksum when reconstruction was failed by exception > --

[jira] [Commented] (HDFS-15795) EC: Wrong checksum when reconstruction was failed by exception

[ https://issues.apache.org/jira/browse/HDFS-15795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17277035#comment-17277035 ] Stephen O'Donnell commented on HDFS-15795: -- Committed to trunk on github and it

[jira] [Updated] (HDFS-15795) EC: Wrong checksum when reconstruction was failed by exception

[ https://issues.apache.org/jira/browse/HDFS-15795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15795: - Fix Version/s: 3.2.3 3.1.5 3.4.0

[jira] [Updated] (HDFS-15795) EC: Wrong checksum when reconstruction was failed by exception

[ https://issues.apache.org/jira/browse/HDFS-15795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15795: - Summary: EC: Wrong checksum when reconstruction was failed by exception (was: EC: Return

[jira] [Commented] (HDFS-15792) ClasscastException while loading FSImage

[ https://issues.apache.org/jira/browse/HDFS-15792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276406#comment-17276406 ] Stephen O'Donnell commented on HDFS-15792: -- [~hexiaoqiao] Note there are checkst

[jira] [Comment Edited] (HDFS-15798) EC: Reconstruct task failed, and It would be XmitsInProgress of DN has negative number

[ https://issues.apache.org/jira/browse/HDFS-15798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276247#comment-17276247 ] Stephen O'Donnell edited comment on HDFS-15798 at 2/1/21, 1:42 PM:

[jira] [Commented] (HDFS-15803) EC: Remove unnecessary method (getWeight) in StripedReconstructionInfo

[ https://issues.apache.org/jira/browse/HDFS-15803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276319#comment-17276319 ] Stephen O'Donnell commented on HDFS-15803: -- Looks like this method was added by

[jira] [Updated] (HDFS-15803) EC: Remove unnecessary method (getWeight) in StripedReconstructionInfo

[ https://issues.apache.org/jira/browse/HDFS-15803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15803: - Summary: EC: Remove unnecessary method (getWeight) in StripedReconstructionInfo (was: R

[jira] [Commented] (HDFS-15792) ClasscastException while loading FSImage

[ https://issues.apache.org/jira/browse/HDFS-15792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276314#comment-17276314 ] Stephen O'Donnell commented on HDFS-15792: -- I am +1 on the 005 patch, pending a

[jira] [Commented] (HDFS-15798) EC: Reconstruct task failed, and It would be XmitsInProgress of DN has negative number

[ https://issues.apache.org/jira/browse/HDFS-15798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276304#comment-17276304 ] Stephen O'Donnell commented on HDFS-15798: -- [~haiyang Hu] Thanks for the update.

[jira] [Commented] (HDFS-15798) EC: Reconstruct task failed, and It would be XmitsInProgress of DN has negative number

[ https://issues.apache.org/jira/browse/HDFS-15798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276260#comment-17276260 ] Stephen O'Donnell commented on HDFS-15798: -- Looking at this a bit more closely,

[jira] [Commented] (HDFS-15798) EC: Reconstruct task failed, and It would be XmitsInProgress of DN has negative number

[ https://issues.apache.org/jira/browse/HDFS-15798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276247#comment-17276247 ] Stephen O'Donnell commented on HDFS-15798: -- I just tried running the test again

[jira] [Commented] (HDFS-15792) ClasscastException while loading FSImage

[ https://issues.apache.org/jira/browse/HDFS-15792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17275982#comment-17275982 ] Stephen O'Donnell commented on HDFS-15792: -- Thanks for the revision [~prasad-aci

[jira] [Commented] (HDFS-15792) ClasscastException while loading FSImage

[ https://issues.apache.org/jira/browse/HDFS-15792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17275944#comment-17275944 ] Stephen O'Donnell commented on HDFS-15792: -- Thanks for the clarifications. I had

[jira] [Commented] (HDFS-15792) ClasscastException while loading FSImage

[ https://issues.apache.org/jira/browse/HDFS-15792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17275901#comment-17275901 ] Stephen O'Donnell commented on HDFS-15792: -- [~prasad-acit] I am not able to get

[jira] [Commented] (HDFS-15798) EC: Reconstruct task failed, and It would be XmitsInProgress of DN has negative number

[ https://issues.apache.org/jira/browse/HDFS-15798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17275345#comment-17275345 ] Stephen O'Donnell commented on HDFS-15798: -- The 002 patch LGTM, +1. I will commi

[jira] [Commented] (HDFS-15798) EC: Reconstruct task failed, and the decrementXmitsInProgress operation will be performed twice

[ https://issues.apache.org/jira/browse/HDFS-15798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17273817#comment-17273817 ] Stephen O'Donnell commented on HDFS-15798: -- Thanks for finding and submitting a

[jira] [Updated] (HDFS-15798) EC: Reconstruct task failed, and the decrementXmitsInProgress operation will be performed twice

[ https://issues.apache.org/jira/browse/HDFS-15798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15798: - Target Version/s: 3.4.0 Status: Patch Available (was: Open) > EC: Reconstr

[jira] [Commented] (HDFS-15796) ConcurrentModificationException error happens on NameNode occasionally

[ https://issues.apache.org/jira/browse/HDFS-15796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17273633#comment-17273633 ] Stephen O'Donnell commented on HDFS-15796: -- [~Daniel Ma] which version are you r

[jira] [Updated] (HDFS-15795) EC: Returned wrong checksum when reconstruction was failed by exception

[ https://issues.apache.org/jira/browse/HDFS-15795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15795: - Summary: EC: Returned wrong checksum when reconstruction was failed by exception (was: R

[jira] [Commented] (HDFS-15797) EC: reconstruction threads limit parameter does not take effect

[ https://issues.apache.org/jira/browse/HDFS-15797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17273486#comment-17273486 ] Stephen O'Donnell commented on HDFS-15797: -- Hi [~wanghongbing] - should we close

[jira] [Updated] (HDFS-15725) Lease Recovery never completes for a committed block which the DNs never finalize

[ https://issues.apache.org/jira/browse/HDFS-15725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15725: - Resolution: Fixed Status: Resolved (was: Patch Available) > Lease Recovery never

[jira] [Updated] (HDFS-15725) Lease Recovery never completes for a committed block which the DNs never finalize

[ https://issues.apache.org/jira/browse/HDFS-15725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15725: - Fix Version/s: 3.2.3 2.10.2 3.1.5

[jira] [Commented] (HDFS-15725) Lease Recovery never completes for a committed block which the DNs never finalize

[ https://issues.apache.org/jira/browse/HDFS-15725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17248969#comment-17248969 ] Stephen O'Donnell commented on HDFS-15725: -- Committed this all the way down to b

[jira] [Updated] (HDFS-15725) Lease Recovery never completes for a committed block which the DNs never finalize

[ https://issues.apache.org/jira/browse/HDFS-15725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15725: - Attachment: HDFS-15725.branch-2.10.001.patch > Lease Recovery never completes for a commi

[jira] [Commented] (HDFS-15725) Lease Recovery never completes for a committed block which the DNs never finalize

[ https://issues.apache.org/jira/browse/HDFS-15725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17248242#comment-17248242 ] Stephen O'Donnell commented on HDFS-15725: -- I have committed this to trunk and b

[jira] [Updated] (HDFS-15725) Lease Recovery never completes for a committed block which the DNs never finalize

[ https://issues.apache.org/jira/browse/HDFS-15725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15725: - Attachment: HDFS-15725.branch-3.2.001.patch > Lease Recovery never completes for a commit

[jira] [Commented] (HDFS-15725) Lease Recovery never completes for a committed block which the DNs never finalize

[ https://issues.apache.org/jira/browse/HDFS-15725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17248022#comment-17248022 ] Stephen O'Donnell commented on HDFS-15725: -- Thanks for the reviews. This change

[jira] [Commented] (HDFS-15725) Lease Recovery never completes for a committed block which the DNs never finalize

[ https://issues.apache.org/jira/browse/HDFS-15725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17247970#comment-17247970 ] Stephen O'Donnell commented on HDFS-15725: -- I ran the failing tests a few times

[jira] [Commented] (HDFS-15725) Lease Recovery never completes for a committed block which the DNs never finalize

[ https://issues.apache.org/jira/browse/HDFS-15725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17247820#comment-17247820 ] Stephen O'Donnell commented on HDFS-15725: -- [~szetszwo] Thanks for taking a look

[jira] [Updated] (HDFS-15725) Lease Recovery never completes for a committed block which the DNs never finalize

[ https://issues.apache.org/jira/browse/HDFS-15725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15725: - Attachment: HDFS-15725.003.patch > Lease Recovery never completes for a committed block w

[jira] [Commented] (HDFS-15725) Lease Recovery never completes for a committed block which the DNs never finalize

[ https://issues.apache.org/jira/browse/HDFS-15725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17247518#comment-17247518 ] Stephen O'Donnell commented on HDFS-15725: -- Uploaded v002 based on the patch [~k

[jira] [Updated] (HDFS-15725) Lease Recovery never completes for a committed block which the DNs never finalize

[ https://issues.apache.org/jira/browse/HDFS-15725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15725: - Attachment: HDFS-15725.002.patch > Lease Recovery never completes for a committed block w

[jira] [Commented] (HDFS-15725) Lease Recovery never completes for a committed block which the DNs never finalize

[ https://issues.apache.org/jira/browse/HDFS-15725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17247501#comment-17247501 ] Stephen O'Donnell commented on HDFS-15725: -- Yes, it is probably the shutdown hoo

[jira] [Commented] (HDFS-15725) Lease Recovery never completes for a committed block which the DNs never finalize

[ https://issues.apache.org/jira/browse/HDFS-15725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17247464#comment-17247464 ] Stephen O'Donnell commented on HDFS-15725: -- [~kihwal] Thanks for this. I will ha

[jira] [Commented] (HDFS-15725) Lease Recovery never completes for a committed block which the DNs never finalize

[ https://issues.apache.org/jira/browse/HDFS-15725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17247448#comment-17247448 ] Stephen O'Donnell commented on HDFS-15725: -- [~szetszwo] Could you have a look at

[jira] [Updated] (HDFS-15725) Lease Recovery never completes for a committed block which the DNs never finalize

[ https://issues.apache.org/jira/browse/HDFS-15725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15725: - Status: Patch Available (was: Open) > Lease Recovery never completes for a committed blo

[jira] [Updated] (HDFS-15725) Lease Recovery never completes for a committed block which the DNs never finalize

[ https://issues.apache.org/jira/browse/HDFS-15725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15725: - Attachment: HDFS-15725.001.patch > Lease Recovery never completes for a committed block w

[jira] [Created] (HDFS-15725) Lease Recovery never completes for a committed block which the DNs never finalize

Stephen O'Donnell created HDFS-15725: Summary: Lease Recovery never completes for a committed block which the DNs never finalize Key: HDFS-15725 URL: https://issues.apache.org/jira/browse/HDFS-15725

[jira] [Updated] (HDFS-15709) EC: Socket file descriptor leak in StripedBlockChecksumReconstructor

[ https://issues.apache.org/jira/browse/HDFS-15709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15709: - Summary: EC: Socket file descriptor leak in StripedBlockChecksumReconstructor (was: Sock

[jira] [Commented] (HDFS-15569) Speed up the Storage#doRecover during datanode rolling upgrade

[ https://issues.apache.org/jira/browse/HDFS-15569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17227012#comment-17227012 ] Stephen O'Donnell commented on HDFS-15569: -- I just thought it would be almost as

[jira] [Commented] (HDFS-15634) Invalidate block on decommissioning DataNode after replication

[ https://issues.apache.org/jira/browse/HDFS-15634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17215676#comment-17215676 ] Stephen O'Donnell commented on HDFS-15634: -- The issue you have seen is a fairly

[jira] [Comment Edited] (HDFS-15634) Invalidate block on decommissioning DataNode after replication

[ https://issues.apache.org/jira/browse/HDFS-15634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17215288#comment-17215288 ] Stephen O'Donnell edited comment on HDFS-15634 at 10/16/20, 9:27 AM: --

[jira] [Commented] (HDFS-15634) Invalidate block on decommissioning DataNode after replication

[ https://issues.apache.org/jira/browse/HDFS-15634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17215288#comment-17215288 ] Stephen O'Donnell commented on HDFS-15634: -- {quote} Proposal: Invalidate these b

[jira] [Commented] (HDFS-15621) Datanode DirectoryScanner uses excessive memory

[ https://issues.apache.org/jira/browse/HDFS-15621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17211086#comment-17211086 ] Stephen O'Donnell commented on HDFS-15621: -- [~belugabehr] That is a good idea. I

[jira] [Updated] (HDFS-15621) Datanode DirectoryScanner uses excessive memory

[ https://issues.apache.org/jira/browse/HDFS-15621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15621: - Attachment: Screenshot 2020-10-09 at 15.20.56.png > Datanode DirectoryScanner uses excess

[jira] [Created] (HDFS-15621) Datanode DirectoryScanner uses excessive memory

Stephen O'Donnell created HDFS-15621: Summary: Datanode DirectoryScanner uses excessive memory Key: HDFS-15621 URL: https://issues.apache.org/jira/browse/HDFS-15621 Project: Hadoop HDFS I

[jira] [Updated] (HDFS-15621) Datanode DirectoryScanner uses excessive memory

[ https://issues.apache.org/jira/browse/HDFS-15621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15621: - Attachment: Screenshot 2020-10-09 at 14.11.36.png > Datanode DirectoryScanner uses excess

[jira] [Updated] (HDFS-15415) Reduce locking in Datanode DirectoryScanner

[ https://issues.apache.org/jira/browse/HDFS-15415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15415: - Fix Version/s: (was: 3.2.3) 3.2.2 > Reduce locking in Datanode Dir

[jira] [Updated] (HDFS-15415) Reduce locking in Datanode DirectoryScanner

[ https://issues.apache.org/jira/browse/HDFS-15415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15415: - Resolution: Fixed Status: Resolved (was: Patch Available) Committed from trunk d

[jira] [Updated] (HDFS-15415) Reduce locking in Datanode DirectoryScanner

[ https://issues.apache.org/jira/browse/HDFS-15415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15415: - Fix Version/s: 3.2.3 3.1.5 > Reduce locking in Datanode DirectoryScann

[jira] [Commented] (HDFS-15382) Split FsDatasetImpl from blockpool lock to blockpool volume lock

[ https://issues.apache.org/jira/browse/HDFS-15382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17203837#comment-17203837 ] Stephen O'Donnell commented on HDFS-15382: -- [~LiJinglun] There is a similar chan

[jira] [Updated] (HDFS-15415) Reduce locking in Datanode DirectoryScanner

[ https://issues.apache.org/jira/browse/HDFS-15415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15415: - Attachment: HDFS-15415.branch-3.1.002.patch > Reduce locking in Datanode DirectoryScanner

[jira] [Commented] (HDFS-15415) Reduce locking in Datanode DirectoryScanner

[ https://issues.apache.org/jira/browse/HDFS-15415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17203511#comment-17203511 ] Stephen O'Donnell commented on HDFS-15415: -- Updated a patch for branch-3.1. With

[jira] [Updated] (HDFS-15415) Reduce locking in Datanode DirectoryScanner

[ https://issues.apache.org/jira/browse/HDFS-15415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15415: - Attachment: HDFS-15415.branch-3.1.001.patch > Reduce locking in Datanode DirectoryScanner

[jira] [Commented] (HDFS-15415) Reduce locking in Datanode DirectoryScanner

[ https://issues.apache.org/jira/browse/HDFS-15415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17203498#comment-17203498 ] Stephen O'Donnell commented on HDFS-15415: -- [~weichiu] Thanks for committing. Th

[jira] [Commented] (HDFS-12861) Track speed in DFSClient

[ https://issues.apache.org/jira/browse/HDFS-12861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17203489#comment-17203489 ] Stephen O'Donnell commented on HDFS-12861: -- It would be great to move this chang

[jira] [Commented] (HDFS-14084) Need for more stats in DFSClient

[ https://issues.apache.org/jira/browse/HDFS-14084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17203481#comment-17203481 ] Stephen O'Donnell commented on HDFS-14084: -- [~xkrogen] It looks like this Jira w

[jira] [Commented] (HDFS-15569) Speed up the Storage#doRecover during datanode rolling upgrade

[ https://issues.apache.org/jira/browse/HDFS-15569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17201450#comment-17201450 ] Stephen O'Donnell commented on HDFS-15569: -- If there are multiple restarts of th

[jira] [Commented] (HDFS-15415) Reduce locking in Datanode DirectoryScanner

[ https://issues.apache.org/jira/browse/HDFS-15415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17201342#comment-17201342 ] Stephen O'Donnell commented on HDFS-15415: -- Thanks [~weichiu] - I ran both the f

[jira] [Updated] (HDFS-15415) Reduce locking in Datanode DirectoryScanner

[ https://issues.apache.org/jira/browse/HDFS-15415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15415: - Attachment: HDFS-15415.branch-3.2.002.patch > Reduce locking in Datanode DirectoryScanner

[jira] [Commented] (HDFS-15415) Reduce locking in Datanode DirectoryScanner

[ https://issues.apache.org/jira/browse/HDFS-15415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17200013#comment-17200013 ] Stephen O'Donnell commented on HDFS-15415: -- I committed the branch-3.3 patch and

[jira] [Updated] (HDFS-15415) Reduce locking in Datanode DirectoryScanner

[ https://issues.apache.org/jira/browse/HDFS-15415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15415: - Attachment: HDFS-15415.branch-3.2.001.patch > Reduce locking in Datanode DirectoryScanner

[jira] [Updated] (HDFS-15415) Reduce locking in Datanode DirectoryScanner

[ https://issues.apache.org/jira/browse/HDFS-15415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15415: - Fix Version/s: 3.3.1 > Reduce locking in Datanode DirectoryScanner >

[jira] [Updated] (HDFS-15583) Backport DirectoryScanner improvements HDFS-14476, HDFS-14751 and HDFS-15048 to branch 3.2 and 3.1

[ https://issues.apache.org/jira/browse/HDFS-15583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15583: - Fix Version/s: 3.2.3 3.1.5 Resolution: Fixed Status:

[jira] [Comment Edited] (HDFS-15415) Reduce locking in Datanode DirectoryScanner

[ https://issues.apache.org/jira/browse/HDFS-15415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17199691#comment-17199691 ] Stephen O'Donnell edited comment on HDFS-15415 at 9/21/20, 10:27 PM: --

[jira] [Commented] (HDFS-15415) Reduce locking in Datanode DirectoryScanner

[ https://issues.apache.org/jira/browse/HDFS-15415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17199691#comment-17199691 ] Stephen O'Donnell commented on HDFS-15415: -- I will commit the branch-3.3 patch t

[jira] [Commented] (HDFS-15583) Backport DirectoryScanner improvements HDFS-14476, HDFS-14751 and HDFS-15048 to branch 3.2 and 3.1

[ https://issues.apache.org/jira/browse/HDFS-15583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17198355#comment-17198355 ] Stephen O'Donnell commented on HDFS-15583: -- This patch also applies cleanly to b

[jira] [Commented] (HDFS-15584) Improve HDFS large deletion cause namenode lockqueue boom and pending deletion boom.

[ https://issues.apache.org/jira/browse/HDFS-15584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17198204#comment-17198204 ] Stephen O'Donnell commented on HDFS-15584: -- Even though the loop in delete drops

[jira] [Commented] (HDFS-15581) Access Controlled HTTPFS Proxy

[ https://issues.apache.org/jira/browse/HDFS-15581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17198188#comment-17198188 ] Stephen O'Donnell commented on HDFS-15581: -- I think I must have clicked "assign"

<    1   2   3   4   5   6   7   8   9   10   >