[jira] [Updated] (HDFS-9263) tests are using /test/build/data; breaking Jenkins

[ https://issues.apache.org/jira/browse/HDFS-9263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9263: - Target Version/s: 3.0.0, 2.7.3, 2.6.5 (was: 3.0.0, 2.7.3, 2.6.4) > tests are using /test/build/data; break

[jira] [Updated] (HDFS-8676) Delayed rolling upgrade finalization can cause heartbeat expiration and write failures

[ https://issues.apache.org/jira/browse/HDFS-8676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8676: - Target Version/s: 2.7.2, 2.6.5 (was: 2.7.2, 2.6.4) > Delayed rolling upgrade finalization can cause heartb

[jira] [Commented] (HDFS-9106) Transfer failure during pipeline recovery causes permanent write failures

[ https://issues.apache.org/jira/browse/HDFS-9106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127557#comment-15127557 ] Junping Du commented on HDFS-9106: -- Move it out of 2.6.4 to 2.6.5 as this JIRA haven't bei

[jira] [Updated] (HDFS-9688) Test the effect of nested encryption zones in HDFS downgrade

[ https://issues.apache.org/jira/browse/HDFS-9688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9688: - Target Version/s: 2.8.0, 2.7.3, 2.6.5 (was: 2.8.0, 2.7.3, 2.6.4) > Test the effect of nested encryption zo

[jira] [Updated] (HDFS-9500) datanodesSoftwareVersions map may counting wrong when rolling upgrade

[ https://issues.apache.org/jira/browse/HDFS-9500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9500: - Target Version/s: 2.7.3, 2.6.5 (was: 2.7.3, 2.6.4) > datanodesSoftwareVersions map may counting wrong when

[jira] [Commented] (HDFS-9500) datanodesSoftwareVersions map may counting wrong when rolling upgrade

[ https://issues.apache.org/jira/browse/HDFS-9500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15120148#comment-15120148 ] Junping Du commented on HDFS-9500: -- Move all non-critical pending issues out of 2.6.4 into

[jira] [Updated] (HDFS-9555) LazyPersistFileScrubber should still sleep if there are errors in the clear progress

[ https://issues.apache.org/jira/browse/HDFS-9555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9555: - Target Version/s: 2.6.5 (was: 2.6.4) > LazyPersistFileScrubber should still sleep if there are errors in t

[jira] [Commented] (HDFS-9555) LazyPersistFileScrubber should still sleep if there are errors in the clear progress

[ https://issues.apache.org/jira/browse/HDFS-9555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15120147#comment-15120147 ] Junping Du commented on HDFS-9555: -- Move all non-critical pending issues out of 2.6.4 into

[jira] [Updated] (HDFS-8870) Lease is leaked on write failure

[ https://issues.apache.org/jira/browse/HDFS-8870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8870: - Target Version/s: 2.7.3, 2.6.5 (was: 2.7.3, 2.6.4) > Lease is leaked on write failure > --

[jira] [Commented] (HDFS-8870) Lease is leaked on write failure

[ https://issues.apache.org/jira/browse/HDFS-8870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15120137#comment-15120137 ] Junping Du commented on HDFS-8870: -- Move it to 2.6.5 as the JIRA haven't been update for a

[jira] [Commented] (HDFS-7694) FSDataInputStream should support "unbuffer"

[ https://issues.apache.org/jira/browse/HDFS-7694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15119738#comment-15119738 ] Junping Du commented on HDFS-7694: -- I have cherry-pick it to branch-2.6. > FSDataInputStr

[jira] [Updated] (HDFS-7694) FSDataInputStream should support "unbuffer"

[ https://issues.apache.org/jira/browse/HDFS-7694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-7694: - Fix Version/s: 2.6.4 > FSDataInputStream should support "unbuffer" > --

[jira] [Resolved] (HDFS-4886) Override verifyBlockPlacement() API in BlockPlacementPolicyWithNodeGroup

[ https://issues.apache.org/jira/browse/HDFS-4886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du resolved HDFS-4886. -- Resolution: Duplicate Assignee: (was: Junping Du) There are already work in HDFS-9456 in progre

[jira] [Commented] (HDFS-7694) FSDataInputStream should support "unbuffer"

[ https://issues.apache.org/jira/browse/HDFS-7694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15117491#comment-15117491 ] Junping Du commented on HDFS-7694: -- Thanks [~cmccabe] for confirmation. I will cherry-pick

[jira] [Commented] (HDFS-7694) FSDataInputStream should support "unbuffer"

[ https://issues.apache.org/jira/browse/HDFS-7694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15114100#comment-15114100 ] Junping Du commented on HDFS-7694: -- bq. Is there compatibility concern for backporting thi

[jira] [Updated] (HDFS-7694) FSDataInputStream should support "unbuffer"

[ https://issues.apache.org/jira/browse/HDFS-7694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-7694: - Target Version/s: 2.7.0, 2.6.4 (was: 2.7.0) > FSDataInputStream should support "unbuffer" > --

[jira] [Commented] (HDFS-9220) Reading small file (< 512 bytes) that is open for append fails due to incorrect checksum

[ https://issues.apache.org/jira/browse/HDFS-9220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15104034#comment-15104034 ] Junping Du commented on HDFS-9220: -- Thanks [~kihwal] for clarification on this. For layout

[jira] [Commented] (HDFS-8871) Decommissioning of a node with a failed volume may not start

[ https://issues.apache.org/jira/browse/HDFS-8871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15103991#comment-15103991 ] Junping Du commented on HDFS-8871: -- Move it out of 2.6.4 given no update for a while. > D

[jira] [Updated] (HDFS-8871) Decommissioning of a node with a failed volume may not start

[ https://issues.apache.org/jira/browse/HDFS-8871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8871: - Target Version/s: 2.7.3, 2.6.5 (was: 2.7.3, 2.6.4) > Decommissioning of a node with a failed volume may no

[jira] [Commented] (HDFS-9500) datanodesSoftwareVersions map may counting wrong when rolling upgrade

[ https://issues.apache.org/jira/browse/HDFS-9500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15103980#comment-15103980 ] Junping Du commented on HDFS-9500: -- bq. So the simplest way to fix this is that we always

[jira] [Commented] (HDFS-8870) Lease is leaked on write failure

[ https://issues.apache.org/jira/browse/HDFS-8870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15103968#comment-15103968 ] Junping Du commented on HDFS-8870: -- Hi [~daryn], is this issue related to HDFS-9294? Thank

[jira] [Commented] (HDFS-9294) DFSClient deadlock when close file and failed to renew lease

[ https://issues.apache.org/jira/browse/HDFS-9294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15103521#comment-15103521 ] Junping Du commented on HDFS-9294: -- BTW, I set back fix version to include 2.7.2 and 2.8.0

[jira] [Commented] (HDFS-9294) DFSClient deadlock when close file and failed to renew lease

[ https://issues.apache.org/jira/browse/HDFS-9294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15103519#comment-15103519 ] Junping Du commented on HDFS-9294: -- Thanks [~brahmareddy] and [~szetszwo] for help on this

[jira] [Updated] (HDFS-9294) DFSClient deadlock when close file and failed to renew lease

[ https://issues.apache.org/jira/browse/HDFS-9294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9294: - Fix Version/s: 2.7.2 2.8.0 > DFSClient deadlock when close file and failed to renew lea

[jira] [Commented] (HDFS-8326) Documentation about when checkpoints are run is out of date

[ https://issues.apache.org/jira/browse/HDFS-8326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15098149#comment-15098149 ] Junping Du commented on HDFS-8326: -- Looks like we wrongly add this to the CHANGES.txt entr

[jira] [Commented] (HDFS-8891) HDFS concat should keep srcs order

[ https://issues.apache.org/jira/browse/HDFS-8891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089150#comment-15089150 ] Junping Du commented on HDFS-8891: -- Thanks [~ajisakaa] and [~chris.douglas] for confirmati

[jira] [Commented] (HDFS-8767) RawLocalFileSystem.listStatus() returns null for UNIX pipefile

[ https://issues.apache.org/jira/browse/HDFS-8767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089145#comment-15089145 ] Junping Du commented on HDFS-8767: -- Thank u, [~ajisakaa]! > RawLocalFileSystem.listStatus

[jira] [Commented] (HDFS-9047) Retire libwebhdfs

[ https://issues.apache.org/jira/browse/HDFS-9047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15087482#comment-15087482 ] Junping Du commented on HDFS-9047: -- bq. IMO +1 on removing them in 2.6 / 2.7 if it's break

[jira] [Commented] (HDFS-9047) Retire libwebhdfs

[ https://issues.apache.org/jira/browse/HDFS-9047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15086600#comment-15086600 ] Junping Du commented on HDFS-9047: -- Hi [~wheat9], what's the plan for branch-2.6/2.7? Remo

[jira] [Updated] (HDFS-8647) Abstract BlockManager's rack policy into BlockPlacementPolicy

[ https://issues.apache.org/jira/browse/HDFS-8647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8647: - Target Version/s: 2.6.4 > Abstract BlockManager's rack policy into BlockPlacementPolicy > -

[jira] [Updated] (HDFS-9314) Improve BlockPlacementPolicyDefault's picking of excess replicas

[ https://issues.apache.org/jira/browse/HDFS-9314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9314: - Target Version/s: 2.6.4 > Improve BlockPlacementPolicyDefault's picking of excess replicas > --

[jira] [Updated] (HDFS-9313) Possible NullPointerException in BlockManager if no excess replica can be chosen

[ https://issues.apache.org/jira/browse/HDFS-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9313: - Target Version/s: 2.6.4 > Possible NullPointerException in BlockManager if no excess replica can be > chos

[jira] [Commented] (HDFS-9047) deprecate libwebhdfs in branch-2; remove from trunk

[ https://issues.apache.org/jira/browse/HDFS-9047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15083445#comment-15083445 ] Junping Du commented on HDFS-9047: -- >From the discussion above (and HDFS-8346), I don't th

[jira] [Commented] (HDFS-8346) libwebhdfs build fails during link due to unresolved external symbols.

[ https://issues.apache.org/jira/browse/HDFS-8346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15083199#comment-15083199 ] Junping Du commented on HDFS-8346: -- Ok. Thanks for pushing it, [~kihwal]! > libwebhdfs bu

[jira] [Commented] (HDFS-8346) libwebhdfs build fails during link due to unresolved external symbols.

[ https://issues.apache.org/jira/browse/HDFS-8346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15082159#comment-15082159 ] Junping Du commented on HDFS-8346: -- So Kihwal, you are preferring to push HDFS-9047 (depre

[jira] [Commented] (HDFS-8346) libwebhdfs build fails during link due to unresolved external symbols.

[ https://issues.apache.org/jira/browse/HDFS-8346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15081516#comment-15081516 ] Junping Du commented on HDFS-8346: -- Thanks Chris for clarification on this. I agree that t

[jira] [Commented] (HDFS-9445) Datanode may deadlock while handling a bad volume

[ https://issues.apache.org/jira/browse/HDFS-9445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15081272#comment-15081272 ] Junping Du commented on HDFS-9445: -- Thanks [~kihwal] for reminding on this. I have ping Ch

[jira] [Commented] (HDFS-8346) libwebhdfs build fails during link due to unresolved external symbols.

[ https://issues.apache.org/jira/browse/HDFS-8346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15081268#comment-15081268 ] Junping Du commented on HDFS-8346: -- Hi [~cnauroth], do we need this fix in branch-2.6/bran

[jira] [Commented] (HDFS-9294) DFSClient deadlock when close file and failed to renew lease

[ https://issues.apache.org/jira/browse/HDFS-9294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15081208#comment-15081208 ] Junping Du commented on HDFS-9294: -- Thanks for your confirmation, Nicholas. I tried to che

[jira] [Updated] (HDFS-9445) Datanode may deadlock while handling a bad volume

[ https://issues.apache.org/jira/browse/HDFS-9445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9445: - Resolution: Fixed Fix Version/s: 2.6.4 Status: Resolved (was: Patch Available) I have me

[jira] [Updated] (HDFS-9445) Datanode may deadlock while handling a bad volume

[ https://issues.apache.org/jira/browse/HDFS-9445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9445: - Target Version/s: 2.7.2, 2.6.4 (was: 2.7.2) > Datanode may deadlock while handling a bad volume >

[jira] [Commented] (HDFS-9445) Datanode may deadlock while handling a bad volume

[ https://issues.apache.org/jira/browse/HDFS-9445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15080586#comment-15080586 ] Junping Du commented on HDFS-9445: -- Hi [~walter.k.su], [~vinayrpet] and [~kihwal], does th

[jira] [Updated] (HDFS-9294) DFSClient deadlock when close file and failed to renew lease

[ https://issues.apache.org/jira/browse/HDFS-9294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9294: - Target Version/s: 2.7.2, 2.6.4 (was: 2.7.2) > DFSClient deadlock when close file and failed to renew leas

[jira] [Commented] (HDFS-9294) DFSClient deadlock when close file and failed to renew lease

[ https://issues.apache.org/jira/browse/HDFS-9294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15080582#comment-15080582 ] Junping Du commented on HDFS-9294: -- Hi [~szetszwo] and [~brahmareddy], shall we cherry-pic

[jira] [Updated] (HDFS-8891) HDFS concat should keep srcs order

[ https://issues.apache.org/jira/browse/HDFS-8891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8891: - Target Version/s: 2.6.4 > HDFS concat should keep srcs order > -- > >

[jira] [Commented] (HDFS-8891) HDFS concat should keep srcs order

[ https://issues.apache.org/jira/browse/HDFS-8891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15080579#comment-15080579 ] Junping Du commented on HDFS-8891: -- Hi [~chris.douglas] and [~jingzhao], shall we cherry-p

[jira] [Updated] (HDFS-9220) Reading small file (< 512 bytes) that is open for append fails due to incorrect checksum

[ https://issues.apache.org/jira/browse/HDFS-9220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9220: - Target Version/s: 2.7.2, 2.6.4 (was: 2.7.2) > Reading small file (< 512 bytes) that is open for append fai

[jira] [Commented] (HDFS-9220) Reading small file (< 512 bytes) that is open for append fails due to incorrect checksum

[ https://issues.apache.org/jira/browse/HDFS-9220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15080570#comment-15080570 ] Junping Du commented on HDFS-9220: -- Hi [~jingzhao] and [~kihwal], shall we cherry-pick the

[jira] [Commented] (HDFS-6945) BlockManager should remove a block from excessReplicateMap and decrement ExcessBlocks metric when the block is removed

[ https://issues.apache.org/jira/browse/HDFS-6945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15080567#comment-15080567 ] Junping Du commented on HDFS-6945: -- I have cherry-pick the patch to branch-2.6. > BlockMa

[jira] [Updated] (HDFS-6945) BlockManager should remove a block from excessReplicateMap and decrement ExcessBlocks metric when the block is removed

[ https://issues.apache.org/jira/browse/HDFS-6945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-6945: - Target Version/s: 2.8.0, 2.6.4 (was: 2.8.0) > BlockManager should remove a block from excessReplicateMap a

[jira] [Updated] (HDFS-6945) BlockManager should remove a block from excessReplicateMap and decrement ExcessBlocks metric when the block is removed

[ https://issues.apache.org/jira/browse/HDFS-6945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-6945: - Fix Version/s: 2.6.4 > BlockManager should remove a block from excessReplicateMap and decrement > ExcessBl

[jira] [Commented] (HDFS-7645) Rolling upgrade is restoring blocks from trash multiple times

[ https://issues.apache.org/jira/browse/HDFS-7645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15080559#comment-15080559 ] Junping Du commented on HDFS-7645: -- Hi [~kihwal], do you suggest we should backport these

[jira] [Commented] (HDFS-8676) Delayed rolling upgrade finalization can cause heartbeat expiration and write failures

[ https://issues.apache.org/jira/browse/HDFS-8676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15080557#comment-15080557 ] Junping Du commented on HDFS-8676: -- Hi [~walter.k.su] and [~kihwal], I tried to cherry-pic

[jira] [Updated] (HDFS-8676) Delayed rolling upgrade finalization can cause heartbeat expiration and write failures

[ https://issues.apache.org/jira/browse/HDFS-8676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8676: - Target Version/s: 2.7.2, 2.6.4 (was: 2.7.2) > Delayed rolling upgrade finalization can cause heartbeat exp

[jira] [Updated] (HDFS-8767) RawLocalFileSystem.listStatus() returns null for UNIX pipefile

[ https://issues.apache.org/jira/browse/HDFS-8767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8767: - Target Version/s: 2.7.2, 2.6.4 > RawLocalFileSystem.listStatus() returns null for UNIX pipefile > -

[jira] [Commented] (HDFS-8767) RawLocalFileSystem.listStatus() returns null for UNIX pipefile

[ https://issues.apache.org/jira/browse/HDFS-8767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15080554#comment-15080554 ] Junping Du commented on HDFS-8767: -- Hi [~wheat9] and [~cnauroth], does this fix should lan

[jira] [Updated] (HDFS-8995) Flaw in registration bookeeping can make DN die on reconnect

[ https://issues.apache.org/jira/browse/HDFS-8995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8995: - Target Version/s: 2.7.2, 2.6.4 (was: 2.7.2) > Flaw in registration bookeeping can make DN die on reconnect

[jira] [Commented] (HDFS-8995) Flaw in registration bookeeping can make DN die on reconnect

[ https://issues.apache.org/jira/browse/HDFS-8995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15080553#comment-15080553 ] Junping Du commented on HDFS-8995: -- Hi [~hitliuyi] and [~kihwal], as Sangjin's comments ea

[jira] [Updated] (HDFS-9106) Transfer failure during pipeline recovery causes permanent write failures

[ https://issues.apache.org/jira/browse/HDFS-9106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9106: - Target Version/s: 2.8.0, 2.6.4 (was: 2.8.0) > Transfer failure during pipeline recovery causes permanent w

[jira] [Commented] (HDFS-9106) Transfer failure during pipeline recovery causes permanent write failures

[ https://issues.apache.org/jira/browse/HDFS-9106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15080549#comment-15080549 ] Junping Du commented on HDFS-9106: -- Hi [~hitliuyi], [~jingzhao] and [~kihwal], do we think

[jira] [Updated] (HDFS-9178) Slow datanode I/O can cause a wrong node to be marked bad

[ https://issues.apache.org/jira/browse/HDFS-9178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9178: - Target Version/s: 2.7.2, 2.6.4 (was: 2.7.2) > Slow datanode I/O can cause a wrong node to be marked bad >

[jira] [Commented] (HDFS-9178) Slow datanode I/O can cause a wrong node to be marked bad

[ https://issues.apache.org/jira/browse/HDFS-9178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15080547#comment-15080547 ] Junping Du commented on HDFS-9178: -- Hi [~kihwal], I saw you already attached the patch for

[jira] [Commented] (HDFS-8722) Optimize datanode writes for small writes and flushes

[ https://issues.apache.org/jira/browse/HDFS-8722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15080543#comment-15080543 ] Junping Du commented on HDFS-8722: -- Hi [~kihwal], shall we backport the fix to 2.6 branch

[jira] [Updated] (HDFS-8722) Optimize datanode writes for small writes and flushes

[ https://issues.apache.org/jira/browse/HDFS-8722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8722: - Target Version/s: 2.7.2, 2.6.4 (was: 2.7.2) > Optimize datanode writes for small writes and flushes >

[jira] [Updated] (HDFS-4660) Block corruption can happen during pipeline recovery

[ https://issues.apache.org/jira/browse/HDFS-4660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4660: - Target Version/s: 2.7.1, 2.6.4 (was: 2.7.1) > Block corruption can happen during pipeline recovery > -

[jira] [Commented] (HDFS-4660) Block corruption can happen during pipeline recovery

[ https://issues.apache.org/jira/browse/HDFS-4660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15080542#comment-15080542 ] Junping Du commented on HDFS-4660: -- Hi [~kihwal], shall we backport this patch to 2.6.x br

[jira] [Commented] (HDFS-9470) Encryption zone on root not loaded from fsimage after NN restart

[ https://issues.apache.org/jira/browse/HDFS-9470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15070296#comment-15070296 ] Junping Du commented on HDFS-9470: -- Hi [~vinodkv], this should be cherry-pick to latest 2.

[jira] [Commented] (HDFS-8791) block ID-based DN storage layout can be very slow for datanode on ext4

[ https://issues.apache.org/jira/browse/HDFS-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15051195#comment-15051195 ] Junping Du commented on HDFS-8791: -- Working on 2.6.3-RC0 now, move it out to 2.6.4. > blo

[jira] [Updated] (HDFS-8791) block ID-based DN storage layout can be very slow for datanode on ext4

[ https://issues.apache.org/jira/browse/HDFS-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8791: - Target Version/s: 2.8.0, 2.7.3, 2.6.4 (was: 2.8.0, 2.7.3, 2.6.3) > block ID-based DN storage layout can be

[jira] [Updated] (HDFS-9263) tests are using /test/build/data; breaking Jenkins

[ https://issues.apache.org/jira/browse/HDFS-9263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9263: - Target Version/s: 3.0.0, 2.7.3, 2.6.4 (was: 3.0.0, 2.7.3, 2.6.3) > tests are using /test/build/data; break

[jira] [Commented] (HDFS-9263) tests are using /test/build/data; breaking Jenkins

[ https://issues.apache.org/jira/browse/HDFS-9263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15051198#comment-15051198 ] Junping Du commented on HDFS-9263: -- Move it out to 2.6.4 given the JIRA is not updated for

[jira] [Updated] (HDFS-9500) datanodesSoftwareVersions map may counting wrong when rolling upgrade

[ https://issues.apache.org/jira/browse/HDFS-9500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9500: - Target Version/s: 2.7.2, 2.6.4 (was: 2.7.2, 2.6.3) > datanodesSoftwareVersions map may counting wrong when

[jira] [Commented] (HDFS-9500) datanodesSoftwareVersions map may counting wrong when rolling upgrade

[ https://issues.apache.org/jira/browse/HDFS-9500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15037832#comment-15037832 ] Junping Du commented on HDFS-9500: -- Moving non-blocker/non-critical issues out of 2.6.3 in

[jira] [Commented] (HDFS-8791) block ID-based DN storage layout can be very slow for datanode on ext4

[ https://issues.apache.org/jira/browse/HDFS-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15035938#comment-15035938 ] Junping Du commented on HDFS-8791: -- Mark this as blocker per comments from [~jrottinghuis]

[jira] [Updated] (HDFS-8791) block ID-based DN storage layout can be very slow for datanode on ext4

[ https://issues.apache.org/jira/browse/HDFS-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8791: - Priority: Blocker (was: Critical) > block ID-based DN storage layout can be very slow for datanode on ext4

[jira] [Commented] (HDFS-8791) block ID-based DN storage layout can be very slow for datanode on ext4

[ https://issues.apache.org/jira/browse/HDFS-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15034931#comment-15034931 ] Junping Du commented on HDFS-8791: -- bq. If you want to pull this in 2.6.3, it might make s

[jira] [Updated] (HDFS-8870) Lease is leaked on write failure

[ https://issues.apache.org/jira/browse/HDFS-8870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8870: - Target Version/s: 2.7.3, 2.6.4 (was: 2.7.3, 2.6.3) > Lease is leaked on write failure > --

[jira] [Commented] (HDFS-8870) Lease is leaked on write failure

[ https://issues.apache.org/jira/browse/HDFS-8870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15033819#comment-15033819 ] Junping Du commented on HDFS-8870: -- Move it to 2.6.4 as the JIRA haven't been update for a

[jira] [Commented] (HDFS-8791) block ID-based DN storage layout can be very slow for datanode on ext4

[ https://issues.apache.org/jira/browse/HDFS-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032187#comment-15032187 ] Junping Du commented on HDFS-8791: -- bq. I think it's important to cherry-pick this patch t

[jira] [Commented] (HDFS-8871) Decommissioning of a node with a failed volume may not start

[ https://issues.apache.org/jira/browse/HDFS-8871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032172#comment-15032172 ] Junping Du commented on HDFS-8871: -- Moving this to 2.6.4 as no update for a while. > Deco

[jira] [Updated] (HDFS-8871) Decommissioning of a node with a failed volume may not start

[ https://issues.apache.org/jira/browse/HDFS-8871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8871: - Target Version/s: 2.7.3, 2.6.4 (was: 2.7.3, 2.6.3) > Decommissioning of a node with a failed volume may no

[jira] [Commented] (HDFS-9263) tests are using /test/build/data; breaking Jenkins

[ https://issues.apache.org/jira/browse/HDFS-9263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15030121#comment-15030121 ] Junping Du commented on HDFS-9263: -- Hi, can we move this out of 2.6.3? Thanks! > tests ar

[jira] [Commented] (HDFS-9470) Encryption zone on root not loaded from fsimage after NN restart

[ https://issues.apache.org/jira/browse/HDFS-9470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15030118#comment-15030118 ] Junping Du commented on HDFS-9470: -- Hi, can we move this out of 2.6.3? Thanks! > Encrypti

[jira] [Commented] (HDFS-8871) Decommissioning of a node with a failed volume may not start

[ https://issues.apache.org/jira/browse/HDFS-8871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15030117#comment-15030117 ] Junping Du commented on HDFS-8871: -- Hi, can we move this out of 2.6.3? Thanks! > Decommis

[jira] [Commented] (HDFS-8870) Lease is leaked on write failure

[ https://issues.apache.org/jira/browse/HDFS-8870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15030111#comment-15030111 ] Junping Du commented on HDFS-8870: -- Hi, can we move this out of 2.6.3? Thanks! > Lease is

[jira] [Commented] (HDFS-9314) Improve BlockPlacementPolicyDefault's picking of excess replicas

[ https://issues.apache.org/jira/browse/HDFS-9314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15024715#comment-15024715 ] Junping Du commented on HDFS-9314: -- Filed HDFS-9456. > Improve BlockPlacementPolicyDefaul

[jira] [Created] (HDFS-9456) BlockPlacementPolicyWithNodeGroup should override verifyBlockPlacement() from BlockPlacementPolicyDefault.

Junping Du created HDFS-9456: Summary: BlockPlacementPolicyWithNodeGroup should override verifyBlockPlacement() from BlockPlacementPolicyDefault. Key: HDFS-9456 URL: https://issues.apache.org/jira/browse/HDFS-9456

[jira] [Commented] (HDFS-9314) Improve BlockPlacementPolicyDefault's picking of excess replicas

[ https://issues.apache.org/jira/browse/HDFS-9314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15024385#comment-15024385 ] Junping Du commented on HDFS-9314: -- Let's keep BlockPlacementPolicyWithNodeGroup#pickupRep

[jira] [Commented] (HDFS-6261) Document for enabling node group layer in HDFS

[ https://issues.apache.org/jira/browse/HDFS-6261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14569020#comment-14569020 ] Junping Du commented on HDFS-6261: -- Thanks [~decster] for updating the patch and [~aw] for

[jira] [Commented] (HDFS-7613) Block placement policy for erasure coding groups

[ https://issues.apache.org/jira/browse/HDFS-7613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14517015#comment-14517015 ] Junping Du commented on HDFS-7613: -- Thanks [~zhz], the multi-policies implementation here

[jira] [Commented] (HDFS-7613) Block placement policy for erasure coding groups

[ https://issues.apache.org/jira/browse/HDFS-7613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14514046#comment-14514046 ] Junping Du commented on HDFS-7613: -- Thanks guys for good discussions above. For support fo

[jira] [Commented] (HDFS-6261) Add document for enabling node group layer in HDFS

[ https://issues.apache.org/jira/browse/HDFS-6261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14376969#comment-14376969 ] Junping Du commented on HDFS-6261: -- Hi [~decster], given HADOOP-11495 is already get commi

[jira] [Commented] (HDFS-6261) Add document for enabling node group layer in HDFS

[ https://issues.apache.org/jira/browse/HDFS-6261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306543#comment-14306543 ] Junping Du commented on HDFS-6261: -- Sounds like a reasonable plan, [~decster]! I may need

[jira] [Commented] (HDFS-4989) Balancer needs to consider storage type in balancing

[ https://issues.apache.org/jira/browse/HDFS-4989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14285320#comment-14285320 ] Junping Du commented on HDFS-4989: -- [~arpitagarwal], sounds good! Please feel free to clos

[jira] [Commented] (HDFS-6506) Newly moved block replica been invalidated and deleted in TestBalancer

[ https://issues.apache.org/jira/browse/HDFS-6506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14088807#comment-14088807 ] Junping Du commented on HDFS-6506: -- Sorry for late response. Patch looks good to me in ove

[jira] [Commented] (HDFS-6506) Newly moved block replica been invalidated and deleted in TestBalancer

[ https://issues.apache.org/jira/browse/HDFS-6506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14061614#comment-14061614 ] Junping Du commented on HDFS-6506: -- Sure. I will be around to review soon. Thanks, Binglin

[jira] [Commented] (HDFS-6159) TestBalancerWithNodeGroup.testBalancerWithNodeGroup fails if there is block missing after balancer success

[ https://issues.apache.org/jira/browse/HDFS-6159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14021641#comment-14021641 ] Junping Du commented on HDFS-6159: -- Thanks [~decster] for investigation on it. I will ping

[jira] [Commented] (HDFS-6362) InvalidateBlocks is inconsistent in usage of DatanodeUuid and StorageID

[ https://issues.apache.org/jira/browse/HDFS-6362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14021639#comment-14021639 ] Junping Du commented on HDFS-6362: -- Hi [~arpitagarwal], I saw TestBalancerWithNodeGroup fa

[jira] [Updated] (HDFS-6500) Snapshot shouldn't be removed silently after renaming to an existing snapshot

[ https://issues.apache.org/jira/browse/HDFS-6500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-6500: - Resolution: Fixed Fix Version/s: 2.5.0 Hadoop Flags: Reviewed Status: Resolved (was

[jira] [Commented] (HDFS-6500) Snapshot shouldn't be removed silently after renaming to an existing snapshot

[ https://issues.apache.org/jira/browse/HDFS-6500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14021127#comment-14021127 ] Junping Du commented on HDFS-6500: -- +1. Patch looks good to me. Will commit it shortly. >

<    1   2   3   4   5   6   7   8   9   10   >