[jira] [Updated] (HDFS-8970) Clean up checkstyle warnings in shortcircuit package

2015-08-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-8970: Description: We moved the {{shortcircuit}} package from {{hadoop-hdfs}} to {{hadoop-hdfs-client}} mo

[jira] [Created] (HDFS-8979) Clean up checkstyle warnings in o.a.h.hdfs.client package

2015-08-27 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-8979: --- Summary: Clean up checkstyle warnings in o.a.h.hdfs.client package Key: HDFS-8979 URL: https://issues.apache.org/jira/browse/HDFS-8979 Project: Hadoop HDFS Iss

[jira] [Commented] (HDFS-8979) Clean up checkstyle warnings in o.a.h.hdfs.client package

2015-08-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14717144#comment-14717144 ] Mingliang Liu commented on HDFS-8979: - We can fix this after moving {{BlockReader}} to

[jira] [Updated] (HDFS-8938) Refactor BlockManager in blockmanagement

2015-08-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-8938: Attachment: HDFS-8938.006.patch > Refactor BlockManager in blockmanagement >

[jira] [Updated] (HDFS-8925) Move BlockReader to hdfs-client

2015-08-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-8925: Attachment: HDFS-8925.001.patch > Move BlockReader to hdfs-client > --- >

[jira] [Commented] (HDFS-8971) Remove guards when calling LOG.debug() and LOG.trace() in shortcircuit package

2015-08-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14717430#comment-14717430 ] Mingliang Liu commented on HDFS-8971: - We can fix this after moving {{BlockReader}} to

[jira] [Updated] (HDFS-8971) Remove guards when calling LOG.debug() and LOG.trace() in client package

2015-08-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-8971: Summary: Remove guards when calling LOG.debug() and LOG.trace() in client package (was: Remove guard

[jira] [Updated] (HDFS-8971) Remove guards when calling LOG.debug() and LOG.trace() in client package

2015-08-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-8971: Description: We moved the {{shortcircuit}} package from {{hadoop-hdfs}} to {{hadoop-hdfs-client}} mo

[jira] [Updated] (HDFS-8938) Refactor BlockManager in blockmanagement

2015-08-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-8938: Attachment: HDFS-8938.007.PATCH > Refactor BlockManager in blockmanagement >

[jira] [Updated] (HDFS-8938) Refactor BlockManager in blockmanagement

2015-08-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-8938: Attachment: (was: HDFS-8938.007.PATCH) > Refactor BlockManager in blockmanagement > -

[jira] [Updated] (HDFS-8938) Refactor BlockManager in blockmanagement

2015-08-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-8938: Attachment: HDFS-8938.007.patch > Refactor BlockManager in blockmanagement >

[jira] [Commented] (HDFS-8938) Refactor BlockManager in blockmanagement

2015-08-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14717651#comment-14717651 ] Mingliang Liu commented on HDFS-8938: - The failing tests {code} hadoop.hdfs.server.bloc

[jira] [Commented] (HDFS-8938) Extract BlockToMarkCorrupt and ReplicationWork as standalone classes from BlockManager

2015-08-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14717679#comment-14717679 ] Mingliang Liu commented on HDFS-8938: - Thanks [~wheat9] ! I hope we'll see no more Jen

[jira] [Updated] (HDFS-8925) Move BlockReader to hdfs-client

2015-08-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-8925: Attachment: HDFS-8925.002.patch > Move BlockReader to hdfs-client > --- >

[jira] [Updated] (HDFS-8938) Extract BlockToMarkCorrupt and ReplicationWork as standalone classes from BlockManager

2015-08-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-8938: Attachment: HDFS-8938.008.patch V8 patch removed the newly brought trailing whitespace as [~wheat9] s

[jira] [Commented] (HDFS-8971) Remove guards when calling LOG.debug() and LOG.trace() in client package

2015-08-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14717936#comment-14717936 ] Mingliang Liu commented on HDFS-8971: - Thanks [~walter.k.su]! I'll also change the log

[jira] [Created] (HDFS-8990) Move RemoteBlockReader to hdfs-client module

2015-08-28 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-8990: --- Summary: Move RemoteBlockReader to hdfs-client module Key: HDFS-8990 URL: https://issues.apache.org/jira/browse/HDFS-8990 Project: Hadoop HDFS Issue Type: Sub-

[jira] [Updated] (HDFS-8990) Move RemoteBlockReader to hdfs-client module

2015-08-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-8990: Fix Version/s: (was: 2.8.0) > Move RemoteBlockReader to hdfs-client module >

[jira] [Updated] (HDFS-8990) Move RemoteBlockReader to hdfs-client module

2015-08-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-8990: Hadoop Flags: (was: Reviewed) > Move RemoteBlockReader to hdfs-client module >

[jira] [Updated] (HDFS-8990) Move RemoteBlockReader to hdfs-client module

2015-08-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-8990: Description: This jira tracks the effort of moving the {{RemoteBlockReader}} class into the {{hdfs-cl

[jira] [Updated] (HDFS-8990) Move RemoteBlockReader to hdfs-client module

2015-08-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-8990: Description: This jira tracks the effort of moving the {{RemoteBlockReader}} class into the {{hdfs-c

[jira] [Updated] (HDFS-8990) Move RemoteBlockReader to hdfs-client module

2015-08-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-8990: Description: This jira tracks the effort of moving the {{RemoteBlockReader}} class into the {{hdfs-c

[jira] [Updated] (HDFS-8990) Move RemoteBlockReader to hdfs-client module

2015-08-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-8990: Attachment: HDFS-8990.000.patch The v0 patch moves the {{RemoteBlockReader}} and {{RemoteBlockReader2

[jira] [Updated] (HDFS-8990) Move RemoteBlockReader to hdfs-client module

2015-08-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-8990: Attachment: HDFS-8990.001.patch > Move RemoteBlockReader to hdfs-client module >

[jira] [Commented] (HDFS-8990) Move RemoteBlockReader to hdfs-client module

2015-08-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720812#comment-14720812 ] Mingliang Liu commented on HDFS-8990: - Thanks [~wheat9]! The wrong constant typo was b

[jira] [Updated] (HDFS-8990) Move RemoteBlockReader to hdfs-client module

2015-08-29 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-8990: Status: Patch Available (was: Open) > Move RemoteBlockReader to hdfs-client module > ---

[jira] [Updated] (HDFS-8990) Move RemoteBlockReader to hdfs-client module

2015-08-30 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-8990: Attachment: HDFS-8990.002.patch > Move RemoteBlockReader to hdfs-client module >

[jira] [Commented] (HDFS-11719) Arrays.fill() wrong index in BlockSender.readChecksum() exception handling

2018-09-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16615615#comment-16615615 ] Mingliang Liu commented on HDFS-11719: -- +1 Rebasing the patch and re-submitting it.

[jira] [Updated] (HDFS-11719) Arrays.fill() wrong index in BlockSender.readChecksum() exception handling

2018-09-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11719: - Attachment: HADOOP-11719.002.patch > Arrays.fill() wrong index in BlockSender.readChecksum() exce

[jira] [Assigned] (HDFS-11719) Arrays.fill() wrong index in BlockSender.readChecksum() exception handling

2018-09-16 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu reassigned HDFS-11719: Assignee: Mingliang Liu (was: Tao Zhang) > Arrays.fill() wrong index in BlockSender.readC

[jira] [Updated] (HDFS-11719) Arrays.fill() wrong index in BlockSender.readChecksum() exception handling

2018-09-16 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11719: - Status: Patch Available (was: In Progress) > Arrays.fill() wrong index in BlockSender.readChecks

[jira] [Assigned] (HDFS-11719) Arrays.fill() wrong index in BlockSender.readChecksum() exception handling

2018-09-16 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu reassigned HDFS-11719: Assignee: Tao Zhang (was: Mingliang Liu) > Arrays.fill() wrong index in BlockSender.readC

[jira] [Updated] (HDFS-11719) Arrays.fill() wrong index in BlockSender.readChecksum() exception handling

2018-09-17 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11719: - Attachment: HADOOP-11719.003.patch > Arrays.fill() wrong index in BlockSender.readChecksum() exce

[jira] [Commented] (HDFS-11719) Arrays.fill() wrong index in BlockSender.readChecksum() exception handling

2018-09-17 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16618253#comment-16618253 ] Mingliang Liu commented on HDFS-11719: -- Failing tests are not related. This is to fi

[jira] [Updated] (HDFS-11719) Arrays.fill() wrong index in BlockSender.readChecksum() exception handling

2018-09-18 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11719: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.1.2 3.2.0

[jira] [Assigned] (HDFS-15281) ZKFC ignores dfs.namenode.rpc-bind-host and uses dfs.namenode.rpc-address to bind to host address

2020-04-17 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu reassigned HDFS-15281: Assignee: Dhiraj Hegde > ZKFC ignores dfs.namenode.rpc-bind-host and uses dfs.namenode.rpc

[jira] [Updated] (HDFS-15281) ZKFC ignores dfs.namenode.rpc-bind-host and uses dfs.namenode.rpc-address to bind to host address

2020-04-17 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-15281: - Fix Version/s: (was: 2.10.1) (was: 3.2.2)

[jira] [Commented] (HDFS-15278) After execute ‘-setrep 1’, make sure that blocks of the file are dispersed across different datanodes

2020-04-17 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17086241#comment-17086241 ] Mingliang Liu commented on HDFS-15278: -- What about balancer which moves data around?

[jira] [Commented] (HDFS-15276) Concat on INodeRefernce fails with illegal state exception

2020-04-17 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17086287#comment-17086287 ] Mingliang Liu commented on HDFS-15276: -- So the problem here is we should not compare

[jira] [Commented] (HDFS-15276) Concat on INodeRefernce fails with illegal state exception

2020-04-17 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17086288#comment-17086288 ] Mingliang Liu commented on HDFS-15276: -- CC: [~arpaga] > Concat on INodeRefernce fai

[jira] [Commented] (HDFS-15276) Concat on INodeRefernce fails with illegal state exception

2020-04-19 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17087335#comment-17087335 ] Mingliang Liu commented on HDFS-15276: -- +1 Test failures seem unrelated. I'll commi

[jira] [Commented] (HDFS-15278) After execute ‘-setrep 1’, make sure that blocks of the file are dispersed across different datanodes

2020-04-19 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17087368#comment-17087368 ] Mingliang Liu commented on HDFS-15278: -- This is interesting use case and feature pro

[jira] [Commented] (HDFS-15281) ZKFC ignores dfs.namenode.rpc-bind-host and uses dfs.namenode.rpc-address to bind to host address

2020-04-19 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17087399#comment-17087399 ] Mingliang Liu commented on HDFS-15281: -- I'm +1 on this idea. I'll leave comments in

[jira] [Comment Edited] (HDFS-15281) ZKFC ignores dfs.namenode.rpc-bind-host and uses dfs.namenode.rpc-address to bind to host address

2020-04-19 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17087399#comment-17087399 ] Mingliang Liu edited comment on HDFS-15281 at 4/20/20, 6:12 AM: ---

[jira] [Updated] (HDFS-15276) Concat on INodeRefernce fails with illegal state exception

2020-04-22 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-15276: - Fix Version/s: 3.4.0 2.10.1 3.2.2 3.1.4

[jira] [Created] (HDFS-15296) TestBPOfferService::testMissBlocksWhenReregister is flaky

2020-04-23 Thread Mingliang Liu (Jira)
Mingliang Liu created HDFS-15296: Summary: TestBPOfferService::testMissBlocksWhenReregister is flaky Key: HDFS-15296 URL: https://issues.apache.org/jira/browse/HDFS-15296 Project: Hadoop HDFS

[jira] [Created] (HDFS-15297) TestNNHandlesBlockReportPerStorage::blockReport_02 fails intermittently in trunk

2020-04-23 Thread Mingliang Liu (Jira)
Mingliang Liu created HDFS-15297: Summary: TestNNHandlesBlockReportPerStorage::blockReport_02 fails intermittently in trunk Key: HDFS-15297 URL: https://issues.apache.org/jira/browse/HDFS-15297 Projec

[jira] [Updated] (HDFS-15297) TestNNHandlesBlockReportPerStorage::blockReport_02 fails intermittently in trunk

2020-04-23 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-15297: - Issue Type: Bug (was: Improvement) > TestNNHandlesBlockReportPerStorage::blockReport_02 fails in

[jira] [Commented] (HDFS-15297) TestNNHandlesBlockReportPerStorage::blockReport_02 fails intermittently in trunk

2020-04-23 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17090977#comment-17090977 ] Mingliang Liu commented on HDFS-15297: -- Option seems good to me. Increasing wait tim

[jira] [Comment Edited] (HDFS-15297) TestNNHandlesBlockReportPerStorage::blockReport_02 fails intermittently in trunk

2020-04-23 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17090977#comment-17090977 ] Mingliang Liu edited comment on HDFS-15297 at 4/23/20, 10:35 PM: --

[jira] [Commented] (HDFS-15281) ZKFC ignores dfs.namenode.rpc-bind-host and uses dfs.namenode.rpc-address to bind to host address

2020-04-23 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17091065#comment-17091065 ] Mingliang Liu commented on HDFS-15281: -- OK, this report seems right. Checkstyle war

[jira] [Comment Edited] (HDFS-15281) ZKFC ignores dfs.namenode.rpc-bind-host and uses dfs.namenode.rpc-address to bind to host address

2020-04-23 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17091065#comment-17091065 ] Mingliang Liu edited comment on HDFS-15281 at 4/24/20, 1:06 AM: ---

[jira] [Comment Edited] (HDFS-15281) ZKFC ignores dfs.namenode.rpc-bind-host and uses dfs.namenode.rpc-address to bind to host address

2020-04-23 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17091065#comment-17091065 ] Mingliang Liu edited comment on HDFS-15281 at 4/24/20, 1:07 AM: ---

[jira] [Commented] (HDFS-15281) ZKFC ignores dfs.namenode.rpc-bind-host and uses dfs.namenode.rpc-address to bind to host address

2020-04-24 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17091939#comment-17091939 ] Mingliang Liu commented on HDFS-15281: -- +1 Will commit in 2 days if no more comment

[jira] [Commented] (HDFS-15297) TestNNHandlesBlockReportPerStorage::blockReport_02 fails intermittently in trunk

2020-04-24 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17092031#comment-17092031 ] Mingliang Liu commented on HDFS-15297: -- [~ayushtkn] I think the patch should work. T

[jira] [Assigned] (HDFS-15297) TestNNHandlesBlockReportPerStorage::blockReport_02 fails intermittently in trunk

2020-04-24 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu reassigned HDFS-15297: Assignee: Ayush Saxena > TestNNHandlesBlockReportPerStorage::blockReport_02 fails intermit

[jira] [Updated] (HDFS-15297) TestNNHandlesBlockReportPerStorage::blockReport_02 fails intermittently in trunk

2020-04-24 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-15297: - Component/s: datanode > TestNNHandlesBlockReportPerStorage::blockReport_02 fails intermittently i

[jira] [Updated] (HDFS-15281) ZKFC ignores dfs.namenode.rpc-bind-host and uses dfs.namenode.rpc-address to bind to host address

2020-04-25 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-15281: - Fix Version/s: 3.4.0 3.3.1 2.10.1 3.2.2

[jira] [Updated] (HDFS-15281) ZKFC ignores dfs.namenode.rpc-bind-host and uses dfs.namenode.rpc-address to bind to host address

2020-04-25 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-15281: - Component/s: ha Hadoop Flags: Reviewed > ZKFC ignores dfs.namenode.rpc-bind-host and uses df

[jira] [Commented] (HDFS-15281) ZKFC ignores dfs.namenode.rpc-bind-host and uses dfs.namenode.rpc-address to bind to host address

2020-04-25 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17092369#comment-17092369 ] Mingliang Liu commented on HDFS-15281: -- [~brahma] Just a kind reminder, if you need

[jira] [Commented] (HDFS-15297) TestNNHandlesBlockReportPerStorage::blockReport_02 fails intermittently in trunk

2020-04-25 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17092391#comment-17092391 ] Mingliang Liu commented on HDFS-15297: -- +1 after the checkstyle is fixed. > TestNNH

[jira] [Updated] (HDFS-15297) TestNNHandlesBlockReportPerStorage::blockReport_02 fails intermittently in trunk

2020-04-25 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-15297: - Fix Version/s: 3.4.0 3.3.1 2.10.1 3.2.2

[jira] [Created] (HDFS-14786) A new block placement policy tolerating availability zone failure

2019-08-27 Thread Mingliang Liu (Jira)
Mingliang Liu created HDFS-14786: Summary: A new block placement policy tolerating availability zone failure Key: HDFS-14786 URL: https://issues.apache.org/jira/browse/HDFS-14786 Project: Hadoop HDFS

[jira] [Commented] (HDFS-14786) A new block placement policy tolerating availability zone failure

2019-08-27 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16917325#comment-16917325 ] Mingliang Liu commented on HDFS-14786: -- Thoughts? [~apurtell] [~szetszwo] [~jojoch

[jira] [Updated] (HDFS-14786) A new block placement policy tolerating availability zone failure

2019-08-27 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-14786: - Description: {{NetworkTopology}} assumes "/datacenter/rack/host" 3 layer topology. Default block

[jira] [Updated] (HDFS-14786) A new block placement policy tolerating availability zone failure

2019-08-27 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-14786: - Description: {{NetworkTopology}} assumes "/datacenter/rack/host" 3 layer topology. Default block

[jira] [Commented] (HDFS-14786) A new block placement policy tolerating availability zone failure

2019-08-30 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16919931#comment-16919931 ] Mingliang Liu commented on HDFS-14786: -- [~surendrasingh] For now in public cloud, th

[jira] [Commented] (HDFS-14786) A new block placement policy tolerating availability zone failure

2019-08-30 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16919947#comment-16919947 ] Mingliang Liu commented on HDFS-14786: -- [~ste...@apache.org] This is new to me. Glad

[jira] [Created] (HDFS-15324) TestRefreshCallQueue::testRefresh fails intermittently

2020-05-02 Thread Mingliang Liu (Jira)
Mingliang Liu created HDFS-15324: Summary: TestRefreshCallQueue::testRefresh fails intermittently Key: HDFS-15324 URL: https://issues.apache.org/jira/browse/HDFS-15324 Project: Hadoop HDFS Is

[jira] [Commented] (HDFS-13179) TestLazyPersistReplicaRecovery#testDnRestartWithSavedReplicas fails intermittently

2020-05-02 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17098085#comment-17098085 ] Mingliang Liu commented on HDFS-13179: -- Seeing this is still happening in {{trunk}} 

[jira] [Created] (HDFS-15326) TestDataNodeErasureCodingMetrics::testFullBlock fails intermittently

2020-05-02 Thread Mingliang Liu (Jira)
Mingliang Liu created HDFS-15326: Summary: TestDataNodeErasureCodingMetrics::testFullBlock fails intermittently Key: HDFS-15326 URL: https://issues.apache.org/jira/browse/HDFS-15326 Project: Hadoop HD

[jira] [Commented] (HDFS-15325) TestRefreshCallQueue is failing due to changed CallQueue constructor

2020-05-02 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17098099#comment-17098099 ] Mingliang Liu commented on HDFS-15325: -- Yeah, Thanks [~ayushtkn]. [~shv] and I file

[jira] [Resolved] (HDFS-15324) TestRefreshCallQueue::testRefresh fails intermittently

2020-05-02 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu resolved HDFS-15324. -- Resolution: Duplicate > TestRefreshCallQueue::testRefresh fails intermittently > --

[jira] [Closed] (HDFS-15324) TestRefreshCallQueue::testRefresh fails intermittently

2020-05-02 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu closed HDFS-15324. > TestRefreshCallQueue::testRefresh fails intermittently >

[jira] [Updated] (HDFS-15320) StringIndexOutOfBoundsException in HostRestrictingAuthorizationFilter

2020-05-02 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-15320: - Fix Version/s: 3.4.0 3.3.1 Hadoop Flags: Reviewed Resolution: Fixed

[jira] [Commented] (HDFS-15325) TestRefreshCallQueue is failing due to changed CallQueue constructor

2020-05-02 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17098149#comment-17098149 ] Mingliang Liu commented on HDFS-15325: -- +1. Will commit after a clean QA.  > TestR

[jira] [Updated] (HDFS-15325) TestRefreshCallQueue is failing due to changed CallQueue constructor

2020-05-02 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-15325: - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Status: Resol

[jira] [Updated] (HDFS-15326) TestDataNodeErasureCodingMetrics::testFullBlock fails intermittently

2020-05-02 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-15326: - Issue Type: Bug (was: Test) > TestDataNodeErasureCodingMetrics::testFullBlock fails intermittent

[jira] [Updated] (HDFS-15326) TestDataNodeErasureCodingMetrics::testFullBlock fails intermittently

2020-05-02 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-15326: - Component/s: erasure-coding > TestDataNodeErasureCodingMetrics::testFullBlock fails intermittentl

[jira] [Created] (HDFS-15327) TestDataNodeErasureCodingMetrics.testReconstructionBytesPartialGroup3 fails intermittently

2020-05-02 Thread Mingliang Liu (Jira)
Mingliang Liu created HDFS-15327: Summary: TestDataNodeErasureCodingMetrics.testReconstructionBytesPartialGroup3 fails intermittently Key: HDFS-15327 URL: https://issues.apache.org/jira/browse/HDFS-15327

[jira] [Updated] (HDFS-15326) TestDataNodeErasureCodingMetrics::testFullBlock fails intermittently

2020-05-02 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-15326: - Description: Sample failing build: https://builds.apache.org/job/hadoop-multibranch/job/PR-1992/

[jira] [Commented] (HDFS-15327) TestDataNodeErasureCodingMetrics.testReconstructionBytesPartialGroup3 fails intermittently

2020-05-02 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17098214#comment-17098214 ] Mingliang Liu commented on HDFS-15327: -- Might be related to HDFS-15326. Linking it h

[jira] [Assigned] (HDFS-15379) DataStreamer should reset thread interrupted state in createBlockOutputStream

2020-06-03 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu reassigned HDFS-15379: Assignee: ludun > DataStreamer should reset thread interrupted state in createBlockOutputS

[jira] [Commented] (HDFS-15379) DataStreamer should reset thread interrupted state in createBlockOutputStream

2020-06-03 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17124697#comment-17124697 ] Mingliang Liu commented on HDFS-15379: -- Added you to contributor list and assigned t

[jira] [Commented] (HDFS-15377) BlockScanner scans one part per round, expect full scans after several rounds

2020-06-03 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17124705#comment-17124705 ] Mingliang Liu commented on HDFS-15377: -- Did not check the patch yet. Just curious, d

[jira] [Commented] (HDFS-15379) DataStreamer should reset thread interrupted state in createBlockOutputStream

2020-06-07 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17127534#comment-17127534 ] Mingliang Liu commented on HDFS-15379: -- Thanks [~pilchard] for filing this. I agree

[jira] [Commented] (HDFS-15391) Standby NameNode due loads the corruption edit log, the service exits and cannot be restarted

2020-06-13 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17134657#comment-17134657 ] Mingliang Liu commented on HDFS-15391: -- If I'm reading it correctly, I think this is

[jira] [Commented] (HDFS-15025) Applying NVDIMM storage media to HDFS

2020-07-21 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17162285#comment-17162285 ] Mingliang Liu commented on HDFS-15025: -- Good feature! Are the failing tests related?

[jira] [Created] (HDFS-15499) Exclude aws-java-sdk-bundle from httpfs

2020-07-29 Thread Mingliang Liu (Jira)
Mingliang Liu created HDFS-15499: Summary: Exclude aws-java-sdk-bundle from httpfs Key: HDFS-15499 URL: https://issues.apache.org/jira/browse/HDFS-15499 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-15499) Exclude aws-java-sdk-bundle from httpfs

2020-07-29 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-15499: - Description: In [HADOOP-14040] we use shaded aws-sdk uber-JAR for instead of s3 jar in hadoop-pro

[jira] [Updated] (HDFS-15499) Exclude aws-java-sdk-bundle from httpfs pom.xml

2020-07-29 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-15499: - Summary: Exclude aws-java-sdk-bundle from httpfs pom.xml (was: Exclude aws-java-sdk-bundle from

[jira] [Commented] (HDFS-15025) Applying NVDIMM storage media to HDFS

2020-08-03 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17170454#comment-17170454 ] Mingliang Liu commented on HDFS-15025: -- Overall the patch looks good. I do not have

[jira] [Comment Edited] (HDFS-15025) Applying NVDIMM storage media to HDFS

2020-08-03 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17170454#comment-17170454 ] Mingliang Liu edited comment on HDFS-15025 at 8/3/20, 10:24 PM: ---

[jira] [Updated] (HDFS-15499) Clean up httpfs/pom.xml to remove aws-java-sdk-s3 exclusion

2020-08-03 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-15499: - Summary: Clean up httpfs/pom.xml to remove aws-java-sdk-s3 exclusion (was: Exclude aws-java-sdk-

[jira] [Assigned] (HDFS-15499) Clean up httpfs/pom.xml to remove aws-java-sdk-s3 exclusion

2020-08-03 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu reassigned HDFS-15499: Assignee: Mingliang Liu > Clean up httpfs/pom.xml to remove aws-java-sdk-s3 exclusion > --

[jira] [Commented] (HDFS-15499) Clean up httpfs/pom.xml to remove aws-java-sdk-s3 exclusion

2020-08-03 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17170483#comment-17170483 ] Mingliang Liu commented on HDFS-15499: -- I did not find {{aws-java-sdk-s3}} included

[jira] [Updated] (HDFS-15499) Clean up httpfs/pom.xml to remove aws-java-sdk-s3 exclusion

2020-08-03 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-15499: - Status: Patch Available (was: Open) > Clean up httpfs/pom.xml to remove aws-java-sdk-s3 exclusio

[jira] [Assigned] (HDFS-15025) Applying NVDIMM storage media to HDFS

2020-08-04 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu reassigned HDFS-15025: Assignee: YaYun Wang > Applying NVDIMM storage media to HDFS > ---

[jira] [Commented] (HDFS-15508) [JDK 11] Fix javadoc errors in hadoop-hdfs-rbf module

2020-08-04 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17171173#comment-17171173 ] Mingliang Liu commented on HDFS-15508: -- +1 checkstyle is related but I think we nee

[jira] [Commented] (HDFS-15288) Add Available Space Rack Fault Tolerant BPP

2020-08-04 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17171182#comment-17171182 ] Mingliang Liu commented on HDFS-15288: -- Useful improvement! Do you mind adding a rel

<    5   6   7   8   9   10   11   12   13   14   >